JP2010210757A - Musical sound generating apparatus and musical sound generating program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate a musical sound waveform data based on vibration of a whole string of a stringed instrument, and based on vibration of the string which is excellent in response. <P>SOLUTION: A CPU 11 obtains image data of an image photographing area over a part where the string vibrates in a string stretch direction, which is photographed by a camera 16, and generates waveform data including a plurality of gain values, by using a displacement amount from a reference position in the vertical direction to the stretch direction of the string, as a gain value, and stores it in a waveform data area in a RAM 13. The CPU 11 reads the waveform data stored in the waveform data area in the RAM 13 at predetermined reading speed, and generates and outputs the musical sound waveform data. The musical sound waveform data are output from the loudspeaker 23 of a sound system 14. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a musical sound generating apparatus and a musical sound generating program for generating musical sounds based on string vibration of a stringed instrument.

  A technique is known in which a pitch is extracted from data based on a musical tone signal output from a stringed instrument such as a guitar, and output waveform data is generated and output based on the extracted pitch. For example, in Patent Document 1 and Patent Document 2, the pitch (pitch) and envelope of musical sound waveform data emitted from six strings of a guitar are extracted, and musical sound waveform data of a predetermined tone color is extracted from a ROM or the like. Reading is performed based on the extracted pitch, and an extracted envelope is given to generate new musical sound waveform data.

  In Patent Document 1, the input waveform data is filtered, the zero-cross point of the filtered waveform data is detected, the time when the waveform data takes a positive value is measured by a counter, and the waveform data The time for which takes a negative value is measured by another counter, the vibration of the fundamental wave of the string is detected by referring to both counter values, and the pitch of the waveform data is extracted.

Japanese Unexamined Patent Publication No. 63-298396 Japanese Patent Laid-Open No. 9-6351 JP-A-9-106274

  In particular, in a stringed instrument, the vibration of each picked string is detected as, for example, a magnetic fluctuation by a pickup, and converted into an electrical signal for output. Therefore, in the conventional pitch extraction, the electric signal obtained by the pickup is converted into digital data, and the converted data is used. Therefore, when multiple strings are picked and multiple strings vibrate, the effects of magnetic fluctuations due to vibrations of other strings are eliminated, and other string vibrations occur in the process of being converted to an electrical signal by the pickup. There is a risk of mixing signals based on. Due to such crosstalk, an accurate pitch may not be calculated in pitch extraction based on an electrical signal from the pickup. In addition, due to the influence of crosstalk, the period of the waveform data in the electrical signal detected by the pickup is not stable, and there is a problem that it may take time to extract the pitch. In addition, since the pitch is extracted based on the periodicity of the electric signal obtained by the pickup, the pitch cannot be extracted until the period is stabilized, and the response is not good.

  Further, in Patent Document 3, the pitch is not directly extracted, a fret switch is provided on the fingerboard of the neck of the stringed instrument, the pitch is determined by the turned on fret switch, and the vibration of the string is measured in each axial direction. There has been proposed an electronic stringed musical instrument that generates a musical tone that is detected by a sensor and that has a tone pitch determined by the sensor and that has a timbre characteristic changed by string vibration detected by the sensor. The electronic stringed instrument disclosed in Patent Document 3 is excellent in response because the pitch is designated by a fret switch. On the other hand, since the string vibration is different from the actual string vibration of a guitar, it is not easy to generate a musical sound that directly corresponds to a change in string vibration of a stringed instrument.

  An object of the present invention is to provide a musical sound generating apparatus and a musical sound generating program capable of generating musical sound waveform data based on the vibration of the entire string of a stringed instrument. Another object of the present invention is to provide a musical sound generating device and a musical sound generating program based on string vibration having excellent response.

An object of the present invention is a musical sound generator for generating a musical sound based on vibration of a string of a stringed instrument,
Image acquisition means for acquiring image data of an image capturing area over the vibrating portion of the string in the stringing direction;
Waveform data including a plurality of gain values in the string tension direction based on the image data obtained by the image acquisition means, with the amount of displacement from a reference position in a direction perpendicular to the string tension direction as a gain value Waveform data generating means for generating and storing in the waveform data area of the storage means;
It is achieved by a musical tone generator comprising: musical tone waveform data generating means for reading waveform data stored in the waveform data area at a predetermined reading speed and generating first musical tone waveform data. .

  In a preferred embodiment, the musical tone waveform data generating means reads the waveform data stored in the waveform data area at 1 / f (seconds) based on the input fundamental frequency f (Hz). The waveform data stored in the waveform data area is read.

  In a more preferred embodiment, the waveform data generating means generates waveform data such that the number N of samples of the waveform data is N = fs / f (fs: sampling frequency).

In another preferred embodiment, the storage device has a timbre waveform data area in which waveform data of a predetermined timbre is stored,
A musical tone waveform data generation means reads waveform data of the predetermined tone color in the tone color waveform data area based on the fundamental frequency, generates second tone waveform data, and generates the first tone waveform data and the first tone waveform data. Synthetic musical sound waveform data obtained by combining the two musical sound waveform data is generated.

  In still another preferred embodiment, the musical sound waveform data generating means synthesizes the second musical sound signal based on the string vibration output from the pickup and the first musical sound signal based on the first musical sound signal data. And output.

In a preferred embodiment, it has a plurality of waveform data areas,
When the waveform data generation means acquires new image data, a new waveform based on the new image data is displayed in another waveform data area where the waveform data is not read by the musical sound waveform data generation means. Store data,
The musical sound waveform data generation means starts reading the new waveform data from the other waveform data area when reading of the waveform data from one waveform data area from which the waveform data is being read is completed.

  In a more preferred embodiment, the musical tone waveform data generating means gradually decreases the level of the waveform data and terminates the reading of the waveform data from the one waveform data area and the other waveform data. The level of the new waveform data read from the area is gradually increased, and the waveform data and the new waveform data are synthesized and output.

Another object of the present invention is a musical sound generating program for generating a musical sound based on the vibration of a string of a stringed instrument.
An image acquisition step of acquiring image data of an image capturing region across the vibrating portion of the string in the stringing direction;
Waveform data including a plurality of gain values in the string stretching direction based on the image data obtained in the image acquisition step, with a displacement amount from a reference position in a direction perpendicular to the string stretching direction as a gain value Generating waveform data and storing it in the waveform data area of the storage means;
This is achieved by a musical tone generation program, wherein the waveform data stored in the waveform data area is read at a predetermined reading speed to generate a first musical tone waveform data step.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide the musical tone generator which can produce | generate the musical sound waveform data based on the vibration of the whole string of a stringed instrument, and a musical tone generation program. In addition, the present invention can provide a musical sound generating device and a musical sound generating program based on string vibration having excellent response.

FIG. 1 is a block diagram showing the configuration of a musical tone generator according to the first embodiment of the present invention. FIG. 2 is a diagram for explaining an arrangement example of guitar strings and cameras in the present embodiment. FIG. 3 is a flowchart showing a process executed by the musical tone generator according to the present embodiment. FIG. 4 is a flowchart illustrating an example of the read frequency setting process according to the present embodiment. FIG. 5 is a flowchart showing an example of waveform data generation processing according to the present embodiment. FIG. 6 is a diagram illustrating an example of the waveform data G (i) stored in the waveform data area. FIG. 7 is a flowchart showing an example of sound generation processing according to the embodiment of the present invention. FIG. 8 is a flowchart showing an example of the crossfade process according to the present embodiment. FIG. 9 is a diagram for explaining the cross fade according to the present embodiment. FIG. 10 is a flowchart showing an example of the mute process according to the present embodiment. FIG. 11 is a block diagram showing the configuration of the musical tone generator according to the second embodiment of the present invention. FIG. 12 is a flowchart illustrating an example of a sound generation process according to the second embodiment.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. FIG. 1 is a block diagram showing the configuration of a musical tone generator according to the first embodiment of the present invention. As shown in FIG. 1, a musical sound generating apparatus 10 according to this embodiment includes a CPU 11, a ROM 12, a RAM 13, a sound system 14, a display unit 15, a camera 16, an image data input interface (I / F) 17, and an operation unit 18. Is provided.

  The CPU 11 controls the entire tone generator 10, detects the operation of a switch (not shown) constituting the operation unit 18, activates the camera 16, and inputs image data to the RAM 13 via the image data input I / F 17. Various processes such as storage of sound, generation of waveform data based on image data, generation of musical sound waveform data based on waveform data, and the like are executed.

The ROM 12 detects the operation of the switch constituting the operation unit 18, stores the image data input through the image data input I / F 17 in the RAM 13, generates waveform data based on the image data, and musical sound waveform data based on the waveform data. Stores processing programs such as generating The ROM 12 includes a preset waveform data area for storing original waveform data (hereinafter referred to as “preset waveform data”) for generating musical sounds such as piano and guitar. The RAM 13 is read from the ROM 12. Stored programs and data generated during processing. Data generated in the course of processing includes image data obtained via an image data input I / F 17 described later, waveform data generated based on the image data, and the like.

  The sound system 14 includes a sound source unit 21, an audio circuit 22, and a speaker 23. The sound source unit 21 reads preset waveform data from the ROM 12 in accordance with an instruction from the CPU 11, generates musical tone waveform data, and outputs it. The audio circuit 22 converts the musical sound waveform data into an analog signal, amplifies the converted analog signal, and outputs it to the speaker 23. Thereby, an acoustic signal is output from the speaker 23.

  The image data input I / F 17 is connected to the camera 16, receives image data output from the camera 16, and stores the image data in a predetermined image data area of the RAM 13 in accordance with an instruction from the CPU 11. The camera 16 is disposed so as to face the strings of the guitar 25, and an almost entire image of each string can be obtained.

  FIG. 2 is a diagram for explaining an arrangement example of guitar strings and cameras in the present embodiment. As shown in FIG. 2, the camera 16 has six image capturing areas 30-1 to 30-6, and each sensor area 30-1 to 30-6 has a first string 26-1 to a first string of the guitar. An image including the 6th string 26-6 can be acquired. As the camera 16, for example, a CCD camera (Charge Coupled Device Image Sensor) can be used.

  As shown in FIG. 2, each of the image capturing regions 30-1 to 30-6 can capture images of the strings 26-1 to 26-6 from the nut 201 to the saddle 202 of the guitar 25. Actually, the neck of the guitar 25 includes a fret (see reference numerals 203 to 205), but the image data input I / F 17 or the CPU 11 determines the position of the fret in each of the image capturing areas 30-1 to 30-6. By obtaining in advance, it is possible to remove only the image of the image of the fret and extract only the string image. In the image data of each string, the position of the string is shown as a black dot, for example.

  Further, each of the image capturing areas 30-1 to 60-5 is only required to capture a portion of the string that vibrates in the extending direction of each of the strings 26-1 to 26-6. Therefore, when a predetermined fret (not shown) is pressed with a finger or the like, the image capturing area only needs to include a string portion from the fret pressed with the finger to the saddle. Therefore, when it is detected in the image data that a predetermined fret is pressed with a finger or the like, the CPU 11 may execute a process of recognizing the pressed fret to the saddle as an image capturing area.

  FIG. 3 is a flowchart showing a process executed by the musical tone generator according to the present embodiment. The CPU 11 of the tone generator 10 performs initialization processing including clearing, for example, image data temporarily stored in the RAM 13 and waveform data obtained by waveform generation processing and stored in a plurality of waveform data areas in the RAM 13. Perform (step 301). In the initialization process, a parameter j for designating a waveform data area to be described later is also initialized to “0”. When the initialization process (step 301) ends, the CPU 11 detects a switch operation of the operation unit 18 and executes a switch process for executing a process according to the detected operation (step 302).

  In the switch processing, for example, information for designating the type (tone color) of the preset waveform data stored in the preset waveform data area of the ROM 12 is stored in the RAM 13 in accordance with the operation of the tone color designation switch. In addition, according to the switch for setting the mix ratio, the musical sound waveform data (second musical sound waveform data) based on the preset waveform data and the musical sound generated based on the waveform data obtained in the waveform data generation process based on the image data Information indicating the mix ratio with the waveform data (first musical sound waveform data) is stored in the RAM 13. Furthermore, in the switch processing according to the present embodiment, the fundamental frequency that defines the frequency of the musical sound generated for each string is designated based on the operation of a predetermined switch by the player, and the designated fundamental frequency is Stored in the RAM 13.

  After the switch process (step 302), the CPU 11 executes a read frequency setting process (step 303). In the following read frequency setting processing (step 303), waveform data generation processing (step 304), sound generation processing (step 305), and mute processing (step 306), processing related to a single string will be described. In steps 303 to 306, the same processing is repeated for each of the six strings.

  FIG. 4 is a flowchart illustrating an example of the read frequency setting process according to the present embodiment. As shown in FIG. 4, in the switch process, the CPU 11 determines whether the fundamental frequency is input and information indicating the fundamental frequency is stored in the RAM 13 (step 401). When the fundamental frequency is input, the CPU 11 acquires the fundamental frequency f stored in the RAM 13 (step 402), and calculates the waveform data read time F = 1 / f (step 403). Further, the CPU 11 calculates the number of waveform data items (number of samples) N to be generated in the waveform data generation process based on N = fs / f (step 404). Note that fs is a sampling frequency. Thereafter, the CPU 11 secures a plurality of waveform data areas in the RAM 13 that can store waveform data for the number of samples (step 405). In the present embodiment, two waveform data areas are secured.

  For example, if the fundamental frequency is 440 Hz, the waveform data read time F = 1/440 seconds, and if the sampling frequency fs = 44 KHz, the number of samples N = 44000/440 = 100.

  When the read frequency setting process (step 303) ends, the CPU 11 executes a waveform data generation process (step 304). FIG. 5 is a flowchart showing an example of waveform data generation processing according to the present embodiment. As shown in FIG. 5, the CPU 11 instructs the camera 16 to capture an image, and the camera 16 captures each image capturing area in response to the instruction. The CPU 11 acquires image data of the image capturing area via the image data I / F 17 (step 502).

  The CPU 11 converts the obtained image data into a format of a displacement amount (gain G ′ (xi)) at a position xi on the X axis parallel to the string extending direction (step 503). In step 503, a predetermined value in the Y-axis direction in the image capturing area is set as a reference position, and at each position on the X-axis orthogonal to the Y-axis, how far away from the reference position in the Y-axis direction is placed on the string. It is detected whether there is a corresponding black dot, and the amount of displacement (distance) from the reference position is set as the position on the X axis (G ′ (xi)). As a result, n displacement amounts (gains) (G ′ (x0) to G ′ (xn)) corresponding to the number of pixels n in the x-axis direction can be obtained. It is parallel to the vertical direction of the installation direction.

Next, the CPU 11 converts the obtained n displacement amounts into image data G (0) to G (N-1) having a number of points equal to the number of samples N (step 504). For example, if the number of samples N and the number of data n obtained from image data are n = m × N (m is an integer),
So-called data thinning may be performed so that G ′ (i × m) = G (i). Alternatively, if N = m × n (m is an integer) between the number of samples N and the number of data n,
As G (i × m) = G ′ (i), values of other G (i) may be obtained by linear interpolation. Even when the relationship of the number of data cannot be expressed by the integer value m as described above, the gain G (i) can be obtained by using linear interpolation or the like.

  Thereafter, the CPU 11 determines whether or not the parameter j for designating the waveform data area is an even number (step 505). If it is determined Yes in step 505, the obtained gain G (i) (i = 0 to N-1) is stored in the waveform data area 0 (step 506). On the other hand, if No in step 506, that is, if the parameter j is an odd number, the gain G (i) (i = 0 to N−1) is stored in the waveform data area 1 (step 507). Thereafter, the CPU 11 increments the parameter j (step 508) and ends the process.

  FIG. 6 is a diagram illustrating an example of the waveform data G (i) stored in the waveform data area. As shown in FIG. 6, the waveform data 600 is a displacement (for example, G (0) (reference numeral 611), G (1) (reference numeral 612)) from the reference position 601 on the Y-axis, and N pieces of data (G (0) to G (N-1)).

  When the waveform data generation process (step 304) ends, the CPU 11 executes a sound generation process (step 305). FIG. 7 is a flowchart showing an example of sound generation processing according to the embodiment of the present invention. As shown in FIG. 7, the CPU 11 determines whether the vibration level of the string is equal to or higher than a predetermined value (step 701). In step 701, it may be determined whether the maximum displacement value Gmax of the waveform data stored in the waveform data area is equal to or greater than a predetermined value. Alternatively, it may be determined whether or not a string signal (original signal) output from a pickup (not shown) of the guitar 25 is equal to or higher than a predetermined level.

  When it is determined Yes in step 701, the CPU 11 gives an instruction to read preset waveform data of a predetermined tone color according to the fundamental frequency f according to the fundamental frequency f. The sound source unit 21 reads predetermined preset waveform data at a reading speed based on the fundamental frequency f in accordance with the instruction (step 702). Thereby, the second musical sound waveform data having a pitch according to the reference frequency f based on the preset waveform data can be obtained.

  Next, the CPU 11 determines whether or not new waveform data has been stored in another waveform data area that is not the currently read waveform data area (step 703). When a new waveform data area is stored in another waveform data area, there is a possibility that the waveform is switched, so the determination in step 703 is performed. When it is determined No in step 703, the CPU 11 reads waveform data from the currently read waveform data area according to the read time F (step 704). Waveform data G (i) from the waveform data area is acquired. Unless new waveform data is stored in another waveform data area, the waveform data from one of the waveform data areas being read is repeatedly read. In step 703, if the currently read waveform data area is the waveform data area 0, the other waveform data area is the waveform data area 1. Conversely, if the waveform data area currently being read is the waveform data area 1, the other waveform data area is the waveform data area 0. The same applies to the cross-fading process described below.

  If it is determined Yes in step 703, it is determined whether or not the value of the X coordinate of the waveform to be read is within the crossfade period (step 705). If it is determined No in step 705, the process proceeds to step 704. On the other hand, if it is determined Yes in step 705, crossfade processing is executed (step 701).

FIG. 8 is a flowchart showing an example of the crossfade process according to the present embodiment. CPU11 is a cross-fade period X, crossfade start position N-X-1, and acquires the cross-fade end position N-1, read the waveform data area from the waveform data _G p currently read _{(i p),} crossfade The following waveform data g ₁ (i) is calculated by multiplying by the coefficient (step 802).

g ₁ (i) = ((N−1) −i _p ) / X) · G _p (i _p )
FIG. 9 is a diagram for explaining the cross fade according to the present embodiment. As shown in FIG. 9, in the present embodiment, the crossfade is started from the output of the (N−X−1) th waveform data in the currently read waveform data area, and the (N−1) th number. In other words, the crossfade ends with the output of the last waveform data. Therefore, if the waveform data G _p (i) from the currently read waveform data area is N−X−1 ≦ i ≦ N−1, it is determined Yes in step 705.

Further, as shown in FIG. 9, the waveform data _g 1 calculated (i) at step 802, as indicated by reference numeral 900, the parameter _{i p} is to specify the waveform data, the following (N-X-1) In some cases, the value is the original value (reference numeral 901), the value decreases until the parameter i _p reaches (N−X−1) to (N−1), and when the parameter i _p is N, “ 0 ".

Then, CPU 11 is newly waveform data from other waveform data area waveform data is stored _{G q (i q) (i} q = i p - (N-X-1)) read out, multiplied by the cross-fade factor Then, the following waveform data g ₂ (i) is calculated (step 803).

g ₂ (i) = (i _q / X) · G _q (i _q )
As shown in FIG. 9, the waveform data g ₂ (i) calculated in step 803 has a parameter i _q for designating waveform data equal to or less than (N−X−1) as indicated by reference numeral 910. is "0", the parameter _{i q} from (N-X-1) up to (N-1), the value increases, the parameter _{i q} is the original value above N (reference numeral 911 see ).

The CPU 11 synthesizes the obtained two waveform data g ₁ (i) and g ₂ (i) to obtain synthesized musical sound waveform data G (i) (first musical sound waveform data) (step 804). ). The synthesized musical sound waveform data G (i) is given to the sound source unit 21.

When the cross-fade process in step 706 is completed or step 704 is completed, the sound source unit 21 obtains the waveform data G (i) acquired from the waveform data area and the waveform data G _PRE ( i) is added according to the mix ratio stored in the RAM 13 to calculate the synthesized musical sound waveform data G _OUT (i) (step 707). The synthesized musical sound waveform data G _OUT (i) is as follows.

G _OUT (i) = A · G (i) + (1−A) · G _PRE (i)
(A (0 <A <1) is the mix ratio)
The audio circuit 22 converts the synthesized musical sound waveform data into an analog signal, amplifies the analog signal obtained by the conversion, and outputs it from the speaker 23.

  After the sound generation process (step 305), the CPU 11 executes a mute process (step 306). FIG. 10 is a flowchart showing an example of the mute process according to the present embodiment. As shown in FIG. 8, the CPU 11 determines whether or not the vibration level of the string is less than a predetermined value (step 1001). In step 1001, it may be determined whether the maximum displacement value Gmax of the waveform data stored in the waveform data area is less than a predetermined value. Alternatively, it may be determined whether or not a string signal (original signal) output from a pickup (not shown) of the guitar 25 is lower than a predetermined level.

  If YES in step 1001, whether the musical sound waveform data (second musical sound waveform data) based on the preset waveform data and the musical sound waveform data (first musical sound waveform data) based on the image data are being output. It is determined whether or not (step 1002). If it is determined Yes in step 1002, the CPU 11 instructs the sound source unit 21 to mute the musical tone waveform data (second musical tone waveform data) based on the preset waveform data. In response to the instruction, the sound source unit 21 generates second musical sound waveform data that gradually attenuates the output level (step 1003). Further, the CPU 11 multiplies the first musical sound waveform data by a coefficient that gradually attenuates the output level of the musical sound waveform data (first musical sound waveform data) based on the image data, and uses the multiplication result data as the first musical sound data. The waveform data is given to the sound source unit 21 (step 1004).

  When Step 1001 is No, Step 1002 is No, or Step 1004 is finished, the mute process is finished. After the mute processing is completed, the CPU 11 executes other necessary processing (step 307). The processing in step 307 includes, for example, image display on the display unit 15 and lighting of LEDs.

  According to the present embodiment, the camera shoots an image shooting region over the portion where the string vibrates in the stringing direction of the guitar 25. The CPU 11 uses the amount of displacement from the reference position in the string stretching direction (X-axis direction), that is, the amount of displacement in the Y-axis direction, as a gain value based on the image data of the image shooting region, in the string stretching direction. Waveform data including a plurality of gain values is generated and stored in the waveform data area of the RAM 13. The CPU 11 reads the waveform data in the waveform data area at a predetermined sound reading speed, gives it to the sound system 14, converts it into an analog signal in the sound system 14, and outputs it. This makes it possible to generate and output musical sound waveform data based on the vibration of the entire string in the image shooting region. In addition, since waveform data is generated using image data of the entire string in the image capturing region, it is possible to output musical sound waveform data with a good response.

  According to the present embodiment, the waveform data in the waveform data area is read based on the fundamental frequency f (Hz) input by operating the switches that constitute the operation unit 18. As a result, a musical tone having a desired pitch can be output by the player's switch operation.

  Further, according to the present embodiment, the CPU 11 generates waveform data such that the number N of waveform data samples is N = fs / f (fs: sampling frequency). Thus, by reading the waveform data at the sampling frequency, it is possible to finish reading the waveform data in the waveform data area at the set time 1 / f.

  Further, according to the present embodiment, the ROM 12 is provided with a preset waveform data area in which waveform data of a predetermined tone color is stored, and the sound source unit 21 reads the preset waveform data based on the basic frequency f. Second musical sound waveform data is generated, synthesized with the first musical sound waveform data read from the waveform data area, and output. Thereby, it is possible to obtain a musical sound obtained by mixing a musical sound obtained from the string vibration of the stringed musical instrument itself and a musical sound generated by the sound source unit 21 (so-called synth sound).

  Furthermore, in this embodiment, when new image data is acquired, the CPU 11 stores new waveform data based on the new image data in another waveform data area from which waveform data has not been read. To do. When reading of waveform data from one waveform data area from which waveform data is being read is completed, the CPU 11 starts reading new waveform data from the other waveform data area. Thus, every time new image data is acquired, new waveform data based on the new image data can be generated, and musical sound waveform data based on the waveform data can be generated.

  In the present embodiment, when the CPU 11 finishes reading the waveform data from one waveform data area, the CPU 11 gradually decreases the level of the waveform data and reads the waveform data from the other waveform data area. The level of new waveform data is gradually increased, and these waveform data are synthesized and output. In this way, the waveform data can be switched smoothly by performing the crossfade process.

  Next, a second embodiment of the present invention will be described. In the first embodiment, the musical sound waveform data (first musical sound waveform data) generated based on the image data is a musical sound waveform based on the preset waveform data generated by the sound source unit 21 and stored in the ROM 12. It is synthesized with data (second musical sound waveform data) and output. In the second embodiment, the tone generator 21 is not provided, and the tone signal obtained from the electric signal based on the string vibration output from the pickup of the guitar 25 and the first tone waveform data are synthesized and output. To do.

  FIG. 11 is a block diagram showing the configuration of the musical tone generator according to the second embodiment of the present invention. In FIG. 11, the same components as those in the musical tone generator shown in FIG. As shown in FIG. 11, the musical sound generation device 100 according to the second embodiment includes a CPU 11, a ROM 12, a RAM 13, a sound system 114, a display unit 15, a camera 16, an image data input I / F 17, and an operation unit 18. .

  In the present embodiment, the sound system 114 includes an audio mixing circuit 114. The output of the pickup 121 of the guitar 25 is input to the audio mixing circuit 114 of the sound system 114. In the present embodiment, as will be described later, the audio mixing circuit 14 converts a musical sound waveform data (first musical sound waveform data) based on image data into an analog signal, and a musical sound signal output from the pickup 121. Are combined with the set mix ratio.

  An outline of processing in the musical sound generating apparatus 100 according to the second embodiment is also shown in FIG. The switch process (step 302), the read frequency setting process (step 303), and the waveform data generation process (step 304) are the same in the second embodiment.

  FIG. 12 is a flowchart illustrating an example of a sound generation process according to the second embodiment. In the second embodiment, step 702 in the sound generation process of the first embodiment, that is, generation of the second musical sound waveform data based on the preset waveform data stored in the ROM 12 is not performed. As shown in FIG. 12, in the sound generation process according to the second embodiment, when the vibration level of the string is equal to or higher than a predetermined value (Yes in step 1201), the other waveform data area that is not currently being read is displayed. If new waveform data is not stored in the waveform data area (No in step 1202) or is not within the crossfade period (No in step 1204), the CPU 11 follows the reading time F to read the waveform data currently being read out. Waveform data is read from the area (step 1203). These steps 1201, 1202, 1203, and 1204 are the same as steps 701, 703, 704, and 705 in FIG.

  If it is determined to be Yes in both step 1201 and step 1204, crossfade processing is executed (step 1205). The cross fade process is the same as that shown in FIG. The waveform data generated in step 1203 or the waveform data generated in the crossfade process is output to the audio mixing circuit 122. When the crossfade process in step 1205 is completed or step 1203 is completed, the audio mixing circuit 122 converts the waveform data G (i) into an analog signal, the musical sound waveform signal obtained by the conversion, and the pickup 122. The musical tone waveform signal based on the string vibration output from is added according to the mix ratio stored in the RAM 13 to generate a synthesized musical tone signal. The generated synthetic tone signal is output from the speaker 23.

  According to the second embodiment, the musical tone signal based on the string vibration output from the pickup 121 of the guitar 25 and the first musical tone signal based on the first musical tone signal data are synthesized and output. Therefore, it is possible to synthesize a musical sound based on string vibration image data and a musical sound based on an electric signal based on string vibration.

  The present invention is not limited to the above embodiments, and various modifications can be made within the scope of the invention described in the claims, and these are also included in the scope of the present invention. Needless to say.

  For example, in the above embodiment, a guitar is used as a stringed instrument, but the present invention is not limited to the guitar, and the present invention can be applied to other stringed instruments such as a bass, a violin, a viola, and a cello. it can.

  In the first embodiment, the musical sound generator 10 includes the sound source unit 21, reads waveform data stored in the ROM 12, generates musical sound waveform data (second musical sound waveform data), and generates an image. The musical tone waveform data (first musical tone waveform data) based on the data and the synthesized musical tone waveform data synthesized are output. In the second embodiment, the tone generator 100 synthesizes and outputs a second tone signal based on the electrical signal from the pickup 121 and a tone signal obtained by analog conversion of the first tone waveform data. is doing. However, it is not limited to the said structure. For example, the tone generator 10 may be configured to simply generate and output tone waveform data (first tone waveform data) based on image data.

10 Musical sound generator 11 CPU
12 ROM
13 RAM
14 Sound System 15 Display Unit 16 Camera 17 Image Data Input I / F
18 Operation unit 21 Sound source unit 22 Audio circuit 23 Speaker 25 Guitar

Claims (8)

A musical sound generator for generating musical sounds based on string vibration of a stringed instrument,
Image acquisition means for acquiring image data of an image capturing area over the vibrating portion of the string in the stringing direction;
Waveform data including a plurality of gain values in the string tension direction based on the image data obtained by the image acquisition means, with the amount of displacement from a reference position in a direction perpendicular to the string tension direction as a gain value Waveform data generating means for generating and storing in the waveform data area of the storage means;
A musical tone generator comprising: musical tone waveform data generation means for reading waveform data stored in the waveform data area at a predetermined reading speed and generating first musical tone waveform data.   The musical sound waveform data generation means reads the waveform data stored in the waveform data area at 1 / f (seconds) based on the input fundamental frequency f (Hz) at a speed at which the waveform data area is read. The musical tone generator according to claim 1, wherein the musical tone generator is configured to read stored waveform data.   3. The musical tone generation according to claim 2, wherein the waveform data generation means generates waveform data so that the number N of samples of the waveform data is N = fs / f (fs: sampling frequency). apparatus. The storage device has a timbre waveform data area in which waveform data of a predetermined timbre is stored;
A musical tone waveform data generation means reads waveform data of the predetermined tone color in the tone color waveform data area based on the fundamental frequency, generates second tone waveform data, and generates the first tone waveform data and the first tone waveform data. 4. A musical tone generator according to claim 2, wherein synthetic musical tone waveform data obtained by synthesizing the two musical tone waveform data is generated.   The musical sound waveform data generating means synthesizes and outputs a second musical sound signal based on string vibration output from a pickup and a first musical sound signal based on the first musical sound signal data. The musical tone generator according to claim 2 or 3. It has multiple waveform data areas,
When the waveform data generation means acquires new image data, a new waveform based on the new image data is displayed in another waveform data area where the waveform data is not read by the musical sound waveform data generation means. Store data,
The musical tone waveform data generation means starts reading the new waveform data from the other waveform data area when reading of the waveform data from one waveform data area from which the waveform data is being read is completed. The musical tone generator according to any one of claims 1 to 5, wherein   The musical sound waveform data generation means gradually decreases the level of the waveform data when the reading of the waveform data from the one waveform data area is completed, and the read out from the other waveform data area. 7. The musical tone generator according to claim 6, wherein the level of new waveform data is gradually increased, and the waveform data and the new waveform data are synthesized and output. A musical sound generation program for generating musical sounds based on string vibration of a stringed instrument,
An image acquisition step of acquiring image data of an image capturing region across the vibrating portion of the string in the stringing direction;
Waveform data including a plurality of gain values in the string stretching direction based on the image data obtained in the image acquisition step, with a displacement amount from a reference position in a direction perpendicular to the string stretching direction as a gain value Generating waveform data and storing it in the waveform data area of the storage means;
A musical tone generating program, comprising: executing a musical tone waveform data step of reading waveform data stored in the waveform data area at a predetermined reading speed to generate first musical tone waveform data.

Images