JP2009216904A - Electronic musical device, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic musical device capable of imparting an optional length of vibrato, capable of attaining a natural vibrato near to performance of an actual musical instrument, and capable of controlling a depth and a speed of the vibrato. <P>SOLUTION: This electronic musical device has: a pitch acquiring means for acquiring a temporal locus of a pitch from an original sound waveform data; an extraction means for extracting respective times and pitches of a ridge and a valley of a peak, from the acquired temporal locus of the pitch; a vibrato period calculating means for calculating period information of the vibrato, based on a difference between the respective times of the ridge and the valley of the extracted peak; a vibrato depth calculating means for calculating depth information of the vibrato, based on a difference between the respective pitches of the ridge and the valley of the extracted peak; a recording means for recording, as a time-serial data, the calculated period information and depth information of the vibrato as one set, together with the time from a pronunciation start time of the original sound waveform data; and a setting means for setting a loop beginning end and a loop terminal end in the time-serial data. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an electronic music device, and more particularly, an electronic music device that generates musical tone control data for adding vibrato to musical tone data, and an electronic musical device that applies vibrato to musical tone data based on the generated musical tone control data. About.

  Conventionally, as a technique for adding vibrato to a musical sound, a technique for modulating the pitch of musical sound data with a modulation waveform of about several Hz generated by a low frequency oscillator (LFO) is known. However, vibrato becomes unnatural in a system that simply modulates the pitch of musical sound data by LFO.

  Therefore, the two series of waveform data for generating the vibrato sound are subjected to frequency analysis on the waveform data of the vibrato performance, created based on the peak and valley points of the vibrato of the basic pitch, and the generated two series of waveform data There has been proposed a technique for generating a more natural vibrato tone by controlling the synthesis ratio using a modulation waveform (see, for example, Patent Document 1).

JP 2007-248551 A

  In the conventional vibrato imparting technology, if the user does not skillfully operate a real-time controller (such as a modulation wheel), mechanical vibrato by LFO may occur. Alternatively, the vibrato reflects the physical characteristics of the controller, and it does not resemble an actual live musical instrument.

  The objective of this invention is providing the electronic music apparatus which can provide the vibrato of arbitrary length.

  Another object of the present invention is to realize a natural vibrato that is close to the performance of an actual musical instrument. It is to provide an electronic music device.

  Still another object of the present invention is to provide an electronic music apparatus that can control the depth and speed of vibrato.

  According to one aspect of the present invention, an electronic music apparatus includes a pitch acquisition unit that acquires a temporal trajectory of a pitch from original sound waveform data, and each time of peak peaks and troughs from the acquired temporal trajectory of pitch. Extraction means for extracting pitch, vibrato period calculation means for calculating period information of vibrato from the difference in time between the peak and valley of the extracted peak, and difference in pitch between the peak and valley of the extracted peak Vibrato depth calculation means for calculating the vibrato depth information from the time series data, together with the time from the sound generation start time of the original sound waveform data, with the set of the vibrato period information and the vibrato depth information as a set And a setting means for setting a loop start end and a loop end in the time series data.

  According to another aspect of the present invention, the electronic music apparatus uses the vibrato period information and the vibrato depth information set with the loop start end and loop end as a set, and the sound generation start time of the original sound waveform data. Recording means for recording time-series data together with the time from the sound generation means, sound generation instruction detection means for detecting a sound generation instruction, and reading means for reading the time-series data from the reading means over time according to the sound generation instruction. Then, after reading the time series data to the end of the loop, according to the reading means for reading again from the loop start end, the vibrato period information and the vibrato depth information included in the read time series data A vibrato control signal generating means for generating a vibrato control signal, and a tone generation is started in response to the sound generation instruction. In, and a tone generating means for modulating musical tone in response to the vibrato control signal.

  According to the present invention, an arbitrary length of vibrato can be applied.

  Further, according to the present invention, a natural vibrato close to an actual musical instrument performance can be realized.

  Furthermore, according to the present invention, the depth and speed of vibrato can be controlled.

  FIG. 1 is a block diagram showing a hardware configuration of an electronic music apparatus 50 according to an embodiment of the present invention.

  The bus 17 of the electronic music device 50 includes a CPU 1, ROM 2, RAM 3, timer 4, operation unit 5, panel display 6, MIDI interface 7, drive device 8, writing circuit 13, buffer 14, sound source unit 15, sound system. 16 is connected.

  The RAM 3 has a working area of the CPU 1 that stores a buffer area such as a reproduction buffer, flags, registers, various parameters, and the like.

  The ROM 2 can store various data files, various parameters and a control program, or a program for realizing the present embodiment. In this case, it is not necessary to store programs or the like in the recording medium 9 in an overlapping manner.

  The CPU 1 performs calculation or control of the electronic music apparatus 50 according to a control program stored in the ROM 2 or the recording medium 9 or a program for realizing the present embodiment. The timer 4 is connected to the CPU 1 and supplies a basic clock signal, interrupt processing timing, and the like to the CPU 1.

  The user can perform various inputs, settings, and selections using the operation unit 5. The operation unit 5 may be any device that can output a signal corresponding to a user input, such as a switch, pad, fader, slider, rotary encoder, joystick, jog shuttle, character input keyboard, mouse, and the like. The operation unit 5 may be a soft switch or the like displayed on the display 6 that is operated using another operation element such as a cursor switch. In the present embodiment, the user operates various data displayed on the display 6 using the operation unit 5.

  The display device 6 can display various information. The user refers to information displayed on the display device 6 and performs various inputs and settings.

  The drive device 8 is a device for accessing a storage medium 9 such as a semiconductor memory such as a hard disk, an FD (flexible disk or floppy disk (registered trademark)), a CD (compact disk), a DVD (digital multipurpose disk), or a flash memory. It is. The storage medium 9 may be detachable or may be built in the electronic music device 50. The recording medium 9 and / or the ROM 2 can store a program for realizing each embodiment of the present invention and a program for controlling the other electronic music apparatus 50. In the case where the program for realizing each embodiment of the present invention and the program for controlling the other electronic music apparatus 50 are stored in the recording medium 9, it is not necessary to store them together with the ROM 2. Further, only a part of the program may be stored in the recording medium 9, and the other program may be stored in the ROM 2.

  The recording medium 9 stores, for example, vibrato data VD created in the embodiment of the present invention. Further, previously created vibrato data VD may be recorded. Further, the vibrato data VD created in advance may be recorded in the ROM 2. Further, the vibrato data VD may be recorded in the waveform memory 10 together with the waveform data.

  The MIDI interface (MIDI I / F) 7 can be connected to an electronic musical instrument, other musical instruments, audio equipment, a computer, etc., and can transmit and receive at least a MIDI signal. The MIDI interface 7 is not limited to a dedicated MIDI interface, and may be configured using a general-purpose interface such as RS-232C, USB (Universal Serial Bus), IEEE 1394 (I-Triple 1394). In this case, data other than MIDI messages may be transmitted and received simultaneously.

  The waveform memory 10 stores a plurality of types of waveform data (waveform data 10a, waveform data 10b) having different waveforms created in advance based on the waveform data of the original waveform and the waveform data of the original waveform. Can be written and read.

  For a method of creating a set of waveform data (waveform data 10a, waveform data 10b) having different waveforms, refer to paragraphs [0013] to [0019] of Japanese Patent Application Laid-Open No. 2007-248551, for example. That is, the original waveform data subjected to vibrato is subjected to frequency analysis by FFT analysis processing to obtain analysis data for each frequency component. Thereafter, components (pitch and harmonics) that are continuous on the time axis are extracted from the analysis data, and the frequency component of the analysis data is changed so that the frequency of the pitch component becomes flat. The amplitude of each harmonic component in the vicinity of the maximum value and the minimum value of the pitch of the original waveform data is applied to the flattened analysis data, and waveform data 10a and waveform data 10b are generated based on the result.

  The access management unit 11 manages access time slots of the waveform memory 10 so that accesses from the writing circuit 13, the sound source unit 15, or the buffer 14 to the waveform memory 10 do not collide with each other.

  The writing circuit 13 samples the original waveform signal input from the external waveform input terminal 12 and writes it in the waveform memory 10. The buffer 14 transfers the waveform data written to the waveform memory 10 from the recording medium 9 or RAM 3 or the waveform data read from the waveform memory 10 to the CPU 1 or RAM 3.

  The tone generator 15 generates a musical sound signal based on the waveform data read from the waveform memory 10 and the MIDI signal input via the MIDI interface and the like, gives various musical effects, and supplies them to the sound system 16. To do. The sound system 16 includes a D / A converter and a speaker, converts a digital musical tone signal supplied to an analog format, and generates a sound.

  The sound source unit 15 may be configured by a combination of dedicated hardware or DSP (Digital Signal Processor) and a microprogram, or by a combination of one dedicated hardware or DSP and a microprogram. Also good. Moreover, you may comprise by the software sound source by the combination of CPU1 and a software program, without using dedicated DSP.

  The sound source unit 15 includes a waveform memory method, FM method, physical model method, harmonic synthesis method, formant synthesis method, VCO (Voltage Controlled Oscillator) + VCF (Voltage Controlled Filter) + VCA (Voltage Controlled Amplifier) analog synthesizer method. Any method such as an analog simulation method may be used.

  Further, a plurality of tone generation channels may be formed by using one tone generator circuit in a time-sharing manner, or a plurality of tone generation circuits may be formed by using one tone generator circuit for each tone generation channel. You may make it comprise.

  The CPU 1 controls the tone generation state of the tone generation channel of the tone generator 15 in accordance with performance information supplied from the MIDI interface 7, the recording medium 9, the RAM 3, or the like when performing performance processing. For example, when a note-on signal indicating the start of sound generation is input from the MIDI interface 7, it is necessary to assign the generation of the musical sound to one of the sound generation channels of the sound source unit 15 and generate the music sound to the assigned sound generation channel. Various musical tone parameters (pitch information, vibrato control information, waveform selection information, volume envelope control information, effect information, etc.) are supplied and a sounding start instruction is given. In response to this, the tone generator 15 uses the assigned tone generation channel to generate a tone corresponding to the tone parameter described above using the waveform data read from the waveform memory 10 according to the waveform selection information. .

  FIG. 2 is a flowchart showing the creation processing of the vibrato data VD according to the embodiment of the present invention. FIG. 3 is a conceptual diagram for explaining the vibrato data VD creation process. The vibrato data creation process will be described below with reference to FIGS. This process is activated by a user start instruction.

  In step SA1, the vibrato data creation process is started. In step SA2, the original musical tone data (original waveform data) as shown in FIG. 3A is acquired. The original sound waveform data is obtained, for example, by the writing circuit 13 sampling the original waveform signal input from the external waveform input terminal 12 and writing it in the waveform memory 10.

  In step SA3, the pitch of the original sound waveform data acquired in step SA2 is extracted, and the temporal trajectory is recorded as shown in FIG. The pitch is extracted by a known technique such as zero crossing or frequency analysis.

  In step SA4, as shown in FIG. 3C, from the time trajectory of the pitch recorded in step SA3, the time of the peak peak (the maximum value in a half cycle and the point indicated by the square in the figure). And the value of the pitch at the time, and the time of the peak valley (the minimum value in the half cycle and indicated by a circle in the figure) and the value of the pitch at the time are extracted. At this time, a predetermined amount of time from the head position of the original sound waveform data is set as an attack portion, and no peak (mountain and valley) portion is extracted for the attack portion. This predetermined time may be a fixed value, or may be manually set by the user referring to the pitch trajectory displayed on the display device 6. In addition, since there are cases where peaks and valleys are formed at places that are not originally peaks due to circumstances such as poor pitch extraction accuracy, margins for determining peaks and valleys may be designated.

  In step SA5, a value corresponding to ½ of the pitch difference between the peaks and valleys extracted in step SA4 (the value indicated by the vertical double arrow in FIG. 3D, that is, twice the amplitude) is obtained. Calculated as depth (Vibrato Depth) [cent]. The value calculated at this time is normalized in 128 steps from 0 to 127 in mounting.

  In step SA6, the period of vibrato (vibrato frequency is obtained by dividing π by the time difference between peaks and troughs extracted in step SA4 (the value indicated by the horizontal double-headed arrow in FIG. 3D, that is, a half period). : VibratoSpeed) [rad / sec] is calculated, and the value calculated at this time is normalized in 128 steps from 0 to 127 in terms of mounting.

  In step SA7, the vibrato depth [cent] calculated in step SA5 is set to time series data (amplitude data) in units of 10 msec as shown in FIG. 3E, for example, and in step SA6. The calculated vibrato period (vibrato frequency) [rad / sec] is, for example, time series data (period data) in units of 10 msec as shown in FIG. Further, the time from the beginning of the original sound waveform data to the peak first extracted in step SA4 is set as a delay value. The amplitude data, period data, and delay value are combined and stored as a set of vibrato data VD, for example, in the recording medium 9 or the like. The delay value is the time from the start of sounding until the start of vibrato. As described above, the time from the beginning of the original sound waveform data to the first peak is automatically set as the delay value. It may be set.

  In step SA8, a loop process is performed on the vibrato data VD recorded in step SA7 as necessary. Details of the loop processing will be described later with reference to FIGS. Thereafter, the process proceeds to step SA9, and the vibrato data creation process is terminated.

  The vibrato data VD is preferably created and stored for each tone color corresponding to each tone color. Further, each tone color may be created / saved corresponding to the tone range, or may be created / saved corresponding to the velocity. Further, a plurality of these vibrato data VD may be created and stored and switched as necessary, or may be used by crossfading.

  FIG. 4 is a schematic diagram showing a first example of loop processing of vibrato data VD according to the embodiment of the present invention.

  FIG. 4A is a schematic diagram showing one of amplitude data (Vibrato Depth) and periodic data (VibratoSpeed) included in the vibrato data VD stored in Step SA7 of FIG. Timing t0 in the figure represents the head position of amplitude data or period data. The user displays either amplitude data or period data on the display 6 and designates the loop start timing t1 and the loop end timing t2 for either of the displayed amplitude data or period data. By designating either one, the loop start timing t1 and the loop end timing t2 are automatically designated at the same temporal position for the other.

  When the user designates the loop start timing t1 and the loop end timing t2, as shown in FIG. 4B, the section from the timing t0 to the timing t1 is designated as the head, and the timing from the timing t1 to the timing t2 is designated. A section is designated as a loop part. In the vibrato data VD designated as described above, after a predetermined time designated by the delay value elapses, the head portion is read out, the loop portion is read out thereafter, and the loop portion is repeatedly read out thereafter. That is, when the vibrato data VD is read out until timing t2, the loop position is repeatedly read out by returning the reading position to timing t1. Thus, by reading, the vibrato data VD in which the loop portion is designated is reproduced as shown in FIG.

  FIG. 5 is a schematic diagram showing a second example of loop processing of vibrato data VD according to the embodiment of the present invention.

  FIG. 5A is a schematic diagram showing either amplitude data (Vibrato Depth) or periodic data (VibratoSpeed) included in the vibrato data VD stored in Step SA7 of FIG. Timing t0 in the figure represents the head position of amplitude data or period data. In this example, the timing after the elapse of a predetermined time from the timing t0 is automatically set as the loop start timing t1, and the timing after the elapse of the predetermined time is automatically set as the loop end timing t2. The user may manually set the loop start timing t1 and the loop end timing t2. At this time, regardless of which data is displayed, the loop start timing t1 and the loop end timing t2 are automatically set at the same time position for the other one.

  In this example, for example, as shown in FIG. 5B, it is conceivable that if loop reproduction is simply performed, discontinuous and unnatural points occur. Therefore, the slope of the predetermined section (timing t12 to timing t21) in the vicinity of the loop portion end is indicated by a one-dot chain line arrow in the drawing so that the loop portion end is naturally connected to the starting end from that indicated by the solid arrow in the drawing. Correct to something.

The correction here is performed from A ₀ (data at timing t11) to A _{L in} the original amplitude data string (or period data string included in the vibrato data VD stored in step SA7 in FIG. 2). When looping in L sections up to ₋₁ (data immediately before timing t21), when correcting the slope of a section of a predetermined length M (timing t12 to timing t21), the corrected data string A ′ is Is obtained by the following equation (1).

... (1)
Data in which the end of the loop portion is naturally connected to the starting end as shown in FIG. 5C by correcting the slope of the section of the predetermined length M (timing t12 to timing t21) using the above equation (1). A row can be obtained. The vibrato data VD including the data string corrected in this way is read out after a predetermined time specified by the delay value, and then the loop part is read out. Thereafter, the loop part is repeatedly read out. . That is, when the vibrato data VD is read out until timing t2, the loop position is repeatedly read out by returning the reading position to timing t1. Thus, by reading, the vibrato data VD in which the loop portion is designated is reproduced as shown in FIG.

  FIG. 6 is a schematic diagram showing a third example of loop processing of vibrato data VD according to the embodiment of the present invention.

  FIG. 6A is a schematic diagram showing either amplitude data (Vibrato Depth) or periodic data (VibratoSpeed) included in the vibrato data VD stored in Step SA7 of FIG. Timing t0 in the figure represents the head position of amplitude data or period data. In this example, the timing after the elapse of a predetermined time from the timing t0 is automatically set as the loop start timing t1, and the timing after the elapse of the predetermined time is automatically set as the loop end timing t2. The user may manually set the loop start timing t1 and the loop end timing t2. At this time, regardless of which data is displayed, the loop start timing t1 and the loop end timing t2 are automatically set at the same time position for the other one.

  In this example as well, for example, as shown in FIG. 6B, it is conceivable that if loop reproduction is simply performed, discontinuous and unnatural points occur. Therefore, the slope of the predetermined section (timing t12 to timing t21) in the vicinity of the loop portion end is indicated by a one-dot chain line arrow in the drawing so that the loop portion end is naturally connected to the starting end from that indicated by the solid arrow in the drawing. Correct to something.

  The correction here is a section of a predetermined length M (timing t12 to timing t12-of the original amplitude data string (or included in the vibrato data VD stored in step SA7 in FIG. 2)). The data sequence at the timing t21) is faded out, and the data sequence in the section from the timing t10 to the loop start timing t11 preceding the loop start timing t1 by the same time as the section of the predetermined length M is cross-faded. Thus, the timing t21 and the timing t11 are naturally continued.

  By performing the crossfade in this way, the inclination of the section of the predetermined length M (timing t12 to timing t21) is corrected, and the data sequence in which the loop end is naturally connected to the starting end as shown in FIG. 6C. Can be obtained. The vibrato data VD including the data string corrected in this way is read out after a predetermined time specified by the delay value, and then the loop part is read out. Thereafter, the loop part is repeatedly read out. . That is, when the vibrato data VD is read out until timing t2, the loop position is repeatedly read out by returning the reading position to timing t1. Thus, by reading, the vibrato data VD in which the loop portion is designated is reproduced as shown in FIG. 6 (D).

  As described above, the length of the vibrato data VD can be adjusted by performing the loop processing of the vibrato data VD shown in FIGS. 4 to 6, and vibrato is imparted to a musical sound (waveform data) having an arbitrary length. Can do.

  The loop processing of the vibrato data VD shown in FIGS. 4 to 6 is performed in step SA8 of the vibrato data creation processing shown in FIG. 2, and the vibrato generation unit 100 described later converts the vibrato data VD into vibrato data VD as necessary. You may perform in the case of the vibrato provision process based on.

  FIG. 7 is a block diagram showing an algorithm applied to the vibrato imparting process by the vibrato generating unit 100 according to the embodiment of the present invention. Here, the vibrato generation unit 100 is configured by the sound source unit 15 or the like, but may be configured by a combination of the CPU 1 and a software program.

  For example, the recording medium 9 stores a plurality of pieces of vibrato data VD including amplitude data (Vibrato Depth), period data (VibratoSpeed), and a delay value.

  When there is a read instruction from the CPU 1 at the timing of a note-on event, the vibrato depth (Vibrato Depth) reading unit 101 starts reading amplitude data (Vibrato Depth) recorded in the recording medium 9 or the like. Each data string is read out every timer interrupt from (10 msec in this example).

  The LFO EG generation unit 102 starts generating the LFO envelope at the timing of the note-on event from the CPU 1, and the output thereof is each data of amplitude data (Vibrato Depth) output from the vibrato depth reading unit 101 by the multiplier 103. Multiply by column. The output of the LFO EG generator 102 varies as shown in FIG. 8, for example. That is, the time corresponding to the delay value included in the vibrato data VD is 0%, and the original vibrato is not reflected in the musical tone at all. Thereafter, when the time of the delay value elapses from note-on, it is gradually raised to 100% at a transition portion that is appropriately determined. When the output reaches 100%, the original vibrato is most reflected on the musical sound.

Returning to FIG. 7, the output of the multiplier 103 is multiplied by a coefficient km ₁ (for example, 0 to 0.1) input from the modulation wheel 51 by the multiplier 104 and input to the multiplier 105. The modulation wheel 51 is an operator (for example, the operation unit 5 in FIG. 1) for controlling (increasing / decreasing) the vibrato depth, and is operated by the user. The user can control the depth of the vibrato effect imparted to the musical sound by operating the modulation wheel 51.

Similarly to the vibrato depth reading unit 101, the vibrato cycle reading unit 106 also receives cycle data (VibratoSpeed) recorded on the recording medium 9 or the like when a read instruction is issued from the CPU 1 at the timing of a note-on event. ) Is started, and thereafter, each data string is read every timer interrupt from the timer 4 (in this example, 10 msec). Note that the phase does not advance in the delay portion of the periodic data. Each data sequences read is sent to the multiplier 107, the multiplier 107, the coefficient is inputted from the modulation wheel 52 _{k m @ 2} (e.g., 0 to 0.1) is multiplied by a low frequency oscillator (LFO) 108 is input. The modulation wheel 52 is an operator (for example, the operation unit 5 in FIG. 1) for controlling (increasing or decreasing) the vibrato period (speed), and is operated by the user. The user can control the cycle of the vibrato effect imparted to the musical sound by operating the modulation wheel 52.

The LFO 108 performs an operation on the input data string using the following equation (2), and outputs the operation result to the multiplier 105.

... (2)
However, t is a real time, Δ is a timer interrupt interval (for example, 10 msec), and Φ is an initial phase. VibratoSpeed is updated at the timer interrupt interval Δ. When the initial phase Φ is set to 1 / 2π, it becomes cosine (cos), so that the one close to the original vibrato is reproduced. In order to simplify the processing, the initial phase may be set to 0 by omitting Φ, or may be set to other values for special effects. Note that the LFO 108 may generate a triangular wave in order to simplify the calculation.

Multiplier 105 multiplies the output of LFO 108 by the output of multiplier 104 and outputs a vibrato control signal Sv. The vibrato control signal Sv is input to the tone generator 150. The vibrato control signal Sv is expressed by the following equation (3).

... (3)
However, t is a real time, Δ is a timer interrupt interval (for example, 10 msec), and Φ is an initial phase. VibratoSpeed and VibratoDepth are updated at the timer interrupt interval Δ. Further, it is assumed that VibratoSpeed and VibratoDepth are respectively multiplied by coefficients K _m1 and K _{m2 as} necessary.

  Since VibratoSpeed and VibratoDepth are updated (read) at the timer interrupt interval Δ, the value read immediately before is held between the read data strings. Therefore, the vibrato depth and period are constant within the timer interrupt interval. It should be noted that the data strings may be complemented so that the vibrato depth and period change continuously.

  The musical tone generation unit 150 can write modulation on the waveform data read from the waveform memory 10 in accordance with the vibrato control signal Sv, thereby adding vibrato to the waveform data and outputting a musical tone signal with a vibrato effect. . Here, it is assumed that the musical sound generation unit 150 includes the sound source unit 15 and the like.

  FIG. 9 is a flowchart showing the vibrato imparting process according to the embodiment of the present invention. This process is started each time a Norton event that is a sound generation instruction is input from a MIDI device or the like connected to the MIDI interface 7.

  In step SB1, the vibrato giving process is started, and in step SB2, a note-on event is acquired. The note-on event is input from, for example, a MIDI device connected to the MIDI interface 7 in FIG. 1, and includes at least a note number that designates a pitch.

  In step SB3, the tone generator circuit 15 is instructed to generate a sound with a pitch (pitch) represented by the note number included in the note event acquired in step SB2. Note that the timbre and the like at this time are set in advance. Corresponding waveform data is read from the waveform memory 10 and sent to the tone generator circuit 15 in response to an instruction to start sound generation.

  In step SB4, the read position of the vibrato data VD is initialized to the head position of the vibrato data VD. The vibrato data VD may be automatically selected corresponding to the tone color set for the note event (MIDI channel) acquired in step SB2, or selected by the user in advance. You may keep it.

  In step SB5, it is determined whether or not a note-off event corresponding to the note-on event acquired in step SB2 is detected. If a note-off event is detected, the process proceeds to step SB6 indicated by a YES arrow, and a sound generation stop (release) instruction is issued to the tone generator circuit 15 in step SB6. The sound source circuit 15 stops sound generation after continuing sound generation for a predetermined release time after an instruction to stop sound generation is given. If no note-off event is detected, the process proceeds to step SB7 indicated by a NO arrow.

  In step SB7, it is determined whether or not the tone generator circuit 15 is currently producing a musical sound even after a predetermined release time has elapsed. If sounding is in progress, the process proceeds to step SB8 indicated by a YES arrow, and if not sounding, the process proceeds to step SB15 indicated by a NO arrow, and the vibrato imparting process is terminated. In addition, when it transfers to step SB7 directly from step SB5, it is not necessary to consider predetermined release time.

  In step SB8, a set of vibrato data VD is read. That is, the amplitude data and period data included in the vibrato data VD are read according to the current interrupt period.

In Step SB9, the amount of change in the vibrato depth and speed (cycle) by the vibrato control operator (for example, the modulation wheels 51 and 52 in FIG. 7) is obtained. The amount of change obtained here is input to the multipliers 104 and 107 in FIG. 7 as, for example, the coefficients _km1 and _km2 .

In step SB 10, specify the speed information of vibrato read in step SB8 change amount of vibrato speed obtained in step SB9 in (cycle data) speed sinusoidal wave output from (coefficient _{k m @ 2)} multiplied by LFO108 (cycle) to (supplied vibrato cycle data multiplied by the coefficient _{k m @ 2} to LFO108). The LFO 18 performs a calculation based on the equation (2) described with reference to FIG. 7 and outputs a calculation result.

In step SB11, by which the LFO envelope by multiplying the depth information of the vibrato read in step SB8 (amplitude data) is multiplied further change amount of vibrato depth determined in step SB9 a (coefficient _{k m1),} LFO108 Specifies the amplitude of the sine wave output from (determines the value to be multiplied by the multiplier 105 to the output of the LFO 108). And then outputs the change amount of vibrato depth output LFO108 multiplied by (coefficient _{k m1),} to the tone generator 15 as a vibrato control signal Sv. Note that the tone generator circuit 15 modulates the musical tone instructed to be sounded in step SB3 by using the vibrato control signal Sv, and outputs a musical tone to which a vibrato effect is added.

  In step SB12, the read position of the vibrato data VD is advanced in response to the interrupt of the timer 4.

  In step SB13, it is determined whether or not the reading of the vibrato data VD has reached the end of the loop (for example, timing t2 in FIG. 4 or timing t21 in FIGS. 5 and 6). When the loop end is reached, the process proceeds to step SB14, where the read position of the vibrato data VD is updated to the loop start end (for example, the timing t1 in FIG. 4 or the timing t11 in FIGS. 5 and 6), and then the process returns to step SB5. . If the end of the loop has not been reached, the process returns to step SB5 indicated by the NO arrow.

  FIG. 10 is a block diagram showing an example of an algorithm applied to the tone generation unit 150 when generating a tone signal. Note that the algorithm applied to the tone generator 150 is not limited to this example, and the waveform data stored in the waveform memory 10 may be modulated in accordance with the vibrato control signal Sv generated in the vibrato generator 100. That's fine. Alternatively, a musical sound may be generated by calculation without having waveform data as in the FM method, and the vibrato control signal Sv may be reflected in the calculation.

  First, when a MIDI note-on signal for instructing sound generation related to waveform data is supplied from the MIDI interface 7 to the electronic music device 50, the CPU 1 instructs the sound source unit 15 to sound the waveform data. . In response to this, the tone generator 15 synthesizes a tone signal having vibrato.

  The sound generation instruction from the CPU 1 includes waveform address information WA indicating an attack portion and a loop portion of waveform data used for sound generation, pitch shift information PS0 (cent) of the waveform data, and a volume envelope to be added to the waveform data. Waveform envelope information WE indicating the shape of the waveform. Here, the pitch shift information PS0 will be described. First, each waveform data stored in the waveform memory 10 is obtained by sampling a musical tone signal having a certain pitch at a predetermined sampling period. If the sampling period at the time of recording is equal to the sampling period at the time of reproduction, if the waveform data is read by “1” samples at each sampling period, the read tone signal has the same pitch as that at the time of recording. . However, when actually reading the waveform data, the pitch to be generated differs from the pitch at the time of sampling. The pitch shift information PS0 represents a difference in cents between a pitch when the waveform data is read out by “1” samples for each sampling period and a pitch to be actually generated. For example, if the former pitch is “C3” and the latter pitch is “C4”, the pitch shift information PS0 is “1200” (cents).

  A vibrato control signal Sv is input from the vibrato generation unit 100. The maximum value of the vibrato control signal Sv is “1”, and the minimum value is “−1”. When the maximum pitch shift fluctuation amount Δfpsmax which is the maximum value of the fluctuation amount to be added to the pitch shift information PS0 (cent) is designated, the multiplier 206 multiplies the vibrato control signal Sv by the maximum pitch shift fluctuation amount Δfpsmax. The pitch shift fluctuation amount Δfps (cent) as a result of the multiplication is added to the pitch shift information PS0 in the adder 200, and the adder 200 outputs the pitch shift information PS1 with vibrato added.

  The linear conversion unit 201 converts pitch shift information PS1 that is frequency ratio information of a cent scale into an f number that is frequency ratio information of a linear scale. The phase generator 202 generates and outputs phase information PH by accumulating the f number from the linear conversion unit 201 every sampling period. The address generator 204 outputs a common address signal AD for reading the waveform data 10a and 10b based on the phase signal PH and the waveform address information WA. The address generator 204 generates the address signal AD so that the attack part is read out only once at first, and then the loop part is repeatedly read out according to the phase related to the phase signal PH and the waveform address information WA.

  As a result, the waveform data 10a and 10b subjected to frequency modulation with the pitch shift fluctuation amount Δfps in the same phase are read from the waveform memory 10 for each sampling period. The read waveform data 10 a and 10 b are weighted by multipliers 214 and 218 and synthesized by adder 222. The synthesized tone signal is subjected to amplitude modulation in the multiplier 224, and the result is output to the sound system 16 as a tone signal Sout having vibrato.

  The delay circuit 210 delays the vibrato control signal Sv by a time corresponding to the designated phase difference Φ1. Multiplier 212 multiplies delayed vibrato control signal Sv by maximum weighting coefficient ΔG1max, and outputs the result as weighting coefficient ΔG1. The maximum weighting coefficient ΔG1max is a coefficient set in the range of “0 to 0.5”.

  The adder 216 adds the weighting coefficient ΔG1 and the basic weight value “0.5”, and supplies the addition result to the multiplier 214 as the upper weight value GU. Further, the adder 220 subtracts the weighting coefficient ΔG1 from the basic weighting value “0.5” and supplies the subtraction result to the multiplier 218 as the lower weighting value GD. As a result, it is understood that the sum of weights (GU + GD) given to the waveform data 10a and 10b is always “1”. When the phase difference Φ1 is set to “0”, the delay time in the delay circuit 210 also becomes “0”, and the timing at which the traveling speed of the address signal AD is maximized (the timing at which the peak of the pitch of the tone signal appears) is multiplied. The timing at which the weighting of the upper musical tone signal is maximized in the unit 214 is completely coincident. Further, by specifying a value other than “0” as the phase difference Φ1, it is also possible to shift the timing of both.

  The delay circuit 226 delays the vibrato control signal Sv by a time corresponding to the designated phase difference Φ2. Here, the phase difference Φ2 is the phase difference between the pitch vibrato and the amplitude vibrato to be applied to the musical tone signal. Multiplier 228 multiplies delayed vibrato control signal Sv by maximum amplitude variation coefficient ΔG2max, and outputs the result as amplitude variation coefficient ΔG2. The maximum amplitude variation coefficient ΔG2max is a coefficient set in the range of “0 to 1.0”. The adder 230 adds the amplitude variation coefficient ΔG 2 and the basic amplitude coefficient “1”, and supplies the gain Gout as a result of the addition to the envelope generation unit 232. Based on the waveform envelope information WE, the envelope generator 232 generates a volume envelope waveform that controls the temporal change in volume from the rising edge to the falling edge of the musical sound signal, and combines the volume envelope waveform with the gain Gout. This is supplied to a multiplier 224 as a volume envelope waveform ED subjected to amplitude modulation. In the multiplier 224, the tone signal output from the adder 222 is subjected to amplitude control by the volume envelope ED, and the result is supplied to the sound system 16 as a tone signal Sout for each sampling period.

  As described above, according to the embodiment of the present invention, the pitch of the original sound waveform data provided with vibrato is detected and the temporal trajectory is recorded, and the time and pitch of each peak peak and trough are recorded from the recorded temporal trajectory. It is possible to extract a value, calculate the vibrato period from the time difference and the vibrato depth from the level difference, and record the calculated vibrato period and depth as time-series data from the sound generation timing. In addition, the vibrato period and depth recorded in this way are used as time-series data from the sounding timing, and a vibrato effect is added to the musical sound waveform data to achieve a natural vibrato that is close to the performance of an actual musical instrument. can do.

  Further, according to the embodiment of the present invention, it is possible to correct so that the seam when the vibrato data is reproduced in a loop is not discontinuous. Therefore, natural vibrato can be imparted to a musical sound of any length.

  Further, according to the embodiment of the present invention, it is possible to perform control to emphasize or weaken the depth and speed of vibrato.

  In the above-described embodiment, the vibrato data VD is prepared for each timbre, but the vibrato data VD may be applied not only to the corresponding timbre but also to other timbres. For example, the vibrato data VD obtained from the flute original sound waveform may be applied to the violin waveform data.

  In the above-described embodiment, the vibrato data VD is recorded every half cycle, but may be recorded every shorter cycle or may be recorded at a longer cycle. However, when recording with a short cycle, the amount of data becomes enormous, and when recording with a long cycle, the vibrato becomes rough and far from the original sound. Therefore, it is preferable to record the vibrato data VD every half cycle.

  In the above-described embodiment, the reading speed of the vibrato time-series data (amplitude data and period data) is constant even when the vibrato speed increases. However, the reading speed is changed according to the vibrato speed. You may do it.

  In the above-described embodiment, the vibrato control signal Sv is described as a sine wave. However, the present invention is not limited to this and may be a triangular wave. Moreover, you may use a rectangular wave etc. aiming at a special effect.

  The embodiments of the present invention may be applied to electronic musical instruments, personal computers + application software, karaoke devices, game devices, portable communication terminals such as mobile phones, automatic performance pianos, and the like.

  When applied to a portable communication terminal, not only when a predetermined function is completed with only the terminal, but also a part of the function is provided on the server side, and the predetermined function is realized as a whole system composed of the terminal and the server. You may make it do.

  In the case of taking the form of an electronic musical instrument, the operation unit 5 includes a performance operator such as a keyboard. However, the form is not limited to a keyboard musical instrument, and may be a stringed instrument type, a wind instrument type, a percussion instrument type, or the like.

  In addition, the sound source device, the automatic performance device, etc. are not limited to those built in one electronic musical instrument body, but each is a separate device, and each device is connected using communication means such as MIDI or various networks. There may be.

  Further, this embodiment may be implemented by a commercially available computer or the like in which a computer program or the like corresponding to this embodiment is installed.

  In that case, the computer program or the like corresponding to the present embodiment may be provided to the user while being stored in a storage medium that can be read by the computer, such as a CD-ROM or a floppy disk.

  When the computer or the like is connected to a communication network such as a LAN, the Internet, or a telephone line, a computer program or various data may be provided to the computer or the like via the communication network.

  Although the present invention has been described with reference to the embodiments, the present invention is not limited thereto. It will be apparent to those skilled in the art that various modifications, improvements, combinations, and the like can be made.

It is a block diagram showing the hardware constitutions of the electronic music apparatus 50 by the Example of this invention. It is a flowchart showing the production process of the vibrato data VD by the Example of this invention. It is a conceptual diagram for demonstrating the production process of vibrato data VD. It is a schematic diagram showing the 1st example of the loop process of the vibrato data VD by the Example of this invention. It is a schematic diagram showing the 2nd example of the loop process of the vibrato data VD by the Example of this invention. It is a schematic diagram showing the 3rd example of the loop process of the vibrato data VD by the Example of this invention. It is a block diagram showing the algorithm applied to the vibrato provision process by the vibrato production | generation part 100 by the Example of this invention. 6 is a graph showing fluctuations in the output of an LFO EG generator 102. It is a flowchart showing the vibrato provision process by the Example of this invention. It is a block diagram showing an example of the algorithm applied to the musical sound production | generation part 150 at the time of the production | generation of a musical sound signal.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... ROM, 3 ... RAM, 4 ... Timer, 5 ... Operation part, 6 ... Display, 7 ... MIDI interface, 8 ... Drive apparatus, 9 ... Recording medium, 10 ... Waveform memory, 11 ... Access management , 12 ... external waveform input terminal, 13 ... writing circuit, 14 ... buffer, 15 ... sound source unit, 16 ... sound system, 17 ... bus, 50 ... electronic music device, 51,52 ... modulation wheel, 100 ... vibrato generation 101: Vibrato depth reading unit, 102 ... LFO EG generation unit, 103, 104, 105, 107 ... Multiplier, 106 ... Vibrato period reading unit, 108 ... LFO, 150 ... Musical sound generation unit, 200 ... Adder, DESCRIPTION OF SYMBOLS 201 ... Linear conversion part, 202 ... Phase generator, 204 ... Address generator, 206 ... Multiplier, 210 ... Delay circuit, 212, 214 218 ... multiplier, 220, 222 ... adder, 224, 228 ... multiplier, 226 ... delay circuit, 232 ... envelope generator

Claims (8)

Pitch acquisition means for acquiring a temporal trajectory of the pitch from the original sound waveform data;
Extraction means for extracting the time and pitch of each peak peak and valley from the time trajectory of the acquired pitch;
Vibrato period calculating means for calculating period information of vibrato from the difference in time between the peak and valley of the extracted peak;
Vibrato depth calculation means for calculating vibrato depth information from the difference in pitch between the peaks and valleys of the extracted peak;
Recording means for recording the vibrato period information and the vibrato depth information as a set together with the time from the sound generation start time of the original sound waveform data as time series data,
An electronic music apparatus comprising setting means for setting a loop start end and a loop end in the time series data. Recording means for recording time series data together with the time from the sound generation start time of the original sound waveform data as a set of vibrato period information and vibrato depth information set with the loop start end and loop end;
Pronunciation instruction detecting means for detecting a pronunciation instruction;
Read means for reading out the time-series data from the read-out means as time elapses according to the sound generation instruction, and after reading out the time-series data to the end of the loop, read-out means for reading out again from the loop start end When,
Vibrato control signal generating means for generating a vibrato control signal in accordance with vibrato period information and vibrato depth information included in the read time-series data;
An electronic music apparatus comprising: a tone generation unit that starts generating a tone according to the sound generation instruction and modulates a tone according to the vibrato control signal. Furthermore, a control signal acquisition means for acquiring a control signal for controlling the vibrato cycle and the vibrato depth;
3. The electronic music apparatus according to claim 2, further comprising an increase / decrease unit that increases / decreases the vibrato period and vibrato depth of the vibrato control signal based on a control signal for controlling the vibrato period and vibrato depth. The electronic music apparatus according to claim 1, further comprising correction means for correcting a connection portion from the loop end to the loop start end. The electronic music apparatus according to claim 4, wherein the correction unit corrects an inclination within a predetermined range from the vicinity of the loop end so as to be connected to the loop start end. 5. The electronic device according to claim 4, wherein the correction unit fades out a data string in a predetermined range from the vicinity of the loop end and crossfades by fading in a data string in a predetermined range before the loop start end of the time series data. Music device. A pitch acquisition procedure for acquiring a temporal trajectory of the pitch from the original sound waveform data;
An extraction procedure for extracting the time and pitch of each peak peak and trough from the time trajectory of the acquired pitch;
A vibrato period calculation procedure for calculating vibrato period information from the difference in time between the peak and valley of the extracted peak;
A vibrato depth calculation procedure for calculating vibrato depth information from the difference in pitch between the peak and valley of the extracted peak;
A recording procedure for recording the vibrato period information and vibrato depth information as a set in the storage means as time series data together with the time from the sound generation start time of the original sound waveform data,
A program having a setting procedure for setting a loop start end and a loop end in the time-series data. Pronunciation instruction detection procedure for detecting pronunciation instructions;
In accordance with the sound generation instruction, as time elapses, time is set with the time from the sound generation start time of the original sound waveform data as a set of vibrato period information and vibrato depth information for which the loop start end and loop end are set. A reading procedure for reading the time series data from the recording means for recording as series data, and after reading the time series data to the loop end, a reading procedure for reading again from the loop start end,
A vibrato control signal generating procedure for generating a vibrato control signal according to the vibrato period information and the vibrato depth information included in the read time-series data;
A program having a tone generation procedure for starting tone generation in response to the pronunciation instruction and modulating the tone in accordance with the vibrato control signal.