JPH0348288A - Musical sound controller - Google Patents

Abstract

PURPOSE:To realize an impressive integral performance by varying and controlling characteristics of audio data reproduced by a reproducing means according to a detected performance state. CONSTITUTION:Performance information detecting means 202 - 205 which detect the performance state as performance information detect, for example, keyboard operation, string operation, or the press operation, foot switch operation, etc., of an electronic wind instrument as velocity data. An audio data control means 112 varies and controls the characteristics of the audio data reproduced by the reproducing means 100 according to the performance information detected by those performance information detecting means 202 - 205. Therefore, when fast key pressing operation is performed, the sound volume is increased and the sound volume of the audio data which is reproduced is also increased associatively. Consequently, the impressive integral performance can be realized.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to a musical tone control device that combines an electronic musical instrument and an audio data reproducing device such as a CD player.

[Conventional technology]

In order to add richer performance effects to the performance expressiveness of electronic musical instruments such as keyboards, electronic musical instruments are combined with compact disc players (CD players, hereinafter the same), etc. that play audio playback sounds based on audio data. Musical tone control devices are attracting attention. With such a combination, for example, in a song composed of parts played by multiple instruments, the so-called minus one song, which excludes the melody of a specific part, can be played back as audio data on a CD player, etc. while that specific part is being played. It becomes possible to perform organically, such as playing with an electronic musical instrument.

In a conventional example of a musical tone control device realized as a combination of an electronic musical instrument and an audio data playback device, musical tones controlled by the electronic musical instrument are generated in accordance with the playing state of the playing section such as the keyboard, strings, or wind pipe. It is conceivable that the audio data controlled by the electronic musical instrument and reproduced by an audio data reproducing device such as a CD player is reproduced independently of the performance state of the electronic musical instrument. [Problem to be Solved by the Invention] However, in the case of the above-mentioned conventional example, when a musical tone is generated by a performance operation in synchronization with audio playback sound based on audio data on a CD player, for example, when a musical tone is generated by a performance operation, the electronic musical instrument generates a musical tone. Although it is possible to add various changes to the characteristics of musical sounds (e.g. volume and pitch) based on performance operations, on the audio playback side, unless the volume, quality knob, equalizer, etc. The characteristics of the audio data to be processed are constant. Therefore, even if the production of musical tones based on performance operations and the reproduction of audio playback sounds based on audio data are performed in conjunction with each other, there is a problem in that a powerful performance cannot be performed.

An object of the present invention is to variably control the characteristics of audio data played back from a playback device according to the performance state of an electronic musical instrument, thereby realizing a powerful performance with a sense of unity. [Means for Solving the Problems] First, the present invention includes performance information detection means for detecting a performance state as performance information. The means can, for example, perform keyboard operations on electronic keyboard instruments, string operations on electronic stringed instruments, press operations on electronic wind instruments, or operation of foot switches attached to these electronic instruments and used during performance.
This is a means of detecting it as velocity data or the like. In addition,
The keyboard, strings, pipes, foot switches, etc. may be connected to the outside via MIDI or the like.

Next, it has musical tone control means for controlling characteristics of musical tones in accordance with the performance information detected by the performance information detection means. The means is, for example, a sound source circuit such as a PCM method, a waveform modulation method, an overtone addition method, or an overtone subtraction method.

Next, it has a reproduction means for reproducing audio reproduction sound based on the audio data. The means is, for example, a compact disc player. Of course, a DAT (digital audio tape recorder) or the like may also be used.

The apparatus further includes audio data control means for variably controlling the characteristics of the audio data reproduced by the reproduction means in accordance with the performance information detected by the performance information detection means. The means is means for controlling, for example, the volume, surround characteristics, equalizing characteristics, etc. of the audio data 5 reproduced by the reproducing means, in accordance with performance information such as velocity data. In this case, the above characteristics may be controlled using data obtained by converting performance information using an appropriate conversion table. In the above configuration, the performance information detection means is capable of detecting each performance state in a plurality of performance forms such as, for example, a keyboard operation in an electronic keyboard instrument, a string operation in an electronic stringed instrument, a press operation in an electronic wind instrument, or a foot pedal operation, A mode selection means is provided for selecting a mode of any one performance form among the performance forms, and the audio data control means reproduces the data using the reproduction means with characteristics corresponding to the performance form selected by the mode selection means according to the performance information. The characteristics of the audio data that is displayed may be variably controlled. In this case, the above characteristics are variably controlled based on data obtained by converting performance information such as velocity data using a conversion table corresponding to each performance form. [Operation] When playing a piece of music with a predetermined tone through the musical tone control means, the playback means also plays back an audio playback sound based on, for example, audio data of another part of the piece of music. In this case, according to the performance information detected by the performance information detection means, the characteristics of the musical tone (for example, volume, pitch,
At the same time, the characteristics of the audio data reproduced by the reproduction means, such as the volume, are variably controlled.

Therefore, for example, when a key is pressed quickly (strongly) on an electronic keyboard instrument, the volume of the generated musical tone, for example, is emphasized, and the volume of the audio data reproduced in conjunction with this is also emphasized. As a result, it is possible to realize a powerful performance with a sense of unity between the musical tone and the audio playback sound.

In addition to the volume, the characteristics of audio data include
Alternatively, if, for example, a surround effect or an equalizing effect is controlled instead, richer performance expression can be achieved.

〔Example〕

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is an overall circuit configuration diagram of a musical tone control device equipped with an electronic musical instrument and a compact disc player, which is a first embodiment of the present invention. In the figure, a portion surrounded by a dashed line 100 is a CD player section (hereinafter referred to as CD player section 100);
A portion surrounded by a dashed line 200 is an electronic musical instrument section (hereinafter referred to as electronic musical instrument section 200).

First, the block structure of the CD player section 100 will be explained. The CD 105 is a compact disc, and is played by being set in a part of the holder (not shown) of the CD player section 100. The CD operation section 101 includes switches for playback functions such as start and stop, switches for pause functions, and switches for special functions such as random memory song selection, which are provided in a normal CD player. The CD control section 102 is, for example, a microprocessor, controls the entire CD player section 100, and exchanges subcode data with the subcode signal processing circuit 115. Further, when driving the CD 105, the disk servo circuit 103 and the pickup servo circuit 104
, outputs a drive control signal.

The disk servo rotation iml03 controls the rotation speed of the disk motor 106 that rotationally drives the CD 105.
Linear velocity of each track of CD105 (Linear Ve
control so that the location (locity) remains constant. The pickup servo circuit 104 also includes an optical pickup 107 that irradiates each track of the CD 105 with a laser beam.
Performs focus servo and tracking servo. The focus servo detects a focus error from the state of the reflected light of the laser beam, and controls and drives the objective lens in the optical pickup 107 in the optical axis direction based on the focus error. - The servo directs the laser beam emitted from the optical pickup 107 to CD 1 while detecting the deviation of the laser beam from the center of the track of CD 105.
The optical pickup 10 is controlled and driven in the radial direction of 0.05.
This is to control the laser beam irradiated from 7 to accurately irradiate the center of the track of the CD 105.

Here, protrusions called pits are carved on the side that is irradiated with the C and D105 laser beams, and PCM signals (digital signals) are recorded by these. The optical pickup 107 detects the presence or absence of a pit based on the amount of reflected light from the irradiated laser beam, and outputs an electric signal corresponding to the presence or absence of the pit and its length to the demodulation circuit 108.

The demodulation circuit 108 detects a frame synchronization signal from the electrical signal output from the optical pickup 107, identifies the division and order of frames, which are units of reproduction processing of audio data and subcodes, and further identifies the EFM in each frame.
Demodulate the modulated data. And the above E F M
Of the yLffl data, the audio data is output to the audio data signal processing circuit 109, and the subcode is output to the subcode signal processing circuit 1115.

The audio data signal processing circuit 109 stores input audio data in an internal RAM (not particularly shown).
, error correction processing is performed based on the Reed-Solomon code, and decreep processing is performed to restore each sample of 16-bit digital audio data in frame units. Then, each of these sample data is transferred to a D/A converter (digital/analog converter) 1.
Output to 10. Note that this output is stereo.

The D/A converter 110 includes an LPF (low-pass filter) 1 having a cutoff frequency of 2 of the sampling frequency.
11, it converts the input 16-bit digital audio data (stereo) into a corresponding stereo analog signal and outputs it to the electronic volume 112. The electronic volume 112 is connected to a musical tone control circuit 201 which will be described later.
stereo analog audio data whose volume is controlled by the amplifier 1l3
The sound is emitted to the outside via the speaker 114. The subcode signal processing circuit 115 performs error detection and correction processing, as well as de-interleaving processing, on the subcode data to restore the subcode. Then, specific bits of the restored subcode are transmitted to the CD control unit 1.
Output to 02. Based on this, the CD control unit 102
Controls music selection, understands and controls the time progression of each music program, etc.

Next, the block configuration of the electronic musical instrument section 200 will be explained. The musical instrument control unit 201 is, for example, a microprocessor, and includes a key touch detection circuit 202, a string vibration detection circuit 203, a press operation detection circuit 204, and a foot pedal detection circuit 20.
The detection signal of each operation from 5 is sent to an internal A/D converter 21.
3, convert it to a digital signal and set it in each register 214 (there are multiple). And the performance mode switching circuit 20
Based on the switching signal from 6, one of the operation detection signals set in the register 214 is converted using a conversion table (not shown), and the electronic volumes 112 and 210 are controlled based on the conversion table. Further, the sound source circuit 207 is controlled based on the operation detection signal and particularly note on/off, key code, etc. (not shown).

Key touch detection circuit 202, string vibration detection circuit 203, press operation detection circuit 204, and foot pedal detection circuit 205
are key touch information, string vibration information, which are input from a keyboard instrument input section, a string instrument input section, a wind instrument input section, and their attached foot pedals, which are respectively connected to the outside via a MIDI interface (not shown). Press information and information on the amount (angle) of foot pedal depression are detected and output to the musical instrument control section 201. The electronic musical instrument section 200 itself may have the form of an electronic keyboard instrument incorporating one of the above input sections, for example, a keyboard instrument input section and a foot pedal. The sound source circuit 207 uses, for example, a PCM method, a waveform modulation method,
This is a sound source using a harmonic addition method, a harmonic subtraction method, etc., and generates a corresponding digital musical tone signal based on the control from the musical tone control section 201 described above.

The digital musical tone signal is input to a D/A converter 208 and an LP having a cutoff frequency of % of the sampling frequency.
F (low-pass filter) 209 converts it into a corresponding analog musical tone signal, and outputs it to an electronic volume 210. The electronic volume 210 is controlled by the above-mentioned musical tone control section 201, and an analog musical tone signal whose volume is controlled thereby is emitted to the outside via an amplifier 211 and a speaker 212.

In the above configuration, the electronic volumes 112 and 210
is a circuit that electronically controls the volume of the input signal using digital data from the musical instrument control section 201. For example, a circuit that selects one of a plurality of resistance values according to digital data, or a circuit that selects one of a plurality of resistance values according to digital data, or a circuit that controls the volume of an input signal according to digital data. Various formats can be adopted, such as those that change the amplification degree of . The operation of the first embodiment of the above structure will be explained using the operation flowchart in each performance mode shown in FIG. 2 and the operation flowchart for CD playback shown in FIG. 3.

2(a) to 2(d) show that the instrument control section 201 is activated when each of the keyboard instrument mode, string instrument mode, wind instrument mode, or foot pedal mode is selected in the performance mode switching circuit 206 of FIG. 3 is a flowchart of each operation of a program to be executed. These programs are stored in a ROM (not shown) or the like, and are stored in the instrument control section 20.
A part (subroutine) of the main operation flowchart (not shown) that is repeatedly executed at high speed in 1.
is executed repeatedly.

First, the operation when the keyboard instrument mode is selected by the performance mode switching circuit 206 will be explained based on FIG. 2(a).

First, information on the key touch state (key pressing speed) from a keyboard instrument input section (not shown) detected by the key touch detection circuit 202 in FIG. 1 is taken into the musical instrument control section 201, and A/D conversion converter 214 into a digital value (
Sl. ).

The detected key touch digital value is stored in the register 214 for keyboard instrument mode (52.).

Then, the key touch digital value stored in the register 214 is converted into a control data value suitable for the volume characteristics of the instrument side and the CD side, using an appropriate conversion table for the keyboard instrument mode (not shown). The signal is output to the electronic volume 210 on the musical instrument side and the electronic volume 112 on the CD side (53.).

The above-mentioned operations are executed every time the main operation flowchart (not shown) is repeated.

Next, when the stringed instrument mode is selected by the performance mode switching circuit 206, the operation flowchart shown in FIG. 2(b) is executed.

First, the string vibration state detected by the string vibration detection circuit 203 in FIG.
The information on the string force) is taken into the instrument control section 201, and the
It is converted into a digital value by the D converter 214 (Slb)
.

The detected string vibration digital value is stored in the string instrument mode register 214 (S2b).

Then, the string vibration digital value stored in the register 214 is converted to a value suitable for the volume characteristics of the instrument side and the CD side, using an appropriate conversion table for the string instrument mode (not shown) in the same manner as in the keyboard instrument mode. After being converted into control data values, they are output to the electronic volume 210 on the musical instrument side and the electronic volume 112 on the CD side (S3
b).

Furthermore, when the wind instrument mode is selected by the performance mode switching circuit 206, the operation flowchart shown in FIG. 2(C) is executed.

First, information on a press operation state (alternatively, a lip operation state may be used) from a wind instrument input section (not shown) detected by the press operation detection circuit 204 in FIG. 1 is taken into the musical instrument control section 201. A/D converter 214
It is converted into a digital value (Slc).

The detected press digital value is stored in the register 214 for wind instrument mode (52.).

Then, the press digital value stored in the register 214 is converted to a value suitable for the volume characteristics of the instrument side and the CD side, using an appropriate conversion table for the wind instrument mode (not shown), in the same way as in the case of the keyboard instrument mode, etc. After being converted into control data values, the electronic volume 210 and CD on the instrument side
Each is output to the electronic volume 112 on the side (S
3c).

Further, when the foot pedal mode is selected in the performance mode switching circuit 206, the operation flowchart shown in FIG. 2(d) is executed.

First, information on the foot pedal status (depression amount or angle) from a foot pedal (not shown) detected by the foot pedal detection circuit 205 in FIG. It is converted into a digital value (Sld).

The detected foot pedal digital value is stored in the foot pedal mode register 214 (S2a).

The foot pedal digital value stored in the register 214 is converted into a control data value suitable for the volume characteristics of the instrument side and the CD side, using an appropriate conversion table for the foot pedal mode (not shown). Electronic volume 2, 10 on the instrument side and electronic volume 11 on the CD side
2 (S3a) - FIG. 3 shows the reproduction operation of the audio reproduction sound based on the audio data, which is executed in the CD player section 100 in parallel with the operation in the musical instrument control section 201 described above. This is an operation flowchart. First, when the CD start key is operated in the CD operation unit 101, the audio data signal processing circuit 10
9, the reproduction operation of the audio reproduction sound based on the audio data is performed (S4).

Then, the above operation is repeated until the end of playback of the audio playback sound based on the audio data is detected (5
5→S4). When the end of playback is detected, the CDIII control section 10 in FIG.
2 controls the disc servo circuit 103 to stop driving the disc motor 106, and ends CD playback (S
5-56) After that, the process shifts to a standby state operation flow, etc., which is not particularly shown. An example of the operation of the first embodiment realized by the operation flowcharts of FIGS. 2 and 3 above will be described with reference to the operational conceptual diagram of FIG. 4.

As shown in Figure 4, on the CD105 (see Figure 1),
The audio data is recorded in a program area 301 (FIG. 3(a)) from the inner track to the outer track of the CD 105, and a plurality of songs are part songs A,
It is recorded as part song B,... (in the same figure))
. In the same figure (a), the innermost area of the disc (area with a diameter of 46 mm to 50 mm) is called a lead-in area 302, and this area contains TOC (Table of Contents) as subcode data.
) is recorded, which corresponds to the table of contents for one disc. This TOC data is detected by the CD control section 102 via the subcode signal processing circuit 115 shown in FIG. 1, and music selection, music progression time control, etc. are performed.

From the above-mentioned recording format, conceptually, over time, CD
Part music A and part music B are played in the order from the inner track to the outer track of the No. 105 disc.

In synchronization with this, when the performer operates, for example, any of the keyboard instrument input section, string instrument input section, wind instrument input section, or mat pedal, the performance state detected by the operation is as shown in Fig. 3(C). (In the same figure, the key touch force is shown. For example, at the beginning of the playback of part song A of the audio data being played, the performance is performed with a large key touch force (fast key operation), and at an intermediate position, the key touch force changes as follows. , the player performs with a moderate key touch force, and in the final stage, plays with a gradually weaker key touch force).

In synchronization with this, the volume level of musical tones produced from the speaker 212 of the electronic musical instrument section 200 changes as shown in FIG. It changes as shown in the figure (a). Note that by changing each change characteristic in the musical instrument control section 201, it is possible to control changes in each volume level so that they have different characteristics. In the first embodiment, the D/A converter 11 in FIG.
0 to the speaker 114 are shown as monaural data, but in reality, the above operation is performed on stereo audio data.

FIG. 5 shows the CD of FIG. 1 as a second embodiment of the present invention.
This figure shows a case where a surround circuit is provided in place of the electronic volume 112 of the player section 100, and this circuit is controlled by the musical instrument control section 201 of FIG. 1 according to the performance state.

In the figure, the left channel of LPFIII in Figure 1 (
First, the difference signal circuit 401 outputs (L cb, the same applies below) and the right channel (Rch, the same applies below).
ch-Rch) difference signal is generated.

This difference signal is delayed by a variable delay circuit 402, and the level of the delayed signal obtained thereby is controlled by a level control circuit 404, and its output is sent to an adder 405L and a subtracter 405.
m, addition and subtraction are performed on each of the Lch and Rch signals.

These processed Lch and Rch signals are amplified by amplifiers 406L and 406m, respectively, and then sent to a speaker 407.
The sound is emitted from L and 407R.

On the other hand, the parameter register 403 selects a predetermined set of data from pre-stored sets of delay time control data and level control data in response to a control signal from the musical instrument control unit 201 shown in FIG. The variable delay circuit 40
2 and level control circuit 404. This results in
The delay time and level are controlled via both circuits 402 and 404 depending on the performance state.

For example, in the case of a large hall, the delay time is 3.2 seconds.
, the level is set to -10 dB, and in the case of a small hall, the delay time is set to 1.8 sec, and the level is set to -5 dB. One of these sets is selected and its control data is output.

Of course, a separate rear speaker may be provided to supply surround signals (outputs of 405L and 405R) to one rear side. Furthermore, the phase and frequency characteristics may be controlled.

FIG. 6 shows the CD of FIG. 1 as a third embodiment of the present invention.
This figure shows a case where an equalizer circuit is provided in place of the electronic volume 112 of the player section 100, and this is controlled by the musical instrument control section 201 of FIG. 1 according to the performance state.

In the same figure, the Lch output of the LPFI 1 in FIG.
and a level control circuit 502L for each output.
Level control is performed by l to 502LJ, and their respective outputs are added by adder 503L to produce the left channel output (L c
h out) to the same amplifier, speaker, etc. as shown in FIG.

Similarly, the Rch output of LPFIII (Fig. 1) is input to BPFs 501Rl to 501R4 with different center frequencies, and level control circuits 502RI to 50R4 are applied to each output.
2R4 performs level control, and each output is sent to an adder 50.
3R is added, and the right channel output (R chou
t), it is output to the same amplifier, speaker, etc. as in FIG.

Then, in response to a control signal from the musical instrument control section 201 shown in FIG. A certain set of data is selected and the level control circuits 502, 1 to 502L4 and 5
Output from 02■ to 502114. Thereby, the level of each frequency band is controlled according to the performance state.

For example, bass sounds may be emphasized, only high and low frequencies may be emphasized, or unnecessary high pitches may be cut off to emphasize the voice range (singing voice).

In the first to third embodiments described above, audio data is recorded on a CD and played back via a CD player, but the audio data is not limited to CDs, and is not limited to DAT (
A digital audio tape recorder) or the like may also be used. In addition to the above-mentioned embodiments, the operating states of the modulation wheel and pitch bend wheel in an electronic keyboard instrument, the operating state of the tremolo arm and the bending operating state of the strings in an electronic stringed instrument, and the lip operating state of an electronic wind instrument (each of these When the operation is performed, the pitch or the like of the musical tone to be generated can be changed or modulated.) The characteristics (for example, the volume) of the audio data to be reproduced may be variably controlled.

〔Effect of the invention〕

According to the present invention, the characteristics of the audio data played back by the playback means are variably controlled according to the performance information detected by the performance information detection means, so that fast (strong) key depression operations can be performed on, for example, an electronic keyboard instrument. For example, the volume of the audio data that is played in conjunction with this can be controlled to be emphasized, making it possible to realize a performance that is powerful and has a sense of unity. Furthermore, if, as a characteristic of the audio data, in addition to or instead of the volume, for example, a surround effect or an equalizing effect is controlled, a richer performance expression can be realized in accordance with the above-mentioned performance information. becomes possible.

[Brief explanation of drawings]

FIG. 1 is a composition diagram of the first embodiment of the present invention, and FIG. 2 (a
) to (d) are operation flowcharts in each performance mode, FIG. 3 is an operation flowchart for CD playback, and FIG.
) to (b) are operational conceptual diagrams of the first embodiment, and FIG.
A block diagram of the surround circuit in the second embodiment. FIG. 6 is a block diagram of the equalizer circuit in the third embodiment. 100...CD player section, 101...CD operation section, 102...CD control section, 103...disk servo circuit, 104...pickup servo circuit, 105...C
D, 106... Disk moder, 10.7... Optical pickup, 108... Demodulation circuit, 109... Audio data signal processing circuit, 110,
208... D/A converter, 111, 209... Low pass filter (LPF), 112, 210... Electronic volume, 113, 211
...Amplifier, 1 1 4, 115 ・ 200 ・ 201 ・ 202 ・ 203 ・ 204 ・ 205 ・ 206 ・ 207 ・ 2 13 ・ 2 14 ・ l2...Subika, ・Subcode signal processing circuit, ・Electronic musical instrument section , - Instrument control section, - Key touch detection circuit, - String vibration detection circuit, - Press operation detection circuit, - Foot pedal detection circuit, - Performance mode switching circuit, - Sound source circuit, - A/D converter, - Register.

Claims (1)

[Scope of Claims] 1) Performance information detection means for detecting a performance state as performance information; musical tone control means for controlling the characteristics of a musical tone according to the performance information detected by the performance information detection means; and an audio system based on audio data. a reproduction means for reproducing the reproduced sound; and performance information detected by the performance information detection means,
A musical tone control device comprising: audio data control means for variably controlling characteristics of audio data reproduced by the reproduction means. 2) The performance information detecting means is capable of detecting each performance state in a plurality of performance forms, and includes mode selection means for selecting a mode of any one performance form among the plurality of performance forms, The data control means variably controls the characteristics of the audio data reproduced by the reproduction means according to the performance information detected by the performance information detection means according to the performance form selected by the mode selection means. A musical tone control device according to claim 1.