JP2010055077A - Controller - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a controller capable of outputting both a control signal and an audio signal from a single audio output terminal and of easily controlling an external device connected to the own device by only outputting the audio signal in which a control signal is superimposed. <P>SOLUTION: A guitar 1 is comprised of: a body 11 in which a string sensor 21 for detecting a vibration of a string 10, an attitude sensor 26 for detecting an attitude of the guitar 1 and an input part 25 for inputting an operation of controlling an external device are arranged; and a neck 12 in which a plurality of fret switches 22 detecting ON/OFF of a fret 121 are arranged. The guitar 1 is provided with a sound source, and generates an audio signal based on detection results (performance information) of the fret switches 22 and the string sensor 21. The guitar 1 generates a control signal for controlling the external device based on the performance information, attitude information from the attitude sensor 26 and operation information from the input part 25 so as to superimpose the control signal to the audio signal and output it. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a control device that can control external devices such as a mixer and a camera while a musical instrument is being played.

  Conventionally, various electronic musical instruments for controlling external devices have been proposed (see, for example, Patent Document 1).

  For example, when controlling a mixer from an electronic musical instrument, the electronic musical instrument stores a control signal for controlling the mixer as MIDI data, and outputs the MIDI data to the mixer for control. For this reason, the electronic musical instrument has to include an audio output terminal for outputting an audio signal and a MIDI terminal for outputting MIDI data.

  Therefore, in the data superimposing method of Patent Document 1, audio data and MIDI data are output from one terminal by superimposing and outputting MIDI data on digital audio data.

JP 2003-316356 A

  However, in the data superimposing method of Patent Document 1, since MIDI data is stored in the LSB (Least Significant Bit) of the audio data, it is converted into compressed audio such as MP3 or emitted as an analog audio signal. , There was a problem that associated information was lost. Although there are applications that handle audio data and MIDI data, there is no general-purpose data format, which is not convenient.

  Therefore, an object of the present invention is to provide a control device that can control an external device by superimposing and outputting a control signal on general-purpose audio data.

  The control device according to the present invention receives an operation input for controlling an external device (for example, an acoustic-related device such as an effector, a mixer, or an automatic performance device, or a stage-related device such as an illumination or a camera). The control device generates a control signal for controlling the external device according to the operation input. Then, the control device superimposes the control signal so that the modulation component of the control signal is included in a band higher than the frequency component of the audio signal generated in accordance with the performance operation, and outputs the control signal to the audio output terminal. For example, encoding can be performed by phase-modulating M-sequence pseudo noise (PN code) with a control signal. The frequency band for superimposing the tempo information is desirably a non-audible range of 20 kHz or higher. However, in the case where the non-audible range cannot be used due to D / A conversion or compression audio encoding, for example, a high frequency band of 15 kHz or higher is used. A control signal is superimposed on to reduce the influence on hearing.

  Thereby, the control apparatus can output both a control signal and an audio signal from one audio output terminal. In addition, the control device can easily control the external device connected to the own device only by outputting the audio signal on which the control signal is superimposed.

  The control device according to the present invention is a musical instrument that accepts, for example, performance operation inputs (on / off of guitar frets, string vibration, etc.) as operation inputs for controlling external devices. The control device includes storage means for storing performance information indicating a performance operation and a control signal in association with each other. And a control apparatus is good also as a structure which acquires the control signal according to the performance operation which received the input from a memory | storage means.

  Thereby, the musical instrument which is a control apparatus can control an external apparatus according to own performance operation during a performance. For example, the performer can change the effect of the effector or start the performance of an automatic performance device (for example, karaoke or the like) by performing a performance operation during the performance. Further, since the external device can be controlled according to the performance operation, it is not necessary to provide a new input means.

  Furthermore, the control device of the present invention may be configured to control an external device not only according to performance operation but also according to posture information (performer performance) by a posture sensor installed in the device itself.

  As a result, the performer controls the external device only by performing a performance such as changing the direction of the control device, so that the audio signal generated by the performance operation is not affected according to the music being played.

  In addition, the control device of the present invention includes a measuring unit that measures the elapsed time and the number of beats after the performance is started. The control device stores a reception period for receiving an input of a performance operation for controlling the external device in the storage unit in association with the control signal. And a control apparatus is good also as a structure which acquires the control signal according to performance operation from the memory | storage means, while the elapsed time which the measurement means measured is within a reception period. For example, the effector effect is changed only during the chorus section, or the mixer volume is increased during the solo performance.

  Thereby, since the control apparatus can control an external apparatus according to the time which passed after starting a performance, even if it is the same operation, it can control a different external apparatus according to the elapsed time. . In particular, the control device can change the effect and volume by controlling an external device (for example, an effector or a guitar amplifier) according to the elapsed time, so that a musical piece whose tune changes according to the elapsed time is played. It is suitable for use in some cases.

  In addition, the control device according to the present invention may include a registration unit that registers an operation for controlling an external device and a control signal corresponding to the operation in association with each other.

  Thus, the performer registers the control signal in advance in association with the performance operation that appears at a specific timing or the performance operation that does not affect the audio signal generated by the performance operation, according to the music to be performed. deep. The performer can control the external device by executing the registered performance operation. For example, the performer registers in advance a control signal associated with a performance operation indicating the start of a solo performance. When the performer performs a solo performance, the control device can control the spotlight to focus the spotlight on the performer. For example, a control signal is registered in advance in association with a performance operation that does not appear in the music to be performed. And if a performer performs the registered performance operation so that the audio signal according to performance operation may not be generated between music, a control device can change an effect sound by controlling an effector.

  Furthermore, the control device according to the present invention includes an audio signal generation means including a pickup and an acoustic microphone, and generates an audio signal based on vibration and sound of the control device. And a control apparatus is good also as a structure which superimposes and outputs a control signal on the produced | generated audio signal.

  As a result, the control device can be retrofitted to an existing musical instrument (for example, an acoustic guitar, a grand piano, a drum, etc.).

  The control device of the present invention can output both a control signal and an audio signal from a single audio output terminal, and can be connected to the own device only by outputting an audio signal on which the control signal is superimposed. The controlled external device can be easily controlled.

It is an external view which shows the external appearance of a guitar. It is a block diagram which shows the function and structure of a guitar. It is a figure which shows an example of a control signal database. It is explanatory drawing which shows an example of the performance environment of a guitar. It is a figure which shows another example of a control signal database. It is the top view which looked at the external appearance of the guitar equipped with the control apparatus from the upper surface. It is a block diagram which shows the function and structure of a control apparatus.

“First Embodiment”
A MIDI guitar 1 that is an electronic stringed instrument according to a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is an external view showing an external appearance of a guitar. FIG. 1A is a top view of the appearance of the guitar as seen from above. FIG. 1B is a partially enlarged view of the neck of the guitar. FIG. 2A is a block diagram showing the function and configuration of the guitar. FIG. 3 is a diagram illustrating an example of the control signal database.

  First, the external appearance of a MIDI guitar (hereinafter simply referred to as a guitar) 1 will be described with reference to FIG. As shown in FIG. 1, the guitar 1 includes a body 11 and a neck 12.

  The body 11 is provided with six strings 10 played by a guitar playing method and an output I / F 30 for outputting an audio signal. Each of the six strings 10 is provided with a string sensor 21 (see FIG. 2A) for detecting the vibration of the string 10.

  As shown in FIG. 1B, the neck 12 is provided with a fret 121 for dividing the scale. A plurality of fret switches 22 are arranged between the fret 121.

  Next, the function and configuration of the guitar 1 will be described with reference to FIG. As shown in FIG. 2A, the guitar 1 includes a control unit 20, a string sensor 21, a fret switch 22, a performance information acquisition unit 23, a tone generation unit 24, an input unit 25, a posture sensor 26, a storage unit 27, and a control signal. A generation unit 28, a superimposition unit 29, and an output I / F 30 are provided.

  The control unit 20 controls the performance information acquisition unit 23 and the tone generation unit 24 based on the volume and tone set in the guitar 1.

  The string sensor 21 includes a piezo sensor or the like, generates a waveform signal obtained by converting the vibration of the corresponding string 10 into a waveform, and outputs the waveform signal to the performance information acquisition unit 23.

  The fret switch 22 detects on / off of its own switch, and outputs a detection signal indicating on / off of the switch to the performance information acquisition unit 23.

  The performance information acquisition unit 23 acquires fingering information indicating the player's finger movement based on the detection signal from the fret switch 22. Specifically, the performance information acquisition unit 23 includes a note number associated with the fret switch 22 to which the detection signal is input, note-on (switch on), note-off (switch off) of the note number, To get.

  The performance information acquisition unit 23 acquires stroke information indicating the strength of the stroke based on the waveform signal from the string sensor 21. Specifically, the performance information acquisition unit 23 acquires a velocity (sound intensity) at the time of note-on.

  And the performance information acquisition part 23 produces | generates the performance information (MIDI message) which shows a player's performance operation based on the acquired fingering information and stroke information, and the musical sound production | generation part 24 and the control signal production | generation part 28 are produced | generated. Output to. Note that the performance information output to the control signal generator 28 is not limited to a MIDI message, and may be data in any format.

  The musical sound generation unit 24 includes a sound source, generates an analog audio signal based on the performance information input from the performance information acquisition unit 23, and outputs the analog audio signal to the superimposition unit 29.

  The input unit 25 receives an input of an operation for controlling the external device, and outputs operation information corresponding to the operation to the control signal generation unit 28. Then, the control signal generation unit 28 generates a control signal corresponding to the operation information from the input unit 25 and outputs the control signal to the superimposition unit 29.

  The posture sensor 26 outputs posture information generated by detecting the posture of the guitar 1 to the control signal generation unit 28. For example, the posture sensor 26 generates posture information (up) when the neck 12 faces upward with respect to the body 11, and generates posture information (left) when the neck 12 faces left with respect to the body 11. When the neck 12 faces the upper left with respect to the body 11, posture information (upper left) is generated.

  The storage unit 27 stores a control signal database (hereinafter, control signal DB) 271 as shown in FIG. The control signal DB 271 is referred to by the control signal generation unit 28. The control signal DB 271 is a database of specific performance information (for example, on / off of a specific fret switch 22) for controlling an external device and specific posture information of the guitar 1. The control signal DB 271 stores these specific performance information and posture information in association with control signals for controlling external devices.

  The control signal generation unit 28 acquires a control signal for controlling the external device from the storage unit 27 based on the performance information from the performance information acquisition unit 23 and the posture information from the posture sensor 26, and outputs the control signal to the superimposition unit 29. To do.

  The superimposing unit 29 superimposes the control signal input from the control signal generating unit 28 on the audio signal input from the musical sound generating unit 24 and outputs it to the output I / F 30. For example, the superimposing unit 29 phase-modulates a high-frequency carrier signal with a control signal (a data code string of 0, 1), thereby controlling the control signal in a band different from the frequency component (acoustic signal component) of the audio signal. Are included. It is also possible to use the following spread spectrum.

  FIG. 2B is a block diagram illustrating an example of the configuration of the superimposing unit 29 when using spread spectrum. In the figure, all digital signal processing is described, but the signal output to the outside may be an analog signal (signal after analog conversion).

  In this example, the multiplier 295 multiplies the M-sequence pseudo-noise code (PN code) output from the spread code generator 294 and the control signal (referred to as a data code string of 0 and 1) by the multiplier 295. Spread spectrum. The spread control signal is input to the XOR circuit 296. The XOR circuit 296 outputs an exclusive OR of the code input from the multiplier 295 and the output code one sample before input via the delay unit 297, and differentially encodes the spread control signal. The signal after differential encoding is binarized by -1,1. By outputting the differential code binarized to −1 and 1, the decoding side can extract the performance information after spreading by multiplying the differential code of two consecutive samples.

  The differentially encoded control signal is band-limited within the baseband in an LPF (Nyquist filter) 298 and input to the multiplier 300. Multiplier 300 multiplies the carrier signal output from carrier signal generator 299 (carrier signal higher in frequency than the acoustic signal component) and the output signal of LPF 298, and frequency-shifts the control signal after differential encoding to the passband. . The control signal after differential encoding may be frequency shifted after up-sampling. The frequency-shifted control signal is gain-adjusted by the gain adjuster 301, mixed with the audio signal by the adder 293, and output to the output I / F 30.

  Note that the audio signal output from the musical sound generation unit 24 is input to the adder 293 after the passband band is cut by the LPF 291 and the gain is adjusted by the gain adjuster 292. However, the LPF 291 is not essential, and the sound It is not necessary to completely divide the band between the signal component and the modulation signal component (the frequency component of the superimposed control signal). For example, if the carrier signal is about 20 to 25 kHz, even if the acoustic signal component and the modulation signal component are slightly overlapped, the signal-to-noise ratio is such that the listener can hardly hear the modulation signal and can decode the control signal. Can be secured. It should be noted that the frequency band for superimposing the control signal is desirably a non-audible range of 20 kHz or more. However, in the case where the non-audible range cannot be used due to D / A conversion, compression audio encoding, or the like, for example, a high frequency of 15 kHz or more is used. By superimposing the control signal on the frequency band, the influence on hearing can be reduced.

  The audio signal on which the control signal is superimposed as described above is output from the output I / F 30 that is an audio output terminal. The output I / F 30 outputs the audio signal input from the superimposing unit 29 to the effector 61 (see FIG. 4).

  Next, control of an external device by playing the guitar 1 will be described with reference to FIG. FIG. 4 is an explanatory diagram showing an example of a guitar playing environment. As shown in FIG. 4, the guitar 1 includes an effector 61 that adjusts sound effects, a guitar amplifier 62 that amplifies the volume of the performance sound of the guitar 1, and input sound (the performance sound of the guitar 1 and the microphone MIC picked up sound). The mixer 63 for synthesizing the voice, the voice reproduced by the automatic performance device 64), and the speaker SP are connected in this order. The mixer 63 is connected to a microphone MIC for collecting vocal sound and an automatic performance device 64 for automatically performing MIDI data provided therein.

  At least one of the external devices such as the effector 61, the guitar amplifier 62, the mixer 63, and the automatic performance device 64 shown in FIG. 4A includes a decoding unit, and decodes the control signal superimposed on the audio signal. Do. The decoding method differs depending on the control signal superimposing method in the superimposing unit 29. However, when the above-described spread spectrum is used, the decoding is performed as follows.

  FIG. 4B is a block diagram illustrating an example of the configuration of the decoding unit. The audio signal input to the decoding unit is input to the HPF 91. The HPF 91 is a filter for removing acoustic signal components. The output signal of the HPF 91 is input to the delay unit 92 and the multiplier 93. The delay amount of the delay unit 92 is set to a time corresponding to one sample of the differential code. When the differential code is upsampled, it is set to the time for one sample after the upsampling. The multiplier 93 multiplies the signal input from the HPF 91 by the signal one sample before output from the delay unit 92, and performs delay detection processing. The differentially encoded signal is binarized to −1 and 1, and indicates the phase change from the code one sample before. Therefore, by multiplying the signal one sample before, the difference is obtained. A control signal (spread code) before dynamic coding is extracted.

  The output signal of the multiplier 93 is extracted as a baseband signal through the LPF 94 which is a Nyquist filter, and is input to the correlator 95. The correlator 95 obtains the correlation with the input signal using the same spreading code as the spreading code output from the spreading code generator 94. Since the spreading code uses a PN code with high autocorrelation, the correlation value output from the correlator 95 is extracted by the peak detector 96 with positive and negative peak components in the spreading code period (data code period). The The code determination unit 97 decodes each peak component as the data code (0, 1) of the control signal. In this way, the control signal superimposed on the audio signal is decoded. The decoded control signal is used to control each external device. Note that the superposition-side differential encoding process and the decoding-side delay detection process are not essential.

  For example, in FIG. 4A, when the guitar 1 detects that the 1st to 6th strings of the 1st fret are pressed by the fret switch 22 without detecting the vibration of the string 10 by the string sensor 21. The control signal instructing the start of the performance of the automatic performance device 64 is acquired from the control signal DB 271 (see FIG. 3). The guitar 1 outputs the control signal superimposed on the audio signal. The automatic performance device 64 acquires the control signal and starts the performance of the automatic performance device 64. As described above, in response to a performance operation of the guitar 1 (a performance operation that does not generate an audio signal), the automatic performance device 64 that is an external device can be started to perform. In this case, the automatic performance device 64 may include a decoding unit, and the automatic performance device 64 may decode the control signal by inputting the audio signal on which the control signal is superimposed. Alternatively, a decoding unit may be built in the mixer 63, the control signal may be decoded by the mixer 63, and the decoded control signal may be input to the automatic performance device 64.

  Further, when the guitar 1 detects that the neck 12 faces downward with respect to the body 11 immediately after the neck 12 faces upward with respect to the body 11 by the posture sensor 26, the control signal DB 271 (see FIG. 3). The control signal for instructing to stop the performance of the automatic performance device 64 is acquired from. The guitar 1 outputs the control signal superimposed on the audio signal. The automatic performance device 64 acquires the control signal and stops the performance of the automatic performance device 64. As described above, according to the posture of the guitar 1 (that is, the performance using the performer's guitar 1), the performance can be stopped with respect to the automatic performance device 64 which is an external device.

  Further, when the guitar 1 detects that the neck 12 faces upward with respect to the body 11 by the posture sensor 26 and detects the vibration of the string 10 by the string sensor 21, the control signal DB 271 (see FIG. 3). The control signal for instructing the mixer 63 to increase the volume of the guitar is obtained from. The guitar 1 outputs the control signal superimposed on the audio signal. The mixer 63 acquires the control signal and increases the volume of the guitar. As described above, the volume at the time of synthesis is adjusted with respect to the mixer 63 which is an external device according to the combination of the posture of the guitar 1 (that is, the performance using the guitar 1 of the performer) and the performance operation of the guitar 1. Can be made.

  In addition, when the guitar 1 detects that a specific fret (2nd string 5th fret, 3rd string 6th fret) is pressed by the fret switch 22, and the string sensor 21 detects vibration of the string 10 Then, a control signal for instructing the effector 61 to change the effect is acquired from the control signal DB 271 (see FIG. 3). The guitar 1 outputs the control signal superimposed on the audio signal. The effector 61 acquires the control signal and changes the effect. As described above, in accordance with the performance operation of the guitar 1 (performance operation for generating an audio signal), the effect can be changed for the effector 61 that is an external device.

  Note that the above-described content is an example, and the guitar 1 registers a control signal for controlling an external device in the control signal DB 271 so that an acoustic-related device such as an effector 61 and a guitar amplifier 62, an illumination, and a camera are registered. Etc. can be controlled as an external device. As described above, it is possible to control external devices (such as the automatic performance device 64 and the mixer 63) in accordance with the performance of the performer using the guitar 1 and the performance operation of the guitar 1.

  Further, the correspondence between the control signal stored in the control signal DB 271 and the performance information and the posture information may be edited. In this case, the guitar 1 is provided with a control signal input unit (not shown), and the player registers a control signal for controlling the external device in the control signal DB 271. Then, the performer performs a performance or performance, and the performance information acquisition unit 23 acquires the performance information and posture information and registers them in the control signal DB 271 in association with the registered control signals. As described above, the performer can easily register the control signal according to his / her application.

  Further, instead of the control signal DB 271, a configuration including a control signal DB 271 ′ in which specific performance information and posture information and a reception period for receiving input of specific performance information and posture information are stored in association with the control signal. Also good. FIG. 5 is a diagram illustrating another example of the control signal database. In this case, the guitar 1 includes a measuring unit (not shown) that measures the elapsed time (or the number of beats) after the performance is started. For example, the guitar 1 detects that the neck 12 is directed upward with respect to the body 11 with the posture sensor 26 within 1 to 2 minutes from the start of performance, and the string sensor 21 vibrates the string 10. When detected, a control signal for instructing the mixer 63 to increase the volume of the guitar is acquired from the control signal DB 271 ′ shown in FIG. Note that the guitar 1 does not acquire the control signal even if the gesture is detected in a time other than 1 to 2 minutes from the start of the performance, and therefore the mixer 63 is not operated.

  In addition, for example, the guitar 1 indicates that the 2nd string of 5th fret and the 3rd string of 6th fret are pressed by the fret switch 22 between 8 beats to 10 beats or 14 beats to 20 beats from the start of performance. When the vibration is detected and the vibration of the string 10 is detected by the string sensor 21, a control signal for instructing the change of the effect of the effector 61 is acquired from the control signal DB 271 ′. Note that the guitar 1 does not acquire the control signal even if it detects the gesture other than between 8 beats to 10 beats or 14 beats to 20 beats from the start of the performance, and therefore the operation of the effector 61 is not performed.

  As described above, the performance operation (performance information) of the guitar 1, the performance (posture information) using the guitar 1 of the performer, and the reception period (the elapsed time and the number of beats since the performance started) The external device can be controlled in accordance with the combination. Thereby, the performer can easily control different external devices according to the elapsed time even in the same performance operation. The guitar 1 can change the effect and volume by controlling an external device (for example, the effector 61 and the guitar amplifier 62) according to the elapsed time, so that the musical piece whose tune changes according to the elapsed time is played. It is suitable for use in some cases.

  Furthermore, in the first embodiment, the guitar 1 has been described as an example, but an electronic musical instrument such as an electronic piano or a MIDI violin may be used.

  In addition, the mixer 63 may be configured to control the external device based on operation information, performance information, and posture information from a plurality of musical instruments. For example, the guitar 1 superimposes performance information indicating the performance operation of the guitar 1 and attitude information indicating performance of the performer using the guitar 1 on the audio signal, and outputs the audio signal to the mixer 63. Similarly, the microphone MIC also superimposes the posture information indicating the performance of the microphone MIC by the vocal (the posture of the microphone MIC) on the vocal uttered voice and outputs the superimposed voice information to the mixer 63. Then, the mixer 63 controls the external device based on the performance information and posture information acquired from the audio signal and the speech sound (for example, adjusting the sound output volume from the speaker SP or changing the effect of the effector 61). Or the mixing ratio of the audio signal and the speech voice is changed by the mixer 63).

  In the first embodiment, the control signal is generated based on the performance information, the operation information, and the posture information. However, if the control signal is generated based on at least one of the operation information, the performance information, or the posture information. Good. In this case, the guitar 1 may include the attitude sensor 26 and the input unit 25 as necessary.

“Second Embodiment”
A control device 5 according to a second embodiment of the present invention will be described with reference to FIGS. FIG. 6 is a top view of the external appearance of the guitar equipped with the control device as viewed from above. FIG. 7 is a block diagram illustrating functions and configurations of the control device. In the second embodiment, a control device 5 is mounted on an acoustic guitar (hereinafter simply referred to as a guitar) 4 which is an acoustic stringed instrument, and a control signal for controlling an external device is superimposed on an audio signal from the guitar 4. The output point is different from the first embodiment. Hereinafter, differences will be described.

  As shown in FIG. 6, the control device 5 includes a microphone 51 (corresponding to the audio signal generating means of the present invention) and a main body 52. The microphone 51 is installed on the body 11 of the guitar 4. As shown in FIG. 7, the main body 52 includes an equalizer 521, an input unit 25, a storage unit 27, a control signal generation unit 28, a superimposition unit 29, and an output I / F 30. During the performance of the guitar 4, the performer may carry the main body 52, or only the input unit 25 may be removed from the main body 52 and the performer may carry only the input unit 25. The storage unit 27, the control signal generation unit 28, the superimposition unit 29, and the output I / F 30 have the same functions and configurations as those in the first embodiment.

  The microphone 51 is, for example, a contact microphone used for guitar pickup or the like, or an electromagnetic microphone for electric guitar. The contact microphone is a microphone that can detect not only the vibration of the string 10 of the guitar 4 but also the sound of the guitar 4 by canceling external noise by being attached to the body of the musical instrument. When the power is turned on, the microphone 51 collects not only the vibration of the string 10 of the guitar 4 but also the sound of the guitar 4 and generates an audio signal. Then, the microphone 51 outputs the generated audio signal to the equalizer 521.

  The equalizer 521 adjusts the frequency characteristics of the audio signal input from the microphone 51 and outputs the audio signal to the superimposing unit 29.

  As described above, since the control device 5 can generate an audio signal according to the vibration of the string 10 of the guitar 4 or the sound of the guitar 4 by the microphone 51 even if the guitar 4 does not generate an audio signal, A control signal can be superimposed on the signal and output.

  The control device 5 may include a fret switch 22 (or a press sensor) that detects on / off of the fret 121 for acquiring performance information of the guitar 4 and a string sensor 21 that detects vibration of each string 10. . Further, the control device 5 may include a posture sensor 26 for acquiring posture information of the guitar 4.

  In the second embodiment, the guitar 4 has been described as an example. However, the present invention is not limited to this, and an acoustic instrument such as a grand piano (keyboard instrument) or a drum (percussion instrument) may be used. For example, in the case of a grand piano, a microphone 51 is installed on the frame of the grand piano, and the control device 5 generates an audio signal by collecting sound from the microphone 51. In addition, a pressure sensor for detecting on / off of each key and a pressure applied to each key and a switch for detecting whether or not a pedal is depressed are installed on the grand piano, and the control device 5 controls the player's grand piano. The performance used and the performance operation of the grand piano may be acquired.

  For example, in the case of a drum, the microphone 51 is installed in the vicinity of the drum, and the control device 5 collects the emitted sound with the microphone 51 to generate an audio signal. Further, a posture sensor 26 for detecting the player's stick carrying (detecting the posture of the stick) and a pressure sensor for measuring the force of hitting the drum are installed on the stick for hitting the drum. Performances using drums and drum performance operations may be acquired.

DESCRIPTION OF SYMBOLS 1,4 ... Guitar, 5 ... Control apparatus, 10 ... String, 11 ... Body, 12 ... Neck, 20 ... Control part, 21 ... String sensor, 22 ... Fret switch, 23 ... Performance information acquisition part, 24 ... Musical sound generation part , 25 ... input unit, 26 ... attitude sensor, 27 ... storage unit, 28 ... control signal generation unit, 29 ... superimposition unit, 30 ... output I / F, 51 ... microphone, 52 ... main body, 61 ... effector, 62 ... guitar Amplifier 63 63 Mixer 64 Automatic performance device 121 Fret 271 Control signal database 521 Equalizer MIC Microphone SP Speaker

Claims (7)

An input means for receiving an input of an operation for controlling an external device;
Control signal generating means for generating a control signal for controlling the external device in response to an operation received by the input means;
Superimposing means for superimposing the control signal on the audio signal so that the modulation component of the control signal is included in a band higher than the frequency component of the audio signal generated according to the performance operation;
And an output unit that outputs an audio signal in which the superimposing unit superimposes the control signal. The superimposing means includes a spreading code generating unit that generates a spreading code having a predetermined period;
Based on the control signal, a modulation unit that phase-modulates the spreading code for each period;
A synthesis unit that synthesizes a modulation signal generated based on the phase-modulated spreading code with the audio signal in a frequency band higher than the frequency of the audio signal, and outputs the synthesized signal;
The control device according to claim 1, comprising: Performance information acquisition means for acquiring performance information indicating the contents of the performance operation;
Storage means for storing the performance information and the control signal in association with each other,
The input means acquires the performance information as an input of the operation,
The control device according to claim 1, wherein the control signal generation unit generates the control signal by referring to the storage unit with performance information acquired by the input unit. A posture sensor that detects posture of the device and generates posture information;
The storage means stores the posture information and the control signal in association with each other,
The input means acquires the posture information as an input of the operation,
The control device according to claim 1, wherein the control signal generation unit generates the control signal by referring to the storage unit based on posture information acquired by the input unit. Further comprising a measuring means for measuring an elapsed time since the performance operation was started,
The storage means further stores a reception period for receiving the input of the operation in association with the control signal,
The control device according to claim 3, wherein the control signal generation unit generates the control signal when the elapsed time measured by the measurement unit is within the reception period. Control signal input means for inputting the control signal;
6. The registration unit according to claim 3, further comprising: a registration unit that registers the control signal input by the control signal input unit and the operation input by the input unit in association with each other in the storage unit. Control device. Audio signal generating means for generating an audio signal based on vibration generated in response to the performance operation;
The control device according to claim 1, wherein the superimposing unit superimposes the control signal on the audio signal generated by the audio signal generating unit.

Images