JP2022191521A - Recording and reproducing apparatus, control method and control program for recording and reproducing apparatus, and electronic musical instrument - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a recording and reproducing apparatus, a control method for a recording and reproducing apparatus and a control program, and an electronic musical instrument capable of efficiently recording and reproducing ensemble performance or the like which synthesizes and reproduces music data from the outside and musical instrument performance data by a user.

SOLUTION: At the time of performance recording, an input timing of an audio signal of an accompaniment sound inputted from an external device 200 is detected by a signal presence and absence detection circuit 122, a difference time Tn which is a time difference from the input timing to the start of a keyboard performance of a user is measured, and the performance is recorded in association with a sequence (performance data) of the keyboard performance. When the input of audio signal of the accompaniment sound from the external device 200 is detected at the time of playing and reproducing the recorded music, the performance sound based on the sequence of the keyboard performance stored in association with the difference time Tn is reproduced after the difference time Tn has passed from the input timing.

SELECTED DRAWING: Figure 2

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to a recording/playback device, a control method and control program for a recording/playback device, and an electronic musical instrument equipped with the recording/playback device.

2. Description of the Related Art Conventionally, there is known a recording/reproducing apparatus that mixes (synthesizes) an accompaniment sound output by an external device and a performance sound of a user's own musical instrument, and records and reproduces the sound. For example, Patent Literature 1 describes a technique for recording and reproducing an ensemble performance in which a piano performance is performed while listening to the reproduced sound of music recorded on a CD (compact disc) or the like.

Japanese Patent Application Laid-Open No. 2003-208166

In a conventional recording/reproducing apparatus, it is necessary to synchronize music data from a CD or the like with performance data by a user, convert the data into a reproducible state, and record the data in a storage medium. As a result, the processing for recording and playback was complicated, and the amount of data to be processed and recorded became enormous, increasing the processing load and making it impossible to record and playback efficiently. .

Accordingly, the present invention provides a recording/reproducing apparatus and control of a recording/reproducing apparatus that can efficiently record and reproduce ensemble performances in which music data from the outside and performance data of a user's own musical instrument are synthesized and reproduced. An object of the present invention is to provide a method, a control program, and an electronic musical instrument.

A recording/playback device according to the present invention includes:
an external input terminal for inputting musical tone signals from the outside,
an operation detection means for detecting an operation related to performance;
A difference from a first timing at which the reproduction of the musical tone signal input from the external input terminal is started to a second timing at which the operation related to the performance is started by the operation detecting means after the reproduction of the musical tone signal is started. a time measuring means for measuring time;
Performance data related to the performance detected by the operation detection means is stored in a storage means in association with the difference time measured by the time measurement means, and the performance related to the performance is associated with the difference time. When it is detected again that the reproduction of the musical tone signal has started while the data is stored in the storage means, the performance data stored in the storage means is replaced with the difference associated with the performance data. a control means for starting reproduction with a time delay;
characterized by comprising

According to the present invention, it is possible to efficiently record and reproduce an ensemble performance or the like in which music data from the outside and performance data of a user's own musical instrument are synthesized and reproduced.

1 is an external view showing an embodiment of an electronic musical instrument equipped with a recording/playback device according to the present invention; FIG. 2 is a block diagram showing a hardware configuration example of the electronic musical instrument according to the first embodiment; FIG. 4 is a timing chart showing a control method in the performance recording mode of the electronic musical instrument according to the first embodiment; 4 is a block diagram showing the operating state of the electronic musical instrument in the performance recording mode according to the first embodiment; FIG. 4 is a timing chart showing a control method in the performance playback mode of the electronic musical instrument according to the first embodiment; 4 is a block diagram showing the operating state of the electronic musical instrument in the performance playback mode according to the first embodiment; FIG. FIG. 4 is a block diagram showing an example of hardware configuration of an electronic musical instrument according to a second embodiment of the present invention; 8 is a timing chart showing a control method in the performance recording mode of the electronic musical instrument according to the second embodiment; FIG. 11 is a block diagram showing the operating state of the electronic musical instrument in the performance recording mode according to the second embodiment; 8 is a timing chart showing a control method in the performance playback mode of the electronic musical instrument according to the second embodiment; FIG. 11 is a block diagram showing the operating state of the electronic musical instrument in the performance playback mode according to the second embodiment;

DESCRIPTION OF THE PREFERRED EMBODIMENTS A recording/playback device, a control method and control program for a recording/playback device, and an electronic musical instrument provided with the recording/playback device according to the present invention will be described in detail below with reference to the accompanying drawings.

<Electronic Musical Instruments>
FIG. 1 is an external view showing an embodiment of an electronic musical instrument equipped with a recording/playback device according to the present invention. Here, as an example of an electronic musical instrument, a case where an electronic keyboard instrument (electronic keyboard) is applied will be described, but the present invention is not limited to this. may be

An electronic musical instrument 100 applied to one embodiment of the present invention has a form of a keyboard instrument, for example, as shown in FIG. It is connected to an external device 200 such as.

The electronic musical instrument 100 has a plurality of keys as performance operators on one side of the main body of the musical instrument. A keyboard 102 is used to specify the pitch, and operations such as volume adjustment, tone color selection, and other function selection are performed. It has an operation panel 104 on which switches are arranged, and a display panel 106 for displaying volume, tone color, setting information, other various information, and the like. The electronic musical instrument 100 also includes a speaker 108 that produces performance sounds generated by the user (musical instrument user) operating the keyboard 102 and the operation panel 104, and music based on audio signals input from the external device 200. , and an external input terminal 110 to which a communication cable such as the audio cable 300 is connected and an audio signal from the external device 200 is input.

Here, the external device 200 is an audio device such as a media player or CD player that reproduces music data recorded on a storage medium such as an SSD (Solid State Drive), an HDD (Hard Disk Drive), a memory card, or a music CD. An audio signal corresponding to music data is unidirectionally output to the electronic musical instrument 100 via the audio cable 300 . Note that the external device 200 may be an electronic device such as a personal computer or a smart phone as long as it can reproduce music data and supply it to the electronic musical instrument 100 as an audio signal.

<First Embodiment>
Next, a first embodiment of an electronic musical instrument having the appearance described above and a control method thereof will be described.
(electronic musical instrument)
FIG. 2 is a block diagram showing a hardware configuration example of the electronic musical instrument according to the first embodiment.

The internal functions of the electronic musical instrument 100 according to the first embodiment are, for example, as shown in FIG. , a signal presence/absence detection circuit 122, a time measurement recording circuit 124, a performance recording/playback timing generation circuit 126, a mixing circuit 128, a speaker amplifier 130, and a speaker 108.

Each functional unit generally performs the following operations.
A sequence control microcomputer (hereinafter abbreviated as a “control microcomputer”) 112 controls the entire electronic musical instrument 100 by controlling the functional units described above, and also controls the performance recording mode and the , each processing operation in the performance reproduction mode is executed.

A keyboard performance detection circuit 114 detects the presence or absence of an operation performed by the user on the keyboard 102 and the timing of the operation. The keyboard performance recording circuit 116 records the start timing of the keyboard performance detected by the keyboard performance detection circuit 114 and the keyboard performance sequence (operation procedure of the keyboard 102; performance data) in a storage device (not shown). A keyboard performance reproduction circuit 118 reads out musical tone data from a sound source (not shown) or the like based on the user's keyboard playing operation, and generates a digital musical tone output signal.

The audio input terminal circuit 120 has an external input terminal 110 to which the audio cable 300 is connected, and converts an analog audio signal (tone signal) input from the external device 200 via the audio cable 300 into a digital signal. The signal presence/absence detection circuit 122 detects the presence/absence of an audio signal input from the external device 200 and the input timing in the audio input terminal circuit 120 . The time measurement recording circuit 124 measures the difference time from the input timing of the audio signal detected by the signal presence/absence detection circuit 122 until the user starts playing the keyboard, and records it as delay time data. The performance record/playback timing generation circuit 126 generates playback start timing of the performance data by the keyboard performance playback circuit 118 based on the delay time data recorded by the time measurement/recording circuit 124 when an audio signal is input from the external device 200 . Generate a command to set the

The mixing circuit 128 synthesizes the digitally converted audio signal input to the audio input terminal circuit 120 with a musical tone output signal generated based on the user's keyboard performance to generate a musical tone waveform signal, which is then converted to analog. output. The speaker amplifier 130 amplifies the analog tone waveform signal generated by the mixing circuit 128 to a predetermined signal level. The speaker 108 emits a synthesized performance sound of a predetermined volume based on the amplified musical waveform signal, a performance sound corresponding to the keyboard performance, or a musical piece based on the audio signal input from the external device 200 to the outside of the musical instrument. do.

(Method of controlling electronic musical instrument)
Next, a method of controlling the electronic musical instrument (a method of controlling the recording/reproducing apparatus) according to this embodiment will be described. Here, for the sake of simplicity, a case will be described in which musical piece data that accompanies keyboard playing on the electronic musical instrument 100 is inputted as an audio signal that is inputted from the external device 200 to the electronic musical instrument 100 via the audio cable 300. explain.

The electronic musical instrument 100 according to this embodiment has a normal performance mode, a performance recording mode, and a performance playback mode, and the processing operations of the selected operation modes are individually executed. These operation modes are selectively set by the user operating buttons and switches provided on the operation panel 104, for example. The performance recording mode and the performance playback mode are set while the electronic musical instrument 100 and the external device 200 are connected by the audio cable 300 . Each operation mode will be described in detail below. Here, the series of control processing described below is realized by executing a predetermined control program in the control microcomputer 112 of the electronic musical instrument 100. FIG.

・Normal performance mode In the normal performance mode of the electronic musical instrument 100 according to the present embodiment, when the electronic musical instrument 100 and the external device 200 are not connected by the audio cable 300, when the user plays the keyboard 102, the control The microcomputer 112 generates a digital musical tone output signal according to the user's keyboard operation by means of a keyboard play reproduction circuit 118 . After the control microcomputer 112 converts the musical tone output signal into an analog signal by the mixing circuit 128 (in this case, only analog conversion is performed without synthesizing the sound), the speaker amplifier 130 adjusts the signal level to a predetermined level. The amplified sound is emitted from the speaker 108 as a performance sound.

On the other hand, in the normal performance mode according to the present embodiment, when the electronic musical instrument 100 and the external device 200 are connected by the audio cable 300, the user turns on the playback switch (SW) of the external device 200. , an analog audio signal corresponding to music data of the accompaniment sound is input to the audio input terminal circuit 120 via the audio cable 300 and converted into a digital signal. Then, the control microcomputer 112 converts the audio signal into an analog signal again by the mixing circuit 128 (at this point, only analog conversion is performed without synthesizing the sound), and the speaker amplifier 130 amplifies the audio signal to a predetermined signal level. After that, sound is emitted from the speaker 108 as an accompaniment sound.

Next, the user listens to the accompaniment sound, which is the reproduced sound of the external device 200, emitted from the speaker 108, and starts playing on the keyboard 102 in time with the sound. As a result, the control microcomputer 112 generates a digital musical tone output signal corresponding to the user's keyboard operation by the keyboard performance reproduction circuit 118, and the musical tone output signal is input from the external device 200 and converted into digital by the mixing circuit 128. After synthesizing the audio signal of the accompaniment sound in the state of a digital signal, it is converted into an analog signal, amplified to a predetermined signal level by the speaker amplifier 130, and emitted from the speaker 108 as a synthesized performance sound. As described above, in the normal performance mode, the performance sound corresponding to the user's keyboard operation is emitted alone or synthesized with the accompaniment sound, which is the sound reproduced by the external device 200, in real time.

- Performance Record Mode FIG. 3 is a timing chart showing a control method in the performance record mode of the electronic musical instrument according to this embodiment. FIG. 4 is a block diagram showing the operating state of the electronic musical instrument in the performance recording mode according to this embodiment.

In the performance recording mode according to the present embodiment, as shown in the timing chart of FIG. 3 and the operating state diagram of FIG. (11)), when the music data of the accompaniment is started to be reproduced, an analog audio signal corresponding to the music data is input to the electronic musical instrument 100 via the audio cable 300 .

Then, when an audio signal is input to the audio input terminal circuit 120 of the electronic musical instrument 100 ((12) in the figure), the control microcomputer 112 detects the input timing with the signal presence/absence detection circuit 122 (( 13)). An audio signal input from the external device 200 is converted into a digital signal by the audio input terminal circuit 120, and then converted into an analog signal again by the mixing circuit 128 (at this point, only analog conversion is performed without synthesizing sound). After being amplified to a predetermined signal level by the speaker amplifier 130, the sound is emitted from the speaker 108 as an accompaniment sound.

On the other hand, the user listens to the accompaniment sound emitted from the speaker 108, and starts playing with the keyboard 102 at a predetermined timing ((14) in the figure). At this time, the control microcomputer 112 calculates a difference time (delay time) Tn, which is the time difference between the input timing of the audio signal detected by the signal presence/absence detection circuit 122 by the time measurement recording circuit 124 and the start timing of the keyboard performance by the user. Measurements are taken and recorded in a storage device (not shown) ((15) in the figure).

Further, the control microcomputer 112 records the sequence (performance data) during the keyboard performance by the user in the storage device by means of the keyboard performance detection circuit 114 and the keyboard performance recording circuit 116 ((16) in the figure). Here, the sequence during keyboard performance has a digital data format such as MIDI, and is recorded in the storage device in association with the difference time Tn from the input timing of the audio signal to the start timing of the keyboard performance.

Further, during the keyboard performance, the control microcomputer 112 generates a digital tone output signal corresponding to the user's keyboard operation by the keyboard performance reproduction circuit 118 ((17) in the figure). Then, the control microcomputer 112 synthesizes the tone output signal generated by the keyboard play reproduction circuit 118 by the mixing circuit 128 and the accompaniment tone based on the audio signal input from the external device 200 and converted into digital signals in a digital signal state. After that, analog conversion is performed ((18) in the figure), the signal level is amplified by the speaker amplifier 130, and the synthesized performance sound is emitted from the speaker 108 ((19) in the figure).

Then, when the keyboard performance detection circuit 114 detects that the user has finished playing the keyboard and performed an operation to end (or stop) performance recording, the control microcomputer 112 causes the keyboard performance recording circuit 116 to record the performance sequence. End (or stop) ((20) in the figure). Also, in synchronization with this timing, the control microcomputer 112 terminates (or stops) emitting the synthesized performance sound or the performance sound from the speaker 108 .

Performance Playback Mode FIG. 5 is a timing chart showing a control method in the performance playback mode of the electronic musical instrument according to this embodiment. FIG. 6 is a block diagram showing the operating state of the electronic musical instrument in the performance reproduction mode according to this embodiment.

In the performance playback mode according to the present embodiment, as shown in the timing chart of FIG. 5 and the operating state diagram of FIG. Set it to play. Next, when the user turns on the playback switch (SW) of the external device 200 ((21) in the figure) to start playing back the music data of the accompaniment sound of the previously recorded music, the corresponding music data is played back. An analog audio signal is input to the electronic musical instrument 100 via an audio cable 300. FIG.

Then, when an audio signal is input to the audio input terminal circuit 120 of the electronic musical instrument 100 ((22) in the figure), the control microcomputer 112 detects the input timing with the signal presence/absence detection circuit 122 (( twenty three)). An audio signal input from the external device 200 is converted into a digital signal by the audio input terminal circuit 120, and then converted into an analog signal again by the mixing circuit 128 (at this point, only analog conversion is performed without synthesizing sound). After the signal level is amplified by the speaker amplifier 130, the sound is emitted from the speaker 108 as an accompaniment sound.

On the other hand, the control microcomputer 112 reads from the storage device the difference time Tn associated with the keyboard playing sequence of the music recorded when the electronic musical instrument 100 was previously played by the time measuring and recording circuit 124 ((24 in the figure). )), the performance recording/playback timing generation circuit 126 sets the playback timing after the difference time Tn has elapsed from the input timing of the audio signal detected by the signal presence/absence detection circuit 122 ((25) in the figure).

Further, the control microcomputer 112 reads out from the storage device the sequence of the keyboard performance of the musical piece recorded when the electronic musical instrument 100 was previously played by the keyboard performance recording circuit 116 ((26) in the figure), and at the above playback timing, , the keyboard performance reproduction circuit 118 generates a digital tone output signal based on the performance sequence ((27) in the figure). Then, the control microcomputer 112 synthesizes the musical tone output signal generated in the keyboard play reproduction circuit 118 by the mixing circuit 128 and the accompaniment sound based on the audio signal input from the external device 200 and converted to digital. ((28) in the figure), the signal level is amplified by the speaker amplifier 130, and a reproduction operation is performed in which the synthesized performance sound is emitted from the speaker 108 ((29) in the figure). As a result, the sound of the previous keyboard performance by the user is superimposed and reproduced from the speaker 108 along with the accompaniment sound of the external device 200 .

When the control microcomputer 112 detects the end (or stop) of the keyboard performance sequence read out by the keyboard performance recording circuit 116, it terminates (or stops) the playback of the performance sequence by the keyboard performance playback circuit 118 (see FIG. medium, (20)). Also, in synchronization with this timing, the control microcomputer 112 terminates (or stops) emitting the synthesized performance sound or the performance sound from the speaker 108 .

In the performance reproduction mode according to the present embodiment, as described above, the accompaniment sound input from the external device 200 is synthesized with the performance sound recorded when the user played the keyboard before, and reproduced. In addition, there is also a form in which only the performance sound recorded when the user played the keyboard in the past is reproduced alone.

Specifically, for example, when the user operates buttons and switches provided on the operation panel 104 to specify a piece of music that the user has previously recorded playing on the electronic musical instrument 100, the control microcomputer 112 performs keyboard performance recording. A circuit 116 reads out the keyboard performance sequence of the song from the storage device, and a keyboard performance reproduction circuit 118 generates a tone output signal based on the performance sequence. After the control microcomputer 112 converts the musical tone output signal into an analog signal by the mixing circuit 128 (in this case, only analog conversion is performed without synthesizing the sound), the speaker amplifier 130 amplifies the signal level. Then, a reproduction operation is executed in which sound is emitted from the speaker 108 as a performance sound.

As described above, in this embodiment, when recording a performance, the input timing of the audio signal of the accompaniment sound input from the external device 200 is detected by the signal presence/absence detection circuit 122. A difference time Tn, which is the time difference between the two, is measured and recorded in association with the keyboard performance sequence (performance data). Then, when the input of the audio signal of the accompaniment sound from the external device 200 is detected during performance reproduction of the recorded music piece, after the difference time Tn has passed from the input timing, it is stored in association with the difference time Tn. Played sounds are reproduced based on the keyboard playing sequence. At this time, a synthesized performance sound obtained by synthesizing the performance sound based on the recorded keyboard performance sequence with the accompaniment sound reproduced based on the audio signal from the external device 200 is reproduced.

As a result, according to this embodiment, the sequence of keyboard performance performed by the user while listening to the music reproduced from the external device is recorded, and then stored in accordance with the music reproduced by the external device. A performance sound based on a keyboard performance sequence can be synthesized at appropriate timing (without timing deviation) and automatically reproduced as a synthesized performance sound, and simple processing can be performed without requiring a special operation by the user. The method can faithfully reproduce the performance state at the time of the previous recording.

Here, in this embodiment, only the keyboard performance sequence is recorded as digital data such as MIDI in association with the difference time Tn from the input timing of the audio signal from the external device. As a result, for example, after mixing an audio signal (accompaniment sound) input from an external device and a musical sound output signal (performance sound) based on the keyboard performance sequence of an electronic musical instrument, it is possible to compare the recording as analog data or digital data. As a result, the amount of data to be processed and the amount of data to be recorded can be reduced, and the processing load can be reduced.

Therefore, according to the present embodiment, in an ensemble performance or the like in which music data from an external device and performance data of an electronic musical instrument by a user are synthesized and played back, the processing operation by the control microcomputer 112 is simplified to efficiently reproduce musical tones. Recording and playback can be performed. Further, according to the present embodiment, it is possible to reduce the capacity of the required storage device and to lower the processing power of the control microcomputer, thereby simplifying the configuration of the electronic musical instrument and reducing the product cost. Alternatively, the present embodiment can be well applied to low-priced electronic musical instruments. Further, in this embodiment, signal processing for accompaniment sounds and performance sounds can be kept to a minimum. sound quality can be achieved.

Furthermore, in this embodiment, only the sequence of the keyboard performance by the user is recorded, and there is no need to record (record) the music data of the accompaniment tones played back on the external device in the electronic musical instrument. Arbitrary music data can be freely used as an accompaniment to keyboard performance without being subject to restrictions in recording data.

<Second embodiment>
Next, a second embodiment of the electronic musical instrument and its control method according to the present invention will be described.
In the above-described first embodiment, when recording a performance, the signal presence/absence detection circuit 122 detects the input timing of the audio signal from the external device 200, and measures the differential time Tn until the start timing of the keyboard performance by the user. , keyboard performance sequence (performance data), and when an input of an audio signal from the external device 200 is detected during playback of the performance, the recorded keyboard performance is recorded after the recorded difference time Tn has elapsed. A form of reproducing performance sounds based on a sequence was presented.

In the second embodiment, when a plurality of sequences of keyboard playing (playing data) are associated with the time difference Tn and recorded, a specific data included in the audio signal from the external device 200 is recorded when the playing is played back. It is characterized by selecting and reproducing an appropriate keyboard performance sequence (performance data) and differential time Tn based on signal characteristics (for example, signal pitch).

(electronic musical instrument)
FIG. 7 is a block diagram showing a hardware configuration example of an electronic musical instrument according to a second embodiment of the present invention. Here, the description of the configuration equivalent to that of the above-described first embodiment is simplified or omitted.

For example, as shown in FIG. 7, the electronic musical instrument 100 according to the second embodiment includes a signal pitch detection circuit 132, a pitch recording circuit 134, and pitch determination performance target data in addition to the internal functions shown in the first embodiment. A selection circuit 136 is added.

The signal pitch detection circuit 132 detects and measures the signal pitch Pn of the leading portion (header portion) of the analog audio signal (musical tone signal) input from the external device 200 via the audio cable 300 . A well-known technique can be applied to the signal pitch detection circuit 132 here.

A pitch recording circuit 134 records the signal pitch Pn measured by the signal pitch detection circuit 132 in a storage device. Here, the signal pitch Pn is the keyboard performance sequence (playback data) recorded by the keyboard performance recording circuit 116 when the user plays the keyboard along with the music based on the audio signal for which the signal pitch Pn is measured. ), and the difference time Tn stored by the time measurement recording circuit 124 .

The pitch determination performance target data selection circuit 136 determines the signal pitch Pn detected and measured by the signal pitch detection circuit 132 when an audio signal is input from the external device 200, and based on the determination result, selects a plurality of pitches. A keyboard performance sequence to be played (that is, performance data to be reproduced) is selected from a plurality of keyboard performance sequences (performance data) recorded in the keyboard performance recording circuit 116 in association with each signal pitch. At the same time, the difference time (delay time) Tn recorded in the time measurement recording circuit 124 is selected in association with the keyboard performance sequence. The control microcomputer 112 controls each functional unit of the entire electronic musical instrument 100 including these, thereby executing each processing operation in a performance recording mode and a performance reproduction mode shown in the control method described later.

(Method of controlling electronic musical instrument)
Next, a method of controlling the electronic musical instrument (a method of controlling the recording/reproducing apparatus) according to this embodiment will be described. Here, the description of processing operations equivalent to those of the first embodiment described above will be simplified.

As in the first embodiment described above, the electronic musical instrument according to this embodiment also executes a normal performance mode, a performance recording mode, and a performance reproduction mode. Here, since the normal performance mode is the same as that of the first embodiment described above, the performance record mode and the performance playback mode, which are features of this embodiment, will be described in detail below.

- Performance Record Mode FIG. 8 is a timing chart showing a control method in the performance record mode of the electronic musical instrument according to this embodiment. FIG. 9 is a block diagram showing the operating state of the electronic musical instrument in the performance recording mode according to this embodiment.

In the performance recording mode according to the present embodiment, as shown in the timing chart of FIG. 8 and the operating state diagram of FIG. (31)), when the reproduction of the music data of the accompaniment sound is started, the audio signal of the music data is input to the audio input terminal circuit 120 ((32) in the figure). On the other hand, the control microcomputer 112 detects the input timing by the signal presence/absence detection circuit 122 ((33) in the figure). Also, the control microcomputer 112 detects and measures the signal pitch Pn of the leading portion (header portion) of the audio signal input by the signal pitch detection circuit 132 ((34) in the figure), and the pitch recording circuit 134 measures the signal pitch Pn. The obtained signal pitch Pn is recorded in a storage device (not shown) ((35) in the figure).

On the other hand, the audio signal input from the external device 200 undergoes predetermined signal processing in the audio input terminal circuit 120, the mixing circuit 128, and the speaker amplifier 130, and then emitted from the speaker 108 as an accompaniment sound. By listening to this accompaniment sound, the user starts playing the keyboard along with the sound ((36) in the figure). At this time, the control microcomputer 112 measures the difference time (delay time) Tn from the input timing of the audio signal to the start timing of the keyboard performance by the time measurement recording circuit 124 and records it in the storage device (in the figure, ( 37)). Further, the control microcomputer 112 records the sequence (performance data) during the keyboard performance in the storage device by means of the keyboard performance detection circuit 114 and the keyboard performance recording circuit 116 ((38) in the figure).

Here, the sequence during the keyboard performance is stored in the keyboard performance recording circuit 116 in association with the signal pitch Pn measured by the signal pitch detection circuit 132 and the differential time Tn measured by the time measurement recording circuit 124. Recorded on the device. Further, during the keyboard performance, the control microcomputer 112 generates a musical tone output signal corresponding to the keyboard operation by the keyboard playing reproduction circuit 118 ((39) in the figure), and the mixing circuit 128 generates the musical tone output signal. and an accompaniment sound based on the above audio signal ((40) in the figure), and then output as a synthesized performance sound from the speaker 108 via the speaker amplifier 130 ((41) in the figure).

Then, when the keyboard performance ends and the keyboard performance detection circuit 114 detects the performance recording end operation (or stop operation), the control microcomputer 112 causes the keyboard performance recording circuit 116 to finish recording the sequence of the keyboard performance ( (or stop) ((42) in the drawing), and terminate (or stop) the output of the synthesized performance sound or the performance sound from the speaker 108. FIG.

The keyboard performance sequence recording process by the keyboard performance recording circuit 116 in the performance recording mode is executed by the user selecting the performance recording mode each time a different piece of music data is played. Then, in the recording process for each piece of music data, audio signals of a plurality of different pieces of music data input from the external device 200 are associated with the signal pitch Pn measured by the signal pitch detection circuit 132 described above. , the keyboard performance sequence (performance data) and the differential time (delay time) Tn are recorded. That is, the keyboard performance recording circuit 116 stores sequences of keyboard performances (performance data) performed for a plurality of different types of music data, and a plurality of signal pitches Pn associated with these are stored for each music. It is stored in the pitch recording circuit 134 as identification information for discriminating data, and the time measurement recording circuit 124 stores the difference time Tn associated with each keyboard performance sequence.

Performance Playback Mode FIG. 10 is a timing chart showing a control method in the performance playback mode of the electronic musical instrument according to this embodiment. FIG. 11 is a block diagram showing the operating state of the electronic musical instrument in the performance playback mode according to this embodiment.

In the performance reproduction mode according to the present embodiment, as shown in the timing chart of FIG. 10 and the operating state diagram of FIG. An arbitrary piece of music to be reproduced is selected, and settings are made so that the accompaniment sound of the selected piece of music is reproduced. Next, when the user turns on the playback switch (SW) of the external device 200 ((51) in the drawing) to start playing the accompaniment sound of the selected song, the audio signal of the song data is output to the audio input terminal. It is input to the circuit 120 ((52) in the figure).

Thereby, the control microcomputer 112 detects the input timing of the audio signal by the signal presence/absence detection circuit 122 ((53) in the figure). Further, the control microcomputer 112 detects and measures the signal pitch Pn of the leading portion (header portion) of the input audio signal by the signal pitch detection circuit 132 ((54) in the figure). Then, the control microcomputer 112 determines the measured signal pitch Pn from among the plurality of signal pitches Pn recorded during the previous performance by the pitch recording circuit 134 and the pitch determination performance target data selection circuit 136 (Fig. (55)), a keyboard performance sequence to be played is selected from the keyboard performance sequences (performance data) recorded in the keyboard performance recording circuit 116 in association with the signal pitch Pn; The difference time (delay time) Tn recorded in the time measurement recording circuit 124 in association with the keyboard playing sequence is selected ((56) in the figure).

On the other hand, the audio signal input from the external device 200 undergoes predetermined signal processing in the audio input terminal circuit 120, the mixing circuit 128, and the speaker amplifier 130, and then emitted from the speaker 108 as an accompaniment sound.

Further, the control microcomputer 112 reads out the sequence (performance data) of the keyboard performance selected by the pitch judgment performance target data selection circuit 136 and the information of the difference time (delay time) Tn ((57) in the figure), and outputs the audio signal. From the input timing of , the reproduction timing after the difference time Tn has elapsed is set ((58) in the figure).

Also, the control microcomputer 112 generates a musical tone output signal based on the keyboard performance sequence (performance data) selected as the performance target by the keyboard performance recording circuit 116 and the keyboard performance reproducing circuit 118 at the above playback timing. ((59) in the figure). Then, after the musical tone output signal and the accompaniment tone based on the audio signal are synthesized by the mixing circuit 128 ((60) in the figure), the synthesized performance tone is emitted from the speaker 108 via the speaker amplifier 130. Playback operation is executed ((61) in the figure). As a result, a piece of music to be played is automatically selected from a plurality of pieces of performance data recorded when the user previously played the keyboard in accordance with the accompaniment sound of the external device 200 from the speaker 108, and is played at an appropriate timing. The accompaniment sound and the performance sound are reproduced (without any deviation in timing), and the performance state at the time of the previous recording is faithfully reproduced.

When the control microcomputer 112 detects the end (or stop) of the keyboard performance sequence read out by the keyboard performance recording circuit 116, the control microcomputer 112 ends (or stops) the reproduction of the performance sequence ((20) in the figure). , in synchronism with this timing, the output of the synthesized performance sound and the performance sound from the speaker 108 is terminated (or stopped).

As described above, in this embodiment, by providing the signal pitch detection circuit 132 for detecting the signal pitch of the header portion of music, the signal of the leading portion (header portion) of the analog audio signal input from the external device 200 can be detected. The pitch Pn is detected and measured, and the characteristic of the signal pitch in the header section is used to determine the keyboard performance to be played from a plurality of keyboard performance sequences (performance data) recorded in association with the signal pitch Pn in advance. and the difference time (delay time) Tn are automatically selected.

As a result, according to the present embodiment, a musical piece played by the external device 200 can be selected from among a plurality of recorded keyboard performance sequences by playing the musical piece on the keyboard 102 while listening to the musical piece reproduced by the external device. A performance sound based on the keyboard performance sequence is automatically selected, and can be synthesized with a musical piece reproduced by an external device 200 at appropriate timing (without timing deviation) and reproduced as a synthesized performance sound. Therefore, the performance state at the time of previous recording can be faithfully reproduced by a simple processing method without requiring any special operation by the user. That is, also in this embodiment, it is possible to obtain the same effects as those of the above-described first embodiment.

In the present embodiment, no particular condition or definition was given for the signal pitch Pn of the leading portion (header portion) of the audio signal, which is detected and measured by the signal pitch detection circuit 132. However, for example, the waveform data of the audio signal , it is possible to apply a well-known method of calculating the signal pitch based on the period of the peak values that exist within a certain period. Also, when the signal pitches of different audio signals match or approximate each other, for example, a method of comparing the average pitch for each fixed period (for example, 5 seconds) or a method of comparing the timing of continuous pitch changes. may be applied to improve the determination accuracy.

Further, in this embodiment, the signal pitch Pn of the header portion of the analog audio signal input from the external device 200 is detected and measured, and based on the characteristics of the signal pitch, a plurality of pre-recorded keyboard performances are performed. Although the case of selecting the performance data to be played and the difference time (delay time) Tn from the sequence of , the present invention is not limited to this. For example, the performance data to be played can be arbitrarily selected by the user. On the other hand, the difference time (delay time) Tn is the result of detecting and measuring the signal pitch Pn of the header part of the audio signal described above. The appropriate one may be automatically selected based on.

In each of the above-described embodiments, the differential time Tn from the input timing of the audio signal input from the external device 200 until the user starts playing the keyboard is a fixed value measured by the time measurement recording circuit 124 when the performance is recorded. However, the present invention is not limited to this. For example, it may be possible to appropriately change after the end of performance recording or at the time of performance reproduction. As a result, it is possible to change the timing of synthesizing the performance data by the user with respect to the musical piece of the accompaniment sound input from the external device 200 and reproduced, so that it can be applied to performance practice, learning, and the like. can.

In each of the above-described embodiments, music data such as accompaniment sounds are input from the external device 200 to the electronic musical instrument 100 via a communication cable such as the audio cable 300 . In this way, by connecting the electronic musical instrument 100 and the external device 200 via the communication cable, it is possible to reliably transmit the music data reproduced by the external device 200 at a stable speed and with low noise. However, the present invention is not limited to this. It may be used for an ensemble performance or the like. In this case, depending on the surrounding environment, the musical sound may not be captured stably or noise may be mixed in, but the advantage is that there is no need to prepare a communication cable, and the musical sound is rich in presence. has the advantage of being able to obtain

Further, in each of the above-described embodiments, as the music data input from the external device 200 to the electronic musical instrument 100 via the audio cable 300, the case has been described in which the music data that accompanies the keyboard performance of the electronic musical instrument 100 is applied. However, the present invention is not limited to this. For example, by applying song data, vocal data, etc. of famous artists and orchestras, you can simulate a session of your own performance with artists, orchestras, etc., and reproduce your performance state at that time. It may be intended to improve performance levels and skills, or to practice or study performance.

Although several embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and includes the invention described in the claims and their equivalents.
The invention described in the original claims of the present application is appended below.

(Appendix)
[1]
an external input terminal for inputting musical tone signals from the outside,
an operation detection means for detecting an operation related to performance;
A difference from a first timing at which the reproduction of the musical tone signal input from the external input terminal is started to a second timing at which the operation related to the performance is started by the operation detecting means after the reproduction of the musical tone signal is started. a time measuring means for measuring time;
Performance data related to the performance detected by the operation detection means is stored in a storage means in association with the difference time measured by the time measurement means, and the performance related to the performance is associated with the difference time. When it is detected again that the reproduction of the musical tone signal has started while the data is stored in the storage means, the performance data stored in the storage means is replaced with the difference associated with the performance data. a control means for starting reproduction with a time delay;
A recording/reproducing device comprising:

[2]
The control means is
including signal characteristic detection means for detecting signal characteristics included in the musical tone signal;
When a musical tone signal is input from the external input terminal, the signal characteristic included in the input musical tone signal is detected, and the performance data related to the performance and the musical tone signal are associated with the detected signal characteristic. adding and storing the difference time to the storage means;
When it is detected again that the reproduction of the musical tone signal has started in a state in which the performance data and the differential time related to the performance are stored in the storage means in association with each of the plurality of signal characteristics, The signal characteristics are detected by the signal characteristics detection means, and the performance data and the differential time associated with the detected signal characteristics are selected from among the plurality of signal characteristics stored in the storage means. The recording/reproducing apparatus according to [1], wherein the reproduction of the selected performance data is started at a timing delayed by the selected differential time.

[3]
The recording/reproducing apparatus according to [2], wherein the signal characteristic included in the musical tone signal is a signal pitch of a header portion of the musical tone signal.

[4]
The recording/playback apparatus according to any one of [1] to [3], wherein the differential time is changeable.

[5]
The recording/reproducing apparatus according to any one of [1] to [4], wherein the tone signal is an analog signal and the performance data is a digital signal.

[6]
The recording/playback apparatus according to any one of [1] to [5], wherein the musical tone signal is input to the external input terminal via a communication cable.

[7]
measuring a difference time from a first timing at which the reproduction of a musical tone signal input from the outside is started to a second timing at which an operation related to performance is started after the reproduction of the musical tone signal is started;
storing performance data related to the performance in a storage means in association with the measured difference time;
When it is detected again that the reproduction of the musical tone signal has started, the performance data stored in the storage means is reproduced at a timing delayed by the differential time associated with the performance data.
A control method for a recording/playback device, characterized by:

[8]
to the computer,
measuring a difference time from a first timing at which reproduction of a musical tone signal input from the outside is started to a second timing at which an operation related to performance is started after the reproduction of the musical tone signal is started;
storing performance data related to the performance in a storage means in association with the measured difference time;
When the start of reproduction of the musical tone signal is detected again, the performance data stored in the storage means is started to be reproduced at a timing delayed by the differential time associated with the performance data.
A control program for a recording/reproducing device, characterized by:

[9]
the recording/playback device according to any one of [1] to [6];
an operation unit for performing an operation for specifying a pitch for performance;
output means for outputting at least one of the musical tone signal and the performance data reproduced by the recording/reproducing device;
An electronic musical instrument comprising:

100 electronic musical instrument 102 keyboard (operation unit)
104 operation panel (operation unit)
108 speaker (output means)
110 External input terminal 112 Control microcomputer (control means)
114 Keyboard performance detection circuit (operation detection means)
116 Keyboard performance recording circuit (storage means)
118 keyboard performance reproduction circuit 120 audio input terminal circuit 122 signal presence/absence detection circuit 124 time measurement recording circuit (time measurement means, storage means)
126 performance recording/playback timing generation circuit 128 mixing circuit 132 signal pitch detection circuit (signal characteristic detection means)
134 pitch recording circuit (storage means)
136 Pitch determination performance target data selection circuit (control means)
200 External device 300 Audio cable (communication cable)

A recording/playback device according to the present invention includes:
measuring a difference time from a first timing at which the reproduction of a musical tone signal input from the outside is started to a second timing at which an operation related to performance is started after the reproduction of the musical tone signal is started ;
The performance data and the difference time associated with the performance are stored in a storage means in association with the signal characteristics included in the input musical tone signal, and are associated with each of the plurality of signal characteristics and associated with the performance. When it is detected again that the reproduction of the musical tone signal has started while the performance data is stored in the storage means, the reproduction is started from among the plurality of signal characteristics stored in the storage means. When a plurality of signal characteristics matching or approximating the signal characteristics included in the musical tone signal are confirmed, the average value of each of the plurality of confirmed signal characteristics for each fixed period and the musical tone signal whose reproduction is started One of the performance data and the difference time is selected by comparing the included signal characteristics with an average value for each fixed period, or the timing of each change of the confirmed plurality of signal characteristics and the reproduction selecting one of the performance data and the differential time by comparing the timing of changes in signal characteristics included in the musical tone signal that has been started;
The reproduction of the selected performance data is started at a timing delayed by the selected differential time .

Claims (9)

an external input terminal for inputting musical tone signals from the outside,
an operation detection means for detecting an operation related to performance;
A difference from a first timing at which the reproduction of the musical tone signal input from the external input terminal is started to a second timing at which the operation related to the performance is started by the operation detecting means after the reproduction of the musical tone signal is started. a time measuring means for measuring time;
Performance data related to the performance detected by the operation detection means is stored in a storage means in association with the difference time measured by the time measurement means, and the performance related to the performance is associated with the difference time. When it is detected again that the reproduction of the musical tone signal has started while the data is stored in the storage means, the performance data stored in the storage means is replaced with the difference associated with the performance data. a control means for starting reproduction with a time delay;
A recording/reproducing device comprising: The control means is
including signal characteristic detection means for detecting signal characteristics included in the musical tone signal;
When a musical tone signal is input from the external input terminal, the signal characteristic included in the input musical tone signal is detected, and the performance data related to the performance and the musical tone signal are associated with the detected signal characteristic. adding and storing the difference time to the storage means;
When it is detected again that the reproduction of the musical tone signal has started in a state in which the performance data and the differential time related to the performance are stored in the storage means in association with each of the plurality of signal characteristics, The signal characteristics are detected by the signal characteristics detection means, and the performance data and the differential time associated with the detected signal characteristics are selected from among the plurality of signal characteristics stored in the storage means. 2. The recording/reproducing apparatus according to claim 1, wherein the reproduction of the selected performance data is started at a timing delayed by the selected differential time. 3. A recording/reproducing apparatus according to claim 2, wherein the signal characteristic included in said musical tone signal is a signal pitch of a header portion of said musical tone signal. 4. The recording/reproducing apparatus according to claim 1, wherein said differential time is changeable. 5. The recording/reproducing apparatus according to claim 1, wherein said tone signal is an analog signal, and said performance data is a digital signal. 6. The recording/reproducing apparatus according to claim 1, wherein said musical tone signal is input to said external input terminal via a communication cable. measuring a difference time from a first timing at which the reproduction of a musical tone signal input from the outside is started to a second timing at which an operation related to performance is started after the reproduction of the musical tone signal is started;
storing performance data related to the performance in a storage means in association with the measured difference time;
When it is detected again that the reproduction of the musical tone signal has started, the performance data stored in the storage means is reproduced at a timing delayed by the differential time associated with the performance data.
A control method for a recording/playback device, characterized by: to the computer,
measuring a difference time from a first timing at which reproduction of a musical tone signal input from the outside is started to a second timing at which an operation related to performance is started after the reproduction of the musical tone signal is started;
storing performance data related to the performance in a storage means in association with the measured difference time;
When the start of reproduction of the musical tone signal is detected again, the performance data stored in the storage means is started to be reproduced at a timing delayed by the differential time associated with the performance data.
A control program for a recording/reproducing device, characterized by: a recording/playback device according to any one of claims 1 to 6;
an operation unit for performing an operation for specifying a pitch for performance;
output means for outputting at least one of the musical tone signal and the performance data reproduced by the recording/reproducing device;
An electronic musical instrument comprising:

Images