JPH0235396B2 - - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION The present invention records performance data in digital form using a video device that records video signals, and performs performance recording and playback that allows, for example, an automatic performance of a musical instrument to be performed along with video playback. Regarding equipment.

Conventionally, it has been known to form a video signal including two channels of audio information for one channel of image information, and such a video signal is
Recording is performed on a video tape recorder or a video disk device. For example, in the case of musical performances such as orchestral performances,
The sound of the performance is reproduced in high quality stereo along with the image of the performance scene, and can be effectively used in music education and the like.

However, music reproduction using such a video device is only electronically reproduced and generated from a speaker, and it is not possible to directly hear the sound of the actual musical instrument itself.

The present invention has been made in view of the above-mentioned points, and it is possible to record and reproduce at least the performance data of a specified musical instrument at the same time, for example, while the performance scenery and sound of the musical instrument are being reproduced.
Based on the performance data, the performance of the instrument is controlled,
It is an object of the present invention to provide a performance recording and reproducing device that can reproduce performance scenes including direct musical instrument performance sounds.

That is, the recording and reproducing apparatus according to the present invention stores and sets at least performance data of a specified musical instrument, and also stores and sets image information corresponding to the performance of the musical instrument, and stores the performance data in the first plurality of frames and thereafter. A mixed video signal in which image information is set is recorded and played back, and the played performance data is stored and set, and the performance data is read out in synchronization with the playback of the image information and used for playing the musical instrument. It was designed so that

An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 shows the configuration of the recording section, in which a self-playing piano 11a, which is included in the group of musical instruments 11 to be played and is played by a musician, is set, and key operations can be controlled from this piano 11a. For example, pitch data corresponding to the pitch of the operating key is generated. This pitch data is composed of, for example, a combination of a 2-bit octave code and a 4-bit note (note name) code, and is composed of a 2-bit octave code and a 4-bit note (note name) code.
Since keys in 1a are operated using both hands, multiple keys may be operated at the same time, and in such cases, the pitch data corresponding to each of the operated keys is stored in parallel. It is occurring. The pitch data from the automatic performance piano 11a is supplied to a key coder 12 consisting of a channel processor. In the key coder 12, a plurality of channels are set, and the pitch data generated from the automatic performance piano 11a is distributed to empty channels in accordance with the order of occurrence, etc., and the buffer memory 15 stores the sound of the plurality of channels. Make sure to store high data in a buffer.

FIG. 2 shows a portion of the key coder 12 and buffer memory 13 that corresponds to one channel. Pitch data generated and distributed in accordance with key operations on the automatic piano is driven by clock φ1. It is stored in the first shift register 14. Then, the pitch data stored in this first shift register 14 is transferred to the next clock φ.
1, and the tone pitch data stored in the second shift register 15 is stored in the buffer 16 in response to another clock φ2 having a different phase. becomes.

Here, the first and second shift registers 1
The memorized pitch data of 4 and 15 are exclusive OR circuit 1.
7, and when there is a difference between the contents of the data stored in both registers 14 and 15, an output signal of "1" is generated from the exclusive OR circuit 17. That is, when new pitch data is input to the contact channel by a new key operation,
Alternatively, when the key corresponding to the pitch data that had been input until then is released and the input pitch data disappears, the exclusive OR circuit 17 outputs a signal "1".
is generated, and the event detection circuit 18 detects a change in the key operation state (event).

The pitch data stored in the buffer 16 is supplied together with the event detection signal to a synthesis circuit 19, and this synthesis circuit 19 receives counted value data from a counting circuit 20 that is driven by a clock pulse CP, that is, a time signal. It also provides data.
Then, time data corresponding to an event is detected from this synthesis circuit 19, and performance data is formed together with pitch data corresponding to the event.
This performance data is formed in the performance data forming circuit 21 for each channel. That is, compressed performance data including pitch data at the time of key depression as well as time data for each key depression and key release in the automatic performance piano 11a is generated corresponding to each channel. Channel data is stored and set in the memory 22 in order.

The calculation scene of the musical instrument group 11 including the automatic performance piano 11a is captured by the video camera 23 and used as image information, and the microphone 24
The performance sounds of the musical instrument group 11 excluding at least the performance sounds of the automatic performance piano 11a are detected in two channels, for example, and the image information and the performance sound information of the two channels are appropriately modulated and synthesized by the synthesis circuit 25. , as a video signal. This video signal is then stored and set in a video storage section 26 made of tape, disk, solid-state memory, or the like.

The performance data stored in the memory 22 and the video signal stored in the video storage section 26 are read out and controlled in accordance with commands from the readout control circuit 27. It is supplied to the mixing circuit 28 together with the read address data.

FIG. 3 shows the format of the mixed video signal mixed and formed by the mixing circuit 28.
The performance data is read out and extracted corresponding to, for example, several tens of fields of the video signal. Then, in response to the completion of reading out the performance data, the video signal is read out from the video storage section 26, and a continuous mixed video signal of the performance data and the video signal is taken out from the mixing circuit 28, and a video device consisting of a videotape or a video disk is output. Recorded against 29.

Here, as shown in FIG. 3, one line of address data is inserted into the blanking portion at the trailing edge of the vertical (V) synchronization period. This address data is
Start and stop addresses for performance data and image information are specified. The performance data is stored in advance in a memory, subjected to signal processing, and then output in synchronization with the image information using address data.

FIG. 4 shows a playback unit from a video device 29 in which a mixed video signal in the format as described above is recorded.The reproduced mixed video signal from this video device is supplied to a separation circuit 30, and first Performance data recorded over a plurality of fields is supplied to a performance data reproduction storage circuit 31. The video signal following this performance data is further supplied to the separation circuit 32, where it is separated into image information and two channels of performance sound signals.The image information is reproduced as an image on the monitor screen 33, and the performance sound signal is The sound is reproduced in high quality in stereo using the two-channel speaker systems 34a and 34b.

In this case, the separation circuit 30 separates and extracts the address data inserted in correspondence with vertical synchronization, drives the readout control circuit 35, synchronizes with the image and sound reproduction, and controls the performance data reproduction storage circuit. 31, and mechanically drives the automatic performance piano 11a,
Performance sounds can be obtained directly from this piano 11a.

That is, the scene of the performance is expressed as an image on the monitor screen 33, and the accompanying performance sound of the musical instrument group 11 is reproduced in high quality in stereo from the speaker systems 34a and 34b, and synchronized with this. Then, the automatic performance piano 11a starts to perform automatically. Therefore, the speaker system 34
Along with the reproduced sounds from the pianos a and 34b, the direct performance sound from the automatic performance piano 11a can be heard, and a very powerful performance situation can be reproduced. This can be very effective in music lessons.

Although not particularly shown in the figure, it is possible to form staff-shaped caption information based on the performance data read out from the performance data reproduction storage circuit 31 and to redisplay this on the monitor screen 33. can. In this case, the player piano 11a
If you turn off the automatic performance mode and play the piano using the staff notation displayed on the monitor screen 33,
It is possible to improve the effect of advanced piano performance practice.

As described above, according to the present invention, by using a video system using tapes, disks, etc., music performances are reproduced with images, and in particular, in a state where the straight performance sound of a specified musical instrument can be heard. Not only can you enjoy musically very powerful performance data, but it can also be very effective in music lessons.

[Brief explanation of drawings]

FIG. 1 is a configuration diagram illustrating a recording section of a performance recording/reproducing apparatus according to an embodiment of the present invention, FIG. 2 is a diagram illustrating performance data forming means in the recording section, and FIG. 3 is a diagram illustrating recorded video. FIG. 4 is a diagram illustrating the format of the signal, and a configuration diagram illustrating the reproducing section. 11... Instrument group, 11a... Self-playing piano,
12...Key coder, 21...Performance data forming circuit, 22...Memory, 23...Video camera, 2
6... Video signal storage circuit, 27... Readout control circuit, 29... Video device, 31... Performance data reproduction storage circuit, 33... Monitor screen, 34a, 3
4b... Speaker system, 35... Readout control circuit.

Claims (1)

[Claims] 1. A musical instrument that generates performance data in accordance with musical performance operations, a means for capturing images of scenery corresponding to musical instrument performance,
Means for storing the performance data and captured image information, and means for setting the performance data in at least the first plurality of fields and subsequently setting the image information to form a mixed video signal and record the video. , means for separating and reproducing performance data from the video-recorded mixed video signal and storing the same, and means for reading and controlling the stored performance data in synchronization with the reproduction of image information from the mixed video signal. A performance recording and reproducing device characterized in that it is possible to control the performance of a musical instrument based on the read performance data.