JP2629740B2 - Sound processing device - Google Patents

Description

Description: BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sound processing apparatus for giving a change to a sound, and more particularly to a sound processing apparatus for changing a sound in relation to an image, for example, an effect of playing a musical instrument and a taste. The present invention relates to a sound processing device for enhancing the sound quality.

[Prior Art] Conventionally, a device for automatically controlling a musical tone corresponding to a video has not been realized.

In the case of electronic musical instruments, etc., conventionally, a DSP (Digital Signal Processor) has been used to control the equalizer, reverb, reverberation, etc. of the performance sound,
2. Description of the Related Art Various effects have been given to performance sounds by controlling timbres, touches, and the like. Since the control of the performance sound is performed by a manual operation of the player, the content of the change itself is limited.

[Problems to be Solved by the Invention] It is an object of the present invention to provide a device of a novel concept that automatically controls musical sounds in accordance with video.

It is another object of the present invention to provide a sound processing apparatus capable of giving a subtle, diverse, or special change to a musical tone.

[Means for Solving the Problems] In order to achieve the above object, a sound processing apparatus according to the present invention includes a control unit for generating a control parameter for controlling characteristics of an acoustic signal, and An audio signal generating means for generating an audio signal having a characteristic according to the control parameter; a video signal input means; and R (red), G (green) and B from the video signal input to the video signal input means.
A color signal separating unit that separates the (blue) color signal and outputs binarized gradation data of each color; and a displacement of the gradation data of each of R, G, and B output from the color signal separation unit. Contour detecting means for obtaining a point, and generating data representing the contour of the subject in the input video signal based on the displacement point, wherein the control means controls the contour of the subject supplied from the contour detecting means. And analyzing the shape of the subject based on the data representing the data, obtaining data representing the complexity of the contour of the subject, and generating the control parameter based on the obtained data.

[Operation] In the sound processing device of the present invention, the contour detecting means includes:
Extracts the complexity of the outline of the subject from video signals or information input from a VTR, LV player, TV camera, or the like. The control means changes the equalizer, reverb, reverberation, timbre, touch, etc. of the audio signal or information according to the complexity of the contour of the subject.

[Effects] Therefore, according to the present invention, visual perception is expressed in correspondence with sound. For example, by giving a change to an image even with the same music, it is possible to play or watch musical sounds having various changes. In addition, it is possible to realize a performance having subtle, diverse, or special changes that were difficult or impossible by manual operation.

Furthermore, when attached to an electronic musical instrument or the like, and the state of the audience at the concert venue is imaged, the musical sound of the electronic musical instrument is automatically changed according to the audience's motion (applause, clapping, step, overall fluctuation, etc.) There is also an effect that you can do it.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. First
FIG. 1 shows a configuration of a musical sound performance system according to an embodiment of the present invention. The system shown in FIG.
And a music performance device 2 configured similarly to a conventionally used device.

The tone processing device 1 includes an LV player 11, TV cameras 12 and 13,
It includes a color signal separation circuit 14, a contour detection circuit 15, a microprocessor 16, and the like.

The music performance device 2 includes a music information generation circuit 21, a digital signal processor (DSP) 22, an input device 23, a sound source 24, an amplifier 25, a speaker 26, and the like.

 Next, the operation of the system shown in FIG. 1 will be described.

In the tone processing apparatus 1, the LV player 11 reproduces a video such as a background recorded in advance. The TV camera 12 captures a background image such as a natural image or a CRT image that changes depending on a song or progress. The TV camera 13 images a performer, a performer, a percussion instrument, and the like.

The color signal separation circuit 14 includes the LV player 11 and the TV camera 1
The R (red), G (green), and B (blue) color signals are separated from the video signals input from 2, 13 and A / D converted for each color to obtain 3 to 6 bits / pixel (dot). Creates gradation (saturation) data and sends it to CPU16.

The contour detection circuit 15 creates data representing the contour of the subject based on the color signal or gradation data output from the color signal separation circuit 14 and sends the data to the CPU 16.

The CPU 16 extracts video elements based on the gradation and contour data output from the color signal separation circuit 14 and the contour detection circuit 15, calculates musical tone control parameters according to the result of the extraction, and forms the music performance device 2. To the DSP 22 and the sound source 24.

In the music playing apparatus 2, the music information generating circuit 21 includes a microphone and an amplifier for receiving the voice of the performer or singer, the sound of the musical instrument, and the voice or applause of the audience, a voice circuit such as the LV player 11, and a record. It comprises an audio input device such as a player or a tape recorder, and generates analog music information and sends it to the DSP 22.

The DSP 22 is the same as that conventionally used for controlling the equalizer, reverb and reverberation (sound field effect) of a musical tone. The DSP 22 converts analog music information generated from the music information generating circuit 21 into a digital signal, The musical information is changed by executing arithmetic processing according to the musical tone control parameter input from the CPU 16 of the musical tone processing device 1, and then converted again into an analog signal to form a musical tone signal, which is transmitted to the amplifier 25. .

The input device 23 is a keyboard (keyboard), a percussion instrument, or the like.

The sound source 24 generates a tone signal corresponding to key press information or the like input from the input device 23 and sends it to the amplifier 25. As the sound source 24, known sources such as a waveform memory reading system, a harmonic synthesis system, an FM system, and a frequency dividing system can be used. The sound source 24 controls the pitch of readout waveform, envelope waveform, spectrum of harmonics, calculation parameters, frequency division ratio, and the like in accordance with the tone control parameters input from the CPU 16 so that the generated tone signal is Gives a change according to the element.

The amplifier 25 amplifies a tone signal (analog signal) input from the DSP 22 and the sound source 24, and the speaker 26 is driven by the amplifier 25 to convert the tone signal into sound and generate sound.

In the system shown in FIG. 1, while a conventional music performance system such as an electronic musical instrument or an LV player gives a change in reverb or reverberation to a musical tone based on a panel operation by a player or a viewer, the system of FIG. The greatest feature is that elements are extracted and musical sounds are automatically changed based on the extraction results.

The relationship between the video element and the tone element to be controlled is, for example, by detecting the color balance of the entire screen of the video and emphasizing the high range to make a bright tone if there are many warm colors, and dark if there are many cool colors. Tones. If the number of contours and colors is detected and the shape is complicated or the number of colors is large, a tone with a strong touch is emitted by a vendor with a strong touch. If the tone is monotonous or small, a tone with a weak touch is emitted.

The hue is obtained by binarizing the gradation data of each of the R, G, and B colors with a predetermined threshold value as shown for the R data (a) in FIG. 2, and for each color, the number of pixels exceeding the threshold value ( Second
(The area of the hatched portion in FIG. B) is counted. If R is large, it is determined that there are many warm colors, and if there are many B, it is determined that there are many cool colors.
In addition, the number of colors used in one screen is detected by determining what combination of each gradation data of R, G, and B each pixel has. For example, in the simplest case, the color of each pixel is determined by arranging the R, G, and B binary data.
It is represented by bit data (0 to 7), and the number of pixels in which the same color appears by 10% or more of the number of pixels among these eight colors is counted.

On the other hand, as shown in FIG. 2c, the position (address) where the binary data of R, G, and B changes is detected as the contour. The CPU 16 analyzes the shape of the subject based on the contour data. Shape analysis is, for example, October 30, 1985
The method may be performed according to the method described in "Technology for Recognizing Shape Patterns" by Hidehiko Takano, published by Information Research Committee, Inc. The degree of complexity can be determined by counting the number of displacement points (marked in FIG. 3) within a certain area. Alternatively, the complexity of the solid line figure is detected by the ratio of the area of the figure shown by the solid line in FIG. 3 to the area of the figure (broken line) connecting the vertices of the convex part of the figure and the number of vertices of the convex part. You may do so.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a schematic configuration of a musical performance system according to an embodiment of the present invention, and FIG. 2 is a diagram for explaining image element (hue, number of colors, outline) detection in the system of FIG. FIG. 3 is an explanatory diagram of detection of a video element (shape of shape) in the system of FIG. 1: Music processing device, 2: Music performance device, 11: LV player, 12,
13: TV camera, 14: color signal separation circuit, 15: contour detection circuit, 1
6: Microprocessor, 21: Music information generation circuit, 22: DS
P, 23: input device, 24: sound source.

Claims (2)

(57) [Claims] 1. A control means for generating a control parameter for controlling a characteristic of an audio signal, an audio signal generating means for generating an audio signal having a characteristic according to the control parameter generated by the control means, and a video signal input Means, and R from the video signal input to the video signal input means.
(Red), G (green) and B (blue) color signals,
A color signal separating unit that outputs the grayscale data of each colorized value; and a displacement point of the grayscale data of each of the R, G, and B colors output from the color signal separation unit, and based on the displacement point, Contour detecting means for creating data representing the contour of the subject in the input video signal, wherein the control means performs shape analysis of the subject based on data representing the contour of the subject supplied from the contour detecting means. A sound processing apparatus for obtaining data representing the complexity of the outline of the subject and generating the control parameter based on the obtained data. 2. The sound is a musical tone, and the control means includes:
The sound processing device according to claim 1, wherein at least one of a tone color, a touch, an equalizer, a reverb, and a sound field effect of the musical tone is controlled.