JPS60216687A - Picture retrieval device employing picture synthesization - Google Patents

Abstract

PURPOSE:To reproduce a video signal of a chromakey material in random access and to retrieve it by frequency-coupling a picture synthesizer and a color video camera by using a reproduction output signal of a picture memory device as a reference. CONSTITUTION:A still picture which is image-picked up by using a chromakey material as a background is recorded in an optical video disk device 1. By operating a retrieval panel 2, a sound signal as well as the still picture is outputted from the device 1, and inputted to a still frame audio adapter 3, which outputs the sound signal from a speaker 3 through a monitor color television device 4. The video signal of the still picture outputted from the device 1 is transmitted to a video distributor 6, while a signal A is inputted to a chromakey processor 7 and a color video camera 8 and used as a reference signal. A signal B is chromakey-processed in the processor 7 and transmitted to a hardcopy device 9. Videos of the camera 8 are stored in a color frame memory device 11.

Description

[Detailed Description of the Invention] [Field of Industrial Application] The present invention is an image synthesis method that performs image synthesis processing on a video material and another video by, for example, chroma key processing, and also allows the video material to be played back and searched in a random access manner. This invention relates to an image retrieval device using r.

[Background technology and its problems]

For example, when trying to select a wig hairstyle or glasses frame suitable for the person from among a plurality of wig hairstyles or glasses frames, the choice is made by looking at a pamphlet or actually trying it on.

Here, when selecting from a pamphlet, you can choose from a large number of printed samples, but there is a drawback that you cannot experience the feeling of actually trying on the clothes. Also, did you actually try it on and choose? However, there are problems in that it is not easy to prepare a large number of samples and that it takes time and effort to try on many samples one by one.

Therefore, it is conceivable to take and record images of a plurality of wig hairstyles or mega-frames, for example, and use image synthesis processing technology to select a wig hairstyle or glasses frame suitable for the person. In this case, an image obtained by capturing a wig hairstyle or glasses frame and an image obtained by capturing an image of the person's face can be combined into an image by, for example, chromakey processing.

Here, chroma key processing is a process of image synthesis processing of a video material such as a wig hairstyle or glasses frame, which is a chroma key material, and an image of the face of the person to whom the wig or glasses frame is to be attached. A key signal is created based on the hue difference using the three primary color signals, and synthesis processing is performed.

By the way, video materials of, for example, wig hairstyles and glasses frames captured against a so-called chroma color background, that is, chroma key materials, can be obtained from a color video camera or a VTR.

If an attempt is made to obtain a video signal of a chroma key material directly from a color video camera, there is a problem in that it can only handle individual chroma key materials and cannot efficiently handle multiple chroma key materials at once. ! In addition, when used in a color video camera', the captured images are image-synthesized immediately upon opening, so the effects obtained by the image-synthesizing process are limited.

Unfortunately, when trying to obtain a video signal for chromakey material using a VTR, it is possible to play back a large number of materials according to the order in which they were recorded on the recording tape, but a VTR is a sequential access playback device. Furthermore, even when fast-forwarding or fast-reversing, instantaneous random access-like playback is not possible, and a sufficiently rational image search cannot be performed.

Unfortunately, it is easy to synthesize images using chroma key processing.
Since a strict synchronization relationship must be maintained for the video signals to be processed, expensive peripheral devices such as a synchronization signal generator, delay unit, and time axis correction device are required, which increases the cost of the entire device. There is.

In this way, conventional image synthesis processing technology has been used to select, for example, wig hairstyles and glasses frames, but it has not been possible to search for wigs and glasses frames efficiently, and the equipment has become sophisticated. There was a problem with that.

[Purpose of the invention]

The present invention has been proposed in view of the above circumstances. For example, when performing image synthesis processing using chroma key processing, the video signal of the chroma key material can be played back and searched in a random access manner, and the entire device is inexpensive. The purpose of this invention is to provide an image retrieval device using image synthesis.

[Summary of the invention]

To achieve this objective, an image retrieval device using image synthesis according to the present invention includes a randomly accessible large-capacity image memory device, a color video camera for imaging a subject, and an image obtained by imaging with this color video camera. a frame memory device for storing a video signal; an image synthesis device for performing image synthesis processing on a reproduced image from the image memory device and an image captured by the color video camera; and a synthesized video signal of the image synthesis device. a monitor display device for displaying images, and synchronously connects the color video camera and the image synthesis device based on the reproduction signal of the image memory device;
The video signal reproduced in a random access manner from the image memory device according to the search operation and the video signal of the color video camera read from the frame memory device are combined in the image synthesis device and displayed on the monitor. It is characterized by displaying a synthesized image on the device.

〔Example〕

Hereinafter, embodiments of the present invention will be described in detail based on the drawings.

FIG. 1 is a block diagram of an image search device using image synthesis according to the present invention.

The image retrieval device described above uses an optical video disk device as a randomly accessible large capacity image memory device in which video signals of chroma key material are recorded, and the video into which the chroma key material is embedded is colored. The image is captured by a video camera, and this video signal is once stored in a color frame memory device. Then, the video signal of the chroma key material is played back in a random access manner by searching from the video disk device, and the video signal of the chroma key material and the video of the color video camera stored in the color frame memory device are combined, for example, with the chroma key material. Image compositing processing is performed through processing.

By the way, the image retrieval device shown in FIG. 1 can be applied to the Tatoeba Hair Production Use System. This hair production system, which applies the above-mentioned image search device, can select a wig hairstyle suitable for the person by using image synthesis means, and when searching, images of wig hairstyles are randomly accessed from system sword 1. It is now possible to play.

This system will be explained below. In FIG. 1, for example, the video disc of the optical video disc device 1 used as the image memory device has red, blue,
Various wig hairstyles to be selected are recorded in still image units, which are imaged against a so-called green chroma color background. The size of the wig hairstyle is kept constant according to the average head size of the person wearing the wig, and it is recorded so that it is displayed in the same position on the monitor screen, so that it can be displayed in the front, back, left, and right. The shape is recorded.

In addition, by operating the search panel 2 according to the operating procedure, the video disk device 1) will first play back a still image of the wig hairstyle used for positioning with the subject, according to the preprogrammed movements. is output.

1. Simultaneously with the output of the still image, the video disk device 1 outputs an audio signal of BGM and an audio message indicating an operating procedure, and inputs it to the still frame audio adapter 3. With this audio adapter 3,
The audio signal is output from the speaker 5 through a monitor display device such as a monitor color television device 4 (hereinafter referred to as monitor color TV device◆). The search panel 2 can be operated according to the messages.

Here, instead of using the audio adapter 3, a tape recorder is used and the video disc device 1 is connected to the video disc device 1.
The tape recorder may also output BGM or voice messages in synchronization with the still images output from the tape recorder.

Further, the video signal of the still image outputted from the video disc device 1 is sent to the video distributor 6 and divided into three parts. Of these three distributed signals, two systems of signals A are manually input to an image synthesis device, for example, a chroma key processing device 7 and a color video camera 8, and are used to synchronize and combine the chroma key processing device 7 and color video camera 8. Used as a reference signal.

The remaining signal B of one system is input as a video key signal to the chroma key processing device 7, and is subjected to chroma key processing in this chroma key processing device 7. For this,
The parts other than the hair style have been changed to a transparent color and a still image of Natsu.
This video signal is sent to the monitor color TV device 4 and video hard copy device 9.

Further, the color video camera 8 having a zoom lens 10 with an automatic focus mechanism is placed directly facing the face of the subject who is about to select a wig hairstyle, and the zoom lens 10 is used to adjust the subject size and focus. Wj
The subject's face is photographed. The video signal from the color video camera 28 is input as a video insert signal to the chromakey processing device 7, and is applied to the transparent portion of the video output of the video disk device 1, which is colored transparent except for the inner hairstyle portion. At this time, the color 7-frame memory device 11 is not activated, and the color video camera 2
The video signal of 8 is sent to the color frame memory device 11'? f:
0 Here, the subject checks the positional relationship between the wig hairstyle and his or her own face while watching the situation on the monitor color TV device 4, and activates the color frame memory device 11 in the optimal positional relationship. Therefore, one frame of the video signal from the video camera 28 is stored in the readable/writable color frame memory device 11. From this point on, the subject does not need to directly face the can-video camera 8 because the bright image signal stored in the color frame memory device 11 is read out and used. One video output read from the memory device 11 is input as a still image to the chroma key processing device 7, and is subjected to image synthesis processing using the wig hairstyle video output obtained from the video disk device 1 and chroma key processing.

Next, operate the search pile 2 to search for wig hairstyles recorded in the video disk device 1,
iL of monitor color TV device 4! Proceed through stage 11 and select a wig hairstyle. At this time, since still images of various wig hairstyles are played back in a random access manner through the search in the video disk device 1 or more, it is possible to select a wig hairstyle very efficiently.

Furthermore, when selecting the icicle hairstyle, a print sample of the effect screen can be obtained by activating the video hard copy device 9 equipped with a frame memory as needed. This completes the series of steps.

In this way, the image retrieval device uses, for example, the optical video disc device 1 as a large capacity image memory device that can be randomly accessed.
Based on the reproduction output, an image synthesizing device such as the chromakey processing device 7 and a color video camera 82 are synchronously coupled. C.

Therefore, expensive broadcasting equipment and peripheral devices such as synchronization signal generators, delay units, and time axis correction devices, which are generally required for chromakey processing, are not required, and the overall configuration is simplified and costs are reduced by combining compact devices. 71>7)> However, it is now possible to obtain the same effects as before.

Is this a synchronous connection function provided within the main device? This was achieved by using alternative methods and rationally connecting devices.

In addition, the optical video disc device 1 has a cycloma key.
The video material used as the raw material 1 It is selectively reproduced in a random access manner as a still image with high temporal axis stability.In addition, by using image synthesis processing technology in this way to select, for example, a wig hairstyle, it is possible to reproduce the actual Totame tsura hairstyle. There is an advantage that a large number of wig hairstyles can be stored as image samples without having to prepare many types of samples requiring a large space.

Further, there is an advantage that the effort of actually trying on a wig hairstyle can be saved, and it is possible to try on a wig in a pseudo manner through image composition processing.

By the way, the above-mentioned image search device is not limited to the above-mentioned hair retrieval system, but can also be used to select frames for eyeglasses, coordinate systems for interior decoration and clothing, various industrial designs, environmental prediction simulations, and flight control simulators and videos for aircraft, etc. It can be applied to games, etc. For this application, off-the-shelf products can be used and entire systems with high added value or productivity can be easily constructed.

As described above, according to the present invention, since the system configuration is simple, it is possible to generalize the application of image composition processing using chromakey processing.

Note that, as the image memory device, a DRAW device (direct 0 read-1 lid/write device) etc., which is not limited to the optical video disc device 1, can be used.

Furthermore, the image synthesis device may be a level key processing device or the like instead of the chroma key processing device 7. As a possible large-capacity image memory device, for example, an image synthesis device consisting of an optical video disc device Rk (?) is used, and the reproduction output signal of this image memory device is used as a reference, for example, a chromakey processing device 77), and an image synthesis device and a color video camera are periodically coupled. The video signal of the chromakey material reproduced in a rerandom access manner by retrieval from the image memory device 70) and the video signal captured by the color video camera are stored in the color frame memory device and then read out. For example, the images are subjected to chroma key processing using an image synthesis device.

Therefore, the 1ζ image retrieval device using image synthesis according to the present invention has a simplified configuration and is low in cost.
It is now possible to obtain the same effects as the conventional image synthesis device using chromakey processing.

Furthermore, the video signal of the chromakey material can be played back in a random access manner from the image memory device, and the search efficiency of a large number of materials is improved, making it possible to perform rapid image synthesis processing.

In addition, since the video signal obtained by capturing an image with a color video camera is stored in the color frame memory device, once the image signal is stored in the color frame memory device, it is possible to see that the subject is directly facing the color video camera. This is not necessary, and the operability of the image search device can be improved.

[Brief explanation of the drawing]

FIG. 1 is a block diagram of an image retrieval device using image synthesis according to an embodiment of the present invention. 1... Optical video disc device 2... Search pie, le 4... Monitor color TV device 6... Video distributor 7... Chromakey processing device 8... Color video camera 10@... Zoom lens 11...Color frame memory device P Applicant Nny Co., Ltd. Agent Patent attorney Koike Mimuki 1) Sakae Mura -

Claims (1)

[Claims] a randomly accessible large-capacity image memory device; a color video camera for capturing an image of a subject; a frame memory device for storing a video signal obtained by capturing an image with the color video camera; and a reproduced image from the image memory device and the above. It has an image compositing device that performs image compositing processing on images captured by a color video camera, and a monitor display device that displays the composite video signal of the image compositing device, and has a monitor display device that displays a composite video signal of the image compositing device, and uses the reproduced signal of the image memory device as a reference. The color video camera and the image synthesizing device are synchronously coupled, and the video signal reproduced in a random access manner from the image memory device in response to a search operation and the video signal of the color video camera read from the frame memory device are used to generate the image. An image retrieval device using image compositing, characterized in that a compositing device performs compositing processing, and the compositing processed video is displayed on the monitor display device.