JP2931718B2 - Imaging equipment - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup optical system, an image pickup device for photoelectrically converting light incident through the image pickup optical system, and outputting an image signal, and an image storage for storing an image to be combined. The present invention relates to an improvement of a photographing apparatus provided with means.

[0002]

2. Description of the Related Art Conventionally, as an apparatus for synthesizing a photographed image with another image, a photographer prepares a still image such as a title or an illustration, shoots it as a still image with a video camera, and binarizes it. Processing the image stored in the memory circuit and combining it with the image to be synthesized by combining the image in the memory circuit with the captured image, or storing various types of images in the memory circuit in advance In addition, there is known a configuration in which an image is called from a storage circuit as needed and combined with a captured image.

FIG. 10 is a block diagram showing a main part of a conventional photographing apparatus having such a function.

First, an operation of reading an image will be described.

[0005] A still image signal such as a title from the image pickup device 101 is input to a video signal conversion circuit 103 via an image synthesis circuit 102, where it is converted into a video signal conforming to the television standard, and is converted into a binarization circuit 104. Supplied to Thereafter, the data is A / D-converted by the binarization circuit 104, compared with a predetermined signal level, converted into binary image data, and supplied to the memory control circuit 105. Then, the binary image data for one image is written by a memory control circuit 105 to an image memory 106 composed of a writable and readable static RAM or the like.

Next, an operation of synthesizing an image will be described.

The memory control circuit 105 supplies the image data read from the image memory 106 to the image synthesizing circuit 102 based on the synchronizing signal from the synchronizing signal generating circuit 107, controls the operation of the image synthesizing circuit 102, The image is combined with the captured image. The memory control circuit 105 also performs conversion of the color of the stored image and the like, and also converts image data of RGB three primary color signals into a luminance signal and a color difference signal.

[0008]

However, in the above-mentioned conventional example, the image to be synthesized is synthesized with the photographed image in accordance with the format stored in the image memory 106. It is possible to create an image as intended by the photographer by placing the subject while avoiding the area such as the title occupying inside, but such an operation can not be performed if the subject is an image with motion,
There is a problem that an image to be combined and a subject overlap each other, resulting in an image different from the intention of the photographer, or a complicated camera operation such as taking an image in accordance with the combined image.

Further, a method has been devised in which an image is synthesized with a photographed video by using another dedicated device, a so-called editing machine, after the shooting is completed. There is a problem that it is necessary to purchase a machine and perform complicated operations for editing.

In view of the above, an object of the present invention is to provide a subject to be photographed without performing a troublesome operation.
It is an object of the present invention to provide a photographing apparatus capable of appropriately combining images without damaging a body image .

[0011]

Means for Solving the Problems To achieve the above object,
According to the first aspect of the present invention, there is provided an image pickup optical system, an image pickup device that photoelectrically converts light incident through the image pickup optical system, and outputs an image signal, and an image pickup device obtained from the image pickup device.
Storage means for storing the image to be synthesized with image, the
Focused state based on the image signal output from the image sensor
Subject extracting means for extracting an area of a subject in the image capturing apparatus; synthesizing means for synthesizing a captured image obtained from the image sensor with an image stored in the storage means;
In the area extracted by the storage means,
Control the image is to control the synthesis of the combining means so as not to interfere
Is characterized in Rukoto a control means.

[0012] To achieve the above object,
Item 4 of the present invention is a photographing optical system capable of changing the photographing magnification.
And photoelectrically convert the light incident through the photographing optical system,
An image sensor that outputs an image signal;
Memory for storing images to be combined with captured images
And an image signal output from the image sensor.
To extract the area of the subject in focus
Means, a captured image obtained from the image sensor, and the storage
Synthesizing means for synthesizing an image stored in the means;
By controlling the magnification of the shadow optical system,
For the size of the image stored by the storage means,
The area extracted by the subject extracting means has a predetermined size.
Control means for controlling the synthesis of the synthesis means.
The feature is that it is obtained.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the illustrated embodiments.

FIG. 1 is a block diagram showing a configuration of a photographing apparatus according to a first embodiment of the present invention.
1 is a photographing optical system, 2 is an image sensor, 3 is an image composition control circuit for controlling image composition, 4 is an image memory for storing image information, 5 is an image signal from the image sensor 2 and an image from the image memory 4. An image synthesizing circuit for synthesizing signals;
Video signal conversion circuit for converting the video signal of the image signal synthesized by the image signal or the image synthesizing circuit 5 according to the television standard from, 7 subject extraction for extracting a region of the subject from the image pickup signal from the image pickup element 2 Circuit, 8 is imaging device 2
A binarizing circuit for binarizing the image in accordance with the luminance of the image signal from the image memory 9;
A memory control circuit that performs conversion of the color of a stored image while reading the image data as necessary, and also converts the image data into a luminance signal and a color difference signal of RGB three primary color signals. Reference numeral 10 denotes a synchronizing signal generation circuit that generates a signal for synchronizing the operation, and 11 denotes an image sensor driving circuit that controls the operation of the image sensor 2.

Here, the operation of the subject extracting circuit 3 will be described with reference to FIG.

The subject extracting circuit 3 detects a blur width corresponding to the blur amount of the edge portion of the subject image from the image pickup device 2 (see FIG. 2A), and blurs the edge according to the detected degree of focus. The distribution of the width on the imaging screen is recognized (see FIG. 2 (b)), and the area of the main subject is set from the in-focus distribution (see FIG. 2 (c)).

Next, the operation of the main part of the photographing apparatus according to the first embodiment of the present invention will be described with reference to FIGS. 4 and 5, according to the flowchart of FIG . In this description of the operation, the photographer prepares a still image of the title, photographs it as an image to be synthesized by the photographing device, binarizes it, and stores it in the image memory 4. State.

In step 101, when it is determined that the photographer has instructed image composition, step 1 is performed.
02, the image synthesis control circuit 3 fetches image (hereinafter referred to as synthesized image) information to be synthesized from the image memory 4 via the memory control circuit 9, and in the next step 103, this synthesis is performed. From the image information, an area occupied by the image to be composited on the imaging screen is detected (see FIG. 4). Then, in step 104, information about the subject area is fetched from the subject extraction circuit 7, and in the next step 105, it is determined whether or not the subject area and the composite image area interfere with each other. In FIG. 5, (a) is an example in which interference occurs, and (b) is an example in which interference does not occur. As a result of the above determination, if there is no interference between the respective regions, the process proceeds to step 107 in order to synthesize the image in the image memory 4 as it is with the captured image. Image memory 6
By so-called affine transformation such as parallel movement, reduction , rotation, etc. of the image, the image is converted so as not to interfere with the area, and an image which does not overlap with the subject is generated (see FIG. 5C). Then, in step 107, the converted image is supplied to the image synthesizing circuit 5.

If the synthesis of images continues for a plurality of screens, the process returns from step 108 to step 102, and the above operation is repeated.

By performing the above operations, the image synthesizing circuit 5 synthesizes the image signal supplied from the image synthesizing control circuit 3 into the same image signal as the image signal used for object recognition (FIG. 5). (See (d)), the combined image signal is supplied to the video signal conversion circuit 6.

The type of image conversion in the image synthesis control circuit 3 may be specified in advance by the photographer, or may be automatically controlled by the image synthesis control circuit 3 according to the movement of the subject. Is also good.

Further, a video signal used for determination of image conversion may be obtained by using an image pickup signal several screens past so as to reduce the delay of the video signal due to the calculation time. The image to be synthesized may be a color image stored in the image memory 4 in advance.

Further, when the image is fetched and binarized and stored in the image memory 4, the memory control circuit 9 calculates the area occupied on the imaged screen of the fetched image, and combines the image area with the image information to obtain an image. A configuration in which data is stored in the memory 4 may be used.

Further, the information of the image pickup signal used for extracting the subject may be a luminance signal or a color signal instead of the blur width, or may be used together.

(Second Embodiment) FIG. 6 is a diagram for helping to explain the operation of the main part in a second embodiment of the present invention.

The second embodiment has the same circuit configuration as the first embodiment, but shows a case in which the conversion process for synthesizing still images such as titles stored in the image memory 4 is different. The composition processing operation will be described with reference to FIG.

The image composition control circuit 3 determines the subject area and the composite image area, and when it is determined that there is interference (see FIG. 6A), an area where the two areas intersect is extracted (see FIG. 6A). The extracted area is subtracted from the synthesized image area (see FIG. 6C), and the synthesized image corresponding to the remaining area is supplied to the image synthesis circuit 5. As a result, the image synthesizing circuit 5 outputs the synthesized image / video signal converting circuit 6 as shown in FIG.

(Third Embodiment) FIG. 7 is a block diagram showing the configuration of a photographing apparatus according to a third embodiment of the present invention. In this embodiment, photographing is performed based on area determination by the image synthesis control circuit 3. The optical system 1 is configured to control zooming, and portions having the same functions as those in FIG. 1 are denoted by the same reference numerals.

In FIG. 7, reference numeral 12 denotes a photographing optical system driving circuit for driving the photographing optical system 1, and reference numeral 13 stores an image (such as an image shown in FIG. 9B described later) to be combined in advance. Image memory.

Next, the operation will be described with reference to FIG. 9 in accordance with the flowchart of FIG.

In step 201, the image composition control circuit 3 determines the size of the subject area (see FIG. 9A) and the size of the composite image (see FIG. 9B) (FIG. 9C).
As a result, if it is determined in step 202 that the image is not appropriate, the process proceeds to step 203, in which the image synthesis control circuit 3 determines whether the size of the synthesized image should be converted or the size of the subject should be changed. A determination is made as to what to do. If the size of the subject is to be converted, the process proceeds to step 204, in which the zooming instruction information for changing the shooting magnification of the shooting optical system 1 to the wide-angle side or the telephoto side is input. Then, the zooming in the designated direction is started. Thus, the size of the subject in the screen changes in a predetermined size direction. Then, in the next step 206, when it is determined that the size of the subject has reached the predetermined size (see FIG. 9D), the process proceeds to step 207.

When the variable power lens in the photographing optical system 1 reaches the wide-angle end or the telephoto end during the magnification changing operation and a predetermined magnification cannot be realized, a display prompting the photographer to change the photographing position. May be indicated. Further, the size of the subject may be converted by electronically converting the image pickup signal, or, of course, the electronic means and the optical means may be combined.

If the image stored in the image memory 13 is to be converted in step 203, the process proceeds to step 205, in which a so-called affine transformation such as parallel movement, enlargement / reduction, or rotation of the image is performed to convert the composite image. The size is converted to a predetermined size.

It should be noted that the image memory 13 may store a plurality of the same type of synthesized image in a plurality of sizes and select a desired size.

If the above operation is completed, or if it is determined in step 202 that the size of the subject region and the combined region is appropriate, the process proceeds to step 207, where the data is converted or Is supplied to the image synthesizing circuit 5.

If the synthesis of images continues for a plurality of screens, the process returns from step 208 to step 202, and the above operation is repeated.

By performing the above operations, the image synthesizing circuit 5 synthesizes the image signal supplied from the image synthesizing control circuit 3 into the same image signal as the image signal used for object recognition (FIG. 9). (See (e)), the combined image signal is supplied to the video signal conversion circuit 6.

(Modification) In the present embodiment, the images are synthesized based on the information on the subject area extracted by the subject extraction circuit 7. However, the present invention is not limited to this. For example, it is determined from the luminance signal and the color signal that the object is in the sky. Since the subject is almost not present in this area, a memory image may be combined with this area.

The above-described processing can be performed by controlling the present invention not only for a synthesized image but also for a moving image including a plurality of screens for each screen.

Further, in each of the above embodiments, the composition processing is performed by setting the area of the composite image. However, the composition processing may be performed by comparing the composite image data itself with the subject area.

[0041]

As described above, according to the first aspect of the present invention, an area of a subject in focus is extracted.
Memory area so that it does not interfere with the area.
Perform complicated operations because the images are combined
And damage the image of the subject to be shot.
In addition, appropriate synthesis of images can be performed.

According to the fourth aspect of the present invention,
By controlling the magnification of the photographic optical system,
The size of the image stored by the storage means
The area extracted by the extracting means has a predetermined size.
Since the image is synthesized, the synthesized image is well-balanced without any troublesome operation, and without impairing each of the image to be used and the image to be synthesized.
Can be obtained.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a photographing apparatus according to a first embodiment of the present invention.

FIG. 2 is a diagram for explaining an operation in the subject extraction circuit of FIG. 1;

FIG. 3 is a flowchart showing an operation of a part according to the present invention of the photographing apparatus in the first embodiment of the present invention.

FIG. 4 is a diagram to help explain the operation of FIG. 3;

FIG. 5 is a diagram for helping to explain the operation of FIG. 3;

FIG. 6 is a diagram for explaining an operation of a portion according to the present invention in the second embodiment of the present invention.

FIG. 7 is a block diagram illustrating a photographing apparatus according to a third embodiment of the present invention.

FIG. 8 is a flowchart showing an operation of a portion according to the present invention of the photographing apparatus in the third embodiment of the present invention.

FIG. 9 is a diagram for helping explain the operation of FIG. 8;

FIG. 10 is a block diagram showing a configuration of a conventional photographing apparatus.

[Description of Signs] 1 shooting optical system 2 imaging device 3 image synthesis control circuit 4 image memory 5 image synthesis circuit 6 video signal conversion circuit 7 subject extraction circuit 8 binarization circuit 9 memory control circuit 12 shooting optical system drive circuit 13 image memory

──────────────────────────────────────────────────続 き Continuation of the front page (56) References JP-A-63-172577 (JP, A) JP-A-50-94822 (JP, A) JP-A-63-233679 (JP, A) JP-A-2- 210981 (JP, A) JP-A-4-122991 (JP, A) JP-A-64-15791 (JP, A) JP-A-60-59685 (JP, A) JP-A-3-34370 (JP, U) (58) Fields surveyed (Int.Cl. ⁶ , DB name) H04N 5/262-5/28

Claims (4)

(57) [Claims] 1. An image pickup optical system, an image pickup device that photoelectrically converts light incident through the image pickup optical system and outputs an image signal, and an image to be combined with a photographed image obtained from the image pickup device. storage means for, based on an image signal output from the image pickup device, focus
Subject extracting means for extracting an area of a subject in a state, synthesizing means for synthesizing a captured image obtained from the image sensor with an image stored in the storage means, and an area extracted by the object extracting means. The storage means
<br/> imaging apparatus according to claim Rukoto and control means stored images to control the synthesis of the combining means so as not to interfere with. 2. The photographing apparatus according to claim 1, wherein
The control means controls the image stored by the storage means.
At least one of translation, reduction, and rotation
The subject extracting means
In the area extracted by the storage means,
The combining of the combining means is controlled so that the image does not interfere.
An imaging device , characterized in that: 3. The photographing apparatus according to claim 1, wherein:
The control means controls the captured image obtained from the image sensor.
And storing the area in the area extracted by the object extracting means.
Combine only the parts where the images stored by the means do not interfere
To control the synthesis of the synthesizing means.
An imaging device characterized by the following . 4. A photographing optical system capable of changing a photographing magnification, and light incident through the photographing optical system is photoelectrically converted to form an image signal.
And an image to be synthesized with a captured image obtained from the image sensor.
A focus unit based on a storage unit for storing an image and an image signal output from the image sensor;
And the object extracting means for extracting a region of the subject in the state, the serial in the storage means and the photographed image obtained from the image sensor
A synthesizing unit for synthesizing the memorized image and a photographic magnification of the photographic optical system by scaling control.
The size of the image stored by the storage means
The area extracted by the subject extracting means is a predetermined size.
Control means for controlling the synthesis of the synthesis means so that
An imaging device, comprising: a step;