JPH08223475A - Image pickup device - Google Patents

Abstract

PURPOSE: To pick up an image while easily and surely recognizing duplicate areas of plural images. CONSTITUTION: An image signal from an image pickup optical system 1 obtained by forming an image of an object onto an image pickup element 2 is fed to a display means 3k on which an image picked up at present is displayed and fed also to a duplicate area detection means 4, in which a duplicate area between an image having been picked up before by the image pickup element 2 and stored and an image picked up at present is detected. A signal representing the duplicate area detected by the duplicate area detection means 4 is fed to a display control means 5, which controls the display means 3 based on the signal representing the duplicate area, then the duplicate area is displayed on the display means 3. Thus, the duplicate area with the image picked up before in the case of image pickup is easily and surely recognized and an image with a wide field angle is easily obtained through a simple operation.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup device capable of obtaining a wide-angle image and a stereoscopic image, and is suitable for application to a video camera, an electronic camera or the like.

[0002]

2. Description of the Related Art Conventionally, the spread of personal computers has accelerated, and it has become possible to import an image captured by a video camera or an electronic camera into a personal computer for editing. For example, if an electronic camera divides a landscape into multiple images and captures them, the images are captured so that there are overlapping portions, these images are captured by a personal computer, and composite processing is performed by application software. Is given. That is, the images are combined so that the overlapping regions of the images overlap, and an image having a view angle much wider than the image view angle that can be picked up by the electronic camera can be obtained. As an example disclosing this, Japanese Patent Laid-Open No. 3-2
There are 62276, JP-A-5-328205 and the like.

In Japanese Patent Laid-Open No. 3-262276, an image to be captured is displayed on the second viewfinder while an image already captured is displayed on the first viewfinder. Then, by framing the image displayed in the first viewfinder and the image displayed in the second viewfinder so as to be continuous, a plurality of images capable of easily forming an image with a wide angle of view. Is disclosed. In addition, JP-A-5-
In Japanese Patent No. 328205, a part (specifically, right end) of the captured first image is displayed with the polarity reversed, and a second image is captured in accordance with the display of the first image. It is disclosed.

Further, for example, it is also possible to obtain the three-dimensional shape of a subject from a plurality of images obtained by photographing one subject from different viewpoints. The three-dimensional shape obtained from the conditions can be displayed on the personal computer. In order to obtain the three-dimensional shape of the subject, it is necessary that the subject is reflected in a plurality of captured images, and the three-dimensional shape can be obtained only from the overlapping area.

[0005]

However, in the method disclosed in Japanese Patent Laid-Open No. 3-262276 among the above-mentioned conventional examples, two viewfinders must be provided and images should be taken while comparing the two viewfinders. No
Therefore, there are problems in terms of cost and operability. Further, in the method disclosed in Japanese Patent Application Laid-Open No. 5-328205, since a part of the captured first image is fixedly displayed, it takes time to perform framing, and a stereoscopic shape may be obtained. In such a case, there was a problem that the overlapping area was too small to implement. Further, since the display position of the captured image is fixed as the end portion in the horizontal direction, it is possible to widen the angle of view in the horizontal direction, but it corresponds to widening the angle of view in the vertical direction. I couldn't.

Therefore, an object of the present invention is to provide an image pickup device capable of picking up an image while easily and surely recognizing an overlapping region of images.

Another object of the present invention is to provide an image pickup device capable of picking up an image while recognizing an overlapping region of images in a compound eye image pickup device easily and surely.

It is another object of the present invention to provide an image pickup device capable of recording a picked-up image.

Another object of the present invention is to provide an image pickup apparatus capable of preventing an image having no overlapping area from being recorded.

It is another object of the present invention to provide an image pickup apparatus capable of selectively recognizing an overlapping area of images.

Another object of the present invention is to provide an image pickup apparatus capable of easily performing image processing of an image having an overlapping area.

An object of the invention of claim 7 is to provide an image pickup apparatus capable of detecting an overlapping area without using special detecting means.

It is another object of the present invention to provide an image pickup apparatus capable of detecting an overlapping area without being affected by the image state.

It is another object of the present invention to provide an image pickup device capable of omitting useless information.

It is another object of the present invention to provide an image pickup device capable of displaying the presence / absence of overlapping areas of images at a low cost.

[0016]

In order to solve the above-mentioned problems, according to an image pickup apparatus of claim 1, an image pickup optical system for forming a subject image on an image pickup element, and an image picked up by the image pickup element. Based on the output of the display means for displaying, an overlapping area detecting means for detecting an overlapping area between an image previously captured by the image sensor and an image currently being captured, and an output of the overlapping area detecting means. Display control means is provided for controlling the display means to display an overlapping area between the captured image and the currently captured image.

According to another aspect of the image pickup apparatus of the present invention, a plurality of image pickup optical systems, an image pickup device provided corresponding to each of the image pickup optical systems, and a display unit for displaying an image picked up by the image pickup device. And an overlapping area detecting unit configured to store an image previously captured by the image sensor, and detecting an overlapping area of a plurality of images captured by the image sensor, and an output of the overlapping area detecting unit. Display control means for controlling the display of the overlapping area of the image on the display means.

According to the third aspect of the image pickup apparatus, there is provided a recording means for recording the image picked up by the image pickup element.

According to the fourth aspect of the present invention, there is provided the warning means for issuing a warning when the image in which the overlapping area does not exist is recorded in the recording means.

According to the image pickup device of the fifth aspect, there is provided a selecting means for selecting whether or not to associate the currently captured image with the previously captured image.

According to the sixth aspect of the present invention, when the image related by the selecting means is selected, the recording control means records the related information in the recording means as the incidental information of the image to be recorded. ing.

According to the seventh aspect of the image pickup apparatus, the overlapping area detecting means includes a correlation detecting means for determining the overlapping area by detecting a correlation between a plurality of images.

According to the eighth aspect of the image pickup apparatus, the overlapping area detecting means includes an image pickup condition detecting means for discriminating the overlapping area by detecting the image pickup condition of the image pickup apparatus.

According to the image pickup device of claim 9, there is provided a recording control means for recording only the overlapping area in the recording means based on the output of the overlapping area detecting means.

According to the imaging device of the tenth aspect, the display means includes the light emitting means, and the display control means controls the light emitting state of the light emitting means based on the output of the overlapping area detecting means.

[0026]

According to the first aspect of the present invention, since the overlapping area between the previously captured image and the currently captured image is displayed on the display means, the image is captured before the image is captured. It is possible to easily and surely recognize the overlapping area with the image.

Further, according to the second aspect of the invention, since the overlapping area of the image in the compound-eye image pickup device is displayed on the display means, it is possible to pick up the image while recognizing the overlapping area of the image easily and surely. it can.

Further, according to the invention of claim 3, since the recording means for recording the image picked up by the image pickup device is provided, the picked up image can be recorded.

According to the invention of claim 4, a warning is issued when an image having no overlapping area is recorded in the recording means, so that an image having no overlapping area is prevented from being recorded. be able to.

Further, according to the invention of claim 5, since the image pickup device is provided with a selecting means for selecting whether or not the image currently picked up is an image related to the image picked up previously, It is possible to selectively perform the overlapping area recognition operation.

According to the sixth aspect of the invention, when the related image is selected by the selecting means, the related information is recorded in the recording means as supplementary information of the image to be recorded. Image processing of an image having a region can be easily performed.

Further, according to the invention of claim 7, since the overlapping area is discriminated by detecting the correlation between the previously picked up image and the currently picked up image, a special detecting means is provided. The overlapping area can be detected without using it.

Further, according to the invention of claim 8, since the overlapping area is discriminated by detecting the imaging condition of the imaging device, the overlapping area can be detected without being influenced by the state of the image. it can.

According to the invention of claim 9, since only the overlapping area is recorded in the recording means, useless information can be omitted.

According to the tenth aspect of the present invention, since the display means is provided with the light emitting means and the overlapping area is displayed by controlling the light emitting state of the light emitting means, the image overlapping can be performed at a low cost. The area can be displayed.

[0036]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram functionally showing the configuration of an image pickup apparatus according to an embodiment of the present invention.

In FIG. 1, the image signal from the image pickup optical system 1 obtained by forming a subject image on the image pickup device 2 is supplied to the display means 3 to display the image currently taken, and The overlapping area between the image that is also supplied to the overlapping area detecting unit 4 and previously captured and stored by the image sensor 2 and the image that is currently captured is detected.
A signal indicating the overlapping area detected by the overlapping area detecting unit 4 is supplied to the display control unit 5, and the overlapping unit is displayed on the displaying unit 3 by controlling the display unit 3 based on the signal indicating the overlapping region. .

Next, a first embodiment of the present invention will be described with reference to the drawings. FIG. 2 is a block diagram of an electronic camera showing the configuration of the image pickup apparatus according to the first embodiment of the present invention.

In FIG. 2, the system control circuit 10 controls the entire image pickup apparatus. The image pickup optical system 11 includes a lens 12 and a diaphragm 13. The lens 12 is driven by the zoom drive circuit 14 when performing the zooming operation, and is driven by the focus drive circuit 15 when performing the focusing operation. The aperture of the diaphragm 13 is adjusted by the iris drive circuit 16 when exposure control is performed. Zoom drive circuit 1
4. The focus drive circuit 15 and the iris drive circuit 16 are controlled by the system control circuit 10.

The light ray that has passed through the image pickup optical system 11 is the image pickup element 2
1, the subject image is formed. Image sensor 21 is C
The CCD driving circuit 30 is driven by the CD driving circuit 30.
Are controlled by the system control circuit 10. Then, the image signal corresponding to the subject image is A / D converter 22.
Is supplied to. The image signal input to the A / D converter 22 is converted into a digital signal and stored in the first image memory 23. The digital image signal stored in the first image memory 23 is converted into a standard television signal by the video signal processing circuit 24 and then supplied to the electronic viewfinder 27 so that the image currently captured can be observed. Then, when the release button 31 is pressed when the desired image is obtained, the image signal stored in the first image memory 23 is recorded in the recording unit 26. The recording unit 26 can be inserted into and removed from the main body of the imaging device, and can be connected to the personal computer through an interface circuit on the personal computer side.

Further, the mode selection switch 32 can select either the normal photographing mode or the grouped photographing mode. The release button 31 and the mode selection switch 32 are connected to the system control circuit 10
It is connected to the. When the normal shooting mode is selected by the mode selection switch 32, each time the release button 31 is pressed, the imaged image is recorded in the recording unit 26.

On the other hand, for example, when a wide-angle image is formed on a personal computer, the mode selection switch 3
The grouping shooting mode is selected by 2. When the grouped shooting mode is selected, the shot images are recorded as related images. That is, the data to be recorded is composed of image data and supplementary information about the image, and the state of the grouping flag in the supplementary information is "Hi".

Then, in the state where the grouped photographing mode is selected, the image photographed immediately before the currently photographed image is stored in the second image memory 28 and then stored in the second image memory 28. Image and the currently captured image,
That is, the correlation detection circuit 25 detects the overlapping area with the image stored in the first image memory 23. The output signal of the correlation detection circuit 25 is the system control circuit 10
Based on the output result of the correlation detection circuit 25,
An overlapping area between the previously captured image and the currently captured image is displayed on the electronic viewfinder 27. As this display method, for example, as shown in FIG. 4A, a frame indicating, on the electronic viewfinder 27, the position of the previously imaged portion in the currently imaged landscape is displayed. There are ways to display it. Note that, as a method of detecting the overlapping region between the image captured previously and the image currently captured by correlation, there is, for example, a matching method.

Next, the photographing operation when the grouped photographing mode is selected by the mode selection switch 32 will be described.

First, in the case of constructing a wide-field landscape with a plurality of images, one image determined by looking through the electronic viewfinder 27 is photographed. Then, when performing the next framing, the electronic viewfinder 27 displays, for example, as shown in FIG.
As shown in (a), the overlapping area is displayed surrounded by a frame. Therefore, by pressing the release button 31 with an angle of view such that the overlapping area is within the screen, a desired overlapping with the previously captured image is obtained. It is possible to take a new image having a region. At this time, if the release button 31 is pressed in a state where the overlapping area does not enter the screen, it is determined that there is no correlation between the previously captured image and the currently captured image, and the warning sound is displayed. It is emitted by the sounding body 29 of. This allows the photographer to recognize that there is no correlation between the previously captured image and the currently captured image. However, when capturing an uncorrelated image as it is, the release button 3
You can shoot by pressing 1 all the way.

After photographing a plurality of images in this way, the recording unit 26 is detached from the main body of the image pickup apparatus and connected to the personal computer. Then, when performing image composition with application software of a personal computer, the grouping flag is determined from the supplementary information of the image, the image is automatically selected and displayed on the personal computer, and the image composition is performed based on the image. To do.

As described above, according to the first embodiment of the present invention, it is possible to know in which part on the screen the overlapping area between the previously captured image and the currently captured image exists. By displaying it on the electronic viewfinder 27, it is possible to prevent a shooting failure. Further, since the function of displaying the overlapping area can be selected by the mode selection switch 32, normal photographing can be performed. Furthermore, when an attempt is made to shoot in a state where there is no overlapping area, the sound generator 29 gives a warning,
It is possible to prevent shooting failures. Furthermore, when it is desired to associate a plurality of captured images as one group, grouping information is added to the recording unit 2 as supplementary information of the images.
By recording in 6, it is possible to easily perform processing on a personal computer.

Next, a second embodiment of the present invention will be described with reference to the drawings. FIG. 3 is a block diagram of an electronic camera showing a configuration of an image pickup apparatus according to the second embodiment of the present invention, which is composed of a compound eye image pickup apparatus.

In FIG. 3, a system control circuit 50 controls the entire image pickup apparatus. Imaging optical system 51,
Reference numeral 61 includes lenses 52 and 62 and diaphragms 53 and 63.
The lenses 52 and 62 are driven by zoom drive circuits 54 and 64 when performing a zooming operation, and are driven by focus drive circuits 55 and 65 when performing a focusing operation. The diaphragms 53 and 63 are used for the iris drive circuit 5 when performing exposure control.
The opening is adjusted by 6, 66. Zoom drive circuit 5
4, 64, focus drive circuits 55, 65, and iris drive circuits 56, 66 are controlled by the system control circuit 50.

The light rays that have passed through the image pickup optical systems 51 and 61 are guided to the image pickup devices 71 and 81 to form a subject image. The image pickup devices 71 and 81 are driven by the CCD drive circuit 91 in a left-right synchronization, and the CCD drive circuit 91 is controlled by the system control circuit 50. Then, the image signals corresponding to the subject image are supplied to the A / D converters 72 and 82, respectively. The image signals input to the A / D converters 72 and 82 are converted into digital signals, and the first image memories 73 and 8
3 is stored. The digital image signals stored in the first image memories 73 and 83 are converted into standard television signals by the video signal processing circuits 74 and 84, and then output to the video output terminals 76 and 86. These video output terminals 76, 8
An output signal from 6 can obtain a stereoscopic video image. A standard television signal is supplied from the video signal processing circuit 74 to the electronic viewfinder 93 so that the video currently captured can be observed.

The second image memories 75 and 85 are connected to the first image memories 73 and 83, respectively,
The first image memories 73 and 83 and the second image memory 75,
Reference numeral 85 is connected to the correlation detection circuit 92 to detect the correlation between the left and right images and the correlation between the images captured before and after in time.

Then, when the desired image is displayed, the release button 95 is pressed, whereby the first image memory 7
The image signals stored in Nos. 3 and 83 are recorded in the recording unit 94. The recording unit 94 can be inserted into and removed from the main body of the imaging device, and can be connected to the personal computer through an interface circuit on the personal computer side. The image recorded in the recording unit 94 is, for example, J
By compressing and recording by the PEG (color still image encoding) system, the memory consumption capacity of the recording unit 94 is reduced.

Further, either the stereoscopic photographing mode or the stereoscopic scanner mode can be selected by the mode selection switch 96, and the release button 95 and the mode selection switch 96 are connected to the system control circuit 50.

Next, the operation of the compound-eye image pickup apparatus of the second embodiment of the present invention will be described.

First, when the stereoscopic photographing mode is selected by the mode selection switch 96, the left and right imaging optical systems 5
The images captured by 1 and 61 are video output terminals 76 and 8
6 is output as a moving image. In addition, the first image memory 7
In order to detect the overlapping area of the left and right images by deriving the correlation between the image signals stored in Nos. 3 and 83 and recognizing the overlapping area with the image picked up by the image pickup optical system 61, FIG.
As shown in (b), the brightness of the non-overlapping areas is reduced and displayed on the electronic viewfinder 93.

In FIG. 4B, when a subject on the table is imaged, both edges of the screen have low brightness, and the ball shown on the left side of FIG. 4B exists in the low brightness portion. Therefore, the photographer can recognize that the ball cannot be expressed three-dimensionally. On the other hand, the photographer can recognize that the plant and the plate can be three-dimensionally expressed, and can easily recognize where the three-dimensionally expressed portion is on the screen. After that, release button 95
Each time is pressed, the images picked up by the left and right image pickup optical systems 51 and 61 are compressed by the JPEG method and are recorded in the recording unit 94.
Recorded in.

Next, the case where the stereoscopic scanner mode is selected by the mode selection switch 96 will be described.

For example, when one object is photographed from a plurality of viewpoints and the three-dimensional shape of the object is obtained based on the images obtained there, the three-dimensional scanner mode is selected. When the stereoscopic scanner mode is selected, the captured image is recorded as a related image. That is, the data to be recorded is composed of image data and supplementary information about the image, and the state of the grouping flag in the supplementary information is "Hi".

Then, in the state where the stereoscopic scanner mode is selected, the image captured immediately before the image currently captured is stored in the second image memories 75 and 85. Then, the images stored in the second image memories 75 and 85 and the image currently captured, that is, the first image memory 7
The correlation detection circuit 92 detects the overlapping area with the images stored in the images 3 and 83 for the respective images captured by the left and right imaging optical systems 51 and 61. The output signal of the correlation detection circuit 92 is the system control circuit 50.
Based on the output result of the correlation detection circuit 92,
An overlapping area between the previously captured image and the currently captured image is displayed on the electronic viewfinder 93.

When the stereoscopic scanner mode is selected and the object is photographed from a certain viewpoint, as shown in FIG. 4C, the image pickup optical system 6 out of the images picked up by the image pickup optical system 51.
Only the overlapping area with the image captured by 1 is displayed on the electronic viewfinder 93, and the non-overlapping area is displayed in black. Then, one image determined by looking through the electronic viewfinder 93 is photographed. Here, only the overlapping area of each image captured by the imaging optical systems 51 and 61 is compressed by the JPEG method and recorded in the recording unit 94. This is because the three-dimensional shape can be obtained only in the overlapping area, and unnecessary information is omitted.

Then, when performing the next framing, as shown in FIG. 4C, the overlapping area between the previously captured image and the currently captured image is overlapped on the electronic viewfinder 93. Is displayed in a frame. That is, in FIG. 4C, a portion other than the overlapping area between the image captured by the image capturing optical system 51 and the image captured by the image capturing optical system 61 is displayed in black, and the image previously captured is displayed. An overlapping area with the currently captured image is displayed in a frame. In this state, by pressing the release button 95 with an angle of view such that the overlapping area falls within the screen, it is possible to shoot a new image having a desired overlapping area with the previously captured image. At this time, if the release button 95 is pressed in a state where the overlapping area does not enter the screen, it is determined that there is no correlation between the previously captured image and the currently captured image, and the warning sound is generated. Pronunciation for 97
Emitted by. This allows the photographer to recognize that there is no correlation between the previously captured image and the currently captured image. However, when capturing an uncorrelated image as it is, the release button 95 should be pressed down. It is possible to shoot at.

In this way, after capturing a plurality of images of the object from various viewpoints and with no omissions, the recording unit 94 is detached from the main body of the image pickup apparatus and connected to the personal computer. And if you want to build a three-dimensional shape with application software of a personal computer,
The grouping flag is discriminated from the incidental information of the image, the image is automatically selected and displayed on the personal computer, the three-dimensional shape is obtained from each of the left and right images, and by combining them, the shape of one object Can be obtained.

As described above, according to the second embodiment of the present invention, it is possible to know in which part on the screen the overlapping area between the previously captured image and the currently captured image exists. By displaying it on the electronic viewfinder 93, it is possible to prevent a shooting failure. Further, when an attempt is made to shoot in a state where there is no overlapping area, the sounding body 97 issues a warning, thereby preventing further failure in shooting. Further, when it is desired to associate a plurality of captured images as one group, by recording the grouping information as the additional information of the image in the recording unit 94, the processing on the personal computer can be easily performed. Furthermore, since only the overlapping area of the left and right imaging areas is displayed on the electronic viewfinder 93, it is possible to recognize at a glance where on the screen the portion capable of stereoscopic expression exists. Further, since only the left and right overlapping areas are recorded in the recording section 94, it is possible to eliminate wasteful consumption of memory.

In the second embodiment of the present invention, an example in which the overlapping area between the image picked up by the image pickup optical system 51 and the image picked up by the image pickup optical system 61 is detected based on the correlation between the images has been described. However, it may be obtained from the imaging conditions of the imaging device, that is, the focal length, the subject distance, the base line length, the vergence angle, and the like. As a result, the image memory can be saved and the cost can be reduced.

Next, a third embodiment of the present invention will be described.

In order to provide the image pickup apparatus of the present invention at low cost, it is conceivable to use an optical finder. However, in the case of the optical type, it is impossible to display a previously captured image on the finder. In addition, TTL (Thr
When using a finder that is not the (ough The Lenz) method,
Since the imaging area and the observation area in the viewfinder are displaced, there is a possibility that shooting may fail while having an overlapping area. Therefore, in the third embodiment of the present invention, a light emitting diode is provided in or near the field of view of the optical viewfinder so that the overlapping area of the images can be easily recognized and imaged at low cost, and the output of the correlation detection circuit is provided. Based on the above, the light emitting diode is made to blink. This makes it possible to provide the imaging device at low cost.

A plurality of light emitting diodes may be provided in the display unit in directions orthogonal to each other so that the light emitting diodes corresponding to the screen in the overlapping area blink. This allows not only the presence or absence of the overlapping area to be displayed. The ratio of the overlapping area and the position of the overlapping area in the display area can also be recognized. Further, the electronic viewfinder may be provided with a light emitting diode, which can reduce the cost of the video signal processing circuit. Further, by forming the visual field frame of the optical finder with liquid crystal, it is possible to display the overlapping region more finely than when the light emitting diode is provided.

Next, a fourth embodiment of the present invention will be described.

In the second embodiment, an example in which a compound eye image pickup device is used to obtain a three-dimensional shape has been described, but in the fourth embodiment, a three-dimensional image pickup device is used to obtain a three-dimensional shape.

As its operation, first, the photographing mode is set to the stereoscopic scanner mode, and the object is photographed from a certain viewpoint.
Then, when the next framing is performed, an overlapping area between the currently captured image and the image captured immediately before the currently captured image is displayed on the electronic viewfinder. Next, press the release button with an angle of view such that the overlapping area fits on the screen. At this time, the image information of only the overlapping area is recorded in the recording unit. Then, when the next framing is performed, an overlapping area between the currently captured image and the image captured immediately before the currently captured image is displayed on the electronic viewfinder. Here, with respect to the image captured immediately before, the image information stored in the first image memory at the time of release is stored in the second image memory as it is,
It is the image stored in the second image memory.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments and various modifications can be made. For example, as a method of displaying the overlapping area of the previously captured image and the currently captured image on the electronic viewfinder 27, in addition to the method of enclosing the overlapping area with a frame, the method of blinking the frame or the overlapping area A method of lowering or increasing the brightness, a method of removing a part of information such as color information of the overlapping area, or a method of changing the brightness of the overlapping area with time may be used. In particular, the method of blinking the frame and the method of temporally changing the brightness of the overlapping area can surely recognize the overlapping area regardless of the state of the subject. Further, a non-overlapping area may be surrounded by a frame, or the brightness may be lowered or raised.

Further, in the above embodiment, an example in which the overlapping area is obtained from the correlation of the images has been described, but the gyro and the acceleration sensor are mounted on the image pickup apparatus to detect the image pickup condition of the image pickup apparatus to obtain the overlap area. You may That is, the rotation angle of the image pickup device may be obtained from the gyro and the movement amount of the image pickup device may be obtained from the acceleration sensor to detect the overlapping region of the image pickup region, and the detected overlapping region may be surrounded by a frame. Furthermore, the overlapping area of the imaging areas may be detected and displayed by placing the imaging device on the pan and detecting the rotation angle of the pan. With such a configuration, it is possible to reliably obtain the overlapping region even from an image that does not change from the image correlation and is difficult to detect, an image that has a repeating pattern, or an image that has distortion. Further, in the case of detecting the overlapping area of the captured images by utilizing the correlation of the images, it is necessary to form a large-scale arithmetic circuit IC in terms of hardware,
The larger the image, the greater the cost burden.
On the other hand, if the sensor such as a gyroscope is used to detect the imaging area, it is easy to store and display not only the immediately preceding image but also the entire area imaged by a series of imaging, which greatly increases the cost. Don't In addition, by determining the overlapping area from both the image correlation detection and the shooting conditions,
The overlapping area can be recognized with high accuracy regardless of the state of the image.

[0073]

According to the first aspect of the present invention, since the overlapping area between the previously captured image and the currently captured image is displayed on the display means, the image is captured before the image is captured. It is possible to easily and surely recognize the overlapping area with the captured image, and to obtain an image with a wide angle of view by an easy operation.

Further, according to the invention of claim 2, since the overlapping area of the image in the compound-eye image pickup device is displayed on the display means, the image can be picked up while recognizing the overlapping area of the image easily and surely. Therefore, a three-dimensional shape can be obtained by an easy operation.

According to the third aspect of the invention, since the recording means for recording the image picked up by the image pickup device is provided, the picked up image can be recorded.

Further, according to the invention of claim 4, a warning is issued when an image having no overlapping area is recorded in the recording means, so that an image having no overlapping area is prevented from being recorded. In addition to the above, it is possible to notify the photographer of the photographing mode when performing the normal photographing while keeping the selection of the related image photographing.

Further, according to the invention of claim 5, since the selection means for selecting whether or not the currently captured image is an image related to a previously captured image is provided. It is possible to selectively perform the overlapping area recognition operation.

Further, according to the invention of claim 6, when the related image is selected by the selecting means, the related information is recorded in the recording means as supplementary information of the image to be recorded. Image processing of an image having a region can be easily performed.

Further, according to the invention of claim 7, since the overlap area is discriminated by detecting the correlation between the previously picked-up image and the presently picked-up image, a special detecting means is provided. The overlapping area can be detected without using it, and the cost can be reduced.

Further, according to the invention of claim 8, since the overlapping area is discriminated by detecting the imaging condition of the imaging device, the overlapping area can be detected without being influenced by the state of the image. Therefore, the detection accuracy of the overlapping area can be improved.

According to the ninth aspect of the invention, since only the overlapping area is recorded in the recording means, wasteful information can be omitted and the memory capacity for recording can be reduced. You can

According to the tenth aspect of the invention, since the display means is provided with the light emitting means and the overlapping area is displayed by controlling the light emitting state of the light emitting means, the cost can be reduced.

[Brief description of drawings]

FIG. 1 is a block diagram functionally showing a configuration of an image pickup apparatus according to an embodiment of the present invention.

FIG. 2 is a block diagram of an electronic camera showing a configuration of an image pickup apparatus according to a first embodiment of the present invention.

FIG. 3 is a block diagram of an electronic camera showing a configuration of an image pickup apparatus according to a second embodiment of the present invention.

FIG. 4 is a diagram showing display contents of a display unit of the image pickup apparatus according to the embodiment of the present invention.

[Explanation of symbols]

 1, 11, 51, 61 Imaging optical system 2, 21, 71, 81 Imaging device 3 Display means 4 Overlapping area detection means 5 Display control means 10, 50 System control circuit 12, 52, 62 Lens 13, 53, 63 Aperture 14 , 54, 64 Zoom drive circuit 15, 55, 65 Focus drive circuit 16, 56, 66 Iris drive circuit 22, 72, 82 A / D converter 23, 28, 73, 75, 83, 85 Image memory 24, 74, 84 video signal processing circuit 25, 92 correlation detection circuit 26, 94 recording unit 27, 93 electronic viewfinder 29, 97 sounding body 30, 91 CCD drive circuit 31, 95 release button 32, 96 mode selection switch

Claims (10)

[Claims] 1. An image pickup optical system for forming a subject image on an image pickup device, display means for displaying an image picked up by the image pickup device, an image previously picked up by the image pickup device, and an image picked up at present. Overlapping area detection means for detecting an overlapping area with an image, and control for displaying an overlapping area between a previously captured image and an image currently captured on the display means based on the output of the overlapping area detection means An image pickup apparatus comprising: a display control unit for performing the above. 2. A plurality of image pickup optical systems, an image pickup device provided corresponding to each of the image pickup optical systems, a display unit for displaying an image picked up by the image pickup device, and the image pickup device before. An overlapping area detecting unit configured to store the captured image and detecting an overlapping area of a plurality of images captured by the image sensor; and an overlapping area of the image based on an output of the overlapping area detecting unit. And a display control means for controlling the display means to display. 3. The image pickup apparatus according to claim 1, further comprising a recording unit that records an image picked up by the image pickup element. 4. The image pickup apparatus according to claim 3, further comprising warning means for issuing a warning when an image having no overlapping area is recorded in the recording means. 5. The image pickup apparatus according to claim 1, further comprising selection means for selecting whether to associate a currently captured image with a previously captured image. . 6. A recording control means for recording related information in the recording means as supplementary information of an image to be recorded when a related image is selected by the selecting means. The imaging device according to. 7. The overlapping area detecting means comprises a correlation detecting means for discriminating the overlapping area by detecting a correlation between a plurality of images. Imaging device. 8. The overlapping area detecting means includes an imaging condition detecting means for determining the overlapping area by detecting an imaging condition of an imaging device.
The imaging device according to any one of 1. 9. The recording control means for recording only the overlapping area in the recording means on the basis of the output of the overlapping area detecting means, according to any one of claims 1 to 8. Imaging device. 10. The display means comprises a light emitting means, and the display control means controls the light emitting state of the light emitting means based on the output of the overlapping area detecting means. The imaging device according to any one of 1.