JP2001268437A - Image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform soft focus photographing in a multi-CCD image processor such as a 2-CCD camera. SOLUTION: The optical axis L of a photographing lens 10 is divided into two by a beam splitter 11 and an optical member 14 such as a lens and a diffusion filter is inserted to one optical path L2 from the beam splitter 11 to a second image pickup element 13. An optical path length from an object 1 to the second image pickup element 13 is changed to the optical path length from the object 1 to a first image pickup element 12 and a blurred image is picked up by the second image pickup element 13. Sharp image by the first image pickup element 12 and the blurred image by the second image pickup element 13 are composited and a soft focus image is obtained.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image processing apparatus such as a digital camera using a solid-state image sensor (hereinafter, referred to as an "image sensor") such as a CCD capable of obtaining a soft focus image.

[0002]

2. Description of the Related Art It has been conventionally proposed to obtain a soft focus image in a digital camera or the like. In a first method, first image data of a subject imaged in an in-focus state by an image sensor is temporarily stored in a memory, and the first image data is processed into blurred second image data in an unfocused state. After the conversion, the in-focus first image data and the out-of-focus second image data are combined, and an image is reproduced using the combined image data. In a second method, first image data of a subject imaged in a focused state by an image sensor and second image data of a subject imaged in an out-of-focus state by continuously moving a lens are synthesized. An image is reproduced by using the obtained image data. In either method, for example, a so-called soft focus image in which a sharp image is superimposed on a blurred image is reproduced on a monitor screen.

On the other hand, in the field of digital cameras, a so-called multi-panel type using two or three image pickup devices in order to obtain a high-definition image is known. In a conventional multi-chip camera, each image sensor is optically equidistant with respect to a subject, and optical members such as a beam splitter are fixed except for zooming and focusing operations of a photographing lens. Similar image data (all in focus or all out of focus) is output from the image sensor.

[0004]

A first method for obtaining the above-mentioned soft focus image is to process image data captured in a focused state by software, and the image processing is complicated. There was a problem that it took time for the arithmetic processing. According to the second method, the image processing method is relatively simple. However, since two image data are obtained at a certain time, the subject moves during the time, and the obtained image becomes unnatural. Had the problem that

Further, the conventional multi-panel camera has a problem that only a sharp image or a blurred image can be obtained as a whole while using a plurality of image pickup devices, which is not functional.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and obtains a soft focus image by simple image processing in an image processing apparatus using a plurality of image sensors (such as a multi-chip CCD camera). It is intended to be.

[0007]

To achieve the above object, an image processing apparatus according to the present invention comprises a first image sensor provided at a focus position with respect to a subject, and a non-focus position with respect to the subject. And an image synthesizing unit for synthesizing two subject image data simultaneously imaged by the first image sensor and the second image sensor.

In the above arrangement, one imaging optical system for forming an image of the subject and an optical path of the imaging optical system are connected to the first optical system.
It is preferable to include an optical path dividing member that divides the optical path into two so as to guide the light to the image sensor and the second image sensor, respectively.

Further, in order to selectively position the second image pickup device with respect to the subject at one of a focused position and a non-focused position, the second image pickup device is provided with the second image sensor among the optical paths divided by the optical path dividing member. It is preferable to include an optical path length varying device that varies the length of the optical path toward the two imaging elements.

Further, it is preferable that the optical path length changing device is a drive mechanism for changing a position of the second image pickup device with respect to the subject.

Alternatively, the optical path length varying device may include the second
It is preferable to include an optical member inserted into an optical path toward the image sensor and a drive mechanism for inserting and extracting the optical member into and from the optical path.

Further, it is preferable that the optical member is a lens or a filter.

Further, it is preferable that the optical member has an ND filter effect.

[0014]

DESCRIPTION OF THE PREFERRED EMBODIMENTS (First Embodiment) A first embodiment of the present invention will be described. FIG. 1 is a diagram illustrating a configuration of a two-panel digital camera that is an example of an image processing apparatus according to the first embodiment. In the figure, a beam splitter 11 such as a half mirror for dividing an optical path of the photographing lens 10 into two is provided on an optical axis L of the photographing lens 10. A first light source such as a CCD is provided on each of the two optical paths L1 and L2 divided by the beam splitter 11.
An image sensor (CCD1) 12 and a second image sensor (CCD1)
2) 13 are provided.

Beam splitter 11 and second image pickup device 13
Between them, an optical member 14 movable in a direction orthogonal to the optical path L2 and an actuator (A1) 15 for driving the optical member 14 are provided. Optical member 1
Numeral 4 is for changing the optical path length of the optical path L2 from the beam splitter 11 to the second image sensor 13 with respect to the optical path length of the optical path L1 from the beam splitter 11 to the first image sensor 12; , A lens or the like can be used.

The first image sensor 12, the second image sensor 13, and the actuator 15 are connected to an arithmetic and control unit 16, respectively. The operation control unit 16 includes an operation unit 17 including a shutter switch and various switches, a storage unit 18 for storing image data such as a memory card, and a display unit 1 such as a liquid crystal display for displaying a monitor image.
9 and the like. As the actuator 15, for example, a plunger using an electromagnet can be used. The arithmetic control unit 16 includes a known CPU, R
OM, RAM, A / D converter, etc.
The function of each part shown in is performed.

In the first embodiment, the first image pickup device 12 and the second image pickup device 13 are arranged at the same distance from the photographing lens 10 and the beam splitter 11, respectively, and the optical member 14 is connected to the optical path L2. By inserting, the first
The optical distance between the image sensor 12 and the second image sensor 13 is changed.

Although not shown, by providing an auto-focus mechanism including a distance measuring mechanism for measuring the distance to the subject 1 and a lens driving mechanism for adjusting the position of the photographing lens 10, the optical member 14 is connected to the optical path. In a state in which the first image sensor 12 and the second image sensor 1 are retracted from L2,
3, sharp images in the in-focus state can be obtained. Further, the optical member 14 is connected to the optical path L2.
, A sharp image in a focused state (in focus) is obtained from the first image sensor 12, and a blurred image in an out of focus state is obtained from the second image sensor 13. . The arithmetic control unit 16 combines the image data obtained by the first image sensor 12 with the image data obtained by the second image sensor, and uses the synthesized image data to display a soft focus image on the display unit 19. Is displayed.

Next, FIG. 2A shows an example of an image reproduced using the image data obtained by the first image sensor 12 when a soft focus image is selected. An image reproduced using the image data obtained by the second image sensor 13 is shown in FIG. Further, FIG. 3C shows an image reproduced using image data obtained by synthesizing the image data obtained by the first image sensor 12 and the image data obtained by the second image sensor 13.

The image shown in FIG. 2A is an image taken in a focused state, and is a sharp image with a clear outline as a whole. On the other hand, the image shown in (b) is an image taken in an out-of-focus state, and the outline is not clear as a whole.
It is a blurred image. The image shown in (c) is a soft focus image which has no sharpness but can recognize the outline of the subject because the overall blurred image is superimposed on the image having a clear outline.

In this embodiment, high-definition photographing and soft-focus photographing can be selected, so that the transmittance and reflectivity of the beam splitter 11 are approximately 50%, respectively, and the first image pickup device 12th and 2nd
The amount of light incident on the image sensor 13 is set to be substantially equal. However, by changing the ratio of the image data by the first image sensor 12 and the ratio of the image data by the second image sensor 13 to the brightness of the soft focus image, the degree of blur of the soft focus image can be changed.

As an example, when combining image data, it is assumed that when the image data from the first image sensor 12 and the image data from the second image sensor are combined at the same ratio, an image with large blur is obtained. In that case, the first image sensor 1
2 to 60% or 70%,
By setting the contribution ratio of the image data by the second image sensor 13 to 40% or 30%, it is possible to improve the sharpness of the soft focus image using the synthesized image data.

As a method of changing the contribution ratio of the image data by the first image pickup device 12 and the contribution ratio of the image data by the second image pickup device 13, the ND (Neutral)
Density) filter characteristics may be provided. In that case,
Since the amount of light incident on the second image sensor 13 is relatively lower than the amount of light incident on the first image sensor 12, in the subsequent signal processing, the image data by the first image sensor 12 and the light amount by the second image sensor 13 What is necessary is just to synthesize with the image data as it is, and the image processing is simplified. However, the contribution rate of the image data by the first imaging element 12 and the contribution rate of the image data by the second imaging element 13 are fixed to a constant value.

Alternatively, by changing the amplification factor of the image data by the first image sensor 12 and the image data by the second image sensor 13 in the image processing, the contribution ratio of the image data by the first image sensor 12 and the second imaging The contribution rate of the image data by the element 13 can be changed. In this case, although the image processing becomes slightly complicated, the contribution ratio can be set to an arbitrary value, and the degree of blurring of the obtained soft focus image can be changed. further,
The optical member 14 may be configured to have ND filter characteristics and change the amplification degree of image data.

Next, FIG. 3 shows a block configuration of each functional unit of the digital camera of the first embodiment. Operation control unit 16
Is a general control unit 20 for controlling the operation of the entire digital camera of this embodiment, and the position of the photographing lens 10 for forming an image of the subject 1 on at least the light receiving surface of the first image sensor 12. Insertion of the optical member 14 into the optical path L2 based on a signal from an AF (auto focus) drive control unit 21 for adjustment and a signal from the operation unit 17 in accordance with the selection of the user, that is, the selection of high-definition shooting or soft focus shooting. And an actuator control unit 22 for controlling evacuation,
An image data reading unit 23 for inputting a predetermined drive signal to the first image sensor 12 and the second image sensor 13 to read analog image data from the first image sensor and analog image data from the second image sensor 13; An A / D converter 24 for converting analog image data read from each of the imaging devices 12 and 13 into digital image data, an image data corrector 25 for performing predetermined image processing on the converted digital image data, and It functions as an image data synthesizing unit 26 that synthesizes each digital image data and an image data output unit that outputs the synthesized digital image data to the storage unit 18 and the display unit 19.

Next, the operation of the first embodiment will be described with reference to FIG.
This will be described with reference to the flowchart shown in FIG. In the drawings, the switch is abbreviated as SW. Also, the overall control unit 20
Is assumed to control the AF drive controller 21 at a fixed interval and adjust the position of the taking lens 10 so that an image of the subject is formed on the first image sensor 13.

First, when the main switch (not shown) of the digital camera is turned on, the overall control unit 20 starts the flow shown in FIG. 4, and the soft focus photographing is selected based on the signal from the operation unit 17. It is determined whether or not it has been performed (step # 1). If soft focus shooting is selected, the overall control unit 20 determines whether or not the optical member 14 is inserted into the optical path L2 based on a position signal or the like from the actuator control unit 22 (step #).
3). Here, if the optical member 14 has not yet been inserted into the optical path L2 (NO in step # 3), the overall control unit 20
Controls the actuator control unit 22 to drive the actuator 15, and inserts the optical member 14 into the optical path L2 (Step # 5).

In step # 3, the optical member 14 is already in the optical path L
2 and the optical member 1 in step # 5.
4 is inserted into the optical path L2, the overall control unit 20 operates the operation unit 1
7 is detected, and it is determined whether or not the shutter switch has been turned on (step # 7).

When the shutter switch is turned on (YES in step # 7), the overall control unit 20 controls the image data reading unit 23 to send a drive signal to the first image sensor 12 and the second image sensor 13, respectively. An input is made (step # 9), and charges charged to each pixel of the first image sensor 12 and the second image sensor 13, that is, image data are read (step # 11).

Further, the overall control unit includes an A / D conversion unit 24.
To convert the analog image data read from the first image sensor 12 and the second image sensor 13 into digital image data (step # 13), and control the image data correction unit 25 to convert the analog image data into digital image data. (Step # 15). As the predetermined image processing, for example, the above-described signal amplification of the image data and the adjustment of the reading start position of each image data when synthesizing the digital image data are performed. Further, the overall control unit controls the image data combining unit 26 to combine the image data from the first image sensor 13 and the image data from the second image sensor 13 (Step # 17). When the image data is combined, the overall control unit 20 controls the image data output unit 17 to output the combined image data to the storage unit 18 and the display unit 19 (Step # 19).

By storing the synthesized image data in the storage unit 18 such as a memory card and displaying it on the display unit 19 such as a liquid crystal display, one soft focus photographing is completed. It is determined whether or not the main switch has been turned off based on the signal at 17 (step # 21). If the main switch has not been turned off, the process returns to step # 1 to prepare for the next photographing. When the main switch is turned off (step # 21)
YES), and the process ends.

On the other hand, when the soft focus photographing is not selected (NO in step # 1), the overall control unit 20
Determines whether or not the optical member 14 is inserted into the optical path L2 based on a position signal or the like from the actuator control unit 22 (step # 23). Here, the optical member 1
4 is inserted into the optical path L2 (YES in step # 23), the overall control unit 20
Is controlled to drive the actuator 15 and the optical member 14
Is retracted from the optical path L2 (step # 25).

At step # 23, the optical member 14 is moved to the optical path L2.
If the optical element 14 has not been inserted into the optical path L2 at step # 25, the overall control unit 20 proceeds to step # 7 and waits for the shutter switch to be turned on. When the optical element 14 retracts from the optical path L2, the second
Since the image pickup device 13 is also in the focused state similarly to the first image pickup device 12, the focused image data is obtained from both the first image pickup device 12 and the second image pickup device 13. By synthesizing these two image data, a high definition image can be obtained.

(Second Embodiment) Next, a second embodiment of the present invention will be described. FIG. 5 is a diagram illustrating a configuration of a two-panel digital camera that is an example of an image processing device according to the second embodiment. Note that members denoted by the same reference numerals as those in the first embodiment shown in FIG. 1 are substantially the same, and a description thereof will be omitted, and different points will be described.

In the first embodiment, the second image sensor 13
Is fixed, and the optical member 14 is inserted into the optical path L2 toward the second image sensor 13 to change the optical path length from the subject to the second image sensor. However, in the second embodiment, the driving mechanism The difference is that the optical path length L2 is changed by moving the second image sensor 13 using (A2) 30.

FIG. 6 shows the structure of the drive mechanism 30. The driving mechanism 30 is screwed with an image sensor holder 31 for moving the image sensor 13 in parallel with the optical path L2 while holding the second image sensor 13, and a female screw portion (not shown) provided on the image sensor holder 31; A screw feed mechanism 32 for moving the image sensor holder 31 in parallel to the optical path L2, a motor 33 for driving the screw feed mechanism 32, and a position of the second image sensor 13 or the image sensor holder 31 in a direction parallel to the optical path L2. And a motor control circuit 35 for controlling the motor 33 using the output of the position sensor 34. The position sensor 34 may be a magnetic sensor using a Hall element, a magnetoresistive element, or the like, or may be an optical sensor using a light emitting element, a light receiving element, and the like.

Next, FIG. 7 shows a block configuration of each functional unit of the digital camera of the second embodiment. In the first embodiment, the actuator control unit 22 for controlling the insertion and retreat of the optical member 14 into and from the optical path L2 is provided. However, in the second embodiment, the drive mechanism 30 is instead controlled to control the second The difference is that a drive mechanism control unit 28 for changing the position of the image sensor 13 is provided.

The motor drive circuit 35 of the drive mechanism 30
Controls the rotation direction and the drive time of the motor 33 using the drive signal from the drive mechanism control unit 28 and the position signal from the position sensor 34. The position sensor 34 is the subject 1
, The position of the second image sensor 13 whose optical path length is equal to that of the first image sensor 12 is set as a reference position, and the amount of displacement from the reference position is detected.

In the second embodiment, by controlling the driving of the motor 33, the second image pickup device 13 can be moved to an arbitrary position. Further, since the degree of blurring of the image is determined by the focal length of the imaging lens 10 and the position of the second imaging element 13, for example, when the imaging lens 10 is a zoom lens and the focal length is short and the depth of field is large, Second
Unless the amount of movement of the imaging element 13 is increased, the image may not be sufficiently blurred. Conversely, if the focal length of the taking lens is long and the depth of field is shallow, it is possible to sufficiently blur the image even if the amount of movement of the second image sensor 13 is reduced. In the second embodiment, the second image sensor 13
The moving amount of the photographing lens 10 can be controlled.
It is possible to obtain an optimal soft focus image according to the focal length of the image.

Next, the operation of the second embodiment will be described with reference to FIG.
This will be described with reference to the flowchart shown in FIG. When the main switch of the digital camera is turned on, the overall control unit 20 starts the flow shown in FIG. 4, and determines whether or not soft focus shooting is selected based on a signal from the operation unit 17 (step #). 101). When soft focus imaging is selected, the overall control unit 20 moves the second image sensor 13 away from the reference position by a predetermined distance in a direction parallel to the optical path L2 based on a position signal or the like from the drive mechanism control unit 28. It is determined whether or not it has moved to the predetermined position (step # 103). Here, if the second image sensor 13 has not yet moved (NO in step # 103),
The overall control unit 20 controls the drive mechanism control unit 28 to drive the drive mechanism 30, and moves the second image sensor 13 to a predetermined position (Step # 105).

In step # 103, the second image pickup device 13
Is moving to the predetermined position and after moving the second image sensor 13 to the predetermined position in step # 105, the overall control unit 20 detects a signal from the operation unit 17 and determines whether the shutter switch is turned on. (Step # 10)
7).

When the shutter switch is turned on (YES in step # 107), the overall control unit 20 controls the image data reading unit 23 to send a drive signal to the first image sensor 12 and the second image sensor 13, respectively. Enter (Step # 10
9) The charge charged to each pixel of the first image sensor 12 and the second image sensor 13, that is, image data is read (step # 111).

Further, the overall control unit includes an A / D conversion unit 24
To convert the analog image data read from the first image sensor 12 and the second image sensor 13 into digital image data (step # 113), and control the image data correction unit 25 to convert the analog image data into digital image data. (# 115). As the predetermined image processing, for example, the above-described signal amplification of the image data and the adjustment of the reading start position of each image data when synthesizing the digital image data are performed. Further, the overall control unit controls the image data combining unit 26 to combine the image data from the first image sensor 13 with the image data from the second image sensor 13 (Step # 117). When the image data is synthesized,
The overall control unit 20 controls the image data output unit 17 to output the synthesized image data to the storage unit 18 and the display unit 19 (Step # 119).

By storing the combined image data in the storage unit 18 such as a memory card and displaying it on the display unit 19 such as a liquid crystal display, one soft focus photographing is completed. It is determined whether or not the main switch has been turned off based on the signal at 17 (step # 121). If the main switch has not been turned off, the process returns to step # 1 to prepare for the next photographing.
When the main switch is turned off (step # 1)
(YES at 21), and the process ends.

On the other hand, when the soft focus photographing is not selected (NO in step # 101), the whole control unit 2
0 determines whether or not the second image sensor 13 has moved to a predetermined position based on a position signal or the like from the drive mechanism control unit 28 (step # 123). Here, when the second imaging element 13 is moving to a predetermined position (Step # 12)
(YES in 3), the overall control unit 20 controls the drive mechanism control unit 28 to drive the drive mechanism 30, and returns the second image sensor 13 to the reference position (step # 125).

If the second image sensor 13 has not moved to the predetermined position in step # 123 and if the second image sensor 13 has returned to the reference position in step # 125, the overall control unit 20 proceeds to step # 107. Wait for the shutter switch to be turned on. When the second image pickup device 13 returns to the reference position, the second image pickup device 13 is also in the focus state similarly to the first image pickup device 12, so that the focus state is obtained from both the first image pickup device 12 and the second image pickup device 13. Is obtained. By synthesizing these two image data, a high definition image can be obtained.

If the photographing lens 10 is a zoom lens, the current focal length of the photographing lens 10 is detected in step # 105, and the amount of movement of the second image sensor 13 according to the focal length is calculated. Second based on the operation result
The imaging device 13 may be configured to move. Alternatively, the degree of soft focus blur may be adjusted according to the user's selection, and the amount of movement of the second image sensor 13 may be calculated in consideration of the degree of blur selected by the user.

(Other Embodiments) In the above embodiment, the optical path of one photographing lens 10 is divided into two by the beam splitter 11, but the invention is not limited to this. An imaging optical system having the same configuration for each of the imaging elements 12 and 13 may be used.

In the above embodiment, the high-definition photographing and the soft-focus photographing can be selected, so that the second image pickup device 13 is positioned so as to be out of focus with respect to the subject 1. Although the optical member 14 is inserted or the position of the second image sensor 13 is changed, the present invention is not limited to this.
On the other hand, the second image sensor 13 may be fixed at a position where the optical path length is different from that of the first image sensor 12, and a digital camera dedicated to soft focus shooting may be used. Alternatively, when a sharp image is obtained, only the first image sensor 12 may be used.

Further, in the above-described embodiment, a multi-panel digital camera has been described. However, the present invention is not limited to this and can be applied to a multi-panel video camera. In this case, sharp image data in a constantly focused state is obtained from one of the two image pickup devices, and blurred image data in a constantly out of focus state is obtained from the other image pickup device. The focus image data is recorded on the tape, and the soft focus image is reproduced on the monitor screen.

[0051]

As described above, according to the image processing apparatus of the present invention, the first image sensor provided at the in-focus position with respect to the subject and the non-focus position with respect to the subject are provided. A second image sensor, and an image synthesizing unit for synthesizing two subject image data simultaneously imaged by the first image sensor and the second image sensor. And the image data in the out-of-focus state by the second image sensor are synthesized as is, and the image is reproduced on a monitor screen or the like using the synthesized image data. The superimposed so-called soft focus image is reproduced. As a result, there is no need to perform complicated software-based image processing as in the first method of the conventional example, which simplifies the image processing and increases the calculation processing speed. Further, since two image data are simultaneously captured by the first image sensor and the second image sensor, the image of the subject does not become unnatural as in the second method of the related art.

Also, there is provided one imaging optical system for forming an image of the subject, and an optical path dividing member for dividing an optical path of the imaging optical system into two so as to be guided to the first imaging element and the second imaging element, respectively. By doing so, an image obtained by the common image pickup optical system can be obtained from each of the first image pickup device and the second image pickup device, so that a soft focus image free from the influence of parallax can be obtained.

Further, in order to selectively position the second image pickup device with respect to the subject at any one of a focus position and a non-focus position, the second image pickup device is provided with the second image sensor among the optical paths divided by the optical path division member. By providing an optical path length varying device that varies the length of the optical path toward the second image sensor, it is possible to select between high-definition imaging and soft-focus imaging according to the position of the second image sensor.

Further, it is necessary to insert an optical member such as a filter or a lens into the optical path of the image pickup optical system by using a drive mechanism for changing the position of the second image pickup element with respect to the object as the optical path length variable device. Since there is no optical path, the optical path length of the imaging optical system can be made short and compact.

Alternatively, the variable optical path length device is configured to include an optical member inserted into an optical path toward the second image pickup device and a drive mechanism for inserting and extracting the optical member into and from the optical path. Thus, although it is necessary to increase the optical path length of the imaging optical system, it is not necessary to move the imaging device, and it is possible to improve the reliability of the electrical wiring.

Further, by using a lens or a filter as the optical member, a large optical path difference can be obtained with a relatively small member. In particular, even when the focal length of the imaging optical system is short and the depth of focus is deep, a large blur amount can be obtained.

Further, by giving the ND filter effect to the optical member, it is possible to combine the sharply focused image data by the first image sensor with the blurred out-of-focus image data by the second image sensor. In addition, it is possible to reduce the contribution ratio of the image data in the out-of-focus state which is blurred with respect to the brightness of the image.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration of a two-panel digital camera that is an example of an image processing apparatus according to a first embodiment of the present invention.

FIGS. 2A and 2B are diagrams illustrating a procedure of forming a soft focus image by the image processing apparatus of the present invention, wherein FIG. 2A illustrates an example of an image obtained by a first image sensor, and FIG. An example of an image is shown, and (c) shows an example of an image based on image data obtained by combining image data obtained by a first image sensor and image data obtained by a second image sensor.

FIG. 3 is a diagram illustrating a block configuration of each functional unit of the digital camera according to the first embodiment.

FIG. 4 is a flowchart illustrating an operation of the digital camera according to the first embodiment.

FIG. 5 is a diagram illustrating a configuration of a two-panel digital camera that is an example of an image processing apparatus according to a second embodiment of the present invention.

FIG. 6 is a diagram illustrating a configuration of a drive mechanism according to a second embodiment.

FIG. 7 is a diagram illustrating a block configuration of each functional unit of a digital camera according to a second embodiment.

FIG. 8 is a flowchart illustrating an operation of the digital camera according to the second embodiment.

[Explanation of symbols]

 1: Object 10: Photographing lens 11: Beam splitter 12: First image sensor 13: Second image sensor 14: Optical member 15: Actuator 16: Operation control unit 17: Operation unit 18: Storage unit 19: Display unit 20: Overall Control unit 21: AF drive control unit 22: Actuator control unit 23: Image data read unit 24: A / D conversion unit 25: Image data correction unit 26: Image data synthesis unit 27: Image data output unit 28: Drive mechanism control unit 30: drive mechanism

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/91 H04N 5/91 J F term (Reference) 2H054 AA01 BB02 BB07 BB11 5C022 AA01 AA11 AA13 AB22 AB46 AB68 AC01 AC42 AC54 AC55 5C023 AA07 AA11 AA31 AA37 BA12 CA03 DA04 EA03 5C052 AA17 AB02 DD02 DD04 EE06 EE08 GA01 GA03 GD03 GE08 5C053 FA07 FA27 GA20 KA04 KA25 LA02 LA06

Claims (7)

[Claims] A first imaging device provided at a focus position with respect to the subject; a second imaging device provided at a non-focus position with respect to the subject; and the first imaging device and the second imaging device. An image processing apparatus comprising: an image synthesizing unit that synthesizes two subject image data captured simultaneously by an element. 2. An imaging optical system for forming an image of the subject, and an optical path of the imaging optical system is connected to the first imaging device and the second imaging device.
The image processing apparatus according to claim 1, further comprising an optical path dividing member that divides the optical path into two so as to guide the light to the image sensor. 3. An optical path split by the optical path splitting member to selectively position the second image sensor with respect to the subject at one of a focus position and a non-focus position. 3. The image processing apparatus according to claim 2, further comprising an optical path length changing device that changes an optical path length toward the two image pickup devices. 4. The image processing apparatus according to claim 3, wherein the variable optical path length device is a drive mechanism that changes a position of a second image sensor with respect to the subject. 5. The optical path length varying device according to claim 1, further comprising: an optical member inserted into an optical path toward the second image sensor, and a drive mechanism for inserting and extracting the optical member into and from the optical path. The image processing apparatus according to claim 3, wherein: 6. The image processing apparatus according to claim 5, wherein the optical member is a lens or a filter. 7. The image processing apparatus according to claim 5, wherein the optical member has an ND filter effect.