JP2005341134A - Image processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To follow an object on a monitor at all times, even during still image photographing. <P>SOLUTION: The image processing apparatus 1 is provided with imaging elements A3, B4 for converting light from an object into a video signal; an imaging apparatus 2 for mutually, independently driving the imaging elements A3, A4; and a central arithmetic unit 15 for controlling the imaging apparatus 2 so as to apply still driving to one of the imaging elements A3, B4 and apply monitor drive to the other. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing apparatus including a plurality of imaging elements such as CCD (Charge Coupled Devices) and CMOS (Complementary Metal Oxide Semiconductor).

  2. Description of the Related Art Conventionally, as an image processing apparatus using a plurality of imaging elements, a technique has been disclosed that obtains a soft focus effect by synthesizing images obtained by shifting the focus of two imaging elements and combining the captured images (for example, , See Patent Document 1).

Japanese Patent Application No. 2000-81545

  However, in a conventional image processing device using an image sensor, it takes time from when the shutter is pressed until data is output from the image capturing device during still image shooting (still image shooting). Since nothing is displayed "or" final monitor image "is displayed, the user cannot follow the subject on the monitor.

  In addition, since the image sensor can only capture the next image after the exposure is completed and the video signal is output, the shooting interval is governed by the exposure time of the image sensor and the video signal output time when performing continuous shooting. There was a situation that.

  The present invention has been made in view of the above-described conventional circumstances, and an object of the present invention is to provide an image processing apparatus that can always follow a subject on a monitor even during still image shooting.

  The image processing apparatus of the present invention includes first and second imaging elements that convert light from a subject into video signals, imaging means that drives the first and second imaging elements independently of each other, and a normal mode. And control means for controlling the image pickup means so that one of the first and second image pickup devices is still driven and the other is monitor driven. According to the above configuration, in the normal mode, by providing the control unit that controls the imaging unit so that one of the first and second imaging elements is still driven and the other is monitor-driven, one of the imaging elements is monitored. Since it can be used exclusively for shooting, it is possible to always follow the subject on the monitor even during still image shooting.

  The image processing apparatus of the present invention further includes an image processing unit that converts video signals from the first and second imaging elements into image data. According to the above configuration, by converting the video signals from the first and second imaging elements into image data, the subject can always be followed on the monitor even during still image shooting.

  In the image processing apparatus of the present invention, the first image sensor and the second image sensor have different numbers of pixels. According to the above configuration, by reducing the number of pixels of one image sensor, the cost of the image sensor and power consumption during monitor photographing can be suppressed.

  In the image processing apparatus of the present invention, the first and second imaging elements have substantially the same number of pixels, and the control unit alternately turns the first and second imaging elements in the continuous shooting mode. To drive. According to the above configuration, the control unit can perform continuous shooting at high speed by alternately driving the first and second image sensors in the continuous shooting mode. In addition, according to the above configuration, the image data obtained by photographing has the same size, the drive time is shifted, the plurality of image sensors are driven, and the image signals obtained by each are sequentially captured from the ones that have been exposed. By converting to data, continuous shooting can be performed at a higher speed than continuous still images obtained by driving one image sensor.

  In the image processing apparatus of the present invention, the control unit drives the first and second image sensors simultaneously, and the exposure time of each image sensor is variable. According to the above configuration, the control unit drives the first and second image sensors simultaneously, and the exposure time of each image sensor is variable, so that a plurality of images with different brightness can be obtained simultaneously.

  In the image processing apparatus of the present invention, the imaging device includes first and second imaging devices that drive the first and second imaging elements, respectively. According to the above configuration, it is possible to suppress power consumption by not using an imaging device corresponding to an unnecessary imaging element. In addition, it becomes easy to deal with image sensors of different types and sizes, image sensors that require different drive signals, and the like.

  The image processing apparatus of the present invention includes first and second imaging optical systems having focal lengths corresponding to the first and second imaging elements, respectively. According to the above configuration, by providing the first and second imaging optical systems having focal lengths corresponding to the first and second imaging elements, a plurality of image data having the same or different focal lengths can be obtained. Can do. Also, one can be equipped with a single focus lens, and the other can be equipped with a zoom lens. When focusing on the shooting response from when the release button is pressed until the actual exposure, the focus is preliminarily applied to everything from a short distance to a far distance. You can use a pan focus single focus lens and use a zoom lens if you want to zoom without focusing on shooting response.

  In the image processing apparatus of the present invention, the first and second imaging optical systems are arranged so that light from different subjects is imaged on the first and second imaging elements, respectively. According to the above configuration, the first and second imaging optical systems are arranged so as to form images of light from different subjects on the first and second imaging elements, respectively. The photographing operation can be performed at the same time. For example, by setting the other one 180 degrees opposite to the other, it is possible to use the front and rear images simultaneously. In this way, by installing a plurality of imaging optical systems and imaging elements so as to compensate for areas where they cannot be captured, it is possible to simultaneously capture 360-degree images.

  The image processing apparatus according to the present invention includes an imaging optical system that forms an image of light from a subject on the first and second imaging elements, and an optical path of the imaging optical system to the first and second imaging elements. And an optical path dividing member that divides so as to guide each of them. According to the above configuration, by providing the optical path dividing member that divides the optical path of the imaging optical system so as to guide the optical path to the first and second imaging elements, respectively, an image is formed on a large number of imaging elements with a small number of imaging optical systems. The imaging optical system can be made compact.

  The image processing apparatus of the present invention includes an optical path length variable device that varies a length of an optical path toward at least one of the first and second imaging elements among the optical paths divided by the optical path dividing member. According to the above configuration, by providing the optical path length variable device that changes the length of the optical path toward at least one of the optical paths divided by the optical path splitting member, image data having different angles of view can be obtained. Can do.

  In the image processing apparatus of the present invention, the optical path length variable device is a drive mechanism that changes the position of at least one of the first and second imaging elements. According to the above configuration, the optical path length variable device is a drive mechanism that changes the position of at least one of the first and second imaging elements, so that the gain of light by the optical path length variable device is not impaired. Image data with different angles of view can be obtained.

  In the image processing apparatus of the present invention, the optical path length varying device includes an optical member that is inserted into an optical path toward at least one of the first and second imaging elements, and the optical member is inserted into and removed from the optical path. A drive mechanism for According to the above configuration, by including the drive mechanism for inserting and withdrawing the optical member with respect to the optical path, the optical member can be inserted to obtain image data having different angles of view, and the optical member can be extracted. Image data having the same optical path length can be obtained.

  Further, the image processing apparatus of the present invention copes with the deviation of the optical path length based on the contour information acquisition device that extracts the contour information of the subject based on the video signal output from the imaging device, and the contour information. And a focusing control device for controlling the imaging optical system. According to the above configuration, the in-focus state due to the optical path length deviation and the imaging optical system can be moved by providing the focusing control device that controls the imaging optical system in response to the optical path length deviation based on the contour information. Therefore, focusing with two or more image sensors having different optical path lengths for one image sensor means that two or more imaging optical elements are used. This is the same as calculating the in-focus state from the movable amount of the system, so that the movable range of the imaging optical system can be reduced, and the time required for focusing can be shortened.

  The image processing apparatus of the present invention includes first and second contour information acquisition apparatuses corresponding to the first and second imaging apparatuses, respectively. According to the above configuration, by providing the first and second contour information acquisition devices corresponding to the first and second imaging devices, respectively, it is possible to control only the focusing control device corresponding to the necessary imaging device. This can reduce power consumption. Also, since the first and second contour information acquisition devices can simultaneously extract the contour information from the video signals output from the first and second imaging devices, the images of the first and second imaging devices. Signal output control can be performed simultaneously.

  In the image processing apparatus according to the aspect of the invention, the control unit may be arranged on one of the first and second imaging elements closest to the in-focus state based on the contour information obtained from the contour information acquisition device. The corresponding imaging optical system is controlled. According to the above configuration, the imaging unit corresponding to one of the first and second imaging elements closest to the in-focus state based on the contour information obtained from the contour information acquisition device. By controlling the system, the movable range of the imaging optical system can be further reduced, and the time required for focusing can be further shortened.

  The image processing apparatus according to the present invention further includes a designation device that designates the number of the imaging elements to be focused. According to the above configuration, it is possible to drive only the necessary imaging optical system and imaging element by designating the number of imaging elements to be focused, so that power consumption can be suppressed.

  The image processing apparatus of the present invention further includes a display device that displays the image data converted by the image processing unit. According to the above configuration, the actually captured video can be confirmed by including the display device that displays the image data converted by the image processing unit.

  In the image processing apparatus of the present invention, the image processing unit switches image data obtained by converting the video signals of the first and second imaging elements and outputs the image data to the display device. According to the above configuration, the image processing unit switches the image data obtained by converting the video signals of the first and second imaging elements and outputs the image data to the display device, thereby changing the imaging update period such as 30 fps or 15 fps. Can be easily changed. For example, by driving the first image sensor at 30 fps and driving it at the second image sensor 15 fps, even if the shooting update cycle is changed from 30 fps to 15 fps by the user, the video signal output is changed to the shooting update cycle. The shooting update cycle can be easily changed by simply switching from the first image sensor driven at 30 fps to the second image sensor driven at the shooting update cycle 15 fps.

  According to the present invention, in the normal mode, by providing the control means for controlling the image pickup means so that one of the first and second image pickup elements is still driven and the other is monitor driven, one image pickup element is monitored. Since it can be used exclusively for shooting, it is possible to always follow the subject on the monitor even during still image shooting.

(First embodiment)
FIG. 1 is a block diagram showing a schematic configuration of an image processing apparatus for explaining a first embodiment of the present invention. As shown in FIG. 1, the image processing apparatus 1 includes an imaging device A3 and an imaging device B4 that convert light from a subject into a video signal, an imaging device 2 that drives the imaging devices A3 and B4 independently of each other, In the mode, a central processing unit 15 is provided that controls the image pickup apparatus 2 so that one of the image pickup elements A3 and B4 is driven still and the other is driven by monitor. 1 includes an image sensor drive signal generator A20 for driving the image sensor A3 and an image sensor drive signal generator B21 for driving the image sensor B4.

  Since the image processing apparatus 1 can drive the image pickup element A3 and the image pickup element B4 independently by the image pickup apparatus 2, the high-speed continuous shooting can be performed by shifting the drive start times of the image pickup element A3 and the image pickup element B4. It can be performed.

  FIG. 2 is a timing chart in the case where the image processing apparatus 1 performs high-speed continuous shooting. As shown in FIG. 2, the imaging device 2 performs exposure control of the image sensor A3 (t1 to t2), and performs video signal output control A of the image sensor A3 after the exposure of the image sensor A3 is completed (t2 to t4). . Further, the exposure control of the image sensor B4 is performed after the exposure start of the image sensor A3 (t2 to t3), and the video signal output control B of the image sensor B4 is performed after the exposure of the image sensor B4 is completed (t4 to t5). . Thereby, it is possible to perform high-speed continuous shooting with little difference in shooting time.

  In FIG. 2, the exposure A of the image sensor A3 represents a period during which light from the subject is exposed, and the video signal output A represents a period during which the video signal A obtained by the exposure A is output to the imaging device 2. . The exposure control A of the imaging device 2 represents a period for controlling the exposure of the imaging element A3, and the video signal output control A represents a period for controlling the video signal output of the imaging element A3. The same applies to the image sensor B4.

  As described above, the continuous shooting can be performed by shifting the processing timing of the video signal output control A and the video signal output control B. However, if the processing capability of the imaging device 2 is high, the video signal output control A and the video signal output control are performed. You may drive to process B simultaneously.

  FIG. 3 is a timing chart when the video signal output control A and the video signal output control B are simultaneously processed by the image processing apparatus 1. As illustrated in FIG. 3, the imaging device 2 processes the video signal output control A (t2 to t4) and the video signal output control B (t3 to t5) in an overlapping manner. In this way, the processing in the imaging device 2 can be shortened. 2 and 3 show a state in which the image pickup device A3 and the image pickup device B4 are picked up one by one. However, the present invention is not limited to this, and a continuous photographing operation may be performed.

  FIG. 4 is a timing chart when the image processing apparatus 1 causes the image sensor A3 and the image sensor B4 to continuously perform photographing operations. As shown in FIG. 4, the image sensor A3 performs exposure A and video signal output A twice in succession (t1 to t4, t4 to t7), and the image sensor B4 outputs exposure B and video signal output B to 2 By continuously performing (t2 to t5, t5 to t8), continuous shooting can be processed at high speed.

  FIG. 5 is a timing chart when the image processing apparatus 1 simultaneously drives the image sensor A3 and the image sensor B4 to change the exposure time of each image sensor. As shown in FIG. 5, the exposure A of the image sensor A3 is a period (t1 to t2), and the exposure B of the image sensor B4 is a period (t1 to t3). Thereby, the image data A and the image data B having different brightnesses can be obtained from the video signal A and the video signal B having different exposure times.

  FIG. 6A is a block diagram showing a schematic configuration of the image processing apparatus 1 in which the image processing unit 5 is added to the image processing apparatus 1 shown in FIG. As shown in FIG. 6A, the image processing apparatus 1 can independently drive the image sensor A3 and the image sensor B4 that convert light from the subject into a video signal, and the image sensor A3 and the image sensor B4. Image processing that includes an image pickup device 2 capable of converting a video signal A picked up by the image pickup device A3 and a video signal B picked up by the image pickup device B4 from the image pickup device 2 into image data simultaneously or sequentially. Part 5.

  FIG. 6B is a timing chart in the case of performing still (still image) shooting with the image sensor B4 during monitor shooting with the image sensor A3 in the image processing apparatus 1 shown in FIG. 6A. As shown in FIG. 6B, the image pickup device 2 uses the image pickup device A3 for a part of all effective pixels of the image pickup device or mixes the pixels, and performs exposure and video signal output at the same timing. Drive by monitor drive system. At the same time, the image sensor B4 is driven by a still drive system that uses some or all of the effective pixels of the image sensor and performs exposure B and video signal output B at exclusive timing. Then, during monitor shooting with the image sensor A3, still image shooting is separately driven with the image sensor B4.

  In FIG. 6B, the monitor A of the image pickup device A3 represents exposure and video signal output, and the monitor control A of the image pickup apparatus 2 represents exposure control and video signal output control of the image pickup device A3. As a result, it can be seen that the monitor imaging of the image sensor A3 can be performed without interruption even during the still imaging of the image sensor B4.

  FIG. 7 is a block diagram illustrating a schematic configuration of the image processing apparatus 1 including the imaging devices A6 and B7 corresponding to the imaging elements 3 and 4, respectively. As illustrated in FIG. 7, the image processing apparatus 1 includes an imaging device A6 corresponding to the imaging device 3 and an imaging device B7 corresponding to the imaging device 4. By providing the imaging devices A6 and B7 corresponding to each of the imaging devices A3 and B4, if there is an unused imaging device, the corresponding imaging device is also not used, thereby reducing power consumption. Can be suppressed. In addition, it becomes easy to deal with image sensors of different sizes and different image sensors such as CCD or CMOS.

  In the above description, when the number of pixels of the image sensor A3 and the image sensor B4 is the same, the sizes of image data obtained by photographing are equal. Further, as shown in FIG. 2 to FIG. 4, the image pickup device A3 and the image pickup device B4 are driven by shifting the drive time, and the video signals obtained by each are taken in order from the completed exposure and converted into image data. Continuous shooting can be performed at a higher speed than continuous still images obtained by driving one image sensor.

  FIG. 8 is a block diagram showing a schematic configuration of the image processing apparatus 1 when the image sensor A3 is a low pixel and the image sensor B4 is a high pixel. Here, in the image processing apparatus 1, a low pixel of about 300,000 pixels is used for the image sensor A 3, and a high pixel of about 8 million pixels is used for the image sensor B 4.

  FIG. 9 is a timing chart showing driving of each image sensor shown in FIG. 8 during monitor photographing. Since the number of horizontal pixels of the image sensor A3 is about 1/5 of that of the image sensor B4, the time required for the video signal output A of the image sensor A3 with a small number of pixels (t1) even when the same monitor photographing is performed. It can be seen that .about.t2) is less than the time (t1 to t3) required for the video signal output B of the image sensor B4 having a large number of pixels. Since the time required for the video signal output A is small, the time for driving the image sensor A3 is reduced, and the power consumption can be reduced as compared with the monitor photographing by the image sensor B4. Further, by using a low-pixel one for monitor photographing, the cost of the image sensor can be expected to be reduced.

  FIG. 10 is a block diagram illustrating a schematic configuration of the image processing apparatus 1 including imaging optical systems A8 and B9 corresponding to the imaging elements A3 and B4, respectively. As shown in FIG. 10, the image processing apparatus 1 includes an imaging optical system A8 corresponding to the imaging element A3, and includes an imaging optical system B9 corresponding to the imaging element B4. In FIG. 10, the optical path length from the subject 100 to the imaging optical system A8 is the optical path length L1, the optical path length from the imaging optical system A8 to the imaging device A3 is the optical path length L11, and the optical path length from the subject 100 to the imaging optical system B9 is the optical path. The optical path length from the length L2 and the imaging optical system B9 to the imaging element B4 is represented as an optical path length L21.

  When the subject 100, the optical path length L1 and the optical path length L2, the imaging optical system A8 and the imaging optical system B9, and the optical path length L11 and the optical path length L21 are all the same, the image is captured by the imaging element A3 and the imaging element B4. The images will be the same. If the drive timings of the image sensor A3 and the image sensor B4 are shifted under these conditions, high-speed continuous shooting can be performed on the same image.

  On the other hand, when the imaging optical system A8 and the imaging optical system B9 are different, and the optical path length L11 and the optical path length L21 are different accordingly, the focal length is different even for the same subject. Becomes a wide-angle video.

  As described above, the same image can be captured continuously by using the same focal length of the imaging optical system, and wide-angle image data and telephoto image data can be obtained by providing the imaging optical systems with different focal lengths. Can be obtained.

  Further, regarding the imaging optical system, different imaging optical systems can be provided such that one is equipped with a single focal lens (single focal length lens) and the other is equipped with a zoom lens (variable focal length lens). When emphasizing the shooting response from when the release button is pressed until the actual exposure is performed, use a Pan Focus single focus lens that is focused on everything from a close distance to a far distance in advance. If you want to zoom without focusing on the zoom, you can use various methods such as using a zoom lens.

  FIG. 11 is a block diagram showing a schematic configuration of the image processing apparatus 1 in which the imaging optical systems A8 and B9 are arranged so as to image light from different subjects 100 and 101, respectively. As shown in FIG. 11, by setting the imaging optical system B9 180 degrees opposite to the imaging optical system A8, a subject that is not captured by the imaging optical system A8 can be captured by the imaging optical system B9. A subject that is not captured by the system B9 can be photographed by the imaging optical system A8. Furthermore, by installing a plurality of image pickup optical systems and image pickup elements so as to cover areas where they cannot be copied, 360-degree images can be simultaneously shot.

  FIG. 12 is a block diagram illustrating a schematic configuration of the image processing apparatus 1 including the optical path dividing member 11 that divides the light output from the imaging optical system 10. An image formed by the imaging optical system 10 is divided by the optical path dividing member 11, and among the divided optical paths, the optical path length to the imaging element A3 is set as an optical path length L111, and the optical path length to the imaging element B4 is set as an optical path length L112. When the optical path length L111 and the optical path length L112 are the same, the image of the same subject 100 can be captured by the imaging element A3 and the imaging element B4 with one imaging optical system 10.

  On the other hand, when the optical path length L111 and the optical path length L112 are different, the in-focus image and the out-of-focus image of the same subject 100 can be imaged on the image sensor A3 and the image sensor B4 with one imaging optical system 10. Thereby, it is possible to form an image on two imaging elements with one imaging optical system, and when photographing the same subject, it is possible to make it more compact than having each imaging optical system.

  FIG. 13 is a block diagram illustrating a schematic configuration of the image processing apparatus 1 including the optical path length variable device 12 on one of the optical paths divided by the optical path dividing member 11. Here, the optical path length from the optical path splitting member 11 to the optical path length variable device 12 is defined as an optical path length L112, and the optical path length from the optical path length variable device 12 to the image sensor B4 is defined as an optical path length L112V. If the sum of the optical path length L112 and the optical path length L112V is equal to the optical path length L111, the image of the same subject 100 can be captured by the image sensor A3 and the image sensor B4. Further, if the optical path length L112V is changed by the optical path length varying device 12 so that the sum of the optical path length L112 and the optical path length L112V is different from the optical path length L111, the same subject 100 having different angles of view in the image sensor A3 and the image sensor B4. Can be captured.

  Here, the optical path length varying device 12 may be a drive mechanism that changes the position of the image sensor B4. In this case, image data having different angles of view can be obtained without impairing the light gain of the optical path length varying device 12.

  The optical path length variable device 12 may include an optical member that is inserted into the optical path toward the image sensor B4 and a drive mechanism that inserts and removes the optical member with respect to the optical path. In this case, when it is desired to obtain image data having a different angle of view, an optical member is inserted, and when it is desired to obtain image data equal to the optical path length L111, the optical member is extracted.

  FIG. 14 is a block diagram illustrating a schematic configuration of the image processing apparatus 1 including the display device 13, and illustrates a case where image data created by the image processing unit 5 is displayed by the display device 13. With this display device 13, it is possible to confirm all or part of the image data obtained by converting the video signals captured by the image sensor A3 and the image sensor B4. Here, the image processing unit 5 may switch and output the image data obtained by converting the video signals captured by the image sensor A3 and the image sensor B4 to the display device 13.

  FIG. 15 is a timing chart when the image sensor A3 is driven at 30 fps and the image sensor B4 is driven at 15 fps in the image processing apparatus 1 of the present embodiment. As shown in FIG. 15, when the image sensor A3 is driven at 30 fps and the image sensor B4 is driven at 15 fps, the image processing unit 5 obtains the image data A obtained by the image sensor A3 when the imaging update period is required to be 30 fps. What is necessary is just to output to the display apparatus 13.

  FIG. 16 shows a timing chart when image data B obtained by the image sensor B4 is output to the display device 13. As shown in FIG. 16, when the imaging update period needs 15 fps, the image processing unit 5 may output the image data B obtained by the imaging element B4 to the display device 13. In this way, the imaging update cycle can be easily changed.

(Second Embodiment)
FIG. 17 is a block diagram showing a schematic configuration of an image processing apparatus for explaining a second embodiment of the present invention. The image processing apparatus 1 shown in FIG. 17 uses the video signal output from the imaging apparatus 2 and extracts the contour information of the subject 100 by the contrast detection method, and the contour information obtained by the contour extraction apparatus 14. And a central processing unit 15 that controls the imaging optical system 10 and performs control for imaging (focusing) of the subject 100. The image pickup apparatus 2 drives the image pickup element A3 and the image pickup element B4 at the same time, and the central processing unit 15 determines the control amount of the image pickup optical system 10 for image formation from the deviation between the optical path length L111 and the optical path length L112. Then, both the image sensor A4 and the image sensor B4, or one of the image sensors is imaged.

  FIG. 18 is a diagram for explaining the influence of the optical path length shift on the focusing of the image sensors A3 and B4. The point A in FIG. 18 indicates the in-focus state of the image sensor A3, the point B indicates the in-focus state of the image sensor B4, and the width G indicates the difference in the in-focus state between the image sensor A3 and the image sensor B4 due to the deviation of the optical path length. In general, when an object is imaged with a lens, an imaging position exists as indicated by point P in FIG. Then, when the lens is shifted from the image forming position, it is out of focus as shown by the curve in FIG. The control amount of the imaging optical system in the figure indicates the movable amount of the “lens for focusing” that can be driven in the imaging optical system, and the focus is shifted by the lens that changes the focal length of the imaging optical system. In addition, focusing can be achieved by moving a lens for focusing.

  In FIG. 18, it can be seen that the image sensor B4 is closer to the in-focus state from the in-focus state of the image sensor A3 and the image sensor B4. Thereby, the central processing unit 15 controls the movable amount of the image pickup optical system 10 in a larger direction, and determines that the point P has been passed when the in-focus state of the image pickup element B4 is lowered. Thereafter, the central processing unit 15 controls the movable amount of the imaging optical system 10 in a smaller direction, and performs control until the in-focus state of the image sensor B4 is higher. As a result, the movable amount of the imaging optical system can be reduced as compared with the case where there is only one imaging element, and focusing can be performed at high speed.

  In addition, although two image sensors are described here, focusing can be performed on an image sensor close to the point P by further increasing the number of image sensors, and the movable amount of the image pickup optical system can be reduced. Focusing can be performed.

  FIG. 19 is a block diagram illustrating a schematic configuration of an image processing apparatus 1 including a plurality of contour extraction devices. As illustrated in FIG. 19, the image processing device 1 uses the video signal output from the imaging device A6 to extract the contour information using the video signal output from the imaging device A6 and the video signal output from the imaging device B7. A contour extracting device B17 that extracts information, and controls the imaging optical system A8 from the contour information obtained by the contour extracting device A16 to perform imaging (focusing) of the subject 100, and obtain contour information obtained by the contour extracting device B17. A central processing unit 15 that controls the imaging optical system B9 to form an image of the subject 100 (focusing).

  The image processing device 1 shown in FIG. 19 includes devices related to the image sensor A3 (imaging optical system A8, image sensor A3, image capture device A6, contour extraction device A16), and devices related to the image sensor B4 (imaging optical system B9, image sensor B4). , The image pickup device B7 and the contour extraction device B17) can be operated independently. Therefore, when only one image pickup device is driven, only the device related to the image pickup device A3 is driven, and only when necessary, the device related to the image pickup device B4. Can also be driven. As a result, power consumption when only one image sensor is driven can be suppressed. Further, since the contour extraction device A16 and the contour extraction device B17 can simultaneously extract the contour information from the video signals output from the imaging device A6 and the imaging device B7, the video signal output control of the imaging device A6 and the imaging device B7 is performed. Can be done simultaneously.

  FIG. 18 illustrates the case where focusing is performed on one of the image sensor A3 and the image sensor B4. However, according to the image processing apparatus 1 illustrated in FIG. 19, focusing is performed on a plurality of image sensors. Can do. Accordingly, not only focusing on the image sensor B4 close to the focused state as shown in FIG. 18, but also the image sensor A3 can be focused and continuous shooting can be performed.

  FIG. 20 is a timing chart showing the operation of the image processing apparatus 1 shown in FIG. In FIG. 20, the contour extraction A of the contour extraction device A16 represents a focusing operation for extracting contour information using the video signal output from the imaging device A6, and the contour extraction B of the contour extraction device B17 is the imaging device B7. Represents the focusing operation for extracting the contour information using the video signal output from. Further, the optical system control A of the central processing unit 15 represents an operation for controlling the imaging optical system A8 to perform focusing, and the optical system control B represents an operation for controlling the imaging optical system B9 to perform focusing. . As shown in FIG. 20, it is possible to take in-focus images one after another by performing a focusing operation on an image sensor that is not capturing a still image as needed.

  FIG. 21 is a block diagram illustrating a schematic configuration of the image processing apparatus 1 including the designation device 18 that designates the number of imaging elements that perform focusing. The image processing apparatus 1 illustrated in FIG. 21 includes a designation device 18 that designates the number of imaging elements to be focused, and a central processing unit 15 that performs the focusing operation of the imaging elements by the number designated by the designation device 18. .

  FIG. 22 is a timing chart showing the operation of the image processing apparatus 1 when performing a focusing operation on two image sensors. In this case, since the designated number is designated as “2” in the designation device 18, both the imaging optical system A8 and the imaging optical system B9 perform the focusing operation.

  FIG. 23 is a timing chart showing the operation of the image processing apparatus 1 when a focusing operation is performed on one image sensor. In this case, since the designated number is designated as “1” in the designation device 18, the focusing operation for one of the imaging optical system A8 and the imaging optical system B9 is performed. Note that although a photographing operation is performed for an apparatus related to an image sensor that does not perform a focusing operation, it is preferable not to perform a photographing operation, thereby reducing power consumption.

  In the above description, two image sensors are shown. However, the present invention is not limited to this, and the designation device 18 may be driven to designate some or all of the plurality of image sensors. For example, if two focusing operations are performed on five image sensors, continuous shooting or simultaneous shooting can be performed for two of the focusing operations, and the remaining three can be operated.

In addition, this invention is not limited to the said embodiment, You may implement as follows.
(1) In the above description, several timings of exposure control and video signal output of the image sensor are shown. However, since exposure control of the image sensor and video signal output can be controlled independently for each image sensor, the timing is Not limited to these, they may be shifted. In each timing, the continuous shooting operation is shown as an example twice, but the present invention is not limited to this, and the continuous shooting operation may be performed any number of times.
(2) In the above description, the case where the image sensor A has a low pixel is shown, but the present invention is not limited to this, and the image sensor B may be driven with a low pixel.
(3) The number of pixels of the image sensor is not limited to the number shown in the above description, and an image sensor with another number of pixels may be used.

  The present invention has the effect of enabling continuous shooting at high speed without the shooting interval being governed by the exposure time of the image sensor and the video signal output time in the high-speed shooting mode. It is useful for an image processing apparatus including a plurality of imaging elements such as a coupling element) and a CMOS (Complementary Metal Oxide Semiconductor).

1 is a block diagram showing a schematic configuration of an image processing apparatus for explaining a first embodiment of the present invention. Timing chart when performing high-speed continuous shooting with the image processing apparatus 1 Timing chart when image signal output control A and image signal output control B are simultaneously processed in the image processing apparatus 1 Timing chart when the image processing apparatus 1 causes the image sensor A3 and the image sensor B4 to continuously perform image capturing operations Timing chart when the image processing apparatus 1 simultaneously drives the image sensor A3 and the image sensor B4 to change the exposure time of each image sensor (A) is a block diagram showing a schematic configuration of an image processing apparatus 1 in which an image processing unit 5 is added to the image processing apparatus 1 shown in FIG. 1, and (b) is an image sensor B4 during monitor photographing with the image sensor A3. Timing chart for still (still image) shooting The block diagram which shows schematic structure of the image processing apparatus 1 provided with imaging device A6 and B7 corresponding to the image pick-up elements 3 and 4, respectively. The block diagram which shows schematic structure of the image processing apparatus 1 in case imaging element A3 is a low pixel and imaging element B4 is a high pixel FIG. 8 is a timing chart showing driving of each image sensor at the time of monitor photographing. The block diagram which shows schematic structure of the image processing apparatus 1 provided with imaging optical system A8 and B9 corresponding to imaging device A3 and B4, respectively. The block diagram which shows schematic structure of the image processing apparatus 1 arrange | positioned so that imaging optical system A8 and B9 may image the light from different to-be-photographed objects 100 and 101, respectively. The block diagram which shows schematic structure of the image processing apparatus 1 provided with the optical path dividing member 11 which divides | segments the light output from the imaging optical system 10 The block diagram which shows schematic structure of the image processing apparatus 1 provided with the optical path length variable apparatus 12 in one of the optical paths divided | segmented by the optical path dividing member 11. FIG. 1 is a block diagram illustrating a schematic configuration of an image processing apparatus 1 including a display device 13. In the image processing apparatus 1, a timing chart in the case of driving the image sensor A3 at 30 fps and driving the image sensor B4 at 15 fps Timing chart when outputting image data B obtained by the image sensor B4 to the display device 13 The block diagram which shows schematic structure of the image processing apparatus for demonstrating the 2nd Embodiment of this invention. The figure explaining the influence which the shift | offset | difference of optical path length has on the focusing of image pick-up element A3 and B4 FIG. 2 is a block diagram showing a schematic configuration of an image processing apparatus 1 including a plurality of contour extraction devices. Timing chart showing the operation of the image processing apparatus 1 shown in FIG. 1 is a block diagram showing a schematic configuration of an image processing apparatus 1 including a designation device 18 that designates the number of imaging elements that perform focusing. Timing chart showing the operation of the image processing apparatus 1 when performing a focusing operation on two image sensors Timing chart showing operation of image processing apparatus 1 when focusing operation is performed on one image sensor

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 2 Imaging apparatus 3 Imaging element A
4 Image sensor B
5 Image Processing Unit 6 Imaging Device A
7 Imaging device B
8 Imaging optical system A
9 Imaging optical system B
DESCRIPTION OF SYMBOLS 10 Imaging optical system 11 Optical path dividing member 12 Optical path length variable apparatus 13 Display apparatus 14 Contour extraction apparatus 15 Central processing unit 16 Contour extraction apparatus A
17 Contour Extractor B
18 Designating device 20 Image sensor driving signal generator A
21 Image sensor drive signal generator B
100 Subject 101 Subject L1 Optical path length L2 from the subject to the imaging optical system A Optical path length L11 from the subject to the imaging optical system B Optical path length L21 from the imaging optical system A to the imaging element A or the optical path dividing member Imaging from the imaging optical system B Optical path length L111 to the element B Optical path length L112 from the optical path dividing member to the imaging optical system A Optical path length L112V from the optical path dividing member to the imaging optical system B Optical path length from the optical path length variable device to the imaging optical system B

Claims (18)

First and second image sensors that convert light from a subject into video signals;
Imaging means for driving the first and second imaging elements independently of each other;
An image processing apparatus comprising: control means for controlling the imaging means so that one of the first and second imaging elements is still driven and the other is monitor driven in a normal mode. The image processing apparatus according to claim 1,
An image processing apparatus comprising an image processing unit that converts video signals from the first and second imaging elements into image data. The image processing apparatus according to claim 1, wherein:
The first image sensor and the second image sensor are image processing apparatuses having different numbers of pixels. The image processing apparatus according to claim 1, wherein:
The first and second imaging elements have substantially the same number of pixels,
The control means is an image processing device that alternately drives the first and second image sensors in a continuous shooting mode. The image processing apparatus according to claim 1, wherein:
The image processing apparatus, wherein the control means drives the first and second image sensors simultaneously, and the exposure time of each image sensor is variable. An image processing apparatus according to any one of claims 1 to 5,
The imaging apparatus includes an image processing apparatus including first and second imaging apparatuses that drive the first and second imaging elements, respectively. The image processing apparatus according to any one of claims 1 to 6,
An image processing apparatus comprising first and second imaging optical systems having focal lengths corresponding to the first and second imaging elements, respectively. The image processing apparatus according to claim 7,
The first and second imaging optical systems are image processing apparatuses arranged to form images of light from different subjects on the first and second imaging elements, respectively. The image processing apparatus according to any one of claims 1 to 6,
An imaging optical system that forms an image of light from a subject on the first and second imaging elements;
An image processing apparatus comprising: an optical path dividing member that divides the optical path of the imaging optical system so as to guide the optical path to the first and second imaging elements, respectively. The image processing apparatus according to claim 9,
An image processing apparatus comprising: an optical path length variable device that varies a length of an optical path toward at least one of the first and second imaging elements among the optical paths divided by the optical path dividing member. The image processing apparatus according to claim 10,
The optical path length variable device is an image processing device that is a drive mechanism that changes the position of at least one of the first and second imaging elements. The image processing apparatus according to claim 10,
The optical path length varying device includes an optical member inserted into an optical path toward at least one of the first and second imaging elements, and a drive mechanism for inserting and removing the optical member with respect to the optical path. Processing equipment. The image processing apparatus according to any one of claims 7 to 12,
A contour information acquisition device for extracting contour information of the subject based on the video signal output from the imaging device;
An image processing apparatus comprising: a focusing control device that controls the imaging optical system in response to a deviation in optical path length based on the contour information. The image processing apparatus according to claim 13,
An image processing device comprising first and second contour information acquisition devices corresponding to the first and second imaging devices, respectively. The image processing apparatus according to claim 13 or 14,
The control means controls an image pickup optical system corresponding to one of the first and second image pickup elements closest to the in-focus state based on the outline information obtained from the outline information acquisition device. Processing equipment. The image processing apparatus according to claim 13 or 14,
An image processing apparatus comprising a designation device that designates the number of the image pickup elements to be focused. The image processing apparatus according to any one of claims 2 to 16, comprising:
An image processing apparatus comprising a display device that displays image data converted by the image processing unit. The image processing device according to claim 17,
The image processing unit is an image processing device that switches image data obtained by converting video signals of the first and second imaging elements and outputs the image data to the display device.

Images