JP2019102894A - Imaging apparatus, control method and program thereof - Google Patents

Abstract

To provide an imaging apparatus capable of changing over day mode, night mode and long-distance mode, while suppressing cost.SOLUTION: An imaging apparatus includes an imaging optical system, an image pick-up device for converting a subject image, focused by the imaging optical system, into an electric video signal, a color filter for transmitting visible radiation of different wavelength for every pixel of the image pick-up device, withdrawal means of infrared cut filter, and development processing means for generating a captured image from the signals obtained from the image pick-up device. The color filter transmits infrared light in addition to the visible radiation, the development processing means generates a captured image by using only the pixel transmitting the visible light of longest wavelength out of the color filter, in a state where the infrared cut filter is evacuated from the optical path by the withdrawal means.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging device, a control method thereof, and a program, and more particularly to an imaging device capable of generating appropriate imaging data according to a shooting mode.

  Conventionally, a network camera has been used as one of the security means. Network cameras are desired to be installed under various environments to provide high-visibility images. However, in a shooting environment of a network camera, when photographing a distant view, the contrast of the subject may be reduced due to the influence of the atmosphere, and an image lacking in visibility may be obtained.

  It is known that short-wavelength blue light has higher scattering intensity than long-wavelength red light. In other words, it is known that red light having a long wavelength and infrared light are less likely to be scattered than blue light having a short wavelength, and the transparency to the atmosphere is high.

  Using this feature, Patent Document 1 uses a film that is sensitive to infrared light and a filter that removes short wavelength components of visible light to clearly image a distant view (far view mode). It is described about.

  Further, in Patent Document 2, there is a technology for switching to a shooting mode suitable for a shooting environment by inserting and removing an optical filter such as an infrared cut filter (IRCF) from the light path and correcting a focus position accompanying the insertion and removal of the filter. It is disclosed. A mode (Night mode) in which a bright image can be captured even in a low illumination environment by removing IRCF and capturing infrared light, and a color close to human perception by inserting IRCF and not capturing infrared light There is a mode (day mode) that can capture a color image of

JP, 2005-51592, A JP, 2014-120923, A

  However, in the above-mentioned patent document 1, it is necessary to use a special filter or film in order to realize imaging of a distant view clearly (far-viewing mode). Further, if the distant view mode is added to the configuration for switching between the day mode and the night mode disclosed in Patent Document 2 and the mode is realized independently, an additional filter drive mechanism or the like is required, and the structure becomes complicated.

  Therefore, an object of the present invention is to provide an imaging device capable of imaging by switching a day mode, a night mode, and a distant view mode with a simple configuration.

  In order to achieve the above object, the present invention has a plurality of pixels covered by either an imaging optical system or a color filter that transmits light components of different wavelengths, and an image is formed by the imaging optical system. An image pickup element for converting an object image into an electric signal, an infrared cut filter for cutting off a light component of a wavelength of a predetermined range, an inserting / extracting means for inserting and removing the infrared cut filter on an optical path of the imaging optical system; The image processing apparatus includes a development processing unit that generates an image from an electrical signal, and a control unit that controls the insertion and removal unit and the development processing unit, and the control unit controls the infrared cut filter from the light path of the imaging optical system. In the removed state, an image covered with a color filter that transmits a light component including a wavelength in a predetermined range that is blocked by the infrared cut filter among the plurality of pixels of the imaging element And generating an image using the converted signals from.

  According to the present invention, it is possible to switch between day mode, night mode, and distant view mode with a simple configuration for imaging.

A figure showing an example of composition of an imaging device concerning a 1st embodiment of the present invention A diagram showing a configuration example of an optical unit of an imaging device according to a first embodiment of the present invention A flowchart showing switching processing of shooting mode according to the first embodiment of the present invention The schematic diagram which shows the example of the captured image of distant view mode and non-far-view mode which concerns on the 1st Embodiment of this invention The flowchart which shows the processing which changes the indicatory picture size which relates to the 2nd execution form of this invention A figure showing an example of composition of an imaging device concerning a 3rd embodiment of the present invention The figure which shows the structural example of the imaging device which concerns on the 4th Embodiment of this invention. A diagram showing a configuration example of an optical unit according to a conventional imaging device

A configuration for switching an imaging mode (filter) such as a day mode, a night mode, and a distant view mode in a conventional surveillance camera (network camera) will be described with reference to FIG. Details of each shooting mode are described below.
-Day mode: A mode capable of capturing visible light under sufficient illumination to capture a color image close to human perception-Night mode: A mode capable of capturing a bright image even under a low illumination environment by capturing infrared light-Far view Mode: An imaging mode intended to clearly capture a distant view (conventionally achieved by cutting visible light and capturing infrared light)

  FIG. 8 is a view showing a configuration example of an optical unit according to a conventional imaging apparatus capable of switching three modes of day mode, night mode and far view mode. The optical unit 401 includes a lens group 1011, an IRCF (infrared cut filter) 1012, a glass 1013, an infrared band pass filter (IRBPF) 4015, and an imaging element 1014. The optical unit 401 switches the imaging mode by inserting one of IRCF (infrared cut filter) 1012, glass 1013, and infrared band pass filter (IRBPF) 4015 on the light path based on an instruction of the filter drive unit 104. . The IRBPF is a filter that transmits only infrared light components of infrared light in a predetermined range.

  A conventional imaging apparatus using such an optical unit 401 inserts the IRCF 1012 in the day mode, the glass 1013 in the night mode, and the IRBPF 4015 in the optical path in the distant mode. Therefore, it is necessary to provide three filters of IRCF (infrared cut filter), glass, an infrared band pass filter (IRBPF), and a mechanism for switching to three states, and the structure becomes complicated. In addition, there is a possibility that the whole surveillance camera (network camera) may become large due to the enlargement of the mechanism.

First Embodiment
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings. Although the case where the camera for monitoring is used as an imaging device is demonstrated to an example below, the use of an imaging device is not limited to monitoring.

  An imaging apparatus according to the first embodiment of the present invention will be described below with reference to FIG. FIG. 1 is a block diagram showing an example of the configuration of an imaging system according to an embodiment of the present invention. The imaging system shown in FIG. 1 includes a monitoring camera 1000 and a client apparatus 2000 connected in a mutually communicable state via an IP network as an apparatus for imaging and image processing. In the monitoring camera 1000, an imaging unit 100 including an optical unit, a development processing unit, an image processing unit and the like generates and outputs an image from a subject image, and a communication unit 113 distributes it to the client apparatus 2000 via a network.

  The imaging unit 100 includes an optical unit 101, a mode setting unit 102, an illuminance acquisition unit 103, a filter driving unit 104, a development processing unit 105, and an angle of view setting unit 106. The optical unit 101 converts light including infrared light or light not including infrared light into an image signal (RAW image) according to an instruction from the filter driving unit 104, and outputs the light to the development processing unit 105. Do.

  The optical unit 101 will be described in more detail with reference to FIG. FIG. 2 is a diagram showing a configuration example of an optical unit of the imaging device according to the first embodiment of the present invention.

  The optical unit 101 includes a lens group 1011, an IRCF (infrared cut filter) 1012, a glass 1013, and an imaging element 1014. The IRCF (infrared cut filter) 1012 and the glass 1013 can be inserted into and removed from the optical path of the imaging optical system by driving a drive mechanism (not shown). The optical unit 101 drives the drive mechanism based on the instruction of the filter drive unit 104 to insert the IRCF 1012 or the glass 1013 into the light path.

  A lens group 1011 that is an imaging optical system focuses light passing through the IRCF 1012 or the glass 1013 on an imaging element in accordance with an instruction from the filter driving unit 104.

  The IRCF 1012 is a filter that transmits light in the visible light wavelength range and blocks light components in the infrared light wavelength range. It has the characteristic that infrared light is less likely to be transmitted than visible light.

  The glass 1013 transmits visible light and infrared light. The glass 1013 is used to suppress focus variation in accordance with the thickness of the filter due to filter switching. Without placing the glass 1013, it is also possible to perform processing for suppressing focus variation by control such as focus position correction according to the thickness of the filter.

  The image pickup device 1014 includes a color filter of Bayer arrangement of R, G, and B each transmitting light components of different wavelengths, and a plurality of pixels. The imaging element 1014 converts an object image (light) formed by passing through the IRCF 1012 or the glass 1013 through the lens group 1011 into an electrical signal, and outputs an image signal. Each of the plurality of pixels is covered with one of R, G, and B color filters, and an object image (light) is separated for each of R, G, and B and photoelectrically converted.

  Referring back to FIG. 1, the mode setting unit 102 is set to any one of the day mode, night mode, and distant view mode, and the mode setting information is set to the filter drive unit 104, the development processing unit 105, and the angle of view setting unit. 106, output to the image processing unit 108; As to which mode to set, for example, the shooting environment may be determined from the shot image and switched, or the user may select.

  The illuminance acquisition unit 103 acquires the illuminance of the imaging environment and outputs the illuminance to the filter drive unit 104. As a method of acquiring the illuminance, for example, detection may be performed using an illuminance sensor, or an illuminance value may be calculated from the exposure information of the imaging device and the brightness information of the captured image.

  The filter drive unit 104 outputs a drive instruction to the optical unit 101 so as to drive the filter based on the mode information acquired from the mode setting unit 102 and the illuminance information acquired from the illuminance acquisition unit 103. For example, when the illuminance is smaller than a predetermined value, the IRCF is taken out from the light path to take in infrared light, and control is performed so that bright imaging can be performed even under low illuminance. At that time, in order to prevent the focus position from being changed due to a change in thickness of the filter, a drive instruction may be output so as to insert the glass 1013 into the light path. On the other hand, for example, when the illuminance is equal to or more than a predetermined value, the IRCF 1012 is inserted in the optical path to remove infrared light and output a drive instruction to perform color imaging.

  The development processing unit 105 performs development processing on the input RAW image data, and outputs the image data subjected to development processing to the angle-of-view changing unit 107. In the present embodiment, development processing according to the mode setting information acquired from the mode setting unit 102 is performed. For example, in the distant view mode, development processing is performed using only data of pixels (R pixels) corresponding to the position of the red color filter provided in the imaging device. On the other hand, in the non-far-viewing mode, that is, in the day mode or the night mode, development processing is performed using data of all pixels (RGB pixels). In the distant view mode, the resolution (number of pixels) of the image data to be output is 1⁄4 in the non distant view mode.

  The angle-of-view setting unit 106 has a display image size set when displaying an image output by the imaging device of the present invention on a display device or the like, and the display image size set for the angle-of-view changing unit 107 Output The display image size set in the angle of view setting unit 106 can be changed by user operation or in accordance with the shooting mode. When trimming and outputting a part of the image data output by the development processing unit 105, coordinate information indicating the position of the trimming area is output. Furthermore, according to the mode setting information acquired from the mode setting unit 102, for example, the coordinate information in the distant view mode is corrected to be 1/2 of the coordinate information in the non distant view mode. The image size is represented by, for example, the number of pixels in the horizontal direction of the image data and the number of pixels in the vertical direction.

  The angle of view changing unit 107 changes the image size of the image data acquired from the development processing unit 105 to the display image size acquired from the angle of view setting unit 106, and outputs the image data after the image size change to the image processing unit 108. Do. When coordinate information representing the position of the trimming area is acquired from the angle of view setting unit 106, the image size of the image data corresponding to the area is changed to the display image size acquired from the angle of view setting unit 106 and the image data is changed. Output.

  The image processing unit 108 performs image processing such as contrast enhancement processing on the image acquired from the angle-of-view changing unit 107. In the present embodiment, image processing according to the mode information acquired from the mode setting unit 102 is performed.

  The control unit 109 controls the entire imaging apparatus 1000 and controls imaging, image processing, video output, and the like. A CPU 110 (computer) and a memory (ROM 111, RAM 112) are provided, and the CPU 110 controls each functional block of the imaging apparatus 1000 and performs necessary operations in accordance with a program loaded from the memory (ROM 111, RAM 112). For example, control of the exposure time (accumulation time) of the imaging element 1014 in the imaging unit 100 and image processing in the image processing unit 108 are controlled. In addition, the zoom operation and the focusing operation of the lens group 1011 in the optical unit 101 and the control of the aperture and the like, and the IRCF 1012 and the glass 1013 are inserted and removed.

  The communication unit 113 transmits the image signal processed by the image processing unit 108 to an external terminal such as the client apparatus 2000 (information processing apparatus). The output destination of the image signal and the distribution destination of the video may be a display incorporated in the camera or an external display independent of the image pickup apparatus. Further, a plurality of video streams may be generated and output from the image signal. Further, the communication unit 113 outputs the state of the system, the processing result, and the like to the client apparatus 2000 as an external terminal connected to the external network, or inputs control information and the like for controlling the operation of the system. Used for The control unit 109 acquires information input via the communication unit 113, and controls each functional block based on the information.

  The client apparatus 2000 displays an image of the image information distributed from the monitoring camera 1000. In addition, the client apparatus 2000 can input an operation from the user, and changes the imaging direction of the monitoring camera 1000, changes the focal length, switches AF / MF, cuts out an image, etc. Control is possible. In this embodiment, a monitoring camera is used as the image processing apparatus, but an image signal acquired by the monitoring camera 1000 may be transmitted to the client apparatus 2000 as it is, and the client apparatus 2000 may perform image processing.

  An example of the processing flow of mode switching of the imaging device according to the present embodiment will be described with reference to FIGS. 3 and 4.

  FIG. 3 is a flowchart showing switching processing of the imaging mode according to the first embodiment of the present invention. The flowchart of FIG. 3 illustrates a processing procedure which controls and executes each processing block by the CPU 110. A program stored in a memory (the ROM 111 or the RAM 112) of the CPU 110 is developed and realized by the CPU 110 executing the program.

  First, in step S01, the filter driving unit 104 determines whether the mode setting unit 102 is set to the distant view mode. If the distant view mode is set, the process proceeds to step S02. If the distant view mode is not set, the process proceeds to step S04.

  If it is determined in step S01 that the distant view mode is set, the process proceeds to step S02. In step S02, the filter driver 104 extracts the IRCF 1012 from the light path and instructs the optical unit 101 to insert the glass 1013 into the light path.

  Thereafter, the process proceeds to step S03, and the development processing unit 105 generates captured image data using only the pixel (R pixel) corresponding to the position of the red color filter. That is, in steps S01 to S03, when the photographing mode is set to the distant view mode, the IRCF 1012 is removed from the light path, infrared light is taken in and imaged, and development processing is performed using only R pixels.

  Returning to step S01, if the distant view mode is not set, the process proceeds to step S04, and the filter driving unit 104 determines whether the illuminance value acquired by the illuminance acquiring unit 103 is equal to or more than a predetermined value. If the illuminance value is less than the predetermined value, the process proceeds to step S02, where the filter driver 104 extracts the IRCF 1012 from the light path and instructs the optical unit 101 to insert the glass 1013 into the light path.

  Thereafter, the process proceeds to step S06, and the development processing unit 105 generates captured image data using RGB pixels.

  Returning to step S04, if it is determined that the illuminance value is smaller than the predetermined value, the process proceeds to step S05. In step S05, the filter driver 104 extracts the glass 1013 from the optical path, and instructs the optical unit 101 to insert the IRCF 1012 into the optical path.

  Thereafter, the process proceeds to step S06, and the development processing unit 105 generates captured image data using pixels (RGB pixels) of all colors. When the illuminance is equal to or higher than a predetermined value, a color image can be output by cutting infrared light, capturing visible light, and performing development using all RGB pixels.

  Here, FIG. 4 is a schematic view showing an example of a captured image of the distant view mode and the non distant view mode according to the first embodiment of the present invention. Even when the distant view is blurred due to the scattering of light by the atmosphere in the non distant view mode (day mode etc.), the effect of the light scattering is suppressed and the distant view becomes clear when the distant view mode is switched.

  As described above, in the first embodiment of the present invention, captured image data is formed using only R pixels instead of using the infrared band pass filter (IRBPF) in the distant view mode. Therefore, it is not necessary to provide an infrared band pass filter (IRBPF) as in the conventional example (FIG. 8). Since three modes can be realized by a mechanism that switches two filters, it is possible to realize a configuration in which three imaging modes are switched with a simple structure as compared with a mechanism that switches three filters.

  Further, in the distant view mode, visible light is captured and only R pixels are used to form captured image data. Light with a long wavelength is difficult to scatter and has high transparency in the atmosphere. Even when visible light is taken in, by forming captured image data using only long light (R pixel) of a wavelength that is less affected by light scattering, it is possible to capture a distant view more clearly.

Second Embodiment
Hereinafter, the second embodiment will be described in detail with reference to FIG. FIG. 5 is a flowchart showing a process of changing the display image size according to the first embodiment of the present invention. The flowchart in FIG. 5 illustrates a processing procedure which is performed by the CPU 110 to control and execute each processing block. A program stored in a memory (the ROM 111 or the RAM 112) of the CPU 110 is developed and realized by the CPU 110 executing the program.

  First, in step S11, the angle-of-view setting unit 106 determines whether or not the imaging device is set to trim (cut out) part of the captured image data and output it. If the trimming setting is set, the process proceeds to step S12. If the trimming setting is not set, the process of the subsequent step is not performed, and the process proceeds to step S15.

  In the next step S12, the angle of view setting unit 106 determines whether the shooting mode is set to the distant view mode by the mode setting unit 102 or not. If the distant view mode is set, the process proceeds to the next step S13. If the distant view mode is not set, the process proceeds to step S14 without performing the process of step S13.

  In step S13, the angle of view setting unit 106 corrects coordinate information of the trimming area. When trimming and outputting a part of the generated image data based on the set display image size, coordinate information indicating the position of the trimming area is output. In accordance with the mode setting information acquired in step S12, the coordinate information in the distant view mode is corrected to be 1/2 of the coordinate information in the case of not the distant view mode. This is because the image is generated using only R pixels in the distant view mode and RGB pixels in the non distant view mode, so the horizontal and vertical sizes are 2 minutes in the non distant mode in the distant view mode. It is to become 1. The image size is represented by, for example, the number of pixels in the horizontal direction of the image data and the number of pixels in the vertical direction. In the distant view mode, the resolution (number of pixels) of the entire image data to be output is one fourth in the non distant view mode.

  In step S14, the angle-of-view changing unit 107 performs trimming processing to cut out image data of an area corresponding to the coordinate information acquired from the angle-of-view setting unit 106. The angle of view changing unit 107 changes the image size of the image data acquired from the development processing unit 105 to a predetermined display image size, and outputs the image data after the image size change to the image processing unit 108. Coordinate information representing the position of the trimming area corrected in step S13 is acquired, and image data corresponding to the area based on the coordinate information is extracted.

  After that, in step S15, the angle of view changing unit 107 enlarges or reduces the image according to the image size information acquired from the angle of view setting unit 106, changes the image size, and converts it to a predetermined display image size. Output.

  In the present embodiment, after the development processing, the image size, the angle of view, and the trimming coordinates are changed according to the mode setting information. In the case of a surveillance camera or the like, there are many use cases in which images of a plurality of cameras are displayed on one monitor, and display is performed with a smaller number of pixels than the number of imaging pixels of the camera. In addition, there are cases where the number of pixels such as FullHD and 4K is smaller than the number of pixels of the image pickup device of the camera according to the format of the high-definition video signal. In this case, the process of reducing the image is necessary. However, if the process of generating captured image data using only R pixels as in the present invention after reducing the image, the original of R pixels is performed in the reducing step. Data may be lost. That is, if reduction or trimming processing is performed, it is possible to preferentially discard unused pixels other than R pixels, but when generating captured image data with only R pixels, much information of R pixels can be used. That is, deterioration of image information can be suppressed by performing processing of changing the image size according to the display image size after generating captured image data using only R pixels.

Third Embodiment
Hereinafter, with reference to FIG. 6, a display apparatus and a control method thereof according to a third embodiment of the present invention will be described. In the first embodiment, an example in which only the R pixel is used in the distant view mode has been described, but in the present embodiment, an example in which G and B pixels are also used according to the illuminance will be described.

  FIG. 6 is a view showing an example of the arrangement of an imaging apparatus according to the third embodiment of the present invention. The same functional units as in the first embodiment (FIG. 1) are assigned the same reference numerals and descriptions thereof will be omitted.

  The illuminance acquisition unit 203 acquires the illuminance of the shooting environment, and outputs the illuminance to the filter drive unit 104 and the development processing unit 205. As a method of acquiring the illuminance, for example, detection may be performed using an illuminance sensor, or an illuminance value may be calculated from the exposure information of the imaging device and the brightness information of the captured image.

  The development processing unit 205 performs development processing on the input RAW image data, and outputs the image data subjected to development processing to the angle-of-view changing unit 107. At this time, in the present embodiment, the development processing is performed according to the mode setting information acquired from the mode setting unit 102 and the illuminance acquired from the illuminance acquiring unit 203. More specifically, in the distant view mode, the color of the pixel used for the development processing is selected according to the illuminance value.

  If the illuminance value is larger than the predetermined value, captured image data is generated using only R pixels as in the first embodiment. On the other hand, when the illuminance value is equal to or less than the predetermined value, captured image data is generated using pixels other than the R pixel. For example, even in the distant view mode, when the illuminance value is equal to or less than a predetermined value, development processing is performed using data of all pixels (RGB pixels).

  On the other hand, in the case of a low illuminance environment in which the illuminance is small, development processing is performed using data of all pixels (RGB pixels). In the case of a low illuminance environment where the illuminance is low, the visible light component contained in the light input to the imaging device is small, and the infrared light component is dominant also for the light transmitted through the G and B pixels. Since the light of the infrared component has a long wavelength, it is hard to be scattered by the atmosphere. Therefore, even if the captured image data is generated using the G and B pixel signals, the degree to which the image is blurred due to scattering is small, and clear distant image capturing data can be obtained. By generating imaging data using signals of RGB pixels, resolution or sensitivity can be improved as compared to the case where image data is generated using only R pixels.

  In the case of the non-far-view mode (day mode or night mode), development processing is performed using data of all pixels (RGB pixels) as in the related art and the first embodiment.

  As described above, according to the third embodiment, in an environment where the illuminance is small, development processing is performed using all pixels (RGB pixels) even in the distant view mode, so that the resolution is higher than in the first embodiment, or It is possible to clearly capture a distant view while maintaining high-sensitivity image quality.

Fourth Embodiment
Hereinafter, with reference to FIG. 7, a display device and a control method thereof according to a fourth embodiment of the present invention will be described. In this embodiment, an example will be described in which the imaging angle of view is changed by driving the lens in the distant view mode and in the non distant view mode. More specifically, an example will be described in which in the distant view mode, the optical zoom is used to magnify (smaller as the angle of view) than in the non distant view mode.

  FIG. 7 is a view showing an example of the arrangement of an imaging apparatus according to the fourth embodiment of the present invention. The same functional units as in the first embodiment are denoted by the same reference numerals, and detailed descriptions thereof will be omitted.

  The optical unit 301 includes a lens group, an IRCF (infrared cut filter), glass, and an imaging device. The optical unit 301 drives a drive mechanism (not shown) based on the instruction of the filter drive unit 104 to insert IRCF (infrared cut filter) or glass on the light path. Also, based on mode setting information and display image size information acquired from a mode setting unit 302 and an angle of view setting unit 306 described later, the lens group 1011 is driven to change the angle of view for imaging.

  The mode setting unit 302 is set to any one of a day mode, a night mode, and a distant view mode, and the mode setting information is set to the optical unit 301, the filter drive unit 104, the development processing unit 105, the angle of view setting unit 306, and the image. It outputs to the processing unit 108. As to which mode to set, for example, the shooting environment may be determined from the shot image and switched, or the user may select.

  The angle of view setting unit 306 corrects the set display image size information based on the mode setting information acquired from the mode setting unit 302, and the display image size information after correction is sent to the optical unit 301 and the angle of view changing unit 307. Output. More specifically, when the view angle setting unit 306 is set to the distant view mode and the number of pixels of the display image becomes smaller than the number of pixels of the imaging device by trimming the captured image, the optical zoom is performed. To instruct the optical unit 301. Further, the display image size information corresponding to the trimming area is corrected so as to be enlarged by the enlargement ratio by the optical zoom. However, the magnification by the optical zoom is in a range not exceeding 4 times.

  In the fourth embodiment, in the distant view mode and when outputting an image obtained by trimming the captured image, the optical zoom is performed (the imaging angle of view is enlarged within a range in which the trimming area falls within the imaging angle of view). Make it smaller). The trimming area is similarly expanded. In the case of optically limiting the angle of view by the optical zoom, image data can be generated using more pixels for the same area as in the case of trimming electronically.

  Since the imaging device according to the first embodiment uses only R pixels in the far view mode to generate a captured image, if it is a Bayer array, which is a general color filter array, the captured image in the far view mode is not The resolution is reduced to a quarter compared to that in the distant view mode. In addition, if the optical zoom is previously enlarged to four times, the resolution of the object can be prevented from being lowered, but the angle of view becomes narrow.

  On the other hand, in the present embodiment, when outputting an image obtained by trimming a part of a captured image in the distant view mode, instead of electronic trimming, the area optically falls within a range where the area is within the imaging angle of view. Expanding. In other words, when the subject area desired to be photographed is narrower than the imaging angle of view, the enlargement by the optical zoom is performed in advance so that the object area desired to be imaged approaches the imaging angle of view. Therefore, the subject in the trimming area can be imaged without reducing the resolution. By enlarging with the optical zoom, it is conceivable that the subject in the trimming area is largely imaged and the trimming area set in advance is extended. Therefore, the trimming area after the optical zoom is set so that the subject in the trimming area before the optical zoom is included in the trimming area after the optical zoom by expanding the trimming area according to the enlargement factor of the optical zoom. . As a result, the resolution of the trimming area after the optical zoom increases, and the resolution of the captured image generated using only R pixels from the image also increases. When outputting a trimmed imaging range (field angle), it is possible to suppress a reduction in resolution due to generating a captured image using only R pixels by cutting out the imaging range (field angle) using an optical zoom. it can.

  As described above, according to the present embodiment, when an image obtained by trimming a captured image is output in the distant view mode, the trimming region is enlarged by the optical zoom, and then only R pixels are extracted to generate captured image data. . Therefore, in the trimming area, it is possible to prevent the reduction in resolution due to the extraction of only the R pixel.

  Note that control may be performed to automatically set the non-far-viewing mode when setting the trimming area. As described above, in the present embodiment, since the optical zoom is performed in the distant view mode, the imaging angle of view becomes narrow. Since the setting operation of the trimming area is usually performed from the photographed image of the bird's-eye view, it is more convenient to perform wide-angle photographing when setting the trimming area. Therefore, by setting the trimming area to be automatically set to the non-far-viewing mode at the time of setting the trimming area, it is possible to prevent a reduction in resolution in the far-viewing mode without impairing the convenience.

  As mentioned above, although the preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary. The present invention is not limited to the above-described embodiment, and it should be changed as needed according to the circuit configuration to be applied. For example, the camera described as the imaging device in the above-described embodiment can be applied to a digital still camera or a digital video camera.

  The present invention can also be embodied as, for example, a system, an apparatus, a method, a computer program, a recording medium, etc. Specifically, even if it is realized by one apparatus, it is applied to a system consisting of a plurality of apparatuses. You may The respective units constituting the image pickup apparatus according to the present embodiment and the steps of the control method of the image pickup apparatus can also be realized by operating a program stored in a memory of a computer or the like. The computer program and a computer readable recording medium storing the program are included in the present invention.

  The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

DESCRIPTION OF SYMBOLS 101 Optical unit 102 Mode setting part 103 Illuminance acquisition part 104 Filter drive part 105 Development processing part 106 Field angle setting part 107 Field angle change part 108 Image processing part

Claims (11)

An imaging optical system,
An image pickup device having a plurality of pixels covered by any of color filters transmitting light components of different wavelengths, and converting an object image formed by the image pickup optical system into an electric signal;
An infrared cut filter for blocking light components of wavelengths within a predetermined range;
Inserting and removing means for inserting and removing the infrared cut filter on the light path of the imaging optical system;
Development processing means for generating an image from the electrical signal;
And controlling means for controlling the inserting and removing means and the developing means.
The control means, in a state where the infrared cut filter is extracted from the optical path of the imaging optical system, has a wavelength in a predetermined range which is blocked by the infrared cut filter among a plurality of pixels of the imaging device. What is claimed is: 1. An imaging device comprising: generating an image from a signal acquired from a pixel covered by a color filter that transmits an included light component. The image processing apparatus further comprises resizing means for resizing the image to any size.
The image pickup apparatus according to claim 1, wherein the changing unit changes the image to an arbitrary size after generating an image from a signal acquired from a specific pixel by the development processing unit. The image processing apparatus further comprises selection means capable of selecting a photographing mode.
When the shooting mode is a mode aiming to clearly capture a distant view,
The control means, in a state where the infrared cut filter is extracted from the optical path of the imaging optical system, has a wavelength in a predetermined range which is blocked by the infrared cut filter among a plurality of pixels of the imaging device. The image pickup apparatus according to claim 1, wherein an image is generated using a signal converted from a pixel covered by a color filter that transmits a light component including the light component. And image processing means for performing contrast enhancement processing on the image.
The image processing means performs contrast enhancement processing of the image generated using a signal converted from a pixel covered by a color filter that transmits a light component including a wavelength in a predetermined range. The imaging device according to any one of 1 to 3. And illumination intensity acquiring means for acquiring the illumination intensity of the subject.
The control unit is configured to, when the illuminance of the subject is smaller than a predetermined value, the infrared cut filter among the plurality of pixels included in the imaging element in a state in which the infrared cut filter is removed from the light path of the imaging optical system. 5. An image is generated using a signal converted from a pixel covered by a color filter that transmits a light component including a predetermined range of wavelengths blocked by a cut filter, according to any one of claims 1 to 4. An imaging device according to item 5. And angle of view changing means for changing the area of the subject image to be included in the image.
The angle-of-view changing means performs enlargement by operating the imaging optical system such that the number of pixels for outputting an object image in the area increases.
The image pickup apparatus according to any one of claims 1 to 5, wherein development processing by the development processing unit and change of an image size by the size changing unit are performed.   The imaging device according to any one of claims 1 to 6, wherein the color filter is a color filter of Bayer arrangement of R, G, and B.   8. The image pickup apparatus according to claim 7, wherein the signal used by the control means for development processing is a signal generated from an R pixel in the Bayer array. An imaging optical system,
An image pickup device having a plurality of pixels covered by any of color filters transmitting light components of different wavelengths, and converting an object image formed by the image pickup optical system into an electric signal;
A control method of an imaging apparatus, comprising: an infrared cut filter that can be inserted into and removed from an optical path of the imaging optical system and blocks a light component having a wavelength in a predetermined range.
Removing the infrared cut filter from the light path of the imaging optical system;
An image is generated using a signal converted from a pixel covered by a color filter that transmits a light component including a predetermined range of wavelengths blocked by the infrared cut filter among a plurality of pixels included in the image sensor. Step and
And a control method of an imaging apparatus.   A computer program for causing a computer to execute each step according to claim 9.   The computer-readable recording medium which described the program of Claim 10.