JP2009246441A - Imaging device and program thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging device that secures a good photographic state using a temperature value corresponding to outside air temperature of the imaging device, and a program thereof. <P>SOLUTION: The imaging device 1 which captures an image by a lens unit 12 and a CMOS imaging element 13 includes a thermistor 15 which measures the temperature value corresponding to the outside air temperature, and a control unit 21 detects a hand shake of the imaging device 1, corrects the position of an effective pixel area to be extracted as a picked-up image of an imaging area of the CMOS imaging element 13 according to the detected hand shake, and varies the size of the effective pixel area according to the temperature value measured by the thermistor 15. Additionally, correction of a hand shake detection area, correction of the hue of the picked-up image, and change of setting states of the picked-up image are carried out using the temperature value corresponding to the outside air temperature of the imaging device. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus whose operation is controlled according to an outside air temperature and a program thereof.

Conventionally, a technique for controlling the operation of a lens in an imaging apparatus according to temperature is known from Patent Document 1 below. The image pickup apparatus described in Patent Document 1 uses a plastic lens. Even when the focus position of the plastic lens changes due to a temperature change, the imaging apparatus corrects the focus setting position of the plastic lens.
JP 2007-293124 A

  However, the imaging apparatus described above uses temperature only for lens control, and it is desirable that the detected temperature can be applied to other operations.

  Therefore, the present invention has been proposed in view of the above-described circumstances, and provides an imaging apparatus and a program thereof that can ensure a better imaging state using a temperature value corresponding to the outside air temperature of the imaging apparatus. Objective.

  The present invention is an image pickup apparatus that acquires a picked-up image with an image pickup element, and in order to solve the above-described problem, a temperature measuring unit that measures a temperature value corresponding to an outside air temperature, and a camera shake of the image pickup apparatus are detected. In accordance with the detected camera shake, a camera shake correction unit that corrects a position of an effective pixel region to be extracted as the captured image in the imaging region of the image sensor, and a size of the effective pixel region was measured by the temperature measurement unit. An area changing unit that changes based on a temperature value, and picks up a captured image of an effective pixel area whose size has been changed by the area changing unit and whose position has been corrected by the camera shake correcting unit.

  In the present invention, the region changing unit decreases the size of the effective pixel region as the temperature value measured by the temperature measuring unit is lower.

  In the present invention, it is preferable that the temperature measuring unit measures a temperature of a lens unit that guides light to the imaging element.

  Furthermore, the present invention may include a lens control unit that controls the operation of the lens unit based on the temperature value of the lens unit measured by the temperature measuring unit.

  Furthermore, in the present invention, the region changing unit may determine the size of the effective pixel region based on a preset image size in addition to the temperature value measured by the temperature measuring unit.

  The present invention is an image pickup apparatus that acquires a picked-up image with an image pickup element, and in order to solve the above-described problem, a temperature measuring unit that measures a temperature value corresponding to an outside air temperature, and a camera shake detection in the picked-up image Based on the temporal difference between the images included in the area, the camera shake detection means for detecting the camera shake of the imaging apparatus, and the size of the camera shake detection area are changed based on the temperature value measured by the temperature measurement means. And an area changing means for performing the above operation.

  In the present invention, the region changing unit increases the size of the camera shake detection region as the temperature value measured by the temperature measuring unit is lower.

  In the present invention, it is preferable that the temperature measuring unit measures a temperature of a lens unit that guides light to the imaging element.

  Furthermore, in the present invention, a lens control unit that controls the operation of the lens unit based on the temperature value of the lens unit measured by the temperature measurement unit may be provided.

  In the present invention, it is desirable that the area changing unit determines the size of the camera shake detection area based on a preset image size in addition to the temperature value measured by the temperature measuring unit.

  Furthermore, in the present invention, there is provided a camera shake correction unit that performs camera shake correction according to the camera shake detected by the camera shake detection unit using an image included in the camera shake detection region whose size is determined by the region changing unit.

  The present invention is an image pickup apparatus that acquires a picked-up image by an image pickup device, and in order to solve the above-described problem, a temperature measuring unit that measures a temperature value corresponding to an outside air temperature and the temperature measuring unit measure the temperature value. A color adjustment unit that adjusts the color of the captured image based on a temperature value;

  In the present invention, it is preferable that the color adjustment unit suppresses the color of the red component in the captured image when the temperature value measured by the temperature measurement unit is equal to or higher than a predetermined temperature.

  The present invention is an image pickup apparatus that acquires a picked-up image by an image pickup device, and in order to solve the above-described problem, a temperature measuring unit that measures a temperature value corresponding to an outside air temperature and the temperature measuring unit measure the temperature value. Estimating means for estimating whether the imaging apparatus is present indoors or outdoors based on a temperature value; and setting means for determining a setting state of the imaging apparatus based on an estimation result estimated by the estimation means. It is characterized by that.

  Furthermore, in the present invention, it comprises storage means for storing date and time information and an indoor temperature and an outdoor temperature corresponding to the date and time information, and a date and time acquisition means for acquiring the current date and time, and the estimation means includes the date and time acquisition. The date and time obtained by the means and the temperature value measured by the temperature measuring means are compared with the date and time and the indoor temperature and the outdoor temperature stored in the storage means, and whether the imaging device exists indoors or outdoors. It is desirable to estimate

  Furthermore, in the present invention, the storage means further includes position positioning means for storing area information in association with the indoor temperature and outdoor temperature, and measuring position information of the imaging device, and the estimation means includes the The indoor and outdoor temperatures corresponding to the area information corresponding to the location information measured by the positioning means are compared with the temperature values measured by the temperature measuring means, and the imaging device is present indoors or outdoors. It is desirable to estimate.

  Furthermore, in the present invention, the estimation unit obtains a color temperature of a captured image acquired by the imaging element in addition to the temperature value measured by the temperature measurement unit, and based on the temperature value and the color temperature, It is desirable to estimate whether the imaging device exists indoors or outdoors.

  Furthermore, in the present invention, it is preferable that the setting unit determines a display order for selecting a white balance setting or a display order of photographing modes.

  The present invention is a program executed by a computer built in an imaging apparatus that includes a temperature measurement unit that measures a temperature value corresponding to the outside air temperature and acquires a captured image by an imaging element, and to solve the above-described problem. In addition, the camera shake of the imaging device is detected, and the process of correcting the position of the effective pixel area to be extracted as the captured image of the imaging area of the imaging device according to the detected camera shake, and the size of the effective pixel area, Causing the computer to execute a process of changing the temperature based on the temperature value measured by the temperature measuring unit, and causing the computer to execute a process of extracting a captured image of the effective pixel region whose size has been changed and whose position has been corrected. It is characterized by that.

  The present invention is a program executed by a computer built in an imaging apparatus that includes a temperature measurement unit that measures a temperature value corresponding to the outside air temperature and acquires a captured image by an imaging element, and to solve the above-described problem. In addition, based on the temporal difference between the images included in the camera shake detection area of the captured image, the process for detecting the camera shake of the imaging apparatus and the size of the camera shake detection area are measured by the temperature measuring unit. And causing the computer to execute a process of changing based on the temperature value.

  In the present invention, there is provided a program executed by a computer built in an imaging apparatus that includes a temperature measurement unit that measures a temperature value corresponding to the outside air temperature and acquires a captured image by an imaging element, and solves the above-described problem. For this purpose, the computer is caused to execute a process of adjusting the color of the captured image based on the temperature value measured by the temperature measuring means.

  In the present invention, there is provided a program executed by a computer built in an imaging apparatus that includes a temperature measurement unit that measures a temperature value corresponding to the outside air temperature and acquires a captured image by an imaging element, and solves the above-described problem. Therefore, based on the temperature value measured by the temperature measuring means, a process for estimating whether the imaging device exists indoors or outdoors, and the setting state of the imaging device based on the estimated result of estimation. It is characterized by causing a computer to execute the determining process.

  According to the imaging device and the program thereof according to the present invention, using the temperature value corresponding to the outside temperature of the imaging device, the correction of the effective pixel region or the camera shake detection region, the correction of the color of the captured image, and the setting of the captured image A better shooting state such as a state change can be ensured.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  First, the functional configuration of the imaging apparatus 1 shown as the embodiment of the present invention will be described with reference to FIG.

  As shown in FIG. 1, the imaging device 1 includes a motor 11, a lens unit 12, a CMOS (Complementary Metal-Oxide Semiconductor) imaging device 13, a controller 14, a thermistor 15, an A / D conversion processing unit 16, Color process circuit 17, DMA (Direct Memory Access) controller 18, DRAM interface (I / F) 19, DRAM 20, control unit 21, VRAM controller 22, VRAM 23, digital video encoder 24, and display unit 25, an image processing unit 26, a memory 27, a key input unit 28, an audio processing unit 29, a microphone unit (MIC) 31, a speaker unit (SP) 32, a strobe driving unit 30, and a strobe light emitting unit. 33.

  The lens unit 12 includes a plurality of lens groups for entering external light. The lens unit 12 is an optical system for imaging outside light in an imaging region within a predetermined range on the CMOS imaging device 13. The lens unit 12 includes a shutter unit and a diaphragm unit (not shown). These shutter units and diaphragm units are moved in focus and diaphragm positions by driving the motor 11. The lens unit 12 also includes a zoom lens that can freely perform zoom-out and zoom-in according to control of the control unit 21 and change the shooting range.

  The CMOS image sensor 13 forms an RGB primary color filter, for example. The CMOS image sensor 13 is scan-driven by a timing generator and a vertical driver (not shown). The CMOS image sensor 13 outputs a photoelectric conversion output corresponding to a light image formed at regular intervals for one screen.

  The controller 14 controls the operation of the lens unit 12 and the CMOS image sensor 13 according to the control of the control unit 21 described later. Specifically, as will be described later, the operation of the lens unit 12 according to the outside air temperature is controlled according to the control of the control unit 21.

  The thermistor 15 functions as a temperature measuring unit that measures a temperature value corresponding to the outside air temperature. The thermistor 15 detects not only the temperature of the lens unit 12 but also a temperature value corresponding to the outside air temperature of the housing of the imaging device 1. Note that the temperature value detected by the thermistor 15 may be corrected by the control unit 21 to be described later and finally set to a temperature corresponding to the outside air temperature.

  The A / D conversion processing unit 16 includes a sample hold circuit and an A / D converter. The A / D conversion processing unit 16 performs desired processing on the photoelectric conversion output output from the CMOS image sensor 13. Specifically, the gain is appropriately adjusted for each primary color component of RGB in the state of an analog value signal with respect to the photoelectric conversion output from the CMOS image sensor 13. Thereafter, the sample is held by the sample hold circuit, converted into digital data by the A / D converter, and output to the color process circuit 17.

  The color process circuit 17 performs color process processing including pixel interpolation processing, γ correction processing, and matrix calculation. The color process circuit 17 generates a luminance signal Y and color difference signals Cb and Cr as digital values and outputs them to the DMA controller 18.

  The DMA controller 18 once writes the luminance signal Y and the color difference signals Cb and Cr output from the color process circuit 17 in a buffer inside the DMA controller 18. At this time, the DMA controller 18 writes the luminance signal Y and the color difference signals Cb and Cr with reference to the composite synchronization signal, the memory write enable signal, and the clock signal that are also supplied from the color process circuit 17. Then, the DMA controller 18 directly transfers the luminance signal Y and the color difference signals Cb and Cr to the DRAM 21 used as a buffer memory via the DRAM interface 19.

  The digital video encoder 24 periodically reads the luminance signal Y and the color difference signals Cb and Cr from the VRAM 23 via the VRAM controller 22, generates a video signal based on these data, and outputs the video signal to the display unit 25.

  With such a configuration, the imaging apparatus 1 can display a captured image captured by the CMOS image sensor 13 on the display unit 25.

  Although not shown, the display unit 25 is provided on the back side of the housing of the imaging device 1. The image processing unit 26 functions as a monitor display unit (electronic finder) in the shooting mode. In this shooting mode, the image processing unit 26 performs display based on the video signal from the digital video encoder 24. Thereby, the imaging device 1 displays the image information captured from the VRAM controller 22 at that time in real time.

  As described above, the imaging device 1 is in a state in which imaging can be performed in a display state of a so-called through image in which an image at that time is displayed in real time on the display unit 25 as a monitor image. When a shutter key, which is one of the key input units 28, is operated at a timing when photographing is desired, a trigger signal is generated for the control unit 21.

  In response to this trigger signal, the control unit 21 supplies the image processing unit 26 with the luminance signal Y and color difference signals Cb and Cr for one screen captured from the CMOS image sensor 13 at that time. At this time, the DRAM interface 19 supplies the image processing unit 26 with each component of the luminance signal Y, the color difference signal Cb, and the color difference signal Cr supplied from the DMA controller 18 and written in the DRAM 20. The DRAM interface 19 reads out the luminance signal Y, the color difference signal Cb, and the color difference signal Cr, for example, in a unit called a basic block of 8 vertical pixels × 8 horizontal pixels, and supplies it to the image processing unit 26.

  Under the control of the control unit 21, the image processing unit 26 applies ADCT (Adaptive Discrete Cosine Transform), entropy coding to the written image in accordance with the JPEG (Joint Photograph Coding Experts Group) standard. Data compression is performed by a process such as Huffman encoding which is a method.

  The memory 27 is a fixed recording medium such as a recording medium or a recording medium such as a memory card that is detachably attached to the imaging apparatus 1. Code data obtained by the processing of the image processing unit 26 under the control of the control unit 21 is written in the memory 27 as a data file of one image.

  The key input unit 28 is a key group for inputting user operations collectively including a power key, a shutter key, a mode switching key, a menu key, a cross key, a set key, and the like. The key input unit 28 is connected to the control unit 21. An operation command signal that indicates that an operation has been performed in response to the operation of each key is output to the control unit 21.

  The sound processing unit 29 includes a sound source circuit such as a PCM sound source. At the time of audio recording, the audio processing unit 29 digitizes the audio signal input from the microphone unit 31 and compresses the data in accordance with a predetermined data file format, for example, the MP3 (MPEG-1 audio layer 3) standard to generate an audio data file. Is transmitted to the memory 27. In addition, the audio processing unit 29 expands the audio data file sent from the memory 27 and converts it into an analog signal when reproducing the audio, and the speaker unit 32 provided on the rear surface of the casing (not shown) of the imaging device 1. The sound is emitted through.

  The strobe drive unit 30 charges a strobe capacitor (not shown) at the time of still image shooting, and then drives the strobe light emission unit 33 in accordance with the control from the control unit 21. When a moving image is shot, recording of the still image data file in which the above-described still image data is compressed by the image processing unit 26 in the memory 27 is started when the first shutter key is operated. Thereafter, this processing is continuously executed at a predetermined frame rate, for example, 30 (frames / second), and when the shutter key is operated for the second time or when a predetermined time limit, for example, 30 seconds elapses. These series of still image data files are collectively set as a motion JPEG data file (AVI file).

  In the playback mode, the control unit 21 first selectively reads out image data recorded in the memory 27. Next, the control unit 21 decompresses the image data that has been compressed in the opposite procedure to the procedure in which the image processing unit 26 compressed the data in the shooting mode, and holds the decompressed image data in the DRAM 20 via the DRAM interface 19. . The contents held in the DRAM 20 are stored in the VRAM 23 via the VRAM controller 22. The VRAM 23 periodically reads out image data and displays it on the display unit 25 as video.

  If the selected image data is not a still image but a moving image, playback of individual still image data constituting the selected moving image file is executed continuously in time, and all the still image data is played back. At the time of completion, playback and display are performed using only the still image data positioned at the head until the next playback instruction is given.

  The control unit 21 includes a CPU, a ROM that stores a computer program that is executed by the CPU for various processes for the outside air temperature, which will be described later, and a RAM that is used as a work memory. To control the operation. Specifically, the control unit 21 reads out the luminance signal Y and the color difference signals Cb and Cr transferred from the DMA controller 18 to the DRAM 20 by controlling the DRAM interface 19 from the DRAM 20. Thereafter, the control unit 21 causes the read signal to be written into the VRAM 23 via the VRAM controller 22. In addition, the control unit 21 performs data compression / decompression, recording / reproduction control for the memory 27, and the like as described above.

  The imaging apparatus 1 configured as described above performs a camera shake correction operation when an operation for capturing an image of a subject is performed while the imaging apparatus 1 is held by a user. In this camera shake correction operation, the control unit 21 sets an effective pixel area to be captured as a captured image in the imaging area of the CMOS image sensor 13 in advance. In other words, a trimming area that is not captured as an effective pixel area in the imaging area of the CMOS image sensor 13 is set. Then, the imaging device 1 corrects the position of the effective pixel region when the camera shake of the imaging device 1 is detected. This correction process of the position of the effective pixel area is a process of shifting the effective pixel area in a direction opposite to the direction moved by hand movement as much as possible.

  In such a camera shake detection process performed by the imaging apparatus 1, the control unit 21 may move the effective pixel region when the control unit 21 detects a sensor value of a gyro sensor (not shown). Specifically, when it is determined that camera shake correction has occurred based on the sensor value of the gyro sensor, the control unit 21 moves the effective pixel region by an amount corresponding to camera shake.

  In addition, the camera shake detection process by the imaging apparatus 1 may be performed by setting a camera shake detection area for detecting image motion in the imaging area of the CMOS image sensor 13. This camera shake detection area is set to an area narrower than the effective pixel area. If the movement of the subject is larger than the predetermined movement amount based on the temporal difference in the movement of the subject included in the camera shake detection area, it is determined that camera shake correction is necessary. When it is determined that camera shake correction is necessary, the control unit 21 moves the effective pixel area according to the amount of movement of the subject in the camera shake detection area.

  Thus, the imaging device 1 that performs camera shake correction uses a temperature value corresponding to the outside air temperature measured by the thermistor 15 for the camera shake correction operation. Here, when the outside air temperature is low, camera shake tends to occur. Therefore, in the imaging device 1 to which the present invention is applied, the control unit 21 increases the size of the effective pixel region as the outside air temperature is lower.

  Specifically, when the camera shake correction operation is OFF, as shown in FIGS. 2 (a) and 3 (a), regardless of the outside air temperature, The captured image 100 and the effective pixel area 101 match. On the other hand, when the camera shake correction operation is turned on, as shown in FIGS. 2B and 3B, the effective pixel region 101 corresponding to the outside air temperature is set. As the season is winter and the outside air temperature is lower, the control unit 21 sets the effective pixel region 101 ′ with a smaller area as shown in FIG. On the other hand, when the season is summer and the outside air temperature is not low, the control unit 21 sets the effective pixel region 101 ′ having a larger area than the effective pixel region 101 ′ illustrated in FIG. Thereby, the control unit 21 functions as a region changing unit that changes the size of the effective pixel region according to the outside air temperature. Therefore, the imaging apparatus 1 takes out the image of the effective pixel region 101 whose size is changed and the position of the captured image 100 is corrected, displays the image on the display unit 25, and performs recording.

Note that the change of the effective pixel area 101 is the same as the change of the trimming area 103 that is uniquely determined by the size of the effective pixel area 101. In the following description, a method of mainly changing the effective pixel area 101 and capturing a captured image of the effective pixel area 101 will be described. However, the change of the effective pixel area 101 is the same as the change of the trimming area 103, and the effective pixel area 101 may be determined by changing the trimming area 103.

  Furthermore, the imaging apparatus 1 changes the camera shake detection area 102 based on the outside air temperature measured by the thermistor 15. Specifically, when the camera shake correction operation is OFF, the camera shake detection region 102 is set as shown in FIGS. 2A and 3A regardless of the outside air temperature. On the other hand, when the camera shake correction operation is turned on, the camera shake detection area 102 corresponding to the outside air temperature is set as shown in FIGS. 2B and 3B. As the season is winter and the outside air temperature is lower, the control unit 21 sets a camera shake detection region 102 ′ having an enlarged area as shown in FIG. On the other hand, when the season is summer and the outside air temperature is not low, the control unit 21 sets the camera shake detection region 102 ′ having a smaller area than the camera shake detection region 102 ′ illustrated in FIG. Thereby, the control unit 21 functions as a region changing unit that changes the size of the camera shake detection region according to the outside air temperature. Therefore, the imaging apparatus 1 determines the camera shake based on the movement of the subject in the camera shake detection area 102 whose size has been changed. As a result, the smaller the camera shake detection area 102 is, the smaller the number of subjects, so that the frequency of camera shake detection is reduced, and the frequency of camera shake detection is increased by widening the camera shake detection area 102.

  Next, a specific operation procedure in the imaging apparatus 1 for changing the size of the effective pixel region and the camera shake detection region as described above will be described with reference to flowcharts in FIG.

  When the imaging apparatus 1 is activated by operating the power key in the key input unit 28, the initial setting initialization is performed in step S1. This initial setting process is to read out information related to the operation setting of the imaging apparatus 1 stored in a memory (not shown) by the control unit 21. Specifically, setting whether the current shooting mode is continuous shooting composition mode or movie shooting mode, image quality setting, image size setting, white balance setting, best shot setting (shooting scene) presentation order setting, This is an initial set value of an effective pixel area (= trimming area) and a camera shake detection area for camera shake correction.

  In the next step S <b> 2, the control unit 21 displays the current shooting condition setting of the imaging device 1 on the display screen of the display unit 25 using the information regarding the operation setting of the imaging device 1 read in step S <b> 1. At this time, the control unit 21 includes, as the shooting conditions, imaging mode, image quality setting, image size setting, white balance setting, best shot setting (scene setting) representing the current shooting scene, ON / OFF of camera shake correction, and the like. Write the setting screen to the VRAM 23. Then, the VRAM controller 22 displays the setting screen written in the VRAM 23 on the display unit 25 via the digital video encoder 24. Thereby, the user can confirm the state of the imaging device 1 when the imaging device 1 is activated.

  In the next step S3, the measured value of the thermistor 15 is supplied to the control unit 21, and the control unit 21 acquires a temperature value corresponding to the outside air temperature.

  In the next step S4, the camera shake detection area 102 and the effective pixel area 101 are updated and photographed based on the temperature value corresponding to the outside air temperature detected in step S3. In step S4, first, using the temperature value corresponding to the outside air temperature acquired in step S3, the camera shake detection area 102 is updated (step S4a), and the effective pixel area 101 (= trimming area) is updated (step S4b). I do. In step S4, the shutter key of the key input unit 28 is operated in a state where the camera shake detection area and the effective pixel area are updated (step S4c). Then, the imaging device 1 performs a camera shake detection process when the shutter key is operated (step S4d). In the camera shake detection process, the motion vector of the subject included in the camera shake detection area 102 ′ changed based on the outside air temperature in step S <b> 4 a is detected. Thereby, the camera shake direction and the camera shake amount of the imaging apparatus 1 are obtained. As described above, the captured image 100 of the entire imaging area of the CMOS image sensor 13 captured by the CMOS image sensor 13 at the time when the shutter key is operated is read by the DRAM 20 via the color process circuit 17, the DMA controller 18 and the DRAM interface 19. The imaging process stored in is performed.

  As shown in FIG. 5, in the update process of the camera shake detection area 102 performed in step S4a, first, in step S31, the control unit 21 acquires the temperature value measured in step S3. In the next step S32, the control unit 21 determines an optimum camera shake detection region 102 'based on the acquired outside air temperature. That is, the area of the camera shake detection region 102 ′ is increased as the outside air temperature is lower, and the area of the camera shake detection region 102 ′ is reduced as the outside air temperature is higher. In the next step S33, the control unit 21 sets a camera shake detection area and returns the process to step S4b in FIG.

  In such an environment where the outside air temperature is low, the camera shake detection area 102 ′ can be enlarged to detect a larger camera shake. That is, even when the hand holding the imaging device 1 shakes, it is possible to deal with the hand shake caused by the shake. Conversely, the camera shake detection area 102 can be reduced in an environment where the outside air temperature is high, the detection accuracy of the motion vector detected in the camera shake detection area 102 ′ can be improved, and the camera shake can be detected in a short time.

  In the update process of the effective pixel region 101 (= trimming region 103) performed in step S4b, as shown in FIG. 6, first, in step S21, the control unit 21 acquires the temperature value measured in step S3. In the next step S22, the control unit 21 determines an optimum effective pixel region 101 'based on the acquired outside air temperature. That is, the area of the effective pixel region 101 ′ is reduced as the outside air temperature is lower, and the area of the effective pixel region 101 ′ is increased as the outside air temperature is higher. In the next step S23, the control unit 21 sets an effective pixel region and returns the process to step S4c in FIG.

  In such an environment where the outside air temperature is low, the effective pixel area 101 is reduced and the trimming area 103 is increased. Thereby, a larger camera shake can be detected. That is, even when the hand holding the imaging device 1 shakes, it is possible to deal with the hand shake caused by the shake. Conversely, the camera shake detection area 102 ′ is enlarged and the trimming area 103 is reduced in an environment where the outside air temperature is high. Thereby, priority can be given to image quality when the hand holding the imaging device 1 does not shake.

  In the camera shake detection area update process and the effective pixel area update process, it is desirable to further update the effective pixel area 101 not only based on the outside air temperature but also based on the image size initially set in step S1.

  For example, changing the size of the camera shake detection area 102 according to the outside air temperature is a balance between the size of the camera shake that can be detected and the detection speed of the motion vector. When the image size is large, the ratio of the camera shake detection area 102 to the captured image 100 of the entire imaging area of the CMOS image sensor 13 is so high that large camera shake can be detected, and the motion vector detection speed does not slow down. When the image size is small, large camera shake cannot be detected unless the ratio of the camera shake detection area 102 to the captured image 100 of the entire imaging area of the CMOS image sensor 13 is increased, and the entire image area of the CMOS image sensor 13 is imaged. Even if the ratio of the camera shake detection area 102 to the image 100 is increased, the motion vector detection speed does not decrease so much.

  Further, for example, when the user desires an image quality of a predetermined level or more according to user settings, a limiter value that can realize the desired image quality is set based on the current image size. Then, the imaging device 1 performs control not to set the effective pixel area 101 below the limiter even when the outside air temperature is low. That is, if the effective pixel region 101 is made smaller as the outside air temperature is lower, the resolution of the captured image becomes lower. However, it is possible to perform an imaging condition in which the resolution of the captured image is not further reduced.

  In the next step S5, a process of cutting out the effective pixel area 101 from the trimming area 103 is performed. At this time, the image processing unit 26 shifts the effective pixel region 101 'by the camera shake direction and the camera shake amount detected in step S4d with respect to the effective pixel region 101' changed in step S4b. The shifted captured image of the effective pixel region 101 ′ is cut out from the captured image 100 of the entire imaging region of the CMOS image sensor 13. At this time, the image processing unit 26 extracts the captured image 100 of the entire imaging region of the CMOS image sensor 13 stored in the DRAM 20 in step S4, and cuts out the captured image of the effective pixel region 101 'from the captured image 100.

  In the next step S <b> 6, the image processing unit 26 adjusts the color of the captured image cut out in step S <b> 5 based on the temperature value corresponding to the outside air temperature measured by the thermistor 15. Specifically, the image processing unit 26 suppresses the color of the red component in the captured image when the temperature value measured by the thermistor 15 is equal to or higher than a predetermined temperature.

  In general, the imaging apparatus 1 is provided with an infrared cut filter that blocks infrared light from external light incident by the lens unit 12. Then, due to the characteristics of the infrared cut filter, when the outside air temperature becomes equal to or higher than a predetermined temperature, the red component is transmitted through the lens unit 12 and a captured image includes many red components. On the other hand, the imaging device 1 performs a color adjustment process for suppressing the red component by the image processing unit 26 when the outside air temperature that may not be blocked by the infrared cut filter is reached. Note that the image processing unit 26 may perform processing to suppress the red component color in stages as the outside air temperature increases. In addition, table data describing a correspondence relationship between the outside air temperature and the degree of tint suppression of the red component is prepared in advance, and the image processing unit 26 refers to the table data according to the outside air temperature, and determines the color of the red component. You may enable it to change the taste suppression degree. As a result, the imaging apparatus 1 can suppress the presence of many red components in the captured image due to the high outside air temperature, and can improve the reproducibility of actual colors.

  In the next step S7, the control unit 21 determines whether or not to end the image capturing. If not, the process returns to step S3. If the image capturing is to end, the process proceeds to step S8. .

  In step S8, the control unit 21 determines whether or not the current imaging mode is a continuous shooting synthesis mode in which a plurality of continuous shot images are combined to generate a single still image. If the continuous shooting composition mode is selected, a plurality of captured images stored in the DRAM 20 are synthesized by the image processing unit 26 in step S9.

  In step S <b> 10, the captured image is stored in the memory 27 under the control of the control unit 21. At this time, in the continuous shooting composition mode, the control unit 21 reads out the still image synthesized in step S9 from the image processing unit 26 and stores it in the memory 27. When not in the continuous shooting composition mode, the control unit 21 reads out the captured image stored in the DRAM 20 by the DRAM interface 19 and stores it in the memory 27.

  As described above, the imaging apparatus 1 can adjust the camera shake detection area 102 and the effective pixel area 101 based on the outside air temperature detected by the thermistor 15 and perform camera shake correction to cut out a captured image. Further, the imaging apparatus 1 can adjust the color of a captured image cut out as a result of camera shake correction based on the outside air temperature. Therefore, the imaging apparatus 1 can be used for various purposes such as adjustment of the effective pixel region 101 and the camera shake detection region 102 in the camera shake correction and the color tone adjustment of the outside air temperature.

  The imaging apparatus 1 can also use the outside air temperature detected by the thermistor 15 for controlling the lens unit 12. Here, when the lens unit 12 is made of a material having a high coefficient of thermal expansion such as plastic, shape distortion occurs due to the outside air temperature. On the other hand, in the imaging apparatus 1, the controller 14 changes the driving range of the lens unit 12 or the like according to the change in the diaphragm characteristic based on the shape distortion of the plastic lens. Thereby, the imaging device 1 can obtain a clearer captured image even when the image formed on the CMOS image sensor 13 is affected according to the outside air temperature. As described above, the imaging apparatus 1 uses the outside air temperature for the adjustment of the effective pixel region 101 and the camera shake detection region 102 in the above-described camera shake correction, and the drive control of the lens other than the tint adjustment, thereby providing a better image capturing environment. Can be provided.

  Furthermore, the imaging apparatus 1 can also execute processing as shown in FIG. 7 in parallel with the processing shown in FIGS. The process shown in FIG. 7 is to change the setting state of the imaging apparatus 1 by estimating whether the location where the imaging apparatus 1 exists is indoors or outdoors.

  The process shown in FIG. 7 is started when the shutter key of the key input unit 28 is operated in step S41. When the control unit 21 detects the operation of the shutter key, the captured image captured by the CMOS image sensor 13 at this time is stored in the DRAM 20.

  In the next step S42, the control unit 21 causes the image processing unit 26 to analyze the captured image stored in the DRAM 20 and extract the color temperature. This color temperature represents the hue of light in the environment where the imaging apparatus 1 exists. This color temperature represents the hue of the light by a numerical value (K: Kelvin). When the light around the imaging device 1 is bluish, the color temperature is a high value, and when the light around the imaging device 1 is reddish, the color temperature is a low value. For example, the color temperature is 5500K for daylight sunlight and 3500-3000K for incandescent bulbs.

  In the next step S44, the measured value of the thermistor 15 is supplied to the control unit 21, and the control unit 21 acquires a temperature value corresponding to the outside air temperature.

  In the next step S45, although not shown, the current position of the image pickup apparatus 1 is acquired by a position positioning unit using GPS that measures the position information of the image pickup apparatus 1. The position information of the imaging device 1 is once supplied to the control unit 21.

  In the next step S46, the control unit 21 acquires the current date and time information from a clock function that is normally provided as a function of the imaging apparatus 1.

  In the next step S47, the control unit 21 calculates the indoor / outdoor evaluation value based on the outside air temperature acquired in step S44, the position information acquired in step S45, and the date / time information acquired in step S46. . At this time, the control unit 21 refers to table data storing region information, date / time information, and indoor / outdoor temperatures corresponding to the date / time information, as shown in FIG. This table data is stored in advance in the memory 27 or a storage unit (not shown). Then, the control unit 21 calculates the indoor / outdoor evaluation value based on the degree of divergence between the indoor / outdoor temperature corresponding to the area information and date / time information and the actual outside air temperature.

  In the next step S48, the control unit 21 determines whether the location of the imaging device 1 is indoor or outdoor based on the indoor / outdoor evaluation value calculated in step S47.

  Specifically, for example, in winter such as January, the control unit 21 estimates that the indoor / outdoor evaluation value is a positive value when the temperature is higher than the indoor / outdoor temperature, and when the indoor / outdoor temperature is lower than the indoor / outdoor temperature. The indoor / outdoor evaluation value is negative and is estimated to be outdoor. Although not shown, in summer, such as August, when the temperature is lower than the indoor / outdoor temperature, the indoor / outdoor evaluation value is a negative value, and it is estimated that the room is indoors. The evaluation value is positive and is estimated to be outdoor. As described above, the control unit 21 creates the table data shown in FIG. 8A and calculates the indoor / outdoor evaluation value, and combines the elements such as seasons included in the date / time information into the indoor / outdoor evaluation value. Based on this, it is determined whether the location of the imaging apparatus 1 is indoor or outdoor. Thereby, it is possible to increase the accuracy of determining whether the location of the imaging apparatus 1 is indoor or outdoor.

  In step S47 and step S48, whether the location of the imaging device 1 is indoor or outdoor may be determined based on the color temperature acquired in step S42 in addition to the outside air temperature. Specifically, a relationship between the color temperature as shown in FIG. 8B and the predicted light source state (prediction) around the imaging apparatus 1 is prepared. In step S47, when the color temperature acquired in step S42 is a low value of 4000 or less, a high indoor / outdoor evaluation value (score) for determining that the room is indoors is created. On the other hand, when the color temperature is a high value such as 5500, a low indoor / outdoor evaluation value for determining outdoor is created. Next, an indoor / outdoor evaluation value relating to the outside air temperature is created from the degree of deviation of the outside air temperature from the room outside temperature shown in FIG. For example, in winter, when the outside air temperature is higher than the indoor / outdoor temperature, the room is indoors, and therefore, a high indoor / outside evaluation value is set. . Conversely, in the summer, when the outside air temperature is lower than the indoor / outdoor temperature, the room is indoors, and therefore, a high indoor / outside evaluation value is obtained. And

  As described above, when the color temperature is used in addition to the outside air temperature, the indoor / outdoor evaluation value is increased when the possibility of being indoors is empirically high, and The table data in FIG. 8B is created so as to lower the outside evaluation value, and the indoor / outdoor evaluation value is calculated from the table data in FIG. Accordingly, in step S48, if the indoor / outdoor evaluation value obtained with reference to FIG. 8A and FIG. 8B is high, it is determined that the room is indoor, and FIG. 8A and FIG. 8B. When the indoor / outdoor evaluation value obtained with reference to is low, it is determined as outdoor. Thereby, it is possible to increase the accuracy of determining whether the location of the imaging apparatus 1 is indoor or outdoor.

  In the next step S49 and step S50, the imaging apparatus 1 changes the setting state of the imaging apparatus 1 based on the indoor / outdoor determined in step S48.

  Specifically, in step S49, the imaging apparatus 1 changes the display order of the best shot setting (scene setting) as the setting state of the imaging apparatus 1 based on the indoor / outdoor determined in step S48. Examples of this best shot setting (scene setting) include shooting scenes such as scenery, cooking, greenery, and characters. When it is determined that the room is indoors, the control unit 21 is configured to first present the indoor scene (food, characters) when the setting operation for the best shot setting (scene setting) is performed. On the other hand, when it is determined that the room is outdoor, when the setting operation of the best shot setting (scene setting) is performed, the setting is such that the outdoor shooting scene (landscape, green) is presented first.

  In step S50, the imaging apparatus 1 changes the display order of the white balance setting as the setting state of the imaging apparatus 1 based on the indoor / outdoor determined in step S48. Examples of the white balance setting include differences in light sources such as shade, light bulb, sunlight, and fluorescent light. Then, when it is determined that the room is indoor, the control unit 21 is set to first present the indoor white balance setting (bulb, fluorescent lamp) when the white balance setting setting operation is performed. On the other hand, when it is determined that the room is outdoor, the white balance setting for outdoor use (shade, sunlight) is first presented when the white balance setting operation is performed.

  More specifically, when it is determined that the outdoor temperature is about 10 degrees in winter, the setting is such that “shade” is preferentially displayed as the white balance setting, and the best shot setting (scene Setting) is a setting for preferentially displaying “landscape” or the like. In addition, when it is determined that the room is indoors because the outside air temperature is about 20 degrees in winter, “white bulb” or the like is preferentially displayed as white balance setting, and “best shot setting (scene setting)” is “ “Cooking” is set to be displayed preferentially. In addition, when the outdoor temperature is determined to be about 32 degrees in the summer, the setting is such that “sunlight” is preferentially displayed as the white balance setting, and the best shot setting (scene setting) is set. “Green” etc. will be displayed with priority. Furthermore, when the outdoor temperature is determined to be about 25 degrees in the summer, the setting is such that “fluorescent light” is preferentially displayed as the white balance setting, and the best shot setting (scene setting) Is set to preferentially display “character”.

  With this setting, as shown in FIG. 4, in the initial setting in step S1, the best shot setting (scene setting) and white balance setting set in step S49 and step S50 are set, and priority is given in step S2. The setting to be displayed automatically is displayed.

  Even when the captured image is displayed on the display unit 25 when the imaging apparatus 1 is activated, it is possible to display an image subjected to image processing with the best shot setting and white balance setting set in step S49 and step S50.

  The above-described embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and various modifications can be made depending on the design and the like as long as the technical idea according to the present invention is not deviated from this embodiment. Of course, it is possible to change.

It is a block diagram of an imaging device to which the present invention is applied. It is explanatory drawing of the effective pixel area | region and camera-shake detection area | region changed with the imaging device to which this invention is applied, (a) is before change, (b) is after change. It is explanatory drawing of the effective pixel area | region and camera-shake detection area | region changed with the imaging device to which this invention is applied, (a) is before change, (b) is after change. It is a flowchart which shows the operation | movement procedure of the imaging device to which this invention is applied. It is a flowchart which shows the process sequence of the update process of a camera shake detection area | region in the imaging device to which this invention is applied. It is a flowchart which shows the process sequence of the update process of the effective pixel area | region (= trimming area | region) in the imaging device to which this invention is applied. 6 is a flowchart illustrating a processing procedure of processing for changing the order of presenting the setting state of the imaging device in the imaging device to which the present invention is applied. (A) is a figure which shows the table which estimates whether an imaging device exists indoors and outdoors based on date information, position information, and outside temperature, (b) is an imaging device exists indoors and outdoors based on color temperature It is a figure which shows the table which estimates whether to do.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image pick-up device 11 Motor 12 Lens unit 13 CMOS image sensor 14 Controller 15 Thermistor 16 Conversion processing part 17 Color process circuit 18 DMA controller 19 DRAM interface 20 DRAM
21 Control unit 21 DRAM
22 VRAM controller 23 VRAM
24 Digital Video Encoder 25 Display Unit 26 Image Processing Unit 27 Memory 28 Key Input Unit 29 Audio Processing Unit 30 Strobe Drive Unit 31 Microphone Unit 32 Speaker Unit 33 Strobe Light Emitting Unit 100 Captured Image 101 Effective Pixel Area 102 Camera Shake Detection Area 103 Trimming Area

Claims (22)

An imaging device that acquires a captured image by an imaging element,
Temperature measuring means for measuring a temperature value corresponding to the outside air temperature;
A camera shake correction unit that detects a camera shake of the imaging device and corrects a position of an effective pixel region to be extracted as the captured image in the imaging region of the image sensor according to the detected camera shake;
Area changing means for changing the size of the effective pixel area based on the temperature value measured by the temperature measuring means;
An image pickup apparatus that extracts a picked-up image of an effective pixel region whose size has been changed by the region changing unit and whose position has been corrected by the camera shake correcting unit.   The imaging apparatus according to claim 1, wherein the region changing unit reduces the size of the effective pixel region as the temperature value measured by the temperature measuring unit is lower.   The imaging apparatus according to claim 1, wherein the temperature measuring unit measures a temperature of a lens unit that guides light to the imaging element.   The imaging apparatus according to claim 3, further comprising a lens control unit that controls an operation of the lens unit based on a temperature value of the lens unit measured by the temperature measurement unit.   2. The area changing unit determines the size of the effective pixel area based on a preset image size in addition to the temperature value measured by the temperature measuring unit. Item 5. The imaging device according to any one of Items 4 to 4. An imaging device that acquires a captured image by an imaging element,
Temperature measuring means for measuring a temperature value corresponding to the outside air temperature;
A camera shake detection unit configured to detect a camera shake of the imaging apparatus based on a temporal difference between images included in a camera shake detection area of the captured image;
An imaging apparatus comprising: an area changing unit that changes a size of the camera shake detection area based on a temperature value measured by the temperature measuring unit.   The imaging apparatus according to claim 6, wherein the region changing unit increases the size of the camera shake detection region as the temperature value measured by the temperature measuring unit is lower.   The imaging apparatus according to claim 6, wherein the temperature measurement unit measures a temperature of a lens unit that guides light to the imaging element.   The imaging apparatus according to claim 8, further comprising a lens control unit that controls an operation of the lens unit based on a temperature value of the lens unit measured by the temperature measurement unit.   7. The region change unit determines the size of the camera shake detection region based on a preset image size in addition to the temperature value measured by the temperature measurement unit. The imaging device according to any one of items 9.   7. A camera shake correction unit configured to perform camera shake correction according to a camera shake detected by the camera shake detection unit using an image included in a camera shake detection region whose size is determined by the region changing unit. The imaging device according to claim 10. An imaging device that acquires a captured image by an imaging element,
Temperature measuring means for measuring a temperature value corresponding to the outside air temperature;
An image pickup apparatus comprising: a color adjustment unit that adjusts a color of the captured image based on a temperature value measured by the temperature measurement unit.   The imaging according to claim 12, wherein the color adjustment unit suppresses the color of a red component in the captured image when a temperature value measured by the temperature measurement unit is equal to or higher than a predetermined temperature. apparatus. An imaging device that acquires a captured image by an imaging element,
Temperature measuring means for measuring a temperature value corresponding to the outside air temperature;
Estimating means for estimating whether the imaging device is present indoors or outdoors based on the temperature value measured by the temperature measuring means;
An imaging apparatus comprising: setting means for determining a setting state of the imaging apparatus based on an estimation result estimated by the estimation means. Storage means for storing date and time information and an indoor temperature and an outdoor temperature corresponding to the date and time information;
A date and time acquisition means for acquiring the current date and time,
The estimation means compares the date and time acquired by the date and time acquisition means and the temperature value measured by the temperature measurement means with the date and time, indoor temperature and outdoor temperature stored in the storage means, and the imaging device The image pickup apparatus according to claim 14, wherein the image pickup apparatus estimates whether the image is present indoors or outdoors. The storage means stores area information in association with the indoor temperature and outdoor temperature,
It further comprises position positioning means for measuring the position information of the imaging device,
The estimation unit compares the indoor temperature and the outdoor temperature corresponding to the area information corresponding to the position measurement information measured by the position measurement unit with the temperature value measured by the temperature measurement unit, and the imaging apparatus The imaging apparatus according to claim 14, wherein the imaging apparatus estimates whether the room exists indoors or outdoors.   The estimation unit obtains a color temperature of a captured image acquired by the imaging element in addition to the temperature value measured by the temperature measurement unit, and the imaging device is indoors or outdoors based on the temperature value and the color temperature. The imaging apparatus according to claim 14, wherein it is estimated whether or not the image is present.   The imaging apparatus according to claim 14, wherein the setting unit determines a display order for selecting a white balance setting or a display order for a photographing mode. A program executed by a computer built in an imaging apparatus that includes a temperature measurement unit that measures a temperature value corresponding to the outside air temperature and acquires a captured image by an imaging element,
Processing for detecting camera shake of the imaging device and correcting the position of an effective pixel region to be extracted as the captured image in the imaging region of the imaging device according to the detected camera shake;
Causing the computer to execute a process of changing the size of the effective pixel area based on the temperature value measured by the temperature measuring unit;
A program for an imaging apparatus, which causes the computer to execute processing for extracting a captured image of an effective pixel region whose size has been changed and whose position has been corrected. A program executed by a computer built in an imaging apparatus that includes a temperature measurement unit that measures a temperature value corresponding to the outside air temperature and acquires a captured image by an imaging element,
A process for detecting a camera shake of the imaging device based on a temporal difference between images included in a camera shake detection area of the captured image;
A program for an imaging apparatus, which causes a computer to execute a process of changing the size of the camera shake detection area based on a temperature value measured by the temperature measurement unit. A program executed by a computer built in an imaging apparatus that includes a temperature measurement unit that measures a temperature value corresponding to the outside air temperature and acquires a captured image by an imaging element,
A program for an imaging apparatus, which causes a computer to execute a process of adjusting a color of the captured image based on a temperature value measured by the temperature measuring unit. A program executed by a computer built in an imaging apparatus that includes a temperature measurement unit that measures a temperature value corresponding to the outside air temperature and acquires a captured image by an imaging element,
Based on the temperature value measured by the temperature measuring means, a process for estimating whether the imaging device is present indoors or outdoors,
A program for an imaging apparatus, which causes a computer to execute processing for determining a setting state of the imaging apparatus based on the estimated estimation result.

Images