WO2017033559A1 - Image capture device, image capture method, and program - Google Patents

Image capture device, image capture method, and program Download PDF

Info

Publication number
WO2017033559A1
WO2017033559A1 PCT/JP2016/069015 JP2016069015W WO2017033559A1 WO 2017033559 A1 WO2017033559 A1 WO 2017033559A1 JP 2016069015 W JP2016069015 W JP 2016069015W WO 2017033559 A1 WO2017033559 A1 WO 2017033559A1
Authority
WO
WIPO (PCT)
Prior art keywords
detection
unit
setting information
brightness
detection target
Prior art date
Application number
PCT/JP2016/069015
Other languages
French (fr)
Japanese (ja)
Inventor
山田　康夫
悦也 高見
Original Assignee
株式会社Ｊｖｃケンウッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社Ｊｖｃケンウッド filed Critical 株式会社Ｊｖｃケンウッド
Publication of WO2017033559A1 publication Critical patent/WO2017033559A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
    • G03B7/08—Control effected solely on the basis of the response, to the intensity of the light received by the camera, of a built-in light-sensitive device
    • G03B7/091—Digital circuits
    • G03B7/093—Digital circuits for control of exposure time
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
    • G03B7/08—Control effected solely on the basis of the response, to the intensity of the light received by the camera, of a built-in light-sensitive device
    • G03B7/091—Digital circuits
    • G03B7/095—Digital circuits for control of aperture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene

Definitions

  • the present invention relates to a photographing apparatus, a photographing method, and a program.
  • Patent Document 1 discloses a technique for performing exposure control using preset brightness of a plurality of areas for exposure control.
  • Patent Document 2 discloses a technique for changing the size of an exposure area used for exposure detection in a captured image based on the traveling speed of a vehicle.
  • the mounting position of a photographing unit such as a camera differs depending on the type of mobile object to be mounted, the user's request, and the like.
  • the photographed images to be photographed differ depending on the installation position and the installation method of the photographing unit. For this reason, when exposure control is performed using luminance or pixel values detected in a predetermined area, there are cases where optimal exposure control cannot be performed.
  • the present invention has been made in view of the above, and has as its main object to provide a photographing apparatus, a photographing method, and a program capable of optimal exposure control.
  • the imaging apparatus of the present invention includes an acquisition unit, a setting unit, a brightness calculation unit, a change amount calculation unit, an update unit, and an exposure control unit.
  • the acquisition unit acquires a captured image.
  • the setting unit sets a detection target area including a plurality of detection areas in the captured image based on the setting information.
  • the brightness calculation unit calculates the brightness of each of a plurality of detection areas included in the detection target area in the captured image.
  • the change amount calculation unit calculates a change amount with respect to the previously calculated brightness for each of the plurality of detection regions.
  • the update unit updates the setting information based on the amount of change in each of the plurality of detection areas.
  • the exposure control unit performs exposure control at the time of photographing by the photographing unit based on the brightness of the detection target region set based on the updated setting information in the photographed image.
  • the imaging method of the present invention includes a step of obtaining a captured image, a step of setting a detection target region including a plurality of detection regions in the captured image based on setting information, and the detection in the captured image. Calculating the brightness of each of the plurality of detection areas included in the target area, calculating the amount of change with respect to the previously calculated brightness for each of the plurality of detection areas, and each of the plurality of detection areas. The step of updating the setting information based on the amount of change, and the exposure control at the time of photographing by the photographing unit based on the brightness of the detection target area set based on the updated setting information in the photographed image Performing the steps.
  • the program of the present invention includes a step of acquiring a captured image, a step of setting a detection target region including a plurality of detection regions in the captured image based on setting information, and the detection target in the captured image. Calculating the brightness of each of the plurality of detection areas included in the area; calculating the amount of change with respect to the previously calculated brightness for each of the plurality of detection areas; and the change of each of the plurality of detection areas A step of updating the setting information based on the amount, and exposure control at the time of photographing by the photographing unit based on the brightness of the detection target region set based on the updated setting information in the photographed image.
  • FIG. 1 is a configuration diagram schematically showing the photographing apparatus of the present embodiment.
  • FIG. 2 is a functional block diagram of the control unit.
  • FIG. 3 is an explanatory diagram of an example of the detection target area.
  • FIG. 4A is an explanatory diagram illustrating an example of setting a detection target region.
  • FIG. 4B is an explanatory diagram illustrating an example of setting a detection target region.
  • FIG. 4C is an explanatory diagram illustrating an example of setting a detection target region.
  • FIG. 4D is an explanatory diagram illustrating an example of setting a detection target region.
  • FIG. 5A is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5B is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5A is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5C is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5D is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5E is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5F is an explanatory diagram of setting information update and detection target region setting.
  • FIG. 5G is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5H is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5I is an explanatory diagram of setting information update and detection target region setting.
  • FIG. 6 is a flowchart illustrating an example of the procedure of the photographing process.
  • the imaging device in the present embodiment continuously captures a plurality of captured images.
  • the imaging device of the present embodiment is applied to an in-vehicle camera mounted on a moving body such as a vehicle, a monitoring camera installed in a building such as a building, and the like.
  • FIG. 1 is a configuration diagram schematically showing a photographing apparatus 10 of the present embodiment.
  • the photographing apparatus 10 includes a photographing unit 12, an analog signal processing unit 14, an A / D (analog / digital) conversion unit 16, an image processing unit 18, a compression / decompression processing unit 20, and a ROM (Read Only Memory). 22, EEPROM (Electrically Erasable Programmable Read-Only Memory) 24, DRAM (Dynamic Random Access Memory) 26, card I / F 28, input / output I / F 30, and control unit 42.
  • EEPROM Electrically Erasable Programmable Read-Only Memory
  • DRAM Dynamic Random Access Memory
  • the photographing apparatus 10 has an automatic exposure (AE) function that automatically determines the exposure at the time of photographing.
  • AE automatic exposure
  • the photographing unit 12 obtains a photographed image by photographing.
  • the photographing unit 12 obtains a plurality of continuous photographed images by photographing.
  • the imaging unit 12 includes a lens group 12A, an image sensor 12C, and a shutter 12B disposed between the lens group 12A and the image sensor 12C.
  • the lens group 12A is, for example, a plurality of lenses including an objective lens and a zoom lens, and a focusing lens group.
  • the image sensor 12C has a configuration in which a plurality of CCDs (Charge-Coupled Devices) are arranged along the light receiving surface.
  • the image sensor 12C may be a CMOS (Complementary Metal Oxide Semiconductor) image sensor instead of the CCD. Since the CMOS image sensor often includes the analog signal processing unit 14 and the A / D conversion unit 16 in the element, the image sensor 12C outputs digital data of the captured image to the image processing unit 18.
  • CMOS Complementary Metal Oxide Semiconductor
  • Reflected light from the subject reaches the image sensor 12C via the lens group 12A and the shutter 12B.
  • Each CCD of the image sensor 12C outputs a signal corresponding to the received light.
  • the image sensor 12C outputs analog data of the captured image to the analog signal processing unit 14.
  • the analog signal processing unit 14 performs signal processing such as automatic gain adjustment (AGC) and correlated double sampling processing on the analog data received from the image sensor 12C, and outputs the result to the A / D conversion unit 16 To do.
  • the A / D converter 16 converts the analog data received from the analog signal processor 14 into digital data. Then, the A / D conversion unit 16 outputs the captured image of the digital data to the image processing unit 18.
  • the image processing unit 18 performs complement processing, white balance correction, RGB / YC conversion processing, and the like on the captured image received from the A / D conversion unit 16.
  • the compression / decompression processing unit 20 compresses or expands the captured image processed by the image processing unit 18.
  • the image processing unit 18, compression / decompression processing unit 20, ROM 22, EEPROM 24, DRAM 26, card I / F 28, input / output I / F 30, and control unit 42 are connected via a bus 44 so that data and signals can be exchanged. .
  • the ROM 22 and the EEPROM 24 store in advance a program for executing each process performed by the photographing apparatus 10.
  • the DRAM 26 stores a photographed image photographed by the photographing unit 12 and processed by the analog signal processing unit 14, the A / D conversion unit 16, the image processing unit 18, the compression / decompression processing unit 20, and the like.
  • the DRAM 26 may function as a temporary storage unit that temporarily stores captured images.
  • the captured image is stored in the card type recording medium 32 connected via the card I / F 28.
  • the card I / F 28 is an interface for inputting / outputting data and signals to / from the card type recording medium 32.
  • the card-type recording medium 32 is connected to the control unit 42 via the card I / F 28 so as to be able to exchange data and signals.
  • the input / output I / F 30 is a communication interface for inputting / outputting data and signals to / from the display unit 34, the audio output unit 36, the operation unit 38, the input / output terminal 40, and the like.
  • the display unit 34, the audio output unit 36, the operation unit 38, and the input / output terminal 40 are connected to the control unit 42 via the input / output I / F 30 so as to be able to exchange data and signals.
  • the display unit 34 displays various images such as photographed images.
  • the display unit 34 is, for example, an LCD (Liquid Crystal Display) and may include a touch panel.
  • the audio output unit 36 outputs audio.
  • the audio output unit 36 is, for example, a speaker.
  • the operation unit 38 receives various operation instructions from the user.
  • the operation unit 38 is, for example, an instruction button or a touch panel.
  • the input / output terminal 40 is a terminal for connecting an external device and the input / output I / F 30 so as to be able to exchange data and signals.
  • the control unit 42 controls the photographing apparatus 10.
  • the control unit 42 is configured by a CPU (Central Processing Unit).
  • the control unit 42 may be realized by a circuit other than the CPU.
  • FIG. 2 is a functional block diagram of the control unit 42.
  • the control unit 42 includes an acquisition unit 42A, a determination unit 42B, a setting unit 42C, a lightness calculation unit 42D, a change amount calculation unit 42E, a weight calculation unit 42F, an exposure control unit 42G, and an update unit 42H. .
  • a part or all of the acquisition unit 42A, the determination unit 42B, the setting unit 42C, the lightness calculation unit 42D, the change amount calculation unit 42E, the weight calculation unit 42F, the exposure control unit 42G, and the update unit 42H is, for example, a CPU
  • the program may be executed by a processing device such as software, that is, may be realized by software, may be realized by hardware such as an IC (Integrated Circuit), or may be realized by using software and hardware together. Also good.
  • a program for executing various processes executed in the present embodiment has a module configuration including these units.
  • the CPU reads from the ROM 22 or the EEPROM 24 data for executing various processes executed in the present embodiment and data including setting data.
  • the above-described units are loaded onto the DRAM 26 and generated on the DRAM 26.
  • the control unit 42 is electrically connected to the storage unit 46 and each unit described with reference to FIG.
  • the storage unit 46 is a storage medium that stores various data. Specifically, the storage unit 46 is the EEPROM 24, the DRAM 26, and the card type recording medium 32 shown in FIG.
  • the acquisition unit 42A acquires a captured image.
  • the acquisition unit 42A acquires the acquired captured image from the imaging unit 12 every time the imaging unit 12 acquires the captured image. Specifically, the acquiring unit 42A acquires from the DRAM 26 a captured image that has been captured by the capturing unit 12 and processed by the analog signal processing unit 14, the A / D conversion unit 16, the image processing unit 18, and the like.
  • the determination unit 42B determines whether the shooting time of the captured image acquired by the acquisition unit 42A is daytime or nighttime.
  • the determination unit 42B may determine whether the shooting time of the captured image is daytime or night by a known method. For example, the determination unit 42B determines whether the shooting time of the captured image is daytime or night using a known determination technique for determining a shooting scene.
  • the setting unit 42C, lightness calculation unit 42D, change amount calculation unit 42E, weight calculation unit 42F, and update unit 42H are determined to be daytime by the determination unit 42B and determined to be nighttime. In each case, the processing described later is executed.
  • the setting unit 42C sets the detection target area in the captured image acquired by the acquisition unit 42A.
  • FIG. 3 is an explanatory diagram of an example of the detection target area 50.
  • the detection target area 50 is a brightness detection target area used for exposure control in a captured image.
  • FIG. 3 shows a case where the detection target area 50 is a partial area in the captured image 54.
  • the detection target area 50 includes a plurality of detection areas 52.
  • the detection target region 50 is illustrated as an example in which a plurality of detection regions 52, specifically, the detection regions 52 1 to 52 16 are arranged in a grid pattern.
  • the size of each detection region 52 may be a size including at least one pixel.
  • the size of the detection area 52 may be a size including at least one CCD in the image sensor 12C.
  • the size of the detection region 52 is a size including a plurality of pixels will be described.
  • the setting unit 42C sets the detection target area 50 in the captured image acquired by the imaging unit 12 based on the setting information.
  • the setting information includes at least one of the position of the detection target region 50 in the captured image, the size of the detection target region 50, and the number of detection regions 52 included in the detection target region 50.
  • the setting information includes the position of the detection target region 50, the size of the detection target region 50, and the number of detection regions 52 included in the detection target region 50.
  • the setting information includes the center position of the captured image 54, the size illustrated in FIG. 3, and the number of detection areas 52, specifically, 16 as an example.
  • the setting information is updated by an update unit 42H described later (details will be described later).
  • the EEPROM 24 stores in advance an initial value of setting information of the detection target area 50 (hereinafter referred to as initial setting information).
  • the initial setting information of the detection target area 50 is set in advance, for example, before shipment when the photographing apparatus 10 is manufactured, and is stored in the EEPROM 24 in advance.
  • the setting unit 42C sets the detection target area 50 in the captured image acquired by the acquisition unit 42A based on the setting information.
  • Setting the detection target area 50 means that the detection target areas 50 having the size indicated by the setting information including the number of detection areas 52 indicated by the setting information are arranged at positions indicated by the setting information on the captured image. It means to do.
  • FIG. 4A is an explanatory diagram illustrating an example of setting of the detection target region 50 by the setting unit 42C.
  • FIG. 4B is an explanatory diagram illustrating an example of setting a detection target region.
  • FIG. 4C is an explanatory diagram illustrating an example of setting a detection target region.
  • FIG. 4D is an explanatory diagram illustrating an example of setting a detection target region.
  • FIG. 4A is an example of the captured image 60 acquired by the acquisition unit 42A.
  • the case where the captured image 60 includes a dark region 60A such as a tunnel is illustrated as an example.
  • FIG. 4B is a schematic diagram illustrating an example of the detection target region 50.
  • the detection target area 50 shown in FIG. 4B is the same as the detection target area 50 shown in FIG.
  • the setting unit 42C arranges the detection target region 50 having the size indicated by the setting information at the position indicated by the setting information on the captured image 60 (see FIG. 4A) (see FIG. 4C). At this time, the setting unit 42C arranges the detection target areas 50 including the number of detection areas 52 indicated by the setting information on the captured image 60 (see FIG. 4C). Thereby, the setting unit 42C sets the detection target region 50 in the captured image 60 (see FIG. 4C).
  • the lightness calculation unit 42D calculates the lightness of each of the plurality of detection regions 52 included in the detection target region 50 in the captured image 60 acquired by the acquisition unit 42A.
  • the brightness calculation unit 42D calculates the average value of the brightness of one or more pixels (CCD) included in the detection area 52 as the brightness of the detection area 52 for each of the detection areas 52 in the captured image 60.
  • the brightness of each pixel may be read from the pixel value of each pixel (CCD).
  • the brightness calculation unit 42D stores the calculated brightness of each detection region 52 in the storage unit 46 in association with the identification information of each detection region 52.
  • the identification information of the detection area 52 the pixel position of the detection area 52 on the captured image 60 is used. Therefore, the brightness calculation unit 42D stores the calculated brightness of each detection region 52 in the storage unit 46 in association with the pixel position on the captured image 60.
  • the change amount calculation unit 42E calculates the change amount with respect to the previously calculated lightness for each of the plurality of detection regions 52.
  • the previously calculated brightness indicates the brightness calculated for each of the plurality of detection areas 52 included in the detection target area 50 in the detection target area 50 set on the photographed image 60 last time.
  • the detection target area 50 previously set on the photographed image 60 is the detection target area 50 set on the photographed image 60 based on the setting information immediately before the latest update by the update unit 42H described later, that is, immediately before the update. It is.
  • the amount-of-change calculating unit 42E calculates the brightness of the detection region 52 previously calculated from the detection target region 50 previously set by the setting unit 42C and the detection region 52 calculated this time from the detection target region 50 set by the setting unit 42C this time.
  • the amount of change is calculated by calculating the difference between the brightness and the brightness.
  • the change amount calculation unit 42E calculates the change amount of each of the plurality of detection regions 52, in other words, the change amount of lightness, using the equation (1).
  • Y (i) (n ⁇ 1) represents the brightness of the detection area 52 calculated last time from the detection target area 50 previously set by the setting unit 42C.
  • Y (i) (n) indicates the brightness of the detection region 52 calculated this time from the detection target region 50 set by the setting unit 42C this time.
  • Y ′ (i) (n) represents the amount of change in lightness of the detection region 52 included in the detection target region 50 set by the setting unit 42C this time.
  • i indicates identification information of the detection region 52.
  • the change amount calculation unit 42E calculates the brightness of the detection area 52 calculated this time from the detection target area 50 set this time and the brightness of the detection area 52 calculated last time from the detection target area 50 set last time. Are calculated for each same pixel position, and the difference is calculated to calculate the amount of change.
  • the change amount calculation unit 42E is configured to detect a detection region 52 in which the detection region 52 at the same pixel position does not exist in the previously set detection target region 50 among the plurality of detection regions 52 of the detection target region 50 set this time. The calculation of the difference from the predetermined value or the change amount determined in advance may be used.
  • the change amount calculation unit 42E stores the change amount calculated for each of the plurality of detection regions 52 in the storage unit 46 in association with the corresponding pixel position in the captured image 60.
  • the update unit 42H updates the setting information based on the amount of change in lightness of each of the plurality of detection areas 52 calculated by the change amount calculation unit 42E.
  • the update unit 42H updates the setting information so as to change the position (see FIG. 4C) of the detection target region 50 set last time. For this reason, the setting unit 42C sets a new detection target area 50B at a position where the previously set detection target area 50A is shifted according to the updated installation information (see FIG. 4D). For this reason, the position of the region used for exposure control in the captured image 60 is changed according to the amount of change in brightness of each of the plurality of detection regions 52.
  • the updating unit 42H sets, for each of the plurality of detection regions 52 included in the detection target region 50 set this time, the average value of the change amount calculated last time and the change amount calculated this time, to the plurality of detection regions 52. It is preferable to update the setting information by using it as the amount of change in the brightness of each.
  • the updating unit 42H may further calculate a change amount ratio for each of the plurality of detection regions 52.
  • the change amount ratio is the ratio of the change amount of each of the plurality of detection regions 52 to the lowest change amount of the change amounts calculated this time for each of the plurality of detection regions 52.
  • the updating unit 42H calculates a change amount ratio of each of the plurality of detection regions 52 using the equation (2).
  • Y ′ (i) indicates the amount of change in the detection area 52 calculated by the setting unit 42C this time, in other words, the amount of change in brightness.
  • Y'low indicates the lowest value of the amount of change in the detection area 52 calculated by the setting unit 42C this time.
  • Y ′ (i) ratio indicates the change ratio of the brightness of the detection area 52 included in the detection target area 50 set by the setting unit 42C this time.
  • i indicates identification information of the detection region 52.
  • the update unit 42H updates the setting information based on the change amount ratio of each of the plurality of detection regions 52.
  • FIG. 5A is an explanatory diagram of setting information updating by the updating unit 42H and setting of the detection target area 50 by the setting unit 42C.
  • FIG. 5B is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5C is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5D is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5E is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5F is an explanatory diagram of setting information update and detection target region setting.
  • FIG. 5G is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5H is an explanatory diagram of setting information update and detection target area setting.
  • FIG. 5I is an explanatory diagram of setting information update and detection target region setting.
  • the acquisition unit 42A has acquired the captured image 60 illustrated in FIG.
  • the setting unit 42C sets the detection target region 50A at the center position of the captured image 60 based on the setting information (see FIG. 5A).
  • the brightness calculation unit 42D calculates the brightness for each of the plurality of detection areas 52, specifically, the detection areas 52 1 to 52 16 (see FIG. 5B).
  • the numbers shown in each detection region 52 are values obtained by replacing an example of lightness with an easily understandable numerical value for easy explanation.
  • the brightness for each pixel is often expressed by 12-bit data, and the brightness for each pixel is expressed in the range of 0 to 4095.
  • the change amount calculation unit 42E calculates the amount of change in brightness for each of the plurality of detection regions 52, specifically, the detection regions 52 1 to 52 16 (see FIG. 5C).
  • the numbers shown in the plurality of detection areas 52, specifically, the detection areas 52 1 to 52 16 are also examples of the amount of change in brightness in order to facilitate the explanation as in FIG. 5B.
  • the values are replaced with easy-to-understand numbers.
  • the lightness for each pixel is often represented by 12-bit data, and the change amount of the lightness for each pixel is represented by the change amount ratio, and the minimum value of the change amount ratio is 1. For this reason, the ratio of the change in brightness is expressed in the range of 1 to 4095.
  • 5D to 5F are diagrams illustrating an example of the detection target area 50 after being updated, which is indicated by the setting information updated by the updating unit 42H.
  • the update unit 42H updates the setting information so as to indicate, as a new detection target region 50, a region including at least the detection region 52 having a change amount ratio equal to or greater than a predetermined threshold among the plurality of detection regions 52.
  • a predetermined value may be stored in advance in the storage unit 46, or may be dynamically generated according to the amount of change in each of the plurality of detection regions 52.
  • the updating unit 42H may use the average value of the change amount ratios of the plurality of detection regions 52 as the threshold value.
  • the update unit 42H includes a plurality of detection areas 52, specifically, detection areas 52 having a change amount ratio equal to or greater than the threshold value “0.3” among the detection areas 52 1 to 52 16 , specifically, In FIG. 5C, the detection area 52 2 , the detection area 52 3 , the detection area 52 6 , and the detection area 52 7 are specified (see the area P). Then, the update unit 42H updates the setting information so that the area including the identified detection area 52 is indicated as a new detection target area 50.
  • the update unit 42H updates the setting information so as to indicate an area arranged around the specified detection area 52 as a new detection target area 50. Specifically, as shown in FIG. 5D, the position of the detection target region 50A set last time is moved in the direction of the arrow X so that the region P by the detection region 52 whose change amount ratio is equal to or greater than the threshold is located at the center. . Then, the control unit 42H updates the setting information so as to indicate the new detection target area 50B after the movement.
  • the setting unit 42C sets the detection target region 50B in the captured image 60 using the updated setting information (see FIG. 5G).
  • the updating unit 42H may update the setting information so as to indicate a region obtained by reducing the previously set detection target region 50 as a new detection target region 50. Specifically, the update unit 42H reduces the previously set detection target region 50A to a region P composed of detection regions 52 whose change amount ratio is equal to or greater than a threshold value. Then, the update unit 42H updates the setting information so that the reduced area P is indicated as a new detection target area 50C (see FIG. 5E).
  • the setting unit 42C sets the detection target region 50C in the captured image 60 using the updated setting information (see FIG. 5H).
  • the updating unit 42H may update the setting information by changing the number of detection areas 52 indicated in the setting information before updating.
  • the update unit 42H excludes the detection region 52 in which the change amount ratio is less than the threshold in the detection target region 50A set last time. Then, the updating unit 42H replaces the detection area 52 with the change amount ratio equal to or greater than the threshold in the detection target area 50A set last time, specifically, the area P including the four detection areas 52 in FIG. As shown, the setting information may be updated (see FIG. 5F).
  • the setting unit 42C sets the detection target region 50D in the captured image 60 using the updated setting information (see FIG. 5I).
  • the updating unit 42H may update the setting information using the change amount instead of the change amount ratio. That is, the update unit 42H may update the setting information so that a region including at least the detection region 52 in which the change amount of each of the plurality of detection regions 52 is equal to or greater than the threshold is indicated as a new detection target region 50. In this case, the update unit 42H may update the setting information in the same manner as when the change amount ratio is used except that the detection region 52 whose change amount is greater than or equal to the threshold value is specified from among the plurality of detection regions 52.
  • the weight calculation unit 42 ⁇ / b> F calculates a weighting value corresponding to the amount of change in each of the plurality of detection regions 52 for each of the plurality of detection regions 52.
  • the weight calculation unit 42F uses the change amount ratio calculated by the change amount calculation unit 42E for each of the detection regions 52 as a weighting value.
  • the weight calculation unit 42F may use a value obtained by multiplying the change amount ratio by a predetermined coefficient as a weighting value. By adjusting this coefficient, the influence exerted by the weighting value can be adjusted.
  • the exposure control unit 42G performs exposure control during photographing by the photographing unit 12 based on the brightness of the detection target region 50 in the photographed image 60.
  • the exposure control unit 42G uses the average value of the brightness of each detection area 52 included in the detection target area 50 set in the captured image 60 as the brightness of the detection target area 50.
  • the exposure control unit 42G preferably calculates a weighted brightness obtained by adding a corresponding weighting value to the brightness of each of the detection regions 52 included in the detection target region 50 in the captured image 60 on the captured image 60.
  • the exposure control unit 42 ⁇ / b> G preferably uses the average value of the weighted brightness of each of the plurality of detection areas 52 included in the detection target area 50 as the brightness of the detection target area 50.
  • the exposure control unit 42G calculates an exposure control value for performing exposure control based on the brightness of the detection target region 50.
  • the exposure control value is an adjustment value for adjusting at least one of the shutter speed of the shutter 12B, the aperture (F value), the setting value of the ND (Neutral Density) filter, and the gain.
  • the exposure control unit 42G may calculate the exposure control value using a known method.
  • the exposure control unit 42G controls the photographing unit 12 using the calculated exposure control value. Exposure control is performed by controlling the photographing unit 12 using the exposure control value. A known method may be used as the exposure control method.
  • the exposure control unit 42G may perform exposure control based on the brightness of the detection target region 50 set based on the updated setting information.
  • FIG. 6 is a flowchart illustrating an example of a procedure of imaging processing executed by the imaging device 10.
  • the control unit 42 of the imaging apparatus 10 executes the imaging process shown in FIG. 6 every time the imaging unit 12 acquires a new captured image 60.
  • the acquisition unit 42A acquires a captured image from the imaging unit 12 (step S100).
  • the determination unit 42B determines whether or not it is the first determination (step S102).
  • the first determination refers to a determination process of the photographing time that is performed first after the photographing apparatus 10 is shipped.
  • step S102 If it is determined that the first photographing process (step S102: Yes), the process proceeds to step S104.
  • step S104 the determination unit 42B determines whether the shooting time of the captured image 60 acquired in step S100 is daytime or nighttime (step S104). Then, the determination unit 42 ⁇ / b> B stores the determination result in the storage unit 46 in association with the identification information of the captured image 60.
  • the setting unit 42C reads the initial setting information (step S106).
  • the storage unit 46 stores in advance initial setting information corresponding to each of the case where the shooting time is daytime and the case where the shooting time is nighttime.
  • the setting unit 42C reads from the storage unit 46 the initial setting information corresponding to the shooting time determined in step S104, which is day or night in the present embodiment, from the storage unit 46. Thereby, the setting unit 42C reads the initial setting information.
  • the setting unit 42C sets the detection target region 50 in the captured image 60 acquired in step S100 based on the initial setting information read in step S106 (step S108).
  • the brightness calculation unit 42D calculates the brightness of each of the plurality of detection areas 52 included in the detection target area 50 set in step S108 in the captured image 60 acquired in step S100 (step S110).
  • the brightness calculation unit 42D associates the calculated brightness of each detection area 52 with each identification information of the detection area 52, in this embodiment, the pixel position, and the determination result of step S104. It memorize
  • the change amount calculation unit 42E calculates the change amount with respect to the previously calculated brightness of each of the plurality of detection regions 52 included in the detection target region 50 set in step S108 in the captured image 60 acquired in step S100. (Step S114).
  • the storage unit 46 stores the reference brightness of each detection area 52 in advance.
  • the change amount calculation unit 42E calculates the difference between the lightness calculated in step S110 and the reference lightness for each of the plurality of detection regions 52. Thereby, the change amount calculation unit 42E calculates the change amount of each of the plurality of detection regions 52.
  • the change amount calculation unit 42E associates each calculated change amount of the detection region 52 with each identification information of the detection region 52, in this embodiment, the pixel position and the determination result of step S104. And stored in the storage unit 46 (step S116).
  • the weight calculation unit 42F reads the initial value of each weighted value in the detection area 52 from the storage unit 46 (step S118).
  • the storage unit 46 stores in advance the initial value of each weighting value of the detection area 52.
  • the weight calculation unit 42F may perform the process of step S118 by reading the initial value of the weighting value from the storage unit 46.
  • the exposure control unit 42G calculates the weighted lightness of each of the plurality of detection regions 52 (step S120). For each of the plurality of detection regions 52, the exposure control unit 42G multiplies the brightness of each detection region 52 calculated in step S110 by the initial value of the weighting value read in step S118. Then, the exposure control unit 42G calculates the multiplication result as the weighted brightness of each of the plurality of detection regions 52.
  • the exposure control unit 42G calculates the brightness of the detection target region 50 set on the captured image 60 in step S108 (step S122). In step S122, the exposure control unit 42G calculates the average value of the weighted brightness values of each of the plurality of detection areas 52 calculated in step S120 as the brightness value of the detection target area 50.
  • the exposure control unit 42G calculates an exposure control value based on the brightness of the detection target region 50 calculated in step S122 (step S124). Then, the exposure control unit 42G performs exposure control by controlling the photographing unit 12 using the exposure control value calculated in step S124 (step S126). For this reason, a photographed image with exposure control based on the exposure control value photographed in step S122 is obtained.
  • control unit 42 determines whether or not to end the photographing process (step S128).
  • the control unit 42 makes an affirmative determination in step S128 when an instruction signal indicating the end of shooting or a signal indicating power OFF is received by an operation instruction of the operation unit 38 by the user (step S128: Yes). If an affirmative determination is made in step S128 (step S128: Yes), this routine ends. If a negative determination is made in step S128 (step S128: No), the process returns to step S100.
  • control unit 42 performs the processing from step S104 to step S128 for each of the case where the determination result of the photographing time is noon and the case after night after the photographing unit 12 is shipped.
  • step S102 determines whether a negative determination is made in step S102 (step S120: No). If a negative determination is made in step S102 (step S120: No), the process proceeds to step S130.
  • step S130 the determination unit 42B determines whether the shooting time of the captured image 60 acquired in step S100 is daytime or nighttime (step S130). Then, the determination unit 42 ⁇ / b> B stores the determination result in the storage unit 46 in association with the identification information of the captured image 60.
  • the update unit 42H uses the previously set detection target region 50 to read the lightness change amount of each detection region 52 calculated from the storage unit 46 (step S132).
  • the update unit 42H reads, for each detection region 52, the lightness change amount calculated by the lightness calculation unit 42D last time corresponding to the determination result of step S130, which is day or night in the present embodiment (step S132).
  • the update unit 42H calculates the change amount ratio of each of the detection regions 52 using the change amount read in step S132 (step S134).
  • the update unit 42H updates the setting information based on the change amount ratio of each of the plurality of detection areas 52 (step S136).
  • the updating unit 42H calculates new setting information using the change amount ratio calculated in step S134. Then, the update unit 42H overwrites and stores the newly calculated setting information over the setting information stored in the storage unit 46 or the initial setting information. At this time, the update unit 42H newly sets the setting information stored in the storage unit 46 in the setting information corresponding to the determination result of the immediately preceding step S130, in the present embodiment, the same determination result as day or night. Overwrite and store information.
  • the updating unit 42H updates the setting information.
  • the update unit 42H updates the setting information every day or night in the present embodiment, which is the result of the shooting time determination by the determination unit 42B.
  • the setting unit 42C reads the setting information from the storage unit 46 (step S138). That is, the setting unit 42C reads the setting information updated by the update unit 42H by the process of step S136.
  • the setting unit 42C sets the detection target region 50 in the captured image 60 acquired in step S100 based on the setting information read in step S138 (step S140).
  • the setting unit 42C obtains a new detection target region 50 based on the setting information different from the detection target region 50 set based on the setting information before the update in the step S100. Set to 60.
  • the brightness calculation unit 42D calculates the brightness of each of the plurality of detection areas 52 included in the detection target area 50 set in step S140 in the captured image 60 acquired in step S100 (step S142).
  • the brightness calculation unit 42D associates the calculated brightness of each detection region 52 with each identification information of the detection region 52 (in the present embodiment, the pixel position and the determination result of step S130). And stored in the storage unit 46 (step S144).
  • the change amount calculation unit 42E calculates the change amount with respect to the previously calculated brightness of each of the plurality of detection regions 52 included in the detection target region 50 set in step S140 in the captured image 60 acquired in step S100. (Step S146).
  • step S146 the change amount calculation unit 42E calculates the change amount for each lightness of the detection region 52, which was calculated last time, corresponding to the determination result of the previous step S130, which is the same determination result as day or night in this embodiment. calculate.
  • the change amount calculation unit 42E associates the calculated change amounts of the detection regions 52 with the respective pieces of identification information of the detection regions 52 in the present embodiment and the determination results of step S130. Then, it is stored in the storage unit 46 (step S148).
  • the weight calculation unit 42F calculates each weighting value of the detection area 52 (step S150). For example, the weight calculation unit 42F controls the change amount calculation unit 42E so as to calculate the lightness change amount ratio of each of the plurality of detection regions 52 using the change amount calculated in step S146.
  • the change amount calculator 42E may calculate the lightness change amount ratio of each of the plurality of detection regions 52 in the same manner as described above. Then, the weight calculation unit 42F may use the brightness change amount ratio of each of the plurality of detection regions 52 as the weighting value of each of the plurality of detection regions 52.
  • the exposure control unit 42G calculates the weighted brightness of each of the plurality of detection areas 52 (step S152). For each of the plurality of detection regions 52, the exposure control unit 42G multiplies the brightness of each detection region 52 calculated in step S142 by the corresponding weight value calculated in step S152. Then, the exposure control unit 42G calculates the multiplication result as the weighted brightness of each of the plurality of detection regions 52.
  • the exposure control unit 42G calculates the brightness of the detection target region 50 set in step S140 (step S154). In step S154, the exposure control unit 42G calculates the average value of the weighted brightness of each of the plurality of detection areas 52 calculated in step S152 as the brightness of the detection target area 50.
  • the exposure control unit 42G calculates an exposure control value based on the lightness of the detection target region 50 calculated in step S154 (step S156). Then, the exposure control unit 42G performs exposure control by controlling the photographing unit 12 using the exposure control value calculated in step S156 (step S158). For this reason, a photographed image with exposure control based on the exposure control value photographed in step S156 is obtained. In addition, as a result of the determination of the shooting time by the determination unit 42B, in the present embodiment, a captured image is obtained in which exposure control is performed according to day or night.
  • control unit 42 determines whether or not to end the photographing process (step S160).
  • control unit 42 determines whether or not a predetermined time has elapsed from the determination processing in step S130. If it is determined that the predetermined time has elapsed, a negative determination is made in step S160 (step S160: No), and the process proceeds to step S100. Return.
  • This predetermined time may be set in advance. This predetermined time is, for example, a time during which a predetermined number of captured images are acquired.
  • control unit 42 may determine whether or not the shooting environment of the shooting apparatus 10 has changed, and if it is determined that the shooting environment has changed, a negative determination may be made in step S160 (step S160: No).
  • the change in the shooting environment is, for example, a change from a shooting environment having a predetermined brightness or higher to a shooting environment having a brightness lower than the predetermined brightness, or a change from a shooting environment having a predetermined brightness or lower to a shooting environment having the predetermined brightness or higher. is there.
  • a known method may be used to determine the shooting environment.
  • control unit 42 determines whether or not an instruction signal indicating the end of photographing or an off signal indicating power OFF is received based on an operation instruction of the operation unit 38 by the user, and the determination of step S160 is performed. Also good. And control part 42 may make affirmation judging (Step S160: Yes) at Step S160, when these directions signals and an off signal are received.
  • step S160 If an affirmative determination is made in step S160 (step S160: Yes), this routine ends.
  • the imaging apparatus 10 of the present embodiment includes the acquisition unit 42A, the setting unit 42C, the lightness calculation unit 42D, the change amount calculation unit 42E, the update unit 42H, the exposure control unit 42G, Is provided.
  • the acquiring unit 42A acquires a captured image.
  • the setting unit 42C sets a detection target area 50 including a plurality of detection areas 52 in the captured image based on the setting information.
  • the brightness calculation unit 42D calculates the brightness of each of the plurality of detection areas 52 included in the detection target area 50 in the captured image.
  • the change amount calculation unit 42E calculates the change amount with respect to the previously calculated lightness for each of the plurality of detection regions 52.
  • the update unit 42H updates the setting information based on the amount of change in each of the plurality of detection regions 52.
  • the exposure control unit 42G performs exposure control during shooting by the shooting unit 12 based on the brightness of the detection target region 50 set based on the updated setting information in the shot image.
  • the imaging apparatus 10 resets the setting information of the detection target region 50 based on the amount of change in brightness of each of the plurality of detection regions 52 included in the detection target region 50. . For this reason, the imaging device 10 can perform exposure control using the brightness of the detection target region 50 set based on the reset setting information for the newly acquired captured image 60.
  • the detection target region 50 can be reset based on the amount of change in the brightness of the detection region 52, so that the optimal exposure is achieved. Control can be performed.
  • the photographing apparatus 10 of the present embodiment can perform optimal exposure control.
  • the setting information includes at least one of the position of the detection target region 50, the size of the detection target region 50, and the number of detection regions 52 included in the detection target region 50.
  • the update unit 42H calculates, for each of the plurality of detection regions 52, a change amount ratio of the change amount of the detection region 52 to the minimum change amount of the change amounts of the plurality of detection regions 52. Then, the update unit 42H can update the setting information based on the change amount ratio of each of the plurality of detection regions 52.
  • the update unit 42H may update the setting information so as to indicate, as the detection target region 50, a region including at least the detection region 52 having a change amount ratio equal to or greater than a predetermined threshold among the plurality of detection regions 52. it can.
  • the update unit 42H updates the setting information so as to indicate, as the detection target region 50, a region including at least the detection region 52 whose change amount is equal to or greater than a predetermined threshold among the plurality of detection regions 52.
  • the imaging device 10 of the present embodiment can include a weight calculation unit 42F.
  • the exposure control unit 42G calculates, for each of the plurality of detection areas 52, a weight value corresponding to the amount of change in each of the plurality of detection areas 52.
  • the exposure control unit 42G calculates a weighted brightness obtained by adding a corresponding weight value to each brightness of the detection area 52 included in the detection target area 50 set based on the updated setting information on the captured image. .
  • the exposure control unit 42G performs exposure control by using the average value of the weighted brightness of each of the plurality of detection areas 52 included in the detection target area 50 as the brightness of the detection target area 50.
  • the imaging device 10 of the present embodiment can include a determination unit 42B.
  • the determination unit 42B determines whether the shooting time of the shot image is daytime or nighttime.
  • the update unit 42H updates the setting information for each of the case where it is determined that it is daytime and the case where it is determined that it is night.
  • a program for executing the above-described processes executed by the imaging apparatus 10 of the present embodiment may be stored in the EEPROM 24.
  • a program for executing each of the processes executed by the imaging apparatus 10 according to the embodiment may be provided by being incorporated in the ROM 22 in advance.
  • a program for executing each of the processes executed by the imaging apparatus 10 of the present embodiment is a file in an installable format or an executable format, and is a CD-ROM, CD-R, memory card, DVD ( It may be stored in a computer-readable storage medium such as a digital versatile disk (FD) or a flexible disk (FD) and provided as a computer program product.
  • FD digital versatile disk
  • FD flexible disk
  • a program for executing each of the processes executed by the photographing apparatus 10 of the present embodiment is stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. May be.
  • a program for executing each of the processes executed by the imaging apparatus 10 of the present embodiment may be provided or distributed via a network such as the Internet.

Abstract

This image capture device 10 is provided with an acquisition unit 42A, a setting unit 42C, a brightness calculation unit 42D, a change amount calculation unit 42E, an update unit 42H, and an exposure control unit 42G. The acquisition unit 42A acquires a captured image. On the basis of setting information, the setting unit 42C sets a region 50 to be detected, which includes a plurality of detection regions 52, in the captured image. The brightness calculation unit 42D calculates the brightnesses of the detection regions 52 included in the region 50 to be detected in the captured image. The change amount calculation unit 42E calculates the amounts of change in the detection regions 52 relative to the previously calculated brightnesses. The update unit 42H updates the setting information on the basis of the amounts of change in the detection regions 52. The exposure control unit 42G controls exposure during image capture by an image capture unit 12 on the basis of the brightness, in the captured image, of the region 50 to be detected which is set on the basis of the updated setting information.

Description

撮影装置、撮影方法、およびプログラムImaging apparatus, imaging method, and program
　本発明は、撮影装置、撮影方法、およびプログラムに関する。 The present invention relates to a photographing apparatus, a photographing method, and a program.
　車両などの移動物に搭載されたカメラで撮影された撮影画像を用いて、カメラの露出制御を行う技術が知られている（例えば、特許文献１～特許文献２参照）。特許文献１には、予め設定された露出制御用の複数エリアの輝度を用いて、露出制御を行う技術が開示されている。特許文献２には、車両の走行速度に基づいて、撮影画像における、露出検出に用いる露出エリアのサイズを小さくなるように変更する技術が開示されている。 2. Description of the Related Art A technique for performing camera exposure control using a photographed image photographed by a camera mounted on a moving object such as a vehicle is known (see, for example, Patent Documents 1 to 2). Patent Document 1 discloses a technique for performing exposure control using preset brightness of a plurality of areas for exposure control. Patent Document 2 discloses a technique for changing the size of an exposure area used for exposure detection in a captured image based on the traveling speed of a vehicle.
特開２０１０－０４１６６８号公報JP 2010-041668 A 特開２０１４－１４３５４７号公報JP 2014-143547 A
　しかしながら、カメラなどの撮影部の搭載位置は、搭載対象の移動体の種類やユーザの要望などによって異なる。また、同じ移動体に搭載された撮影部であっても、撮影部の設置位置や設置方法などによって、撮影される撮影画像が異なる。このため、予め定めた領域で検出された輝度や画素値を用いて露出制御を行うと、最適な露出制御を行うことが出来ない場合があった。 However, the mounting position of a photographing unit such as a camera differs depending on the type of mobile object to be mounted, the user's request, and the like. Moreover, even if the photographing units are mounted on the same moving body, the photographed images to be photographed differ depending on the installation position and the installation method of the photographing unit. For this reason, when exposure control is performed using luminance or pixel values detected in a predetermined area, there are cases where optimal exposure control cannot be performed.
　本発明は、上記に鑑みてなされたものであって、最適な露出制御が可能な、撮影装置、撮影方法、およびプログラムを提供することを主な目的とする。 The present invention has been made in view of the above, and has as its main object to provide a photographing apparatus, a photographing method, and a program capable of optimal exposure control.
　本発明の撮影装置は、取得部と、設定部と、明度算出部と、変化量算出部と、更新部と、露出制御部と、を備える。取得部は、撮影画像を取得する。設定部は、設定情報に基づいて、撮影画像に、複数の検出領域を含む検出対象領域を設定する。明度算出部は、撮影画像における、検出対象領域に含まれる複数の検出領域の各々の明度を算出する。変化量算出部は、複数の検出領域の各々について、前回算出した明度に対する変化量を算出する。更新部は、複数の検出領域の各々の変化量に基づいて、設定情報を更新する。露出制御部は、撮影画像における、更新された設定情報に基づいて設定された検出対象領域の明度に基づいて、撮影部による撮影時の露出制御を行う。 The imaging apparatus of the present invention includes an acquisition unit, a setting unit, a brightness calculation unit, a change amount calculation unit, an update unit, and an exposure control unit. The acquisition unit acquires a captured image. The setting unit sets a detection target area including a plurality of detection areas in the captured image based on the setting information. The brightness calculation unit calculates the brightness of each of a plurality of detection areas included in the detection target area in the captured image. The change amount calculation unit calculates a change amount with respect to the previously calculated brightness for each of the plurality of detection regions. The update unit updates the setting information based on the amount of change in each of the plurality of detection areas. The exposure control unit performs exposure control at the time of photographing by the photographing unit based on the brightness of the detection target region set based on the updated setting information in the photographed image.
　また、本発明の撮影方法は、撮影画像を取得するステップと、設定情報に基づいて、前記撮影画像に、複数の検出領域を含む検出対象領域を設定するステップと、前記撮影画像における、前記検出対象領域に含まれる複数の前記検出領域の各々の明度を算出するステップと、複数の検出領域の各々について、前回算出した明度に対する変化量を算出するステップと、複数の前記検出領域の各々の前記変化量に基づいて、前記設定情報を更新するステップと、前記撮影画像における、更新された前記設定情報に基づいて設定された前記検出対象領域の明度に基づいて、撮影部による撮影時の露出制御を行うステップと、を含む。 Further, the imaging method of the present invention includes a step of obtaining a captured image, a step of setting a detection target region including a plurality of detection regions in the captured image based on setting information, and the detection in the captured image. Calculating the brightness of each of the plurality of detection areas included in the target area, calculating the amount of change with respect to the previously calculated brightness for each of the plurality of detection areas, and each of the plurality of detection areas The step of updating the setting information based on the amount of change, and the exposure control at the time of photographing by the photographing unit based on the brightness of the detection target area set based on the updated setting information in the photographed image Performing the steps.
　また、本発明のプログラムは、撮影画像を取得するステップと、設定情報に基づいて、前記撮影画像に、複数の検出領域を含む検出対象領域を設定するステップと、前記撮影画像における、前記検出対象領域に含まれる複数の前記検出領域の各々の明度を算出するステップと、複数の検出領域の各々について、前回算出した明度に対する変化量を算出するステップと、複数の前記検出領域の各々の前記変化量に基づいて、前記設定情報を更新するステップと、前記撮影画像における、更新された前記設定情報に基づいて設定された前記検出対象領域の明度に基づいて、撮影部による撮影時の露出制御を行うステップと、をコンピュータに実行させるためのプログラムである。 The program of the present invention includes a step of acquiring a captured image, a step of setting a detection target region including a plurality of detection regions in the captured image based on setting information, and the detection target in the captured image. Calculating the brightness of each of the plurality of detection areas included in the area; calculating the amount of change with respect to the previously calculated brightness for each of the plurality of detection areas; and the change of each of the plurality of detection areas A step of updating the setting information based on the amount, and exposure control at the time of photographing by the photographing unit based on the brightness of the detection target region set based on the updated setting information in the photographed image. A program for causing a computer to execute the steps to be performed.
　本発明によれば、最適な露出制御を行うことができる、という効果を奏する。 According to the present invention, there is an effect that optimal exposure control can be performed.
図１は、本実施の形態の撮影装置を模式的に示す構成図である。FIG. 1 is a configuration diagram schematically showing the photographing apparatus of the present embodiment. 図２は、制御部の機能ブロック図である。FIG. 2 is a functional block diagram of the control unit. 図３は、検出対象領域の一例の説明図である。FIG. 3 is an explanatory diagram of an example of the detection target area. 図４Ａは、検出対象領域の設定の一例を示す説明図である。FIG. 4A is an explanatory diagram illustrating an example of setting a detection target region. 図４Ｂは、検出対象領域の設定の一例を示す説明図である。FIG. 4B is an explanatory diagram illustrating an example of setting a detection target region. 図４Ｃは、検出対象領域の設定の一例を示す説明図である。FIG. 4C is an explanatory diagram illustrating an example of setting a detection target region. 図４Ｄは、検出対象領域の設定の一例を示す説明図である。FIG. 4D is an explanatory diagram illustrating an example of setting a detection target region. 図５Ａは、設定情報の更新、および、検出対象領域の設定の説明図である。FIG. 5A is an explanatory diagram of setting information update and detection target area setting. 図５Ｂは、設定情報の更新、および、検出対象領域の設定の説明図である。FIG. 5B is an explanatory diagram of setting information update and detection target area setting. 図５Ｃは、設定情報の更新、および、検出対象領域の設定の説明図である。FIG. 5C is an explanatory diagram of setting information update and detection target area setting. 図５Ｄは、設定情報の更新、および、検出対象領域の設定の説明図である。FIG. 5D is an explanatory diagram of setting information update and detection target area setting. 図５Ｅは、設定情報の更新、および、検出対象領域の設定の説明図である。FIG. 5E is an explanatory diagram of setting information update and detection target area setting. 図５Ｆは、設定情報の更新、および、検出対象領域の設定の説明図である。FIG. 5F is an explanatory diagram of setting information update and detection target region setting. 図５Ｇは、設定情報の更新、および、検出対象領域の設定の説明図である。FIG. 5G is an explanatory diagram of setting information update and detection target area setting. 図５Ｈは、設定情報の更新、および、検出対象領域の設定の説明図である。FIG. 5H is an explanatory diagram of setting information update and detection target area setting. 図５Ｉは、設定情報の更新、および、検出対象領域の設定の説明図である。FIG. 5I is an explanatory diagram of setting information update and detection target region setting. 図６は、撮影処理の手順の一例を示す、フローチャートである。FIG. 6 is a flowchart illustrating an example of the procedure of the photographing process.
　以下に添付図面を参照して、本実施形態にかかる、撮影装置、撮影方法、およびプログラムの一の実施の形態を詳細に説明する。 Hereinafter, an embodiment of a photographing apparatus, a photographing method, and a program according to the present embodiment will be described in detail with reference to the accompanying drawings.
　本実施の形態における撮影装置は、複数の撮影画像を連続して撮影する。本実施の形態の撮影装置は、車両などの移動体に搭載される車載カメラや、ビルなどの建造物に設置される監視カメラなどに適用される。 The imaging device in the present embodiment continuously captures a plurality of captured images. The imaging device of the present embodiment is applied to an in-vehicle camera mounted on a moving body such as a vehicle, a monitoring camera installed in a building such as a building, and the like.
　図１は、本実施の形態の撮影装置１０を模式的に示す構成図である。 FIG. 1 is a configuration diagram schematically showing a photographing apparatus 10 of the present embodiment.
　撮影装置１０は、撮影部１２と、アナログ信号処理部１４と、Ａ／Ｄ（アナログ／デジタル）変換部１６と、画像処理部１８と、圧縮／伸長処理部２０と、ＲＯＭ（Ｒｅａｄ　Ｏｎｌｙ　Ｍｅｍｏｒｙ）２２と、ＥＥＰＲＯＭ（Ｅｌｅｃｔｒｉｃａｌｌｙ　Ｅｒａｓａｂｌｅ　Ｐｒｏｇｒａｍｍａｂｌｅ　Ｒｅａｄ－Ｏｎｌｙ　Ｍｅｍｏｒｙ）２４と、ＤＲＡＭ（Ｄｙｎａｍｉｃ　Ｒａｎｄｏｍ　Ａｃｃｅｓｓ　Ｍｅｍｏｒｙ）２６と、カードＩ／Ｆ２８と、入出力Ｉ／Ｆ３０と、制御部４２と、を備える。 The photographing apparatus 10 includes a photographing unit 12, an analog signal processing unit 14, an A / D (analog / digital) conversion unit 16, an image processing unit 18, a compression / decompression processing unit 20, and a ROM (Read Only Memory). 22, EEPROM (Electrically Erasable Programmable Read-Only Memory) 24, DRAM (Dynamic Random Access Memory) 26, card I / F 28, input / output I / F 30, and control unit 42.
　本実施の形態の撮影装置１０は、撮影時の露出を自動で決定する自動露出（ＡＥ：Ａｕｔｏ　Ｅｘｐｏｓｕｒｅ）機能を有する。 The photographing apparatus 10 according to the present embodiment has an automatic exposure (AE) function that automatically determines the exposure at the time of photographing.
　撮影部１２は、撮影によって撮影画像を得る。本実施の形態では、撮影部１２は、撮影によって、連続した複数の撮影画像を得る。撮影部１２は、レンズ群１２Ａと、撮像素子１２Ｃと、レンズ群１２Ａと撮像素子１２Ｃとの間に配置されたシャッタ１２Ｂと、を備える。 The photographing unit 12 obtains a photographed image by photographing. In the present embodiment, the photographing unit 12 obtains a plurality of continuous photographed images by photographing. The imaging unit 12 includes a lens group 12A, an image sensor 12C, and a shutter 12B disposed between the lens group 12A and the image sensor 12C.
　レンズ群１２Ａは、例えば、対物レンズおよびズーム用のレンズなどを含む複数のレンズや、フォーカス用レンズ群である。 The lens group 12A is, for example, a plurality of lenses including an objective lens and a zoom lens, and a focusing lens group.
　撮像素子１２Ｃは、受光面に沿って複数のＣＣＤ（Ｃｈａｒｇｅ－Ｃｏｕｐｌｅｄ　Ｄｅｖｉｃｅ）を配列した構成である。また、撮像素子１２Ｃは、ＣＣＤに代えてＣＭＯＳ（Ｃｏｍｐｌｅｍｅｎｔａｒｙ　Ｍｅｔａｌ　Ｏｘｉｄｅ　Ｓｅｍｉｃｏｎｄｕｃｔｏｒ）イメージセンサを使用してもよい。ＣＭＯＳイメージセンサは、アナログ信号処理部１４およびＡ／Ｄ変換部１６を素子内に内蔵している場合が多いため、撮像素子１２Ｃは撮影画像のデジタルデータを画像処理部１８へ出力する。 The image sensor 12C has a configuration in which a plurality of CCDs (Charge-Coupled Devices) are arranged along the light receiving surface. The image sensor 12C may be a CMOS (Complementary Metal Oxide Semiconductor) image sensor instead of the CCD. Since the CMOS image sensor often includes the analog signal processing unit 14 and the A / D conversion unit 16 in the element, the image sensor 12C outputs digital data of the captured image to the image processing unit 18.
　被写体による反射光は、レンズ群１２Ａおよびシャッタ１２Ｂを介して撮像素子１２Ｃへ到る。撮像素子１２Ｃの各ＣＣＤは、受光した光に応じた信号を出力する。これにより、撮像素子１２Ｃは、撮影画像のアナログデータをアナログ信号処理部１４へ出力する。 Reflected light from the subject reaches the image sensor 12C via the lens group 12A and the shutter 12B. Each CCD of the image sensor 12C outputs a signal corresponding to the received light. Thereby, the image sensor 12C outputs analog data of the captured image to the analog signal processing unit 14.
　アナログ信号処理部１４は、撮像素子１２Ｃから受信したアナログデータに対して、自動利得調整（ＡＧＣ：Ａｕｔｏｍａｔｉｃ　Ｇａｉｎ　Ｃｏｎｔｒｏｌ）や相関二重サンプリング処理などの信号処理を行い、Ａ／Ｄ変換部１６へ出力する。Ａ／Ｄ変換部１６は、アナログ信号処理部１４から受信したアナログデータをデジタルデータに変換する。そして、Ａ／Ｄ変換部１６は、デジタルデータの撮影画像を、画像処理部１８へ出力する。 The analog signal processing unit 14 performs signal processing such as automatic gain adjustment (AGC) and correlated double sampling processing on the analog data received from the image sensor 12C, and outputs the result to the A / D conversion unit 16 To do. The A / D converter 16 converts the analog data received from the analog signal processor 14 into digital data. Then, the A / D conversion unit 16 outputs the captured image of the digital data to the image processing unit 18.
　画像処理部１８は、Ａ／Ｄ変換部１６から受信した撮影画像に対して、補完処理、ホワイトバランス補正、ＲＧＢ／ＹＣ変換処理などを行なう。圧縮／伸長処理部２０は、画像処理部１８で処理された撮影画像を、圧縮または伸長する。 The image processing unit 18 performs complement processing, white balance correction, RGB / YC conversion processing, and the like on the captured image received from the A / D conversion unit 16. The compression / decompression processing unit 20 compresses or expands the captured image processed by the image processing unit 18.
　画像処理部１８、圧縮／伸長処理部２０、ＲＯＭ２２、ＥＥＰＲＯＭ２４、ＤＲＡＭ２６、カードＩ／Ｆ２８、入出力Ｉ／Ｆ３０、および制御部４２は、バス４４を介してデータや信号授受可能に接続されている。 The image processing unit 18, compression / decompression processing unit 20, ROM 22, EEPROM 24, DRAM 26, card I / F 28, input / output I / F 30, and control unit 42 are connected via a bus 44 so that data and signals can be exchanged. .
　ＲＯＭ２２およびＥＥＰＲＯＭ２４は、撮影装置１０で行う各処理を実行するためのプログラムを予め記憶する。ＤＲＡＭ２６は、撮影部１２で撮影され、アナログ信号処理部１４、Ａ／Ｄ変換部１６、画像処理部１８、および圧縮／伸長処理部２０などで処理された撮影画像を記憶する。 The ROM 22 and the EEPROM 24 store in advance a program for executing each process performed by the photographing apparatus 10. The DRAM 26 stores a photographed image photographed by the photographing unit 12 and processed by the analog signal processing unit 14, the A / D conversion unit 16, the image processing unit 18, the compression / decompression processing unit 20, and the like.
　なお、ＤＲＡＭ２６は、撮影画像を一時的に記憶する一時記憶部として機能してもよい。この場合、撮影画像は、カードＩ／Ｆ２８を介して接続されたカード型記録媒体３２に記憶される。カードＩ／Ｆ２８は、カード型記録媒体３２との間でデータや信号の入出力を行うためのインターフェースである。カード型記録媒体３２は、カードＩ／Ｆ２８を介して、制御部４２にデータや信号授受可能に接続される。 Note that the DRAM 26 may function as a temporary storage unit that temporarily stores captured images. In this case, the captured image is stored in the card type recording medium 32 connected via the card I / F 28. The card I / F 28 is an interface for inputting / outputting data and signals to / from the card type recording medium 32. The card-type recording medium 32 is connected to the control unit 42 via the card I / F 28 so as to be able to exchange data and signals.
　入出力Ｉ／Ｆ３０は表示部３４、音声出力部３６、操作部３８、入出力端子４０などとの間でデータや信号の入出力を行うための通信インターフェースである。表示部３４、音声出力部３６、操作部３８、および入出力端子４０は、入出力Ｉ／Ｆ３０を介して制御部４２にデータや信号授受可能に接続される。 The input / output I / F 30 is a communication interface for inputting / outputting data and signals to / from the display unit 34, the audio output unit 36, the operation unit 38, the input / output terminal 40, and the like. The display unit 34, the audio output unit 36, the operation unit 38, and the input / output terminal 40 are connected to the control unit 42 via the input / output I / F 30 so as to be able to exchange data and signals.
　表示部３４は、撮影画像などの各種画像を表示する。表示部３４は、例えば、ＬＣＤ（Ｌｉｑｕｉｄ　Ｃｒｙｓｔａｌ　Ｄｉｓｐｌａｙ）であり、タッチパネルを備えていてもよい。音声出力部３６は、音声を出力する。音声出力部３６は、例えば、スピーカである。操作部３８は、ユーザからの各種操作指示を受付ける。操作部３８は、例えば、指示ボタンやタッチパネルである。入出力端子４０は、外部装置と入出力Ｉ／Ｆ３０とをデータや信号授受可能に接続するための端子である。 The display unit 34 displays various images such as photographed images. The display unit 34 is, for example, an LCD (Liquid Crystal Display) and may include a touch panel. The audio output unit 36 outputs audio. The audio output unit 36 is, for example, a speaker. The operation unit 38 receives various operation instructions from the user. The operation unit 38 is, for example, an instruction button or a touch panel. The input / output terminal 40 is a terminal for connecting an external device and the input / output I / F 30 so as to be able to exchange data and signals.
　制御部４２は、撮影装置１０を制御する。制御部４２は、ＣＰＵ（Ｃｅｎｔｒａｌ　Ｐｒｏｃｅｓｓｉｎｇ　Ｕｎｉｔ）で構成する。なお、制御部４２は、ＣＰＵ以外の回路などによって実現してもよい。 The control unit 42 controls the photographing apparatus 10. The control unit 42 is configured by a CPU (Central Processing Unit). The control unit 42 may be realized by a circuit other than the CPU.
　図２は、制御部４２の機能ブロック図である。制御部４２は、取得部４２Ａと、判定部４２Ｂと、設定部４２Ｃと、明度算出部４２Ｄと、変化量算出部４２Ｅと、重付算出部４２Ｆと、露出制御部４２Ｇと、更新部４２Ｈと、を備える。 FIG. 2 is a functional block diagram of the control unit 42. The control unit 42 includes an acquisition unit 42A, a determination unit 42B, a setting unit 42C, a lightness calculation unit 42D, a change amount calculation unit 42E, a weight calculation unit 42F, an exposure control unit 42G, and an update unit 42H. .
　取得部４２Ａ、判定部４２Ｂ、設定部４２Ｃ、明度算出部４２Ｄ、変化量算出部４２Ｅ、重付算出部４２Ｆ、露出制御部４２Ｇ、および、更新部４２Ｈ、の一部またはすべては、例えば、ＣＰＵなどの処理装置にプログラムを実行させること、すなわち、ソフトウェアにより実現してもよいし、ＩＣ（Ｉｎｔｅｇｒａｔｅｄ　Ｃｉｒｃｕｉｔ）などのハードウェアにより実現してもよいし、ソフトウェアおよびハードウェアを併用して実現してもよい。 A part or all of the acquisition unit 42A, the determination unit 42B, the setting unit 42C, the lightness calculation unit 42D, the change amount calculation unit 42E, the weight calculation unit 42F, the exposure control unit 42G, and the update unit 42H is, for example, a CPU The program may be executed by a processing device such as software, that is, may be realized by software, may be realized by hardware such as an IC (Integrated Circuit), or may be realized by using software and hardware together. Also good.
　例えば、本実施の形態で実行される各種処理を実行するためのプログラムは、これらの各部を含むモジュール構成となっている。実際のハードウェアとしては、ＣＰＵが、ＲＯＭ２２またはＥＥＰＲＯＭ２４から、本実施の形態で実行される各種処理を実行するためのプログラムや、設定データなどを含むデータを読み出して実行する。これにより、上述した各部がＤＲＡＭ２６上にロードされ、ＤＲＡＭ２６上に生成される。 For example, a program for executing various processes executed in the present embodiment has a module configuration including these units. As actual hardware, the CPU reads from the ROM 22 or the EEPROM 24 data for executing various processes executed in the present embodiment and data including setting data. As a result, the above-described units are loaded onto the DRAM 26 and generated on the DRAM 26.
　制御部４２は、記憶部４６および図１を用いて説明した装置各部に電気的に接続されている。記憶部４６は、各種データを記憶する記憶媒体である。記憶部４６は、具体的には、図１に示すＥＥＰＲＯＭ２４、ＤＲＡＭ２６、およびカード型記録媒体３２である。 The control unit 42 is electrically connected to the storage unit 46 and each unit described with reference to FIG. The storage unit 46 is a storage medium that stores various data. Specifically, the storage unit 46 is the EEPROM 24, the DRAM 26, and the card type recording medium 32 shown in FIG.
　取得部４２Ａは、撮影画像を取得する。取得部４２Ａは、撮影部１２が撮影画像を得る度に、得られた撮影画像を該撮影部１２から取得する。詳細には、取得部４２Ａは、撮影部１２で撮影され、アナログ信号処理部１４、Ａ／Ｄ変換部１６、および画像処理部１８などで処理された撮影画像を、ＤＲＡＭ２６から取得する。 The acquisition unit 42A acquires a captured image. The acquisition unit 42A acquires the acquired captured image from the imaging unit 12 every time the imaging unit 12 acquires the captured image. Specifically, the acquiring unit 42A acquires from the DRAM 26 a captured image that has been captured by the capturing unit 12 and processed by the analog signal processing unit 14, the A / D conversion unit 16, the image processing unit 18, and the like.
　判定部４２Ｂは、取得部４２Ａが取得した撮影画像の撮影時刻が、昼であるか夜であるかを判定する。判定部４２Ｂは、公知の方法により、撮影画像の撮影時刻が昼であるか夜であるかを判定すればよい。例えば、判定部４２Ｂは、撮影シーンを判定する公知の判定技術を用いて、撮影画像の撮影時刻が昼であるか夜であるかを判定する。 The determination unit 42B determines whether the shooting time of the captured image acquired by the acquisition unit 42A is daytime or nighttime. The determination unit 42B may determine whether the shooting time of the captured image is daytime or night by a known method. For example, the determination unit 42B determines whether the shooting time of the captured image is daytime or night using a known determination technique for determining a shooting scene.
　設定部４２Ｃ、明度算出部４２Ｄ、変化量算出部４２Ｅ、重付算出部４２Ｆ、および、更新部４２Ｈは、判定部４２Ｂによって昼であると判定された場合、および、夜であると判定された場合、の各々ごとに、後述する処理を実行する。 The setting unit 42C, lightness calculation unit 42D, change amount calculation unit 42E, weight calculation unit 42F, and update unit 42H are determined to be daytime by the determination unit 42B and determined to be nighttime. In each case, the processing described later is executed.
　設定部４２Ｃは、取得部４２Ａが取得した撮影画像に、検出対象領域を設定する。 The setting unit 42C sets the detection target area in the captured image acquired by the acquisition unit 42A.
　図３は、検出対象領域５０の一例の説明図である。検出対象領域５０は、撮影画像における、露出制御に用いる明度の検出対象の領域である。図３には、検出対象領域５０は、撮影画像５４における一部の領域である場合を示した。 FIG. 3 is an explanatory diagram of an example of the detection target area 50. The detection target area 50 is a brightness detection target area used for exposure control in a captured image. FIG. 3 shows a case where the detection target area 50 is a partial area in the captured image 54.
　検出対象領域５０は、複数の検出領域５２を含む。図３に示す例では、検出対象領域５０には、複数の検出領域５２、具体的には検出領域５２１～検出領域５２１６が格子状に配列されている形態を一例として示した。各検出領域５２の大きさは、少なくとも１画素を含む大きさであればよい。言い換えると、検出領域５２の大きさは、撮像素子１２Ｃにおける、少なくとも１つのＣＣＤを含む大きさであればよい。本実施の形態では、検出領域５２の大きさは、複数の画素が含まれる大きさである場合を説明する。 The detection target area 50 includes a plurality of detection areas 52. In the example illustrated in FIG. 3, the detection target region 50 is illustrated as an example in which a plurality of detection regions 52, specifically, the detection regions 52 1 to 52 16 are arranged in a grid pattern. The size of each detection region 52 may be a size including at least one pixel. In other words, the size of the detection area 52 may be a size including at least one CCD in the image sensor 12C. In the present embodiment, the case where the size of the detection region 52 is a size including a plurality of pixels will be described.
　設定部４２Ｃは、設定情報に基づいて、撮影部１２で取得した撮影画像に検出対象領域５０を設定する。設定情報は、検出対象領域５０の撮影画像における位置、検出対象領域５０のサイズ、および検出対象領域５０に含まれる検出領域５２の数、の少なくとも１つを含む。 The setting unit 42C sets the detection target area 50 in the captured image acquired by the imaging unit 12 based on the setting information. The setting information includes at least one of the position of the detection target region 50 in the captured image, the size of the detection target region 50, and the number of detection regions 52 included in the detection target region 50.
　本実施の形態では、設定情報は、検出対象領域５０の位置、検出対象領域５０のサイズ、および、検出対象領域５０に含まれる検出領域５２の数、を含む場合を説明する。図３に示す例では、設定情報が、撮影画像５４の中心位置、図３に示す大きさ、および、検出領域５２の数、具体的には１６個、を含む場合を一例として示した。 In the present embodiment, a case will be described in which the setting information includes the position of the detection target region 50, the size of the detection target region 50, and the number of detection regions 52 included in the detection target region 50. In the example illustrated in FIG. 3, the setting information includes the center position of the captured image 54, the size illustrated in FIG. 3, and the number of detection areas 52, specifically, 16 as an example.
　設定情報は、後述する更新部４２Ｈによって更新される（詳細後述）。記憶部４６例えば、ＥＥＰＲＯＭ２４は、検出対象領域５０の設定情報の初期値（以下、初期設定情報と称する）を予め記憶する。 The setting information is updated by an update unit 42H described later (details will be described later). For example, the EEPROM 24 stores in advance an initial value of setting information of the detection target area 50 (hereinafter referred to as initial setting information).
　検出対象領域５０の初期設定情報は、例えば、撮影装置１０の製造時の出荷前に予め設定され、ＥＥＰＲＯＭ２４に予め記憶される。 The initial setting information of the detection target area 50 is set in advance, for example, before shipment when the photographing apparatus 10 is manufactured, and is stored in the EEPROM 24 in advance.
　設定部４２Ｃは、取得部４２Ａが取得した撮影画像に、設定情報に基づいて、検出対象領域５０を設定する。検出対象領域５０を設定する、とは、設定情報によって示される数の検出領域５２を含む、設定情報によって示されるサイズの検出対象領域５０を、撮影画像上における、設定情報によって示される位置に配置することを意味する。 The setting unit 42C sets the detection target area 50 in the captured image acquired by the acquisition unit 42A based on the setting information. Setting the detection target area 50 means that the detection target areas 50 having the size indicated by the setting information including the number of detection areas 52 indicated by the setting information are arranged at positions indicated by the setting information on the captured image. It means to do.
　図４Ａは、設定部４２Ｃによる検出対象領域５０の設定の一例を示す説明図である。図４Ｂは、検出対象領域の設定の一例を示す説明図である。図４Ｃは、検出対象領域の設定の一例を示す説明図である。図４Ｄは、検出対象領域の設定の一例を示す説明図である。 FIG. 4A is an explanatory diagram illustrating an example of setting of the detection target region 50 by the setting unit 42C. FIG. 4B is an explanatory diagram illustrating an example of setting a detection target region. FIG. 4C is an explanatory diagram illustrating an example of setting a detection target region. FIG. 4D is an explanatory diagram illustrating an example of setting a detection target region.
　図４Ａは、取得部４２Ａが取得した撮影画像６０の一例である。図４Ａに示す例では、撮影画像６０に、トンネルなどの暗い領域６０Ａが含まれている場合を、一例として示した。 FIG. 4A is an example of the captured image 60 acquired by the acquisition unit 42A. In the example illustrated in FIG. 4A, the case where the captured image 60 includes a dark region 60A such as a tunnel is illustrated as an example.
　図４Ｂは、検出対象領域５０の一例を示す模式図である。図４Ｂに示す検出対象領域５０は、図３に示す検出対象領域５０と同様である。 FIG. 4B is a schematic diagram illustrating an example of the detection target region 50. The detection target area 50 shown in FIG. 4B is the same as the detection target area 50 shown in FIG.
　例えば、記憶部４６に、図４Ｂに示す検出対象領域５０の設定情報が記憶されていたとする。この場合、設定部４２Ｃは、撮影画像６０上における（図４Ａ参照）、設定情報によって示される位置に、設定情報によって示されるサイズの検出対象領域５０を配置する（図４Ｃ参照）。このとき、設定部４２Ｃは、設定情報によって示される数の検出領域５２を含む検出対象領域５０を、撮影画像６０上に配置する（図４Ｃ参照）。これにより、設定部４２Ｃは、撮影画像６０に検出対象領域５０を設定する（図４Ｃ参照）。 For example, it is assumed that the setting information of the detection target area 50 illustrated in FIG. 4B is stored in the storage unit 46. In this case, the setting unit 42C arranges the detection target region 50 having the size indicated by the setting information at the position indicated by the setting information on the captured image 60 (see FIG. 4A) (see FIG. 4C). At this time, the setting unit 42C arranges the detection target areas 50 including the number of detection areas 52 indicated by the setting information on the captured image 60 (see FIG. 4C). Thereby, the setting unit 42C sets the detection target region 50 in the captured image 60 (see FIG. 4C).
　図２に戻り、明度算出部４２Ｄは、取得部４２Ａが取得した撮影画像６０における、検出対象領域５０に含まれる複数の検出領域５２の各々の明度を算出する。明度算出部４２Ｄは、撮影画像６０における、検出領域５２の各々について、検出領域５２に含まれる１または複数の画素（ＣＣＤ）の明度の平均値を、検出領域５２の明度として算出する。各画素の明度は、各画素（ＣＣＤ）の画素値から読取ればよい。 2, the lightness calculation unit 42D calculates the lightness of each of the plurality of detection regions 52 included in the detection target region 50 in the captured image 60 acquired by the acquisition unit 42A. The brightness calculation unit 42D calculates the average value of the brightness of one or more pixels (CCD) included in the detection area 52 as the brightness of the detection area 52 for each of the detection areas 52 in the captured image 60. The brightness of each pixel may be read from the pixel value of each pixel (CCD).
　そして、明度算出部４２Ｄは、算出した各検出領域５２の明度を、各検出領域５２の識別情報に対応づけて、記憶部４６へ記憶する。本実施の形態では、検出領域５２の識別情報として、撮影画像６０上における検出領域５２の画素位置を用いる。このため、明度算出部４２Ｄは、算出した各検出領域５２の明度を、撮影画像６０上における画素位置に対応づけて、記憶部４６へ記憶する。 The brightness calculation unit 42D stores the calculated brightness of each detection region 52 in the storage unit 46 in association with the identification information of each detection region 52. In the present embodiment, as the identification information of the detection area 52, the pixel position of the detection area 52 on the captured image 60 is used. Therefore, the brightness calculation unit 42D stores the calculated brightness of each detection region 52 in the storage unit 46 in association with the pixel position on the captured image 60.
　変化量算出部４２Ｅは、複数の検出領域５２の各々について、前回算出した明度に対する変化量を、算出する。 The change amount calculation unit 42E calculates the change amount with respect to the previously calculated lightness for each of the plurality of detection regions 52.
　前回算出した明度、とは、前回、撮影画像６０上に設定された検出対象領域５０において、該検出対象領域５０に含まれる複数の検出領域５２の各々について算出された明度を示す。前回、撮影画像６０上に設定された検出対象領域５０とは、後述する更新部４２Ｈによる最新の更新前、すなわち更新直前の設定情報に基づいて、撮影画像６０上に設定された検出対象領域５０である。 The previously calculated brightness indicates the brightness calculated for each of the plurality of detection areas 52 included in the detection target area 50 in the detection target area 50 set on the photographed image 60 last time. The detection target area 50 previously set on the photographed image 60 is the detection target area 50 set on the photographed image 60 based on the setting information immediately before the latest update by the update unit 42H described later, that is, immediately before the update. It is.
　変化量算出部４２Ｅは、設定部４２Ｃが前回設定した検出対象領域５０から前回算出された検出領域５２の明度と、設定部４２Ｃが今回設定した検出対象領域５０から今回算出された検出領域５２の明度と、の差を算出することで、変化量を算出する。 The amount-of-change calculating unit 42E calculates the brightness of the detection region 52 previously calculated from the detection target region 50 previously set by the setting unit 42C and the detection region 52 calculated this time from the detection target region 50 set by the setting unit 42C this time. The amount of change is calculated by calculating the difference between the brightness and the brightness.
　具体的には、変化量算出部４２Ｅは、式（１）を用いて、複数の検出領域５２の各々の変化量、言い換えると明度の変化量）を算出する。 Specifically, the change amount calculation unit 42E calculates the change amount of each of the plurality of detection regions 52, in other words, the change amount of lightness, using the equation (1).
Figure JPOXMLDOC01-appb-M000001
Figure JPOXMLDOC01-appb-M000001
　式（１）中、Ｙ（ｉ）（ｎ－１）は、設定部４２Ｃが前回設定した検出対象領域５０から前回算出された検出領域５２の明度を示す。Ｙ（ｉ）（ｎ）は、設定部４２Ｃが今回設定した検出対象領域５０から今回算出された検出領域５２の明度を示す。Ｙ’（ｉ）（ｎ）は、設定部４２Ｃが今回設定した検出対象領域５０に含まれる検出領域５２の、明度の変化量を示す。ｉは、検出領域５２の識別情報を示す。 In the formula (1), Y (i) (n−1) represents the brightness of the detection area 52 calculated last time from the detection target area 50 previously set by the setting unit 42C. Y (i) (n) indicates the brightness of the detection region 52 calculated this time from the detection target region 50 set by the setting unit 42C this time. Y ′ (i) (n) represents the amount of change in lightness of the detection region 52 included in the detection target region 50 set by the setting unit 42C this time. i indicates identification information of the detection region 52.
　なお、撮影画像６０上における、前回設定された検出対象領域５０の位置と、今回設定された検出対象領域５０の位置と、が異なる場合がある。このため、変化量算出部４２Ｅは、詳細には、今回設定された検出対象領域５０から今回算出した検出領域５２の明度と、前回設定された検出対象領域５０から前回算出した検出領域５２の明度と、を、同じ画素位置ごとに比較し、差分を算出することで、変化量を算出する。 Note that the previously set position of the detection target area 50 on the captured image 60 may be different from the position of the detection target area 50 set this time. Therefore, in detail, the change amount calculation unit 42E calculates the brightness of the detection area 52 calculated this time from the detection target area 50 set this time and the brightness of the detection area 52 calculated last time from the detection target area 50 set last time. Are calculated for each same pixel position, and the difference is calculated to calculate the amount of change.
　なお、変化量算出部４２Ｅは、今回設定された検出対象領域５０の複数の検出領域５２の内、同じ画素位置の検出領域５２が前回設定された検出対象領域５０に存在しない検出領域５２については、予め定めた値との差の算出、もしくは事前に決められた変化量を使用すればよい。 It should be noted that the change amount calculation unit 42E is configured to detect a detection region 52 in which the detection region 52 at the same pixel position does not exist in the previously set detection target region 50 among the plurality of detection regions 52 of the detection target region 50 set this time. The calculation of the difference from the predetermined value or the change amount determined in advance may be used.
　そして、変化量算出部４２Ｅは、複数の検出領域５２ごとに算出した変化量を、撮影画像６０における対応する画素位置に対応づけて、記憶部４６へ記憶する。 Then, the change amount calculation unit 42E stores the change amount calculated for each of the plurality of detection regions 52 in the storage unit 46 in association with the corresponding pixel position in the captured image 60.
　更新部４２Ｈは、変化量算出部４２Ｅで算出した、複数の検出領域５２の各々の明度の変化量に基づいて、設定情報を更新する。 The update unit 42H updates the setting information based on the amount of change in lightness of each of the plurality of detection areas 52 calculated by the change amount calculation unit 42E.
　例えば、更新部４２Ｈは、前回設定された検出対象領域５０の位置（図４Ｃ参照）を変更するように、設定情報を更新する。このため、設定部４２Ｃは、前回設定した検出対象領域５０Ａを、更新された設置情報に応じてずらした位置に、新たな検出対象領域５０Ｂを設定することとなる（図４Ｄ参照）。このため、撮影画像６０における、露出制御に用いる領域の位置が、複数の検出領域５２の各々の明度の変化量に応じて、変更される。 For example, the update unit 42H updates the setting information so as to change the position (see FIG. 4C) of the detection target region 50 set last time. For this reason, the setting unit 42C sets a new detection target area 50B at a position where the previously set detection target area 50A is shifted according to the updated installation information (see FIG. 4D). For this reason, the position of the region used for exposure control in the captured image 60 is changed according to the amount of change in brightness of each of the plurality of detection regions 52.
　なお、更新部４２Ｈは、今回設定した検出対象領域５０に含まれる複数の検出領域５２の各々について、前回算出した変化量と、今回算出した変化量と、の平均値を、複数の検出領域５２の各々の明度の変化量として用いて、設定情報を更新することが好ましい。 Note that the updating unit 42H sets, for each of the plurality of detection regions 52 included in the detection target region 50 set this time, the average value of the change amount calculated last time and the change amount calculated this time, to the plurality of detection regions 52. It is preferable to update the setting information by using it as the amount of change in the brightness of each.
　平均値を用いることによって、変化量の算出結果に異常値が含まれた場合であっても、設定情報の更新に用いる変化量として、精度の高い値を用いることができる。 By using the average value, even if an abnormal value is included in the calculation result of the change amount, a highly accurate value can be used as the change amount used for updating the setting information.
　なお、更新部４２Ｈは、さらに、複数の検出領域５２の各々について、変化量比を算出してもよい。変化量比は、複数の検出領域５２の各々の、今回算出した変化量の内の最低変化量に対する、該複数の検出領域５２の各々の変化量の比である。 Note that the updating unit 42H may further calculate a change amount ratio for each of the plurality of detection regions 52. The change amount ratio is the ratio of the change amount of each of the plurality of detection regions 52 to the lowest change amount of the change amounts calculated this time for each of the plurality of detection regions 52.
　具体的には、更新部４２Ｈは、式（２）を用いて、複数の検出領域５２の各々の変化量比を算出する。 Specifically, the updating unit 42H calculates a change amount ratio of each of the plurality of detection regions 52 using the equation (2).
Figure JPOXMLDOC01-appb-M000002
Figure JPOXMLDOC01-appb-M000002
　式（２）中、Ｙ’（ｉ）は、設定部４２Ｃが今回算出した、検出領域５２の変化量、言い換えると明るさの変化量を示す。Ｙ’ｌｏｗは、設定部４２Ｃが今回算出した、検出領域５２の変化量の内の最低値を示す。Ｙ’（ｉ）ｒａｔｉｏは、設定部４２Ｃが今回設定した検出対象領域５０に含まれる検出領域５２の、明度の変化量比を示す。ｉは、検出領域５２の識別情報を示す。 In Expression (2), Y ′ (i) indicates the amount of change in the detection area 52 calculated by the setting unit 42C this time, in other words, the amount of change in brightness. Y'low indicates the lowest value of the amount of change in the detection area 52 calculated by the setting unit 42C this time. Y ′ (i) ratio indicates the change ratio of the brightness of the detection area 52 included in the detection target area 50 set by the setting unit 42C this time. i indicates identification information of the detection region 52.
　そして、更新部４２Ｈは、複数の検出領域５２の各々の変化量比に基づいて、設定情報を更新する。 Then, the update unit 42H updates the setting information based on the change amount ratio of each of the plurality of detection regions 52.
　図５Ａは、更新部４２Ｈによる設定情報の更新、および、設定部４２Ｃによる検出対象領域５０の設定の説明図である。図５Ｂは、設定情報の更新、および、検出対象領域の設定の説明図である。図５Ｃは、設定情報の更新、および、検出対象領域の設定の説明図である。図５Ｄは、設定情報の更新、および、検出対象領域の設定の説明図である。図５Ｅは、設定情報の更新、および、検出対象領域の設定の説明図である。図５Ｆは、設定情報の更新、および、検出対象領域の設定の説明図である。図５Ｇは、設定情報の更新、および、検出対象領域の設定の説明図である。図５Ｈは、設定情報の更新、および、検出対象領域の設定の説明図である。図５Ｉは、設定情報の更新、および、検出対象領域の設定の説明図である。 FIG. 5A is an explanatory diagram of setting information updating by the updating unit 42H and setting of the detection target area 50 by the setting unit 42C. FIG. 5B is an explanatory diagram of setting information update and detection target area setting. FIG. 5C is an explanatory diagram of setting information update and detection target area setting. FIG. 5D is an explanatory diagram of setting information update and detection target area setting. FIG. 5E is an explanatory diagram of setting information update and detection target area setting. FIG. 5F is an explanatory diagram of setting information update and detection target region setting. FIG. 5G is an explanatory diagram of setting information update and detection target area setting. FIG. 5H is an explanatory diagram of setting information update and detection target area setting. FIG. 5I is an explanatory diagram of setting information update and detection target region setting.
　例えば、取得部４２Ａが、図５Ａに示す撮影画像６０を取得したと仮定する。そして、設定部４２Ｃが、設定情報に基づいて、撮影画像６０の中央の位置に検出対象領域５０Ａを設定したと仮定する（図５Ａ参照）。 For example, it is assumed that the acquisition unit 42A has acquired the captured image 60 illustrated in FIG. Then, it is assumed that the setting unit 42C sets the detection target region 50A at the center position of the captured image 60 based on the setting information (see FIG. 5A).
　明度算出部４２Ｄは、複数の検出領域５２、具体的には検出領域５２１～検出領域５２１６の各々について、明度を算出する（図５Ｂ参照）。図５Ｂ中、各検出領域５２内に示した数字は、説明を容易にするために、明度の一例を分かりやすい数値に置き換えた値である。実際には、１画素毎の明度は１２ｂｉｔデータで表されることが多く、１画素毎の明度は０～４０９５の範囲で表される。 The brightness calculation unit 42D calculates the brightness for each of the plurality of detection areas 52, specifically, the detection areas 52 1 to 52 16 (see FIG. 5B). In FIG. 5B, the numbers shown in each detection region 52 are values obtained by replacing an example of lightness with an easily understandable numerical value for easy explanation. Actually, the brightness for each pixel is often expressed by 12-bit data, and the brightness for each pixel is expressed in the range of 0 to 4095.
　変化量算出部４２Ｅが、複数の検出領域５２、具体的には検出領域５２１～検出領域５２１６の各々について、明度の変化量を算出する（図５Ｃ参照）。図５Ｃ中、複数の検出領域５２、具体的には検出領域５２１～検出領域５２１６の各々内に示す数字も図５Ｂと同様に説明を容易にするために、明度の変化量の一例を分かりやすい数値に置き換えた値である。実際には、１画素毎の明度は１２ｂｉｔデータで表されることが多く、１画素毎の明度の変化量は変化量の比で表され、変化量の比の最小値は１となる。このため、明度の変化量の比は１～４０９５の範囲で表される。 The change amount calculation unit 42E calculates the amount of change in brightness for each of the plurality of detection regions 52, specifically, the detection regions 52 1 to 52 16 (see FIG. 5C). In FIG. 5C, the numbers shown in the plurality of detection areas 52, specifically, the detection areas 52 1 to 52 16 are also examples of the amount of change in brightness in order to facilitate the explanation as in FIG. 5B. The values are replaced with easy-to-understand numbers. Actually, the lightness for each pixel is often represented by 12-bit data, and the change amount of the lightness for each pixel is represented by the change amount ratio, and the minimum value of the change amount ratio is 1. For this reason, the ratio of the change in brightness is expressed in the range of 1 to 4095.
　図５Ｄ～図５Ｆは、更新部４２Ｈが更新した設定情報によって示される、更新後の検出対象領域５０の一例を示す図である。 5D to 5F are diagrams illustrating an example of the detection target area 50 after being updated, which is indicated by the setting information updated by the updating unit 42H.
　更新部４２Ｈは、複数の検出領域５２の内、変化量比が予め定めた閾値以上の検出領域５２を少なくとも含む領域を、新たな検出対象領域５０として示すように、設定情報を更新する。この閾値は、予め一定の値を記憶部４６へ記憶してもよいし、複数の検出領域５２の各々の変化量に応じて動的に生成してもよい。例えば、更新部４２Ｈは、複数の検出領域５２の各々の変化量比の平均値を、閾値として用いてもよい。 The update unit 42H updates the setting information so as to indicate, as a new detection target region 50, a region including at least the detection region 52 having a change amount ratio equal to or greater than a predetermined threshold among the plurality of detection regions 52. As this threshold value, a predetermined value may be stored in advance in the storage unit 46, or may be dynamically generated according to the amount of change in each of the plurality of detection regions 52. For example, the updating unit 42H may use the average value of the change amount ratios of the plurality of detection regions 52 as the threshold value.
　例えば、この閾値が“０．３”であったと仮定する。この場合、更新部４２Ｈは、複数の検出領域５２、具体的には検出領域５２１～検出領域５２１６の内、変化量比が閾値“０．３”以上の検出領域５２、具体的には、図５Ｃでは、検出領域５２２、検出領域５２３、検出領域５２６、検出領域５２７を特定する（領域Ｐ参照）。そして、更新部４２Ｈは、特定した検出領域５２を含む領域を、新たな検出対象領域５０として示すように、設定情報を更新する。 For example, assume that the threshold value is “0.3”. In this case, the update unit 42H includes a plurality of detection areas 52, specifically, detection areas 52 having a change amount ratio equal to or greater than the threshold value “0.3” among the detection areas 52 1 to 52 16 , specifically, In FIG. 5C, the detection area 52 2 , the detection area 52 3 , the detection area 52 6 , and the detection area 52 7 are specified (see the area P). Then, the update unit 42H updates the setting information so that the area including the identified detection area 52 is indicated as a new detection target area 50.
　例えば、更新部４２Ｈは、特定した検出領域５２を中心に配置した領域を、新たな検出対象領域５０として示すように、設定情報を更新する。具体的には、図５Ｄに示すように、前回設定した検出対象領域５０Ａの位置を、変化量比が閾値以上の検出領域５２による領域Ｐが中心に位置するように、矢印Ｘ方向に移動させる。そして、制御部４２Ｈは、移動後の新たな検出対象領域５０Ｂを示すように、設定情報を更新する。 For example, the update unit 42H updates the setting information so as to indicate an area arranged around the specified detection area 52 as a new detection target area 50. Specifically, as shown in FIG. 5D, the position of the detection target region 50A set last time is moved in the direction of the arrow X so that the region P by the detection region 52 whose change amount ratio is equal to or greater than the threshold is located at the center. . Then, the control unit 42H updates the setting information so as to indicate the new detection target area 50B after the movement.
　この場合、設定部４２Ｃは、次回の設定時には、更新後の設定情報を用いて、撮影画像６０に検出対象領域５０Ｂを設定することとなる（図５Ｇ参照）。 In this case, in the next setting, the setting unit 42C sets the detection target region 50B in the captured image 60 using the updated setting information (see FIG. 5G).
　なお、更新部４２Ｈは、前回設定した検出対象領域５０を縮小した領域を、新たな検出対象領域５０として示すように、設定情報を更新してもよい。具体的には、更新部４２Ｈは、前回設定した検出対象領域５０Ａを、変化量比が閾値以上の検出領域５２からなる領域Ｐに縮小する。そして、更新部４２Ｈは、縮小した領域Ｐを、新たな検出対象領域５０Ｃとして示すように、設定情報を更新する（図５Ｅ参照）。 Note that the updating unit 42H may update the setting information so as to indicate a region obtained by reducing the previously set detection target region 50 as a new detection target region 50. Specifically, the update unit 42H reduces the previously set detection target region 50A to a region P composed of detection regions 52 whose change amount ratio is equal to or greater than a threshold value. Then, the update unit 42H updates the setting information so that the reduced area P is indicated as a new detection target area 50C (see FIG. 5E).
　この場合、設定部４２Ｃは、次回の設定時には、更新後の設定情報を用いて、撮影画像６０に検出対象領域５０Ｃを設定することとなる（図５Ｈ参照）。 In this case, in the next setting, the setting unit 42C sets the detection target region 50C in the captured image 60 using the updated setting information (see FIG. 5H).
　また、更新部４２Ｈは、更新前の設定情報に示される、検出領域５２の数を変更することで、設定情報を更新してもよい。 Further, the updating unit 42H may update the setting information by changing the number of detection areas 52 indicated in the setting information before updating.
　例えば、更新部４２Ｈは、前回設定した検出対象領域５０Ａにおける、変化量比が閾値未満の検出領域５２を除外する。そして、更新部４２Ｈは、前回設定した検出対象領域５０Ａにおける、変化量比が閾値以上の検出領域５２、具体的に図５Ｆでは４つの検出領域５２、による領域Ｐを、新たな検出対象領域５０Ｄとして示すように、設定情報を更新してもよい（図５Ｆ参照）。 For example, the update unit 42H excludes the detection region 52 in which the change amount ratio is less than the threshold in the detection target region 50A set last time. Then, the updating unit 42H replaces the detection area 52 with the change amount ratio equal to or greater than the threshold in the detection target area 50A set last time, specifically, the area P including the four detection areas 52 in FIG. As shown, the setting information may be updated (see FIG. 5F).
　この場合、設定部４２Ｃは、次回の設定時には、更新後の設定情報を用いて、撮影画像６０に検出対象領域５０Ｄを設定することとなる（図５Ｉ参照）。 In this case, in the next setting, the setting unit 42C sets the detection target region 50D in the captured image 60 using the updated setting information (see FIG. 5I).
　なお、更新部４２Ｈは、変化量比に代えて、変化量を用いて、設定情報を更新してもよい。すなわち、更新部４２Ｈは、複数の検出領域５２の各々の変化量が閾値以上の検出領域５２を少なくとも含む領域を、新たな検出対象領域５０として示すように、設定情報を更新してもよい。この場合、更新部４２Ｈは、複数の検出領域５２の内、変化量が閾値以上の検出領域５２を特定する以外は、変化量比を用いる場合と同様にして、設定情報を更新すればよい。 Note that the updating unit 42H may update the setting information using the change amount instead of the change amount ratio. That is, the update unit 42H may update the setting information so that a region including at least the detection region 52 in which the change amount of each of the plurality of detection regions 52 is equal to or greater than the threshold is indicated as a new detection target region 50. In this case, the update unit 42H may update the setting information in the same manner as when the change amount ratio is used except that the detection region 52 whose change amount is greater than or equal to the threshold value is specified from among the plurality of detection regions 52.
　図２に戻り、重付算出部４２Ｆは、複数の検出領域５２の各々について、複数の検出領域５２の各々の変化量に応じた重み付け値を算出する。例えば、重付算出部４２Ｆは、変化量算出部４２Ｅが検出領域５２の各々について算出した変化量比を、重み付け値として用いる。なお、重付算出部４２Ｆは、該変化量比に、予め定めた係数を乗算した値を、重み付け値として用いてもよい。この係数を調整することで、重み付け値が与える影響力をと調整することができる。 Returning to FIG. 2, the weight calculation unit 42 </ b> F calculates a weighting value corresponding to the amount of change in each of the plurality of detection regions 52 for each of the plurality of detection regions 52. For example, the weight calculation unit 42F uses the change amount ratio calculated by the change amount calculation unit 42E for each of the detection regions 52 as a weighting value. Note that the weight calculation unit 42F may use a value obtained by multiplying the change amount ratio by a predetermined coefficient as a weighting value. By adjusting this coefficient, the influence exerted by the weighting value can be adjusted.
　露出制御部４２Ｇは、撮影画像６０における、検出対象領域５０の明度に基づいて、撮影部１２による撮影時の露出制御を行う。 The exposure control unit 42G performs exposure control during photographing by the photographing unit 12 based on the brightness of the detection target region 50 in the photographed image 60.
　詳細には、露出制御部４２Ｇは、撮影画像６０に設定した検出対象領域５０に含まれる検出領域５２の各々の明度の平均値を、該検出対象領域５０の明度として用いる。 Specifically, the exposure control unit 42G uses the average value of the brightness of each detection area 52 included in the detection target area 50 set in the captured image 60 as the brightness of the detection target area 50.
　なお、露出制御部４２Ｇは、撮影画像６０上における、撮影画像６０における、検出対象領域５０に含まれる検出領域５２の各々の明度に、対応する重み付け値を付加した重み付け明度を算出することが好ましい。そして、露出制御部４２Ｇは、検出対象領域５０に含まれる、複数の検出領域５２の各々の重み付け明度の平均値を、検出対象領域５０の明度として用いることが好ましい。 Note that the exposure control unit 42G preferably calculates a weighted brightness obtained by adding a corresponding weighting value to the brightness of each of the detection regions 52 included in the detection target region 50 in the captured image 60 on the captured image 60. . The exposure control unit 42 </ b> G preferably uses the average value of the weighted brightness of each of the plurality of detection areas 52 included in the detection target area 50 as the brightness of the detection target area 50.
　そして、露出制御部４２Ｇは、検出対象領域５０の明度に基づいて、露出制御を行うための露出制御値を算出する。露出制御値は、シャッタ１２Ｂのシャッタスピード、絞り（Ｆ値）、ＮＤ(Ｎｅｕｔｒａｌ　Ｄｅｎｓｉｔｙ、減光)フィルターの設定値、ゲイン、の少なくとも１つを調整するための調整値である。露出制御部４２Ｇは、公知の方法を用いて、露出制御値を算出すればよい。 The exposure control unit 42G calculates an exposure control value for performing exposure control based on the brightness of the detection target region 50. The exposure control value is an adjustment value for adjusting at least one of the shutter speed of the shutter 12B, the aperture (F value), the setting value of the ND (Neutral Density) filter, and the gain. The exposure control unit 42G may calculate the exposure control value using a known method.
　そして、露出制御部４２Ｇは、算出した露出制御値を用いて、撮影部１２を制御する。露出制御値を用いて撮影部１２を制御することで、露出制御を行う。なお、露出制御の方法には、公知の方法を用いればよい。 Then, the exposure control unit 42G controls the photographing unit 12 using the calculated exposure control value. Exposure control is performed by controlling the photographing unit 12 using the exposure control value. A known method may be used as the exposure control method.
　なお、更新部４２Ｈによって設定情報が更新された場合、露出制御部４２Ｇは、更新された設定情報に基づいて設定された検出対象領域５０の明度に基づいて、露出制御を行えばよい。 When the setting information is updated by the updating unit 42H, the exposure control unit 42G may perform exposure control based on the brightness of the detection target region 50 set based on the updated setting information.
　次に、撮影装置１０で実行する撮影処理の手順を説明する。図６は、撮影装置１０で実行する撮影処理の手順の一例を示す、フローチャートである。 Next, a procedure of photographing processing executed by the photographing device 10 will be described. FIG. 6 is a flowchart illustrating an example of a procedure of imaging processing executed by the imaging device 10.
　撮影装置１０の制御部４２は、撮影部１２が新たな撮影画像６０を取得する度に、図６に示す撮影処理を実行する。 The control unit 42 of the imaging apparatus 10 executes the imaging process shown in FIG. 6 every time the imaging unit 12 acquires a new captured image 60.
　まず、取得部４２Ａが、撮影部１２から撮影画像を取得する（ステップＳ１００）。次に、判定部４２Ｂが、初回の判定であるか否かを判定する（ステップＳ１０２）。初回の判定とは、撮影装置１０が出荷された後、最初に行う撮影時刻の判定処理を示す。 First, the acquisition unit 42A acquires a captured image from the imaging unit 12 (step S100). Next, the determination unit 42B determines whether or not it is the first determination (step S102). The first determination refers to a determination process of the photographing time that is performed first after the photographing apparatus 10 is shipped.
　初回の撮影処理と判定すると（ステップＳ１０２：Ｙｅｓ）、ステップＳ１０４へ進む。 If it is determined that the first photographing process (step S102: Yes), the process proceeds to step S104.
　ステップＳ１０４では、判定部４２Ｂが、ステップＳ１００で取得した撮影画像６０の撮影時刻が昼であるか夜であるかを判定する（ステップＳ１０４）。そして、判定部４２Ｂは、判定結果を、該撮影画像６０の識別情報に対応づけて記憶部４６へ記憶する。 In step S104, the determination unit 42B determines whether the shooting time of the captured image 60 acquired in step S100 is daytime or nighttime (step S104). Then, the determination unit 42 </ b> B stores the determination result in the storage unit 46 in association with the identification information of the captured image 60.
　次に、設定部４２Ｃが、初期設定情報を読取る（ステップＳ１０６）。ここで、本実施の形態では、記憶部４６は、撮影時刻が昼である場合と、撮影時刻が夜である場合と、の各々に対応する、初期設定情報を予め記憶している。設定部４２Ｃは、記憶部４６から、ステップＳ１０４で判定した撮影時刻、本実施の形態では昼または夜に対応する初期設定情報を記憶部４６から読取る。これにより、設定部４２Ｃは、初期設定情報を読取る。 Next, the setting unit 42C reads the initial setting information (step S106). Here, in the present embodiment, the storage unit 46 stores in advance initial setting information corresponding to each of the case where the shooting time is daytime and the case where the shooting time is nighttime. The setting unit 42C reads from the storage unit 46 the initial setting information corresponding to the shooting time determined in step S104, which is day or night in the present embodiment, from the storage unit 46. Thereby, the setting unit 42C reads the initial setting information.
　次に、設定部４２Ｃは、ステップＳ１０６で読取った初期設定情報に基づいて、ステップＳ１００で取得した撮影画像６０に、検出対象領域５０を設定する（ステップＳ１０８）。 Next, the setting unit 42C sets the detection target region 50 in the captured image 60 acquired in step S100 based on the initial setting information read in step S106 (step S108).
　次に、明度算出部４２Ｄが、ステップＳ１００で取得した撮影画像６０における、ステップＳ１０８で設定した検出対象領域５０に含まれる複数の検出領域５２の各々の、明度を算出する（ステップＳ１１０）。 Next, the brightness calculation unit 42D calculates the brightness of each of the plurality of detection areas 52 included in the detection target area 50 set in step S108 in the captured image 60 acquired in step S100 (step S110).
　そして、明度算出部４２Ｄは、算出した検出領域５２の各々の明度を、該検出領域５２の各々の識別情報、本実施の形態では画素位置と、ステップＳ１０４の判定結果と、に対応づけて、記憶部４６へ記憶する（ステップＳ１１２）。 Then, the brightness calculation unit 42D associates the calculated brightness of each detection area 52 with each identification information of the detection area 52, in this embodiment, the pixel position, and the determination result of step S104. It memorize | stores in the memory | storage part 46 (step S112).
　次に、変化量算出部４２Ｅが、ステップＳ１００で取得した撮影画像６０における、ステップＳ１０８で設定した検出対象領域５０に含まれる複数の検出領域５２の各々の、前回算出した明度に対する変化量を算出する（ステップＳ１１４）。 Next, the change amount calculation unit 42E calculates the change amount with respect to the previously calculated brightness of each of the plurality of detection regions 52 included in the detection target region 50 set in step S108 in the captured image 60 acquired in step S100. (Step S114).
　なお、本実施の形態では、記憶部４６は、検出領域５２の各々の、基準明度を予め記憶する。ステップＳ１１４では、変化量算出部４２Ｅは、複数の検出領域５２の各々ごとに、ステップＳ１１０で算出した明度と基準明度との差を算出する。これによって、変化量算出部４２Ｅは、複数の検出領域５２の各々の変化量を算出する。 In the present embodiment, the storage unit 46 stores the reference brightness of each detection area 52 in advance. In step S114, the change amount calculation unit 42E calculates the difference between the lightness calculated in step S110 and the reference lightness for each of the plurality of detection regions 52. Thereby, the change amount calculation unit 42E calculates the change amount of each of the plurality of detection regions 52.
　そして、変化量算出部４２Ｅは、算出した検出領域５２の各々の変化量を、該検出領域５２の各々の識別情報、本実施の形態では画素位置と、ステップＳ１０４の判定結果と、に対応づけて、記憶部４６へ記憶する（ステップＳ１１６）。 Then, the change amount calculation unit 42E associates each calculated change amount of the detection region 52 with each identification information of the detection region 52, in this embodiment, the pixel position and the determination result of step S104. And stored in the storage unit 46 (step S116).
　次に、重付算出部４２Ｆが、記憶部４６から、検出領域５２の各々の重み付け値の初期値を読取る（ステップＳ１１８）。本実施の形態では、記憶部４６は、検出領域５２の各々の重み付け値の初期値を予め記憶する。重付算出部４２Ｆは、記憶部４６から重み付け値の初期値を読取ることで、ステップＳ１１８の処理を行えばよい。 Next, the weight calculation unit 42F reads the initial value of each weighted value in the detection area 52 from the storage unit 46 (step S118). In the present embodiment, the storage unit 46 stores in advance the initial value of each weighting value of the detection area 52. The weight calculation unit 42F may perform the process of step S118 by reading the initial value of the weighting value from the storage unit 46.
　次に、露出制御部４２Ｇが、複数の検出領域５２の各々の重み付け明度を算出する（ステップＳ１２０）。露出制御部４２Ｇは、複数の検出領域５２の各々について、ステップＳ１１０で算出した検出領域５２の各々の明度に、ステップＳ１１８で読取った重み付け値の初期値を乗算する。そして、露出制御部４２Ｇは、この乗算結果を、複数の検出領域５２の各々の重み付け明度として算出する。 Next, the exposure control unit 42G calculates the weighted lightness of each of the plurality of detection regions 52 (step S120). For each of the plurality of detection regions 52, the exposure control unit 42G multiplies the brightness of each detection region 52 calculated in step S110 by the initial value of the weighting value read in step S118. Then, the exposure control unit 42G calculates the multiplication result as the weighted brightness of each of the plurality of detection regions 52.
　次に、露出制御部４２Ｇは、ステップＳ１０８で撮影画像６０上に設定した検出対象領域５０の明度を算出する（ステップＳ１２２）。ステップＳ１２２では、露出制御部４２Ｇは、ステップＳ１２０で算出した、複数の検出領域５２の各々の重み付け明度の平均値を、該検出対象領域５０の明度として算出する。 Next, the exposure control unit 42G calculates the brightness of the detection target region 50 set on the captured image 60 in step S108 (step S122). In step S122, the exposure control unit 42G calculates the average value of the weighted brightness values of each of the plurality of detection areas 52 calculated in step S120 as the brightness value of the detection target area 50.
　次に、露出制御部４２Ｇは、ステップＳ１２２で算出した、検出対象領域５０の明度に基づいて、露出制御値を算出する（ステップＳ１２４）。そして、露出制御部４２Ｇは、ステップＳ１２４で算出した露出制御値を用いて、撮影部１２を制御することで、露出制御を行う（ステップＳ１２６）。このため、ステップＳ１２２で撮影された露出制御値に基づいた露出制御のなされた、撮影画像が得られる。 Next, the exposure control unit 42G calculates an exposure control value based on the brightness of the detection target region 50 calculated in step S122 (step S124). Then, the exposure control unit 42G performs exposure control by controlling the photographing unit 12 using the exposure control value calculated in step S124 (step S126). For this reason, a photographed image with exposure control based on the exposure control value photographed in step S122 is obtained.
　次に、制御部４２は、撮影処理を終了するか否かを判断する（ステップＳ１２８）。 Next, the control unit 42 determines whether or not to end the photographing process (step S128).
　制御部４２は、ユーザによる操作部３８の操作指示などによって、撮影終了を示す指示信号や、電源ＯＦＦを示す信号を受付けた場合に、ステップＳ１２８で肯定判断する（ステップＳ１２８：Ｙｅｓ）。ステップＳ１２８で肯定判断すると（ステップＳ１２８：Ｙｅｓ）、本ルーチンを終了する。ステップＳ１２８で否定判断すると（ステップＳ１２８：Ｎｏ）、ステップＳ１００へ戻る。 The control unit 42 makes an affirmative determination in step S128 when an instruction signal indicating the end of shooting or a signal indicating power OFF is received by an operation instruction of the operation unit 38 by the user (step S128: Yes). If an affirmative determination is made in step S128 (step S128: Yes), this routine ends. If a negative determination is made in step S128 (step S128: No), the process returns to step S100.
　なお、制御部４２は、撮影部１２の出荷後において、撮影時刻の判定結果が昼であった場合と、夜であった場合と、の各々について、ステップＳ１０４～ステップＳ１２８の処理を行う。 Note that the control unit 42 performs the processing from step S104 to step S128 for each of the case where the determination result of the photographing time is noon and the case after night after the photographing unit 12 is shipped.
　一方、上記ステップＳ１０２で否定判断すると（ステップＳ１２０：Ｎｏ）、ステップＳ１３０へ進む。 On the other hand, if a negative determination is made in step S102 (step S120: No), the process proceeds to step S130.
　ステップＳ１３０では、判定部４２Ｂが、ステップＳ１００で取得した撮影画像６０の撮影時刻が昼であるか夜であるかを判定する（ステップＳ１３０）。そして、判定部４２Ｂは、判定結果を、該撮影画像６０の識別情報に対応づけて記憶部４６へ記憶する。 In step S130, the determination unit 42B determines whether the shooting time of the captured image 60 acquired in step S100 is daytime or nighttime (step S130). Then, the determination unit 42 </ b> B stores the determination result in the storage unit 46 in association with the identification information of the captured image 60.
　次に、更新部４２Ｈが、前回設定した検出対象領域５０を用いて、前回算出した検出領域５２の各々の明度の変化量を、記憶部４６から読取る（ステップＳ１３２）。更新部４２Ｈは、ステップＳ１３０の判定結果、本実施の形態では昼または夜に対応する、前回、明度算出部４２Ｄが算出した明度の変化量を、検出領域５２ごとに読取る（ステップＳ１３２）。 Next, the update unit 42H uses the previously set detection target region 50 to read the lightness change amount of each detection region 52 calculated from the storage unit 46 (step S132). The update unit 42H reads, for each detection region 52, the lightness change amount calculated by the lightness calculation unit 42D last time corresponding to the determination result of step S130, which is day or night in the present embodiment (step S132).
　次に、更新部４２Ｈは、ステップＳ１３２で読取った変化量を用いて、検出領域５２の各々の変化量比を算出する（ステップＳ１３４）。 Next, the update unit 42H calculates the change amount ratio of each of the detection regions 52 using the change amount read in step S132 (step S134).
　そして、更新部４２Ｈは、複数の検出領域５２の各々の変化量比に基づいて、設定情報を更新する（ステップＳ１３６）。 Then, the update unit 42H updates the setting information based on the change amount ratio of each of the plurality of detection areas 52 (step S136).
　すなわち、更新部４２Ｈは、ステップＳ１３４で算出した変化量比を用いて、新たな設定情報を算出する。そして、更新部４２Ｈは、新たに算出した設定情報を、記憶部４６に記憶されている設定情報、または初期設定情報に上書き記憶する。このとき、更新部４２Ｈは、記憶部４６に記憶されている、直前の上記ステップＳ１３０の判定結果、本実施の形態では昼または夜と同じ判定結果に対応する設定情報に、新たに算出した設定情報を上書きして記憶する。 That is, the updating unit 42H calculates new setting information using the change amount ratio calculated in step S134. Then, the update unit 42H overwrites and stores the newly calculated setting information over the setting information stored in the storage unit 46 or the initial setting information. At this time, the update unit 42H newly sets the setting information stored in the storage unit 46 in the setting information corresponding to the determination result of the immediately preceding step S130, in the present embodiment, the same determination result as day or night. Overwrite and store information.
　これにより、更新部４２Ｈは、設定情報を更新する。また、更新部４２Ｈは、判定部４２Ｂによる撮影時間の判定結果、本実施の形態では昼または夜ごとに、設定情報を更新することとなる。 Thereby, the updating unit 42H updates the setting information. In addition, the update unit 42H updates the setting information every day or night in the present embodiment, which is the result of the shooting time determination by the determination unit 42B.
　次に、設定部４２Ｃは、記憶部４６から設定情報を読取る（ステップＳ１３８）。すなわち、設定部４２Ｃは、ステップＳ１３６の処理によって更新部４２Ｈで更新された設定情報を読取る。 Next, the setting unit 42C reads the setting information from the storage unit 46 (step S138). That is, the setting unit 42C reads the setting information updated by the update unit 42H by the process of step S136.
　次に、設定部４２Ｃは、ステップＳ１３８で読取った設定情報に基づいて、ステップＳ１００で取得した撮影画像６０に、検出対象領域５０を設定する（ステップＳ１４０）。 Next, the setting unit 42C sets the detection target region 50 in the captured image 60 acquired in step S100 based on the setting information read in step S138 (step S140).
　このため、設定部４２Ｃは、更新前の設定情報に基づいて設定された検出対象領域５０とは、異なる設定情報に基づいた、新たな検出対象領域５０を、ステップＳ１００で新たに取得した撮影画像６０に設定する。 For this reason, the setting unit 42C obtains a new detection target region 50 based on the setting information different from the detection target region 50 set based on the setting information before the update in the step S100. Set to 60.
　次に、明度算出部４２Ｄが、ステップＳ１００で取得した撮影画像６０における、ステップＳ１４０で設定した検出対象領域５０に含まれる複数の検出領域５２の各々の、明度を算出する（ステップＳ１４２）。 Next, the brightness calculation unit 42D calculates the brightness of each of the plurality of detection areas 52 included in the detection target area 50 set in step S140 in the captured image 60 acquired in step S100 (step S142).
　そして、明度算出部４２Ｄは、算出した検出領域５２の各々の明度を、該検出領域５２の各々の識別情報（、本実施の形態では画素位置と、ステップＳ１３０の判定結果と、に対応づけて、記憶部４６へ記憶する（ステップＳ１４４）。 Then, the brightness calculation unit 42D associates the calculated brightness of each detection region 52 with each identification information of the detection region 52 (in the present embodiment, the pixel position and the determination result of step S130). And stored in the storage unit 46 (step S144).
　次に、変化量算出部４２Ｅが、ステップＳ１００で取得した撮影画像６０における、ステップＳ１４０で設定した検出対象領域５０に含まれる複数の検出領域５２の各々の、前回算出した明度に対する変化量を算出する（ステップＳ１４６）。 Next, the change amount calculation unit 42E calculates the change amount with respect to the previously calculated brightness of each of the plurality of detection regions 52 included in the detection target region 50 set in step S140 in the captured image 60 acquired in step S100. (Step S146).
　ステップＳ１４６では、変化量算出部４２Ｅは、直前の上記ステップＳ１３０の判定結果、本実施形態では昼または夜と同じ判定結果に対応する、前回算出した、検出領域５２の各々の明度に対する変化量を算出する。 In step S146, the change amount calculation unit 42E calculates the change amount for each lightness of the detection region 52, which was calculated last time, corresponding to the determination result of the previous step S130, which is the same determination result as day or night in this embodiment. calculate.
　そして、変化量算出部４２Ｅは、算出した検出領域５２の各々の変化量を、該検出領域５２の各々の識別情報本実施の形態では画素位置と、ステップＳ１３０の判定結果と、に対応づけて、記憶部４６へ記憶する（ステップＳ１４８）。 Then, the change amount calculation unit 42E associates the calculated change amounts of the detection regions 52 with the respective pieces of identification information of the detection regions 52 in the present embodiment and the determination results of step S130. Then, it is stored in the storage unit 46 (step S148).
　次に、重付算出部４２Ｆが、検出領域５２の各々の重み付け値を算出する（ステップＳ１５０）。例えば、重付算出部４２Ｆは、ステップＳ１４６で算出した変化量を用いて、複数の検出領域５２の各々の、明度の変化量比を算出するように、変化量算出部４２Ｅを制御する。変化量算出部４２Ｅは、上記と同様にして、複数の検出領域５２の各々の明度の変化量比を算出すればよい。そして、重付算出部４２Ｆは、複数の検出領域５２の各々の、明度の変化量比を、複数の検出領域５２の各々の重み付け値として用いればよい。 Next, the weight calculation unit 42F calculates each weighting value of the detection area 52 (step S150). For example, the weight calculation unit 42F controls the change amount calculation unit 42E so as to calculate the lightness change amount ratio of each of the plurality of detection regions 52 using the change amount calculated in step S146. The change amount calculator 42E may calculate the lightness change amount ratio of each of the plurality of detection regions 52 in the same manner as described above. Then, the weight calculation unit 42F may use the brightness change amount ratio of each of the plurality of detection regions 52 as the weighting value of each of the plurality of detection regions 52.
　次に、露出制御部４２Ｇが、複数の検出領域５２の各々の重み付け明度を算出する（ステップＳ１５２）。露出制御部４２Ｇは、複数の検出領域５２の各々について、ステップＳ１４２で算出した検出領域５２の各々の明度に、ステップＳ１５２で算出した、対応する重み付け値を乗算する。そして、露出制御部４２Ｇは、この乗算結果を、複数の検出領域５２の各々の重み付け明度として算出する。 Next, the exposure control unit 42G calculates the weighted brightness of each of the plurality of detection areas 52 (step S152). For each of the plurality of detection regions 52, the exposure control unit 42G multiplies the brightness of each detection region 52 calculated in step S142 by the corresponding weight value calculated in step S152. Then, the exposure control unit 42G calculates the multiplication result as the weighted brightness of each of the plurality of detection regions 52.
　次に、露出制御部４２Ｇは、ステップＳ１４０で設定した検出対象領域５０の明度を算出する（ステップＳ１５４）。ステップＳ１５４では、露出制御部４２Ｇは、ステップＳ１５２で算出した、複数の検出領域５２の各々の重み付け明度の平均値を、該検出対象領域５０の明度として算出する。 Next, the exposure control unit 42G calculates the brightness of the detection target region 50 set in step S140 (step S154). In step S154, the exposure control unit 42G calculates the average value of the weighted brightness of each of the plurality of detection areas 52 calculated in step S152 as the brightness of the detection target area 50.
　次に、露出制御部４２Ｇは、ステップＳ１５４で算出した、検出対象領域５０の明度に基づいて、露出制御値を算出する（ステップＳ１５６）。そして、露出制御部４２Ｇは、ステップＳ１５６で算出した露出制御値を用いて、撮影部１２を制御することで、露出制御を行う（ステップＳ１５８）。このため、ステップＳ１５６で撮影された露出制御値に基づいた露出制御のなされた、撮影画像が得られる。また、判定部４２Ｂによる撮影時刻の判定結果、本実施の形態では昼または夜に応じた露出制御のなされた、撮影画像が得られる。 Next, the exposure control unit 42G calculates an exposure control value based on the lightness of the detection target region 50 calculated in step S154 (step S156). Then, the exposure control unit 42G performs exposure control by controlling the photographing unit 12 using the exposure control value calculated in step S156 (step S158). For this reason, a photographed image with exposure control based on the exposure control value photographed in step S156 is obtained. In addition, as a result of the determination of the shooting time by the determination unit 42B, in the present embodiment, a captured image is obtained in which exposure control is performed according to day or night.
　次に、制御部４２は、撮影処理を終了するか否かを判断する（ステップＳ１６０）。 Next, the control unit 42 determines whether or not to end the photographing process (step S160).
　例えば、制御部４２は、ステップＳ１３０の判定処理から所定時間経過したか否かを判別し、所定時間経過したと判別した場合、ステップＳ１６０で否定判断し（ステップＳ１６０：Ｎｏ）、上記ステップＳ１００へ戻る。この所定時間は、予め設定すればよい。この所定時間は、例えば、予め定めた枚数の撮影画像が取得される時間である。 For example, the control unit 42 determines whether or not a predetermined time has elapsed from the determination processing in step S130. If it is determined that the predetermined time has elapsed, a negative determination is made in step S160 (step S160: No), and the process proceeds to step S100. Return. This predetermined time may be set in advance. This predetermined time is, for example, a time during which a predetermined number of captured images are acquired.
　なお、制御部４２は、撮影装置１０の撮影環境が変化したか否かを判別し、撮影環境が変化したと判別した場合、ステップＳ１６０で否定判断（ステップＳ１６０：Ｎｏ）してもよい。撮影環境の変化は、例えば、所定の明度以上の撮影環境から該所定の明度未満の撮影環境への変化や、所定の明度未満の撮影環境から該所定の明度以上の撮影環境への変化、である。撮影環境の判別には、公知の方法を用いればよい。 Note that the control unit 42 may determine whether or not the shooting environment of the shooting apparatus 10 has changed, and if it is determined that the shooting environment has changed, a negative determination may be made in step S160 (step S160: No). The change in the shooting environment is, for example, a change from a shooting environment having a predetermined brightness or higher to a shooting environment having a brightness lower than the predetermined brightness, or a change from a shooting environment having a predetermined brightness or lower to a shooting environment having the predetermined brightness or higher. is there. A known method may be used to determine the shooting environment.
　また、制御部４２は、ユーザによる操作部３８の操作指示などによって、撮影終了を示す指示信号や、電源ＯＦＦを示すオフ信号を受付けたか否かを判別することで、ステップＳ１６０の判断を行ってもよい。そして、制御部４２は、これらの指示信号やオフ信号を受付けた場合に、ステップＳ１６０で肯定判断（ステップＳ１６０：Ｙｅｓ）してもよい。 In addition, the control unit 42 determines whether or not an instruction signal indicating the end of photographing or an off signal indicating power OFF is received based on an operation instruction of the operation unit 38 by the user, and the determination of step S160 is performed. Also good. And control part 42 may make affirmation judging (Step S160: Yes) at Step S160, when these directions signals and an off signal are received.
　ステップＳ１６０で肯定判断すると（ステップＳ１６０：Ｙｅｓ）、本ルーチンを終了する。 If an affirmative determination is made in step S160 (step S160: Yes), this routine ends.
　以上説明したように、本実施の形態の撮影装置１０は、取得部４２Ａと、設定部４２Ｃと、明度算出部４２Ｄと、変化量算出部４２Ｅと、更新部４２Ｈと、露出制御部４２Ｇと、を備える。取得部４２Ａは、撮影画像を取得する。設定部４２Ｃは、設定情報に基づいて、撮影画像に、複数の検出領域５２を含む検出対象領域５０を設定する。明度算出部４２Ｄは、撮影画像における、検出対象領域５０に含まれる複数の検出領域５２の各々の明度を算出する。変化量算出部４２Ｅは、複数の検出領域５２の各々について、前回算出した明度に対する変化量を算出する。更新部４２Ｈは、複数の検出領域５２の各々の変化量に基づいて、設定情報を更新する。露出制御部４２Ｇは、撮影画像における、更新された設定情報に基づいて設定された検出対象領域５０の明度に基づいて、撮影部１２による撮影時の露出制御を行う。 As described above, the imaging apparatus 10 of the present embodiment includes the acquisition unit 42A, the setting unit 42C, the lightness calculation unit 42D, the change amount calculation unit 42E, the update unit 42H, the exposure control unit 42G, Is provided. The acquiring unit 42A acquires a captured image. The setting unit 42C sets a detection target area 50 including a plurality of detection areas 52 in the captured image based on the setting information. The brightness calculation unit 42D calculates the brightness of each of the plurality of detection areas 52 included in the detection target area 50 in the captured image. The change amount calculation unit 42E calculates the change amount with respect to the previously calculated lightness for each of the plurality of detection regions 52. The update unit 42H updates the setting information based on the amount of change in each of the plurality of detection regions 52. The exposure control unit 42G performs exposure control during shooting by the shooting unit 12 based on the brightness of the detection target region 50 set based on the updated setting information in the shot image.
　このように、本実施の形態では、撮影装置１０は、検出対象領域５０に含まれる複数の検出領域５２の各々の、明度の変化量に基づいて、検出対象領域５０の設定情報を再設定する。このため、撮影装置１０は、新たに取得する撮影画像６０について、再設定された設定情報に基づいて設定された検出対象領域５０の明度を用いて、露出制御を行うことができる。 As described above, in the present embodiment, the imaging apparatus 10 resets the setting information of the detection target region 50 based on the amount of change in brightness of each of the plurality of detection regions 52 included in the detection target region 50. . For this reason, the imaging device 10 can perform exposure control using the brightness of the detection target region 50 set based on the reset setting information for the newly acquired captured image 60.
　すなわち、撮影部１２の設置位置や設置方法などによって撮影環境が異なる場合であっても、検出領域５２の明度の変化量に基づいて検出対象領域５０を再設定することができるので、最適な露出制御を行うことができる。 That is, even if the shooting environment varies depending on the installation position, installation method, and the like of the imaging unit 12, the detection target region 50 can be reset based on the amount of change in the brightness of the detection region 52, so that the optimal exposure is achieved. Control can be performed.
　従って、本実施の形態の撮影装置１０は、最適な露出制御を行うことができる。 Therefore, the photographing apparatus 10 of the present embodiment can perform optimal exposure control.
　また、設定情報は、検出対象領域５０の位置、検出対象領域５０のサイズ、および検出対象領域５０に含まれる検出領域５２の数、の少なくとも１つを含む。 The setting information includes at least one of the position of the detection target region 50, the size of the detection target region 50, and the number of detection regions 52 included in the detection target region 50.
　また、更新部４２Ｈは、複数の検出領域５２の各々について、複数の検出領域５２の変化量の内の最低変化量に対する、検出領域５２の変化量の、変化量比を算出する。そして、更新部４２Ｈは、複数の検出領域５２の各々の変化量比に基づいて、設定情報を更新することができる。 Further, the update unit 42H calculates, for each of the plurality of detection regions 52, a change amount ratio of the change amount of the detection region 52 to the minimum change amount of the change amounts of the plurality of detection regions 52. Then, the update unit 42H can update the setting information based on the change amount ratio of each of the plurality of detection regions 52.
　また、更新部４２Ｈは、複数の検出領域５２の内、変化量比が予め定めた閾値以上の検出領域５２を少なくとも含む領域を、検出対象領域５０として示すように、設定情報を更新することができる。 In addition, the update unit 42H may update the setting information so as to indicate, as the detection target region 50, a region including at least the detection region 52 having a change amount ratio equal to or greater than a predetermined threshold among the plurality of detection regions 52. it can.
　また、更新部４２Ｈは、複数の検出領域５２の内、変化量が予め定めた閾値以上の検出領域５２を少なくとも含む領域を、検出対象領域５０として示すように、設定情報を更新する。 Further, the update unit 42H updates the setting information so as to indicate, as the detection target region 50, a region including at least the detection region 52 whose change amount is equal to or greater than a predetermined threshold among the plurality of detection regions 52.
　また、本実施の形態の撮影装置１０は、重付算出部４２Ｆを備えることができる。露出制御部４２Ｇは、複数の検出領域５２の各々について、複数の検出領域５２の各々の変化量に応じた重み付け値を算出する。露出制御部４２Ｇは、撮影画像上における、更新された設定情報に基づいて設定された検出対象領域５０に含まれる検出領域５２の各々の明度に、対応する重み付け値を付加した重み付け明度を算出する。そして、露出制御部４２Ｇは、検出対象領域５０に含まれる、複数の検出領域５２の各々の重み付け明度の平均値を、該検出対象領域５０の明度として用い、露出制御を行う。 Moreover, the imaging device 10 of the present embodiment can include a weight calculation unit 42F. The exposure control unit 42G calculates, for each of the plurality of detection areas 52, a weight value corresponding to the amount of change in each of the plurality of detection areas 52. The exposure control unit 42G calculates a weighted brightness obtained by adding a corresponding weight value to each brightness of the detection area 52 included in the detection target area 50 set based on the updated setting information on the captured image. . Then, the exposure control unit 42G performs exposure control by using the average value of the weighted brightness of each of the plurality of detection areas 52 included in the detection target area 50 as the brightness of the detection target area 50.
　また、本実施の形態の撮影装置１０は、判定部４２Ｂを備えることができる。判定部４２Ｂは、撮影画像の撮影時刻が昼であるか夜であるかを判定する。更新部４２Ｈは、昼であると判定された場合、および夜であると判定された場合、の各々ごとに、設定情報を更新する。 Moreover, the imaging device 10 of the present embodiment can include a determination unit 42B. The determination unit 42B determines whether the shooting time of the shot image is daytime or nighttime. The update unit 42H updates the setting information for each of the case where it is determined that it is daytime and the case where it is determined that it is night.
　なお、本実施の形態の撮影装置１０で実行される上記各処理を実行するためのプログラムは、ＥＥＰＲＯＭ２４に記憶されていてもよい。また、上記実施の形態の撮影装置１０で実行される上記各処理を実行するためのプログラムは、ＲＯＭ２２に予め組み込まれて提供されていてもよい。 It should be noted that a program for executing the above-described processes executed by the imaging apparatus 10 of the present embodiment may be stored in the EEPROM 24. In addition, a program for executing each of the processes executed by the imaging apparatus 10 according to the embodiment may be provided by being incorporated in the ROM 22 in advance.
　また、本実施の形態の撮影装置１０で実行される上記各処理を実行するためのプログラムは、インストール可能な形式または実行可能な形式のファイルでＣＤ－ＲＯＭ、ＣＤ－Ｒ、メモリカード、ＤＶＤ（Ｄｉｇｉｔａｌ　Ｖｅｒｓａｔｉｌｅ　Ｄｉｓｋ）、フレキシブルディスク（ＦＤ：Ｆｌｅｘｉｂｌｅ　Ｄｉｓｋ）等のコンピュータで読取り可能な記憶媒体に記憶されてコンピュータプログラムプロダクトとして提供されるようにしてもよい。 In addition, a program for executing each of the processes executed by the imaging apparatus 10 of the present embodiment is a file in an installable format or an executable format, and is a CD-ROM, CD-R, memory card, DVD ( It may be stored in a computer-readable storage medium such as a digital versatile disk (FD) or a flexible disk (FD) and provided as a computer program product.
　また、本実施の形態の撮影装置１０で実行される上記各処理を実行するためのプログラムを、インターネット等のネットワークに接続されたコンピュータ上に格納し、ネットワーク経由でダウンロードさせることにより提供するようにしてもよい。また、本実施の形態の撮影装置１０で実行される上記各処理を実行するためのプログラムを、インターネット等のネットワーク経由で提供または配布するようにしてもよい。 Further, a program for executing each of the processes executed by the photographing apparatus 10 of the present embodiment is stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. May be. In addition, a program for executing each of the processes executed by the imaging apparatus 10 of the present embodiment may be provided or distributed via a network such as the Internet.
　なお、上記には、本発明の実施の形態を説明したが、上記実施の形態は、一例として提示したものであり、発明の範囲を限定することは意図していない。この新規な実施の形態は、その他の様々な形態で実施されることが可能であり、発明の要旨を逸脱しない範囲で、種々の省略、置き換え、変更を行うことができる。本実施の形態は、発明の範囲や要旨に含まれるとともに、特許請求の範囲に記載された発明とその均等の範囲に含まれる。 In addition, although embodiment of this invention was described above, the said embodiment is shown as an example and is not intending limiting the range of invention. The novel embodiment can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. The present embodiment is included in the scope and gist of the invention, and is included in the invention described in the claims and the equivalent scope thereof.
　例えば、上記実施の形態のフローチャートにおける各ステップを、その性質に反しない限り、実行順序を変更し、複数同時に実施し、あるいは実施毎に異なった順序で実施してもよい。 For example, as long as each step in the flowchart of the above embodiment is not contrary to the nature, the execution order may be changed, a plurality of steps may be performed simultaneously, or may be performed in a different order for each execution.
１０　撮影装置
１２　撮影部
４２Ａ　取得部
４２Ｂ　判定部
４２Ｃ　設定部
４２Ｄ　明度算出部
４２Ｅ　変化量算出部
４２Ｆ　重付算出部
４２Ｇ　露出制御部
４２Ｈ　更新部 DESCRIPTION OF SYMBOLS 10 Imaging device 12 Imaging | photography part 42A Acquisition part 42B Determination part 42C Setting part 42D Brightness calculation part 42E Change amount calculation part 42F Weight calculation part 42G Exposure control part 42H Update part

Claims (9)

  1. 　撮影画像を取得する取得部と、
    　設定情報に基づいて、前記撮影画像に、複数の検出領域を含む検出対象領域を設定する設定部と、
    　前記撮影画像における、前記検出対象領域に含まれる複数の前記検出領域の各々の明度を算出する明度算出部と、
    　複数の検出領域の各々について、前回算出した明度に対する変化量を算出する変化量算出部と、
    　複数の前記検出領域の各々の前記変化量に基づいて、前記設定情報を更新する更新部と、
    　前記撮影画像における、更新された前記設定情報に基づいて設定された前記検出対象領域の明度に基づいて、撮影部による撮影時の露出制御を行う露出制御部と、
    　を備える撮影装置。     An acquisition unit for acquiring a captured image;
    A setting unit configured to set a detection target area including a plurality of detection areas in the captured image based on setting information;
    A brightness calculation unit that calculates the brightness of each of the plurality of detection areas included in the detection target area in the captured image;
    For each of the plurality of detection areas, a change amount calculation unit that calculates a change amount with respect to the lightness calculated previously,
    An update unit that updates the setting information based on the amount of change in each of the plurality of detection regions;
    An exposure control unit that performs exposure control at the time of photographing by the photographing unit, based on the brightness of the detection target region set based on the updated setting information in the photographed image;
    An imaging device comprising:
  2. 　前記設定情報は、前記検出対象領域の位置、前記検出対象領域のサイズ、および前記検出対象領域に含まれる前記検出領域の数、の少なくとも１つを含む、請求項１に記載の撮影装置。 The imaging apparatus according to claim 1, wherein the setting information includes at least one of a position of the detection target area, a size of the detection target area, and a number of the detection areas included in the detection target area.
  3. 　前記更新部は、
    　複数の前記検出領域の各々について、複数の前記検出領域の前記変化量の内の最低変化量に対する、前記検出領域の前記変化量の、変化量比を算出し、
    　複数の前記検出領域の各々の前記変化量比に基づいて、前記設定情報を更新する、
    　請求項１または請求項２に記載の撮影装置。     The update unit
    For each of the plurality of detection regions, calculate a change amount ratio of the change amount of the detection region to the minimum change amount of the change amounts of the plurality of detection regions,
    Updating the setting information based on the change amount ratio of each of the plurality of detection regions;
    The imaging device according to claim 1 or 2.
  4. 　前記更新部は、
    　複数の前記検出領域の内、前記変化量比が予め定めた閾値以上の前記検出領域を少なくとも含む領域を前記検出対象領域として示すように、前記設定情報を更新する、
    　請求項１～請求項３の何れか１項に記載の撮影装置。     The update unit
    Updating the setting information so as to indicate, as the detection target region, a region including at least the detection region having a change amount ratio equal to or greater than a predetermined threshold among the plurality of detection regions;
    The photographing apparatus according to any one of claims 1 to 3.
  5. 　前記更新部は、
    　複数の前記検出領域の内、前記変化量が予め定めた閾値以上の前記検出領域を少なくとも含む領域を、前記検出対象領域として示すように、前記設定情報を更新する、
    　請求項１に記載の撮影装置。     The update unit
    Updating the setting information so as to indicate, as the detection target area, an area including at least the detection area having a change amount equal to or greater than a predetermined threshold among the plurality of detection areas;
    The imaging device according to claim 1.
  6. 　複数の前記検出領域の各々について、複数の前記検出領域の各々の前記変化量に応じた重み付け値を算出する重付算出部を備え、
    　前記露出制御部は、
    　前記撮影画像上における、更新された前記設定情報に基づいて設定された前記検出対象領域に含まれる前記検出領域の各々の明度に、対応する前記重み付け値を付加した重み付け明度を算出し、
    　前記検出対象領域に含まれる、複数の前記検出領域の各々の前記重み付け明度の平均値を、該検出対象領域の明度として用い、前記露出制御を行う、
    　請求項１～請求項５の何れか１項に記載の撮影装置。     For each of the plurality of detection regions, a weight calculation unit that calculates a weighting value according to the amount of change of each of the plurality of detection regions,
    The exposure control unit
    On the photographed image, a weighted brightness obtained by adding the corresponding weight value to the brightness of each of the detection areas included in the detection target area set based on the updated setting information,
    Using the average value of the weighted brightness of each of the plurality of detection areas included in the detection target area as the brightness of the detection target area, the exposure control is performed.
    The photographing apparatus according to any one of claims 1 to 5.
  7. 　前記撮影画像の撮影時刻が昼であるか夜であるかを判定する判定部を備え、
    　前記更新部は、昼であると判定された場合、および夜であると判定された場合、の各々ごとに、前記設定情報を更新する、
    　請求項１～請求項６の何れか１項に記載の撮影装置。     A determination unit for determining whether the shooting time of the captured image is daytime or night;
    The update unit updates the setting information for each of the case where it is determined that it is daytime and the case where it is determined that it is night.
    The photographing apparatus according to any one of claims 1 to 6.
  8. 　撮影画像を取得するステップと、
    　設定情報に基づいて、前記撮影画像に、複数の検出領域を含む検出対象領域を設定するステップと、
    　前記撮影画像における、前記検出対象領域に含まれる複数の前記検出領域の各々の明度を算出するステップと、
    　複数の検出領域の各々について、前回算出した明度に対する変化量を算出するステップと、
    　複数の前記検出領域の各々の前記変化量に基づいて、前記設定情報を更新するステップと、
    　前記撮影画像における、更新された前記設定情報に基づいて設定された前記検出対象領域の明度に基づいて、撮影部による撮影時の露出制御を行うステップと、
    　を含む、撮影方法。     Acquiring a captured image;
    Setting a detection target area including a plurality of detection areas in the captured image based on setting information;
    Calculating the brightness of each of the plurality of detection areas included in the detection target area in the captured image;
    For each of the plurality of detection areas, calculating a change amount with respect to the previously calculated brightness;
    Updating the setting information based on the amount of change in each of the plurality of detection regions;
    Performing exposure control at the time of photographing by a photographing unit based on the brightness of the detection target region set based on the updated setting information in the photographed image;
    Including shooting method.
  9. 　撮影画像を取得するステップと、
    　設定情報に基づいて、前記撮影画像に、複数の検出領域を含む検出対象領域を設定するステップと、
    　前記撮影画像における、前記検出対象領域に含まれる複数の前記検出領域の各々の明度を算出するステップと、
    　複数の検出領域の各々について、前回算出した明度に対する変化量を算出するステップと、
    　複数の前記検出領域の各々の前記変化量に基づいて、前記設定情報を更新するステップと、
    　前記撮影画像における、更新された前記設定情報に基づいて設定された前記検出対象領域の明度に基づいて、撮影部による撮影時の露出制御を行うステップと、
    　をコンピュータに実行させるためのプログラム。     Acquiring a captured image;
    Setting a detection target area including a plurality of detection areas in the captured image based on setting information;
    Calculating the brightness of each of the plurality of detection areas included in the detection target area in the captured image;
    For each of the plurality of detection areas, calculating a change amount with respect to the previously calculated brightness;
    Updating the setting information based on the amount of change in each of the plurality of detection regions;
    Performing exposure control at the time of photographing by a photographing unit based on the brightness of the detection target region set based on the updated setting information in the photographed image;
    A program that causes a computer to execute.
PCT/JP2016/069015 2015-08-27 2016-06-27 Image capture device, image capture method, and program WO2017033559A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015-167953 2015-08-27
JP2015167953A JP2017046217A (en) 2015-08-27 2015-08-27 Photographing apparatus, photographing method, and program

Publications (1)

Publication Number Publication Date
WO2017033559A1 true WO2017033559A1 (en) 2017-03-02

Family

ID=58099871

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/069015 WO2017033559A1 (en) 2015-08-27 2016-06-27 Image capture device, image capture method, and program

Country Status (2)

Country Link
JP (1) JP2017046217A (en)
WO (1) WO2017033559A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110892708B (en) 2017-08-18 2021-07-30 富士胶片株式会社 Image pickup apparatus, control method of image pickup apparatus, and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08214208A (en) * 1995-02-08 1996-08-20 Fujitsu General Ltd Method for correcting exposure of monitor camera
JP2005148308A (en) * 2003-11-13 2005-06-09 Denso Corp Exposure controller for white line detection camera
JP2008292663A (en) * 2007-05-23 2008-12-04 Fujifilm Corp Camera and portable electronic equipment
JP2010219864A (en) * 2009-03-17 2010-09-30 Konica Minolta Opto Inc Imaging apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08214208A (en) * 1995-02-08 1996-08-20 Fujitsu General Ltd Method for correcting exposure of monitor camera
JP2005148308A (en) * 2003-11-13 2005-06-09 Denso Corp Exposure controller for white line detection camera
JP2008292663A (en) * 2007-05-23 2008-12-04 Fujifilm Corp Camera and portable electronic equipment
JP2010219864A (en) * 2009-03-17 2010-09-30 Konica Minolta Opto Inc Imaging apparatus

Also Published As

Publication number Publication date
JP2017046217A (en) 2017-03-02

Similar Documents

Publication Publication Date Title
JP5398156B2 (en) WHITE BALANCE CONTROL DEVICE, ITS CONTROL METHOD, AND IMAGING DEVICE
JP6267502B2 (en) IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, AND PROGRAM
JP2011182387A (en) Imaging device, warning method, and program
US20150042839A1 (en) Distance measuring apparatus, imaging apparatus, and distance measuring method
JP6559366B2 (en) Blur correction apparatus, imaging apparatus, and blur correction method
JP6525543B2 (en) IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND PROGRAM
US9066003B2 (en) Apparatus for adjusting autofocus using luminance correction and method of controlling the same
US9762805B2 (en) Image processing apparatus performing tone correction process and method, and image capturing apparatus performing tone correction process
US10972676B2 (en) Image processing method and electronic device capable of optimizing hdr image by using depth information
WO2014188647A1 (en) Image adjustment device, image adjustment method, image adjustment program, and image capture device
WO2017033559A1 (en) Image capture device, image capture method, and program
JP5062072B2 (en) Camera system and table adjustment method
US11727716B2 (en) Information processing apparatus, imaging apparatus, which determines exposure amount with respect to face detection and human body detection
US11575841B2 (en) Information processing apparatus, imaging apparatus, method, and storage medium
JP5880121B2 (en) Image processing device
JP6245847B2 (en) Image processing apparatus and image processing method
JP2021182673A (en) Image processing device, image processing method, and program
CN109479100B (en) Image processing apparatus, image processing method, and program
JP6381212B2 (en) Imaging apparatus and control method thereof
JP2013186560A (en) Image processing apparatus
JP2019176302A (en) Image processing device, image processing method, and program
JP5943682B2 (en) Imaging apparatus, control method thereof, and program
JP7353864B2 (en) Information processing device, control method and program for information processing device, imaging system
US20230276134A1 (en) Information processing apparatus, imaging apparatus, method, and storage medium
JP2001086396A (en) Image-pickup device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16838906

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16838906

Country of ref document: EP

Kind code of ref document: A1