JP2015177313A - digital camera - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an image of a subject which generates steam or cool air, with much reality.SOLUTION: A digital camera 1 comprises: a determination unit 26 which, on the basis of the temperature of a subject measured by an infrared radiation thermometer 20 and an outside air temperature measured by a temperature sensor 24, determines whether or not the subject is generating steam or cool air; and image synthesis means which, when the determination unit 26 determines that the subject is generating steam or cool air, synthesizes a subject image captured without use of light emission by a light emission unit (stroboscope) 13 and the image of the steam or cool air in a subject image captured by light emission by the light emission unit (stroboscope) 13.

Description

  The present invention relates to a digital camera having a function of capturing an image based on subject information and combining a plurality of captured images.

  2. Description of the Related Art When a subject image of a dish such as yudofu is recognized by image analysis, a reproduction effect device that reproduces an animation image such as steam superimposed on the subject image is known. Animation images such as steam used for the effect processing are stored in advance as effect template images in the storage device (see, for example, Patent Document 1).

JP 2010-237516 A

  However, in the reproduction effect device disclosed in Patent Document 1, the effect template image stored in advance in the storage device is superimposed on the subject image, so that the image obtained by combining the subject image and the effect template image is an image with poor realism. There is a problem that it ends up.

  According to a first aspect of the present invention, there is provided a digital camera for photographing a subject, a light emitting unit for emitting illumination light to the subject, a first thermometer for measuring the temperature of the subject, and measuring an outside air temperature. Based on the second thermometer, the temperature of the subject measured with the first thermometer, and the outside air temperature measured with the second thermometer, whether or not steam or cold is generated from the subject is determined. A judgment means for judging, and when the judgment means judges that the steam or cold is generated, the subject image was taken without emitting light by the light emitting means, and the subject image was taken by emitting light from the light emitting means Image synthesizing means for synthesizing steam or cold images in the subject image.

  According to the digital camera of the first aspect of the present invention, the subject image captured without light emission by the light emitting means and the steam or cold image in the subject image captured by light emission by the light emitting means are combined. A composite image rich in realism can be obtained.

It is a block diagram which shows the structure of the principal part of the digital camera which concerns on the 1st Embodiment of this invention. It is the schematic which shows the imaging | photography condition of the to-be-photographed object which has generated the steam by the digital camera which concerns on the 1st Embodiment of this invention. It is the schematic of the to-be-photographed object which has generate | occur | produced cold. It is a flowchart explaining operation | movement of the digital camera which concerns on the 1st Embodiment of this invention. It is an example of the temperature table which the judgment part of the digital camera which concerns on the 1st Embodiment of this invention has. FIGS. 6A and 6B are diagrams showing image composition by an image composition processing unit of the digital camera according to the embodiment of the present invention, FIG. 6A is an image before image composition, FIG. 6B is a partial image of steam, and FIG. c) is a subject image, and FIG. 6D is a composite image. It is a block diagram which shows the structure of the principal part of the digital camera which concerns on the 2nd Embodiment of this invention. FIGS. 8A and 8B are diagrams illustrating the state of heat fluctuation from a subject. FIG. 8A is a schematic diagram of a subject generating steam, and FIG. 8B is a diagram illustrating a temperature change of the subject over time. It is a graph. It is an example of the infrared thermography obtained with the digital camera of the modification of this Embodiment.

The configuration of a digital camera according to an embodiment of the present invention will be described below with reference to the drawings.
-First embodiment-
<Configuration>
Referring to FIG. 1, the digital camera 1 according to the present embodiment performs shooting by a shooting unit 10 including a shooting lens 11, an image sensor 12, and a light emitting unit (strobe) 13. The light emitting unit 13 irradiates a subject with flash light for performing flash photography. As the light emitting unit 13, there are one using an arc tube and one using an LED.

  Light from the subject forms an image on the photoelectric conversion surface of the image pickup device 12 via the photographing lens 11, and the image pickup device 12 photoelectrically converts the formed subject image and outputs an image signal. The image signal is temporarily recorded in the buffer memory 14 and output from the buffer memory 14 to the image processing unit 15, and various image processing, for example, white balance adjustment and gamma correction is performed in the image processing unit 15. Later, it is stored as image data in the internal memory 16.

  The digital camera 1 of the present embodiment also has a temperature measurement function, and performs two-system temperature measurement. In the first system, the temperature of an object surface, that is, the surface temperature of a predetermined portion of a subject is measured in a non-contact manner by an infrared radiation thermometer 20 including an infrared lens 21, an infrared sensor 22, and an infrared / temperature converter 23. . Such an infrared radiation thermometer 20 can measure the surface temperature of a solid or liquid in a non-contact manner, but cannot accurately measure the temperature of a gas or the internal temperature of a solid or liquid.

  Note that the temperature of the subject at the center position of the through image can be measured by matching the temperature measurement direction by the first system with the shooting direction by the shooting unit 10. Specifically, the temperature of the subject at the center position of the through image can be measured by matching the optical axis direction of the infrared lens 21 with the optical axis direction of the photographing lens 11.

  In the second system, the outside air temperature is measured by the temperature sensor 24 and the voltage / temperature conversion unit 25. For example, a thermocouple or a thermistor is used as such a thermometer. Here, the outside air temperature includes both the ambient temperature of the subject and the ambient temperature of the digital camera 1.

  The determination unit 26 inputs the surface temperature data of the subject output from the infrared / temperature conversion unit 23 and the outside air temperature data output from the voltage / temperature conversion unit 25, and from the subject based on these two temperature data. Determine whether steam or cold is occurring. As an example, the determination unit 26 has a temperature table 26a that stores temperature conditions for generating steam or cold. By comparing the two measured temperature data with the temperature table 26a, the occurrence of steam or cold is generated. Judgment is made.

  When the shooting control unit 27 controls the flash 13 to emit light or not, or receives a determination signal from the determination unit 26 that steam or cold is generated, the shooting control unit 27 does not emit light when shooting the flash 13. The mode is shifted to the “steam / cold shooting mode” in which shooting is performed twice, and shooting by the shooting unit 10 is executed. The photographing unit 10 performs photographing with light emission and photographing without light emission on the same subject in the “steam / cold air photographing mode”. The two photographed image data are stored as image data in the internal memory 16 after being subjected to image processing by the image processing unit 15.

  FIG. 2 shows an example of shooting with the strobe 13 lit, and shows a scene in which the strobe 13 is lit and shot with respect to a subject 101 in which steam 102 is generated, for example, a hot dish such as ramen. Steam is condensed by the water vapor being cooled by outside air at a low temperature to form fine water droplets, and appears white because it scatters light. Since the irradiation light from the strobe 13 is scattered by steam, the steam portion can be emphasized white and photographed.

  FIG. 3 shows a subject 201 in which cold air 202 is generated, for example, a cold object such as an ice lolly. When cold air touches a cold object, water vapor in the air condenses into fine water droplets, and cold air also appears white because it scatters light like steam. Since the irradiation light from the strobe 13 is scattered by cold air, the cold air portion can be emphasized white and photographed.

  Returning to FIG. 1, the image composition processing unit 28 reads two pieces of captured image data for the same subject stored in the internal memory 16, and generates a partial image of steam or cold taken by the flash 13 and a flash. 13 is combined with the subject image captured without causing light to be emitted to generate a composite image. The composite image data is stored in the memory card 30.

<Operation>
Next, the operation of the digital camera 1 will be described with reference to FIGS.
Referring to the flowchart of FIG. 4, in step S11, the temperature sensor 24 and the voltage / temperature conversion unit 25 measure the outside air temperature, and in step S12, the infrared radiation thermometer 20 measures the temperature at a predetermined position of the subject. As described above, by making the optical axis direction of the infrared lens 21 coincide with the optical axis direction of the photographing lens 11, the surface temperature of the subject at the center position of the through image can be measured.

  In step S13, the determination unit 26 inputs the outside air temperature data output from the voltage / temperature conversion unit 25 and the surface temperature data of the subject output from the infrared / temperature conversion unit 23, and converts the two temperature data into temperatures. By comparing with the table 26a, it is determined whether steam or cold is generated.

  The table in FIG. 5 is an example of the temperature table 26a, and is composed of combinations of the temperature of the outside air and the temperature of the subject. In the temperature table 26a, three conditions for generating steam or cold are described. Condition A is that steam is generated when the outside air temperature is 10 ° C. or lower and the subject temperature is 45 ° C. or higher, and the subject example is a hot spring. Condition B is that steam is generated when the outside air temperature is 15 ° C. or lower and the subject temperature is 70 ° C. or higher, and the subject example is ramen. Condition C is that cold air is generated when the outside air temperature is 30 ° C. or higher and the subject temperature is 5 ° C. or lower, and the subject example is an ice lolly.

Hereinafter, the operation after step S14 in the flowchart of FIG. 4 will be described with reference to the temperature table 26a of FIG.
If the outside air temperature is 10 ° C. or less in step S14, the process proceeds to step S15. If the subject temperature is 45 ° C. or more in step S15, the process proceeds to step S16, and the determination unit 26 determines that steam is generated. This corresponds to the condition A of the temperature table 26a in FIG.

  If a negative determination is made in step S14, the process proceeds to step S17. If the outside air temperature is 15 ° C. or lower in step S17, the process proceeds to step S18. If the subject temperature is 70 ° C. or higher in step S18, the process proceeds to step S19. The determination unit 26 determines that steam is generated. This corresponds to the condition B of the temperature table 26a in FIG.

  If a negative determination is made in step S17, the process proceeds to step S20. If the outside air temperature is 30 ° C. or higher in step S20, the process proceeds to step S21. If the subject temperature is 5 ° C. or less in step S21, the process proceeds to step S22. The determination unit 26 determines that cold air is generated. This corresponds to the condition C of the temperature table 26a in FIG.

  As described above, when the condition A is satisfied in step S16, the condition B is satisfied in step S19, or the condition C is satisfied in step S22, the imaging control unit 27 in step S23 Then, the shooting mode by the shooting unit 10 is switched to the “steam / cold shooting mode”.

  In step S <b> 24, the photographing unit 10 performs photographing with the strobe 13 and photographing without emitting light with respect to the same subject. These two captured image data are stored as image data in the internal memory 16 after being subjected to image processing by the image processing unit 15.

  In step S25, the image compositing processing unit 28 reads out two pieces of captured image data with and without light emission for the same subject stored in the internal memory 16, and generates steam or cold partial image data and subject image data. Compositing to generate composite image data. Note that the image composition processing unit 28 may read one of the two photographed image data with and without light emission from the internal memory 16 and directly input the other from the image processing unit 15 to generate composite image data. Alternatively, two pieces of captured image data with and without light emission may be directly input from the image processing unit 15 to generate composite image data.

  On the other hand, if a negative determination is made in step S20 or a negative determination is made in step S21, in step S26, the shooting control unit 27 shifts the shooting mode of the shooting unit 10 to “normal shooting mode” in which normal shooting is performed. In step S27, the photographing unit 10 performs normal photographing.

<Generation of composite image data>
Hereinafter, generation of a composite image will be described with reference to FIG.
FIG. 6 is a diagram for explaining image composition processing by the image composition processing unit 28. FIG. 6A is a photographed image obtained by photographing a subject (for example, ramen) 101 on which steam rises with light emission, and is an image before image composition. Since the flash 13 was fired and photographed, the steam 102 is clearly shown. Steam and cold are generally white, so the white color of steam and cold can be easily distinguished from the surrounding colors, and the range of steam and cold can be known from the difference in color. 102A is a contour line that virtually indicates a range where the steam 102 is clear.

FIG. 6B is a partial image obtained by cutting out only steam 102 shown in the photographed image of FIG. 6A along the contour line, and steam 102 is emphasized.
FIG. 6C is an image obtained by photographing the subject 101 shown in the photographed image of FIG. 6A without causing the flash 13 to emit light. Since the subject 101 is photographed without light emission, the steam 102 that appears light is observed. .

The image composition processing unit 28 stores the partial image data of only the steam 102 as shown in FIG. 6B and the subject image data of the subject 101 where the light steam 102 rises as shown in FIG. And synthesizing these two image data to generate composite image data as shown in FIG.
Note that further image processing can be performed on the generated composite image data. For example, for a portion where steam 102 overlaps with food, if a portion of steam 102 is deleted by image processing, a composite image in which the entire subject is clearly visible can be obtained.

The digital camera 1 according to the first embodiment has the following operational effects.
(1) A steam or cold partial image is combined with a subject image using two shot image data of shooting with the flash 13 and shooting without flashing the same subject, and composite image data is generated. Therefore, a composite image rich in reality can be obtained.
(2) The determination unit 26 includes a temperature table 26a serving as a reference for determining whether steam or cold is generated, and includes the outside air temperature data from the voltage / temperature conversion unit 25 and the infrared / temperature conversion unit 23. Since the surface temperature data of the subject is input and these two temperature data are compared with the temperature table 26a, it is possible to accurately determine whether steam or cold is generated.

-Second Embodiment-
The digital camera 2 according to the second embodiment has a configuration similar to that of the digital camera 1 according to the first embodiment and has the same function.
In the digital camera 1 of the first embodiment, two systems of temperature measurement are performed, and the surface temperature of the subject is measured by the infrared radiation thermometer 20 including the infrared lens 21, the infrared sensor 22, and the infrared / temperature conversion unit 23. The outside air temperature is measured by the temperature sensor 24 and the voltage / temperature conversion unit 25, and the presence or absence of generation of steam or cold is determined based on these two temperature data.

  FIG. 7 is a block diagram illustrating a configuration of the digital camera 2 according to the second embodiment. The digital camera 2 does not include the temperature sensor 24 and the voltage / temperature conversion unit 25 for measuring the outside air temperature, and is based on the time change of the surface temperature of the subject continuously measured by the infrared radiation thermometer 20. Whether or not steam or cold is generated is determined, and is different from the digital camera 1 of the first embodiment in this respect. Accordingly, the determination unit 26A differs from the determination unit 26 of the digital camera 1 of the first embodiment in the determination process. In the block diagram of FIG. 7, the same blocks as those in the block diagram of FIG.

  FIG. 8A is a schematic view of a dish in which steam is generated, that is, the subject 101. FIG. 8B is a graph showing a temperature change when the surface temperature at a predetermined position of the subject 101 shown in FIG. 8A is continuously measured by the infrared radiation thermometer 20, and the vertical axis indicates the temperature, The horizontal axis represents time. In the graph of FIG. 8 (b), as time passes, a high temperature extreme value A is reached at time t1, a low temperature extreme value B at time t2, and a high temperature extreme value C again at time t3. Such a change in the temperature measurement value is considered to be caused by a state where steam is covering the dish and a state where it is not covered by the convection of air due to the heat of the dish.

  In the state where the steam does not cover the dish, the infrared radiation thermometer 20 can accurately measure the temperature of the dish itself. However, in the state where the steam covers the dish, the infrared radiation thermometer 20 is actually affected by steam having a low emissivity. A temperature lower than the temperature is measured. In the graph of FIG. 8B, the high temperature extreme values at the time t1 and the time t3 are measured values when the steam does not cover the dish, and the low temperature extreme value at the time t2 is the steam covering the food. It is a measured value in the state. In addition, the amount of steam covering the dish is increasing between time t1 and time t2, and the amount of steam covering the dish is decreasing between time t2 and time t3.

Paying attention to such a phenomenon, if the difference between the extreme value A and the extreme value B of the measured temperature or the difference between the extreme value B and the extreme value C is equal to or greater than a predetermined value, steam is sufficiently generated. Can be determined.
In the digital camera 2 according to the present embodiment, the determination unit 26A determines that steam is generated if the difference between the high temperature extreme value and the low temperature extreme value B is equal to or greater than a predetermined value. The subsequent operation is the same as the operation of the digital camera 1 according to the first embodiment.

  That is, in accordance with the determination signal from the determination unit 26A, the imaging control unit 27 switches the imaging mode by the imaging unit 10 to the “steam / cold imaging mode”, and the imaging unit 10 causes the flash 13 to emit light to the same subject. Execute shooting without shooting and flashing. Subsequently, the image composition processing unit 28 reads out the two photographed image data with and without light emission stored in the internal memory 16 for the same subject, and synthesizes the steam or cold partial image data and the subject image data. Then, composite image data is generated.

On the other hand, if the difference between the extreme value of the high temperature and the extreme value of the low temperature is less than the predetermined value, the determination unit 26A determines that no steam is generated, and the imaging control unit 27 sets the imaging mode by the imaging unit 10 to “normal”. Shift to “shooting mode” and execute normal shooting.
Note that the above description has been made in the case where the presence or absence of the steam 102 as shown in FIG. 8A is determined, but the same applies to the case where the presence or absence of the cold air 202 as shown in FIG. 3 is determined. Applicable.

The digital camera 2 according to the second embodiment also has the same operational effects as the digital camera 1 according to the first embodiment. That is, in the second embodiment, steam or cold partial image data and the subject are obtained by using two pieces of photographed image data obtained by photographing with the flash 13 and photographing without emitting light with respect to the same subject. Since the image data is combined with the image data to generate the combined image data, a realistic combined image can be obtained.
Furthermore, in the second embodiment, since the presence or absence of steam is determined based on the amount of change in temperature when continuously measured by the infrared radiation thermometer 20, the temperature sensor 24 for measuring the outside air temperature and The voltage / temperature converter 25 is not required.

Hereinafter, modifications of the first and second embodiments will be described.
(1) The digital camera 1 of the first embodiment measures the surface temperature of an object with the infrared radiation thermometer 20 and measures the outside air temperature with the temperature sensor 24 and the voltage / temperature conversion unit 25. The digital camera 2 according to the embodiment measures the surface temperature of the subject continuously with the infrared radiation thermometer 20, but the digital cameras 1 and 2 are infrared thermography devices as devices for temperature measurement. You may have. An infrared thermography apparatus is an apparatus that detects infrared radiation energy emitted from an object, converts the detected energy into an apparent temperature, and visualizes a temperature distribution two-dimensionally.

  FIG. 9 is an infrared image obtained by the infrared thermography apparatus, and shows a case where the region matches the image captured by the imaging unit 10 (through image). In the infrared image 300 of FIG. 9, the temperature distribution is displayed in four stages. As shown in the figure, in the infrared image 300, the central portion 101a of the dish is the hottest, and the peripheral portion 101b of the dish is the next. The temperature is high, the temperature of the tableware 101c is the next highest, and the temperature around the object 101, that is, the outside air temperature is the lowest.

  Since the temperature of air cannot be measured in the infrared thermography apparatus, the temperature of the object around the subject, for example, the temperature of the desk on which the tableware 101c is placed or the temperature of the background wall is regarded as the outside temperature. If an infrared thermography apparatus is used, the surface temperature and the outside air temperature of the subject 101 can be measured simultaneously and continuously, so whether steam or cold is generated regardless of whether it is applied to the digital camera 1 or the digital camera 2. Temperature information for determination is obtained.

(2) In the first and second embodiments, the flash photography is performed in order to emphasize the steam or cold, but the steam or cold can be achieved by increasing the shutter speed without using the flash 13. Can be taken with emphasis.

(3) In the first and second embodiments, the order of shooting with the strobe 13 and shooting without the strobe 13 are not asked for the same subject, but shooting with the strobe 13 is performed first. Thereafter, it is desirable to perform shooting without causing the flash 13 to emit light. Normally, the amount of steam or cold decreases with the passage of time, so it is desirable to perform shooting with the strobe 13 emitting light in the first time zone in which steam or cold is frequently generated.
The present invention is not limited to the embodiment described above as long as the characteristics are not impaired.

DESCRIPTION OF SYMBOLS 1, 2: Digital camera 10: Shooting part 11: Shooting lens 12: Imaging element 13: Light emission part (strobe) 15: Image processing part 20: Infrared radiation thermometer 21: Infrared lens 22: Infrared sensor 23: Infrared / temperature Conversion unit 24: Temperature sensor 25: Voltage / temperature conversion unit 26: Judgment unit 26a: Temperature table 27: Shooting control unit 28: Image composition processing unit 101: Subject 102: Steam 201: Subject 202: Cold air

Claims (6)

Photographing means for photographing the subject;
A light emitting means for emitting illumination light to the subject;
A first thermometer for measuring the temperature of the subject;
A second thermometer for measuring the outside air temperature;
Determining means for determining whether or not steam or cold is generated from the subject based on the temperature of the subject measured by the first thermometer and the outside air temperature measured by the second thermometer;
When the determination means determines that the steam or cold is generated, the subject image taken without light emission by the light emission means and the steam in the subject image taken by light emission by the light emission means Or a digital camera comprising image composition means for synthesizing a cold image. The digital camera according to claim 1, wherein
A digital camera characterized in that a photographing direction of the photographing means and a measuring direction of the first thermometer coincide with each other. The digital camera according to claim 1, wherein
The digital camera, wherein the first thermometer and the second thermometer constitute an infrared thermography device that acquires the temperature of the subject and the outside air temperature as a two-dimensional temperature distribution image. The digital camera according to any one of claims 1 to 3,
The determination means has a temperature table that describes conditions for generating steam or cold based on the temperature of the subject and the outside air temperature, and determines whether the steam or cold is generated using the temperature table. A digital camera characterized by that. Photographing means for photographing the subject;
A light emitting means for emitting illumination light to the subject;
A first thermometer that continuously measures the temperature of the subject;
Determining means for determining the presence or absence of steam or cold from the subject based on the amount of change in temperature of the subject continuously measured by the first thermometer;
When the determination means determines that the steam or cold is generated, the subject image taken without light emission by the light emission means and the steam in the subject image taken by light emission by the light emission means Or a digital camera comprising image composition means for synthesizing a cold image. The digital camera according to any one of claims 1 to 5,
The digital camera according to claim 1, wherein the photographing unit shoots the subject by performing light emission using the light emitting unit, and then images the subject without performing light emission using the light emitting unit.

Images