JP5751479B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

The present invention relates to an image processing apparatus , an image processing method, and a program for determining a shooting scene.

  In recent years, an imaging device such as a digital still camera is used to determine a shooting scene (for example, landscape, night view, macro, etc.), and as shooting conditions suitable for the shooting scene, for example, AE (automatic exposure) or AWB (automatic white balance). ) Etc., the technology for controlling these is advancing day by day. In this case, the image is analyzed based on the through image (live view image) captured from the imaging unit, and the shooting scene is determined from the analysis result. However, the image analysis alone has a limit and is determined. There were not many types of shooting scenes. Therefore, conventionally, a technique has been disclosed in which a shooting scene is determined based on collected sound as means other than image analysis (see Patent Document 1).

JP 2010-273280 A

  However, in the technique of the above-described Patent Document 1, a shooting scene relating to sound is determined. For example, even shooting scenes suitable for subjects that are frequently shot, for example, subjects such as people, flowers, and dishes are used. It was not something that could be judged.

  An object of the present invention is to make it possible to determine a shooting scene based on a new determination element.

In order to solve the above-described problem, one aspect of the present invention is as follows.
An image processing apparatus for determining a shooting scene based on a shooting environment,
Odor detection means for detecting the odor of the surroundings as a shooting environment;
Shooting setting means for setting shooting conditions;
A determination unit that determines the shooting scene by combining the shooting condition set by the shooting setting unit and the odor detected by the odor detection unit;
An image processing apparatus comprising:
In order to solve the above-described problem, another aspect of the present invention provides:
An image processing apparatus for determining a shooting scene based on a shooting environment,
Odor detection means for detecting the odor of the surroundings as a shooting environment;
Determination means for determining a plurality of the shooting scenes from odors detected by the odor detection means;
Selecting means for selecting which of the plurality of shooting scenes determined by the determining means to be used;
An image processing apparatus comprising:
In order to solve the above-described problem, another aspect of the present invention provides:
An image processing apparatus for determining a shooting scene based on a shooting environment,
Odor detection means for detecting the odor of the surroundings as a shooting environment;
Determination means for determining a plurality of the shooting scenes in order according to the intensity of the odor based on a plurality of odors detected by the odor detection means;
Selecting means for selecting which of the plurality of shooting scenes determined by the determining means to be used;
An image processing apparatus comprising:
In order to solve the above-described problem, another aspect of the present invention provides:
Odor detection means for detecting the odor of the surroundings as a shooting environment;
Determination means for determining a shooting scene based on an odor detected by the odor detection means;
Shooting control means for controlling the shooting operation according to the shooting scene determined by the determination means;
An image processing apparatus comprising:
In order to solve the above-described problem, another aspect of the present invention provides:
An odor detection step for detecting ambient odor as a shooting environment;
A determination step of determining a shooting scene based on the odor detected by the odor detection step;
A shooting control step for controlling the shooting operation according to the shooting scene determined by the determination step;
The image processing method characterized by including.

In order to solve the above-described problem, another aspect of the present invention provides:
Against the computer,
An odor detection function that detects ambient odors as a shooting environment,
A determination function for determining a shooting scene based on an odor detected by the odor detection function;
A shooting control function for controlling the shooting operation according to the shooting scene determined by the determination function;
It is a program for realizing.

  According to the present invention, it is possible to increase the types of shooting scenes that can be determined by determining a shooting scene based on a new determination element, or to accurately determine a shooting scene.

The block diagram which showed the basic component of the digital camera applied as an image processing apparatus. The figure for demonstrating the flag information in the work memory M2. The figure for demonstrating the imaging | photography scene determination table M3. The flowchart which showed the outline | summary of the whole operation | movement of a camera. 5 is a flowchart for explaining in detail a shooting scene determination process (step A7 in FIG. 4). The flowchart which showed the photography scene determination process in 2nd Embodiment.

(First embodiment)
The first embodiment of the present invention will be described below with reference to FIGS.
FIG. 1 is a block diagram showing basic components of a digital camera applied as an image processing apparatus.
This digital camera (image processing apparatus) is, for example, a compact camera capable of shooting a moving image in addition to a full-color still image, has a shooting scene determination function, and has the control unit 1 as a core. The control unit 1 operates by supplying power from the power supply unit (secondary battery) 2 and controls the overall operation of the digital camera (hereinafter abbreviated as a camera) according to various programs in the storage unit 3. An arithmetic processing unit.

  The storage unit 3 includes, for example, a ROM, a RAM, a flash memory, and the like, and stores a program and various applications for realizing the present embodiment in accordance with an operation procedure illustrated in FIGS. In addition to this, it has a configuration having a work area for temporarily storing various information (for example, a flag, a timer, etc.) necessary for the operation of this camera. The storage unit 3 includes a program memory M1, a work memory M2, and the like, and a photographic scene determination table M3 described later. For example, the storage unit 3 includes a removable portable memory (recording medium) such as an SD card or an IC card. Although not shown in the drawings, it may include a storage area on a predetermined external server side when connected to a network via a communication function.

  The display unit 4 is a high-definition liquid crystal display that displays an image in high definition, and functions as a finder screen (monitor screen) that displays a through image (live view image) on a monitor, or functions as a playback screen that displays a stored image. To do. For example, a capacitive touch screen (touch screen) may be configured by stacking a transparent touch panel that detects finger contact on the surface of the display unit 4. The operation unit 5 includes various buttons of a push button type such as a shutter button and a mode button. The control unit 1 performs, for example, a photographing process, a process according to an input operation signal from the operation unit 5. Perform playback processing.

  Although not shown, the imaging unit 6 includes a lens unit, an imaging device, an A / D (analog / digital) conversion unit, and the like, and can capture moving images in addition to still images. A subject image from a lens unit including a lens or the like is formed on an image sensor (CCD or CMOS) via a diaphragm or a shutter (not shown) so that the subject can be photographed with high definition. The image signal photoelectrically converted by this image sensor (analog value signal) is subjected to color separation, gain adjustment for each RGB color component, and the like, and then converted to digital value data. The digitally converted image data is subjected to color interpolation processing (demosaic processing). The image data that has been demosaiced in this way is sent to the display unit 4 and displayed in full color as a through image. The imaging unit 6 and the control unit 1 perform autofocus processing (AF processing), zoom processing, exposure adjustment processing (AE processing), white balance adjustment processing, aberration correction processing, image compression processing, image restoration processing, and the like. .

  The face detection unit 7 constitutes a subject recognition function for tracking and recognizing a subject in a captured image (through image in the case of still image shooting), and from the imaging unit 6 at a maximum frame rate (for example, 300 fps). Capture captured images and analyze the captured image for each frame, the shape of the face of the subject (for example, a person or a pet) and the shape or positional relationship of the baht (eyes, mouth, nose, forehead, etc.) forming the face The face of the subject is detected and the face of the same subject appearing continuously over a plurality of frames is tracked. The control unit 1 acquires a through image in a state where the face detection unit 7 is turned on at the time of shooting, detects the subject's face, focuses the detected subject's face, and makes the face color beautiful. In order to achieve this, control is performed to adjust exposure and white balance. However, such a face detection function is a technique generally used in cameras, and in the present embodiment, the well-known technique is used. Since it is used, its specific description will be omitted.

  The odor detection unit 8 detects an odor (type and intensity of odor) drifting around the image when the imaging unit 6 captures an image, and the control unit 1 uses the odor detection unit 8 to detect the odor. The detected detection result (smell) is acquired as a determination element for determining a shooting scene based on the shooting environment. The odor detection unit 8 has a plurality of odor sensors that detect voltage changes due to odor substances adhering to the sensitive film, and the odor type is determined based on detection signals from the odor sensors. The scent is identified and the intensity is measured. In this embodiment, the odor detection unit 8 can identify, for example, 20 types of odors, except for unpleasant bad odors, but the type and number are arbitrary, and the configuration thereof Is also optional.

  The detection of odorous substances by the odor detection unit 8 is not limited to foods and cosmetics, but can also detect odors of people and plants. In the present embodiment, for example, 20 kinds of odors include, for example, a plurality of kinds of flowers, a plurality of kinds of dishes, a perfume odor, a scent of smell, an odor of aging, a smell of sea breezes, and a milk odor. It is the structure which can detect etc. Further, the odor intensity can be detected in a plurality of stages (for example, three stages).

FIG. 2 is a diagram for explaining flag information in the work memory M2.
The work memory M2 stores three types of flags, “shooting scene flag F1,” “selection flag F2,” and “determination flag F3.” Corresponding to the shooting scene flag F1, selection flag F2, and determination flag F3. , “0”, “1”, “2” flags are stored. The shooting scene flag F1 is a flag indicating whether or not to determine a shooting scene at the time of shooting. When the value is “0”, “no shooting scene determination is performed”, and when “1”, “ It is determined that the shooting scene is determined.

  Further, the “selection flag F2” is selected as a result of determining a shooting scene, and when a plurality of shooting scenes are determined as determination results, continuous shooting is performed for all the determined shooting scenes or is arbitrarily selected by a user operation. A flag indicating whether shooting is performed in a shooting scene. When the value is “0”, “continuous shooting is performed in all shooting scenes”, and in the case of “1”, shooting is performed in a user-selected shooting scene. "Do it". Note that continuous shooting refers to, for example, high-speed shooting capable of 10 continuous shots per second, but the number of continuous shots is arbitrary.

  In addition, the “determination flag F3” is a determination element for determining a shooting scene. Whether the determination is performed only by image analysis, whether only the smell is detected, or whether the determination is comprehensively performed including the smell. When the value is “0”, “determine a shooting scene only with an image”, and when “1”, “determine a shooting scene only with an odor”, or “2” In this case, it indicates that “the photographic scene is comprehensively determined including the smell”. In the figure, “-” indicates a “no flag” state in which no flag is set.

FIG. 3 is a diagram for explaining the shooting scene determination table M3.
The shooting scene determination table M3 includes an image shooting scene determination table M3-1 (see FIG. 3A) for determining a shooting scene by image analysis, and an odor shooting scene determination table for determining a shooting scene by odor detection. M3-2 (see FIG. 3 (2)). Note that the imaging scene determination table M3-1 for images has a known content, and therefore the description thereof will be omitted. Hereinafter, the imaging scene determination table M3-2 for smell will be described.

  As shown in FIG. 3 (2), the odor shooting scene determination table M3-2 shows the relationship between the odor type and the shooting scene when the odor is included as a determination element when determining the shooting scene. The table has items of “additional element”, “scent type”, “determination shooting scene”, and “determination count history”. “Additional element” is an element that is added to the determination along with the smell. In the example shown in the figure, “none”, “macro setting”, “determined as a face by image analysis”, and “determination as a landscape by image analysis” are stored Yes.

  “None” for “Additional element” indicates that the shooting scene is determined without taking into consideration other than odor as a determination element when determining the shooting scene. “Macro setting” includes setting of the macro shooting mode. This indicates that the shooting scene should be determined. “Determine face by image analysis” indicates that the photographic scene should be determined by taking into account the face of the subject as a result of image analysis as a determination element other than odor. “Determined as landscape by image analysis” indicates that a scene to be photographed should be determined taking into account the landscape as a result of image analysis as a determination element other than odor.

  Here, when the “additional element” is “none”, for example, in order to determine the type of flower from the scent of the flower, “scent of flower” is stored in the “scent of scent”, "Type of flower" is stored. In order to determine the type of dish from the smell of the dish, “scent of dish” is stored in the “scent type”, and “type of dish” is stored in the “determination shooting scene”. In order to determine the gender from the scent of the perfume, “scent of perfume” is stored in “type of scent”, and “sex” is stored in “determination shooting scene”. Hereinafter, similarly, the contents for determining gender from the smell of scent are memorized, and the contents for determining whether it is age from the smell of aging odor, whether it is seaside from the smell of sea breeze, and whether it is an infant from milk odor are stored. Yes.

  Further, when “additional element” is “macro setting”, for example, in order to determine the type of flower as a subject from the smell of flowers, “scent of flowers” is stored in “type of smell”, and “ In the “judgment shooting scene”, “flower type” is stored. In order to determine the type of cooking as a subject from the smell of cooking, “smell of cooking” is stored in “smell type”, and “type of cooking” is stored in “determination shooting scene”. In the case where the “additional element” is “determined as a face shooting scene by image analysis”, in order to determine the gender of the subject from the smell of the perfume, “the smell of the perfume” is stored in the “type of smell”. “Gender” is stored in the “judgment shooting scene”.

  Hereinafter, similarly, contents for determining the sex of the subject from the smell of odor are stored, and contents for determining the age of the subject from the smell of aging odor and whether the baby is an infant from the milk odor are stored. In addition, when “additional element” is “determined to be landscape by image analysis”, for example, contents for determining whether or not the shooting site is the seaside from the smell of sea breeze are stored. The “determination history count” stores the number of times determined in the past corresponding to the “determination shooting scene”, and every time the shooting scene is determined based on the smell, the “determination history count” is plus “1”. Updated one by one.

  Next, the operation concept of the camera in the present embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. In other words, in addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium.

FIG. 4 is a flowchart showing an outline of the overall operation of the camera.
First, after executing initialization processing such as clearing predetermined memory contents (step A1), the control unit 1 checks whether a shooting operation with a shirt tabota has been performed (step A2) or other operations are performed. While checking whether or not (step A3), it enters a state of waiting for an operation. As other operations, when a setting operation for instructing setting of shooting conditions such as AE (automatic exposure) or AWB (automatic white balance) or a reproduction operation for instructing image reproduction is performed (in step A3). (YES) After performing a setting process, a reproduction process, etc. as a process according to the operation (step A4), the process returns to step A2 and waits for an operation.

  If a shooting operation using the shutter button is performed (YES in step A2), it is checked whether or not the value is “1” with reference to the shooting scene flag F1 (step A5). If the shooting scene flag F1 is “0” (NO in step A5), the shooting scene is not determined, so the process moves to step A6, and shooting is performed based on the shooting conditions arbitrarily set by the user. After that, the process returns to the above-described step A2 to be in an operation waiting state. If the shooting scene flag F1 is “1” (YES in step A5), the process proceeds to shooting scene determination processing (step A7).

FIG. 5 is a flowchart for explaining the photographing scene determination process (step A7 in FIG. 4) in detail.
First, the control unit 1 refers to the determination flag F3 to check whether the value is “1” or more (step B1). If the value is “0” (NO in step B1), the image analysis is performed. Therefore, the process proceeds to step B2, and the imaging scene determination table M3-1 for images is accessed. Then, the photographed image (through image) is analyzed, and the photographing scene determination table M3-1 for the image is searched based on the analysis result, and the photographing scene is determined based on the analysis result (step B3). Thereafter, the flow of FIG. 5 is exited.

  If the value of the determination flag F3 is “1” or “2” (YES in step B1), the detection result from the odor detection unit 8 is acquired to check whether or not the surrounding odor can be specified ( Step B4). If the ambient scent cannot be specified (NO in step B4), the imaging scene determination table M3-1 for images is accessed (step B2) as in the above case, and the result of image analysis. The shooting scene is determined based on (Step B3). If the odor can be specified (YES in step B4), it is checked whether the value of the determination flag F3 is “2” (step B5).

  If the value of the determination flag F3 is “1”, that is, when a shooting scene is determined only by smell detection (NO in step B4), a process of determining a shooting scene based on the smell (step B10, B12 to 16), but if the value of the determination flag F3 is “2”, that is, if the shooting scene is comprehensively determined including the odor (YES in step B5), the determination elements other than the odor Is performed (steps B6 to B9), and then the process proceeds to a process of determining a shooting scene based on the smell (steps B11 to B16).

  Here, in the process for adding determination elements other than odor, a captured image (through image) is acquired and image analysis is performed (step B6), and an image shooting scene determination table M3- is used based on the analysis result. 1 is searched for, for example, whether it is a shooting scene for shooting the face of a subject or a shooting scene for shooting a landscape, and the determination result is acquired as a determination element (additional element) other than smell. (Step B7). In addition, it is checked whether or not the macro setting is performed (step B8). If the macro setting is performed (YES in step B8), the macro photographing mode is acquired as a determination element (consideration element) other than odor (step B9). ).

  In the process of determining the shooting scene based on the smell, first, the shooting scene determination table M3-2 for smell is accessed. If the value of the determination flag F3 is “1”, only the smell detection is performed. When determining the shooting scene (NO in step B5), an area having “None” as the “additional element” is designated as a search target (step B10). In addition, if the value of the determination flag F3 is “2”, that is, if the shooting scene is comprehensively determined including the odor (YES in step B5), in order to add determination elements other than the odor, An area other than “None” in “Additional elements” is designated as a search target (step B11).

  Next, it is checked whether or not there are a plurality of odors detected by the odor detection unit 8 (step B12). When a plurality of odors are detected (YES in step B12), an odor shooting scene determination table M3-2 is stored. Search is performed, and a plurality of shooting scenes arranged in the order corresponding to the intensity of odor are determined as determination results (step B13). For example, when the “additional element” is “none”, if a plurality of odors are detected, for example, a scent of flowers, a scent of perfume, and a scent of cooking, the intensity is “scent of flowers> perfume”. If the scent of the food> the scent of the food, a plurality of shooting scenes arranged in the order of “flower type”, “sex”, and “type of food” are determined as determination results. Note that the order according to the intensity of the odor is the same even when a determination element other than the odor is added.

  If there is only one kind of odor detected by the odor detector 8 (NO in step B12), it is checked whether or not this one kind of odor corresponds to a plurality of shooting scenes (step B14), and a single shooting scene is obtained. If so (NO in step B14), the shooting scene is determined as the final determination result (step B16). If one kind of odor corresponds to a plurality of shooting scenes (YES in step B14), it is possible. A plurality of shooting scenes arranged in descending order are determined as determination results (step B15). In this case, by referring to the odor shooting scene determination table M3-2 and comparing the values of the “determination count history” corresponding to each shooting scene, it is highly likely that the determination count is in descending order. In order.

  When such a shooting scene determination process ends (step A7 in FIG. 4), it is checked whether there are a plurality of shooting scenes determined in this process (step A8). If there is a single shooting scene (NO in step A8). ), Based on the determined shooting scene, shooting is performed by controlling shooting conditions such as AE (automatic exposure) and AWB (automatic white balance) (step A15). If there are a plurality of determined shooting scenes (YES in step A8), it is checked whether “selection flag F2” is “1” (step A9). If “1” (YES in step A9), Since shooting is performed with the shooting scene selected by the user, when a plurality of determined shooting scenes are displayed in a list and an arbitrary shooting scene is selected by a user operation (step A10), the selected shooting is performed. Shooting is performed by controlling shooting conditions based on the scene (step A11).

  Further, if the “selection flag F2” is not “1” (NO in step A9), it is a case where continuous shooting is performed in all shooting scenes. Shooting is performed by controlling shooting conditions (step A12). Then, it is checked whether or not an unphotographed scene that has not been photographed remains among the determined plurality of photographed scenes (step A13). If an unphotographed scene remains (YES in step A13), the next-ranked photograph is taken. Shooting is performed by controlling shooting conditions based on the scene (step A14). Thereafter, the process returns to the above-described step A13 and repeats the process of controlling the shooting conditions based on the unphotographed scene and executing the shooting, for example, after performing high-speed shooting capable of 10 continuous shooting per second ( Step A14), returning to the above-mentioned step A2.

  As described above, in the first embodiment, when the odor detection unit 8 detects a surrounding odor as a shooting environment, the control unit 1 determines the shooting scene based on this odor, so a new determination of odor is made. By determining the shooting scene based on the elements, it is possible to increase the types of shooting scenes that can be determined, or to accurately determine the shooting scene.

  Since the control unit 1 determines the shooting scene by combining the captured image acquired by the imaging unit 6 and the odor detected by the odor detection unit 8, it can be expected to improve the determination accuracy of the shooting scene. .

  Since the control unit 1 determines the shooting scene by combining the set shooting conditions (for example, macro setting) and the odor detected by the odor detection unit 8, it is expected to improve the determination accuracy of the shooting scene. Can do.

  Since the control unit 1 selects which shooting scene to use when determining a plurality of shooting scenes from the odor detected by the odor detection unit 8, even when a plurality of shooting scenes are determined, the user Appropriate response reflecting the intentions of the company is possible.

  The control unit 1 determines a plurality of shooting scenes in the order according to the intensity of the odor based on the plurality of odors detected by the odor detection unit 8, and when a plurality of shooting scenes are determined, which shooting scene is used. Therefore, even when a plurality of odors are detected, an appropriate shooting scene can be determined.

  Since the control unit 1 controls the shooting conditions based on the determined shooting scene, it is possible to perform shooting suitable for the determined shooting scene.

  When the control unit 1 determines a plurality of shooting scenes based on the odor detected by the odor detection unit 8, the control unit 1 controls the shooting conditions based on the plurality of shooting scenes in the order of determination so that continuous shooting is performed. Therefore, it is possible to perform shooting including an appropriate shooting scene.

  When a plurality of shooting scenes are determined based on a plurality of odors detected by the odor detection unit 8, the control unit 1 sets shooting conditions based on the shooting scene selected according to which shooting scene is used. Since the control is performed, it is possible to cope with photographing according to the user's preference and purpose.

  When the control unit 1 sequentially determines a plurality of shooting scenes from the one type of odor detected by the odor detection unit 8 in the order of high possibility (in descending order of determination history determination times), the plurality of shooting scenes. Since the shooting conditions are controlled in the order of determination based on the above and continuous shooting is performed, it is possible to perform shooting including an appropriate shooting scene.

(Second Embodiment)
A second embodiment of the present invention will be described below with reference to FIG.
In the first embodiment described above, the shooting scene is determined by combining the captured image captured by the imaging unit 6 and the odor detected by the odor detection unit 8, but in the second embodiment, When a shooting scene determined based on an odor is different from a shooting scene determined based on a captured image, which shooting scene is used is selected. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 6 is a flowchart showing a shooting scene determination process in the second embodiment.
First, the control unit 1 acquires the odor detected by the odor detection unit 8 (step C1), and searches the odor shooting scene determination table M3-2 based on this odor to determine the corresponding shooting scene. (Step C2). Next, a captured image captured by the imaging unit 6 is acquired and image analysis is performed (step C3). Based on the analysis result, the image capturing scene determination table M3-1 is searched, and the corresponding capturing scene is selected. Determine (step C4).

Then, the photographing scene determined based on the smell is compared with the photographing scene determined by the image analysis to check whether they are different (step C5). As a result, if the two shooting scenes are not different, that is, if they match (NO in step C5), the shooting scene is determined as a determination result (step C6), but the two shooting scenes may be different. For example (YES in step C5), each shooting scene is displayed in a list, and when an arbitrary shooting scene is selected by a user operation (step C7), the selected shooting scene is determined as a determination result (step C8). ).
It is the same as in the first embodiment described above to perform shooting by controlling shooting conditions based on the shooting scene thus determined.

  As described above, in the second embodiment, the control unit 1 compares the shooting scene determined based on the odor and the shooting scene determined by image analysis, and if both are different, which shooting scene is selected. Since it is possible to select whether to use or not, the shooting condition is controlled based on the selected shooting scene, so that the shooting scene is determined based on a new determination element called odor as in the first embodiment described above. This makes it possible to increase the types of shooting scenes that can be determined, to accurately determine shooting scenes, and to handle shooting according to user preferences and purposes.

  In each of the above-described embodiments, the shooting conditions for adjusting automatic exposure, automatic white balance, and the like are controlled. However, an image processing process is performed to correct a shot image based on the determined shooting scene. It may be.

  In the above-described embodiment, the shooting scene is determined based on the through image captured from the imaging unit 6, but the shooting scene may be determined based on the captured image. If the captured scene is determined by analyzing the captured image in this way, the captured image can be freely modified at any time according to the captured scene. In the above-described embodiment, the shooting scene is determined based on the detection result detected by the odor detection unit 8 at the time of shooting. However, the odor and the captured image are associated with each other and recorded and saved. If the photographic scene is determined based on the smell, the captured image can be freely modified at any time according to the photographic scene.

  Further, in the above-described embodiment, the case where the present invention is applied to a digital camera applied as an image processing apparatus has been shown. is there.

  Further, the “apparatus” and “unit” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

As mentioned above, although several embodiment of this invention was described, this invention is not limited to this, The invention described in the claim and its equal range are included.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
An image processing apparatus for determining a shooting scene based on a shooting environment,
Odor detection means for detecting the odor of the surroundings as a shooting environment;
Determination means for determining the shooting scene based on the odor detected by the odor detection means;
An image processing apparatus comprising:
(Claim 2)
The invention according to claim 2 is the image processing apparatus according to claim 1,
The determination unit further determines the shooting scene by combining a captured image acquired by an imaging unit included in the image processing apparatus and an odor detected by the odor detection unit,
This is an image processing apparatus characterized by being configured as described above.
(Claim 3)
The invention according to claim 3 is the image processing apparatus according to claim 1 or 2,
The camera further comprises shooting setting means for setting shooting conditions,
The determination means further determines the shooting scene by combining the shooting conditions set by the shooting setting means and the odor detected by the odor detection means,
This is an image processing apparatus characterized by being configured as described above.
(Claim 4)
The invention according to claim 4 is the image processing apparatus according to any one of claims 1 to 3,
The determination means determines a plurality of shooting scenes from the odor detected by the odor detection means,
A selection means for selecting which shooting scene to use when a plurality of shooting scenes are determined by the determination means;
This is an image processing apparatus characterized by being configured as described above.
(Claim 5)
The invention according to claim 5 is the image processing apparatus according to any one of claims 1 to 3,
The determination unit determines a plurality of the shooting scenes based on a plurality of odors detected by the odor detection unit in order according to the intensity of the odor,
A selection means for selecting which shooting scene to use when a plurality of shooting scenes are determined by the determination means;
This is an image processing apparatus characterized by being configured as described above.
(Claim 6)
The invention according to claim 6 is the image processing apparatus according to any one of claims 1 to 5,
A photographing control means for controlling photographing conditions based on the photographing scene determined by the determining means;
This is an image processing apparatus characterized by being configured as described above.
(Claim 7)
The invention according to claim 7 is the image processing apparatus according to claim 6,
The determination means determines a plurality of shooting scenes based on the odor detected by the odor detection means,
The shooting control unit performs continuous shooting by controlling shooting conditions in the determination order based on a plurality of shooting scenes determined by the determination unit;
This is an image processing apparatus characterized by being configured as described above.
(Claim 8)
The invention according to claim 8 is the image processing apparatus according to claim 6,
The determination means determines a plurality of the shooting scenes based on a plurality of odors detected by the odor detection means,
A selection unit for selecting which shooting scene to use when a plurality of shooting scenes are determined by the determination unit;
The shooting control means controls shooting conditions based on the shooting scene selected by the selection means;
This is an image processing apparatus characterized by being configured as described above.
(Claim 9)
The invention according to claim 9 is the image processing apparatus according to claim 6,
The determination means sequentially determines a plurality of shooting scenes from the one kind of odor detected by the odor detection means in descending order of possibility,
The shooting control unit performs continuous shooting by controlling shooting conditions in the determination order based on a plurality of shooting scenes determined by the determination unit;
This is an image processing apparatus characterized by being configured as described above.
(Claim 10)
According to a tenth aspect of the present invention, in the image processing apparatus according to the ninth aspect,
A determination history storage means for storing a past determination result as a determination history for each shooting scene;
The determination unit refers to the content of the determination history storage unit when sequentially determining the plurality of shooting scenes in descending order of possibility, and determines in order from the largest number of determinations.
This is an image processing apparatus characterized by being configured as described above.
(Claim 11)
The invention according to claim 11 is the image processing apparatus according to claim 6,
The determination unit further determines a shooting scene based on a captured image acquired by an imaging unit included in the image processing apparatus,
And a selection unit that selects which shooting scene to use when the shooting scene determined based on the odor by the determination unit is different from the shooting scene determined based on the captured image. ,
The shooting control means controls shooting conditions based on the shooting scene selected by the selection means;
This is an image processing apparatus characterized by being configured as described above.
(Claim 12)
The invention according to claim 12
Against the computer,
A function for determining a shooting scene based on a surrounding odor detected as a shooting environment;
A function of controlling shooting conditions based on the determined shooting scene;
It is a program for realizing.

DESCRIPTION OF SYMBOLS 1 Control part 3 Memory | storage part 4 Display part 5 Operation part 6 Imaging part 7 Face detection part 8 Odor detection part M1 Program memory M3 Shooting scene determination table M3-1 Shooting scene determination table for images M3-2 Shooting scene determination for smell table

Claims (12)

An image processing apparatus for determining a shooting scene based on a shooting environment,
Odor detection means for detecting the odor of the surroundings as a shooting environment;
Shooting setting means for setting shooting conditions;
A determination unit that determines the shooting scene by combining the shooting condition set by the shooting setting unit and the odor detected by the odor detection unit;
An image processing apparatus comprising: An image processing apparatus for determining a shooting scene based on a shooting environment,
Odor detection means for detecting the odor of the surroundings as a shooting environment;
Determination means for determining a plurality of the shooting scenes from odors detected by the odor detection means;
Selecting means for selecting which of the plurality of shooting scenes determined by the determining means to be used;
An image processing apparatus comprising: An image processing apparatus for determining a shooting scene based on a shooting environment,
Odor detection means for detecting the odor of the surroundings as a shooting environment;
Determination means for determining a plurality of the shooting scenes in order according to the intensity of the odor based on a plurality of odors detected by the odor detection means;
Selecting means for selecting which of the plurality of shooting scenes determined by the determining means to be used;
An image processing apparatus comprising: Odor detection means for detecting the odor of the surroundings as a shooting environment;
Determination means for determining a shooting scene based on an odor detected by the odor detection means;
Shooting control means for controlling the shooting operation according to the shooting scene determined by the determination means;
An image processing apparatus comprising: The camera further comprises shooting setting means for setting shooting conditions,
The determination means further determines the shooting scene by combining the shooting conditions set by the shooting setting means and the odor detected by the odor detection means,
The image processing apparatus according to claim 4, which is configured as described above. The determination means determines a plurality of the shooting scenes based on the odor detected by the odor detection means,
The shooting control unit performs continuous shooting by controlling shooting conditions in the determination order based on a plurality of shooting scenes determined by the determination unit;
The image processing apparatus according to claim 4 or claim 5, characterized in that the the like. The determination means determines a plurality of the shooting scenes based on a plurality of odors detected by the odor detection means,
When a plurality of shooting scenes are determined by the determination unit, the selecting unit further includes a selection unit that selects which shooting scene to use from the determined plurality.
The shooting control unit controls the shooting operation based on a shooting scene selected by the selection unit;
The image processing apparatus according to claim 4 or claim 5, characterized in that the the like. The determination means sequentially determines a plurality of shooting scenes from the one kind of odor detected by the odor detection means in descending order of possibility,
The shooting control unit performs continuous shooting by controlling shooting conditions in the determination order based on a plurality of shooting scenes determined by the determination unit;
The image processing apparatus according to claim 4 or claim 5, characterized in that the the like. A determination history storage means for storing a past determination result as a determination history for each shooting scene;
The determination unit refers to the content of the determination history storage unit when sequentially determining the plurality of shooting scenes in descending order of possibility, and determines in order from the largest number of determinations.
The image processing apparatus according to claim 8, which is configured as described above. The determination unit further determines the shooting scene based on a captured image acquired by an imaging unit included in the image processing apparatus,
And a selection unit that selects which shooting scene to use when the shooting scene determined based on the odor by the determination unit is different from the shooting scene determined based on the captured image. ,
The shooting control unit controls the shooting operation based on a shooting scene selected by the selection unit;
The image processing apparatus according to claim 4 or claim 5, characterized in that the the like. An odor detection step for detecting ambient odor as a shooting environment;
A determination step of determining a shooting scene based on the odor detected by the odor detection step;
A shooting control step for controlling the shooting operation according to the shooting scene determined by the determination step;
An image processing method comprising: Against the computer,
An odor detection function that detects ambient odors as a shooting environment,
A determination function for determining a shooting scene based on an odor detected by the odor detection function;
A shooting control function for controlling the shooting operation according to the shooting scene determined by the determination function;
A program to realize

Images