JP5421682B2 - Imaging apparatus and method - Google Patents

Description

  The present invention relates to an imaging apparatus having a shooting scene determination function.

  In Patent Document 1, it is determined whether or not an actual shooting scene is appropriate for a set shooting mode based on a digital image signal or EV value captured via a CCD. When the shooting mode is appropriate, the digital camera performs shooting processing in the shooting mode and records the shooting mode information in the header portion of the image data. When the shooting mode is inappropriate, the digital camera sets the setting. Confirm with the operator whether or not to shoot in the selected shooting mode, and shift to the shooting process, and check with the operator whether or not to record the shooting mode information in the header portion of the image data, or standard Record shooting mode information.

  The camera described in Patent Document 2 automatically sets a camera shooting mode based on output information of subject movement, imaging magnification, or subject distance. Note that the shooting mode setting refers to settings such as a Tv value, an Av value, a program, a diagram, exposure (dimming correction), strobe light emission, zoom AF mode, feeding mode, and metering mode.

JP 2003-244530 A JP 2003-344891 A

  The “shooting mode check process” of Patent Document 1 (S13 in FIG. 2) operates constantly, and does not operate as necessary, and is inefficient. Also, “Automatic shooting mode setting” in Patent Document 2 (S112 in FIG. 4) is an operation only once after the release button is pressed halfway, and appropriate shooting is performed according to a shooting scene that may change moment by moment. The mode is not always set stably.

  An object of the present invention is to output a stable result as necessary when a scene is recognized by a camera.

  An imaging apparatus according to the present application stores information acquisition means for acquiring shooting information that is information of a shooting scene, reference information storage means for storing reference information set based on the shooting information, and storage in the reference information storage means. The scene change determining means for determining whether or not the shooting scene has changed from the reference information and the shooting information acquired by the information acquisition means, and that the shooting scene has been changed by the scene change determining means. A scene recognition unit for recognizing a shooting scene based on the shooting information acquired by the information acquisition unit according to the determination, and a display control, a shooting control, a signal according to a scene recognition result of the scene recognition unit. Control means for performing at least one of processing control and information recording control is provided.

  The scene recognition unit updates the reference information stored in the reference information storage unit based on shooting information corresponding to the scene recognition result.

  The information acquisition means includes at least one information of face detection result information indicating whether or not there is a person's face in the shooting scene, subject distance information regarding subject distance, and sidelight information regarding subject brightness, It acquires as said imaging | photography information, It is characterized by the above-mentioned.

  The information acquisition means includes two or more pieces of information of face detection result information indicating whether or not a person's face is present in a shooting scene, subject distance information regarding subject distance, and sidelight information regarding subject brightness, Acquired as shooting information, and the scene change determination means changes the shooting scene from the shooting information acquired by the information acquisition means and the reference information corresponding to the shooting information stored in the reference information storage means. It is characterized by determining whether or not.

  The scene variation determination means assigns a weight for each information to the two or more information acquired by the information acquisition means and the reference information corresponding to the two or more information stored in the reference information storage means. It has the weight setting means to perform, It is characterized by the above-mentioned.

    By the single scene fluctuation determining means for determining the presence or absence of fluctuations in the shooting scene sequentially from the reference information stored in the reference information storage means and the shooting information acquired by the information acquisition means, and by the single scene fluctuation determining means A scene variation history storage unit that stores a history of a result of the single scene variation determination as a scene variation history, and a total scene variation determination unit that determines whether or not the shooting scene has changed based on the scene variation history. It is characterized by.

  The scene recognition means performs scene recognition for a predetermined period or a predetermined number of times based on the shooting information acquired by the shooting information acquisition means in response to the fact that the shooting scene has been changed by the scene change determination means. A single scene recognition means, a scene recognition history storage means for storing a history of a single scene recognition result by the single scene recognition means as a scene recognition history, and a total scene recognition for performing scene recognition of the photographic scene based on the scene recognition history Means.

  The total scene recognizing unit detects a shooting scene indicated by the maximum frequency single scene recognition result from the scene recognition history, and the shooting scene indicated by the maximum frequency single scene recognition result is detected by the scene variation determination unit. It is characterized in that it is recognized as a photographic scene after it has been determined that it has changed.

  The total scene recognizing means, when a plurality of shooting scenes indicated by the maximum frequency single scene recognition result is detected, after determining that the latest shooting scene has changed by the scene fluctuation determining means. It is characterized in that it is recognized as a shooting scene.

  The selection further comprises selection means for selecting whether scene recognition of the photographic scene is performed when the scene changes or every predetermined period, and period setting means for setting a predetermined period for performing the scene recognition. If it is selected that the scene recognition of the photographic scene is performed every predetermined period by the means, the scene recognition means replaces the scene change determination means when it is determined that the photographic scene has changed. Scene recognition of the photographic scene is performed on the basis of the photographic information acquired by the photographic information acquisition means at every predetermined period set by the period setting means.

  The predetermined cycle set by the cycle setting means is a cycle set in advance or a cycle that can be arbitrarily set by the user.

  The imaging and imaging method according to the present invention includes a step of acquiring shooting information that is information of a shooting scene, a step of recognizing a shooting scene from the acquired shooting information, and the shooting information corresponding to the recognition result of the shooting scene. A step of storing reference information set based on the step, a step of determining whether or not the shooting scene has changed from the stored reference information and the acquired shooting information, and that the shooting scene has changed. According to the determination, at least one of a step of recognizing the shooting scene based on the shooting information and a display control, shooting control, signal processing control, and information recording control according to the recognition result of the shooting scene. Performing a step.

  According to the present invention, a process for determining what kind of scene it is and a process for monitoring whether there is a change from the recognized scene are mixedly operated. Then, by determining which scene is the first time when the scene changes, it is possible to perform accurate and stable scene recognition.

Schematic block diagram showing the configuration of the digital camera Flowchart of scene recognition main processing according to the first embodiment Flow chart of frame fluctuation check Photometric value variation check flowchart Flow chart of focus position fluctuation check Flow chart of face presence / absence variation check Flowchart showing scene recognition details The figure which showed scene recognition result SR notionally Flow chart of scene determination subroutine (person determination) Flow chart of scene determination subroutine (landscape determination) Flowchart of scene determination subroutine (night scene determination) Another example of flowchart of scene determination subroutine (night scene determination) Flowchart of scene determination subroutine (close-up determination) The figure which shows an example of the result display of a scene determination Flowchart of frame fluctuation check according to second embodiment The figure which shows the relationship between the weight E_AUTOSP_FRAME_CHECK1-3 corresponding to the 1st-3rd frame fluctuation check result, and the value of change_measure according to the presence or absence of the change by the 1st-3rd frame fluctuation check Flowchart of scene recognition main processing according to the third embodiment Diagram showing an example of frame fluctuation history Flowchart of scene recognition main processing (scene variation recognition / periodic recognition coexistence type) according to the fourth embodiment

<First Embodiment>
FIG. 1 is a schematic block diagram showing a configuration of a digital camera 1 of the present invention. The digital camera 1 converts image data acquired by photographing into an image file in Exif format, and records it in a recording unit 70 such as an external recording medium that can be attached to and detached from the main body.

  The operation system of the digital camera includes an operation unit 11 including an operation mode switch, a menu / OK button, a zoom / up / down arrow lever, a left / right arrow button, a back button, a display switching button, a release button, a power switch, and the like. And a control circuit 74 that interprets the contents of the operation on the operation unit 11 and controls each unit. The control circuit 74 includes a CPU 75 that performs information processing, a program that defines information processing, firmware, a ROM 68 that records threshold values and other constants used for various determinations in the program, and a RAM 69 that stores variables and data necessary for information processing. It has.

  The lens 20 has a focus lens and a zoom lens. The lens 20 can be moved in the optical axis direction by the lens driving unit 51. The lens drive unit 51 controls the movement of the focus lens or the zoom lens based on the focus drive amount data output from the CPU 75 or the operation amount data of the zoom / up / down arrow lever included in the operation unit 11.

  The diaphragm 54 is driven by a diaphragm driving unit 55 including a motor and a motor driver. The aperture driver 55 adjusts the aperture diameter based on aperture value data output from the AE / AWB processor 63.

  An imaging device 58 such as a CCD or a CMOS is disposed behind the imaging optical system including the lens 20 and the diaphragm 54. The imaging element 58 has a photoelectric surface in which a large number of light receiving elements are two-dimensionally arranged, and subject light that has passed through the optical system forms an image on the photoelectric surface and is subjected to photoelectric conversion. In front of the photocathode, a microlens array for condensing light on each pixel and a color filter array in which filters of R, G, and B colors are regularly arranged are arranged. The image sensor 58 outputs the charge accumulated for each pixel as a serial analog image signal for each line in synchronization with the vertical transfer clock and the horizontal transfer clock supplied from the image sensor control unit 59. The time for accumulating charges in each pixel, that is, the exposure time is determined by an electronic shutter drive signal provided from the image sensor control unit 59. The gain of the image sensor 58 is adjusted by the image sensor control unit 59 so that an analog image signal having a predetermined size can be obtained.

  The analog photographing signal captured from the image sensor 58 is input to the analog signal processing unit 60. The analog signal processing unit 60 includes a correlated double sampling circuit (CDS) that removes noise from the analog signal, and an auto gain controller (AGC) that adjusts the gain of the analog signal.

  The A / D converter 61 converts the analog image signal processed by the analog signal processor 60 into digital image data. The image data converted into the digital signal is CCD-RAW data having R, G, and B density values for each pixel.

  The control circuit 74 generates a timing signal, inputs this timing signal to the image sensor control unit 59, operates the release button included in the operation unit 11, captures the charge of the image sensor 58, and the analog signal processing unit 60. Processing is synchronized.

  The flash control unit 73 causes the flash 24 composed of a strobe discharge tube and other circuits to emit light during photographing (when the release button is fully pressed). Specifically, when the flash emission mode is set to flash on, the flash 24 is turned on and the flash 24 is caused to emit light at the time of shooting. On the other hand, when the flash emission mode is set to flash off, the flash 24 is prohibited from emitting light during shooting.

  The control circuit 74 performs photometry by detecting the luminance of the image signal generated by the image sensor 58. The control circuit 74 receives the result of photometry that the field luminance is low, and instructs the auxiliary light control unit 25 to irradiate the auxiliary light from the auxiliary light emitting unit 26 including LEDs.

  The R, G, B image data (CCD-RAW data) output from the A / D converter 61 is subjected to white balance (WB) adjustment, γ correction, and YC processing in the digital signal processing unit 65. Then, the processed image data is written in the memory 66.

  The digital signal processing unit 65 is provided with a photometry unit 46. The photometry unit 46 receives the Y signal for one screen from the A / D conversion unit 61, and uniformly distributes a desired region in the imaging surface of the image sensor 58, for example, a region near the center, a face detection region, or the entire imaging surface. The Y signal is integrated for each block of a predetermined number, for example, 64 blocks divided into eight. The integrated luminance value for each of the blocks is sent to the CPU 75 as a photometric result. During the AE control, the CPU 75 performs a well-known calculation process on the luminance integrated value based on a predetermined algorithm, and determines an appropriate exposure (aperture value, shutter speed).

  The memory 66 is a working memory used when various digital image processing (signal processing) described later is performed on the image data. For example, an SDRAM (Synchronous) that performs data transfer in synchronization with a bus clock signal having a fixed period. Dynamic Random Access Memory) is used.

  The display unit 71 displays the image data sequentially stored in the memory 66 from the setting of the shooting mode until the main shooting instruction is given as a through image on a liquid crystal monitor (not shown), or is stored in the recording unit 70 in the playback mode. The image data is displayed on a liquid crystal monitor. The through image is taken by the image sensor 58 at a predetermined interval while the shooting mode is selected. Note that the through image indicates a subject imaged by the image sensor 58 at a predetermined time interval while the shooting mode is selected so that the user can check the shooting angle of view and the situation in real time. An image displayed on the display unit 71 based on the image signal.

  The pre-imaging AF processing unit 81 determines shooting conditions based on through images that are sequentially supplied until the release button is half-pressed. That is, the pre-imaging AF processing unit 81 detects the focal position based on the through image and outputs focus drive amount data. As a focus position detection method, for example, a passive method that detects a focus position using a feature that the contrast of an image is high in a focused state can be considered. That is, the pre-imaging AF processing unit 81 extracts high-frequency components from the through image, and integrates the extracted high-frequency component in the entire image or a specific part of the image (such as the center or the face detection region). Get the evaluation value. The maximum point of the obtained AF evaluation value is searched over the lens driving range, and the lens position where the maximum point is obtained is determined as the in-focus position.

  The AF processing unit 62 and the AE / AWB processing unit 63 determine shooting conditions based on the pre-image. The pre-image is represented by image data stored in the memory 66 as a result of the CPU 75 that has detected a half-press signal generated by half-pressing the release button of the operation unit 11 causing the image sensor 58 to perform pre-photographing. It is an image to be.

  The AF processing unit 62 detects the focal position based on the pre-image and outputs focus drive amount data (AF processing). As a focus position detection method, for example, a passive method that detects a focus position using a feature that the contrast of an image is high in a focused state can be considered. That is, the AF processing unit 62 extracts a high frequency component from the pre-image, and integrates it in the entire image or a partial region of the image to obtain an AF (focus) evaluation value. The maximum point of the obtained AF evaluation value is searched over the lens driving range, and the lens position where the maximum point is obtained is determined as the in-focus position.

  The AE / AWB processing unit 63 measures subject brightness based on the pre-image, determines an aperture value, shutter speed, etc. based on the measured subject brightness, and determines aperture value data and shutter speed data as exposure setting values. (AE treatment). The AE / AWB processing unit 63 determines the white balance correction amount of the image data based on the image data obtained by the main exposure performed in response to the release button being fully pressed (AWB processing).

  The exposure and white balance can be set manually by the user of the digital camera 1 when the shooting mode is set to the manual mode. Even when the exposure and white balance are automatically set, the user can manually adjust the exposure and white balance by giving an instruction from the operation unit 11 such as a menu / OK button.

  The shooting condition corresponds to a scene recognition result SR described later. For example, if the scene recognition result SR is a night view, the ISO sensitivity is 80, the shutter speed is 1 / 1.6 seconds, and the like. Alternatively, if the scene recognition result SR is close-up, the aperture is opened and the flash 24 is inhibited from emitting light. The search for the in-focus position may be performed toward a far position (INF side) starting from a close position (Near side). Alternatively, if the scene recognition result SR is a landscape, “average metering” is performed as a metering mode, and the metering unit 46 performs divided metering. Alternatively, if the scene recognition result SR is a person, the AF processing unit 62 sets the AF evaluation value calculation region as the face region detected by the face detection processing unit 80. If the scene recognition result SR is AUTO, imaging conditions such as a shutter speed and an aperture value are automatically set.

  The digital signal processing unit 65 performs image quality correction processing such as gamma correction, sharpness correction, and contrast correction on the image data of the main image, CCD-RAW data as Y data that is a luminance signal, and Cb data that is a blue color difference signal. Then, YC processing for converting into YC data composed of Cr data which is a red color difference signal is performed. This main image is captured from the image sensor 58 in the main photographing executed when the release button is fully pressed, and is stored in the memory 66 via the analog signal processing unit 60, the A / D conversion unit 61, and the digital signal processing unit 65. It is an image by the image data stored in. The upper limit of the number of pixels of the main image is determined by the number of pixels of the image sensor 58. For example, the number of recorded pixels can be changed by setting fine, normal, and the like. On the other hand, the number of images of the through image and the pre-image is smaller than that of the main image.

  Further, the digital signal processing unit 65 obtains the luminance of the face area in the main image when the light emission amount of the flash 24 is smaller than that during normal photographing, and the luminance is smaller than the predetermined threshold Th1. The process of adjusting the brightness of the face area to the threshold value Th1 is performed.

  The digital signal processing unit 65 performs a compression process on the image data of the main image subjected to the correction / conversion process, for example, in a compression format such as JPEG to generate an image file. A tag storing incidental information such as shooting date and time is added to the image file based on the Exif format or the like. Further, in the reproduction mode, the digital signal processing unit 65 reads the compressed image file from the recording unit 70 and performs expansion processing. The expanded image data is output to an external liquid crystal monitor by the display unit 71.

  The ROM 68 stores various constants set in the digital camera 1, programs executed by the CPU 75, and the like. The RAM 69 temporarily stores data necessary for the CPU 75 to execute the program.

  The CPU 75 controls each part of the main body of the digital camera 1 in accordance with signals from various processing units such as the operation unit 11 and the AF processing unit 62.

  The face detection processing unit 80 detects a human face from a through image, an image (pre-image) displayed when the release button is pressed halfway, or a main image. Specifically, an area having a facial feature included in the face (for example, having skin color, having eyes, or having a face shape) is detected as a face area, but the present invention is not limited to this.

  FIG. 2 is a flowchart of the scene recognition main process. Scene recognition refers to recognizing that a subject at the time of shooting is a predetermined subject situation (a shooting scene or simply a scene). In other words, it is to recognize what kind of scene the frame image the user is going to shoot. Examples of recognized scenes include a person, a landscape, a night view, and a close-up (described later). The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68. This process starts when the shooting mode is set from the operation unit 11 and “automatic scene recognition ON” is set from the operation unit 11 at that time. If “automatic scene recognition OFF” is set from the operation unit 11, the process does not start.

  In S1, it is determined whether or not this process is executed for the first time. If “Yes”, the process proceeds to S2. If “No”, the process proceeds to S3.

  In S2, the frame variation reference information in the RAM 69 is initialized. The frame variation reference information is information referred to in the frame variation check process. The frame fluctuation reference information is created based on shooting information (information on a frame image, which will be described later) that is information relating to a shooting scene when the first frame fluctuation check is performed, and based on the total scene recognition result (described later) in S13. Updated. The frame variation reference information includes the divided photometric value, the position of the focus lens, the type of the focus AF area (whether the AF area in the focused state is a face area detected by the face detection processing unit 80, or Whether or not it is the default area near the center of the screen), a focusing AF filter (for example, a low pass filter or a high pass filter disclosed in Japanese Patent Laid-Open No. 2006-145964), and whether or not a face is detected by the face detection processing unit 80. Further, the status of the RAM 69 is set to the search state, the check counter is set to 0, and the scene recognition history holding flag is set to OFF.

In S3, it is determined whether or not status of the RAM 69 is in a final state. If “Yes”, S4
If “No”, the process proceeds to S7.

  In S4, a frame variation check is performed. This process will be described later.

  In S5, it is determined whether or not there is a frame variation as a result of the frame variation check. If “Yes”, the process returns to S6. If “No”, the process returns to S1.

  In S6, it is determined that the scene has changed, and the status of the RAM 69 is set to the search state.

  In S7, it is determined whether or not the scene recognition history retention flag in the RAM 69 is set to ON. If “Yes”, the process proceeds to S9. If “No”, the process proceeds to S8.

  In S8, the scene recognition counter in the RAM 69 is set to zero. Also, the scene recognition history in the RAM 69 is cleared.

  In S9, a single scene recognition operation is performed by the recognition unit. This process will be described later. As a result of this processing, the scene single recognition result SR is stored in the RAM 69. The single scene recognition result SR includes landscape, AUTO, person, night view, close-up, and the like. Details of the process for recognizing each single scene will be described later.

  In S10, the scene recognition counter in the RAM 69 is incremented by 1.

  In S11, the scene recognition counter in the RAM 69 and the threshold value (E_AUTOSR_SR_HISTORY_BEFORE_S1) of the predetermined number of scene recognition results in the ROM 68 are compared to determine whether or not the scene recognition counter ≧ the threshold value of the number of scene recognition results. If “Yes”, the process proceeds to S 12. If “No”, the process proceeds to S 17.

  In S12, the scene recognition history in the RAM 69 is checked. The scene recognition history is composed of a plurality of single scene recognition results SR that are individually stored in S9 that is repeated until status becomes a definite state.

  In S13, total scene recognition is performed. That is, the scene recognition result SR in the RAM 69 is updated to the one having the maximum appearance frequency among the scene recognition histories constituted by a plurality of single scene recognition results SR stored at different times in S9. Further, the frame variation reference information in the RAM 69 is updated to the frame variation reference information acquired at the same time as the single scene recognition result SR having the maximum appearance frequency.

  In S14, it is determined whether or not the scene recognition result SR (total scene recognition result) in the RAM 69 is different from “AUTO”. If “Yes”, the process proceeds to S 16. If “No”, the process proceeds to S 15.

  In S15, the status of the RAM 69 is set to the search state, and the process returns to S1.

  In S16, the status of the RAM 69 is set to a confirmed state, and the process returns to S1.

  FIG. 3 is a flowchart showing a detailed processing flow of the frame variation check (S4). The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

  In S21, change which is a parameter of the RAM 69 is set to OFF, and change_measure is set to 0.

  In S22, frame variation reference information is created based on the shooting information. The shooting information includes a face detection result, a focus lens position, a zoom lens position, an in-focus state, a photometric value, and the like. The data item included in the frame variation reference information may be the same as the data item included in the shooting information. Further, the first frame variation check is performed based on the created frame variation reference information. Note that the frame fluctuation check is a process for detecting whether the current frame state is fluctuating compared to the state of the frame image (frame) when the scene recognition was performed last time. When there is a frame change, it is determined that the shooting scene has changed, and a scene recognition process is performed. Here, the frame variation check is one of a photometric value variation check, a focus position variation check, and a face presence / absence variation check, but may include other types. These processes will be described later. The result of the first frame variation check is stored as E_AUTOSP_FRAME_CHECK1, which is a parameter of the RAM 69.

  In S23, it is determined whether or not there is a frame variation as a result of the first frame variation check in S22. If “Yes”, the process proceeds to S 24. If “No”, the process proceeds to S 26.

  In S24, the change_measure in the RAM 69 is incremented by 1.

  In S25, the change_measure in the RAM 69 and the predetermined threshold value E_AUTOSP_FRAME_CHANGE_MEASURE in the ROM 68 are compared to determine whether or not change_measure ≧ E_AUTOSP_FRAME_CHANGE_MEASURE. If “No”, the process proceeds to S26, and if “Yes”, the process proceeds to S35.

  In S26, a second frame variation check is performed. Here, the frame variation check is any one of the photometry value variation check, the focus position variation check, and the face presence / absence variation check different from the first time. The result of the second frame fluctuation check is stored as E_AUTOSP_FRAME_CHECK2 which is a parameter of the RAM 69.

  In S27, it is determined whether or not there is a frame variation as a result of the second frame variation check in S26. If “Yes”, the process proceeds to S 28. If “No”, the process proceeds to S 30.

  In S28, the change_measure in the RAM 69 is incremented by 1.

  In S29, the change_measure in the RAM 69 is compared with the threshold value E_AUTOSP_FRAME_CHANGE_MEASURE stored in the ROM 68, and it is determined whether or not change_measure ≧ E_AUTOSP_FRAME_CHANGE_MEASURE. If “No”, the process proceeds to S30, and if “Yes”, the process proceeds to S35.

  In S30, a third frame variation check is performed. Here, the frame variation check is different from the first time and the second time among the photometric value variation check, the focus position variation check, and the face presence / absence variation check. The result of the third frame variation check is stored as E_AUTOSP_FRAME_CHECK3, which is a parameter of the RAM 69.

  In S31, it is determined whether or not there is a frame variation as a result of the third frame variation check in S30. If “Yes”, the process proceeds to S 32. If “No”, the process proceeds to S 34.

  In S32, change_measure in the RAM 69 is incremented by 1.

  In S33, the change_measure in the RAM 69 is compared with the threshold value E_AUTOSP_FRAME_CHANGE_MEASURE stored in the ROM 68, and it is determined whether or not change_measure ≧ E_AUTOSP_FRAME_CHANGE_MEASURE. If “No”, the process proceeds to S34, and if “Yes”, the process proceeds to S35.

  In S34, it is determined that there is no frame variation. A flag indicating the determination may be stored in the RAM 69. Then, the process returns to S5 of the scene recognition main process.

  In S35, it is determined that there is a frame fluctuation. The flag “change in frame” is set to change = ON and stored in the RAM 69. Then, the process returns to S5 of the scene recognition main process.

  FIG. 4 is a flowchart of the photometric value fluctuation check. The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

  In S41, the parameter change_ev in the RAM 69 is set to OFF. The parameter ev [i] of the RAM 69 is set to a photometric value obtained from the photometric unit 46 for the current frame image. i is a subscript corresponding to each of N blocks obtained by dividing an image by a predetermined unit. Here, i = 0 to N-1.

  Further, the parameter ev_base [i] of the RAM 69 is set as the divided photometric value of the frame variation reference information, and the value is secured in the RAM 69. Note that ev_base [i] is initialized in S2 of the main process and updated in S13. Also, the weight w [i] corresponding to each block is read from the ROM 68.

In S42, delta_ev is set in the RAM 69 by the following equation. The summation is performed for i = 0 to N-1. delta_ev may be the difference between the brightness of the entire screen.

delta_ev = ΣW [i] * | ev [i] -ev_base [i] | / ΣW [i]
The sum of the absolute values of the differences for each region is as follows. If the absolute value is not taken, it is to prevent the change for each region from being canceled out by the sum, even though a large change actually occurs for each region, and to prevent the change from being lost as a whole.

In S43, the delta_ev in the RAM 69 is compared with the threshold value E_AUTOSP_FRAME_DELTA_EV stored in the ROM 68 to determine whether or not delta_ev ≧ E_AUTOSP_FRAME_DELTA_EV. “
If “Yes”, the process proceeds to S 44. If “No”, the process proceeds to S 45.

  In S44, it is determined that the photometric value has changed. Then, the flag change_ev indicating that the photometric value has changed is set to ON and stored in the RAM 69.

  In S45, it is determined that there is no change in the photometric value. A flag indicating that there is no change in the photometric value may be stored in the RAM 69.

  FIG. 5 is a flowchart of the focus position variation check. The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

In S51, the parameter change_focal_point of the RAM 69 is set to OFF, the focal_point is set to the focus lens position (number of drive pulses) set by the lens driving unit 51 when the current frame image is acquired, and focal_point_base is set to the focus lens of the frame variation reference information. The position (initialized in S2 or updated in S13) is set, and the storage area is secured in the RAM 69.

  In S52, delta_focal_point is set in the RAM 69 by the following equation.

delta_focal_point = | focal_point- focal_point_base |
In S53, delta_focal_point in the RAM 69 is compared with a predetermined focus position fluctuation threshold stored in the ROM 68, and it is determined whether or not delta_focal_point> focus position fluctuation threshold. If “Yes”, the process proceeds to S 54. If “No”, the process proceeds to S 55.

In S54, it is determined that the focus position has changed. Then, the flag change_focal_point indicating that the focus position has changed is set to ON and stored in the RAM 69.

  In S55, it is determined that the focus position has not changed. A flag indicating that the focus position has not changed may be stored in the RAM 69.

  FIG. 6 is a flowchart of the face presence / absence variation check. The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

  In S61, the parameter change_face_result of the RAM 69 is set to OFF.

  In S62, the presence or absence of face detection output by the face detection processing unit 80 when the current frame image is acquired matches the presence or absence of face detection (initialized in S2 or updated in S13) in the frame variation reference information. Judge whether to do. If “Yes”, the process proceeds to S 64. If “No”, the process proceeds to S 63.

  In S63, it is determined that there has been a change in the presence or absence of face detection. Then, a flag change_face_result indicating that there has been a change in the presence or absence of face detection is set to ON and stored in the RAM 69.

  In S64, it is determined that there is no change in the presence or absence of face detection. A flag indicating that there is no change in the presence or absence of face detection may be stored in the RAM 69.

  FIG. 7 is a flowchart showing details of the single scene recognition operation (S9) of the recognition unit. The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

  In S71, it is determined whether or not the flag (E_AUTOSR_SEARCH_TYPE) for executing the scene-dependent search stored in the RAM 69 is zero. If “Yes”, the process proceeds to S 80. If “No”, the process proceeds to S 72. Note that the value of E_AUTOSR_SEARCH_TYPE can be arbitrarily set from the operation unit 11.

  In S72, AUTO is set in the scene recognition result SR of the RAM 69.

  In S73, E_AUTOSR_MODULE1 stored in advance in the ROM 68 is substituted for the parameter i of the RAM 69. E_AUTOSR_MODULE1 is an integer from 0 to 4. Then, a scene determination (recognition) subroutine corresponding to module [i] is executed. module [0] does nothing. module [1] performs person determination described later. module [2] performs the landscape determination described later. module [3] performs night view judgment described later. module [4] performs the close-up judgment described later.

  In S74, it is determined whether or not the scene recognition result SR in the RAM 69 is AUTO as a result of the execution of module [i] in S73. If “Yes”, the process proceeds to S75. If “No”, the process returns to S10 of the main process.

  In S75, E_AUTOSR_MODULE2 stored in advance in the ROM 68 is substituted for the parameter i of the RAM 69. E_AUTOSR_MODULE2 is an integer from 0 to 4, and is different from E_AUTOSR_MODULE1. Then, a scene determination subroutine corresponding to module [i] is executed.

  In S76, it is determined whether or not the scene recognition result SR in the RAM 69 is AUTO as a result of the execution of module [i] in S75. If “Yes”, the process proceeds to S77, and if “No”, the process returns to S10 of the main process.

  In S77, E_AUTOSR_MODULE3 stored in the ROM 68 in advance is substituted for the parameter i of the RAM 69. E_AUTOSR_MODULE3 is an integer from 0 to 4, and is different from E_AUTOSR_MODULE1 and E_AUTOSR_MODULE2. Then, a scene determination subroutine corresponding to module [i] is executed.

  In S78, it is determined whether or not the scene recognition result SR of the RAM 69 is AUTO as a result of the execution of module [i] in S77. If “Yes”, the process proceeds to S79. If “No”, the process returns to S10 of the main process.

  In S79, E_AUTOSR_MODULE4 stored in advance in the ROM 68 is substituted for the parameter i of the RAM 69. E_AUTOSR_MODULE34 is an integer from 0 to 4, and is different from E_AUTOSR_MODULE1, E_AUTOSR_MODULE2, and E_AUTOSR_MODULE3. Then, a scene determination subroutine corresponding to module [i] is executed. The values of E_AUTOSR_MODULE1, E_AUTOSR_MODULE2, E_AUTOSR_MODULE3, and E_AUTOSR_MODULE4 may be set in any way, but it is better to assign a young number to the type for which scene determination is to be performed preferentially. For example, when it is desired to perform scene determination in the order of person determination> landscape determination> night scene determination> close-up determination, E_AUTOSR_MODULE1 = 1, E_AUTOSR_MODULE2 = 2, E_AUTOSR_MODULE3 = 3, E_AUTOSR_MODULE4 = 4. These values may be arbitrarily set from the operation unit 11.

  In S80, it is determined whether or not the current scene recognition result SR in the RAM 69 is AUTO. If “Yes”, the process proceeds to S 72. If “No”, the process proceeds to S 81.

  In S81, the current scene recognition result SR of the RAM 69 is set in the parameter SR_old of the RAM 69. That is, SR_old = 0 if the current scene recognition result SR in the RAM 69 is AUTO, SR_old = 1 if the scene recognition result SR in the current RAM 69 is a person, and SR_old if the scene recognition result SR in the current RAM 69 is a landscape. = 2, SR_old = 3 if the current scene recognition result SR in the RAM 69 is a night view, and SR_old = 4 if the current scene recognition result SR in the RAM 69 is a close-up.

  In S82, SR_old is substituted for the parameter i of the RAM 69. Then, a scene determination subroutine corresponding to module [i] is executed.

In S83, it is determined whether or not the scene recognition result SR of the RAM 69 is AUTO as a result of the execution of module [i] in S82. If “Yes”, the process proceeds to S84. If “No”, the process returns to S10 of the main process.

In S84, it is determined whether SR_old = E_AUTOSR_MODULE1. If “Yes”, the process proceeds to S87. If “No”, the process proceeds to S85.

  In S85, E_AUTOSR_MODULE1 stored in advance in the ROM 68 is substituted for the parameter i of the RAM 69. Then, a scene determination subroutine corresponding to module [i] is executed.

In S86, it is determined whether or not the scene recognition result SR in the RAM 69 is AUTO as a result of the execution of module [i] in S85. If “Yes”, the process proceeds to S87. If “No”, the process returns to S10 of the main process.

In S87, it is determined whether SR_old = E_AUTOSR_MODULE2. If “Yes”, the process proceeds to S90, and if “No”, the process proceeds to S88.

  In S88, E_AUTOSR_MODULE2 stored in advance in the ROM 68 is substituted for the parameter i of the RAM 69. Then, a scene determination subroutine corresponding to module [i] is executed.

In S89, it is determined whether or not the scene recognition result SR in the RAM 69 is AUTO as a result of the execution of module [i] in S88. If “Yes”, the process proceeds to S90, and if “No”, the process returns to S10 of the main process.

In S90, it is determined whether SR_old = E_AUTOSR_MODULE3. If “Yes”, the process proceeds to S93. If “No”, the process proceeds to S91.

  In S91, E_AUTOSR_MODULE3 stored in the ROM 68 in advance is substituted for the parameter i of the RAM 69. Then, a scene determination subroutine corresponding to module [i] is executed.

In S92, it is determined whether or not the scene recognition result SR in the RAM 69 is AUTO as a result of the execution of module [i] in S91. If “Yes”, the process proceeds to S93. If “No”, the process returns to S10 of the main process.

In S93, it is determined whether SR_old = E_AUTOSR_MODULE4. If “Yes”, the process returns to S10 of the main process, and if “No”, the process proceeds to S94.

  In S94, E_AUTOSR_MODULE4 stored in advance in the ROM 68 is substituted for the parameter i of the RAM 69. Then, a scene determination subroutine corresponding to module [i] is executed. Thereafter, the process returns to S10 of the main process.

  FIG. 8 conceptually shows the single scene recognition result and the total scene recognition result SR determined by the above processing (S9) and S13.

  As shown in FIG. 8, five single scene recognition results SR are successively stored from the oldest to the newest. Each single scene recognition result SR is given a suffix j = 0 to 4, and the smaller the number, the newer the recognition result. The number of stored single scene recognition results = 5 is an example, and any number may be used as long as it is an integer of 3 or more.

  A new scene recognition result SR is acquired every time module [i] single scene recognition is executed in S73, S75, S77, S79 or S85, S88, S91, S94. As a result, 1 is incremented to the subscript of the past scene recognition result SR accumulated so far, and the history becomes one generation old. The new scene recognition result SR is given a subscript of 0 (zero) and becomes the current scene recognition result.

  In FIG. 8, SR [0] = 3, SR [1] = 3, SR [2] = 3, SR [3] = 0, SR [4] = 1 are the new single scene recognition results. By adding SR [0] = 2, SR [1] = 3, SR [2] = 3, SR [3] = 3, SR [4] = 0. Prior to the addition of a new single scene recognition result SR [0], the oldest generation single scene recognition result SR [4] = 1 may be deleted from the RAM 69 or saved together with the addition of a new single scene recognition result. Also good.

  In S13, when a new single scene recognition result is added, single scene recognition having the highest appearance frequency among SR [0], SR [1], SR [2], SR [3], SR [4] The result is specified, and this is again used as a scene recognition result SR (total scene recognition result). In FIG. 8, since the appearance frequency of 3 is the maximum, SR = 3. Accordingly, the CPU 75 sets the total scene recognition result as SR = 3 and sets the shooting mode to the night view mode. As a result, it becomes possible to execute image capturing and recording in accordance with the night view mode shooting conditions and image processing conditions. Further, the frame variation reference information is updated based on the shooting information used at the time of obtaining the newest single scene recognition result among the single scene recognition results having the maximum appearance frequency. In FIG. 8, the single scene recognition results with the maximum appearance frequency (3) are SR [1], SR [2], and SR [3]. Since the latest single scene recognition result among them is SR [3], the frame variation reference information is updated based on the shooting information used when SR [3] is obtained.

  Although illustration is omitted, when there are a plurality of single scene recognition results with the highest frequency, the one containing the latest scene single scene recognition result is set as the total scene recognition result SR. For example, if SR [0] = 2, SR [1] = 3, SR [2] = 3, SR [3] = 2, SR [4] = 0, SR [0] = SR [3] = 2 SR [1] = SR [2] = 3 and 2 and 3 have the same appearance frequency. In this case, 2 including the newest generation single scene recognition result SR [0] is the total scene recognition result SR. Further, the frame variation reference information is updated based on the shooting information used when the single scene recognition result SR [0] is obtained.

FIG. 9 is a flowchart showing details of the scene determination subroutine (person determination, module [1]). The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

  In S101, the face detection processing unit 80 determines whether a face is detected. If “Yes”, the process proceeds to S102. If “No”, the process proceeds to S105.

  In S102, it is determined whether or not the face restriction flag in the RAM 69 is on. If “Yes”, the process proceeds to S 103. If “No”, the process proceeds to S 104.

  In S103, for the face area set as the AF evaluation value calculation area, the face size is within a predetermined range, the face inclination is within the predetermined range, the face orientation is within the predetermined range, and the face probability score Is determined within a predetermined range and whether the face position is within the predetermined range. If “No”, the process proceeds to S105, and if “Yes”, the process proceeds to S104.

In S104, the scene recognition result SR = person is set. Then, the process proceeds after module [1], that is, the next process of any one of S73, S75, S77, and S79, or the next process of any one of S85, S88, S91, and S94.

  In S105, the scene recognition result SR is set to AUTO.

FIG. 10 is a flowchart showing details of the scene determination subroutine (landscape determination, module [2]). The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

  In S111, it is determined whether or not the half-press (S1) of the release button is locked. If “Yes”, the process proceeds to S 124. If “No”, the process proceeds to S 112.

  In S <b> 112, it is determined whether execution of continuous AF (hereinafter referred to as “CAF”) is set in advance via the setting menu or the operation unit 11. If “Yes”, the process proceeds to S113. If “No”, the process proceeds to S129.

  In S113, it is determined whether the AF evaluation value calculated by the pre-imaging AF processing unit 81 is higher than a predetermined threshold stored in the ROM 68. If “Yes”, the process proceeds to S114. If “No”, the process proceeds to S119. Note that step S113 may be omitted. In this case, if “Yes” in S112, the process proceeds to S114, and the processes (S119, S120, S121, S122, and S123) that follow when “No” is determined in S113 are also omitted.

In S114, it is determined whether or not E_AUTOSR_CHECK_CAFSTATUS_HIGH = 0 stored in the ROM 68. If “Yes”, the process proceeds to S 115. If “No”, the process proceeds to S 116.

  In S115, it is determined whether the in-focus position determined as a result of the CAF is on the infinity side (INF) side from the predetermined focal length threshold stored in the ROM 68, that is, whether the in-focus subject is farther than the predetermined distance. To do. If “Yes”, the operation proceeds to S 125. If “No”, the operation proceeds to S 129.

In S116, it is determined whether E_AUTOSR_CHECK_CAFSTATUS_HIGH = 1. “Yes
If "", the process proceeds to S117. If "No", the process proceeds to S118.

  In S117, as a result of the CAF, the maximum point of the AF evaluation value is detected, and the focal length corresponding to the in-focus position determined by the maximum point is infinity (INF) than the predetermined focal length threshold stored in the ROM 68. ) Side, that is, whether it is farther than a predetermined distance. If “Yes”, the operation proceeds to S 125. If “No”, the operation proceeds to S 129.

  In S118, as a result of CAF, the maximum point of the AF evaluation value is detected or the AF evaluation value is in the vicinity of the maximum point (for example, “fine adjustment” in paragraph 0041 of Japanese Patent Laid-Open No. 2003-348426 by the present applicant). And the focal length corresponding to the in-focus position determined at the local maximum point is on the infinity side (INF) side of the predetermined focal length threshold stored in the ROM 68, that is, from the predetermined distance. Judge whether the distance is too far. If “Yes”, the operation proceeds to S 125. If “No”, the operation proceeds to S 129.

  In S119, it is determined whether or not E_AUTOSR_CHECK_CAFSTATUS_LOW = 0 stored in the ROM 68. If “Yes”, the process proceeds to S120. If “No”, the process proceeds to S121.

  In S120, it is determined whether the in-focus position determined as a result of CAF is on the infinity side (INF) side of the predetermined focal length threshold stored in the ROM 68, that is, whether it is farther than the predetermined distance. If “Yes”, the operation proceeds to S 125. If “No”, the operation proceeds to S 129.

  In S121, it is determined whether E_AUTOSR_CHECK_CAFSTATUS_LOW = 1. If “Yes”, the process proceeds to S122. If “No”, the process proceeds to S123.

  In S122, as a result of the CAF, the maximum point of the AF evaluation value is detected, and the focal length corresponding to the in-focus position determined by the maximum point is infinity (INF) than the predetermined focal length threshold stored in the ROM 68. ) Side, that is, whether it is farther than a predetermined distance. If “Yes”, the operation proceeds to S 125. If “No”, the operation proceeds to S 129.

  In S123, as a result of CAF, the maximum point of the AF evaluation value is detected or the AF evaluation value is in the vicinity of the maximum point (for example, “fine adjustment” in paragraph 0041 of JP-A-2003-348426 by the present applicant). And the focal length corresponding to the in-focus position determined at the local maximum point is on the infinity side (INF) side of the predetermined focal length threshold stored in the ROM 68, that is, from the predetermined distance. Judge whether the distance is too far. If “Yes”, the operation proceeds to S 125. If “No”, the operation proceeds to S 129.

  In S124, the in-focus position is determined by the AF processing of the AF processing unit 62, and the focal length corresponding to the in-focus position is on the infinity (INF) side of the predetermined focal length threshold stored in the ROM 68. That is, it is determined whether or not the distance is longer than a predetermined distance. If “Yes”, the operation proceeds to S 125. If “No”, the operation proceeds to S 129.

  In S125, it is determined whether or not the field luminance measured by the control circuit 74 is lower than a predetermined threshold stored in the ROM 68. If “Yes”, the process proceeds to S 126. If “No”, the process proceeds to S 129.

  In S126, it is determined whether or not the landscape zoom information flag is set in advance as a setting parameter of the ROM 68 or from the operation unit 11. If “Yes”, the operation proceeds to S127. If “No”, the operation proceeds to S128.

  In S127, it is determined whether or not the zoom lens position is within a predetermined range, for example, on the wide side of the predetermined position. If “Yes”, the process proceeds to S128. If “No”, the process proceeds to S129. The zoom position is not within the predetermined range when, for example, the zoom lens position is at or near the tele end. In this case, since the entire view cannot be included in the angle of view and is not suitable for landscape photography, the photographing scene is determined to be AUTO.

  In S128, SR = landscape is set. Then, the process proceeds after module [2].

  In S129, SR = AUTO is set. Then, the process proceeds after module [2].

  FIG. 11 is a flowchart showing details of the scene determination subroutine (night scene determination, module [3]). The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

  In S 131, it is determined whether or not the field luminance measured by the control circuit 74 is lower than a predetermined threshold stored in the ROM 68. If “Yes”, the operation proceeds to S 132. If “No”, the operation proceeds to S 152.

  In S132, it is determined whether or not the release button half-press (S1) is locked. If “Yes”, the process proceeds to S 147. If “No”, the process proceeds to S 133.

  In S133, it is determined whether or not the night scene determination flag stored in the RAM 69 before half-pressing (S1) is set to ON. If “Yes”, the process proceeds to S 134. If “No”, the process proceeds to S 152.

  In S134, it is determined whether the distance information is to be used in the night scene determination based on the input from the operation unit 11 or the parameter stored in the ROM 68. If the setting for using distance information is set for night scene determination, the process proceeds to S135, and if the setting for using distance information is not set for night scene determination, the process proceeds to S149.

  In S135, it is determined whether or not CAF execution is set in advance via the setting menu or the operation unit 11. If “Yes”, the operation proceeds to S136. If “No”, the operation proceeds to S152.

  In S 136, it is determined whether or not the AF evaluation value calculated by the pre-imaging AF processing unit 81 is higher than a predetermined threshold stored in the ROM 68. If “Yes”, the operation proceeds to S 137. If “No”, the operation proceeds to S 142. Note that step S136 may be omitted. In this case, if “Yes” in S135, the process proceeds to S137, and various processes subsequent to “No” in S136 are also omitted.

In S137, it is determined whether E_AUTOSR_CHECK_CAFSTATUS_HIGH = 0. “Yes
If "", the process proceeds to S138. If "No", the process proceeds to S139.

  In S138, it is determined whether the in-focus position determined as a result of CAF is on the infinity side (INF) side of the predetermined focal length threshold stored in the ROM 68, that is, whether it is farther than the predetermined distance. If “Yes”, the process proceeds to S 149. If “No”, the process proceeds to S 152.

In S139, it is determined whether E_AUTOSR_CHECK_CAFSTATUS_HIGH = 1. “Yes
If "", the process proceeds to S140. If "No", the process proceeds to S141.

  In S140, as a result of CAF, the maximum point of the AF evaluation value is detected, and the focal length corresponding to the in-focus position determined by the maximum point is infinity (INF) than the predetermined focal length threshold stored in the ROM 68. ) Side, that is, whether it is farther than a predetermined distance. If “Yes”, the process proceeds to S 149. If “No”, the process proceeds to S 152.

  In S141, as a result of CAF, the maximum point of the AF evaluation value is detected or the AF evaluation value is in the vicinity of the maximum point (for example, “fine adjustment” in paragraph 0041 of Japanese Patent Laid-Open No. 2003-348426 by the present applicant). And the focal length corresponding to the in-focus position determined at the local maximum point is on the infinity side (INF) side of the predetermined focal length threshold stored in the ROM 68, that is, from the predetermined distance. Judge whether the distance is too far. If “Yes”, the process proceeds to S 149. If “No”, the process proceeds to S 152.

  In S142, it is determined whether E_AUTOSR_CHECK_CAFSTATUS_LOW = 0. If “Yes”, the process proceeds to S143. If “No”, the process proceeds to S144.

  In S143, it is determined whether the in-focus position determined as a result of the CAF is on the infinity side (INF) side of the predetermined focal length threshold stored in the ROM 68, that is, whether it is farther than the predetermined distance. If “Yes”, the process proceeds to S 149. If “No”, the process proceeds to S 152.

  In S144, it is determined whether E_AUTOSR_CHECK_CAFSTATUS_LOW = 1. If “Yes”, the process proceeds to S145. If “No”, the process proceeds to S146.

  In S145, as a result of CAF, the maximum point of the AF evaluation value is detected, and the focal length corresponding to the in-focus position determined by the maximum point is infinity (INF) than the predetermined focal length threshold stored in the ROM 68. ) Side, that is, whether it is farther than a predetermined distance. If “Yes”, the process proceeds to S 149. If “No”, the process proceeds to S 152.

  In S146, as a result of CAF, a maximum point of the AF evaluation value is detected or the AF evaluation value is in the vicinity of the maximum point (for example, “fine adjustment” in paragraph 0041 of Japanese Patent Application Laid-Open No. 2003-348426 by the present applicant). And the focal length corresponding to the in-focus position determined at the local maximum point is on the infinity side (INF) side of the predetermined focal length threshold stored in the ROM 68, that is, from the predetermined distance. Judge whether the distance is too far. If “Yes”, the process proceeds to S 149. If “No”, the process proceeds to S 152.

  In S147, it is determined whether the distance information is to be used in the night scene determination based on an input from the operation unit 11 or a parameter stored in the ROM 68. If the setting for using distance information is set for night scene determination, the process proceeds to S148, and if the setting for using distance information is not set for night scene determination, the process proceeds to S149.

  In S148, the in-focus position is determined by the AF processing of the AF processing unit 62, and the focal length corresponding to the in-focus position is on the infinity (INF) side of the predetermined focal length threshold stored in the ROM 68. That is, it is determined whether or not the distance is longer than a predetermined distance. If “Yes”, the process proceeds to S 149. If “No”, the process proceeds to S 152.

  In S149, it is determined whether the night view zoom information flag is set to ON in advance as a setting parameter of the ROM 68 or from the operation unit 11. If “Yes”, the process proceeds to S150. If “No”, the process proceeds to S151.

  In S150, it is determined whether or not the zoom lens position is within a predetermined range, for example, on the wide side of the predetermined position. If “Yes”, the process proceeds to S 151. If “No”, the process proceeds to S 152. The zoom position is not within the predetermined range when, for example, the zoom lens position is at or near the tele end. In this case, the back distant view with a small amount of incident light cannot be included in the angle of view, and is not suitable for night view photography, so it is determined as AUTO.

  In S151, SR = night view is set. Then, the process proceeds after module [3].

In S152, SR = AUTO is set. Then, the process proceeds after module [3].

FIG. 12 is a flowchart illustrating another example of the scene determination subroutine (night scene determination, module [3]). The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68. For night view determination, either of FIGS. 11 and 12 is sufficient. Either one may be selectively executed.

  In S 161, it is determined whether or not the field luminance measured by the control circuit 74 is lower than a predetermined threshold stored in the ROM 68. If “Yes”, the operation proceeds to S 162. If “No”, the operation proceeds to S 168. This threshold value may be the same as or different from the threshold value for determining whether to instruct the auxiliary light control unit 25 to emit light.

  In S162, it is determined whether or not the release button half-press (S1) is locked. If “Yes”, the process proceeds to S 163. If “No”, the process proceeds to S 168.

  In S163, it is determined whether or not the auxiliary light control unit 25 is instructed to emit the auxiliary light 26. If “Yes”, the process proceeds to S 164. If “No”, the process proceeds to S 168.

  In S164, whether or not the difference in the field luminance measured by the control circuit 74 immediately before and after the auxiliary light control unit 25 causes the auxiliary light emitting unit 26 to emit light exceeds a predetermined threshold stored in the ROM 68. Judging. If “Yes”, the process proceeds to S168. If “No”, the process proceeds to S165. Note that if the difference does not exceed the threshold and is very small, it can be said that there is almost no contribution to the increase in subject brightness due to irradiation of auxiliary light, and the subject is not close.

  In S165, it is determined whether the night view zoom information flag is set to ON in advance as a setting parameter of the ROM 68 or from the operation unit 11. If “Yes”, the process proceeds to S 166. If “No”, the process proceeds to S 167.

  In S166, it is determined whether or not the zoom lens position is within a predetermined range, for example, on the wide side of the predetermined position. If “Yes”, the process proceeds to S 167. If “No”, the process proceeds to S 168. The zoom position is not within the predetermined range when, for example, the zoom lens position is at or near the tele end. In this case, the back distant view cannot be included in the angle of view and is not suitable for night view photography.

  In S167, SR = night scene is set. Then, the process proceeds after module [3].

In S168, SR = AUTO is set. Then, the process proceeds after module [3].

FIG. 13 is a flowchart showing details of the scene determination subroutine (close-up determination, module [4]). The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

  In S171, it is determined whether or not the release button half-press (S1) is locked. If “Yes”, the process proceeds to S 184. If “No”, the process proceeds to S 172.

  In S172, it is determined whether or not CAF execution is set in advance via the setting menu or the operation unit 11. If “Yes”, the process proceeds to S 173. If “No”, the process proceeds to S 188.

  In S 173, it is determined whether or not the AF evaluation value calculated by the pre-imaging AF processing unit 81 is higher than a predetermined threshold stored in the ROM 68. If “Yes”, the process proceeds to S 174. If “No”, the process proceeds to S 179. Note that step S173 may be omitted. In this case, if “Yes” in S 172, the process proceeds to S 174, and various processes subsequent to “No” in S 173 are also omitted.

In S174, it is determined whether E_AUTOSR_CHECK_CAFSTATUS_HIGH = 0. “Yes
If "", the process proceeds to S175. If "No", the process proceeds to S176.

  In S175, it is determined whether the in-focus position determined as a result of CAF is closer to the near (NEAR) side than the predetermined focal distance threshold stored in the ROM 68, that is, whether it is closer than the predetermined distance. If “Yes”, the process proceeds to S 185. If “No”, the process proceeds to S 188.

In S176, it is determined whether E_AUTOSR_CHECK_CAFSTATUS_HIGH = 1. “Yes
If "", the process proceeds to S177, and if "No", the process proceeds to S178.

  In S177, as a result of CAF, the maximum point of the AF evaluation value is detected, and the focal length corresponding to the in-focus position determined by the maximum point is closer than the predetermined focal length threshold value stored in the ROM 68 (NEAR). It is determined whether it is on the side, that is, whether it is closer than a predetermined distance. If “Yes”, the process proceeds to S 185. If “No”, the process proceeds to S 188.

  In S178, as a result of CAF, the maximum point of the AF evaluation value is detected or the AF evaluation value is in the vicinity of the maximum point (for example, “fine adjustment” in paragraph 0041 of JP-A-2003-348426 by the present applicant). And the focal length corresponding to the in-focus position determined by the local maximum point is closer to the near (NEAR) side than the predetermined focal length threshold stored in the ROM 68, that is, more than the predetermined distance. Judge whether it is close or not. If “Yes”, the process proceeds to S 185. If “No”, the process proceeds to S 188.

  In S179, it is determined whether E_AUTOSR_CHECK_CAFSTATUS_LOW = 0. If “Yes”, the process proceeds to S180. If “No”, the process proceeds to S181.

  In S180, it is determined whether the in-focus position determined as a result of CAF is closer to the nearer (NEAR) side than the predetermined focal length threshold stored in the ROM 68, that is, whether it is closer than the predetermined distance. If “Yes”, the process proceeds to S 185. If “No”, the process proceeds to S 188.

  In S181, it is determined whether E_AUTOSR_CHECK_CAFSTATUS_LOW = 1. If “Yes”, the process proceeds to S 182. If “No”, the process proceeds to S 183.

  In S182, as a result of CAF, the maximum point of the AF evaluation value is detected, and the focal length corresponding to the in-focus position determined by the maximum point is closer than the predetermined focal length threshold value stored in the ROM 68 (NEAR). It is determined whether it is on the side, that is, whether it is closer than a predetermined distance. If “Yes”, the process proceeds to S 185. If “No”, the process proceeds to S 188.

  In S183, as a result of CAF, the maximum point of the AF evaluation value is detected or the AF evaluation value is in the vicinity of the maximum point (for example, “fine adjustment” in Japanese Patent Application Laid-Open No. 2003-348426, paragraph 0041 by the present applicant). And the focal length corresponding to the in-focus position determined by the local maximum point is closer to the near (NEAR) side than the predetermined focal length threshold stored in the ROM 68, that is, more than the predetermined distance. Judge whether it is close or not. If “Yes”, the process proceeds to S 185. If “No”, the process proceeds to S 188.

  In S184, the focus position is determined by the AF process of the AF processing unit 62, and the focal length corresponding to the focus position is closer to the near (NEAR) side than the predetermined focal distance threshold stored in the ROM 68. That is, it is determined whether or not it is closer than a predetermined distance. If “Yes”, the process proceeds to S 185. If “No”, the process proceeds to S 188.

  In S185, it is determined whether the close-up zoom information flag is set to ON in advance as a setting parameter of the ROM 68 or from the operation unit 11. If “Yes”, the process proceeds to S186. If “No”, the process proceeds to S187.

  In S186, it is determined whether or not the zoom lens position is within a predetermined range stored in the ROM 68, for example, on the wide side of the predetermined position. If “Yes”, the process proceeds to S 187. If “No”, the process proceeds to S 188. Note that the zoom position is not within the predetermined range, for example, except when the zoom lens position is at or near the wide end. In this case, the close subject cannot be focused and is not suitable for close-up photography.

  In S187, SR = close-up is set. Then, the process proceeds after module [4].

  In S188, SR = AUTO is set. Then, the process proceeds after module [4].

  The CPU 75 controls the display unit 11 to display the scene determination results in FIGS. 9 to 13.

  For example, as shown in FIG. 14, characters such as “landscape”, “AUTO”, “person”, “night view”, and “close-up”, which are the results of the scene determination, are recorded on the through image or after the release button is fully pressed. The image is superimposed on the image and displayed on the display unit 11. Character strings, icons, symbols, and other information indicating the result of scene determination are generated by an OSD circuit (not shown). If the camera 1 is provided with an audio processing circuit and a speaker, the CPU 75 may control to output a notification sound corresponding to the result of the scene determination. If “automatic scene recognition OFF” is set, the scene determination result is not displayed.

  Through the above processing, it is possible to recognize what kind of scene the user is going to take or has taken. As shown in FIG. 14, the recognized result is notified to the user in an easy-to-understand form by displaying text and icons. Recognizable scenes are a person (FIG. 9), a landscape (FIG. 10), a night view (FIGS. 11 and 12), and a close-up (FIG. 13). If the scene determination result does not apply to any of these scenes, the result is AUTO.

In the main process of FIG. 2, scene recognition is performed when the scene changes. Changes in the state of the frame when the previous scene recognition result is confirmed and the state of the current frame are monitored (S4, FIG. 3). If it is determined that there is a scene change when there is a change (S5), status = search state (S6), and the recognition unit operates at the scene change timing (S9).

In the frame variation check of FIG. 3, it is possible to have a plurality of factors for detecting variation, and the order can be changed by setting E_AUTOSR_FRAME_CHECK1 to 3. When a change is detected, the value of change_measure that is an index of the frame change is incremented (S24, S28, S32). If the value of change_measure is greater than or equal to E_AUTOSR_FRAME_CHANGE_MEASURE (“Yes” in S25, S29, and S33), it is determined that there is a frame variation (S35).

  Here, as specific processing for detecting the frame fluctuation, a photometric value fluctuation check (FIG. 4), a focus position fluctuation check (FIG. 5), and a face presence / absence fluctuation check (FIG. 6) are shown. Although illustration is omitted, frame variation may be detected according to whether or not the pre-imaging AF processing unit 81 has detected focus.

In the photometric value fluctuation check of FIG. 4, delta_ev, which is an index of the photometric value fluctuation amount, is calculated by calculating the photometric value fluctuation amount for each of the N-divided areas and summing them by applying a weight corresponding to each area. It is. If the value of delta_ev is equal to or greater than E_AUTOSP_FRAME_DELTA_EV, it is determined that there is a change in the photometric value.

In the focus position fluctuation check of FIG. 5, delta_focal_point, which is an index of the focus position fluctuation amount, is calculated from the difference between the focus position of the reference information and the current focus position. When the value of delta_focal_point is equal to or greater than the focus position fluctuation threshold, it is determined that there is a focus position fluctuation. Note that the threshold used here is set in the ROM 68 for each zoom position.

  In the face presence / absence variation check in FIG. 6, it is determined that there is a face presence / absence variation when the face presence / absence result of the reference information is different from the current face presence / absence result.

  The scene recognition history used for the difference in the recognition unit operation is cleared after obtaining the SR to be adopted as a result of the automatic scene recognition (S8). This is because the recognizing unit is not assumed to always operate and does not refer to information at a distant time.

  Here, since the scene recognition history is cleared, after entering the search state (S6), the same number of times as the number of single scene recognition results required for total scene recognition are obtained. Only until the recognition unit operates (until “Y” in S11), the SR is not updated.

  Further, when determining the SR, the shooting information at the time point when the adopted SR becomes the maximum frequency (latest side) is stored as the frame variation reference information for checking the frame variation (S13).

  If the determined SR is other than AUTO, the status is “determined” (S16), and the recognition unit does not operate until the scene changes. On the other hand, when the determined SR is AUTO, the “search state” is set (S15), and the recognition unit is continuously operated. This is because setting the status to the “determined state” based on the result recognized in the middle of the scene change may prevent the scene change from being detected correctly.

  If you check the frame fluctuation after registering the state in the middle of the scene fluctuation as the frame fluctuation reference information, even if you want the recognizer to operate with the scene fluctuation finally completed, Since the difference from the information is small, a phenomenon occurs in which the recognition unit does not operate. In order to avoid this, processing for updating the frame variation reference information is performed based on the shooting information corresponding to the scene determined as described above (S13).

  If the result of scene recognition is not stable, the output result causes user confusion. Accordingly, by performing a mixed operation of the process for determining what kind of scene the shooting scene is (S7 to S16) and the process for monitoring whether there is a change from the recognized scene (S4 to S6). It is possible to perform accurate and stable scene recognition.

Second Embodiment
FIG. 15 is a flowchart of a frame fluctuation check subroutine according to the second embodiment. This process can be executed instead of the process of FIG. The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

  S201 to S203 are the same as S21 to 23.

  In S204, a value obtained by adding a weight E_AUTOSP_FRAME_CHECK1 corresponding to the first frame variation check to the parameter change_measure in the RAM 69 is set as a new change_measure. E_AUTOSP_FRAME_CHECK1 is stored in the ROM 68 in advance.

  S205 to S207 are the same as S25 to 27.

  In S208, a value obtained by adding the weight E_AUTOSP_FRAME_CHECK2 corresponding to the second frame variation check to the parameter change_measure in the RAM 69 is set as a new change_measure. E_AUTOSP_FRAME_CHECK2 is stored in the ROM 68 in advance.

  S209 to S211 are the same as S29 to 27.

  In S212, a value obtained by adding the weight E_AUTOSP_FRAME_CHECK3 corresponding to the third frame variation check to the parameter change_measure in the RAM 69 is set as a new change_measure. E_AUTOSP_FRAME_CHECK3 is stored in the ROM 68 in advance.

  S213 to S215 are the same as S33 to 35.

  FIG. 16 shows an example of weights E_AUTOSP_FRAME_CHECK1 to 3 corresponding to the first to third frame fluctuation checks stored in the ROM 68, and an example of the value of change_measure corresponding to the presence or absence of a change due to the first to third frame fluctuation checks. It is a table which shows the relationship.

  Here, as an example, the first frame variation check is a face presence variation (FIG. 6), the second frame variation check is a focus position variation (FIG. 5), and the third frame variation check is a photometric value variation (FIG. 4). Yes, E_AUTOSP_FRAME_CHECK1 = 2, E_AUTOSP_FRAME_CHECK2 = 1, and E_AUTOSP_FRAME_CHECK3 = 1. That is, the face presence / absence fluctuation is more weighted than the focus position fluctuation and the photometric value fluctuation.

  The table covers all combinations of variation results assumed in the first to third frame variation checks, but is not shown. For example, when E_AUTOSP_FRAME_CHANGE_MEASURE = 2, if it is determined that there is a change in the first frame change check (face presence / absence change), change_measure = 2 = E_AUTOSP_FRAME_CHANGE_MEASURE, so “Yes” is determined in S205, and the process proceeds to S215. It is determined that there is a frame fluctuation. That is, since the weight corresponding to the face presence / absence variation is large, there is a frame variation immediately when there is a face presence / absence variation.

  on the other hand. If it is determined that there is no change in the first frame variation check (face presence variation), even if it is determined that there is a change in the second frame variation check (focus position variation), change_measure = 1 <E_AUTOSP_FRAME_CHANGE_MEASURE. Therefore, unless it is determined that there is a change in the third frame fluctuation check, “No” is determined in S213, and the process proceeds to S214, where it is determined that there is no frame fluctuation. In other words, since the weight corresponding to the focus position change is small, it is determined that the change does not occur immediately when there is a focus position change, but only when there is a change in other factors.

  The contents of the table of FIG. 16, that is, the weight corresponding to each frame change check and the value of E_AUTOSP_FRAME_CHANGE_MEASURE can be freely set by the user via the operation unit 11 from the “important item selection” screen displayed on the display unit 71. .

  In this way, when there are a plurality of factors for determining whether the scene is changing, the weights corresponding to each factor can be freely set, so that the criteria for the scene change check can be expressed in various forms. If the user can freely set the condition for determining that there is a scene change, the scene change reference can be customized, and the change of the factor emphasized by the user can be strongly reflected in the determination of the scene change.

<Third Embodiment>
FIG. 17 is a flowchart of the main process according to the third embodiment. This process can be executed instead of the process of FIG. The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68. In this embodiment, the frame variation check (single frame variation check) is performed a plurality of times based on the frame variation reference information, the frame variation check result is accumulated as a frame variation history, and the frame variation check is performed based on the frame variation history. (Total frame fluctuation check) is performed.

  S301 to 303 are the same as S1 to S3. However, in S302, the frame fluctuation history is also initialized.

  In S304, the frame fluctuation history stored in the RAM 69 is moved up by one generation. That is, the frame fluctuation history is slid. In FIG. 18, as an example, five histories 1, 1, 0, 0, 1 are slid from a new one. As a result, the latest history is “null”, and the older history is 1, 1, 0, 0. Note that the number of histories need not be five.

  In step S305, a frame variation check (single frame variation check) is performed on the latest fetched frame, and the result is added to the frame variation history as the latest single frame variation check result.

  In S306, it is determined whether or not the frame has changed as a result of S305. If “Yes”, the process returns to S307, and if “No”, the process returns to S301.

  In S307, the variation flag of the latest single frame variation check result in the frame variation history stored in the RAM 69 is set to ON. In FIG. 18, as an example, the latest frame is determined to have a frame variation, and the frame variation history is 1, 1, 1, 0, 0.

  S308 is the same as S4.

  In the following S309 and S310, a frame variation check (total frame variation check) based on the frame variation history is performed. In S309, the frame fluctuation history stored in the RAM 69 is referred to and the number of times of fluctuation (E_AUTOSR_FRAME_CHECK_HISTORY) is counted.

  In S309, the number of changes (E_AUTOSR_FRAME_CHECK_HISTORY) counted in S309 among the past M (M = 5 in FIG. 18) single frame change check results included in the frame change history is stored in the ROM 68. It is determined whether or not a predetermined scene variation determination threshold value (E_AUTOSR_SCENE_CHANGE_JUDGE) or more. If “Yes”, the process returns to S310, and if “No”, the process returns to S301.

  In S310, it is determined that there is a scene change, the status is set to the search state, and the frame change history in the RAM 69 is cleared. That is, all the frame fluctuation histories 1, 1, 1, 0, 0 in FIG. 18 are cleared, and the presence or absence of scene fluctuation (total frame fluctuation check) is not judged until M individual frame fluctuation check results are newly accumulated. .

  In S311, it is determined whether or not the scene recognition history retention flag is ON. If “Yes”, the process proceeds to S 313. If “No”, the process proceeds to S 312.

  In S312, the scene recognition counter of the RAM 69 is set to 0, the scene recognition history is cleared, and the reference scene recognition history for recognition after half-pressing (S1) is cleared.

  S313 to S321 are the same as S9 to S17, respectively.

  In this process, it is monitored whether the state of the current frame changes compared to the frame state when the previous scene recognition result SR is confirmed. A predetermined number of the frame fluctuation states are sequentially stored from the oldest to the newest as the frame fluctuation history. If the number of times that “there is frame variation” in the history of E_AUTOSR_FRAME_CHECK_HISTORY is greater than or equal to E_AUTOSR_SCENE_CHANGE_JUDGE (“Yes” in S309), it is determined that there is a scene variation (S310), and the recognition unit operates. (S313).

  As described above, when the scene variation is determined, by using the frame variation history, it is possible to prevent hunting and perform a reliable scene variation determination.

<Fourth embodiment>
FIG. 19 is a flowchart of main processing (scene variation recognition / periodic recognition coexistence type) according to the fourth embodiment. This process can be selectively executed with the process of FIG. 2 (or FIG. 17). The execution of this process is controlled by the CPU 75 of the camera 1. A program for defining this processing is stored in the ROM 68.

  S401 is the same as S1.

  In step S402, the frame variation history in the RAM 69 is initialized, the frame variation reference information is initialized, status = search state, check counter = 0, and scene recognition history retention flag = OFF.

In S403, it is determined whether status = confirmed state. If “Yes”, S404 “
If “No”, the process proceeds to S415.

  In S404, it is determined whether or not a flag for periodically operating the recognition unit is set (E_AUTOSR_RECOGNIZE_CYCLE_TYPE = 0). If “Yes”, the process proceeds to S 405. If “No”, the process proceeds to S 412. The value of E_AUTOSR_RECOGNIZE_CYCLE_TYPE may be arbitrarily input by the user from the operation unit 11, or may be stored in the ROM 68 in advance by the manufacturer. The unit of the period is also arbitrary, and the user may arbitrarily input it from the operation unit 11. For example, a cycle such as 2 seconds every 5 frames can be set. By periodically operating the recognition unit, the recognition result does not change rapidly and stability is improved. In addition, since the check is periodically performed, even if inappropriate recognition is once performed, the result is not continuously output thereafter.

  S405 to S411 are the same as S304 to S310, respectively.

  In S412-414, status = search state is set according to whether or not a fixed period for scene recognition has arrived. That is, in S412, the check counter is incremented by 1. In S413, it is determined whether or not the check counter has reached a predetermined search cycle E_AUTOSR_CONST_SEARCH_CYCLE stored in the ROM 68. In the case of “Yes”, the process proceeds to S414. If “No”, the process returns to S401. In S414, status = search state and check counter is set to zero.

  S415 to S425 are the same as S311 to S321, respectively.

  There are merits and demerits between when the recognition unit operates, that is, when the scene recognition is performed when the scene changes and when the scene recognition is performed at regular intervals. When performing scene recognition when the scene changes, the responsiveness is higher than when performing it at regular intervals. On the other hand, when scene recognition is performed at regular intervals, the stability is excellent, and even if a wrong scene determination (scene recognition) is made, it is not output on the screen. Therefore, by making it possible for the user to select which method to use, it is possible to improve the user-specific usability.

  In addition, it is possible not to determine the timing at which the recognition unit operates by user selection, but even if the designer selects in advance, the operation of both can be realized by the difference in parameters based on the common firmware It becomes. Therefore, it is also possible to change the control for each user who is a target of a different camera product (model) without changing the firmware.

62: AF processing unit, 63: AE / AWB processing unit, 75: CPU, 80: face detection processing unit, 81: pre-imaging AF processing unit

Claims (14)

Shooting information acquisition means for acquiring shooting information which is information of a shooting scene;
Reference information storage means for storing reference information for discriminating changes in the shooting scene;
Scene variation determining means for determining whether or not the shooting scene has changed from the reference information stored in the reference information storage means and the shooting information acquired by the shooting information acquisition means;
A scene recognizing unit for recognizing a shooting scene based on the shooting information acquired by the shooting information acquiring unit in response to determining that the shooting scene has been changed by the scene change determining unit;
Processing means for storing new reference information based on photographing information corresponding to a scene recognition result recognized by the scene recognition means as the reference information in the reference information storage means;
Depending on the scene recognition means scene recognition recognized result, display control, photographing control, e Bei and control means for performing at least one of the signal processing control and information recording control,
The scene recognizing means continues scene recognition of the shooting scene when the recognized shooting scene is a specific scene, and determines scene recognition of the shooting scene when the recognized shooting scene is other than a specific scene. An imaging device that does not recognize a scene until the scene change determining means determines that the shooting scene has changed . The scene recognition means includes
A single scene recognition means for performing single scene recognition based on the shooting information acquired by the shooting information acquisition means in response to the fact that the shooting scene has been changed by the scene change determination means;
A scene recognition history storage means for storing a history of a single scene recognition result by the single scene recognition means as a scene recognition history;
With
The processing means sets the new reference information based on the shooting information used at the time of obtaining the newest single scene recognition result among the single scene recognition results having the highest appearance frequency in the scene recognition history as the reference information. The imaging apparatus according to claim 1, which is stored in a storage unit.   The imaging apparatus according to claim 2, further comprising a total scene recognition unit configured to perform scene recognition of the shooting scene based on the scene recognition history. The total scene recognizing unit detects a shooting scene indicated by the maximum frequency single scene recognition result from the scene recognition history, and the shooting scene indicated by the maximum frequency single scene recognition result is detected by the scene variation determination unit. The imaging device according to claim 3, wherein the imaging device is recognized as a photographic scene after it is determined that it has changed. When a plurality of shooting scenes indicated by the maximum frequency single scene recognition result are detected, the total scene recognition means selects the latest shooting scene among the shooting scenes indicated by the plurality of maximum frequency single scene recognition results. The imaging apparatus according to claim 4 , wherein the imaging variation is recognized as a photographic scene after it is determined that the photographic scene has been changed by the scene change determination unit. The shooting information acquisition means includes at least one information of face presence / absence information indicating whether or not a person's face is present in the shooting scene, subject distance information related to a subject distance, and photometric information related to subject brightness, the imaging apparatus according to claim 1 for obtaining a photographic information 5. The photographing information acquisition means obtains two or more pieces of information of face detection result information indicating whether or not a person's face is present in a photographing scene, subject distance relating to subject distance, and photometric information relating to subject brightness. As information,
The scene variation determination means determines whether the shooting scene has changed from the shooting information acquired by the shooting information acquisition means and the reference information corresponding to the shooting information stored in the reference information storage means. the imaging apparatus according to any one of claims 1 to determine 6. The scene variation determination unit weights each information to the two or more pieces of information acquired by the photographing information acquisition unit and the reference information corresponding to the two or more pieces of information stored in the reference information storage unit. The imaging apparatus according to claim 7 , further comprising weight setting means for performing the following. The scene variation determination means includes
Single scene change determination means for sequentially determining the presence or absence of changes in the shooting scene from the reference information stored in the reference information storage means and the shooting information acquired by the shooting information acquisition means;
A scene fluctuation history storage means for storing a history of a result of the single scene fluctuation determination by the single scene fluctuation determination means as a scene fluctuation history;
Total scene change determination means for determining whether or not the shooting scene has changed based on the scene change history;
Imaging device according to any one of claims 1 to 8 comprising a. A selection means for selecting whether to perform scene recognition of the shooting scene at the time of a scene change, or to be performed at predetermined intervals;
Cycle setting means for setting a predetermined cycle for performing the scene recognition, and
If it is selected by the selection means that scene recognition of the photographic scene is performed at predetermined intervals, the scene recognition means is replaced when the scene change determination means determines that the shooting scene has changed. the apparatus according to claim 1 for the scene recognition of the photographic scene based on acquired by the photographic information obtaining means every predetermined period set by the period setting means and the photographing information 9 . The imaging apparatus according to claim 10 , wherein the predetermined period set by the period setting unit is a preset period or a period that can be arbitrarily set by a user. Acquiring shooting information that is information of a shooting scene;
Storing reference information for discriminating changes in the shooting scene;
Determining whether or not the shooting scene has changed from the stored reference information and the acquired shooting information;
Recognizing the shooting scene based on the shooting information in response to determining that the shooting scene has changed; and
Storing new reference information based on shooting information corresponding to the recognition result of the recognized shooting scene as the reference information;
Performing at least one of display control, shooting control, signal processing control, and information recording control according to the recognition result of the recognized shooting scene,
The step of recognizing the shooting scene continues the scene recognition of the shooting scene when the recognized shooting scene is a specific scene, and recognizes the scene of the shooting scene when the recognized shooting scene is other than the specific scene. An imaging method including the step of not recognizing a scene until it is determined that the shooting scene has changed . Recognizing that the shooting scene has changed, and performing single scene recognition based on the acquired shooting information;
Storing the history of the single scene recognition result as a scene recognition history;
Storing, as the reference information, new reference information based on shooting information used at the time of obtaining the newest single scene recognition result among the single scene recognition results having the highest appearance frequency in the scene recognition history; ,
The imaging method according to claim 12 , comprising: The imaging method according to claim 13 , further comprising: performing scene recognition of the shooting scene based on the scene recognition history.

Images