JP6210699B2 - Imaging apparatus and control method thereof - Google Patents

Description

  The present invention relates to an imaging apparatus and a control method thereof that are suitable for supporting imaging technology education.

  When taking a picture, an image displayed in the viewfinder or on the rear liquid crystal is checked, and zoom, exposure, aperture, etc. are set, and shooting parameters are determined. Since the photo finish varies greatly depending on such shooting parameters, many users learn how to set shooting parameters.

  As a learning method to learn the general method of setting shooting parameters, you can read shooting parameters from the metadata of actual shot images, or obtain books on which these methods are written, and learn by yourself. Is common. There are also many users who attend a classroom (camera classroom) where a lecturer teaches photographing techniques.

  However, in such a learning method, only a general setting method for main subjects such as people, landscapes, and flowers can be known. At the time of actual photographing, the relationship between the main subject and the non-main subject, the background, and the like are different, so that a better parameter setting value varies depending on the relationship. That is, at the time of shooting, not only the main subject but also other factors affect the shooting parameters. For example, to prevent unwanted objects from entering the background, change the zoom to change the angle of view, change the aperture to adjust the blur of the background, or the status of minor subjects The exposure is determined in consideration of this.

  Therefore, in the process of determining parameters during shooting, it is useful to know what is in the finder and what shooting parameters are changed and how. In order to convey such a parameter determination method, there is a case where a lecturer actually explains a method for determining a parameter setting value while photographing in the above-described camera classroom or the like. Knowing the parameter changing process in this way is a learning with a wider application range than learning to learn a general set value.

  On the other hand, a technique for automatically discriminating what is important in a photographed image by a photographer is known as a prior art, and Patent Document 1 discloses a method for determining an important region for a photographed image. ing. According to Patent Document 1, “line-of-sight information” up to shooting, “shooting parameter setting information” such as a zoom setting value called context information, and “low-resolution image” used for display on the rear liquid crystal "Is acquired. Then, an important area in the captured image is determined from these three pieces of information.

Japanese Patent No. 4511821

  However, in the above-described conventional technology, the main subject of the captured image can be determined, but there is a problem in that it is not possible to obtain information on what to focus on when determining the imaging parameter and which imaging parameter has been changed.

  Therefore, an object of the present invention is to make it possible to easily tell a third party what has been noticed when a shooting parameter is changed.

In order to achieve the above object, an imaging apparatus according to an aspect of the present invention provides:
Obtaining means for obtaining an image based on an image signal from the image sensor;
Identifying means for identifying a position of interest in the image by detecting a user's action;
Detecting means for detecting a change in imaging parameters in the imaging apparatus;
When the change of the shooting parameter is detected by the detection unit , a data set in which the image acquired by the acquisition unit, the attention position specified by the specifying unit, and the shooting parameter are associated with each other, And holding means for holding a plurality of data sets at the time of detection of the change and before that.

  The present invention makes it possible to easily share information regarding the change of the shooting parameter and the area focused on at that time in the process of shooting, and to easily tell the third party what was focused on when changing the shooting parameter. Become.

The perspective view which shows the external appearance from the back of a digital camera. FIG. 2 is a vertical sectional view of the digital camera of FIG. 1. The figure which shows the general view from the front of a digital camera. The block diagram which shows the circuit structural example of a digital camera. The figure which shows a Bayer arrangement | sequence. The figure which shows the data structural example of the buffer for parameter change histories. The figure which shows a gaze detection apparatus. The flowchart which shows the preservation | save process of parameter change log | history. The flowchart which shows the output process of a change log | history. The figure which shows an example of the area | region division of an image. The figure which shows an example of the data set of imaging | photography parameter change log | history. The flowchart which shows the transmission process of a parameter change log | history. The flowchart which shows the provision process of an attention tag. The flowchart which shows the display process of a parameter change log | history. The figure which shows the example of a display of a parameter change log | history.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[First embodiment]
In FIG. 1, an eyepiece window 111 for finder observation, an AE (automatic exposure) lock button 112, an AF distance measuring point selection button 113, and a release button 114 for performing a shooting operation are provided on the upper part of the camera body 100. ing. Further, the camera body 100 is provided with an electronic dial 411, a shooting mode selection dial 117, and an external display 409. The electronic dial 411 is a multi-function signal input device that is used in combination with other operation buttons to input numerical values to the camera and to switch the shooting mode. The external display 409 is composed of a liquid crystal display device, and displays shooting conditions such as shutter speed, aperture, shooting mode, and other information.

  Also, on the back of the camera body 100, there are an LCD monitor 417 for displaying captured images and various setting screens, a monitor switch 121 for turning on / off the LCD monitor 417, a cross switch 116, and a menu button 124. Is provided.

  The cross placement switch 116 has four buttons arranged vertically and horizontally, and a SET button arranged in the center. The user instructs the camera to select and execute a menu item displayed on the LCD monitor 417. Used for.

  The menu button 124 is a button for displaying a menu screen for performing various camera settings on the LCD monitor 417. For example, when selecting and setting the shooting mode, after pressing the menu button 124, the user operates the up / down / left / right buttons of the cross switch 116 to select the desired mode, and the desired mode is selected. Setting is completed by pressing the SET button.

  Since the LCD monitor 417 of the present embodiment is a transmissive type, an image cannot be visually recognized only by driving the LCD monitor 417, and a backlight illumination device 416 is required on the back surface thereof as shown in FIG. As described above, the LCD monitor 417 and the backlight illumination device 416 constitute an image display device.

  As shown in FIG. 2, the photographing lens 200 of the imaging optical system can be attached to and detached from the camera body 100 via a lens mount 202. The taking lens 200 and the camera body 100 can communicate with each other via a contact point of the lens mount 202. In FIG. 2, 201 is a photographing optical axis, and 203 is a quick return mirror. The quick return mirror 203 is disposed in the photographing optical path, and a position for guiding the subject light from the photographing lens 200 to the finder optical system (referred to as a position shown in FIG. 2, an oblique position) and a position for retracting outside the photographing optical path (retraction position). Is called). In this embodiment, the quick return mirror 203 is a half mirror that guides subject light to the viewfinder optical system and forms an image on the imaging device 418. An image created by reducing an image formed on the imaging device can be displayed as a live view image, but in the present embodiment, this image is also used for recording as information when determining imaging parameters. Further, instead of the optical viewfinder, an electronic viewfinder using a small liquid crystal display may be adopted.

  In FIG. 2, the subject light guided from the quick return mirror 203 to the finder optical system is imaged on the focus plate 204. Reference numeral 205 denotes a condenser lens for improving the visibility of the finder, and 206 denotes a pentagonal roof prism, which guides the subject light that has passed through the focus plate 204 and the condenser lens 205 to an eyepiece lens 208 and a photometric sensor 207 for finder observation. A line-of-sight detection mechanism is located between the pentagonal roof prism 206 and the eyepiece 208 (details will be described later with reference to FIG. 6).

  Reference numerals 209 and 210 respectively denote a rear curtain and a front curtain that constitute a shutter, and an image sensor 431 that is a solid-state image sensor disposed rearward by opening the rear curtain 209 and the front curtain 210 is exposed for a necessary time. The image sensor 431 is held on the printed board 211. Behind this printed board 211, a display board 215, which is another printed board, is arranged. An LCD monitor 417 and a backlight illumination device 416 are disposed on the opposite surface of the display substrate 215. Reference numeral 419 denotes a recording device for recording image data, and 217 denotes a battery (portable power supply). These recording device 419 and battery 217 are detachable from the camera body.

  3 is a lens removal button for removing the photographing lens 200 from the camera body 100. Reference numeral 304 denotes a narrowing button, which narrows the lens aperture to the aperture value set at that time, and can confirm the depth of field on the LCD monitor 417 in FIG. At normal times when the narrowing button 304 is not pressed, an image in which the aperture is open is displayed on the LCD monitor 417.

  FIG. 4 is a block diagram illustrating a circuit configuration example of the camera body 100 and the photographing lens 200 according to the present embodiment. The photographing lens 200 and the camera body 100 can communicate with each other via a lens-side communication contact 425 and a camera-side communication contact 434. The operation switch 421 transmits signals of a large number of switches including an electronic dial provided in the camera to the lens CPU 426, and performs zooming, focusing and aperture value setting by manual operation, switching between auto focus and manual focus, and the like. The lens control circuit 422 performs communication with a lens group (not shown) in the taking lens 200, lens drive control during AF (autofocus), and aperture blade drive control. The lens CPU 426 controls the operation within the photographing lens 200.

  The subject light that has passed through the photographing optical system L composed of a lens group (not shown) and a diaphragm forms an image on the imaging surface (light receiving surface) of the imaging element 431. The imaging element 431 is configured by a photoelectric conversion element such as a CCD or a CMOS, and converts an optical image into an electrical signal by photoelectric conversion. In this embodiment, the image sensor 431 is a single-plate CCD, and the color filter array is a typical Bayer array (FIG. 5A). The image reduction circuit 432 generates a confirmation image for the rear liquid crystal (LCD monitor 417) from the result of developing the image signal obtained from the image sensor. The external storage device 433 is, for example, a hard disk drive or a semiconductor memory card that can be attached to and detached from the camera body 100.

  The release switch 435 is composed of a two-stage switch. The first-stage switch is turned on when the release button 114 (see FIG. 1) is half-pressed, and the digital camera is in a shooting preparation state. Further, when the release button 114 is fully pressed (fully pressed), the second switch of the release switch 435 is turned on, and exposure to the image sensor 431 is started. In the present embodiment, the period from the half-pressed state of the release button 114 to the fully-pressed state is defined as a shooting parameter adjustment period, and information on this period is analyzed and shared.

  Under the control of the camera CPU 436, the display unit 439 displays on the LCD monitor 417 a live view image in which the subject is displayed in real time, and a moving image or a still image captured using the image sensor 431. The setting switch 440 is operated to perform a shooting mode and various settings. The line-of-sight detection circuit 441 and the parameter change history buffer 438 store the imaging parameter, its change history, line-of-sight information, and the image obtained from the image sensor 431 during the imaging parameter adjustment period. The camera CPU 436 performs various controls such as drive control of the display unit 439 and setting switch 440, checking of remaining capacity in the power source 437, and sharing of power. In addition to those shown in FIG. 4, various components such as a distance measuring (AF) circuit, a photometric (AE) circuit, a backlight illumination, a dust position memory, and a strobe light emission dimming control circuit can be considered. Omitted for simplicity.

  FIG. 6 is a diagram illustrating a line-of-sight detection device. The light emitting diode 604 emits insensitive infrared rays to the photographer's eyeball 605. The dichroic mirror 603 is an optical member having a characteristic of transmitting visible light and reflecting infrared light, and is disposed in an optical path sandwiched between the pentagonal roof prism 206 and the eyepiece lens 208. When the photographer's eyeball 605 is irradiated by the light emitting diode 604, the reflected light from the eyeball is reflected by the dichroic mirror 603 and enters the light receiving lens 602. The light receiving lens 602 forms a cornea image of the eyeball on the image sensor 601. The sight line detection circuit 441 shown in FIG. 4 analyzes the cornea image of the photographer's eye detected by the image sensor 601, thereby detecting the position of the user's line of sight within the viewfinder.

  Next, a process for storing a parameter change history using line-of-sight detection information will be described. The operation until the camera CPU 436 detects the shooting parameter adjustment period and stores the parameter change history during that period will be described with reference to the flowchart of FIG. As described above, the shooting parameter adjustment period starts when the release button 114 is half-pressed and ends when the release button 114 is fully pressed. Then, the change of the shooting parameters during the shooting parameter adjustment period, the line-of-sight position in the finder, and the image formed on the image sensor 431 at that time are stored and analyzed.

  In step S701, the camera CPU 436 creates a file (parameter change history storage file) for storing the shooting parameter change history. FIG. 10 is a diagram illustrating a data configuration example of a file created by the processing described below. Here, the camera CPU 436 outputs the file identifier and basic data such as the image division size as the file header information 1001, and advances the processing to step S702 in a state where the data can be written. The image division size will be described later with reference to FIG.

  In step S702, the camera CPU 436 reduces the rear liquid crystal created from the imaging parameters, the line-of-sight position in the finder, and the image formed on the image sensor 431 when the release button 114 is half-pressed. Get an image. Then, the camera CPU 436 temporarily stores the acquired information in a parameter change history buffer 438 (see FIG. 5B, where “notable tag” is used in the second embodiment). In this embodiment, a data set in which an aperture value, an exposure setting value, a zoom position, and a shutter speed are associated as recording parameters is recorded. Also, as the line-of-sight position, only when the line-of-sight is located in the image in the finder, the coordinates when mapped to the reduced image are recorded with the upper left of the image as the origin. Therefore, when the line-of-sight position is moved outside the image due to the line-of-sight input of parameters, the line-of-sight position is not recorded. Judgment as to whether there is a line of sight in the image or where the parameter information on the outside is written is performed by a conventional technique such as a line-of-sight input of an imaging parameter or an AF function for the line-of-sight position, for example. It is what.

  In step S703, 1 is assigned to the usage counter (cnt) of the parameter change history buffer 438. Next, in step S704, the camera CPU 436 determines whether it is a data recording timing. The data recording timing has a predetermined time interval. For example, the data recording timing may be the same timing when the camera body 100 creates a reduced image for the rear liquid crystal for live view shooting, or may be a timing that is an integral multiple of that. In this embodiment, the reduced image for the rear liquid crystal is created 60 times per second, and the data recording timing is twice as long as that, that is, 30 times per second.

  If it is determined in step S704 that the data recording timing is reached, the process advances to step S705. Here, the camera CPU 436 stores the shooting parameters at that time, the line-of-sight detection position (line-of-sight position), and the reduced image in the cnt-th (buffer [cnt]) of the parameter change history buffer 438. In step S706, the camera CPU 436 adds 1 to the usage counter cnt of the parameter change history buffer 438. In step S707, the camera CPU 436 compares the shooting parameter stored in buffer [cnt-1] at the current timing with the shooting parameter stored in buffer [cnt-2] at the immediately preceding timing. If both values are the same, the process proceeds to step S709, and if they are different, the process proceeds to step S708.

  In step S708, the camera CPU 436 analyzes the change history, outputs the result to the file created in step S701, deletes data from buffer [0] to buffer [cnt-2], and is the latest data. Copy buffer [cnt-1] to buffer [0]. The output of the change history will be described in detail later with reference to FIG. In step S <b> 709, the camera CPU 436 checks whether there is still a space in the parameter change history buffer 438 prepared in advance. In this embodiment, it is assumed that a buffer capacity sufficient to store 150 sets of imaging parameters, line-of-sight positions, and reduced images is prepared. Therefore, if cnt is less than 150, it can be determined that there is still an empty area in the buffer, and if cnt is 150 or more, all the buffer capacity is used. If there is no free area in parameter change history buffer 438, the process proceeds to step S710, and if there is still free capacity, the process proceeds to step S711. If the shooting parameter is different from the previous data recording timing at the data recording timing, an empty area appears in the change history buffer in step S708. Therefore, when the process proceeds to step S710, the same shooting parameter (only the line-of-sight position is different) is stored in all the change history buffers.

  In step S710, the camera CPU 436 deletes the oldest data (data of buffer [0] in this embodiment) from the parameter change history buffer 438, and sets the buffer numbers for the remaining data one by one. Replace. Further, 1 is subtracted from the value of the counter cnt. That is, in this example, the value of cnt is 149. In step S711, it is detected whether or not the release button 114 has been fully pressed. If the release button 114 is still half-pressed, the camera CPU 436 determines that it is still within the shooting parameter adjustment period, and returns the process to step S704. On the other hand, if the release button 114 is fully pressed, the camera CPU 436 determines that the shooting parameter adjustment period has ended, and advances the process to step S712. In step S712, the file created in step S701 is closed, and this flow ends.

  Next, with reference to FIG. 8, the flow of writing the change history when the shooting parameter is changed will be described.

  In step S801, the camera CPU 436 writes the shooting parameters before and after the change as the shooting parameter 1002 and the shooting parameter 1003, respectively, in the file created in step S701. More specifically, since the same shooting parameters are used from buffer [0] to buffer [cnt-2], the oldest data in the parameter change history buffer 438 is stored in buffer [0]. The buffer [cnt-1] storing the newest data is written as the shooting parameters 1002 and 1003. Next, in step S802, the camera CPU 436 writes the number of reduced images to be written in the current file as a reduced image before and after the parameter change written in step S801. Specifically, since cnt images from buffer [0] to buffer [cnt-1] are written in the file, the value cnt is written as the number of images 1004.

  In step S803, the camera CPU 436 prepares an image counter I, and initializes it by substituting zero therein. In step S804, a line-of-sight concentration area number as a user's attention position is calculated from the line-of-sight position of buffer [I]. In the present embodiment, as data to be written in the file, as shown in FIG. 9, the image area is divided into 48 × 8 × 6, and area numbers are assigned in order of raster from the upper left. Then, the region number is calculated from the coordinates of the line-of-sight position stored in buffer [I]. For example, if the size of the reduced image is 640 × 480 pixels and the coordinates of the detected line-of-sight position are (520, 40), the line-of-sight concentration area number is calculated as 6.

  In step S805, the camera CPU 436 compresses the reduced image in buffer [I] with JPEG. In step S806, the camera CPU 436 outputs the line-of-sight concentration area number calculated in step S804 and the compressed data created in step S805 to a file. As a result, the line-of-sight concentration area number (AI) and the reduced image 1006 (PI) are written to the file. When the image counter I is 0, the line-of-sight concentration area number 1005 (A0) and the reduced image 1006 (P0) are written in the file.

  In step S807, the camera CPU 436 increments the image counter I. In step S808, the camera CPU 436 compares the image counter I with the number cnt of reduced images to be written to determine whether or not the writing associated with the current shooting parameter change is complete. If the image counter I is equal to the number cnt of reduced images, it is determined that writing has been completed, and the process advances to step S809. On the other hand, if the image counter I is not equal to the number cnt of reduced images, the process returns to step S804. In step S809, the camera CPU 436 copies the data of buffer [cnt-1] storing the newest data to buffer [0], and deletes the data from buffer [1] to buffer [cnt-1]. Then, this flow is finished. In step S809, the value of the counter cnt is reset to 1.

Through the processing as described above, a file as shown in FIG. 10 is generated. That is,
Shooting parameters before and after the change (shooting parameters 1002, 1003),
A combination of a reduced image and a line-of-sight concentration area number representing an area of interest in the change process (line-of-sight concentration area number 1005, reduced image 1006 to line-of-sight concentration area number 1007, and reduced image 1008)
Each time the parameter is changed, it is saved in a file as a data set of shooting parameter change history. Therefore, by providing this file to a third party, it is possible to easily disclose to the third party information about what parameters were noticed and which parameters were changed when determining the shooting parameters.

  In addition, since the reduced image saved as the shooting parameter change history data set is compressed and saved, the parameter change history saving file size can be kept small. In addition, by storing together the line-of-sight concentration area number and the reduced image at that time, the position, composition, and angle of view of the camera will change in the process until shooting, so that it will be included in the finally shot image. Even if there is no object, it is possible to know that the object has been noticed when determining the shooting parameters. This effect will be described in detail in the third embodiment.

[Second Embodiment]
In the second embodiment, the shooting parameter change history during the shooting parameter adjustment period is transmitted to an external device without being saved in a file. The configuration of the imaging apparatus according to the second embodiment is the same as that of the first embodiment. Hereinafter, the operation of the imaging apparatus according to the second embodiment will be described with reference to the flowchart of FIG. In FIG. 11, the same reference numerals as those in FIG. 7 are assigned to the same processing steps as those in FIG. In the second embodiment, as in the first embodiment, the imaging parameter change during the parameter adjustment period, the line-of-sight position in the finder, and the image formed on the image sensor 431 at that time are monitored. Then, the imaging parameter, reduced image, line-of-sight position, etc. are transmitted to an external device (digital camera, PC, tablet PC, etc.) having a display device registered in advance.

  In addition to the shooting parameters, reduced images, and line-of-sight positions saved in the first embodiment, the parameter change history buffer 438 of the second embodiment displays whether or not these data are data immediately before the shooting parameter change. An area for storing the attention tag shown is provided (see FIG. 5B). It is assumed that the line-of-sight concentration area number is stored in the target tag if the data is immediately before the imaging parameter change, and a negative value is stored if not.

  In step S1102, as in the first embodiment, the shooting parameters, reduced image, and line-of-sight position are stored in buffer [0], and further, minus 1 is entered in the attention tag and initialization is performed. Steps S703 and S704 perform the same operation as in the first embodiment. In step S1102, as in step S1101, the shooting parameters, the reduced image, and the line-of-sight position are stored in buffer [cnt], and the attention tag is initialized with minus one. Steps S706 and S707 operate in the same manner as in the first embodiment. If the shooting parameters of buffer [cnt-2] and buffer [cnt-1] are the same in step S707, the process proceeds to step S709, and the same processing as in the first embodiment is performed.

  On the other hand, if the shooting parameters are different in step S707, the process proceeds to step S1103. In step S1103, the camera CPU 436 assigns an attention tag to buffer [cnt-1], and proceeds to step S709. A method of assigning the attention tag will be described later with reference to the flowchart of FIG. In step S709, it is determined whether or not there is a space in the parameter change history buffer 438 as in the first embodiment. If there is a vacancy, the process proceeds to step S711.

  If there is no empty space in parameter change history buffer 438, the process proceeds to step S1104. In step S <b> 1104, the camera CPU 436 transmits the shooting parameter, the reduced image, and the value of the attention tag among the data of buffer [0] to the external device registered in advance. In step S1105, the camera CPU 436 copies the data in buffer [k + 1] (k = 0 to n−1) to buffer [k], decreases the number of buffer usage counters cnt by 1, and advances the process to step S711. In step S711, as in the first embodiment, the camera CPU 436 determines whether the release button 114 is fully pressed. If the fully depressed state of the release button 114 is not detected, the camera CPU 436 returns the process to step S704, and if detected, advances the process to step S1106. In step S1106, all data sets remaining in the buffer, that is, shooting parameters, reduced images, and attention tags are transmitted, and this flow ends.

  Next, the attention tag assignment processing in step S1103 will be described with reference to FIG. In FIG. 12, steps having the same operations as those in the process of FIG. 8 described in the first embodiment are assigned the same numbers as in FIG.

  In step S803, the camera CPU 436 assigns zero to the image counter I and initializes it. In step S <b> 1201, the camera CPU 436 determines whether the attention tag is assigned to the data set of buffer [I] in order to search for the first image to which the attention tag is not attached among the images in the parameter change history buffer 438. Judge whether. In the case of this embodiment, if the attention tag is minus 1, it can be determined that the attention tag has not been given yet, and in this case, the process proceeds to step S804. At this time, the image for which the attention tag is set is determined to be the attention area at the time of the previous shooting parameter change, and the process proceeds to step S1202. In step S1202, 1 is added to the image counter I.

  In step S804, the camera CPU 436 calculates a line-of-sight concentration area number as a user's attention position. The calculation process of the line-of-sight concentration area number is as described in the first embodiment. In step S1203, the camera CPU 436 substitutes the line-of-sight concentration area number calculated in step S804 for the target tag. Steps S807 and S808 are the same as in the first embodiment.

  In the case of the second embodiment, the external device registered in advance can share the process of changing the shooting parameter with the digital camera in almost real time. Therefore, the parameter change history storage file as shown in FIG. 10 can be held in the external device. In this embodiment, the image data (reduced image) to be transmitted is not compressed. However, the image data may be transmitted after being compressed by JPEG or the like. In addition, the information processing apparatus may hold all the data transmitted from the imaging apparatus in steps S1104 and S1106 in a file, or may hold data to which an attention tag is assigned in a file. If the data to which the attention tag is attached is held in the file, a file equivalent to the file (FIG. 10) described in the first embodiment is generated in the information processing apparatus.

[Third embodiment]
In the third embodiment, a method for displaying the file created in the first embodiment will be described with reference to the flowchart of FIG. Hereinafter, a case where the camera CPU 436 of the digital camera reads and displays the parameter change history storage file stored in the external storage device 433 will be described. As described in the second embodiment, it is obvious to those skilled in the art that the parameter change history storage file is stored in the external device, and the external device reads and displays the file.

  In step S1301, the camera CPU 436 acquires a parameter change history storage file in which the parameter change history is stored, and opens the file for reading. In step S <b> 1302, the camera CPU 436 reads the file header information 1001 and acquires the size of the region division of the image. In the case of this embodiment, it can be seen that the image is divided into squares of 80 pixels vertically and horizontally (since the size of the reduced image is 640 × 480 pixels and is divided into 8 × 6). In step S1303, the camera CPU 436 reads the shooting parameter 1002 as the shooting parameter Pbefore before the change. In step S1304, the camera CPU 436 reads out the shooting parameter 1003 as the changed shooting parameter Pafter.

  In step S1305, the camera CPU 436 compares Pbefore acquired in step S1303 with Pafter acquired in step S1304. Then, among the shooting parameters such as aperture value, exposure setting value, zoom position, and shutter speed recorded as shooting parameters, the changed shooting parameters (hereinafter referred to as change parameters) and their values are acquired. In the present embodiment, it is assumed that the zoom value has been changed from 50 mm to 70 mm. Here, by obtaining the difference d, the parameter for which d ≠ 0 is the change parameter, and the change parameter displayed in the display area 1402 of FIG. 14 described later is specified.

  In step S1306, the camera CPU 436 reads the number of images 1004 (N) recorded in association with the change parameter from the file. In step S1307, the camera CPU 436 initializes the image by assigning zero to the image counter h. In step S1308, the camera CPU 436 reads the h-th line-of-sight concentration area number (line-of-sight concentration area number 1005 when h = 0) and the reduced image (reduced image 1006 when h = 0). Then, the camera CPU 436 displays the line concentration area number and the reduced image together with the change parameter and the value acquired in step S1305.

  In step S1309, the camera CPU 436 increments the counter h by adding 1. In step S1310, the camera CPU 436 compares the counter h with the number N of images acquired in step S1306. If the counter h is the same as the number N of images, it is determined that the display of the image related to the current change parameter is completed, and the process proceeds to step S1311. On the other hand, if the counter h and the number N of images are different, it is determined that there is an image that has not been displayed yet, and the process returns to step S1308. In step S1311, the camera CPU 436 determines whether the processing has been completed up to the end of the file (the last change history data set). If the end of the file has not been reached yet, it is determined that another shooting parameter change history is stored, and the process returns to step S1303. If it is the end of the file, it is determined that all the parameter change histories have been displayed, and this flow ends.

  An example of the parameter change history displayed in the third embodiment is shown in FIG. FIG. 14A shows the state before the zoom is changed, FIG. 14C shows the state after the change of the zoom is confirmed, and FIG. 14B shows the progress of the process. . Reference numeral 1401 denotes a display area showing all the setting values of the shooting parameters, and reference numeral 1402 denotes a display area that displays the changed parameters among the shooting parameters. Reference numeral 1403 denotes a line-of-sight concentration region in the image. In this manner, the line-of-sight concentration area 1403, that is, the user's attention position is displayed in an identifiable manner in each displayed image, so that it is possible to immediately grasp which part of the image the user has been paying attention to when changing parameters. .

  FIG. 14 shows an example in which shooting parameters are changed in order to remove unnecessary objects from the shooting area while placing the main subject at the center. That is, if the main subject is brought to the center with a zoom of 50 mm, an unnecessary object is included in the area 1403. Therefore, the zoom position is changed to 70 mm, and the composition is determined such that the main subject is the center and unnecessary objects are not captured. As described above, in this embodiment, since the reduced image at that time is held together with the shooting parameters up to shooting, it is possible to know the object deviated from the shot image and the process of changing the shooting parameter for that purpose. Can do.

  In the case of a continuously changing parameter such as zoom, a plurality of data sets of a series of data from the imaging parameter 1002 to the reduced image 1008 as shown in FIG. Generated in the file. When the shooting parameters before and after the change are displayed in the display area 1402, if the changed shooting parameter 1003 is the same as the parameter before the change at the beginning of the next series of data, the change is taken into consideration. It is better to determine the value shown in the display area 1402 as a later parameter. For example, when there is a data set of zoom from 60 mm to 70 mm following a data set of zoom from 50 mm to 60 mm, considering the continuity of zoom change, as shown in the figure, before and after the change, such as 50 mm → 70 mm. It is preferable to display the parameter in the display area 1402.

[Other Embodiments]
In the first embodiment and the second embodiment, the line-of-sight position information in the finder is used for calculating the attention area, but the present invention is not limited to this. For example, when the imaging apparatus does not have a finder and the line-of-sight position information cannot be acquired, for example, an instruction with a finger may be used as the line-of-sight concentration area for an image displayed on the touch panel display. For example, a camera using a touch panel display as the LCD monitor 417 has a UI that designates the zoom center point with two fingers and specifies the zoom magnification by opening the finger as it is. In this case, for example, the center point designated with two fingers that is input to the touch panel display that is displaying an image during the above-described imaging parameter adjustment period can be used as the line-of-sight position information.

  In each of the above embodiments, the image is divided in advance and the attention area number is shared as the user's attention position, but the line-of-sight position coordinates may be shared as the attention position. In this case, the coordinate position may be indicated by a point as the attention position, or a circle may be drawn around the coordinates of the line-of-sight position, and the circle may be displayed as the attention position (line-of-sight concentration region). Alternatively, the image may be analyzed, an object including the coordinates of the line-of-sight position may be cut out, and the object may be presented.

  In each of the above embodiments, the method of JPEG compression of an image stored as a data set of shooting parameter change history has been described, but it goes without saying that another compression method such as JPEG2000 or PNG may be used. In the case of compressing with JPEG2000, the line-of-sight concentration area can also be indicated using a JPEG2000 ROI (region of interest). In that case, it is not necessary to dare to enter the line-of-sight concentration area number as a data set of the imaging parameter change history.

  Further, the image area to be presented as the line-of-sight concentration area may be stored with a low compression ratio, and the other areas may be stored with a high compression ratio. When JPEG compression is used, this can be easily realized by increasing the value of the Q factor for the image of the line-of-sight concentration region and decreasing the Q factor value for the other regions. Also in this case, it is not necessary to dare put the line-of-sight concentration area number in the imaging parameter change history data set.

  Alternatively, a series of images can be regarded as a moving image, and can be stored in a moving image compression method such as MPEG or H264. In this case, the line-of-sight concentration area number for each frame may be stored or transmitted together at the beginning of the moving image data.

  In the above embodiments, images to be stored / transmitted are images reduced for the rear liquid crystal. However, when the captured image size is small, an image having the same size as the captured image size is not intentionally reduced. May be used. In that case, the processing load on the camera body is reduced by the amount of reduction processing.

  In each of the above embodiments, the release button is used to detect the shooting parameter adjustment period, and the release button is in the half-pressed state to the fully-pressed state. However, a shooting parameter adjustment period may be detected by explicitly providing a new mode indicating shooting and switching to that mode.

  Further, in the first embodiment, in the output of the change history in step S708, the oldest one held in the parameter change history buffer 438 from the time when the change of the imaging parameter is detected is output to the file (FIG. 8) is not limited to this. For example, a predetermined number of past records may be output to a file at the time of detecting a change in shooting parameters.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

Claims (12)

An imaging device,
Obtaining means for obtaining an image based on an image signal from the image sensor;
Identifying means for identifying a position of interest in the image by detecting a user's action;
Detecting means for detecting a change in imaging parameters in the imaging apparatus;
When the change of the shooting parameter is detected by the detection unit , a data set in which the image acquired by the acquisition unit, the attention position specified by the specifying unit, and the shooting parameter are associated with each other, Holding means for holding a plurality of data sets at the time of detection of the change and before ,
An imaging apparatus comprising: The holding unit associates the image acquired by the acquiring unit, the attention position specified by the specifying unit, and the changed shooting parameter when the change of the shooting parameter is detected by the detecting unit. Hold
The imaging apparatus according to claim 1. It said retaining means, the imaging apparatus according to claim 1 or 2, characterized in that for holding the image and the target position to be associated with the imaging parameters of the changed. Said retaining means, before and after the shooting parameters changes resulting from the previous SL multiple datasets, in any one of claims 1 to 3, characterized in that storing a plurality of images and each of the target position as a file The imaging device described. Before SL imaging apparatus according to any one of claims 1 to 4, further comprising a transmitting means for transmitting the data set to the external device. The shooting parameters before and after the change are read out and displayed from the file stored by the holding unit, the image selected from the plurality of images is read out and displayed, and the attention position associated with the displayed image is displayed. The imaging apparatus according to claim 4 , further comprising display means for reading and displaying the image in an identifiable manner.   An imaging device,
  Obtaining means for obtaining an image based on an image signal from the image sensor;
  Identifying means for identifying a position of interest in the image by detecting a user's action;
  Detecting means for detecting a change in imaging parameters in the imaging apparatus;
  A holding unit that holds the image acquired by the acquiring unit and the attention position specified by the specifying unit in association with each other when a change in the shooting parameter is detected by the detecting unit;
  The specifying unit specifies the position of interest based on a detection position of a user's line of sight in the finder.
  An imaging apparatus characterized by that. The imaging apparatus according to any one of claims 1 to 7 , wherein the shooting parameter includes any one of zoom, exposure, aperture, and shutter speed. A touch panel display for displaying an image obtained from the image sensor;
The specifying means, the imaging apparatus according to any one of claims 1 to 8, characterized in that identifying said target position based on the position indicated by the touch panel display in the display of the image. A control method in an imaging apparatus,
An acquisition step of acquiring an image based on an image signal from the image sensor;
A specific step of identifying a position of interest in the image by detecting a user action;
A detection step of detecting a change in imaging parameters in the imaging device;
When a change in the shooting parameter is detected in the detection step, a data set in which the image acquired in the acquisition step, the attention position specified in the specifying step, and the shooting parameter are associated with each other, A control method for an imaging apparatus, comprising: a change detection value and a holding step for holding a plurality of data sets before the change detection value .   A control method in an imaging apparatus,
  An acquisition step of acquiring an image based on an image signal from the image sensor;
  A specific step of identifying a position of interest in the image by detecting a user action;
  A detection step of detecting a change in imaging parameters in the imaging device;
  A holding step of holding the image acquired in the acquisition step and the attention position specified in the specific step in association with each other when a change in the shooting parameter is detected in the detection step;
  In the specifying step, the attention position is specified based on a detection position of the user's line of sight in the finder.
  And a method of controlling the imaging apparatus. Program for causing a computer to function as each unit of the imaging apparatus according to any one of claims 1 to 9.

Images