JP6566695B2 - Display control apparatus and control method thereof - Google Patents

Description

  The present invention relates to a display control apparatus and a control method thereof, and more particularly to a display technique for information related to focus.

  Focus adjustment methods in the imaging apparatus include AF (autofocus) and MF (manual focus). In AF, a method of continuously performing AF based on information on a specific area on the imaging surface (continuous AF), a method of performing AF only when an AF operation instruction operation is performed, and detecting a face There are methods. In general, these functions are selectively used by selecting what type of AF to use in a menu or the like. In addition, in order to facilitate the focus adjustment in the MF, there is also known one that performs display for guiding the focus position.

  Japanese Patent Application Laid-Open No. H10-228688 proposes that face AF can be performed for distance measurement within the detected face range. Even in the AF mode, a dialog for displaying the status of the focus position adjustment (where the focus position has moved) is displayed by simply changing to the MF mode by a single operation of a predetermined operation member. It has been proposed that the focus position can be adjusted.

  Japanese Patent Application Laid-Open No. 2004-228620 proposes that markers that are offset according to the deviation of the focus position from the focus position when manually focusing are arranged and displayed in a rotationally symmetric positional relationship.

Japanese Patent Application Laid-Open No. 2011-039206 JP 2007-279334 A

  Even in the AF mode, depending on the operating state of the AF, it may be useful to display the degree of focus. However, Patent Documents 1 and 2 described above have been sufficiently studied. There wasn't. In other words, in Patent Documents 1 and 2 described above, it is impossible to perform guide display with a suitable degree of focus according to the AF operation state in the AF mode.

  In view of the above problems, the present invention provides a display control device, a control method for the display control device, a program, and a recording medium that can perform guide display of the degree of focus more appropriately according to the operating state of AF. Objective.

In view of the above problems, the display control device of the present invention is
Mode setting means for setting to a first AF mode for continuously performing autofocus (AF) operation;
When the first AF mode is set and continuous AF is performed, control is performed so that the first display item indicating the AF position, which is the position to be focused by AF, is displayed on the live view. Display control means;
The set to the first AF mode, when you have made continued AF, the continued AF stopped, accepting means for accepting a stop instruction you the AF lock state of fixing the focus position without AF When,
A second display item indicating the degree of focus at a position corresponding to the AF position, instead of the first display item, in response to accepting the stop instruction by the accepting means and entering the AF locked state. And control means for controlling to display.

  According to the present invention, it is possible to perform guide display of the degree of focus more suitably according to the operating state of AF.

Configuration block diagram of the digital camera 10 Explanatory drawing of the light-receiving surface of the image sensor 102 Flowchart of shooting mode processing Flowchart of screen type determination process Focus assist display process flowchart Flowchart of screen size setting switching process Enlargement process flowchart Example of focus assist display Screen display example during focus assist display Other display examples of focus assist Screen display example after determining the screen type Screen display example at maximum size and screen display example in crop mode Screen display example before and after enlargement processing according to the setting of the focus assist function Screen display example before and after enlargement processing according to the Disp level Screen display example 1 for each magnification Screen display example 2 for each magnification Screen display example 3 for each magnification

<Hardware configuration>
FIG. 1 shows an example of a hardware configuration of a digital camera 10 as an example of the display control apparatus of the present invention.

  The housing 100 is an exterior that contains many of the components of the digital camera 10. Various operation units, the display unit 107, and the external output unit 121 are exposed on the surface of the housing 100.

  The interchangeable lens 101 is a photographing lens composed of a plurality of lens groups, and includes a focus lens, a zoom lens, a shift lens, and an aperture.

  The imaging element 102 has a configuration in which a plurality of pixels each having a photoelectric conversion element are arranged two-dimensionally. The image sensor 102 photoelectrically converts the subject optical image formed by the interchangeable lens 101 at each pixel, and further performs analog / digital conversion by an A / D conversion circuit to output an image signal (RAW image data) in units of pixels. To do. Details of the image sensor 102 used in the present embodiment and the related distance measuring unit 108 will be described later with reference to FIG.

  The ND filter 103 is provided in the digital camera 10 to adjust the amount of incident light separately from the diaphragm provided in the lens.

  The image processing unit 118 corrects a level difference caused by the image sensor 102. For example, using the pixels in the OB area (optical black area), the level of the pixels in the effective area is corrected, and the defective pixels are corrected using the surrounding pixels. In addition, various processes such as correction for peripheral light loss, color correction, contour enhancement, noise removal, gamma correction, debayer, and compression are performed. When the above processing is performed on the RAW image data input from the image sensor 102, the image processing unit 118 outputs the corrected image data to other control units.

  The recording medium I / F unit 104 is an interface between the recording medium 105 and the digital camera 10, and controls recording of image data input from the image processing unit 118 and reading of recorded image data with respect to the recording medium 105. To do.

  The recording medium 105 is a recording medium composed of a semiconductor memory or the like for recording captured video or image data. Recording of the image data and recorded images are performed according to control by the recording medium I / F unit 104. Read data. The recording medium 105 is a removable memory card or the like. A built-in recording medium may be used.

  The GPU 115 is a rendering engine that draws various information displays and menu screens of the video camera in the VRAM. In addition to a character string and figure drawing function, an enlargement / reduction drawing function, a rotation drawing function, and a layer composition function are provided. The VRAM has an alpha channel representing transparency, and a display object drawn on the VRAM can be displayed on-screen on a captured image or a reproduced image by the display I / F unit 106.

  The display I / F unit 106 performs superposition synthesis and resizing processing on the video data (captured image, reproduced image) from the image processing unit 118 and the display object drawn on the VRAM by the GPU 115, and outputs the result to the display unit 107. Yes (display). When in the enlarged display mode, the display I / F unit 106 performs superposition synthesis and resizing processing on the partial area of the video data. As a result, in the enlarged display mode, an enlarged image is displayed on the display unit 107 as compared with the normal time, which makes it easier for the photographer to perform a focus adjustment operation with manual focus (hereinafter referred to as MF) more accurately.

  The display unit 107 is an external monitor that is visible from the side of the housing 100 that displays the image data output from the display I / F unit 106 for angle of view confirmation, or a display unit in the viewfinder. The display unit 107 can be configured by a liquid crystal display, an organic EL display (Organic Light-Emitting Diode Display), or the like.

  The main body microcomputer 119 is a control unit that controls the entire operation of the digital camera 10 and is configured by a microcomputer or the like. The main body microcomputer 119 includes a CPU 119a, a ROM 119b, and a RAM 119c. The CPU 119a executes operations of various flowcharts to be described later by expanding and executing the program stored in the ROM 119b in the RAM 119c.

  The gain control unit 109, the shutter control unit 110, the ND control unit 111, and the aperture control unit 112 described below are all blocks for exposure control. These are controlled by the main body microcomputer 119 based on the result of calculating the luminance level of the image data output from the image processing unit 118 by the main body microcomputer 119 or based on the operation parameters manually set by the photographer. The gain control unit 109 controls the gain of the image sensor 102.

  The shutter control unit 110 controls the shutter speed of the image sensor 102.

  The ND control unit 111 controls the amount of light incident on the image sensor 102 via the ND filter 103.

  A diaphragm control unit 112 controls the diaphragm of the interchangeable lens 101.

  The focus control unit 113 performs different operations depending on whether the focus drive state held by the main body microcomputer 119 is AF (autofocus) or MF (manual focus).

  At the time of AF, the main body microcomputer 119 calculates focus focus information with reference to the image data output from the image processing unit 118, and the focus control unit 113 determines the focus lens inside the interchangeable lens 101 based on the calculated focus focus information. Control. Alternatively, the focus control unit 113 controls the focus lens inside the interchangeable lens 101 based on the defocus amount output from the distance measuring unit 108 by detecting the imaging surface phase difference.

  It is also possible to set an AF frame in a partial area of the image data and calculate focus information based only on the subject in the AF frame. The AF further has two operation modes depending on the behavior of the main body microcomputer 119. One is a one-shot AF mode, in which AF control is performed only when the one-shot AF key 129 is pressed, and after focus success or focus failure is confirmed, control of the focus control unit 113 is stopped. . The other is a continuous AF mode (servo AF), in which AF control is always performed. However, even in the continuous AF mode, when the AF lock key 130 is pressed to enter the AF lock state, the control of the focus control unit 113 is stopped. Switching between the two modes is performed by changing the setting in the menu screen.

  In the case of MF, the focus control unit 113 stops AF control. In this case, an arbitrary focus adjustment can be performed by rotating the focus ring 134 incorporated in the interchangeable lens 101 by the photographer.

  The image stabilization control unit 114 refers to the image data output from the image processing unit 118, calculates the motion vector of the subject with the main body microcomputer 119, and the interchangeable lens so as to cancel out camera shake based on the calculated motion vector. An optical image stabilization process for controlling the shift lens 101 is performed. Alternatively, the image stabilization control unit 114 performs an electronic image stabilization process that cuts out an image at each frame of the moving image in a direction that cancels image blur due to camera shake.

  The memory I / F unit 116 writes RAW image data for all the pixels output from the image sensor 102 to the memory 117, reads out the RAW image data held in the memory 117, and outputs it to the image processing unit 118.

  The memory 117 is a volatile storage medium that stores RAW image data for all pixels of several frames.

  The image processing unit 118 performs image processing necessary for control on the RAW image data for all the pixels sent from the memory I / F unit 116.

  The external output I / F unit 120 performs resizing processing on the video data from the image processing unit 118. In addition, signal conversion and control signal application suitable for the standard of the external output unit 121 are performed, and output to the external output unit 121.

  The external output unit 121 is a terminal that outputs video data to the outside, and is, for example, an SDI (Serial Digital Interface) terminal or an HDMI (registered trademark) (High-Definition Multimedia Interface) terminal. A monitor display, which is an external device, or an external recording device can be connected.

  The external operation I / F unit 122 is an interface that receives a control instruction from the external operation unit 123 and notifies the main body microcomputer 119 of the control instruction. For example, an infrared remote control light receiving unit, a wireless LAN (Local Area Network) interface, or a LANC (Registered Trademark) (corresponding to a local application control bus system) is equivalent.

  The external operation unit 123 transmits a control instruction (control command) to the external operation I / F unit 122. In addition to transmitting instructions (commands) corresponding to the operations of the respective units of the operation units 124 to 135 incorporated in the housing 100 and the interchangeable lens 101, setting change information on the menu screen displayed on the display unit 107 is transmitted. Can do.

  The menu keys 124 to AF / MF switch 135 are operation units, and are composed of members such as keys (buttons), dials, tact switches, rings, and touch panels. Each of them takes a role of accepting a photographer's operation and notifying the main body microcomputer 119 of a control instruction. The menu keys 124 to START / STOP key 133 are operation units on the main body side assembled to the housing 100. The focus ring 134 and the AF / MF switch 135 are lens side operation units assembled to the interchangeable lens 101. Some of these operation units can exchange the role of keys or be assigned to another function according to the setting in the menu screen.

  The menu key 124 instructs the display unit 107 to display a menu screen or closes an already opened menu screen.

  Both the cross key 125 and the dial 126 give an instruction to move a cursor for selecting an item in the menu screen or to move a frame display relating to the focus in a direction desired by the photographer. The cross key 125 is a direction key composed of an up key, a down key, a left key, and a right key, and each may be a separate operation member, or may be configured as the same operation member according to the position to be pressed. You may comprise so that instruction | indication of either up and down, right and left can be performed. The dial 126 is a rotation operation member that can perform a clockwise operation and a counterclockwise operation.

  The SET key 127 gives an instruction to select the item on which the cursor is placed on the menu screen or to confirm various setting operations.

  A cancel key 128 gives an instruction to return to the previous layer or to discard various setting operations when a deep layer is selected on the menu screen.

  The one-shot AF key 129 instructs the focus control unit 113 to drive AF when the AF mode is one-shot AF.

  The AF lock key 130 issues a stop instruction for stopping control by the focus control unit 113 and a release instruction for releasing the control stop state when the AF mode is continuous AF.

  The enlargement key 131 gives an instruction to enlarge or restore the image displayed on the display unit 107.

  The DISPLAY key 132 gives an instruction to change the Disp level held by the main body microcomputer 119. Based on the selected Disp level, the display of various information displayed on the display unit 107 is limited, so that more detailed information can be displayed and the video can be displayed more clearly.

  A START / STOP key 133 instructs the recording medium I / F unit 104 to start and stop recording.

  The focus ring 134 can move the focus lens in the interchangeable lens 101 and perform focus adjustment when the focus drive state is MF.

  The AF / MF switch 135 gives an instruction to switch the focus driving state, that is, AF and MF to each other.

<Imaging surface phase difference detection>
FIG. 2 shows a part of the light receiving surface of the image sensor 102 as an image sensor.

  In order to enable imaging surface phase difference AF, the image sensor 102 arranges pixel portions holding two photodiodes as light receiving portions as photoelectric conversion means for one microlens in an array. Thereby, each pixel unit can receive a light beam obtained by dividing the exit pupil of the interchangeable lens 101.

  FIG. 2A is a schematic diagram of a part of the image sensor surface of an example of Bayer arrangement of red (R), blue (B), and green (Gb, Gr) for reference. FIG. 2B shows an example of a pixel portion in which two photodiodes as photoelectric conversion means are held for one microlens corresponding to the arrangement of the color filters in FIG.

  The image sensor having such a configuration can output two signals (hereinafter also referred to as an A image signal and a B image signal) for detecting a phase difference from each pixel unit. Further, an image recording signal (A image signal + B image signal) obtained by adding the signals of the two photodiodes can be output. In the case of this added signal, a signal equivalent to the output of the image sensor of the Bayer array example schematically described in FIG.

  Using the output signal from the image sensor 102 as such an image sensor, the distance measuring unit 108 performs correlation calculation between the two image signals, and calculates information such as the defocus amount and various reliability. The defocus amount is calculated based on the deviation between the A image signal and the B image signal. The defocus amount has a positive or negative value, and it can be determined whether the defocus amount is a positive value or a negative value depending on whether the defocus amount is a positive value or a negative value. In addition, the absolute value of the defocus amount indicates the degree of focusing, and if the defocus amount is 0, the focus is achieved. That is, the distance measuring unit 108 outputs information on whether the front pin or the rear pin is based on the sign of the defocus amount calculated for the distance measurement position (range measurement area, focus detection position, focus detection area) to the CPU 119a and the like. Further, based on the absolute value of the defocus amount, focus degree information that is the degree of focus (degree of focus shift) is output to the CPU 119a and the like. Information about whether the front pin or the rear pin is present is output when the defocus amount exceeds a predetermined value, and when the absolute value of the defocus amount is within the predetermined value, information indicating that the focus is achieved is output. The in-focus degree information is output as a value obtained by converting the defocus amount into an operation amount for rotating the focus ring 134 before focusing.

  In this embodiment, a total of three signals, that is, two signals for imaging and two signals for phase difference detection are output from the imaging element 102. This point is not limited to such a method. For example, a total of two signals out of two signals of an imaging signal and an image signal for phase difference AF may be output. In this case, after output, the other one of the two signals of the image signal for phase difference detection is calculated using the two output signals from the image sensor 102.

  FIG. 2 shows an example in which pixel portions holding two photodiodes as photoelectric conversion means are arranged in an array for one microlens. In this regard, pixel portions holding three or more photodiodes as photoelectric conversion means may be arranged in an array for one microlens. Moreover, you may make it have multiple pixel parts from which the opening position of a light-receiving part differs with respect to a micro lens. That is, it is only necessary to obtain two phase difference detection signals capable of detecting a phase difference, such as an A image signal and a B image signal.

  3 to 6 are flowcharts showing the control performed by the digital camera 10. The operations of these flowcharts are realized by the main body microcomputer 119 (more specifically, the CPU 119a) controlling each part of the digital camera 10 based on a program stored in the ROM 119b.

<Shooting mode processing>
FIGS. 3A and 3B are flowcharts showing the overall operation when the digital camera 10 is in the shooting mode. When the digital camera 10 is activated and set to the photographing mode, the processing of FIG.

  In S301, the CPU 119a determines a screen type to be displayed on the display unit 107. In this process, based on information such as ON / OFF of the face detection function, whether the focus setting is AF or MF, whether the AF is in focus, ON / OFF of the focus assist setting, etc. The necessity of display and the display form of the AF frame, the face frame, and the focus assist frame are determined. Details of this processing will be described later with reference to FIG.

  In S302, the CPU 119a determines whether or not the screen type determined in S301 is a screen in a state where focus assist display is possible. More specifically, it is determined whether or not the focus assist display is present by the processing of FIG. 4 described later. If the focus assist display is possible, the process proceeds to S303, and if not, the process proceeds to S305.

  In S303, the CPU 119a determines whether or not the Disp level is an information non-display state. The Disp level is a multiple-level information display level in which various information displays to be displayed superimposed on a captured image are displayed in detail, and which type of information is displayed. When the Disp level is set to the information non-display state, no information is displayed on the captured image. The setting of the Disp level will be described later in S336. If the Disp level is in the information non-display state, the process proceeds to S305, and if other Disp level, the process proceeds to S304.

  In S304, the CPU 119a performs a focus assist display process. This process indicates the degree of focusing and the operation direction until focusing is performed on the subject at a specific location (ranging position, focus detection position) in the captured image based on information acquired from the ranging section 108. This is processing for displaying focus assist, which is a display item. Details of this processing will be described later with reference to FIG.

  In S305, the CPU 119a displays the live view image on the display unit 107 without performing the focus assist display. The live view image is a captured image captured by the image sensor 102 and subjected to image processing for live view by the image processing unit 118, and is an image that is sequentially updated at a predetermined frame rate.

  In S306, the CPU 119a determines whether or not the dial 126 has been operated (movement instruction reception). If the dial 126 is operated, the process proceeds to S307, and if not, the process proceeds to S308.

  In step S307, based on the operation of the dial 126, the distance measurement position (range measurement area, focus detection position, focus detection area) is jumped (moved to any one of a plurality of specific locations). For example, among the four intersections obtained by dividing the image vertically and horizontally into a golden ratio (approximately 5: 8), jump from the intersection closest to the previous distance measurement position to the position of the next intersection according to the rotation direction of the dial 126 (measurement). Change the distance position). The distance measurement position held in the RAM 119c is updated with the moved distance measurement position. When the distance measurement position moves, the focus assist display position also moves in conjunction with the distance measurement position. In general, it is considered that the composition is stable when the main subject is arranged at the intersection of the golden ratio in the video. For this reason, when photographing taking account of the golden ratio, there is a high possibility that a subject to be subjected to focus adjustment is placed at any of the four intersections described above. In this way, if the distance measuring position is sequentially jumped to the intersection of the golden ratio according to the operation of the dial 126, the distance measuring position is quickly changed to the position of the subject to be focused at the intersection of the golden ratio. can do. Note that the processing of S306 and S307 is performed only in the operation mode in which the golden ratio auxiliary line (grid line) is displayed. Otherwise, the photographing is not necessarily conscious of the golden ratio. A configuration may be adopted in which the distance measurement position is not jumped even when operated. Further, the jump is not limited to the intersection of the golden ratios, but may be made to jump to the intersection of three dividing lines or the center of the screen. Furthermore, you may make it jump to a different position according to the kind of displayed grid line. For example, when the golden ratio grid line is displayed, the distance measurement position is sequentially moved to the intersection of the golden ratio as described above according to the operation of the dial 126. On the other hand, when a three-divided grid line is displayed, the distance measurement position is sequentially moved to the intersection of the three-divided lines according to the operation of the dial 126.

  In S308, the CPU 119a determines whether or not the cross key 125 has been operated (movement instruction reception). If the cross key 125 is operated, the process proceeds to S309, and if not, the process proceeds to S310.

  In step S309, the CPU 119a moves the distance measurement position by a certain amount in a direction corresponding to the operated key of the cross key 125 (any one of up, down, left, and right directions). The distance measurement position held in the RAM 119c is updated with the moved distance measurement position. When the distance measurement position is moved, the position of the focus assist display is also moved in conjunction with it. When the cross key 125 is continuously operated (when the cross key 125 is continuously pressed for a predetermined time or more), the moving speed of the distance measurement position may be accelerated according to the length. In this way, the distance measurement position can be quickly moved even with respect to the subject at a position away from the distance measurement position before the movement. While the movement of the distance measurement position according to the operation of the dial 126 is a movement for jumping the distance measurement position to any of a plurality of predetermined positions, the movement of the distance measurement position according to the operation of the cross key 125 is performed. Is an operation of moving the ranging position to an arbitrary position on the user screen. If the image processing unit 118 performs face detection control, the distance measurement position may be moved to the detected face position that exists in the direction of operation of the cross key 125. In this way, the distance measuring position can be immediately applied to a distant face.

  Note that, as described in S306 to S309, the distance measurement position can be moved according to the user's operation only when the face detection function described later in S314 is OFF. When the face detection function is ON, the distance measurement position is linked to the position of the face determined as the main face among the detected faces. Therefore, when the face detection function is ON, the distance measurement position is not moved even if the user operates the dial 126 or the cross key 125.

  In S310, the CPU 119a determines whether the menu key 124 has been pressed. If the menu key 124 is pressed, the process proceeds to S311. Otherwise, the process proceeds to S324 in FIG.

  In S <b> 311, the CPU 119 a displays a menu screen that lists setting items (menu items) related to the digital camera 10 on the display unit 107. In the menu screen, setting of various functions of the digital camera 10 can be changed by selecting any of the menu items with the cross key 125 or the dial 126 and performing a selection or confirmation operation with the SET key 127.

  In step S312, the CPU 119a determines whether a menu item for switching ON / OFF of the focus assist function is selected, and whether or not the focus assist function ON / OFF switching operation is performed from that item. If the focus assist function ON / OFF switching operation has been performed, the process proceeds to S313, and if not, the process proceeds to S314.

  In S313, the CPU 119a changes ON / OFF setting (assist display display setting) of the focus assist function. When the focus assist function is set to ON, information indicating that the focus assist function is set to ON is recorded in the ROM 119b. When the focus assist function is set to OFF, information indicating that the focus assist function is set to OFF is recorded in the ROM 119b. As described above, when the focus assist function is turned off from the setting item of the menu, the focus assist display is not performed in any case. On the other hand, when the focus assist function is turned on from the menu setting item, the focus assist is not always displayed, and depending on the situation based on conditions such as AF setting or MF setting and various conditions such as the Disp level. Perform focus assist display.

  In S <b> 314, the CPU 119 a determines whether a menu item for switching ON / OFF of the face detection function is selected, and whether the operation for switching ON / OFF of the face detection function has been performed from that item. If the switching operation has been performed, the process proceeds to S315, and if not, the process proceeds to S316.

  In S315, the CPU 119a sets the face detection function to ON or OFF based on the face detection function ON / OFF setting switching operation, and records information indicating the set state in the ROM 119b. When the face detection function is turned on, the area of the person's face (specific subject) is detected from the captured live view image (captured image). The detected face area is displayed with a face frame. In addition, when the AF is set, the size of the detected faces is large, close to the center of the screen, or personally recognized as a registered specific individual. AF (face AF) is performed on the face (main face) determined to be the main face. When the face detection function is set to ON and a face can be detected, the distance measurement position is overwritten with the position of the main face. That is, a position for performing focus assist described later is linked to the detected position of the main face.

  In step S316, it is determined whether a menu item for changing the AF mode setting has been selected and an AF mode changing operation has been performed. In the present embodiment, it is assumed that there are two AF modes, one-shot AF and continuous AF. One-shot AF is an operation mode in which one AF is performed in response to the user pressing the one-shot AF key 129 once, and the focus position is not moved in other cases. AF is performed each time the one-shot AF key 129 is pressed. On the other hand, continuous AF is an operation mode in which AF is continuously performed so that a predetermined subject is focused. When the subject to be focused moves without a user operation, a digital camera When 10 moves, the focus position is adjusted at any time. In the present embodiment, these two types are exemplified as AF modes. However, the present invention is not limited to this, and other AF modes may be selectable. If an AF mode change operation has been performed, the process proceeds to S317, and if not, the process proceeds to S320.

  In S317, the CPU 119a sets the AF mode selected by the user (in this embodiment, one-shot AF or continuous AF) according to the AF mode changing operation. Then, information indicating the set AF mode is recorded in the ROM 119b.

  In step S318, the CPU 119a determines whether an image size setting menu item has been selected and an image size setting change operation has been performed. If the image size setting has been changed, the process proceeds to S319, and if not, the process proceeds to S320.

  In S319, the CPU 119a changes the image size setting according to the user's operation. Information indicating the set value of the changed image size setting is recorded in the ROM 119b. When shooting / recording is performed, the image is recorded with the image size set here. Details of this processing will be described later with reference to FIG.

  In S320, the CPU 119a determines whether or not a setting change operation has been performed on setting items other than the setting items described in S312 to S319 described above on the menu screen. If there is a setting change operation, the process proceeds to S321, and if not, the process proceeds to S322. In S321, the CPU 119a changes the setting according to the operation performed in S320.

  In S322, the CPU 119a determines whether or not an operation for closing the menu screen has been performed. The operation of closing the menu screen is either pressing the menu key 124, pressing the cancel key 128 on the initial menu screen, or pressing the SET key 127 with the menu end item selected. Operation. If an operation to close the menu screen is performed, the process proceeds to S323, and if not, the process returns to S312 and the process is repeated.

  In S323, the CPU 119a ends the menu screen display, redisplays the live view screen, and proceeds to S324 in FIG.

  In S324 of FIG. 3B, the CPU 119a determines whether or not the AF / MF switch 135 has performed switching operation between AF and MF. If switching between AF and MF is performed, the process proceeds to S325, and if not, the process proceeds to S326.

  In S325, the CPU 119a switches between AF and MF in accordance with the operation of the AF / MF switch 135. When switched to AF, information indicating that the mode has been switched to AF is recorded in the ROM 119b, and the operation with AF setting is started. When the AF setting is switched, the operation of the mode indicated by the current AF mode is performed among the one-shot AF mode and the continuous AF mode described above.

  In S326, the CPU 119a determines whether or not the AF / MF switch 135 is set to AF and the AF mode is the one-shot AF mode. If true, the process proceeds to S327, and if not, the process proceeds to S329.

  In S327, the CPU 119a determines whether or not the one-shot AF key 129 has been pressed (accepting an AF execution instruction). If the one-shot AF key 129 is pressed, the process proceeds to S328, and if not, the process proceeds to S329.

  In S328, the CPU 119a performs AF by controlling the focus control unit 113 so that the subject at the distance measurement position corresponding to the AF frame is in focus.

  In S329, the CPU 119a determines whether or not the AF / MF switch 135 is set to AF and the AF mode is the continuous AF mode. If true, the process proceeds to S330, and if not, the process proceeds to S335.

  In S330, the CPU 119a determines whether or not the AF lock state is established by pressing the AF lock key 130. If it is in the AF lock state, the process proceeds to S331, and if not, the process proceeds to S332. The AF lock state is a state in which the focus position is fixed without performing AF temporarily during the operation mode in which continuous AF is performed.

  In S331, the CPU 119a determines whether or not the AF lock key 130 is pressed (accepts a stop instruction or a release instruction). If the AF lock key 130 is pressed, the process proceeds to S332, and if not, the process proceeds to S335.

  In S332, the CPU 119a releases the AF lock state, performs continuous AF, and continuously controls the focus control unit 113 so that the subject corresponding to the AF frame is in focus.

  In S333, the CPU 119a determines whether or not the AF lock key 130 has been pressed. If the AF lock key 130 is pressed, the process proceeds to S334, and if not, the process proceeds to S335.

  In S334, the CPU 119a stops the continuous AF and locks the AF (sets the AF lock state). That is, the AF control by the focus control unit 113 is stopped. As a result, the change of the focus position by AF is stopped, but manual focus by operating the focus ring 134 is possible.

  In S335, the CPU 119a determines whether or not the DISPLAY key 132 has been pressed. If the DISPLAY key 132 is pressed, the process proceeds to S336, and if not, the process proceeds to S337.

  In S336, the CPU 119a switches the Disp level in response to pressing of the DISPLAY key 132. The changed Disp level is recorded in the ROM 119b, and information display according to the changed Disp level is performed.

  In S337, the CPU 119a determines whether or not the enlargement key 131 has been pressed. If the enlargement key 131 is pressed, the process proceeds to S338, and if not, the process proceeds to S339.

  In S338, the CPU 119a performs enlargement processing. Details of this processing will be described later with reference to FIG.

  In S339, the CPU 119a determines whether or not the START / STOP key 133 has been pressed. If the START / STOP key 133 is pressed, the process proceeds to S340; otherwise, the process proceeds to S343.

  In S340, the CPU 119a determines whether or not the moving image recording operation is being performed (during shooting recording). If the recording operation is in progress, the process proceeds to S342, and if not (when shooting is in standby), the process proceeds to S341.

  In S341, the CPU 119a starts moving image recording. That is, a moving image captured by the image sensor 102 and processed for recording by the image processing unit 118 is recorded as a moving image file on the recording medium 105 in accordance with a predetermined file format.

  In S342, the CPU 119a stops moving image recording. When the moving image recording is stopped, the moving image ending process such as adding an attribute to the recorded moving image file or closing the file is performed.

  In S343, the CPU 119a determines whether an event other than the events listed in the above steps has occurred. If there is another event, the process proceeds to S344, and if not, the process proceeds to S345. In S344, the CPU 119a performs processing corresponding to the event that occurred in S343.

  In S345, the CPU 119a determines whether or not there is an event for ending the shooting mode process. If there is an end event, the shooting mode is ended. If not, the process returns to S301 to repeat the process. The end event includes, for example, an operation for turning off the power of the digital camera 10, a power off due to a power supply voltage drop, an auto power off in response to no operation for a predetermined time in a shooting standby state, a shooting mode such as a playback mode and a communication mode. There is an operation to shift to an operation mode other than the mode.

  Note that the distance measurement position can be moved according to the user's operation only when the face detection function set in S314 is OFF, but when the face detection function is ON. Alternatively, the distance measurement position may be moved according to the user's operation. In this case, before the user operation for moving the distance measurement position as described in S306 to S309 is performed, the distance measurement position is linked to the detected position of the main face. When a user operation for moving the distance measurement position is performed, the distance measurement position is moved according to the user operation without being linked to the position of the main face. After being moved according to the user operation, the distance measuring position is not linked with the position of the main face. After that, when a return operation (reset operation) is performed to return the distance measurement position to the main face position, the distance measurement position becomes the main face position again. After that, the distance measurement position becomes the main face position. Interlock. As the reset operation, for example, pressing the cancel key 128 can be considered. In this case, when the focus assist function is turned on in S312 described later and focus assist is displayed, the face frame indicating the main face is displayed when the distance measurement position and the main face position are linked. Do not show. When a user operation for moving the distance measurement position is performed, the distance measurement position is moved in accordance with the user operation without being linked with the position of the main face, and the focus assist position is also moved. At the same time, a face frame indicating the main face is newly displayed at the position of the main face. Thereafter, when the distance measurement position is linked again to the position of the main face by the return operation, the face frame indicating the main face is not displayed.

<Image type determination process>
Details of the screen type determination process described in S301 of FIG. First, various screen types will be described. FIGS. 11A to 11G show display examples on the display unit 107 of various display states (various screen types). Although not shown in FIGS. 11A to 11G, when the Disp level is other than information non-display, it corresponds to the Disp level other than the focus assist, the AF frame (AF area), and the face frame. Information is displayed superimposed on the live view. The information according to the Disp level other than the face frame includes a grid line, a remaining battery level, a remaining shooting time, and the like. Hereinafter, the case where the face detection function described in S314 and S315 is set to ON is simply referred to as face detection ON, and the case where the face detection function is set to OFF is simply referred to as face detection OFF.

  FIG. 11A is a display example when face detection is OFF, MF setting, and focus assist function setting are OFF, and when face detection is OFF, AF setting, one-shot AF mode, and focus assist function setting is OFF. . At this time, the live view is displayed on the display unit 107, and the focus assist, the AF frame, and the face frame are not displayed.

  FIG. 11B shows a case where the face detection is OFF and the focus assist function is set to ON, in addition to the MF setting, before the AF operation in the one-shot AF mode, or in the AF lock state in the continuous AF mode. Is a display example. The display unit 107 displays a focus assist 1101 superimposed on the live view image. The focus assist 1101 determines whether the subject at the position (ranging position, focus detection position) where the focus assist 1101 is displayed is in focus, whether it is the front pin or the rear pin, and the degree of focus (degree of focus deviation). ) Is a display item. The user can perform an adjustment operation with reference to the focus assist 1101 when operating the MF. Details of the focus assist 1101 will be described later with reference to FIG.

  FIG. 11C shows the display unit during face detection OFF and AF operation in one-shot AF mode or continuous AF mode, or after AF operation in face detection OFF and one-shot AF mode. FIG. A subject area (ranging position, AF position, focus detection position) to be subjected to AF control (AF operation) and an AF control state are indicated by displaying an AF frame 1102. The position of the AF frame 1102 indicates the subject area (ranging position, AF position) that is the target of the AF operation. The color of the AF frame 1102 indicates the AF operation state. During continuous AF (continuous AF operation) and from the start of execution of one-shot AF to focusing. It is displayed in white, and is displayed in green when in-focus by executing one-shot AF.

  FIG. 11D shows a display example when the AF / MF setting is set to AF and the setting of the focus assist function is OFF when the AF lock state is set in the continuous AF mode. The AF frame 1103 is displayed in gray superimposed on the live view image, indicating that the AF operation is not performed.

  FIG. 11E shows a display example during the AF operation in the face detection ON and AF operation in the one-shot AF mode or continuous AF mode. Face frames 1104, 1105, and 1106 are displayed superimposed on the live view. Face frames 1104 to 1106 are displayed at the positions of the faces detected from the captured image. The face frame 1106 is a frame indicating a face (primary face) to be subjected to face AF among the detected faces, and the face frames 1104 and 1105 are frames indicating faces (sub-faces) other than the main face. The main face face frame 1106 and the sub-face face frames 1104 and 1105 are displayed in different forms so that the face frame 1106 can be identified as a face frame indicating the main face. For example, the display form is different depending on color, single line or double line, and in the illustrated example, the right and left triangles of the frame indicate the main face frame. The left and right triangles of the frame indicate that the main face can be changed to another face by pressing the left and right keys (that is, according to the user's operation). That is, in the present embodiment, the user can also specify the main face that is the target of the face AF among the plurality of detected faces (of the plurality of detected specific subject areas, which are AF targets). Area can be selected). In order to represent the AF operation status, the face frames 1104 and 1105 of the sub-faces not targeted for AF are displayed in gray. A face frame 1106 indicating the main face is displayed in white during AF execution in one-shot AF or continuous AF. When in-focus with face AF by one-shot AF, it is displayed in green.

  In FIG. 11F, in addition to the condition that face detection is ON and the setting of the focus assist function is OFF, the MF is set, before AF is executed in the one-shot AF mode, or in the AF lock state in the continuous AF mode. It is a display example in the case of. Face frames 1104 and 1105 are face frames indicating sub-faces, and face frame 1107 is a face frame indicating the main face. However, in this case, the AF operation is not performed on the face frame 1107. In this case, both the face frame 1107 indicating the main face and the face frames 1104 and 1105 indicating the sub-face are displayed in gray to indicate that the AF operation is not performed. However, the face frame 1107 has a display form that indicates that it is the main face (the left and right triangles of the face frame 1107 indicate that it is the main face face frame).

  In FIG. 11G, in addition to the condition that the face detection is ON and the setting of the focus assist function is ON, it is MF setting, before AF is executed in the one-shot AF mode, or AF in the continuous AF mode. It is an example of a display in a locked state. In this case, the focus assist 1101 is displayed at the position of the main face instead of the face frame as shown in FIGS. The sub-face 1104 is displayed in gray and the focus assist 1101 is displayed in white to indicate the AF operation status. That is, the distance measuring position that is the position of the focus assist 1101 is linked to the position of the detected main face. The display position of the focus assist 1101 is also linked to the position of the main face on the live view.

  Next, a detailed flow of the screen type determination process described in S301 of FIG. 3 will be described. FIG. 4 shows a flowchart of the screen type determination process described in S301 of FIG.

  In S401, the CPU 119a refers to the setting information stored in the ROM 119b and determines whether or not the face detection function is set to ON. If the face detection function is set to ON in S315 described above, it is determined that the function is ON here. If it is set to ON, the process proceeds to S413, and if not, the process proceeds to S402.

  In S402, the CPU 119a determines whether AF is set by the AF / MF switch 135 or not. If it is set to AF, the process proceeds to S406; otherwise (ie, if it is set to MF), the process proceeds to S403.

  In S403, the CPU 119a refers to the setting information stored in the ROM 119b and determines whether or not the setting of the focus assist function is ON. If the setting of the focus assist function is set to ON in S313 described above, it is determined here to be ON. If the focus assist function setting is set to ON, the process proceeds to S404; otherwise, the process proceeds to S405.

  In S404, the CPU 119a determines the display type when face detection is OFF, MF setting, and focus assist is ON. Then, AF frame display: none, face frame display: none, and focus assist display: yes are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11B is displayed on the display unit 107.

  In S405, the CPU 119a determines the display type when face detection is OFF, MF setting, and focus assist is OFF. Then, AF frame display: None, Face frame display: None, Focus assist display: None are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11A is displayed on the display unit 107.

  In S406, the CPU 119a refers to the setting information stored in the ROM 119b, and determines whether or not the AF mode is set to the one-shot AF mode. If the one-shot AF mode is set in S317, it is determined that the one-shot AF mode is set. If the one-shot AF is set, the process proceeds to S407; otherwise (that is, if the AF mode is set to continuous AF), the process proceeds to S415.

  In S407, the CPU 119a determines whether or not the AF operation by the one-shot AF has been executed. That is, it is a determination as to whether or not the one-shot AF key 129 has been pressed in the one-shot AF mode. If it is determined that the one-shot AF has been executed, the process proceeds to S408. If not (before the one-shot AF key 129 is pressed), the process proceeds to S411.

  In S408, the CPU 119a determines whether or not the AF target is focused by the one-shot AF (whether or not the focusing is successful). If it is in focus, the process proceeds to S409. If not (the one-shot AF operation is started but not yet focused), the process proceeds to S410.

  In step S409, the CPU 119a determines the display type in the state where the face detection is OFF and the one-shot AF mode is in focus. Then, AF frame display: green (indicating focus), face frame display: none, and focus assist display: none are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11C is displayed on the display unit 107. Note that the AF frame is displayed in green.

  In S410, the CPU 119a determines the display type when face detection is OFF, the one-shot AF mode, and the out-of-focus state (while the AF operation is in progress). Then, AF frame display: white (indicating that AF operation is in progress), face frame display: none, and focus assist display: none are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11C is displayed on the display unit 107. However, the AF frame is displayed in white.

  In S411, the CPU 119a determines whether the setting of the focus assist function is ON as in S403. If the setting of the focus assist function is set to ON, the process proceeds to S414, and if not, the process proceeds to S412.

  In S412, the CPU 119a determines whether or not an AF frame moving operation has been performed. For example, when the cross key 125 is pressed, the AF frame can be moved in a direction corresponding to the pressed direction key. If it is determined that there has been an AF frame moving operation, the position of the AF frame is moved in accordance with the moving operation, and then the process proceeds to S410. Otherwise, the process proceeds to S413. In S410, which proceeds from S412, the AF frame is displayed in white while the AF frame is being moved. After the AF frame moving operation is completed, the AF frame is displayed in white for a predetermined time (about several seconds), and then the AF frame is not displayed.

  In S413, the CPU 119a determines that the face detection is OFF, the setting of the focus assist function is OFF, and the display type is the one before the one-shot AF operation in the one-shot AF mode. Then, AF frame display: None, Face frame display: None, Focus assist display: None are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11A is displayed on the display unit 107. This screen is a screen when the AF assist state before the one-shot AF key 129 is operated and the setting of the focus assist function is OFF.

  In S414, the CPU 119a determines that the face detection is OFF, the focus assist function setting is ON, and the display type is the one before the one-shot AF operation in the one-shot AF mode. Then, AF frame display: none, face frame display: none, and focus assist display: yes are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11B is displayed on the display unit 107. Even in this state, manual focus by operating the focus ring 134 is possible. Therefore, by displaying the focus assist 1101, the user's MF operation can be supported. At this time, the position of the focus assist 1101 can be moved as described in S306 to S309 in FIG. When the position of the focus assist 1101 is moved, the distance measuring position and the AF position are also moved. Thereafter, when the one-shot AF key 129 is pressed, the display changes to the display of S409 through the display of S410. That is, when the setting of the focus assist function is ON in the one-shot AF mode, focus assist is displayed at the distance measurement position before the one-shot AF key 129 is pressed. When the one-shot AF key 129 is pressed, AF is performed at that position, and the focus assist display is replaced with the AF frame.

  In S415, the CPU 119a determines whether or not the AF lock state is set. When the AF lock state is set in S334 described above, it is determined here that the AF lock state is set. If it is in the AF lock state, the process proceeds to S417, and if not, the process proceeds to S416.

  In S416, the CPU 119a determines that the display type is the face detection OFF, the continuous AF mode, and the AF lock is not performed (during the execution of continuous AF). Then, AF frame display: white, face frame display: none, and focus assist display: none are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11C is displayed on the display unit 107. However, the AF frame 1102 is displayed in white.

  In S417, as in S403, the CPU 119a determines whether the setting of the focus assist function is ON. If the focus assist function is set to ON, the process proceeds to S419, and if not, the process proceeds to S418.

  In S418, the CPU 119a determines that the face detection is OFF, the setting of the focus assist function is OFF, and the display type is the AF lock state in the continuous AF mode. Then, AF frame display: gray, face frame display: none, and focus assist display: none are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11D is displayed on the display unit 107.

  In S419, the CPU 119a determines that the face detection is OFF, the setting of the focus assist function is ON, and the display type is the AF lock state in the continuous AF mode. Then, AF frame display: none, face frame display: none, and focus assist display: yes are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11B is displayed on the display unit 107. As described in S334, manual focus is possible by operating the focus ring 134 even in the AF locked state, and thus displaying the focus assist 1101 can support the user's MF operation. At this time, the position of the focus assist 1101 can be moved as described in S306 to S309 in FIG. When the position of the focus assist 1101 is moved, the distance measuring position and the AF position are also moved. Thereafter, when the AF lock state is canceled and the continuous AF is executed, the display of S416 is performed, and the focus assist 1101 is replaced with the AF frame 1102.

  In S430, the CPU 119a determines whether AF is set by the AF / MF switch 135 or not. If it is set to AF, the process proceeds to S434; otherwise, the process proceeds to S431.

  In S431, the CPU 119a determines whether or not the setting of the focus assist function is ON as in S403. If it is ON, the process proceeds to S432, and if not, the process proceeds to S433.

  In S432, the CPU 119a determines that the display type is when the face detection is ON, the MF setting, and the focus assist is ON. Then, AF frame display: none, face frame display: no main face, subface is gray, focus assist display: at the position of the main face, are set. The set contents are held in the RAM 119c. As a result, the display unit 107 displays the screen as shown in FIG.

  In S433, the CPU 119a determines that the display type is when face detection is ON, MF setting, and focus assist is OFF. Then, AF frame display: None, Face frame display: Main face and sub-face are gray, Focus assist display: None are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11F is displayed on the display unit 107.

  In S434, the CPU 119a determines whether or not the AF mode is one-shot AF, as in S406. If the one-shot AF, the process proceeds to S435, and if not, the process proceeds to S442.

  In S435, the CPU 119a determines whether or not the AF operation by the one-shot AF is executed, similar to S407. If it is determined that the one-shot AF has been executed, the process proceeds to S436, and if not, the process proceeds to S439.

  In S436, the CPU 119a determines whether or not the AF target is focused by the one-shot AF (whether or not the focusing is successful), as in S408. If it is in focus, the process proceeds to S437, and if not, the process proceeds to S438.

  In S437, the CPU 119a determines that the face type is ON, the one-shot AF mode is selected, and the display type is in a focused state as a result of performing the one-shot AF. Then, AF frame display: none, face frame display: green for the main face, gray display for the sub-face, and focus assist display: none are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11E is displayed on the display unit 107. Note that the face frame 1106 is displayed in green.

  In S438, the CPU 119a determines that the face type is ON, the one-shot AF mode is selected, and the display type is in an in-focus state (in the middle of the AF operation). Then, AF frame display: none, face frame display: white for the main face, gray display for the sub-face, and focus assist display: none are set. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11E is displayed on the display unit 107. However, the face frame 1106 is displayed in white.

  In S439, the CPU 119a determines whether the setting of the focus assist function is ON as in S403. If the setting of the focus assist function is set to ON, the process proceeds to S441, and if not, the process proceeds to S440.

  In S440, the CPU 119a determines that the display type is the state in which the face detection is ON, the setting of the focus assist function is OFF, the one-shot AF mode, and the one-shot AF is not performed. Then, AF frame display: none, face frame display: main face and sub-face are gray, focus assist display: none. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11F is displayed on the display unit 107.

  In S442, the CPU 119a determines that the face detection is ON, the setting of the focus assist function is ON, and the display type prior to the one-shot AF operation in the one-shot AF mode. Then, AF frame display: none, face frame display: no main face, subface is gray, focus assist display: at the position of the main face, are set. The set contents are held in the RAM 119c. As a result, the display unit 107 displays the screen as shown in FIG. Even in this state, manual focus by operating the focus ring 134 is possible. Therefore, by displaying the focus assist 1101, the user's MF operation can be supported. Thereafter, when the one-shot AF key 129 is pressed, the display changes to the display of S437 through the display of S438. That is, when the setting of the focus assist function is ON in the one-shot AF mode, focus assist is displayed at the distance measurement position before the one-shot AF key 129 is pressed. When the one-shot AF key 129 is pressed, face AF is performed at that position, and the focus assist display is replaced with a focused face frame.

  In S442, the CPU 119a determines whether or not the AF lock state is set, as in S415. If it is in the AF lock state, the process proceeds to S444, and if not, the process proceeds to S443.

  In S443, the CPU 119a determines the display type when face detection is ON and continuous AF is performed. Then, AF frame display: none, face frame display: white for the main face, gray for the sub-face, and focus assist display: none. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11E is displayed on the display unit 107. However, the face frame 1106 is displayed in white.

  In S444, as in S403, the CPU 119a determines whether the setting of the focus assist function is ON. If the focus assist function is set to ON, the process proceeds to S446, and if not, the process proceeds to S445.

  In S445, the CPU 119a determines the display type when the face detection is ON, the setting of the focus assist function is OFF, and the AF lock state is set in the continuous AF mode. Then, the AF frame is set to None, the face frame display is gray for the main face and the sub-face, and the focus assist display is set to None. The set contents are held in the RAM 119c. As a result, the screen as shown in FIG. 11F is displayed on the display unit 107.

  In S446, the CPU 119a determines that the face detection is ON, the setting of the focus assist function is ON, and the display type is the AF lock state in the continuous AF mode. Then, AF frame display: none, face frame display: no main face, subface is gray, focus assist display: at the position of the main face, are set. The set contents are held in the RAM 119c. As a result, the display unit 107 displays the screen as shown in FIG. As described in S334, manual focus is possible by operating the focus ring 134 even in the AF locked state, and thus displaying the focus assist 1101 can support the user's MF operation. Thereafter, when the AF lock state is released and the continuous AF is executed, the display of S443 is displayed and the focus assist 1101 is replaced with the face frame 1106.

<Focus assist display processing>
FIG. 5 is a flowchart showing details of the focus assist display processing described above in S304 of FIG.

  In S501, the CPU 119a reads the distance measurement position (focus detection position) held in the RAM 119c.

  In S502, the CPU 119a obtains the focusing information and the information on the success or failure of the distance measurement from the distance measuring unit 108 for the subject corresponding to the distance measurement position obtained in S501. As described above, the in-focus information includes information indicating whether the in-focus state, the front pin, or the rear pin is calculated based on the defocus amount and the in-focus level information.

  In S503, the CPU 119a determines the frame display position, index angle, and display color of focus assist (assist display, focus guide, focus guide display) drawn by the GPU 115 based on the information obtained in S501 and S502. The frame display position is determined as the distance measurement position. The index angle is determined based on information indicating whether the focus, the front pin, or the rear pin is in the state, and the focus degree information for the front pin or the rear pin. The display color is determined based on the information indicating whether the focus, the front pin, or the rear pin is in the state, and the distance measurement success / failure information. Details will be described later.

  In S504, the CPU 119a refers to the distance measurement success / failure information obtained in S502 and determines whether or not the distance measurement is successful. If successful, the process proceeds to S505, and if unsuccessful, the process proceeds to S510.

  In step S505, the CPU 119a determines whether the subject is in focus or in focus based on the information obtained in step S502. If it is in focus, the process proceeds to S507, and if it is not in focus, the process proceeds to S506.

  In S506, the CPU 119a determines whether the subject is in the front pin state or the rear pin state based on the information obtained in S502. If it is the front pin state, the process proceeds to S508, and if it is the rear pin, the process proceeds to S509.

  In S507, the CPU 119a selects index assist data corresponding to the index pattern A, that is, the index display mode when the subject is in focus. A display example of the index and frame data is shown in FIG. An index 801 indicates an in-focus state (a state where the subject in the focus detection area is in focus). An index 804 and an index 805, which will be described later, are integrated with each other, and further, a position adjacent to the index 803 (an index 803 The position indicated by. The color is also displayed in green different from the other states. By adopting such an expression, the display area of the index is smaller in the in-focus state and in the vicinity thereof than in other states, so that it is possible to reduce the influence of the photographer on visual recognition. A frame 802 indicates an area corresponding to the distance measurement position obtained in S501 on the live view.

  In S508, the CPU 119a selects the index pattern B, that is, the focus assist data corresponding to the index display form when the subject is in the front pin state. Display examples of the index and frame data are shown in FIGS. 8B-1 and 8B-2. An index 803 indicates the target point of the index 804 and the index 805 for moving toward the in-focus state, and is represented by a white triangle that faces the frame 802. The index 804 and the index 805 indicate the degree of focus of the distance measurement position according to the display distance between them, and are expressed by triangles facing away from the frame 802. When the distance between the subject and the digital camera 10 fluctuates, the degree of focus changes, so that the interval between the index 804 and the index 805 narrows or widens, or the display position dynamically changes. The distance (angle) between the index 804 and the index 805 is based on the degree-of-focus information, and the display distance is smaller (the angle becomes narrower) when the focus detection area is smaller than when the deviation from focus is large. Change to be smaller). That is, FIG. 8B-1 shows that the subject is relatively small blurred (the degree of out-of-focus is small), and FIG. 8B-2 shows that the subject is relatively large out-of-focus (out of focus). The degree is large). Since the index 803, the index 804, and the index 805 form a triangle whose apexes face each other in the vicinity of the in-focus state, it is easy to visually recognize a slight focus shift in the vicinity of the in-focus state. Further, since each index is displayed in the vicinity of the frame 802, the photographer can check the in-focus state without greatly diverting the line of sight from the subject. In addition, even when the focus assist display can be displayed at a plurality of positions at the same time, the connection between each frame and the index is easy to understand.

  In S509, the CPU 119a selects the index pattern C, that is, the focus assist data corresponding to the index display form when the subject is in the rear pin state. Display examples of the index and frame data are shown in FIGS. 8C-1 and 8C-2. Unlike FIG. 8B-1 and FIG. 8B-2, the index 803 is represented by a white triangle facing away from the frame 802, and the index 804 and the index 805 are triangles facing the frame 802. It is expressed. Therefore, the display form is such that the front pin or the rear pin can be distinguished at a glance. FIG. 8C-1 shows that the subject is relatively small blurred (the degree of out-of-focus is small), and FIG. 8C-2 shows that the subject is out-of-focus (relatively out of focus). Large).

  In S510, the CPU 119a selects the index assist data corresponding to the index pattern D, that is, the index display form when the subject is in a largely blurred state. A display example of the index and frame data is shown in FIG. Each of the index 803, the index 804, and the index 805 is represented by a rectangle, and FIG. 8 (A), FIG. 8 (B-1), FIG. 8 (B-2), FIG. 8 (C-1), FIG. The shape is different from the index shown in (C-2). The color is also displayed in gray. As a result, it is visually indicated that the determination of the front pin and the rear pin has failed (that is, the distance measurement has failed) is in a large blurred state.

  In S511, the CPU 119a renders the index and frame data selected in any of S507 to S510 in the frame display VRAM by the GPU 115 with the display position, index angle, and display color determined in S503.

  In S512, the CPU 119a draws various display elements other than the focus assist display in the OSD display VRAM.

  In S513, the CPU 119a combines the OSD display VRAM drawn in S512 with the GPU 115 on the frame display VRAM drawn in S511.

  In S514, the CPU 119a superimposes the VRAM synthesized in S513 on the video (live view image) by the display I / F unit 106 and displays it on the display unit 107. 9A and 9B show a screen structure displayed on the display portion 107 at this time. Each of the focus assist 901a and the focus assist 901b includes the frame and the index shown in FIG. An icon 902 indicates that the AF / MF switch 135 is set to MF. A subject 903 and a subject 904 are subjects (part of the live view) imaged on the image sensor 102. In addition, other information display elements that are not related to the present invention are also displayed in the screen. These are drawn in S512, but numbers are not given. In FIG. 9A, the distance measurement position obtained in S501 corresponds to the subject 903, and the subject 903 is in focus. On the other hand, FIG. 9B shows a display example when the distance measurement position is moved by the cross key 125 or the dial 126 from FIG. 9A. The distance measuring position is the position of the subject 904 and is in a state of a front pin with respect to the subject 904. FIG. 9B shows a state in which a part of the index of the focus assist 901b is hidden under another display element due to the effect of composition in S513 (superimposed display so that the other display element is on the upper side). Have been). Even in such a state, since the index is composed of three figures, the focus state can be confirmed by another exposed index.

  Thus, the focus assist indicates how much the focus 134 should be operated to which side before focusing on the subject at the distance measurement position (focus detection position). In other words, the focus assist indicates the degree of focus (degree of focus shift) of the subject at the distance measurement position. In other words, the focus assist indicates a deviation between the focal length and the current focal length when the subject at the distance measurement position is focused. In other words, the focus assist indicates the relationship between the focus position (the distance between the currently focused position and the digital camera 10) and the subject distance (the distance between the digital camera 10 and the subject) at the distance measurement position. ing.

<Modification of focus assist display mode>
An example of another display form of the frame and index shown in FIG. 8 is shown in FIG.

  FIG. 10A shows an in-focus state corresponding to FIG. The index 1001 corresponds to the index 801, and the frame 1002 corresponds to the frame 802. An index 1001 is an expression in which an index 1003, an index 1004, and an index 1005, which will be described later, are overlapped and integrated, and in the same way as in FIG. The influence of is reduced.

  FIG. 10B shows a front pin state corresponding to FIG. 8B-2. The index 1003 corresponds to the index 803, the index 1004 corresponds to the index 804, and the index 1005 corresponds to the index 805. An arrow 1006 indicates a direction in which the focus ring 134 should be rotated in order to go to focus. As a result, even if the photographer is not familiar with the operation of the focus ring 134, the user can smoothly operate in the in-focus direction without hesitation in the rotation direction. When the display unit 107 can change the orientation with respect to the focus ring 134, it can be adapted to any orientation of the display unit 107 by detecting the orientation state and changing the direction of the arrow 1006. .

  FIG. 10C shows a rear pin state corresponding to FIG. 8C-2. The positions of the index 1004 and the index 1005 are opposite to those in FIG. In this way, the display form is such that the photographer can distinguish between the front pin and the rear pin at a glance. An arrow 1006 also points in the opposite direction to FIG. 10B, indicating that the rotation direction of the focus ring 134 for operating in the in-focus direction is different.

<Image size setting switching processing (crop setting)>
The image size setting switching process described in S318 and S319 of FIG. 3 will be described.

The digital camera 10 has an item of image size setting (resolution setting) as a menu item on the menu screen. When a menu item for image size setting is selected, a submenu having the following options is displayed, and the user can select any of the options.
Setting 1 ... 4K: 4096 pixels x 2160 pixels Setting 2 ... 4K: 3840 pixels x 2160 pixels Setting 3 ... 2K: 2048 pixels x 1080 pixels Setting 4 ... 2K: 1920 pixels x 1080 pixels Setting 5 ... 2K crop: 2048 pixels x 1080 Pixel setting 6… 2K crop: 1920 pixels × 1080 pixels

  Setting 1 is a setting of the maximum size that can be set by the digital camera 10. The maximum number of pixels of the image sensor 102 is slightly larger than 4096 pixels × 2160 pixels of setting 1, but the maximum size (effective pixels) that can be set as the image size (number of recording pixels) is 4096 pixels × 2160 pixels And

  Settings 3 and 4 are sizes obtained by resizing and reducing images read out from pixels having the same range and the same number of pixels as the settings 1 and 2 in the image sensor 102, respectively. Accordingly, the images have the same angle of view as those in the settings 1 and 2, respectively.

  Settings 5 and 6 are partial ranges including the center of the image sensor 102 (setting 5 is a range of 2048 pixels × 1080 pixels from the center of the image sensor 102, and setting 6 is 1920 pixels × 1080 pixels from the center of the image sensor 102. In this setting, readout is performed only from pixels in the range (1). That is, only a pixel in a range narrower than the settings 1 to 4 is used, and an image having an angle of view narrower than the settings 1 to 4 is obtained. That is, it is a size obtained by cutting out a partial range including the center of the image sensor 102. Shooting with settings 5 and 6 is collectively referred to as a crop mode. Note that settings 1 to 6 are not set as menu items in the same layer, and the option “Crop Mode” is selected in the first layer of the image size setting, and then the 2048 pixel × 1080 pixel or 1920 pixel in the submenu of the crop mode. It may be possible to select × 1080 pixels.

  In this embodiment, when the crop mode is set, it is determined whether or not the distance measurement position is within the shooting range in the crop mode. If not, the distance measurement position is changed to the center. . The concept of this process will be described with reference to FIG.

  FIG. 12A is an example of an image captured at the maximum size (setting 1). Shooting is performed using pixels in a range corresponding to the maximum size in the image sensor 102, and an image in the shooting range 1201 is captured. A crop range 1202 indicates a range cut out by crop photography.

  FIG. 12B is an example of an image captured by pixels in a range corresponding to the crop range 1202 in FIG.

  FIG. 12C shows a display example of the focus assist 1203 and the live view image when the maximum size (setting 1) is set and the distance measurement position is an area outside the cropping range 1202.

  FIG. 12D shows a display example of the live view image and the focus assist 1203 when the crop mode is switched from the state of FIG. 12C (when the image size is set to setting 5 or 6). In FIG. 12C, since the distance measurement position is an area outside the crop range 1202, in response to the change to the crop mode, the distance measurement position is set to the center of the shooting range in the crop mode (the center of the image sensor 102). ) Has been changed. Even when the crop mode is entered, the size of the area to be measured on the image sensor 102 does not change. That is, since the size of the live view image with respect to the image sensor 102 is reduced (the shooting range is narrowed) in accordance with the crop mode, the distance measurement range (focus detection range) for the live view image is relatively large. Become. Accordingly, the focus assist 1203 superimposed on the live view image on the display unit 107 is also larger in FIG. 12D than in FIG.

  FIG. 12E is a display example of the focus assist 1203 and the live view image when the maximum size (setting 1) is set and the distance measurement position is an area inside the cropping range 1202.

  FIG. 12F shows a display example of the live view image and the focus assist 1203 when the crop mode is switched from the state of FIG. 12E (when the image size is set to 5 or 6). In FIG. 12E, since the distance measurement position is inside the crop range 1202, the distance measurement position in the image sensor 102 is not changed even when the crop mode is changed. That is, if the digital camera 10 and the subject do not move, the focus assist 1203 is set to the same subject position (dog head in the illustrated example) before and after switching to the crop mode.

  Further, as shown in FIG. 12G, when the frame of the focus assist 1203 indicating the distance measurement position with the maximum size (setting 1) partially overlaps both the inside and outside of the crop range 1202, the crop mode is set. When switched, the distance measurement position (range measurement range) shown in FIG. That is, the distance measurement position is moved so that the entire distance measurement range is within the shooting range in the crop mode. In this case, it does not move to the center.

  Further, when the crop mode is canceled from the crop mode (when switching from setting 5 or 6 to any one of settings 1 to 4), the ranging position is not changed (held). That is, when the image size setting is changed to setting 1 from the state of FIG. 12F, the focus assist 1203 is displayed at the position of FIG.

  FIG. 6 shows a flowchart of the image size setting switching process. This process is a detail of the process of S319 in FIG.

  In S601, the CPU 119a determines whether or not the crop mode has been set. That is, it is determined whether or not any one of the settings 1 to 6 is set to the setting 5 or the setting 6. If the crop mode is set (set to setting 5 or 6), the process proceeds to S602, and if not, the process proceeds to S607.

  In S602, the CPU 119a changes the readout range from the sensor (image sensor 102) to a crop range corresponding to the set crop mode. That is, when setting 5 is set, a range of 2048 pixels × 1080 pixels with the center of the image sensor 102 as the center is set as a reading range. When setting 6 is set, a range of 1920 pixels × 1080 pixels with the center of the image sensor 102 as the center is set as a reading range.

  In S603, the CPU 119a determines whether the current distance measurement position and the entire distance measurement range are outside the readout range (crop range) set in S602. If it is determined that the entire distance measurement range is outside the cropping range, the process proceeds to S604, and if not, the process proceeds to S605.

  In step S604, the CPU 119a changes the distance measurement position and sets it to the center of the image sensor 102 (the center of the shooting range). Thus, the distance measurement position is changed as shown in FIG. 12C to FIG. 12D, and the display position of the focus assist 1203 is also updated.

  In S605, the CPU 119a determines whether or not a part of the current distance measurement range is outside the cropping range (partly within the cropping range). If it is determined that a part of the distance measurement range is not the entire cropping range, the process proceeds to S606. If not, that is, if the entire distance measurement range is within the crop range, the process proceeds to S608 without changing the distance measurement position.

  In step S606, the CPU 119a changes the distance measurement position to a position where the entire distance measurement range falls within the crop range. More specifically, if a part of the distance measurement range protrudes from the cropping range only in the X direction (horizontal direction) before changing the distance measurement position, the position in the Y direction (vertical direction) does not move. The distance measurement position is moved inward of the cropping range in parallel with the X axis by the distance in the X direction that has protruded. If a part of the distance measurement range protruded from the cropping range only in the Y direction (vertical direction) before the distance measurement position was changed, the position in the X direction (horizontal direction) did not move, and the Y was protruding The distance measurement position is moved inward of the cropping range by the distance in the direction parallel to the Y axis. If a part of the distance measurement range protrudes from the cropping range in both the X and Y directions before changing the distance measurement position, it will be displayed at the apex of the cropping range closest to the distance measurement position before the change. The distance measurement position is moved so that the vertices of the distance measurement range coincide and the distance measurement range falls within the crop range. As a result, the distance measurement position is changed as shown in FIG. 12G to FIG. 12H, and the display position of the focus assist 1203 is also updated. If the distance measurement range is partly outside the clip range without performing the processes of S605 and S606, the process may proceed to S604 to set the distance measurement position to the center.

  In S607, settings other than the crop mode set by the user (the above settings 1 to 4) are set, and information indicating the set values is recorded in the ROM 119b.

  The processes of S604 and S606 described above are performed regardless of whether the focus assist function is set to ON or OFF. That is, even if the setting of the focus assist function is OFF, when all or part of the distance measurement range is outside the cropping range when the crop mode is set, the processing of S604 and S606 is performed.

  As described above, when the crop mode is set by the process described with reference to FIG. 6 and the menu is closed and the screen is returned to the live view screen, the screen transition described with reference to FIGS. .

<Enlargement processing>
The enlargement process will be described. In the digital camera 10 of the present embodiment, the enlargement key 131 (enlarge button) is pressed while the live view is being displayed at the normal magnification (the magnification at which the entire live view of the shooting range corresponding to the recording size fits in the display unit 107) To enter the enlargement mode. In the enlargement mode, the live view image is enlarged and displayed on the display unit 107. When the enlargement key 131 is pressed to change to the enlargement mode, the enlargement is initially displayed at the enlargement magnification (either 2 ×, 4 ×, or 8 ×) that was last displayed in the previous enlargement mode. Note that the initial value is double, and when the power mode is switched to the enlargement mode for the first time, the enlarged display is doubled. In the enlargement mode, every time the SET key 127 is pressed, the enlargement magnification can be sequentially switched from 2 × → 4 × → 8 × → 2 × →. When the enlargement key 131 is pressed in the enlargement mode, the enlargement mode is exited at any magnification, and the live view display is returned to the normal magnification.

  In the enlargement mode, when the setting of the focus assist function set at 313 in FIG. 3 is ON and when the AF / MF switch 135 is set to AF, the distance measuring position (in the case of AF, the same as the AF position) ). That is, when focus assist is displayed before enlargement, the enlargement range is determined so that the focus assist frame is centered. When the distance measurement position is near the end of the shooting range, the distance measurement position is not necessarily the center of the enlarged range, and the range that includes the distance measurement position and does not protrude outside the shooting range is enlarged. In other words, the enlarged display is performed so that the blank portion lacking the image does not occur when the enlarged display is performed. In any case, based on the distance measurement position set before enlargement, the distance measurement position (center of the distance measurement range) is enlarged and displayed so as to be included in the enlargement range.

  On the other hand, in the enlargement mode, when the focus assist function set in 313 in FIG. 3 is OFF and the AF / MF switch 135 is set to MF, the center of the shooting range is set regardless of the distance measurement position. Expand as the center.

  Screen transition related to enlarged display will be described with reference to FIGS. 13 (A) to 13 (E).

  FIG. 13A is a display example on the display unit 107 when the setting of the focus assist function set in 313 of FIG. 3 is ON and the AF / MF switch 135 is set to MF. A focus assist 1301 is displayed superimposed on the live view image. When the enlargement key 131 is pressed from this state, the live view is enlarged and displayed so that the distance measurement position (the position where the focus assist 1301 is displayed) is at the center, as shown in FIG. In addition, an enlarged range guide 1302 indicating which range of the entire photographing range is enlarged is displayed.

  From the state of FIG. 13A, as described in S310 to S313 of FIG. 3, when the menu screen is opened to set the focus assist function to OFF and the menu screen is closed, the display unit 107 displays FIG. C) is displayed. Since the setting of the focus assist function is set to OFF, the focus assist 1301 is not displayed for the live view image. When the enlargement key 131 is pressed in this state, the live view is enlarged and displayed around the center of the shooting range, not the distance measurement position, as shown in FIG. In this embodiment, at this time, the distance measurement position held in the RAM 119c is updated with the enlargement center position. That is, the distance measuring position is changed to the center of the shooting range and stored. When the enlargement key 131 is further pressed in the state of FIG. 13D, the enlargement mode is canceled, and as described in S310 to S313 of FIG. 3, the menu screen is opened and the setting of the focus assist function is turned on. Then, the display shown in FIG. At this time, since the distance measurement position is changed to the center of the shooting range, the position of the focus assist 1301 is the center of the shooting range, unlike FIG. As described above, in this embodiment, when live view enlargement display is performed when the focus assist function is set to OFF and the MF is set, the focus detection position to be assisted by the focus assist 1301 is determined based on the enlargement range. change.

  On the other hand, if the focus assist function is set to ON even if enlarged display is performed when focus assist is not displayed because the Disp level is set to the information non-display level, the distance measurement position is within the expanded range. Do not interlock.

  Screen transitions due to switching of the Disp level will be described with reference to FIGS. FIG. 14A shows the display unit when the setting of the focus assist function set in 313 of FIG. 3 is ON and the AF / MF switch 135 is set to MF, as in FIG. 13A. This is a display example at 107. When the enlargement key 131 is pressed from this state, the display is as shown in FIG. 14B, and when the enlargement is canceled after that, the display returns to the display of FIG. This screen transition is the same as in FIGS. 13A to 13B and FIGS. 13B to 13A. On the other hand, if the Disp level is switched from the state shown in FIG. 14A and the information is not displayed, the display shown in FIG. 14C is displayed, and the assist assist 1301 is not displayed. When the enlarged display is performed from this state, the range centering on the distance measurement position is enlarged based on the distance measurement position held in the RAM 119c, and the display as shown in FIG. When the enlargement is canceled thereafter, the display is as shown in FIG. 14C, and when the setting of the focus assist function is further changed to ON, the display shown in FIG. 14A is obtained. In other words, even if enlarged display is performed when focus assist is not displayed due to the information non-display level being set, if the focus assist function is set to ON, the distance measurement position is not linked to the enlarged range.

  FIG. 7 shows a flowchart of the above-described enlarged display process. This process is the details of the process of S338 in FIG.

  In S701, the CPU 119a reads the enlargement magnification at the previous enlargement mode stored in the RAM 119c.

  In S702, the CPU 119a determines whether or not the read magnification is two times. If it is double, the process proceeds to S703, and if not, the process proceeds to S722.

  In S703, the CPU 119a refers to the setting information stored in the ROM 119b, and determines whether the setting of the focus assist function is ON. If the setting of the focus assist function is set to ON in S313 described above, it is determined here to be ON. If the setting of the focus assist function is set to ON, the process proceeds to S704, and if not, the process proceeds to S705.

  In S704, the CPU 119a determines an enlargement range based on the current distance measurement position held in the RAM 119c, and displays the live view image on the display unit 107 with an enlargement of 2 times the normal magnification. Basically, the enlargement range is determined so that the distance measurement position is the center of the enlargement range. If the distance measurement position is near the end of the shooting range, and the distance measurement position is set to the center of the enlargement range, the enlargement range will exceed the shooting range. Determine as the expansion range. In any case, based on the distance measurement position, the distance measurement position (center of the distance measurement range) is enlarged and displayed so as to be included in the enlarged range. A display example at this time is FIG. 13B described above. As shown in the drawing, the focus assist is not displayed on the enlarged live view image in the enlargement mode (enlargement process) even if the focus assist function is set to ON. By doing so, it is possible to prevent the focus assist from obstructing the visual recognition of the enlarged live view when it is desired to enlarge and confirm the focus in detail.

  In S705, the CPU 119a determines whether or not the AF / MF switch 135 is set to MF. If it is set to MF, the process proceeds to S706. If not, that is, if it is set to AF, the process proceeds to S704.

  In S706, the CPU 119a determines an enlargement range centered on the center of the shooting range (the center of the live view image at the normal magnification), and enlarges the live view image to 2 times the normal magnification on the display unit 107. indicate. A display example at this time is FIG. 13D described above.

  In S707, the CPU 119a updates the distance measurement position held in the RAM 119c according to the enlarged position. That is, the distance measurement position is set to the center of the shooting range (the center of the live view image at normal magnification) (the distance measurement range is set to a range centered on the center of the shooting range). As a result, when the setting is made so that the focus mode is displayed after the enlargement mode is canceled, the position at which the focus assist is displayed is as shown in FIG. The position is different from A).

  In S708, the CPU 119a determines whether or not the operation of the cross key 125 has been performed (enlargement range movement instruction reception). If the operation of the cross key 125 is performed, the process proceeds to S709, and if not, the process proceeds to S712.

  In S709, the CPU 119a moves the enlargement center position in the direction corresponding to the operated direction key of the cross key 125. In other words, the range of the shooting range that is enlarged and displayed on the display unit 107 is changed according to the operation of the cross key 125 performed during the enlarged display.

  In S710, the CPU 119a determines whether the AF / MF switch 135 is set to MF. If it is set to MF, the process proceeds to S711. If not, that is, if it is set to AF, the process proceeds to S712.

  In S711, the CPU 119a updates the distance measurement position held in the RAM 119c in accordance with the enlargement center position moved in S709. That is, the distance measurement position is set to the center of the enlarged range after movement (the distance measurement range is changed to a range centered on the center of the enlarged range after movement).

  In S712, the CPU 119a determines whether or not another event has occurred. Examples of the other event include pressing of the menu key 124, pressing of the START / STOP key 133, and operations for setting various shooting parameters. If another event has occurred, the process proceeds to S713, and if not, the process proceeds to S714.

  In S713, processing corresponding to the other event that has occurred is performed. For example, when the START / STOP key 133 is pressed, recording of a moving image is started. That is, a moving image can be recorded even during enlargement.

  In S714, the CPU 119a determines whether or not the SET key 127 has been pressed. If it is determined that the SET key 127 has been pressed, the process proceeds to S716, otherwise, the process proceeds to S715.

  In S715, the CPU 119a determines whether or not the enlargement key 131 has been pressed. If the enlargement key 131 is pressed, the process proceeds to S717, and if not, the process returns to S708 to repeat the process.

  In S717, the current enlargement magnification is stored in the RAM 119c, the enlargement is canceled (returned to the normal magnification), and the process is terminated. Note that the current magnification may be recorded in the ROM 119b, which is a nonvolatile memory, instead of the RAM 119c. In this way, the enlargement mode can be started from the enlargement magnification used last time even after the power is turned off.

  In S716, the CPU 119a displays the live view image on the display unit 107 by changing the enlargement magnification from 2 to 4 with reference to the current enlargement position.

  In S722, the CPU 119a determines whether or not the enlargement magnification read in S701 is four times. If it is four times, the process proceeds to S703, and if not (that is, eight times), the process proceeds to S722.

  Steps S723 to S735 are the same as steps S703 to S715 except that the magnification to be enlarged is not doubled but four times, and thus description thereof is omitted. In S <b> 736, the CPU 119 a displays the live view image on the display unit 107 while changing the enlargement magnification from 4 times to 8 times based on the current enlargement position.

  Steps S743 to S755 are the same as steps S703 to S715 except that the enlargement magnification is 8 times instead of 2 times, and thus the description thereof is omitted. In S <b> 756, the CPU 119 a displays the live view image on the display unit 107 while changing the enlargement magnification from 8 times to 2 times based on the current enlargement position.

<Focus assist display processing in enlarged mode (variation)>
Although an example has been described in which focus assist is not displayed in the enlarged live view image in the enlargement mode (enlargement process) described with reference to FIGS. 7, 13, and 14, the present invention is not limited thereto. Focus assist may be displayed even in the enlargement mode. Hereinafter, processing in the case of displaying focus assist in live view enlarged display will be described.

[Modification 1]
A modified example 1 related to the display of the focus assist in the enlargement mode will be described with reference to FIGS.

  FIG. 15A is a display example on the display unit 107 when the focus assist function is set to ON and the focus assist 1501 is displayed in the live view display at the normal magnification (normal angle of view). In the focus assist 1501, a frame portion surrounded by a square indicates a distance measurement position (range measurement range), and a triangular display at the upper part of the ring indicates a focus shift amount and a focus movement with respect to the in-focus state. This shows a change in the focus state. Moreover, the arrow display at the lower part of the ring indicates the operation direction of the ring.

  FIG. 15B is a display example when the enlarged live view display is performed with the enlargement magnification set to 2 in the enlargement mode, and is a modification of the display in S704 in FIG. 7 described above. The subject (live view image) is doubled compared to the normal magnification, and the entire focus assist 1501 is displayed in double size. Even if the display size of the focus assist 1501 is doubled and the live view is also doubled, the area occupied by the imaging element 102 in the distance measuring range indicated by the rectangular frame portion of the focus assist 1501 is the normal magnification. Same as time.

  FIG. 15C is a display example when the enlarged live view display is performed with the enlargement magnification set to 4 in the enlargement mode, and is a display example performed in S724 in FIG. 7 described above. The subject (live view image) is quadrupled and the focus assist 1501 is not displayed.

  FIG. 15D is a display example when the enlarged live view display is performed with the enlargement magnification set to 8 in the enlargement mode, and is a display example performed in S744 in FIG. 7 described above. When the subject (live view image) is 8 times, the focus assist 1501 is not displayed.

  In the first modification, as described above, the focus assist is displayed when the enlargement magnification is 2 times or less, and the focus assist is not displayed when the enlargement magnification exceeds 2 times. As described above, when the live view image is enlarged, the distance measurement range display size also increases. For this reason, if the display of the focus assist is made to correspond to the distance measurement range, the display size of the focus assist must be enlarged in accordance with the enlargement magnification of the live view. However, in this case, when the enlargement magnification is increased, the focus assist wedge and the ring portion are outside the display area of the display unit 107, and when further enlarged, the focus assist rectangular frame part is also outside the display area. . Then, the focus assist cannot be displayed properly. In addition, the size of the wedge and the ring may change the sense of incongruity when the user operates the manual focus. In the first modification, such a situation can be prevented by not displaying the focus assist when the enlargement magnification exceeds two times.

  In the first modification, the display / non-display of the focus assist is switched with a threshold value of 2 times, but the present invention is not limited to this. When the enlargement magnification can be set not only to 2 times, 4 times, and 8 times, but also to an arbitrary magnification more finely, it is possible to switch between display and non-display using a calculation formula described below.

The horizontal address of the upper left coordinate when cut out in the rectangular area of the focus assist frame portion is x1, the vertical address is y1, the horizontal size is Width1, the vertical size is Height1, and the enlargement magnification is N. At that time, the enlarged upper left coordinates (x2, y2) and size (Width2, Height2) can be obtained as follows.
x2 = x1− (Width1 × N−Width1) ÷ N
y2 = y1− (Height1 × N−Height1) ÷ N
Width2 = Width1 × N
Height2 = Height1 × N

  At this time, it is determined whether either x2 or y2 is out of the display area, or any of x2 + Width2, y2 + Height2 is out of the display area, and if it is out of the display area, it is not displayed. Even if an arbitrary magnification is set, it is possible to cope.

[Modification 2]
A modified example 2 related to the focus assist display in the enlargement mode will be described with reference to FIGS.

  FIG. 16A shows a display example on the display unit 107 when the focus assist function is set to ON and the focus assist 1601 is displayed in the live view display at the normal magnification (normal angle of view).

  FIG. 16B is a display example when the enlarged live view display is performed with the enlargement magnification set to 2 in the enlargement mode, and is a modification of the display in S704 in FIG. 7 described above. The subject (live view image) is doubled compared to the normal magnification, and the rectangular frame portion 1601a (indicating the distance measurement range) of the focus assist 1601 is displayed in double size. Annulus indicating the amount of focus deviation with respect to the in-focus state and a change in the focus state accompanying the focus movement, an arrow indicating the operation direction of the ring, and the wedge portion 1601b are not changed in size from the normal magnification. The background live view image is displayed in a semi-transparent color so that it can be seen.

  FIG. 16C is a display example when the enlarged live view display is performed with the enlargement magnification set to 4 in the enlargement mode, and is a modification of the display in S7024 in FIG. 7 described above. The subject (live view image) is quadrupled compared to the normal magnification, and only the rectangular frame portion 1601a of the focus assist 1601b is quadrupled. The ring / arrow / wedge portion 1601b is displayed in a translucent color so that the background live view image can be visually recognized without changing the size from the normal magnification.

  FIG. 16D is a display example when the enlarged live view display is performed at an enlargement magnification of 8 in the enlargement mode, and is a modification of the display in S744 in FIG. 7 described above. The subject (live view image) is 8 times larger than the normal magnification, and the rectangular frame portion 1601a of the focus assist 1601 is not displayed. The ring / arrow / wedge portion 1601b is displayed in a semi-transparent color so that the background live view image can be visually recognized without changing the size from the normal magnification. According to the second modification, the rectangular frame portion 1601a is enlarged and displayed in accordance with the enlargement magnification unless the size of the distance measurement range in the live view image exceeds the display area of the display unit 107. Can be accurately recognized by the user. On the other hand, the other portion 1601b is displayed semi-transparently without changing the display size even when the live view is enlarged. Therefore, the user can recognize the degree of focus, the front pin or the rear pin, the direction in which the focus ring 134 should be rotated, etc. without disturbing the visual recognition of the live view display, and assist the user's manual focus operation. be able to. Since the enlarged display is often used when it is desired to strictly adjust the focus with manual focus, the assistance of the manual focus operation during enlarged display as in the second modification is convenient for the user. high.

[Modification 3]
A modified example 3 related to the display of focus assist in the enlargement mode will be described with reference to FIGS.

  FIG. 17A shows a display example on the display unit 107 when the focus assist function is set to ON and the focus assist 1701 is displayed in the live view display at the normal magnification (usually each).

  FIG. 17B is a display example when the enlarged live view display is performed with the enlargement magnification set to 2 in the enlargement mode, and is a modification of the display in S704 in FIG. 7 described above. The subject (live view image) is doubled compared to the normal magnification, and the rectangular frame portion 1701a (indicating the distance measurement range) of the focus assist 1701 is displayed in double size. The portions other than the rectangular frame portion 1701a, that is, the ring, the arrow indicating the operation direction of the ring, and the wedge portion 1701b are not changed in size from the case of the normal magnification, and the display position is not related to the distance measurement position. The display area 107 is changed to the lower left corner. In this way, by changing the display position of the portion 1701b other than the rectangular frame portion 1701a indicating the distance measurement range, the visual recognition of the center portion (particularly the distance measurement range center portion) of the background live view image is prevented. Yes.

  FIG. 17C is a display example when the enlarged live view display is performed with the enlargement magnification set to 4 in the enlargement mode, and is a modification of the display in S7024 in FIG. 7 described above. The subject (live view image) is quadrupled compared to the normal magnification, and only the rectangular frame portion 1701a of the focus assist 1701b is displayed four times. The size of the ring / arrow / wedge portion 1601b is not changed from the case of the normal magnification, and the display position is changed to the lower left corner of the display area of the display unit 107 unrelated to the distance measurement position.

  FIG. 17D is a display example when the enlarged live view display is performed at an enlargement magnification of 8 in the enlargement mode, and is a modification of the display in S7044 in FIG. 7 described above. The subject (live view image) is 8 times larger than the normal magnification, and the rectangular frame portion 1701a of the focus assist 1701 is not displayed. In addition, the size of the ring / arrow / wedge portion 1701b is not changed from the case of the normal magnification, and the display position is changed to the lower left corner of the display area of the display unit 107 unrelated to the distance measurement position.

  According to the third modification, the rectangular frame portion 1701a is enlarged and displayed in accordance with the enlargement magnification unless the size of the distance measurement range in the live view image exceeds the display area of the display unit 107. Can be accurately recognized by the user. On the other hand, the other portion 1701b does not change the display size even when the live view is enlarged, but changes the display position to move to a position that does not overlap the center of the distance measurement range. Therefore, the user can recognize the degree of focus, the front pin or the rear pin, the direction in which the focus ring 134 should be rotated, etc. without disturbing the visual recognition of the live view display, and assist the user's manual focus operation. be able to. Compared with the second modification, since the position is moved, it is not necessary to make the translucent, and the visibility of the portion 1701b can be improved. Since the enlarged display is often used when it is desired to strictly adjust the focus with manual focus, the assistance of the manual focus operation during enlarged display as in the third modification is convenient for the user. high.

  Note that the display mode of the focus assist described in the first to third modifications is not limited to this, and any of the display modes described in FIGS. Further, the present invention is not limited to the first to third modifications, and a magnification that can be enlarged may be limited based on ON / OFF of the setting of the focus assist function described above. For example, when the setting of the focus assist function is OFF, 2 ×, 4 ×, and 8 × can be used as the live view enlargement magnification as described above. On the other hand, when the setting of the focus assist function is OFF, the magnification cannot be increased to 4 times or 8 times (even if an operation for changing the magnification such as pressing the SET key 127 is performed, It is also possible not to change the magnification to 8 times).

<Other examples>
Note that the various controls described as being performed by the CPU 119a may be performed by a single piece of hardware, or the entire apparatus may be controlled by a plurality of pieces of hardware sharing the processing.

  Although the present invention has been described in detail based on the preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms without departing from the gist of the present invention are also included in the present invention. included. Furthermore, each embodiment mentioned above shows only one embodiment of this invention, and it is also possible to combine each embodiment suitably.

  Further, in the above-described embodiment, the case where the present invention is applied to the digital camera 10 has been described as an example. However, this is not limited to this example, and focus information can be displayed regarding the distance measurement position. Any display control device can be applied. As described above, not only a digital camera having an image sensor in the main body, but also an image sensor itself is not included in the main body, and a live view image captured by an external image pickup device is received remotely, and the focus of the distance measurement position is adjusted. The present invention can also be applied to an apparatus that can display the status. For example, the present invention can be applied to display control at the time of remote shooting with a smartphone, a tablet PC, or the like that is connected to an imaging device wirelessly or by wire. As described above, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, music players, game machines, electronic book readers, and the like.

  The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Claims (11)

Mode setting means for setting to a first AF mode for continuously performing autofocus (AF) operation;
When the first AF mode is set and continuous AF is performed, control is performed so that the first display item indicating the AF position, which is the position to be focused by AF, is displayed on the live view. Display control means;
The set to the first AF mode, when you have made continued AF, the continued AF stopped, accepting means for accepting a stop instruction you the AF lock state of fixing the focus position without AF When,
A second display item indicating the degree of focus at a position corresponding to the AF position, instead of the first display item, in response to accepting the stop instruction by the accepting means and entering the AF locked state. And a control means for controlling to display the display. A display setting means for setting whether or not to display the second display item in the manual focus (MF) mode;
When the display setting unit is set to display the second display item, the control unit receives the stop instruction by the receiving unit and sets the AF lock state in response to receiving the stop instruction. In place of the display item, control is performed so that the second display item indicating the degree of focus is displayed at a position corresponding to the AF position, and the display setting unit is set to not display the second display item. If it is, the display unit changes the display form of the first display item without displaying the second display item in response to receiving the stop instruction by the receiving unit and setting the AF lock state. The display control device according to claim 1, wherein the display control device is controlled as follows. It further comprises detection means for detecting a specific subject area from the captured image,
The AF position is a position of a specific subject detected by the detection means in an operation mode in which AF is performed on the specific subject area detected by the detection means. The display control apparatus according to 1 or 2 .   The display control apparatus according to claim 3, wherein the specific subject area is a human face. The display form of the first display item differs depending on whether or not it is an operation mode in which AF is performed on the specific subject area detected by the detection means, and the specific subject detected by the detection means 5. The display according to claim 3, wherein the first display item is in a display form representing a subject area detected by the detection unit in an operation mode in which AF is performed on the area. Control device. In the operation mode in which AF is performed on the specific subject area detected by the detection unit, the first display item is a face frame, and AF is performed on the specific subject region detected by the detection unit. The display control apparatus according to claim 5 , wherein the first display item when the operation mode is not an operation mode is an AF frame. In the operation mode in which AF is performed on the specific subject area detected by the detection unit, if a plurality of the specific subject areas are detected, an AF target among the plurality of specific subject areas is detected. the display control device according to any one of claims 3 to 6, further comprising a selection means for selecting in accordance with a region to be a user operation. The control means includes
When the first AF mode is set and a continuous operation is being performed, the AF lock state is switched in response to a specific operation for instructing the stop.
When the first AF mode is set and the AF lock state is set, control is performed so as to release the AF lock state and perform the continuous AF in response to the specific operation being performed.
The display control apparatus according to claim 1, wherein the display control apparatus is a display control apparatus. A mode setting step for setting to a first AF mode for continuously performing autofocus (AF) operation;
When the first AF mode is set and continuous AF is performed, control is performed so that the first display item indicating the AF position, which is the position to be focused by AF, is displayed on the live view. A display control step;
It is set to the first AF mode, receiving step of when you have made continued AF, the continued AF stopped, receives a stop instruction you the AF lock state of fixing the focus position without AF When,
In response to accepting the stop instruction in the accepting step and entering the AF locked state, a second display item indicating the degree of focus at a position corresponding to the AF position instead of the first display item And a control step for controlling to display the display control device. The program for functioning a computer as each means of the display control apparatus as described in any one of Claims 1 thru | or 8 . A computer-readable storage medium storing a program for causing a computer to function as each unit of the display control device according to any one of claims 1 to 8 .

Images