JP2019070822A - Imaging apparatus and control method of the same - Google Patents

Abstract

To provide an imaging apparatus which can accurately focus a subject which a user intends with a simpler operation and to provide a control method of the apparatus.SOLUTION: An imaging apparatus includes: an imaging optical system; an imaging element for acquiring an image of a subject; means for acquiring distance information between the imaging optical system and the subject; means for generating a distance map corresponding to the image on the basis of the distance information; a display section for displaying the image which the imaging element acquires; means for detecting touch operation of a user to the display section which displays the image and detecting a position in the image corresponding to a position which the user touches; and control means constituted to acquire the distance information in the position of the acquired image from the distance map, to set the position in a focus point in accordance with the acquired distance information or to display an enlarged image obtained by cutting a partial region of the image including the position on the display section.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an imaging device and a control method thereof.

  2. Description of the Related Art Conventionally, in an imaging apparatus having a liquid crystal panel with a touch panel mounted, a technique has been proposed in which a focus area (hereinafter also referred to as "AF point" or "focus point") is set by pressing a display screen. Patent Document 1 describes enlarging and displaying a partial area of an acquired image for confirmation of focusing of a set AF point.

JP, 2005-078009, A

  However, when the user designates an AF point on the screen of the imaging device with a finger, the intended subject may not be in focus or a perspective conflict may occur. Further, in the technology described in Patent Document 1, although it is possible to check the in-focus point by enlarging the AF point, if it was not in-focus on the intended part, it was necessary to start again from the entire screen display.

  Further, in recent years, a method of enlarging an image by identifying an operation of spreading two fingers touched by a multi-touch operation has become widespread. However, it is difficult to perform multi-touch operation while holding the imaging device at the time of shooting, and it takes time to set an AF point at a desired subject position.

  An object of the present invention is to provide an imaging apparatus capable of accurately focusing on an object intended by a user with a simpler operation, and a control method thereof.

  According to one aspect of the present invention, an imaging optical system for forming an optical image of a subject, an imaging element for acquiring an image of the subject from the optical image, distance information between the imaging optical system and the subject Means for acquiring, means for generating a distance map corresponding to the image based on the distance information, a display unit for displaying the image acquired by the imaging device, and a user of the display unit displaying the image A means for detecting a touch operation and detecting a position in the image corresponding to a position touched by the user, and acquiring the distance information at the position of the acquired image from the distance map, to the acquired distance information In response, the control unit is configured to set the position as a focus point or display an enlarged image obtained by cutting out a partial area of the image including the position on the display unit. Imaging apparatus is provided, characterized in that it comprises a means.

  Further, according to another aspect of the present invention, an imaging optical system for forming an optical image of a subject, an imaging element for acquiring an image of the subject from the optical image, and the imaging optical system and the subject Control method of an imaging apparatus having: a unit for acquiring distance information of the above; a display unit for displaying the image acquired by the imaging device; and a unit for detecting a user's touch operation on the display unit displaying the image A step of generating a distance map corresponding to the image based on the acquired distance information, a step of displaying the acquired image on the display unit, and a user's touch operation on the display unit. Acquiring a position in the image corresponding to the position touched by the user, and acquiring the distance information at the position of the acquired image from the distance map Setting the position as a focus point in accordance with the acquired distance information, or displaying an enlarged image obtained by cutting out a partial area of the image including the position on the display unit. A control method of an imaging device characterized by the present invention is provided.

  According to the present invention, it is possible to accurately focus on a subject intended by the user with a simpler operation.

It is a block diagram showing composition of an imaging device by a 1st embodiment of the present invention. It is a figure explaining the distance map used in the imaging device by a 1st embodiment of the present invention. It is a flowchart which shows the control method of the imaging device by 1st Embodiment of this invention. It is a figure explaining the selection method of AF point in the control method of the imaging device by a 1st embodiment of the present invention. It is a figure explaining the distance histogram used in the imaging device by 1st Embodiment of this invention. It is a figure explaining the kind of peak pattern of a distance histogram. It is a figure explaining an example of the method of detecting the peak of a distance histogram. It is a figure explaining the expansion process of an image when a distance histogram shows a single peak pattern. It is a figure explaining the expansion process of the image in case a distance histogram shows a several peak pattern. It is a figure explaining the selection method of AF point from the expansion picture in the control method of the imaging device by a 1st embodiment of the present invention. It is a figure explaining the example of generation | occurrence | production of the near-and-far conflict in AF point. It is a schematic diagram of the display screen which shows the control method of the imaging device by 2nd Embodiment of this invention. It is a figure which shows an example of the distance histogram displayed in the control method of the imaging device by 3rd Embodiment of this invention.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

First Embodiment
An imaging apparatus and a driving method thereof according to a first embodiment of the present invention will be described with reference to FIGS.

  FIG. 1 is a block diagram showing a configuration of an imaging device according to the present embodiment. FIG. 2 is a diagram for explaining a distance map used in the imaging device according to the present embodiment. FIG. 3 is a flowchart showing the operation of the imaging device according to the present embodiment. FIG. 4 is a view for explaining the AF point selection method in the control method of the imaging device according to the present embodiment. FIG. 5 is a view for explaining the distance histogram used in the imaging device according to the present embodiment. FIG. 6 is a diagram for explaining types of peak patterns of the distance histogram. FIG. 7 is a diagram for explaining an example of a method of detecting a peak of the distance histogram. FIG. 8 is a diagram for explaining an image enlargement process when the distance histogram indicates a single peak pattern. FIG. 9 is a diagram for explaining an image enlargement process when the distance histogram indicates a plurality of peak patterns. FIG. 10 is a view for explaining a method of selecting an AF point from an enlarged image in the control method of the imaging device according to the present embodiment.

  First, the structure of the imaging device according to the present embodiment will be described with reference to FIG.

  As shown in FIG. 1, the imaging apparatus 10 according to the present embodiment includes an imaging optical system 101, a focus control unit 102, an imaging sensor 103, an image processing unit 104, a distance information generation unit 105, a memory 106, a recording processing unit 107, and a recording unit. A medium 108 and a ROM 109 are included. The imaging device 10 further includes a system control unit 110, a display processing unit 111, a display unit 112, a position detection unit 113, a touch panel 114, and a bus 115.

  The imaging sensor 103 is a solid-state imaging device such as a CMOS sensor, and is for acquiring an image of a subject (hereinafter, also referred to as a “subject image”). A sensor for phase difference detection is embedded in the imaging sensor 103, and distance information between the subject and an object to be photographed can be acquired based on the phase difference signal output from the imaging sensor 103. The imaging optical system 101 is for forming an optical image of a subject on the imaging sensor 103, and has a focus position control mechanism. The focus control unit 102 is for controlling the operation of the focus position control mechanism of the imaging optical system 101.

  The distance information generation unit 105 is for calculating distance information with the subject based on the phase difference signal output from the imaging sensor 103. The calculated distance information of the subject is stored in the memory 106. The image processing unit 104 is for digitizing an image signal output from the imaging sensor 103 and performing predetermined processing. The processed image data is temporarily stored in the memory 106.

  The memory 106 is an internal storage device made of a semiconductor memory such as a DRAM. The memory 106 stores recording data generated by the recording information unit 107, a program for controlling the imaging device 10, and images (characters and icons) displayed on the display unit 112 such as graphical user interface (GUI) data. Ru.

  The recording processing unit 107 reads out the image data and the distance information of the subject stored in the memory 106, converts the information into a predetermined recording format, and writes the information into the recording medium 108. Although the recording medium 108 is not particularly limited, for example, a memory card using a nonvolatile semiconductor memory such as an SD memory card can be applied.

  The system control unit 110 is a control unit (CPU) for controlling the entire imaging device 10. A ROM (Read Only Memory) 109 is for storing control programs, character fonts, icon resource data, and the like.

  The display unit 112 is configured of a display device such as a liquid crystal panel. A touch panel 114 is mounted on the display surface of the display unit 112, for example, a liquid crystal panel. The display processing unit 111 is for performing processing for causing the display unit 112 to display information such as an image, an icon, and a character stored in the memory 106.

  The position detection unit 113 is for detecting a touch operation of the user on the touch panel 114 or a position pressed by the user and outputting the detected position to the system control unit 110.

  The bus 115 is a path for connecting the above-described modules and exchanging data between the modules. The system control unit 110 controls the entire imaging device 10 by transmitting a predetermined control signal to each module via the bus 115.

  Here, before describing the specific operation of the imaging device 10 according to the present embodiment, an example of the distance information generated by the distance information generation unit 105 will be described with reference to FIG.

  FIG. 2A is a schematic view showing the positional relationship between the imaging device 10 and the subjects 210, 211, 212. It is assumed that the distances from the imaging device 10 to the subjects 210, 211, and 212 are distances L1, L2, and L3, respectively.

  As described above, the imaging sensor 103 can acquire phase difference information for AF (Auto Focus) in units of pixels by dividing and capturing the signal of each pixel of the imaging surface. Then, based on the phase difference information acquired from the imaging sensor 103, the distance information generation unit 105 generates, with a predetermined resolution, distance information to the subject being photographed. In addition, since a well-known technique can be applied to generation | occurrence | production of distance information by imaging surface phase difference detection, detailed description is abbreviate | omitted here.

  FIG. 2B is a schematic view of a distance map representing the acquired distance information as two-dimensional image information. In the distance map 215 shown in FIG. 2B, the captured image is divided into 9 × 9 unit areas, and each unit area is divided into different patterns corresponding to the distance to the subject. The distance data 220, 221, 222 is data representing the distance from the subject 210, 211, 212 in FIG. 2A. The right side of FIG. 2B shows the relationship between the pattern of each area in the distance map 215 and the distance from the imaging device to the subject.

  Distance data can be detected in units of pixels of the imaging sensor 103. However, in order to improve the processing performance, for example, in the initial state, a distance map in which one distance data is allocated for each N × N pixels of the imaging sensor 103 can be set to be generated. When the total number of pixels of the imaging sensor 102 is H × V pixels, the resolution of the distance map in the initial state is (H / N) × (V / N). The resolution of the distance map 215 can be changed by the setting of the system control unit 110.

  Note that the format of the distance data shown on the distance map 215 is not limited to the above example, and data of any format may be used as long as the data indicates the distance between the imaging device 10 and the subject. Is possible.

  The distance map data generated by the distance information generation unit 105 is temporarily stored in a predetermined area of the memory 106. Then, under the control of the system control unit 110, the recording processing unit 107 converts the image data stored in the memory 106 into a predetermined recording format and records the image data in the recording medium 108. The image data and the distance map data are generated based on signals at the same timing in the imaging sensor 103.

  Next, the operation of the imaging device according to the present embodiment will be described using FIG. 3 to FIG.

  The imaging device 10 according to the present embodiment can be controlled, for example, according to the flowchart shown in FIG.

  First, in step S301, power is turned on via the operation unit (not shown), and the operation of the imaging device 10 is started.

  Next, in step S302, the image of the subject being imaged which is incident on the imaging sensor 103 via the imaging optical system 101 is converted into an electrical signal in the imaging sensor 103 and input to the image processing unit 104. The image processing unit 104 applies predetermined image processing to the image data, and the processed image data is stored in the memory 106. The image data stored in the memory 106 is read by the display processing unit 111 and displayed on the display unit 112.

  Further, a focus detection signal for AF (the above-described phase difference information) is also output from the imaging sensor 103, and is input to the distance information generation unit 105. The distance information generation unit 105 generates a distance map based on the focus detection signal, and stores the distance map in the memory 106.

  Next, in step S303, when a touch operation by the user's finger or the like on the touch panel 114 is detected, the touch panel 114 outputs a signal corresponding to the operation to the position detection unit 113. As a signal which touch panel 114 outputs, a signal which shows a pressing state of a finger, a signal which shows the position when it is pressed, etc. are mentioned.

  The position detection unit 113 receives, from the touch panel 114, a signal corresponding to the pressing at a predetermined sampling rate. Then, data indicating a two-dimensional position on the screen of the display unit 112 is output to the system control unit 110 when the touch panel 114 is pressed or when the touch panel 114 is pressed.

  The system control unit 110 detects an operation state of the finger on the touch panel based on the data received from the position detection unit 113. As the operation state of the finger, a state in which the finger touches the touch panel 114 (hereinafter referred to as “press”), a state in which the finger is released from the touch panel 114 (hereinafter referred to as “unpress”), A state (hereinafter, referred to as "move") and the like can be mentioned.

  If the system control unit 110 determines that the operation state is "press", the process proceeds to step S304. On the other hand, when the operation state is not "press", the next data from the position detection unit 113 is waited in step S303.

  In step S304, the system control unit 110 determines whether the operation state of the finger is "move" based on the data received from the position detection unit 113. As a result, when it is determined that the operation state of the finger is "move", the process proceeds to step S307.

  In step S307, the system control unit 110 determines whether the subject image displayed on the display unit 112 is in the enlargement display state. Note that the enlarged display state is a state when a partial area of the subject image is enlarged and displayed in step S308 described later. As a result, when it is determined that the enlarged display state is set, the enlarged display image is moved according to the moved amount and direction of movement. On the other hand, when it is determined that the subject image displayed on the display unit 112 is not in the enlarged display state, the state as it is is held, and the process returns to step S302.

  In step S304, when it is determined by the system control unit 110 that the operation state of the finger is not "move", the process proceeds to step S305.

  In step S305, analysis of distance map data generated by the distance information generation unit 105 and stored in the memory 106 is performed. An analysis method of distance map data in step S305 will be described with reference to FIGS. 4 and 5.

  As shown in FIG. 4A, it is assumed that subjects 403, 404, and 405 are included in the screen (subject image 401) being displayed on the display unit 112. It is assumed that the distance map corresponding to the subject image 401 is the distance map 402 shown in FIG. In the distance map 402, the distance data 406, 407, and 408 represent the distances to the objects 403, 404, and 405, respectively.

  When the user's finger 409 presses the touch panel 114 mounted on the display unit 112 displaying the subject image 401, the system control unit 110 is pressed on the subject image 401 via the touch panel 114 and the position detection unit 113. Detect the position where the For example, in the subject image 401 of FIG. 4A, it is assumed that the point A is a detected press position (hereinafter referred to as “press position A”).

  The system control unit 110 sets a predetermined area P around the press position A. The area on the distance map 402 corresponding to the area P is the area 421 in FIG. In the example of FIG. 4B, 25 unit areas are included in the area 421, and each unit area is associated with distance data representing distance information to the subject image.

  The system control unit 110 analyzes the distance data in the area 421 and generates a distance histogram as shown in FIG. That is, the system control unit 110 counts the number of unit areas in each of the plurality of unit areas in the area 421 for each distance represented by the distance data, and increases the number of unit areas for each distance from the minimum value of the distance to the maximum value. Line up. For example, for the area 421 in FIG. 4B, the number of unit areas corresponding to each distance is as shown in Table 1, and when this is graphed, the distance histogram shown in FIG. 5 is obtained.

  Next, in step S306, the system control unit 110 determines whether the focus point (AF point) can be determined based on the generated distance histogram.

  First, the system control unit 110 classifies distance data into three distance patterns based on the generated distance histogram. In the three distance patterns, the first is a single peak pattern, the second is a multiple peak pattern, and the third is a single distance pattern.

  These three distance patterns will be described with reference to FIG. FIG. 6 (a) is a schematic view of a distance histogram of a single peak pattern. As shown in FIG. 6A, the single peak pattern has a data section indicating a single peak, and the ratio of the frequency of the data section indicating a single peak to the total number of data is less than or equal to a predetermined value. is there. That is, in this case, a considerable number of distance data other than a single peak is also included. FIG. 6B is a schematic view of a distance histogram of a plurality of peak patterns. The multiple peak pattern is a case where there are multiple data sections showing peaks, as shown in FIG. 6 (b). FIG. 6C is a schematic view of a distance histogram of a single distance pattern. The single distance pattern has a data section indicating a single peak, and the ratio of the frequency of the data section indicating a single peak to the total number of data is a predetermined value or more. That is, distance data other than a single peak is a small number of cases.

  For example, the following method can be used for peak detection in the distance histogram. However, the method of peak detection is not limited to the following method, and other known methods can also be used.

  First, the system control unit 110 calculates the average value of the frequencies in the distance histogram. For example, in the distance histogram of FIG. 7, it is assumed that the frequency M is an average value. Next, the difference between the frequency of each distance and the average value M is calculated. And when the difference is more than predetermined value, the distance is detected as a peak. For example, in the example of FIG. 7, when the average frequency M and the predetermined value D of the difference are as illustrated, a distance (3 m to 4 m) having a frequency of (M + D) or more is detected as a peak.

  If a single distance pattern is detected as a result of peak detection in this way, it is determined that the AF point is determined, and the system control unit 110 sends distance information of the data section corresponding to the detected peak to the system control unit 110. It preserve | saves and transfers to step S309.

  On the other hand, when a single peak pattern or a plurality of peak patterns are detected, the system control unit 110 determines that the AF point is not determined, and proceeds to step S308. In step S308, in order to confirm the AF point, a process for enlarging and redisplaying a part of the image is performed.

  A process when it is determined as a single peak pattern as a result of peak detection in step S306 will be described using the schematic diagram of FIG. FIG. 8 (a) is a schematic view of a distance map, and FIG. 8 (b) is a distance histogram generated based on the distance map of FIG. 8 (a).

  In the distance map 600 of FIG. 8A, an area 602 is an area set by the system control unit 110 centering on a point pressed by the user when selecting an AF point. FIG. 8B is a distance histogram generated by the system control unit 110 based on distance data of unit areas in the area 602.

  As a result of detecting the above-mentioned peak pattern in the system control unit 110 using the distance histogram of FIG. 8B, it is assumed that the single peak pattern having the peak 601 is detected.

  When a single peak 601 is detected, the system control unit 110 extracts a unit area indicating a data section (3 m-4 m) corresponding to the peak 601 from the distance map 600, and the position of the center of gravity of the extracted unit area calculate. Then, the system control unit 110 sets a cutout region around the calculated position of the center of gravity. At this time, the cutout size is calculated so that the ratio occupied in the cutout area of the unit area indicating the distance information corresponding to the data section of the peak 601 becomes a predetermined value, for example, about 50%. In the example of FIG. 8A, it is assumed that the area 603 indicated by a dotted line is set by the system control unit 110 as a cutout area.

  A process in the case where it is determined as a plurality of peak patterns as a result of peak detection in step S306 will be described using the schematic diagram of FIG. FIG. 9A is a schematic diagram of distance map data, and FIG. 9B is a distance histogram generated based on the distance map data of FIG. 9A.

  FIG. 9A is a distance map 402 corresponding to the image 401 being photographed shown in FIG. 4A, and an area 421 is an area set by the system control unit 110 corresponding to the press position A. FIG. 9B is a distance histogram generated by the system control unit 110 based on distance data of unit areas in the area 421. The distance histogram of FIG. 9B is classified into a plurality of peak patterns having a plurality of peaks 701 and 702.

  When a plurality of peak patterns are detected, in system control section 110, a unit area indicating a data section (1 m-2 m) corresponding to peak 701 and a data section (3 m-4 m) corresponding to peak 702 is Extract. Then, in the system area 110, the position of the center of gravity of the extracted unit area is calculated, and the cutout area is set around the position of the calculated center of gravity. At this time, the cutout size is calculated so that the ratio occupied in the cutout area of the unit area indicating the distance information corresponding to the data section of the peaks 701 and 702 becomes a predetermined value, for example, about 50%. In the example of FIG. 9A, it is assumed that the area 704 indicated by a dotted line is set by the system control unit 110 as a cutout area.

  After the cutout region is set in this manner, the process returns to step S302, and the display of the enlarged image is performed. That is, the system control unit 110 instructs the display processing unit 111 to read out data corresponding to the cutout area from the image being captured stored in the memory 106 and to perform enlargement processing. The display processing unit 111 enlarges the data read from the memory 106 and outputs the data to the display unit 112. As a result, a part of the image being photographed corresponding to the area 603 is enlarged and displayed on the display unit 112.

  A step of the user expanding a desired position to a desired size by pinching out on the screen or the like by automatically determining whether to determine the AF point or display the enlarged image according to the peak pattern of the distance histogram Can be omitted. In particular, the operation of performing pinch-out or the like while holding the imaging apparatus is complicated and time-consuming, so the method of the present embodiment is extremely useful.

  FIG. 10A is an enlarged image in the case where it is determined that there are a plurality of peak patterns, and an image corresponding to the region 704 in FIG. 9A is enlarged. The magnified image 801 includes a subject 802 and a subject 804.

  After the enlarged image is displayed on the display unit 112 in step S302, the above-described processing is performed on the enlarged image in the subsequent steps. That is, when the user touches the subject 802 with the finger on the enlarged image 801, touch panel depression is detected in step S303. Next, in step S304, the system control unit 110 detects whether it is a move operation. Next, in step S305, analysis of distance map data of the pressed area is performed.

  In the example of FIG. 10A, the distance map corresponding to the area 803 is to be analyzed. FIG. 10B shows a schematic view of the distance histogram detected in the area 803.

  In step S306, the system control unit 110 analyzes the peak pattern of the distance histogram detected in the area 803. The distance histogram in FIG. 10B has a single peak, and since the ratio of the frequency of the peak distance to the total number of data is equal to or greater than a predetermined number, it is determined to be a single distance pattern. Can be determined as substantially the same distance. As a result, the system control unit 110 determines that the AF point is determined, stores the distance information of the peak, and shifts to step S309.

  When enlarging and displaying the image of the area set in step S308, it is desirable to obtain and display an image for which focus control has been performed so as to focus on the enlarged subject. For example, in the case of a single peak pattern, by performing focus control in accordance with the distance of the peak of the distance histogram, the subject positioned at the distance of the peak when enlarged display can be brought into a focused state. In the case of a multiple peak pattern, by focusing on the distance of the largest frequency among the multiple peaks, an image in which the subject located at the distance of the peak of the largest frequency is in focus when enlarged display Become. This makes it possible to improve the visibility when selecting an AF point in the enlarged image.

  Next, in step S309, the system control unit 110 instructs the focus control unit 102 to perform focus control using the stored distance information of the peaks. The focus control unit 102 controls the imaging optical system 101 so as to focus at the designated distance. As a result, an image in which the subject in the peak area is in focus can be acquired and displayed on the display unit 112.

  As described above, in the image pickup apparatus according to the present embodiment, when a subject region to be focused is selected by the touch panel operation, the AF point is automatically enlarged to an appropriate size based on the distance data map. Can be set. As a result, an imaging device with excellent convenience and usability can be realized.

Second Embodiment
An imaging apparatus and a method of driving the same according to a second embodiment of the present invention will be described with reference to FIGS. 11 and 12. The same members of the present embodiment as those of the imaging device according to the first embodiment shown in FIGS. 1 to 10 are represented by the same reference numbers not to repeat or to simplify their explanation.

  FIG. 11 is a diagram for explaining an example of occurrence of near and far conflict at an AF point. FIG. 12 is a schematic view of a display screen showing a control method of the imaging device according to the second embodiment of the present invention.

  The control method of the image pickup apparatus according to the present embodiment corresponds to the case where it is difficult to select the AF point even in the image which is enlarged and displayed in the method of driving the image pickup apparatus according to the first embodiment. Hereinafter, characteristic parts of the driving method of the imaging device according to the present embodiment will be described with reference to the drawings.

  FIG. 11 (a) is a schematic view showing an example of an enlarged image, and FIG. 11 (b) is a schematic view showing an example of a distance histogram used when generating the enlarged image of FIG. 11 (a). is there.

  In FIG. 11A, four belt-like regions 1102 with dense hatching are objects corresponding to the peaks located in the data section (2 m-3 m) of the distance histogram of FIG. Do. In addition, it is assumed that four band-like regions 1103 with sparse hatching correspond to the peaks located in the data section (4 m to 5 m) of the distance histogram of FIG. In such a case, even if the magnified image 1101 is pressed with a finger to set an AF point, either the region 1102 or the region 1103 is selected and pressed accurately because the regions 1102 and 1103 are thin and adjacent to each other. Things are difficult.

  Therefore, in the imaging apparatus according to the present embodiment, a GUI is displayed on the operation unit or display unit 112 (not shown) so that the user can switch the display mode.

  For example, when the system control unit 110 detects the operation of the operation unit or the touch panel 114 and further detects that the operation is the operation of the display mode switching button, the display of the display unit 112 is displayed on the screen 1201 of FIG. Change to a similar configuration.

  The screen 1201 includes a magnified image 1202 and a distance histogram 1203. The magnified image 1202 is the magnified image (corresponding to the magnified image 801) described in the first embodiment, and is generated by the display processing unit 111. The distance histogram 1203 is a distance histogram that is the basis of the enlarged image. The system control unit 110 calculates distance histogram data, generates GUI data as shown in FIG. 12 using the calculated distance histogram data, and stores the GUI data in the memory 106. The display processing unit 111 reads GUI data stored in the memory 106 and displays the data on the display unit 112.

  The user can select a subject by pressing the distance histogram 1203 instead of the enlarged image 1202. For example, when it is intended to select the subject in the area 1102 as the AF point, the data section 1204 of the distance histogram 1203 corresponding to the area 1102 is pressed. By doing this, a desired subject can be easily selected as an AF point. The detection of the press position and the like are the same as in the first embodiment, and thus the description thereof is omitted here.

  As shown in FIG. 12, the color or pattern may be changed for each data section of the distance histogram 1203, and the same color or pattern may be attached to the object located at the distance corresponding to each data section. By doing this, the relationship between the data section of the distance histogram 1203 and the subject of the enlarged image can be clarified, and the user can easily specify the data section corresponding to the desired subject.

  As described above, according to the present embodiment, it is possible to easily select a desired subject as the AF point even when the near and far conflict occurs in the focus area selected by the user.

Third Embodiment
An imaging apparatus and a method of driving the same according to a third embodiment of the present invention will be described with reference to FIG. The same members of the present embodiment as those of the imaging device and the driving method according to the first and the second embodiments shown in FIGS. 1 to 12 are represented by the same reference numbers not to repeat or to simplify their explanation.

  FIG. 13 is a diagram showing an example of the distance histogram displayed in the control method of the imaging device according to the present embodiment.

  The driving method of the imaging apparatus according to the present embodiment copes with focusing with higher accuracy by improving the accuracy of the distance map data in stages.

  In the method of driving the imaging apparatus according to the second embodiment, the display unit 112 displays a GUI including, for example, an enlarged image 801 shown in FIG. 10A and a distance histogram (FIG. 13A) based thereon. It shall have been done.

  In this case, according to the method of driving the imaging device according to the second embodiment, the user selects the data section corresponding to the distance (1 m-2 m) as the AF point, but the AF point based on the higher precision distance range It is also assumed that the user desires the setting of. Therefore, in the method of driving an imaging device according to the present embodiment, focusing can be performed with higher accuracy by performing the following processing.

  When detecting that the enlarged image 801 has been pressed, the system control unit 110 displays the distance histogram of FIG. 13A as a GUI and measures an elapsed time from the start of the press.

  If a data section having a distance histogram displayed as a GUI is pressed before the elapsed time from the press of the enlarged image 801 reaches a predetermined time, the processing is continued according to the driving method of the second embodiment.

  If the press on the distance histogram is not detected before the elapsed time from the press on the enlarged image 801 exceeds the predetermined time, the system control unit 110 instructs the distance information generation unit 105 to use a unit of distance information to be generated. Instructs you to set in fine units. The distance information generation unit 105 regenerates the distance map data according to the newly set unit. Then, the system control unit 110 generates a distance histogram in which the resolution of the data section is increased based on the regenerated distance map data.

  FIG. 13B is an example of the regenerated distance histogram. In the distance histogram of FIG. 13 (a), the data section is divided by 1 m, but in the distance histogram of FIG. 13 (b), the data section is divided by 0.2 m, and the accuracy is 5 times. There is.

  The display histogram is displayed on the display unit 112 as a GUI by the display processing unit 111. Then, when the user presses a specific data section of the displayed distance histogram with a finger, it is possible to focus on a desired point of the subject.

  Thus, according to the present embodiment, it is possible to set an AF point on a desired subject with higher accuracy.

[Modified embodiment]
The present invention is not limited to the above embodiment, and various modifications are possible.
For example, the configuration of the imaging device according to the first embodiment is an example, and the imaging device to which the present invention can be applied is not limited to the configuration shown in FIG.

  In addition, each step in the control method of the imaging device shown in the above-described embodiment realizes the function by reading a program for realizing them from the memory and executing it by the CPU of the system control unit 110. All or part of the functions of each step may be realized by dedicated hardware.

  The memory described above may be a non-volatile memory such as a magneto-optical disk device or a flash memory, a storage medium such as a CD-ROM which can only read data, or a volatile memory other than a RAM. Also, the present invention may be configured from a computer readable and writable storage medium by a combination thereof.

  In addition, a program that implements one or more functions of the above-described embodiments is supplied to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. But it is possible. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

  For example, a program for realizing the above steps may be recorded in a computer readable storage medium, and the computer system may read and execute the program recorded in the storage medium to perform each process. Here, the “computer system” includes an OS and hardware such as peripheral devices. Specifically, the program read from the storage medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program, the CPU provided in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing of the above-described embodiment is realized.

  Further, the "computer-readable storage medium" refers to a storage device such as a flexible disk, a magneto-optical disk, a ROM, a portable medium such as a ROM or a CD-ROM, or a hard disk built in a computer system. Furthermore, the "computer-readable storage medium" also includes one that holds a program for a certain period of time. For example, it also includes volatile memory (RAM) in a computer system serving as a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. These are storage media that hold programs for a fixed time.

  The program may be transmitted from a computer system in which the program is stored in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. Here, the “transmission medium” for transmitting the program is a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.

  Further, the program may be for realizing a part of the functions described above. Furthermore, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

  A program product such as a computer readable recording medium having the above program recorded thereon can also be applied as an embodiment of the present invention. The above program, recording medium, transmission medium and program product are included in the scope of the present invention.

  The above-described embodiments are merely examples of implementation for carrying out the present invention, and the technical scope of the present invention should not be interpreted in a limited manner by these. That is, the present invention can be implemented in various forms without departing from the technical concept or the main features thereof.

101 ... imaging optical system 102 ... focus control unit 103 ... imaging sensor 104 ... image processing unit 105 ... distance information generation unit 106 ... memory 107 ... recording processing unit 108 ... .Recording medium 109 ... ROM
110: System control unit 111: Display processing unit 112: Display unit 113: Position detection unit 114: Touch panel

Claims (9)

Acquisition means for acquiring an image of a subject taken by an imaging device and map information corresponding to distance information between the imaging device and the subject;
Generation means for generating a distance histogram based on the map information;
Display control means for displaying the image and the distance histogram corresponding to the image on a display unit;
A detection unit that detects a touch operation by the user on the distance histogram displayed on the display unit;
An setting unit configured to set, as a focus area, an area indicating the distance information corresponding to a data section of the distance histogram touched by the user in the image. The information processing apparatus according to claim 1, wherein the display control means simultaneously displays the image and the distance histogram on the display unit. The information processing apparatus according to claim 1, wherein the display control unit displays the distance histogram in which each of the data sections is represented differently. The display control means displays the distance histogram represented by different colors or patterns for each data section;
The information according to claim 1, wherein the display control means displays the subject at a distance corresponding to each of the data sections of the image with the same color or pattern as that of the data sections. Processing unit. The information processing apparatus according to claim 1, wherein the display control means displays the distance histogram provided with a different GUI for each data section. The information processing apparatus according to claim 1, wherein the setting unit automatically sets the focus area based on a distribution of the distance histogram generated by the generation unit. The information processing apparatus according to claim 1, wherein the generation unit generates a plurality of distance histograms having different resolutions. The apparatus further includes a focus control unit that controls an operation of a focus position control mechanism of an imaging optical system for forming an optical image of the subject on the imaging device based on the focus area set by the setting unit. The information processing apparatus according to claim 1, wherein Acquiring an image of a subject captured by an imaging device, and map information corresponding to distance information between the imaging device and the subject;
Generating a distance histogram based on the map information;
Displaying the image and the distance histogram corresponding to the image on a display unit;
Detecting a touch operation by the user on the distance histogram displayed on the display unit;
Setting an area indicating the distance information corresponding to a data section of the distance histogram touched by the user in the image as a focus area.

Images