JP5215427B2 - Information processing apparatus, information processing method, program, and recording medium - Google Patents

Description

The present invention provides an information processing apparatus and an information processing method capable of automatically detecting a feature portion of a subject and displaying an image of an area that is automatically focused or an area that is in focus at a focus point that is disposed at a fixed position. The present invention relates to a program and a recording medium .

  2. Description of the Related Art Conventionally, a technique for confirming a focus area of an image by displaying focus information included in an image photographed with a digital camera together with the image is known. In addition, a function of cutting out and enlarging an image around a focus area set by focus information is known. A method has been proposed in which such a technique or function is used to identify a characteristic portion of a person and confirm the in-focus state according to the identification result (see Patent Document 1). In Patent Document 1, there is an effect of detecting the characteristic portion of the subject by analyzing the image data. In addition, there is an effect that the image of the detection range is cut out and the image of the entire angle of view and the image of the detection range are displayed to check the focus.

JP 2005-323015 A

  However, the technique described in Patent Document 1 requires a digital camera having a function of detecting a characteristic part of a subject, and this function is applied to a digital camera having a function of focusing on a focus point placed at a fixed position. In this case, the number of parts increases and the cost increases.

  Also, use a PC to check images taken with a digital camera that automatically detects and automatically focuses on the subject's features, and a digital camera that has the function to focus on a focus point placed at a fixed position. In this case, it is not possible to display an enlarged image of an area that is automatically focused or that includes a focus point that is in focus.

The present invention has been made in view of the above problems, and in an image taken by an imaging apparatus having a function of focusing on a plurality of focus points arranged at a plurality of fixed positions, the focus point in focus is set. by calculating and displaying a pseudo-focus region using, whereas, in the image captured by the imaging apparatus having the function of focusing automatically detect characteristic portion of the object, the automatic discovery focused regions by displaying, and to provide an information processing apparatus which can confirm the image of the portion even focus matches either readily, information processing method, program, and storage medium.

In order to achieve the above object, an information processing apparatus according to claim 1 has a function of photographing a subject by focusing on one or a plurality of focus points among a plurality of focus points arranged at a plurality of fixed positions. The display unit displays the first image input by the imaging apparatus, and the second image input by the imaging apparatus having a function of capturing the subject by automatically detecting and focusing the characteristic portion of the subject. an information processing apparatus for displaying a reading means for reading and said second image and the first image from the storage device, by analyzing the shooting information added to the read image by said reading means, Information for identifying focus points arranged at a plurality of fixed positions and information indicating focus match / mismatch for each of the plurality of focus points Determining bets to be the first image an image capturing information is added containing, and determines that the image capturing information including information on one or more of the focus area is added as a second image A determination unit that detects, when the determination unit determines that the image is the first image, a detection unit that detects one or a plurality of focus points in focus from the first image read by the reading unit; According to the arrangement position and the number of one or more focus points detected by the detection means, a calculation means for calculating a focus area including the one or more focus points, and a first image by the determination means If it is determined that there is at least a part of the reduced image of the first image read by the reading unit and the focus calculated by the calculating unit Performs control to display an image of the range and a large display image from the display magnification the first reduced image on a display area of the display device, and was determined to be the second image by said determining means In this case, at least a part of the reduced image of the second image read by the reading unit and an image in a focus area specified from the shooting information added to the second image, and a display magnification from the reduced image Display control means for performing control to display a large display image on the display area of the display device.

In order to achieve the above object, the information processing method according to claim 3 has a function of photographing a subject by focusing on one or a plurality of focus points among a plurality of focus points arranged at a plurality of fixed positions. The display unit displays the first image input by the imaging apparatus, and the second image input by the imaging apparatus having a function of capturing the subject by automatically detecting and focusing the characteristic portion of the subject. an information processing method in an information processing device for displaying, analyzing and reading step of reading said first image from the storage device and the second image, the shooting information added to image read by said reading step Information for identifying focus points placed at a plurality of fixed positions and each of the plurality of focus points The image capturing information including information indicating a match / mismatch of cement is added is determined that the said first image, and the image capturing information including information on one or more of the focus areas are added A determination step for determining that the image is a second image, and one or a plurality of focuses that are in focus from the first image read by the reading step when the determination step determines that the image is the first image A detection step for detecting a point; a calculation step for calculating a focus region including the one or more focus points according to the arrangement position and number of the one or more focus points detected by the detection step; Reduction of the first image read by the reading step when it is determined by the determining step that the image is the first image There line control to display on a display area of the display device and a large display image of at least a portion with an image the first display magnification from the reduced image of the focus area calculated by said calculation step of the image, and , wherein when it is determined that the second image by the determination step, identified from at least a portion photographing information such is added to the second image of the reduced image of the second image read by said reading step And a display control step for performing control to display a display image having a display magnification larger than that of the reduced image on the display area of the display device.

To achieve the above object, the program according to claim 4 is input by an imaging apparatus having a function of photographing a subject by focusing on one or a plurality of focus points among a plurality of focus points arranged at fixed positions. The displayed first image is displayed on the display device, and the second image input by the imaging device having a function of photographing the subject is displayed on the display device by automatically detecting and focusing the characteristic portion of the subject. a program executable in an information processing apparatus, reading means for reading and said second image and the first image from the storage device, by analyzing the imaging information added to the read image by said reading means To pinpoint information for identifying the focus points to be placed at a plurality of fixed positions and each of the plurality of focus points. Determining an image capturing information is added containing information indicating the match / mismatch between a said first image, and the image capturing information including information on one or more of the focus area is added first Determining means for determining that the image is a second image; if the determining means determines that the image is the first image, one or more focus points in focus from the first image read by the reading means are selected; Detecting means for detecting, calculating means for calculating a focus area including the one or more focus points according to the arrangement position and number of the one or more focus points detected by the detecting means, and the determining means When it is determined that the image is the first image, at least a part of the reduced image of the first image read by the reading unit and the calculation unit. The image of the calculated focus region and a large display image of the first display magnification from the reduced image of the performed control to display on a display area of the display device, and is the second image by said determining means In the case where it is determined that the reduced image of the second image read by the reading means and an image of the focus area specified from the shooting information added to the second image, the reduced image The information processing apparatus is caused to function as a display control unit that performs control to display a display image having a display magnification larger than that of an image in a display area of the display device.

According to the present invention, a pseudo focus area is calculated using an in-focus focus point in an image shot by an imaging device having a function of focusing on focus points arranged at a plurality of fixed positions. On the other hand, in an image captured by a photographing device having a function of automatically detecting and focusing on a characteristic part of a subject, the automatically detected focus area is displayed. It is possible to easily check the image of the part in focus.

It is a block diagram which shows schematic structure of the information processing apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the flow of the image reproduction operation | movement process performed with PC. It is a figure which shows the focus area or focus point of an image, (a) is a focus area when one subject is image | photographed with the digital camera of the 1st format, (b) is 2 people with the digital camera of the 1st format. (C) is the focus point when one subject is photographed with the second type digital camera, and (d) is the two subjects with the second type digital camera. Indicates the focus point when was photographed. It is a figure which shows an example of the screen displayed with PC or a digital camera, (a) is a display screen of an image when one subject is image | photographed with the digital camera of a 1st format, (b) is a 1st format. (C) is an image display screen when one subject is photographed with a digital camera of the second format, and (d) is a first screen. An image display screen when two subjects are photographed by a two-format digital camera is shown. FIG. 7 is a diagram illustrating an example of a display screen when a plurality of images are cut out according to a plurality of focus areas or pseudo focus areas and each is enlarged and displayed in parallel in a PC or a digital camera. In the case of the focus area, (b) is a case of a plurality of pseudo focus areas. It is a flowchart which shows the flow of the focus confirmation display process performed with PC. It is a figure which shows the format of image data, (a) is the image data image | photographed with the digital camera of the 1st format, (b) is the image data image | photographed with the digital camera of the 2nd format. It is a flowchart which shows the detail of the focus information determination process performed with PC. It is a flowchart which shows the detail of the automatic focus confirmation display process performed with PC or a digital camera. It is a flowchart which shows the automatic focus confirmation parallel display process performed with PC or a digital camera. It is a flowchart which shows the detail of the fixed position focus confirmation display process performed with PC or a digital camera. FIG. 7 is a diagram illustrating an example of an image display screen on which a focus point is displayed based on focus information added to image data in a PC or a digital camera, where (a) is an image obtained by photographing one subject; d) shows an image in which two subjects are photographed. It is a flowchart which shows the fixed position focus confirmation parallel display process performed with PC or a digital camera. It is a flowchart which shows the detail of the pseudo focus area calculation process performed with PC or a digital camera. It is a figure which shows an example of the image image | photographed with the digital camera of the 2nd format, (a) is an image in which focus is not in all of several focus points, (b) is in focus at all of several focus points. Are images that match. It is a figure which shows an example of the display screen when the image image | photographed with the digital camera of the 2nd format is enlarged and displayed by the image reproduction process, (a) is an image in which focus is not in all of several focus points. , (B) are images in which the focus is the same at all of the plurality of focus points. In an image shot with a digital camera horizontally or vertically, an image that is cut out and enlarged according to the pseudo focus area and the pseudo focus area when multiple focus points with the same focus are aligned vertically or horizontally It is a figure which shows the area to display. It is an enlarged view of the whole image arrange | positioned at each upper left part of the image shown to Fig.17 (a)-FIG.17 (d). (A) is a schematic diagram illustrating a method of calculating a pseudo focus area when two focus points that are in focus are lined up in the vertical direction when the second type digital camera is photographed horizontally, and (b) FIG. 4 is a schematic diagram illustrating a method for calculating a pseudo focus area when a second type digital camera is photographed sideways and focus points that are in focus are arranged in a substantially horizontal direction. (A) is a schematic diagram showing a method of calculating a pseudo focus area when two digital focus points are photographed vertically with two focus points aligned side by side in the vertical direction, and (b) FIG. 5 is a schematic diagram illustrating a method of calculating a pseudo focus area when two digital focus points are photographed with a second-type digital camera vertically and two focus points that are in focus are arranged in the horizontal direction. (A) is a schematic diagram showing a pseudo focus area and an area for displaying a cut-out image when the digital camera of the second format is photographed sideways and there is only one point where the focus is matched, It is the schematic which shows the area which displays the cut-out image and the pseudo focus area when it image | photographs with two types of digital cameras sideways, and there is only the location where the focus was in agreement. (A) is a schematic diagram showing a method for calculating a pseudo focus area when there is only one point in focus in an image taken with a digital camera of the second format sideways, and (b) is a second format. It is the schematic which shows the calculation method of a pseudo focus area when only the location where the focus was matched in the image image | photographed vertically with the digital camera of. (A) is a diagram for explaining a method of searching for an adjacent focus position from a point in focus in an image photographed with a digital camera of the second format, and (b) is a digital camera of the second format FIG. 10 is a diagram for explaining a method of searching for an adjacent focus position from a point in focus in an image photographed with the vertical axis. It is a flowchart of the mode selection process performed with PC or a digital camera. It is a flowchart which shows the detail of the image scroll process performed with PC or a digital camera. It is a flowchart which shows the detail of the image expansion / reduction display process performed with PC or a digital camera. It is a block diagram which shows the main functional structures of a digital camera as an example of the imaging device which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the flow of the image reproduction operation | movement process performed with a digital camera. It is a flowchart which shows the flow of the focus confirmation display process performed with a digital camera. It is a figure which shows another example of the calculation method of a pseudo focus area.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing a schematic configuration of an information processing apparatus according to the first embodiment of the present invention.

  The information processing apparatus (hereinafter referred to as “PC”) 500 includes a CPU 501, a RAM 502, a ROM 503, a storage device 504, an input device 505, a display device 506, and a communication I / F 507. The PC 500 can be loaded with the storage medium 510 from the outside. These are connected to each other via a system bus 508.

  The ROM 503 stores a boot program for the PC 500, a BIOS, and the like. The storage device 504 is configured by a hard disk drive or the like, and stores an OS (Operating System), a program for causing the CPU 501 to execute processing to be described later, an image display application to be described later, data, and the like. These are read into the RAM 502 and executed as needed under the control of the CPU 501. The RAM 502 includes a work area for temporarily storing programs and data loaded from the storage device 504, and is used by the CPU 501 to perform various processes.

  The communication I / F 507 is an interface that controls communication with an external device such as the digital camera 509 connected to the PC 500 via the USB cable 511. The storage medium 510 is configured by a memory card such as an SD card that can be attached to and detached from the PC 500 and a compact flash (registered trademark). The input device 505 includes a pointing device, a keyboard, and the like, and inputs various instructions from the user to the CPU 501. The display device 506 is configured by a CRT, a liquid crystal display, or the like. The CPU 501 performs display control of the display device 506, and displays, for example, windows and buttons for displaying images, icons, messages, menus, and other user interface information.

  In the PC 500, image data captured by the digital camera is taken into the RAM 502 from the storage medium 510 by communicating with the digital camera 509 via a USB cable or the like. The image data to be imported into the PC 500 is arranged at a fixed position or a digital camera having a function of automatically detecting and automatically focusing a characteristic part of a subject (for example, a human face). Image data captured by a digital camera having a function of focusing on the focused point (hereinafter abbreviated as “second-type digital camera”). The image information is added to these image data on the digital camera side. The shooting information includes shooting date and time, a reduced image (thumbnail image), focus information, and the like added to the image data in a predetermined format, as shown in FIGS. 7A and 7B. FIG. 7A shows a format of image data shot with the first format digital camera, and FIG. 7B shows a format of image data shot with the second format digital camera. Thus, the focus information added to the image data by the first format digital camera and the focus information added by the second format digital camera have slightly different contents.

  In FIG. 7A, a focus registration number Z001 and focus information Z002 are stored in a shooting information area of image data (file name: IMG — 0001.jpg) shot with a digital camera of the first format. The focus information Z002 is composed of the position (coordinate position) and size (width and height) of each focus area as coordinate information. An original image is stored in the image data area.

  In FIG. 7B, the number Z100 of fixed position focus positions and the focus information Z101 are stored in the shooting information area of the image data (file name: IMG — 0002.jpg) shot by the second format digital camera. Yes. The focus information Z101 is composed of a coordinate position (x, y), a size (w, h), and focus information (focus match / mismatch) regarding each focus point (focus position). An original image is stored in the image data area.

  Returning to FIG. 1, the image data is compressed in a predetermined compression format, for example, the JPEG method, but is not limited to this. The storage device 504 stores software for compression / decompression, and performs compression of image data including shooting information captured in the RAM 502 and decompression of the compressed image data.

  In the PC 500, images captured by the first format digital camera and the second format digital camera can be captured and displayed on the display device 506 by an image display application. Then, the focus information added to the image data can be used to confirm the focus of the subject on the displayed screen.

  Next, an image reproduction operation for displaying the entire image and an enlarged image around the position where the subject is in focus using the focus information added to the image data in the PC 500 will be described.

  FIG. 2 is a flowchart showing the flow of image reproduction operation processing executed by the PC 500 of FIG. This process is executed based on a program (image display application) read by the CPU 501 from the storage device 504 or the like.

  First, in step S201, the CPU 501 determines whether an image playback mode is set. The image reproduction mode is a mode in which an image with focus information added is displayed on the display device 506 of the PC 500 by a predetermined display method. The image playback mode is set by selecting a mode from the menu screen displayed by the image display application in the mode selection process shown in FIG.

  If the image reproduction mode is set as a result of the determination in step S201, the CPU 501 reads image data from the storage medium 510 or the digital camera 509 (step S202). Next, the CPU 501 determines whether or not the focus confirmation display mode is set (step S203). In the focus confirmation display mode, when displaying an image on the display device 506, an image of a rectangular area including the focus area (or pseudo focus area) of the image is enlarged and displayed based on the focus information added to the image data. This is the mode to be used. The focus confirmation display mode is set by selecting a mode from a menu screen displayed by the image display application. The pseudo focus area is a pseudo focus area obtained on the basis of a focused focus point among a plurality of focus points arranged at a fixed position on an image photographed by a second type digital camera.

  A focus area, a focus point (focus position), and a pseudo focus area in an image shot with a digital camera will be described with reference to FIGS. 3 (a) to 3 (d).

  Reference numerals 701 and 702 denote images taken with a first format digital camera, and reference numerals 703 and 704 denote images taken with a second format digital camera. In the images 703 and 704, nine focus points are arranged at fixed positions.

  The image 701 includes a focus area 711 automatically detected from one subject by the face detection function, and the image 702 includes a plurality of focus areas 721 and 722 detected from the two subjects by the face detection function. Exists. On the other hand, the image 703 includes two focus points 734 and 735 that are in focus among nine focus points 732 arranged at fixed positions from one subject. In the image 704, there are coincident focus points 744, 745, 746, 747 among the nine focus points 743 arranged at fixed positions from two subjects.

  Reference numerals 731, 741, and 742 are pseudo values obtained from focus points that are in focus among focus points arranged at fixed positions, such as focus areas 711, 721, and 722 that are automatically detected from the subject by the face detection function. Focus area.

  Returning to FIG. 2, if the result of determination in step S203 is that the focus confirmation display mode is not set, the CPU 501 displays normal image data (step S205). On the other hand, when the focus confirmation display mode is set, the CPU 501 executes the focus confirmation display process shown in FIG. 6 (step S204). Next, in step S206, the CPU 501 determines whether or not the reproduction has ended. If it has ended, the CPU 501 returns. If not, the process returns to step S202. An example of a screen displayed on the display device 506 by the focus confirmation display process is shown in FIGS. 4 (a) to 4 (d).

  4A to 4D, the screens 801, 802, 803, and 804 display the entire image 701 to 704 and an enlarged image of the image including the focus area or the pseudo focus area. Yes. Reference numeral 811 denotes a reduced image of the entire image, which is arranged in the upper left part of the screen 801. Reference numeral 812 denotes a subject. 813 is an enlarged view of the reduced image 811. Reference numeral 815 denotes a focus area, and reference numeral 814 denotes an enlarged image display area of an image including the focus area 815.

  821 is a reduced image of the entire image, and is arranged at the upper left of the screen 802. 822 is one of the two subjects. Reference numeral 823 is an enlarged view of the reduced image 821. Reference numeral 825 denotes a focus area, and reference numeral 824 denotes an enlarged image display area of an image including the focus area 825.

  In this embodiment, when an image including one of a plurality of focus areas or a pseudo focus area is cut out and enlarged and displayed, the other focus areas (for example, the focus area 826 and the pseudo focus area 846) are Since the image is not cut out and enlarged and displayed, the color of the frame in the focus area is changed. In addition, by not displaying the frame from which the image is cut out as in the area 824, it is possible to determine which area of the image is cut out and enlarged.

  FIG. 6 is a flowchart showing the focus confirmation display process in step S204 of FIG. This process is executed based on a program read by the CPU 501 from the storage device 504 or the like.

  First, in step S301, the CPU 501 determines whether shooting information is added to image data. If shooting information has been added, the process proceeds to step S302. On the other hand, if no shooting information is added, the CPU 501 creates a reduced image from the original image of the image data (step S305). Subsequently, the generated reduced image is displayed on the display device 506 (step S307), and the process returns.

  In step S302, the CPU 501 determines whether or not there is a reduced image (thumbnail image) in the shooting information included in the image data. If there is no reduced image, a reduced image is created from the original image data (step S304), and the process proceeds to step S306. On the other hand, if there is a reduced image, the reduced image is acquired from the shooting information of the image data (step S303), and the process proceeds to step S306.

  In step S306, the CPU 501 displays the created or acquired reduced image on the display device 506. Next, in step S308, the CPU 501 determines whether there is focus information in the image data. If there is no focus information, the process returns. If there is focus information, the process proceeds to step S309.

  In step S309, the CPU 501 acquires focus information from the image data. Next, the CPU 501 performs focus information determination processing for determining whether the acquired focus information is fixed position focus or automatic focus (step S310). Details of this processing will be described later.

  Next, if the result of determination in step S310 is fixed position focus (YES in step S311), the CPU 501 performs fixed position focus confirmation display processing (step S312). Details of this processing will be described later. On the other hand, when the focus is not fixed position, that is, when the focus is automatic (NO in step S311), the CPU 501 performs an automatic focus confirmation display process (step S313). Details of this processing will be described later.

  FIG. 8 is a flowchart showing details of the focus information determination processing in step S310 of FIG. This process is executed based on a program read by the CPU 501 from the storage device 504 or the like.

  In FIG. 8, the CPU 501 has a plurality of focus positions as conditions for fixed position focus (YES in step S401), the focus positions are evenly arranged (YES in step S402), and all focus areas are set. If the same size (YES in step S403) and focus matching (ON / OFF) information exists (YES in step S404), it is determined that the focus is fixed position.

  FIG. 9 is a flowchart showing details of the automatic focus confirmation display process in step S313 of FIG. This process is executed based on a program read by the CPU 501 from the storage device 504 or the like.

  In step S501, the CPU 501 determines whether there are a plurality of pieces of focus information acquired from the image data. If there are more than one, the process proceeds to step S502, and if there are not more than one, the process proceeds to step S503.

  In step S502, the CPU 501 sets the focus area arranged at the upper left of the image to the selected state based on the coordinate information included in the focus information. Here, setting to the selected state means displaying, for example, an image 814 including the focus area 815 shown in FIG. 4A on the reduced image included in the focus information. Note that the order in which the focus area is set to the selected state is not limited to the arrangement position of the focus area on the image, but may be a method based on the area of the focus area.

  Next, in step S504, the CPU 501 displays other focus areas that are not set in the selected state (in the non-selected state) on the reduced image in a rectangular display. For example, as shown in FIG. 4B, a focus area 826 is displayed.

  Next, in step S505, the CPU 501 displays the focus area set in the selected state on the reduced image as a rectangle as shown in FIG. At this time, the rectangular frame surrounding the focus area may be highlighted so as to stand out.

  Next, in step S506, the CPU 501 cuts out an image including the focus area set in the selected state from the original image data, displays the enlarged image on the display device 506 like the screen 801, and displays the upper left of the screen 801. The reduced image 811 of the entire image is superimposed and displayed on the part.

  In step S508, the CPU 501 determines whether there is a plurality of pieces of focus information. On the other hand, if there is a plurality, it is determined whether or not the user has instructed switching of the focus area (step S509). If a switching instruction has been given, the process proceeds to step S507.

  In step S507, the CPU 501 cancels the selected state of the focus area set to the selected state, switches to the next focus area in order from the upper left position, and sets the focus area to the selected state. As described above, in the method based on the area of the focus area, the area size is switched based on the area.

  The case where the image including the focus area set in the selected state is enlarged and displayed has been described. However, when there are a plurality of focus areas, as shown in FIG. Only the included image is enlarged and displayed.

  When there are a plurality of focus areas, as shown in FIG. 5A, a plurality of rectangular areas may be cut out from the image according to the plurality of focus areas, and the images of the rectangular areas may be enlarged and displayed in parallel. Good. By displaying in parallel, the focus of a plurality of subjects can be confirmed at the same time, reducing the operation burden on the user and enabling an efficient focus confirmation operation. When the sizes of the plurality of focus areas are different from each other, the enlargement ratio of the image including each focus area may be adjusted in a timely manner so that the images are displayed in parallel on one screen.

  Next, an automatic focus confirmation parallel display process for cutting out a plurality of images according to a plurality of focus areas and enlarging and displaying each of them in parallel will be described.

  FIG. 10 is a flowchart showing the automatic focus confirmation parallel display processing. This process is a process executed instead of the process of FIG.

  In step S551, the CPU 501 determines whether there are a plurality of pieces of focus information acquired from the image data. If there are more than one, the process proceeds to step S552, and if not, the process proceeds to step S553.

  In step S552, the CPU 501 obtains a display area by dividing the enlarged display area by the number of focus areas. For example, when there are two focus areas, as shown in FIG. 5A, the enlarged display area is divided into two and a display area for displaying two enlarged images converted according to the two focus areas. Ask for. When there are three focus areas, the enlarged display area is divided into three. The number of focus areas is obtained from the value stored in the focus registration number Z001 or the fixed position focus position number Z100 in the photographing information.

  In step S553, the CPU 501 highlights all the focus areas of the reduced image. For example, the focus areas Z22 and Z23 in the reduced image in FIG.

  Next, in step S554, the CPU 501 cuts out each image in accordance with all the focus areas, displays the enlarged image in the enlarged display area, and returns. Here, in order to display the enlarged image of the image including the focus area in the enlarged display area obtained in step S552, the size and arrangement of each enlarged image are adjusted to match the size of the enlarged display area.

  FIG. 11 is a flowchart showing details of the fixed position focus confirmation display process in step S312 of FIG. This process is executed based on a program read by the CPU 501 from the storage device 504 or the like.

  In step S <b> 601, the CPU 501 displays a frame of a focus point (focus position) on the display device 506.

  Next, in step S602, the CPU 501 uses the coordinate position, size, and focus information related to the focus point included in the focus information Z101 in FIG. 7B, and as shown in FIG. The focused focus points 631 and 632 are highlighted on the display screen.

  Next, in step S603, the CPU 501 obtains a pseudo focus area so as to include all of the plurality of focus points that are in focus. By obtaining the pseudo focus area in this way, it is possible to confirm the image of the area in focus as in the case of automatic focusing while detecting the characteristic portion of the subject.

  Next, in step S604, the CPU 501 determines whether there are a plurality of pseudo focus areas calculated in step S603. If there are more than one, the process proceeds to step S605, and if there are not more than one, the process proceeds to step S606.

  In step S605, the CPU 501 sets the pseudo focus area arranged at the upper left of the image in the selected state based on the coordinate information included in the focus information. Here, setting to the selected state means that an image 834 including a pseudo focus area 835 is displayed on the reduced image included in the focus information, for example, as shown in FIG. Say. Note that the order in which the pseudo focus area is set to the selected state is not limited to the arrangement position of the pseudo focus area on the image, but may be a method based on the area of the pseudo focus area.

  Next, in step S607, the CPU 501 displays other pseudo focus areas that are not set in the selected state (in the non-selected state) on the reduced image in a rectangular manner. For example, as shown in FIG. 4D, a pseudo focus area 846 is displayed.

  Next, in step S608, the CPU 501 displays the pseudo focus area set in the selected state on the reduced image as a rectangle as shown in FIG. At this time, the rectangular frame surrounding the pseudo focus area may be highlighted so as to stand out.

  Next, in step S609, the CPU 501 cuts out an image including the pseudo focus area set in the selected state from the original image data, displays the enlarged image on the display device 506 like the screen 803, and displays the screen 803. The reduced image 831 of the entire image is displayed in a superimposed manner on the upper left.

  In step S611, the CPU 501 determines whether or not there is a plurality of focus information. On the other hand, if there are a plurality, it is determined whether or not the user has instructed switching of the pseudo focus area (step S612). If a switching instruction is given, the process proceeds to step S610.

  In step S610, the CPU 501 cancels the selection state of the pseudo focus area set to the selection state, switches to the next pseudo focus area in order from the upper left position, and sets the pseudo focus area to the selection state. As described above, in the method based on the area of the pseudo focus area, the area size is switched based on the area.

  Although the case where an image including the pseudo focus area set in the selected state is enlarged and displayed has been described, when there are a plurality of pseudo focus areas, as shown in FIG. Only the image including the focus area is enlarged and displayed.

  When there are a plurality of pseudo focus areas, as shown in FIG. 5B, a plurality of images may be cut out according to the plurality of pseudo focus areas, and each may be enlarged and displayed in parallel. By displaying in parallel, the focus of a plurality of subjects can be confirmed at the same time, reducing the operation burden on the user and enabling an efficient focus confirmation operation. When the sizes of the plurality of pseudo focus areas are different from each other, the enlargement ratio of the image including each pseudo focus area may be adjusted in a timely manner so that the images are displayed in parallel on one screen.

  Next, a fixed position focus confirmation parallel display process for cutting out a plurality of images according to a plurality of pseudo focus areas, and magnifying and displaying each of them in parallel will be described.

  FIG. 13 is a flowchart showing fixed position focus confirmation parallel display processing. This process is a process executed instead of the process of FIG.

  In step S651, the CPU 501 causes the display device 506 to display a frame of a focus point (focus position).

  Next, in step S652, the CPU 501 uses the coordinate position, size, and focus information related to the focus point included in the focus information Z101 in FIG. 7B, as shown in FIG. The focused focus points 641, 642, 643, 644 are highlighted.

  Next, in step S653, the CPU 501 obtains a pseudo focus area so as to include all of the plurality of focus points that are in focus. By obtaining the pseudo focus area in this way, it is possible to confirm the image of the area in focus as in the case of automatic focusing while detecting the characteristic portion of the subject.

  Next, in step S654, the CPU 501 determines whether there are a plurality of pseudo focus areas calculated in step S653. If there are more than one, the process proceeds to step S655, and if there are not more than one, the process proceeds to step S656.

  In step S655, the CPU 501 obtains a display area by dividing the enlarged display area by the number of focus areas. For example, when there are two pseudo focus areas, as shown in FIG. 5B, the enlarged display area is divided into two to display two enlarged images converted according to the two pseudo focus areas. Obtain the display area. When there are three pseudo focus areas, the enlarged display area is divided into three. The number of focus areas is obtained from the value stored in the focus registration number Z001 or the fixed position focus position number Z100 in the photographing information. The enlarged display area is, for example, B13, B23, B33, and B43 shown in FIGS. 17 (a) to 17 (d). A method for obtaining the enlarged display area will be described later.

  In step S656, the CPU 501 highlights all pseudo focus areas of the reduced image. For example, the pseudo focus areas Z42 and Z43 in the reduced image in FIG.

  Next, in step S657, the CPU 501 cuts out each image in accordance with all the pseudo focus areas, displays the images in an enlarged display area, and returns. Here, in order to display the enlarged image of the image including the pseudo focus area in the enlarged display area obtained in step S655, the size and arrangement of each enlarged image are adjusted to match the size of the enlarged display area.

  FIG. 14 is a flowchart showing details of the pseudo focus area calculation process in step S603 of FIG. This process is executed based on a program read by the CPU 501 from the storage device 504 or the like.

  In step S <b> 701, the CPU 501 determines whether or not there is a location where the focus is matched among the focus points included in the focus information. Specifically, it is determined from the focus information in the focus information Z101 whether there is a focus position that matches the focus. Specifically, the CPU 501 uses the focus information (focus match / mismatch) for each focus point stored in the focus information Z101 shown in FIG. Judgment. For example, as shown in FIG. 15A, the image 901 has no focus point 911 that is in focus. On the other hand, as shown in FIG. 15B, in the image 902, all the focus points 921 are in focus.

  When the image 901 is enlarged and displayed in the image reproduction mode, the screen 1001 shown in FIG. 16A is displayed. When the image 902 is enlarged and displayed in the image reproduction mode, the screen 1002 shown in FIG. 16B is displayed. In the screens 1001 and 1002, A11 and A21 are reduced images, A12 and A22 are enlarged images, and A13 and A23 are enlarged images of the reduced images A11 and A21.

  On the screens 1001 and 1002, the peripheral images A14 and A24 of the central portions A15 and A25 of the automatic focus arranged at fixed positions are cut out and enlarged. In this case, the image 703 shown in FIG. 3C displayed when the pseudo focus area is obtained from the fixed position focus, the image 704 shown in FIG. 3D, and the like are not displayed.

  Returning to FIG. 14, in step S <b> 702, the CPU 501 determines whether or not all the focus points are in focus. If all the focus points are in focus, the process proceeds to step S704, and if not, the process proceeds to step S703.

  In step S703, the CPU 501 searches for a focus point that is in focus in order from the focus point located at the upper left, with the upper left corner of the image as the origin. In step S705, the CPU 501 determines whether or not there is a focus point that is in focus. If there is a focus point that is in focus, the CPU 501 matches the focus at the focus point adjacent to the found focus point. The current focus point is searched sequentially (steps S706 and S707). Specifically, as shown in FIG. 23A or FIG. 23B, an adjacent focus point is searched from G08 and G32 in focus. G01 to G06, G21 to G26 indicate focus points, and G07 and G27 indicate search directions. The focus area that looks for the adjacent focus point from G08 and G32 that are in focus is G09 and G28 on the top, G12 and G31 on the bottom, G11 and G29 on the left, and G10 and G30 on the right. The focus area closest to the area is targeted.

  When there is no coincidence between adjacent focus points, the CPU 501 obtains a pseudo focus area by grouping the focus point found in step S703 and the adjacent focus point in focus (step S708). Specifically, the pseudo focus area is obtained by the method shown in FIGS. 17 (a) and 17 (b) show the case where the camera is photographed in the horizontal position, and FIGS. 17 (c) and 17 (d) show the case where the camera is photographed in the vertical position.

  When the pseudo focus area is in the vertical direction, as shown in B12 in FIG. 17A and B32 in FIG. 17C, the pseudo focus area is displayed in the vertical direction, and the enlarged display area has a width of B14, B34, As shown by heights B15 and B35, a display area in which the image in the vertical direction can be enlarged as much as possible is obtained so that the entire upper left images B11 and B31 do not overlap.

  When the pseudo focus area is in the horizontal direction, the pseudo focus area is displayed in the horizontal direction as shown in B22 in FIG. 17B and B42 in FIG. 17D. As shown by B44 and heights B25 and B45, a display area where the horizontal image can be enlarged as much as possible is obtained so that the entire upper left images B21 and B41 do not overlap.

  FIG. 18 is an enlarged view of the reduced whole image and pseudo focus area of B11, B21, B31, and B41 of FIG. FIG. 19 shows a method for obtaining the pseudo focus area when the camera is photographed in the horizontal position, and FIG. 20 shows a method for obtaining the pseudo focus area when the camera is photographed in the vertical position. is there.

  When the focus areas in the adjacent focus area are in the vertical direction, such as D17 and D18 in FIG. 19A and D37 and D38 in FIG. 20A, the focus areas of the adjacent focus areas shown in FIG. The half distance in the vertical direction is obtained as m for B15 and D16, n for D35 and D36, and the heights for D13 and D33 are obtained.

  When the height of the pseudo focus area in the vertical direction is determined in FIGS. 19A and 20A, the area of the pseudo focus area can be obtained by obtaining the horizontal size from the aspect ratio of the entire image size.

  In FIGS. 19B and 20B, the focus areas that are in focus in adjacent focus areas are horizontal areas such as D29 and D28 in FIG. 19B and D48 and D49 in FIG. 20B. For the direction, the distance in the horizontal direction of the adjacent focus area shown in FIG. 23 is obtained as n of D24 and D25, n of D43 and D44, and the widths of D26 and D46 are obtained.

  When the width of the pseudo focus area in the horizontal direction is determined in FIGS. 19B and 20B, the area of the pseudo focus area is obtained by obtaining the height size from the aspect ratio of the entire image size.

  21 and 22 show that when only one focus is achieved, or when no focus is achieved as shown in FIG. 15A, all the focus areas are in focus as shown in FIG. 15B. It shows how to obtain a pseudo focus area when one focus area arranged at the center is used as a reference.

  In FIG. 21A, when the camera is photographed in the horizontal position, half of the horizontal size of the adjacent focus area is obtained on the basis of F16 that is in focus, the width is fixed, and then the vertical and horizontal directions of the entire image are obtained. Find the height from the ratio. Conversely, in FIG. 21B, when the camera is photographed in a standing position, the vertical size of the adjacent focus area is obtained with reference to F23 that is in focus, and the height is determined. The width is obtained from the aspect ratio of the entire image.

  In step S709, it is determined whether or not all focus points in focus that are sequentially searched using the upper left of the image as the origin in step S703 have been confirmed. If not all have been confirmed, the process returns to step S705 to obtain a pseudo focus area. By performing such processing, one or a plurality of pseudo focus areas are obtained.

  In addition, the reference | standard of an adjacent focus point can be changed timely. In the present embodiment, as shown in FIG. 18C, an example in which one pseudo focus area is formed by C32, C33, C34, and C35 in focus is given. However, for example, when C32 and C35 are in focus, but C33 and C34 are out of focus, C33 and C34 that are out of focus exist between them, but they are treated as adjacent. It is also possible. This is because C33 and C34 do not block C32 and C35. In this case, one pseudo focus area can be created. On the other hand, C32 and C35 can be handled as not adjacent to each other. In this case, two pseudo focus areas can be created.

  In the present embodiment, as shown in FIG. 14, a focused focus point is found, and the pseudo focus area is calculated from the found focus point. However, the method for obtaining the pseudo focus area is not limited to this. I can't. For example, as shown in FIG. 30, there is a method in which pseudo focus areas corresponding to all combination patterns of in-focus focus points are prepared in advance and the pseudo focus area is obtained by performing pattern matching. For example, if only the focus area of A is in focus, the pattern list No. One focus area information is obtained as a pseudo focus area.

  In the present embodiment, nine focus points are exemplified, but pseudo focus areas corresponding to the combination patterns of all nine focus points are prepared in advance. In the case of the N point focus point, a pseudo focus area corresponding to the combination pattern of all the N point focus points is prepared in advance. By adopting the pattern matching method in this way, it becomes unnecessary to calculate the pseudo focus area every time, and the pseudo pattern area can be obtained at high speed.

  FIG. 17A shows an image captured with a digital camera placed sideways, and is cut out and enlarged according to the pseudo focus area and the pseudo focus area when a plurality of focus points with the same focus are aligned in the vertical direction. It is a figure which shows the area which displays an image.

  FIG. 17 (b) shows an image captured with a digital camera placed sideways and cut out in accordance with the pseudo focus area, display area, and pseudo focus area when a plurality of focused focus points are aligned in the horizontal direction. It is a figure which shows the area which displays the image expanded in this way.

  FIG. 17 (c) is an enlarged image cut out in accordance with the pseudo focus area and the pseudo focus area when a plurality of focus points with the same focus are aligned in the vertical direction in an image taken with the digital camera vertically. It is a figure which shows the area which displays an image.

  FIG. 17D illustrates a cut-out according to a pseudo focus area, a display area, and a pseudo focus area when a plurality of focus points having the same focus are arranged in a horizontal direction in an image taken with a digital camera vertically. It is a figure which shows the area which displays the image expanded in this way.

  FIG. 18 is an enlarged view of the entire image arranged at the upper left part of each of the reduced images B11, B21, B31, and B41 shown in FIGS. 17 (a) to 17 (d).

  FIG. 19A is a schematic diagram illustrating a method for calculating a pseudo focus area when two digital focus points D17 and D18 are aligned in the vertical direction when the second type digital camera is photographed sideways. It is. The intermediate positions D15 and D16 are obtained from the distance between the two focus points arranged at the vertical position, the vertical axis length D12 is obtained, and the length of the horizontal axis D14 is obtained from the aspect ratio of the image size. When the camera is photographed in the horizontal position and the pseudo focus area is in the vertical direction, the aspect ratio of the image size is reversed. When the camera is photographed in the vertical position, the aspect ratio of the image size is obtained by reversing even when the pseudo focus area is in the horizontal direction.

  FIG. 19B is a schematic diagram showing a method for calculating the pseudo focus area when the second type digital camera is photographed horizontally and the two focus points D29 and D28 that are in focus are aligned in the substantially horizontal direction. FIG. The intermediate positions D24 and D25 are obtained from the distance between the two focus points arranged at the horizontal position, the horizontal axis length D23 is obtained, and the length of the vertical axis D22 is obtained from the aspect ratio of the image size.

  FIG. 20A is a schematic diagram illustrating a method for calculating a pseudo focus area when a second type digital camera is photographed vertically and two focus points D37 and D38 that are in focus are aligned in the vertical direction. It is.

  FIG. 20B is a schematic diagram illustrating a method of calculating the pseudo focus area when the second type digital camera is photographed vertically and two focus points D48 and D49 in focus are aligned in the horizontal direction. It is.

  FIG. 21A is a diagram showing a pseudo focus area and an area for displaying a cut-out image when the second type digital camera is photographed sideways and there is only one point in focus.

  In FIG. 21A, in the case of an image photographed with the second-format digital camera placed sideways, the entire image E11, the focus area E12, and E14 that cuts out and displays a part of the image are all horizontally long.

  FIG. 21B is a diagram showing a pseudo focus area and an area for displaying a cut-out image when the second type digital camera is photographed sideways and there is only one point in focus.

  In FIG. 21B, in the case of an image taken with a digital camera of the second format in the vertical direction, E21 of the entire image, focus area E22, and E24 for cutting out and displaying a part of the image are all vertically long.

  FIG. 22A is a schematic diagram illustrating a method for calculating a pseudo focus area when there is only one point in focus in an image photographed with a digital camera of the second format sideways.

  In FIG. 22A, in the image taken with the second type digital camera placed sideways, the length of n (F14) is obtained from the width of adjacent focus positions to determine the size of the width (F18). The length of the vertical axis is obtained from the aspect ratio of the size.

  FIG. 22B is a schematic diagram illustrating a method for calculating a pseudo focus area when there is only one point in focus in an image photographed with the digital camera of the second format vertically.

  In FIG. 22B, in the image taken with the second type digital camera vertically, the length of m (F25) is obtained from the vertical width of the adjacent focus position, and the size of the height (F22) is determined. The length of the horizontal axis is obtained from the aspect ratio of the image size.

  FIG. 23A is a diagram for explaining a method of searching for an adjacent focus position from a point in focus in an image photographed with a digital camera of the second format sideways.

  In FIG. 23 (a), when a digital camera is photographed horizontally, when the focus position adjacent to G08 that is in focus is obtained as a reference, it is arranged at the closest position in the vertical and horizontal directions from the focus match point G08. Find the focus position.

  FIG. 23B is a diagram for explaining a method of searching for an adjacent focus position from a point in focus in an image photographed with the second type digital camera vertically.

  Similarly, in FIG. 23B, when the adjacent focus position is obtained with reference to the focus coincidence point G32, the focus position arranged at the closest position in the vertical and horizontal directions from the focus coincidence point G32 is obtained.

  In this way, it is effective before and after shooting by using information that is automatically detected by automatically detecting the characteristic part of the subject of the image data shot with a digital camera, or using information that has automatic focus at a fixed position. It is possible to check the focus of the subject.

  FIG. 24 is a flowchart showing the mode selection process.

  In FIG. 24, the CPU 501 determines which of the image playback mode, the image scroll mode, and the image enlargement / reduction display mode has been selected (step S2401). In accordance with this determination, the above-described image reproduction process (step S2402), image scroll process (step S2403), and image enlargement / reduction display process (step S2404) are performed.

  FIG. 25 is a flowchart showing details of the image scroll processing in step S2403 of FIG. This process is executed based on a program read by the CPU 501 from the storage device 504 or the like. This process is a process executed after the focus area is enlarged and displayed on the display device 506 by the above-described operation.

  In step S801, the CPU 501 determines whether the image scroll mode is set. If it is in the scroll mode, the process proceeds to step S802.

  In step S <b> 802, the CPU 501 moves an enlarged image (initially, an area where the focus area is displayed) on the image according to an operation (movement instruction) from the user, and enlarges and displays the moved area. . The user can scroll the image by dragging a region where the image is cut out and displayed by an operation using an arrow key of a keyboard connected to the PC 500 or a mouse connected to the PC 500. In the second embodiment to be described later, the image can be scrolled by an operation by the operation unit of the digital camera.

  Next, in step S803, the CPU 501 moves the rectangular area including the focus area in the reduced image in accordance with the movement in step S802.

  As described above, by allowing the user to perform a scroll operation after enlarging and displaying an image including the focus area, the user can check an enlarged image near the focus area with a small operation procedure. .

  FIG. 26 is a flowchart showing details of the image enlargement / reduction display processing in step S2404 of FIG. This process is executed based on a program read by the CPU 501 from the storage device 504 or the like. This process is a process executed after the focus area is enlarged and displayed on the display device 506 by the above-described operation or after the process shown in FIG.

  In step S <b> 901, the CPU 501 determines whether the display mode is an enlargement / reduction display mode. If it is in the enlarged / reduced display mode, the process proceeds to step S902.

  In step S902, the CPU 501 determines whether or not the enlarge key has been pressed by the user. If the button has been pressed, the enlarged display area is further enlarged and the process proceeds to step S905.

  In step S903, the CPU 501 determines whether or not the reduction key has been pressed by the user. When pressed, the enlarged display area is reduced and displayed (step S904), and the preview frame in the reduced image is enlarged or reduced.

  According to the first embodiment, an imaging apparatus having a function of automatically detecting and automatically focusing an image and an object photographed by an imaging apparatus having a function of focusing on a focus point arranged at a fixed position. It is possible to easily check the image of the part in focus in any of the images photographed in.

[Second Embodiment]
In the first embodiment, the embodiment in which the present invention is applied to the PC 500 that is an information processing apparatus has been described. In the second embodiment, the present invention is applied to a digital camera that is an imaging apparatus. explain. In the second embodiment, a digital camera that automatically detects and automatically focuses a characteristic portion of a subject or records information in which automatic focus is arranged at a fixed position is used to capture an image by using focus information. It becomes possible to confirm the focus of the subject effectively before and after.

  FIG. 27 is a block diagram illustrating a main functional configuration of a digital camera as an example of an imaging apparatus according to the second embodiment of the present invention.

  The taking lens 10 includes a zoom lens for continuously changing the focal length and a focus lens for adjusting the focus. These lenses are driven by the zoom control unit 44 and the distance measurement control unit 42. The taking lens 10 forms an image of a subject on the image pickup surface of the image pickup device 14. The image pickup device 14 is a photoelectric conversion image pickup device that outputs an electrical signal corresponding to the light intensity of the subject image formed on the image pickup surface, and a CCD type or MOS type individual image pickup device is used.

  The aperture 12 is operated by the exposure control unit 40. An analog video signal from the image sensor 14 is input to the A / D converter 16 and converted from an analog signal to a digital signal. The A / D converted digital signal is subjected to various image processing such as gamma correction and white balance correction by the image processing unit 20. The image display memory 24 is a memory that can store data for a plurality of frames captured by the image sensor 14. The image processed image data is temporarily stored in the image display memory 24.

  The system control unit 112 is connected to the exposure control unit 40, the camera posture detection unit 106, and the like, and performs sequence control when the camera operates. The system control unit 112 includes a power switch 72 for turning on / off the camera, a shutter switch 62 and a full-press switch 64 for turning on / off in conjunction with the release, and a camera for displaying the camera displayed on the display unit 54. An operation unit 70 for selecting various menu contents is provided. When the subject brightness is low, the flash 48 is emitted.

  In addition to the image data converted by the image processing unit 20, the image data stored in the image display memory 24 matches the focus information for determining the feature position of the subject's face or the focus confirmation position arranged at a fixed position. Shooting information such as information on the location and information of the camera posture detection unit 106 is also stored together. Data stored in the image display memory 24 is recorded in storage media 200 and 210 such as a memory card. When recording image data in the storage media 200 and 210, data compression is generally performed in a predetermined compression format, for example, the JPEG method. The compression / decompression unit 32 performs data compression when recording image data and photographing information in the storage media 200 and 210, and decompression processing of the image data compressed from the storage media 200 and 210.

  The nonvolatile memory 56 is a nonvolatile memory capable of electrically erasing and recording stored data and the like, and for example, an EEPROM or the like is used. The memory 52 is a memory for storing constants, variables, programs and the like for operating the system control circuit 50. The communication unit 110 has a communication function. An antenna (connector in the case of wired communication) 112 connects the digital camera 100 to other devices via a packet network, a network, and the Internet by the communication unit 110. The connectors 82 and 84 are connection parts that connect the power supply control unit 80 and the power supply 86. The power source 86 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like.

  The display image data written in the image display memory 24 is displayed by the image display unit 28 via the D / A conversion circuit 26. By sequentially displaying the image data on the image display unit 28, the electronic finder function can be realized. The optical viewfinder 104 can take an image using only the optical viewfinder without using the electronic viewfinder function of the image display unit 28.

  The timing generation circuit 18 is controlled by the memory control unit 22 and the system control unit 112. The memory 30 is a memory for storing captured still images and moving images. The barrier control unit 46 controls the operation of the protection unit 102. The mode dial switch 60 can switch and set various function modes such as power-off, automatic shooting mode, shooting mode, panoramic shooting mode, moving image shooting mode, playback mode, multi-screen playback / erase mode, and PC connection mode. The playback mode switch 66 is a mode switch for executing the image playback processing described in the above embodiment. The attitude mode switch 68 is a switch that automatically determines whether the camera is shooting in the vertical position or in the horizontal position.

  The storage medium 200 includes a recording unit 202 configured by a semiconductor memory, a magnetic disk, and the like, an I / F 204 that is an interface with the digital camera 100, and a connector 206 that is connected to the digital camera 100. The storage medium 210 includes a recording unit 212 composed of a semiconductor memory, a magnetic disk, or the like, an I / F 214 that is an interface with the digital camera 100, and a connector 216 that connects to the digital camera 100. The I / Fs 90 and 94 are interfaces for connecting the storage media 200 and 210 such as a memory card and a hard disk and the system bus. The connectors 92 and 96 are connection portions that connect the storage media 200 and 210 such as a memory card and a hard disk and the I / Fs 90 and 94. The storage medium attachment / detachment detection means 98 is a sensor that detects whether or not the storage media 200 and 210 are attached to the connectors 92 and 96.

  Next, in the digital camera 100, an image reproduction operation for displaying the entire image and an enlarged image around the position where the subject is in focus using the focus information added to the image data will be described.

  FIG. 28 is a flowchart showing the flow of image reproduction operation processing executed by the digital camera 100 of FIG. This process is executed based on a program read by the system control unit 112 from the nonvolatile memory 56 or the like.

  First, in step S101, the system control unit 112 determines whether an image playback mode is set. The image reproduction mode in the present embodiment is a mode in which images before and after shooting are displayed on the image display unit 28 of the digital camera 100 by the display method described in the first embodiment. The image playback mode is set by operating the operation unit 70 of the digital camera 100 in the mode selection process shown in FIG.

  If the image reproduction mode is set as a result of the determination in step S101, the system control unit 112 determines whether or not it is before shooting (step S102). When it is before photographing (YES in step S102), the system control unit 112 reads image data from the image display memory 24 which is an internal memory. On the other hand, after photographing (NO in step S102), image data is read from the storage media 200, 201, etc. (step S104).

  Next, the system control unit 112 determines whether or not the focus confirmation display mode is set (step S105). In the focus confirmation display mode, when an image is displayed on the image display unit 28, the focus area (or pseudo focus area) of the image is based on the focus information added to the image data, as in the first embodiment. Is a mode for enlarging and displaying an image of a rectangular region including For example, screens 801 to 804 shown in FIGS. 4A to 4D are displayed on the image display unit 28. The focus confirmation display mode is set by operating the operation unit 70. Similar to the first embodiment, the pseudo focus area is a pseudo focus area obtained based on a focused focus point among a plurality of focus points arranged at a fixed position.

  If the focus confirmation display mode is not set as a result of the determination in step S105, the system control unit 112 displays normal image data (step S107). On the other hand, when the focus confirmation display mode is set, the system control unit 112 executes a focus confirmation display process shown in FIG. 29 (step S106). Next, in step S108, the system control unit 112 determines whether or not the reproduction has been completed. If the reproduction has been completed, the system control unit 112 returns. On the other hand, if the reproduction has not been completed, the system control unit 112 returns to step S102.

  As shown in FIGS. 4A to 4D, the images 701 to 701 shown in FIGS. 3A to 3D are displayed on the screens 801, 802, 803, and 804 by the focus confirmation display process. An enlarged image of the entire image 704 and an image including the focus area or the pseudo focus area is displayed on the image display unit 28.

  FIG. 29 is a flowchart showing the focus confirmation display process in step S106 of FIG. This process is executed based on a program read by the system control unit 112 from the nonvolatile memory 56 or the like. Further, in this processing, the CPU 501 that is the main body of the processing in FIG. 2 is changed to the system control unit 112, and the same processing contents are denoted by the same reference numerals and description thereof is omitted.

  In this embodiment, since the focus confirmation display process is executed by either the first format digital camera or the second format digital camera, unlike the PC 500, it is not necessary to determine focus information. Therefore, when the system control unit 112 acquires focus information in step S309, a fixed position focus confirmation display process (or automatic focus confirmation display process) is executed (step S314).

  If the digital camera 100 is a digital camera of the first format, the system control unit 112 executes automatic focus confirmation display processing (or automatic focus confirmation parallel display processing) shown in FIG. 9 (or FIG. 10). On the other hand, when the digital camera 100 is a digital camera of the second format, the system control unit 112 executes the fixed position focus confirmation display process (or fixed position focus confirmation parallel display process) shown in FIG. 11 (or FIG. 13). . When the fixed position focus confirmation display process (or the fixed position focus confirmation parallel display process) is executed, the pseudo focus area calculation process shown in FIG. 14 is executed. As a result, as described in the first embodiment, the screens as shown in FIGS. 4A to 4D are displayed.

  According to the second embodiment, it is possible to easily check an image of a portion in focus from an image photographed by a function for focusing on a focus point arranged at a fixed position. In addition, it is possible to easily confirm the image of the in-focus portion from the image captured by the function of automatically detecting and automatically focusing the characteristic portion of the subject.

  The object of the present invention can also be achieved by executing the following processing. That is, a storage medium that records a program code of software that realizes the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus is stored in the storage medium. This is the process of reading the code. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code and the storage medium storing the program code constitute the present invention.

  Moreover, the following can be used as a storage medium for supplying the program code. For example, floppy (registered trademark) disk, hard disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM or the like. Alternatively, the program code may be downloaded via a network.

  Further, the present invention includes a case where the function of the above-described embodiment is realized by executing the program code read by the computer. In addition, an OS (operating system) running on the computer performs part or all of the actual processing based on an instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Is also included.

  Furthermore, a case where the functions of the above-described embodiment are realized by the following processing is also included in the present invention. That is, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing.

28 Image display unit 100, 509 Digital camera 112 System control unit 500 PC
501 CPU
506 display device

Claims (5)

A first image input by an imaging device having a function of photographing a subject by focusing on one or a plurality of focus points among a plurality of fixed points is displayed on a display device, and An information processing apparatus for displaying on a display device a second image input by an imaging device having a function of photographing a subject by automatically detecting and focusing a feature portion,
A reading means from the storage device to read said second image and the first image,
By analyzing the shooting information added to the image read by the reading means, information for identifying the focus points arranged at a plurality of fixed positions and information indicating the match / mismatch of the focus for each of the plurality of focus points determining bets to be the first image an image capturing information is added containing, and determines that the image capturing information including information on one or more of the focus area is added as a second image Determination means to perform,
A detection unit that detects one or a plurality of focus points in focus from the first image read by the reading unit when the determination unit determines that the image is the first image;
Calculating means for calculating a focus region including the one or more focus points according to the arrangement position and the number of the one or more focus points detected by the detecting means;
And at least a part of the reduced image of the first image read by the reading unit and the image of the focus area calculated by the calculating unit when the determining unit determines that the image is the first image. When the control unit displays the display image having a display magnification larger than that of the first reduced image in the display area of the display device, and the determination unit determines that the display image is the second image, the reading unit And at least a part of the reduced image of the second image read by the image and a display image of a focus area identified from shooting information added to the second image and having a display magnification larger than that of the reduced image. An information processing apparatus comprising: display control means for performing control to display in a display area of the display device. The calculation unit calculates one focus area by grouping adjacent focus points among a plurality of focus points detected by the detection unit into one group,
When the calculation means calculates focus points that are not adjacent to each other in a plurality of groups and calculates a plurality of focus areas, the display control means is an image of each of the focus areas and the first image In order to display a plurality of display images having a display magnification larger than that of the reduced image in the display area of the display device, the display area is divided by the calculated number of focus areas. A plurality of display images that are images of each of the plurality of focus regions and have a display magnification larger than the reduced image of the first image are displayed side by side, and the plurality of focus regions corresponding to the display images that are displayed side by side are It controls to display each identifiable image in the reduced image of the first image, added to the second image When a plurality of focus areas specified from the shooting information to be included are included, a plurality of display images that are images of the plurality of focus areas and have a display magnification larger than the reduced image of the second image In order to display in the area, the display area is divided by the number of pieces of information specifying the focus area included in the image, and each of the plurality of focus areas is divided into the divided display areas. A plurality of display images having a display magnification larger than that of the reduced image of the second image are displayed side by side, and the plurality of focus areas corresponding to the displayed images displayed side by side are identifiable in the reduced image of the second image. The information processing apparatus according to claim 1, wherein control is performed. A first image input by an imaging device having a function of photographing a subject by focusing on one or a plurality of focus points among a plurality of fixed points is displayed on a display device, and An information processing method in an information processing apparatus for displaying on a display device a second image input by an imaging device having a function of photographing a subject by automatically detecting and focusing a characteristic part,
A reading step from the storage device to read said second image and the first image,
By analyzing shooting information added to the image read in the reading step, information for specifying focus points arranged at a plurality of fixed positions and information indicating a match / mismatch of the focus for each of the plurality of focus points determining bets to be the first image an image capturing information is added containing, and determines that the image capturing information including information on one or more of the focus area is added as a second image A determination step to:
A detection step for detecting one or a plurality of focus points in focus from the first image read by the reading step when it is determined by the determination step that the image is the first image;
A calculation step of calculating a focus region including the one or more focus points according to the arrangement position and number of the one or more focus points detected by the detection step;
An image of at least a part of the reduced image of the first image read by the reading step and the image of the focus area calculated by the calculating step when it is determined that the image is the first image by the determining step; There line control to display the display area of the first reduced image from the display magnification larger display image and the display device, and, if it is determined that the second image by the determination step, the reading An image of a focus area identified from at least a part of the reduced image of the second image read in the step and shooting information added to the second image, and a display image having a larger display magnification than the reduced image; A display control step for performing control to display the image on a display area of the display device. A first image input by an imaging device having a function of photographing a subject by focusing on one or a plurality of focus points among a plurality of fixed points is displayed on a display device, and A program that can be executed in an information processing apparatus that displays on a display device a second image input by an imaging device having a function of photographing a subject by automatically detecting and focusing a characteristic portion,
Wherein said first image from the storage device a second reading means for reading an image,
By analyzing the shooting information added to the image read by the reading means, information for identifying the focus points arranged at a plurality of fixed positions and information indicating the match / mismatch of the focus for each of the plurality of focus points determining bets to be the first image an image capturing information is added containing, and determines that the image capturing information including information on one or more of the focus area is added as a second image Means for determining,
A detection unit that detects one or a plurality of focus points in focus from the first image read by the reading unit when the determination unit determines that the image is the first image;
In accordance with the arrangement position and number of the one or more focus points detected by the detection means, the calculation means for calculating a focus area including the one or more focus points, and the determination means with the first image If it is determined that there is at least part of the reduced image of the first image read by the reading means and the image of the focus area calculated by the calculating means, the display magnification is higher than the first reduced image. A display image having a large size is displayed in the display area of the display device, and when the determination unit determines that the second image is a second image, the second image read by the reading unit An image of a focus area identified from at least a part of the reduced image and shooting information added to the second image, and a display magnification of the reduced image Large display image and a program for causing to function the information processing apparatus as a display control unit for controlling display on the display area of the display.   A recording medium storing the program according to claim 4 in a computer-readable manner.

Images