JP2006173854A - Image display apparatus, image display program, and imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display technology quickly and properly carrying out detailed display of a photographed image in the case of recording an RAW image as the photographed image. <P>SOLUTION: In the case of recording the RAW image as the photographed image to a memory card, a photographing apparatus generates a partial image Ga wherein left and right ends (width Xc) and upper and lower ends (width Yc) are trimmed from an image Go resulting from applying image processing for including pixel interpolation to the RAW image, and also records compression image data resulting from compression processing applied to the partial image Ga in the JPEG form. When confirmation of a focus of the photographed image is needed, the image resulting from applying expanding processing to the recorded compression image data is displayed in detail on a display section. As a result, detailed display of the photographed image is quickly and properly performed in the case of recording the RAW image as the photographed image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image display technique for displaying a captured image.

  Some digital cameras (imaging devices) record a CCD-RAW image (hereinafter also referred to as a “RAW image”) composed of pixel data output from a CCD as a captured image. This RAW image cannot be displayed as it is on a display unit of a personal computer or the like, and image processing such as pixel interpolation processing is necessary for the display, so that it is difficult to display it quickly.

  For example, Non-Patent Document 1 discloses a technique that enables this quick display. This technique records an RGB image with a reduced resolution (image size) of a captured image together with a RAW image as a captured image. When displaying a captured image, it is possible to display the image quickly by using the RGB image. .

Kodak Corporation, “DCS Pro SLR / n Digital Camera Product Features”, [online], [Searched on December 10, 2004], Internet <URL: http://wwwjp.kodak.com/JP/en/professional /products/cameras/dcsproslr/feature/dcr.shtml>

  However, in the technique of Non-Patent Document 1 described above, when it is desired to display the captured image in detail, it is necessary to enlarge and display the low-resolution RGB image. is there.

  In a digital camera, a relatively large amount of captured images are often recorded, but usually the user performs an operation of selecting the best image for focusing or the like. During such work, the details of the photographed image (for example, the human eyes in the portrait) are checked, but if the enlargement process is performed on the low-resolution RGB image as in the above technique, the image is displayed. It becomes unclear and it becomes difficult to check in detail. Although detailed display based on the RAW image can be performed, rapid display is difficult as described above.

  The present invention has been made in view of the above problems, and an object thereof is to provide an image display technique capable of quickly and appropriately displaying a captured image in detail when a RAW image is recorded as a captured image.

  In order to solve the above problems, the invention of claim 1 is an image display device having display means capable of displaying an image, and corresponds to (a) a RAW image as a captured image and a part of the captured image. Based on the partial image obtained by acquiring the compressed image data obtained by compressing the partial image, (b) the designation unit for designating the portion of the captured image, and (c) the partial image obtained by decompressing the compressed image data, Display control means for causing the display means to display a portion of the captured image designated by the designation means, and the partial image is a part of an image obtained by performing image processing including pixel interpolation on the RAW image. .

  According to a second aspect of the present invention, in the image display device according to the first aspect of the invention, the partial image is an image portion centered on a central portion of the photographed image.

  According to a third aspect of the present invention, in the image display device according to the first aspect of the invention, the partial image is an image portion centered on a focusing area used for a focusing operation at the time of shooting the captured image. is there.

  According to a fourth aspect of the present invention, in the image display device according to any one of the first to third aspects, the display control means includes: (c-1) a part of the photographed image designated by the designation means. When the image includes an image portion other than the partial image, the image capturing device includes means for displaying the portion of the captured image based on the RAW image.

  The invention according to claim 5 is the image display device according to any one of claims 1 to 4, wherein the display control means is (c-2) a part of the photographed image designated by the designation means. Is displayed at the same magnification on the display means.

  According to a sixth aspect of the invention, when executed in a computer built in the image display device, the image display device functions as the image display device according to any one of the first to fifth aspects of the invention. An image display program characterized by the above.

  The invention of claim 7 is an imaging device capable of recording an image on a predetermined recording means, wherein (a) an imaging means for imaging a subject to generate a captured image; and (b) an image of the captured image. A compression processing means for generating compressed image data obtained by compressing a partial image corresponding to a part; and (c) a recording control means for recording the compressed image data in the predetermined recording means together with a RAW image as the photographed image. The partial image is a part of an image obtained by performing image processing including pixel interpolation on the RAW image.

  According to an eighth aspect of the present invention, in the imaging apparatus according to the seventh aspect of the invention, the partial image is an image portion centered on a central portion of the captured image.

  According to a ninth aspect of the present invention, in the imaging device according to the seventh aspect of the invention, the partial image is an image portion centered on a focusing area used for a focusing operation at the time of shooting the captured image. .

  According to the first to sixth aspects of the present invention, compressed image data obtained by compressing a partial image corresponding to a part of an image subjected to image processing including pixel interpolation on a RAW image as a captured image is obtained. The part of the designated photographed image is displayed based on the partial image obtained by decompressing the compressed image data. As a result, when a RAW image is recorded as a captured image, detailed display of the captured image can be performed quickly and appropriately.

  In particular, in the invention of claim 2, since the partial image is an image portion centered on the central portion of the photographed image, relatively important image portions can be displayed quickly.

  In the invention of claim 3, since the partial image is an image portion centered on the in-focus area used for the focusing operation at the time of capturing the captured image, the image portion necessary for focus confirmation is quickly displayed. it can.

  Further, in the invention of claim 4, when the designated part of the photographed image includes an image part other than the partial image, the part of the photographed image is displayed based on the RAW image. Can be displayed.

  According to the fifth aspect of the present invention, since the designated portion of the captured image is displayed at the same magnification, the detailed display of the captured image can be easily performed.

  According to the seventh to ninth aspects of the present invention, the compression is performed by compressing a partial image corresponding to a part of an image obtained by performing image processing including pixel interpolation on the RAW image together with the RAW image as the captured image. Image data is recorded in a predetermined recording means. As a result, even when a RAW image is recorded as a captured image, detailed display of the captured image can be performed quickly and appropriately.

  In the invention of claim 8, since the partial image is an image portion centered on the central portion of the photographed image, compressed image data including a relatively important image portion can be appropriately generated.

  In the invention of claim 9, since the partial image is an image portion centered on the in-focus area used for the focusing operation at the time of capturing the captured image, the compressed image including the image portion necessary for focus confirmation Data can be generated properly.

<Embodiment>
An image reproduction system 1 according to an embodiment of the present invention includes an imaging device 2 and an image display device 3.

  Hereinafter, the imaging device 2 and the image display device 3 will be described in order.

<Configuration of main part of imaging apparatus 2>
FIG. 1 is a functional block diagram illustrating a main configuration of the imaging apparatus 2.

  The imaging device 2 is configured by, for example, a digital camera, and includes an imaging lens 21, an imaging unit 22, an A / D conversion unit 23, and a signal processing unit 24. In addition, the imaging device 2 includes a trimming processing unit 25 that trims an image output from the signal processing unit 24, a JPEG encoder unit 26, a file creation unit 27, a temporary storage memory 28 that temporarily stores data, A memory card 29 is provided that is detachably attached to the imaging device 2 and stores a captured image.

  The optical image of the subject that has passed through the imaging lens 21 is input to the imaging unit 22. In the imaging unit 22, photoelectric conversion is performed, and an analog signal divided into RGB signals by a color filter that performs color division of the image signal shown in FIG. 2 is generated as a captured image. The color filter shown in FIG. 2 allows any one of RGB light to pass through each pixel, and the RGB filter arrangement is such that G is arranged every other pixel both vertically and horizontally, and R and B are arranged for each column. Array (Bayer array).

  The electrical signal generated by the imaging unit 22 is input to the A / D conversion unit 23 and subjected to analog / digital conversion. The image data after A / D conversion in this way is configured as digital data in which RGB pixel data is arranged in the Bayer array shown in FIG. This image data is referred to as CCD-RAW data (hereinafter, also simply referred to as “RAW data”).

  The RAW data generated by the A / D conversion unit 23 is output to the signal processing unit 24. In the signal processing unit 24, a process for interpolating from surrounding pixels having data for pixels having no specific color data in the RAW data is performed, and image data in which each pixel has data of all RGB colors is generated. . Then, image processing such as white balance adjustment and gamma correction is performed on the RGB image created by pixel interpolation image processing.

  The RGB image data generated by the signal processing unit 24 is input to the trimming processing unit 25, and the captured image is trimmed. Specifically, as shown in FIG. 3, processing is performed on the captured image Go created by the signal processing unit 24 so that the upper end portion and the lower end portion of the image are cut by Yc pixels, and the left end of the image is displayed. A process is performed in which the portion and the right end portion are cut out by the amount corresponding to Xc pixels, and an image portion centered on the central portion of the captured image is extracted. Thereby, a partial image Ga (FIG. 3) corresponding to a part of the photographed image having the number of pixels Xa in the horizontal direction and the number of pixels Ya in the vertical direction is generated.

  In the above trimming process, it is desirable to set Yc and Xc to be removed to about 20% of Ya and Xa. As a result, the partial image Ga after the trimming process with respect to the photographed image Go is reduced to about 70% in terms of the line ratio, and the total number of pixels is about 50%, so that the balance between the display and the recording size can be achieved. .

  The partial image Ga subjected to the trimming process as described above is transferred to the JPEG encoder unit 26. The JPEG encoder unit 26 performs JPEG image compression processing on the partial image Ga, and generates JPEG image data for display (hereinafter also simply referred to as “JPEG data”).

  The RAW data generated by the A / D conversion unit 23 and the JPEG data (compressed image data) generated by the JPEG encoder unit 26 are sent to the file creation unit 27, and one image obtained by synthesizing these data A file is created. As shown in FIG. 4, the image file is composed of a header portion Fa in which parameters at the time of shooting, parameters specific to the camera, and the like are written, JPEG data Fb for display, and RAW data Fc. In the header portion Fa, a small image (thumbnail image) in which the resolution of the captured image (full-size image) Ga shown in FIG. 3 is reduced is recorded.

  The image file created by the file creation unit 27 is written to the temporary storage memory 28 and then transferred to the memory card 29. As a result, JPEG data is recorded on the memory card 29 (predetermined recording means) together with RAW image data as a photographed image.

<Structure of main part of image display device 3>
FIG. 5 is a diagram illustrating a main configuration of the image display device 3.

  The image display device 3 includes a personal computer (hereinafter referred to as “PC”) 4 and a card reader 5 that is connected to the PC 4 via a USB cable CB and reads data from the memory card 29 (FIG. 1).

  The PC 4 includes a main body unit 40, a display unit 41 configured with, for example, a liquid crystal display and capable of displaying an image, and an input unit 42 having a mouse 421 and a keyboard 422.

  The main body 40 includes a CPU and a memory that function as a computer, and application software for image display (hereinafter referred to as “image display software”) is installed on the hard disk. This image display software (image display program) browses images stored in a hard disk (fixed storage device) or removable media in the main body 40, and supports narrowing down images after confirming exposure, composition, focus, etc. Software. When this image display software is executed by a computer built in the image display device 3, an image file photographed by the imaging device 2 and recorded on the memory card 29 is read from the card reader 5 and displayed on the display unit 41. It becomes possible.

  When the image display software is activated, a window screen (hereinafter referred to as “main window”) Mo having a GUI (Graphical User Interface) shown in FIG. The main window Mo is roughly divided into the following four areas.

(1) Folder tree structure area (folder tree area) Ma
(2) Area for displaying a list of thumbnail images stored in the folder selected in the folder tree area Ma (thumbnail image display area) Mb
(3) Area (histogram display area) Mc for displaying the histogram of the image selected by the mouse 421 or the like
(4) Area (preview image display area) Md for displaying a medium-sized image (preview image) selected by the mouse 421 or the like
The function of the image display software having the main window Mo will be described in detail.

  A memory card 29 on which an image taken by the imaging device 2 is recorded is set in the card reader 5 and the image file is transferred to the hard disk in the main body 40 of the PC 4. As a result, the RAW image and JPRG data as the captured image are acquired by the image display device 3.

  After the image file is transferred to the hard disk, when the image file transfer destination folder is selected with the mouse 421 for the folder group displayed in the folder tree area Ma of the main window Mo, thumbnails related to all the image files in the selected folder. A list of images is displayed in the thumbnail image display area Mb. As for the thumbnail image, the thumbnail image recorded in the header portion Fa of the image file shown in FIG. 4 is read and displayed.

  When one image is designated from the list of thumbnail images displayed in the thumbnail image display area Mc with the mouse 421 or the like, a histogram of the image is displayed in the histogram display area Mc, and a preview image of the image is displayed in the preview image display area Md. Is displayed. This preview image is a reduced image so that the entire captured image (full size image) is displayed in the preview image display area Md, and is developed by subjecting the CCD-RAW data Fc (FIG. 4) to pixel thinning. Is generated. The composition can be confirmed by viewing the preview image displayed in this manner, and the exposure can be confirmed from the preview image and the histogram displayed in the histogram display area Mc.

  The loupe function is used to check the focus of the captured image in the image display software. With the loupe function, when the mouse pointer Pt is placed on an arbitrary position on the thumbnail image displayed in the thumbnail image display area Mb and clicked, the details of the photographed image centered on the mouse pointer Pt are referred to as the main window Mo. This is a function for enlarging and displaying in another child window Wn. In this child window Wn, it is possible to display not only the currently displayed image portion but also the surrounding image portion by dragging the mouse pointer Ph to an arbitrary position on the display image.

  The operation of the image display device 3 related to the above loupe function will be specifically described.

  FIG. 7 is a flowchart showing the basic operation of the image display device 3.

  In step S1, the mouse pointer Pt is placed on the thumbnail image displayed in the thumbnail image display area Mb shown in FIG. By this click, the loupe function is turned on (activated) as described above, and the part of the captured image to be enlarged is designated.

  In step S2, a display area centered on the point clicked in step S1 is calculated based on the full-size image (captured image). Specifically, the coordinates of the mouse pointer Pt at the time of clicking are acquired, and a display area (a part of the captured image) for enlarging and displaying in the child window Wn of FIG.

  In step S3, is the display area calculated in step S2 within the range of the partial image (hereinafter referred to as “display partial image”) Ga (FIG. 3) recorded in the display JPEG data Fb of FIG. Determine. If the display area is within the range of the display partial image, the process proceeds to step S4. If not, the process proceeds to step S5. Specifically, for example, as shown in FIG. 8, when the display area Ds is within the display partial image Ta included in the full-size image To, the process proceeds to step S4, and the display is performed as shown in FIG. If the area Ds is out of the range, such as when protruding from the display partial image Ta, the process proceeds to step S5.

  In step S4, the display file JPEG data Fb shown in FIG. 4 is read into the memory in the main body 30, and enlarged image data corresponding to the display area Ds (FIG. 8) is generated based on the display JPEG data Fb. . That is, the display area Ds is extracted from the RGB image obtained by decompressing the display JPEG data.

  By the operation in step S4, the portion of the captured image specified in steps S1 and S2 can be displayed on the display unit 41 based on the partial image obtained by decompressing the display JPEG data (compressed image data) Fb. Detailed display can be performed quickly and appropriately.

  In step S5, the CCD-RAW data Fc of the image file shown in FIG. 4 is read into the memory in the main body 30, and the display area Ds () is based on the CCD-RAW data Fc and the parameters written in the header part Fa. The image portion corresponding to FIG. 9) is subjected to image processing including pixel interpolation to generate enlarged image data of the RGB image. As described above, when the part of the photographed image specified in steps S1 and S2 includes an image part other than the display partial image Ta, this part can be displayed based on the RAW image, and thus the entire range of the photographed image is displayed in detail. Can be performed.

  In step S6, enlarged display is performed based on the enlarged image data generated in step S4 or step S5 (details will be described later).

  In step S7, it is determined whether the loupe function is turned off. Specifically, it is determined whether or not the mouse 421 has performed an operation of closing the child window Wn. If the loupe function is not turned off, step ST6 is repeated. When the loupe function is turned off, the process exits this flow.

  FIG. 10 is a flowchart showing an enlarged display operation corresponding to step S6.

  In step S11, it is determined whether a drag operation has been performed on the display image of the child window Wn using the mouse 421. If a drag operation has been performed, the process proceeds to step S12. If a drag operation has not been performed, the process proceeds to step ST16.

  In step S12, the display area is calculated based on the drag operation in step S11. Specifically, the coordinates at the end of the drag when the display position is moved by the drag operation are acquired, and the display area is obtained around this coordinate.

  In step S13, it is determined whether the display area calculated in step S12 is within the range of the display partial image recorded in the display JPEG data Fb in FIG. If the display area is within the range of the display partial image, the process proceeds to step S14. If not, the process proceeds to step S15.

  In steps S14 and S15, the same operations as in steps S4 and S5 described above are performed to create enlarged image data.

  In step S16, based on the enlarged image data generated in step S14 or S15, the image portion corresponding to the display area Ds (FIGS. 8 to 9) in the captured image is displayed in the child window Wn (FIG. 6) at the same magnification. . Thereby, since the detail of a picked-up image is expanded, a user can perform a focus confirmation appropriately.

  After the user's focus confirmation is completed, it is possible to classify each image by assigning four ranks (best shot, better, good, NG) according to the focus state in the main window Mo. This ranking is performed by selecting one of the four color rank buttons Rb arranged at the top of the thumbnail image Th shown in FIG. The upper part of the thumbnail image display area Mb is provided with tabs Rt corresponding to four types of ranks. When the user clicks a tab Rt of a rank that the user wants to display, only the image of that rank is displayed in the thumbnail image display area. It is displayed in Mb. Such a function of the main window Mo makes it easy for the user to narrow down images.

  With the operation of the image display device 3 described above, the enlarged display of the captured image is performed based on the display partial image of the JPEG data added to the RAW image as the captured image, so that the detailed display of the captured image can be performed quickly and appropriately.

  The details of the captured image that the user confirms for checking the focus and the like often correspond to an important part of the subject, but this important part rarely exists at the end of the captured image. Therefore, in this embodiment, as the display RGB image to be added to the RAW image, not the full-size image that covers the entire shooting range, but the four sides at the end of the shot image that are extremely unlikely to be checked are removed. The partial image thus obtained was subjected to compression processing. As a result, the size (storage capacity) of the display image added to the RAW image can be suppressed, and detailed display of the captured image can be performed at a comfortable speed.

<Modification>
For the display JPEG data in the above embodiment, it is not essential to extract and create the central part of the photographed image. For example, the display JPEG data should be created around an area of a specific color such as an AF area or a skin color. Also good. This AF area can also be used when it is desired to focus on a main subject SB such as a person who is not in the center of the image, as in the area EA shown in FIG. 11, and the difference in contrast of the image in this area EA is obtained. An AF operation can be performed as an evaluation value. In this way, by extracting and compressing the image part centering on the AF area (focusing area) used for the focusing operation when shooting the captured image, compression including the image part necessary for focus confirmation is performed. Image data can be generated appropriately.

  When based on the AF area, AF information may be recorded in an image file, and only the AF area may be trimmed to create display JPEG data.

  In the trimming process of the above embodiment, it is not essential that Yc and Xc to be removed (FIG. 3) be about 20% of Ya and Xa, and Yc and Xc should be about 10% of Ya and Xa. good. In this case, the ratio of the total number of pixels increases to 70% with respect to the full-size photographed image, but since the line ratio can cover 83%, there are almost no cases where it is necessary to develop the RAW image data.

  In the above embodiment, it is not essential that the image display software is executed by a personal computer, and it may be executed by an imaging device (camera). In this case, it is possible to check and evaluate an image captured by the imaging apparatus, and convenience is improved.

  For the loupe function of the above embodiment, it is not essential to display a partial image at the same magnification (100% display), and even a 50% display or the like may correspond to the detailed display of the photographed image.

It is a functional block diagram which shows the principal part structure of the imaging device 2 which concerns on embodiment of this invention. 3 is a diagram illustrating a color filter arrangement of the imaging unit 12. FIG. It is a figure for demonstrating the trimming process of a picked-up image. It is a figure which shows the structure of an image file. It is a figure which shows the principal part structure of the image display apparatus 3 which concerns on embodiment of this invention. It is a figure which shows the main window Mo of image display software. 3 is a flowchart showing a basic operation of the image display device 3. 6 is a diagram for explaining the operation of the image display device 3. FIG. 6 is a diagram for explaining the operation of the image display device 3. FIG. It is a flowchart which shows an enlarged display operation | movement. It is a figure for demonstrating AF area EA which concerns on the modification of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image reproduction system 2 Imaging device 3 Image display device 4 Personal computer (PC)
5 Card reader 22 Imaging unit 25 Trimming processing unit 26 JPEG encoder unit 27 File creation unit 29 Memory card 421 Mouse Ds Display area Fa Header part Fb Display JPEG data Fc CCD-RAW data Mb Thumbnail image display area Md Preview image display area Mo Main window Pt Mouse pointer Ta Partial image for display Wn Child window

Claims (9)

An image display device having display means capable of image display,
(a) an acquisition means for acquiring a RAW image as a captured image and compressed image data obtained by compressing a partial image corresponding to a part of the captured image;
(b) a designation means for designating a part of the captured image;
(c) based on the partial image obtained by decompressing the compressed image data, display control means for causing the display means to display a portion of the photographed image designated by the designation means;
With
The image display apparatus according to claim 1, wherein the partial image is a part of an image obtained by performing image processing including pixel interpolation on the RAW image. The image display device according to claim 1,
The image display apparatus according to claim 1, wherein the partial image is an image portion centered on a central portion of the captured image. The image display device according to claim 1,
The image display apparatus according to claim 1, wherein the partial image is an image portion centered on a focusing area used for a focusing operation when the captured image is captured. The image display device according to any one of claims 1 to 3,
The display control means includes
(c-1) means for displaying the portion of the photographed image based on the RAW image when the portion of the photographed image designated by the designation means includes an image portion other than the partial image;
An image display device comprising: The image display device according to any one of claims 1 to 4,
The display control means includes
(c-2) means for displaying the portion of the photographed image designated by the designation means at the same magnification on the display means;
An image display device comprising:   An image display program for causing an image display device to function as the image display device according to any one of claims 1 to 5 by being executed by a computer incorporated in the image display device. An imaging apparatus capable of recording an image on a predetermined recording means,
(a) imaging means for imaging a subject and generating a captured image;
(b) compression processing means for generating compressed image data obtained by compressing a partial image corresponding to a part of the photographed image;
(c) a recording control means for recording the compressed image data in the predetermined recording means together with the RAW image as the captured image;
With
The imaging apparatus according to claim 1, wherein the partial image is a part of an image obtained by performing image processing including pixel interpolation on the RAW image. The imaging apparatus according to claim 7,
The imaging device according to claim 1, wherein the partial image is an image portion centered on a central portion of the captured image. The imaging apparatus according to claim 7,
2. The imaging apparatus according to claim 1, wherein the partial image is an image portion centered on a focusing area used for a focusing operation when the captured image is captured.

Images