JP2008204182A - Image processor, control method, program and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processor, capable of attaining both speed-up of processing for displaying an image and high-quality image display, and a control method, a program and a storage medium therefor. <P>SOLUTION: In the information processor, a CPU 101 executes the following processing by a control program. Half decode processing is performed in a main thread to acquire 1/2 resolution RAW data. Developing processing is performed based on a developing parameter, and variable magnification processing is performed based on a display resolution to display an image on a display part 108. When the display resolution is not less than 100%, full decode processing is started in a sub-thread. In the full decode processing, full-resolution RAW data are acquired, and the 1/2 resolution RAW data are discarded and substituted by the full-resolution RAW data. When the display resolution is less than 100%, the developing processing is started over, when a change occurs in the image to be displayed on the display part 108, to update the display. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image processing apparatus that performs image processing on image data to be displayed, a control method, a program, and a storage medium.

  Conventionally, in an imaging device such as a digital still camera, an electrical signal of a photographed image obtained by photoelectrically converting an optical image of a subject using an image sensor such as a CMOS type or a CCD type is converted into digital data and stored as RAW image data. Some have the function to do. In this type of imaging apparatus, color interpolation processing, gamma correction processing, white balance adjustment processing, and the like are performed on RAW image data (hereinafter referred to as RAW data) to create an image to be printed out by an image output device such as a printer.

  Since the imaging device has a structure in which receptors for receiving R, G, and B colors are regularly arranged, digital data stored as RAW data has the same arrangement. The arrangement rule includes, for example, a Bayer arrangement (color arrangement made up of a plurality of pixels having different periodicities) in which R, G, and B colors are arranged as shown in FIG. FIG. 6 is a diagram illustrating the arrangement of the pixels in the Bayer array.

  Here, a method for indicating each pixel position in the Bayer array will be described with reference to FIG. FIG. 7 is a diagram illustrating a method for specifying each pixel in the Bayer array. In the two-dimensional Bayer array as shown in FIG. 7, the rows and columns have the upper left as the origin, the right direction is 1, 2,..., The second column, the lower direction is 1, 2,. It shall be counted as 2n line.

  A Bayer array is divided into two rows and two columns, and a group of 2 × 2 pixels is called a block. An array with a block as one unit is called a block array. That is, a Bayer array having 2m × 2n pixels is an m × n block array. Bayer array rows and columns are referred to as pixel rows and pixel columns, respectively, and block array rows and columns are referred to as block rows and block columns, respectively. The i-th block column includes pixel columns 2i-1 and 2i, and the j-th block row includes 2j-1 rows and 2j-th pixel rows.

The four pixels included in the i-th column and j-th block are R _{(i, j)} , G _{(i, j) a} (upper left in the block), G _{(i, j) b} (upper left in the block), B _It shall be expressed as _{(i, j)} . In the present specification, hereinafter, the above-mentioned rule is used when designating each pixel in the Bayer array.

  When creating an RGB image from Bayer array RAW data, an RGB image having a resolution of 2m × 2n is generally created from RAW data having a resolution of 2m × 2n. At this time, since each pixel has only one color information, the other color information of each pixel is interpolated from the color information of surrounding pixels.

For example, the values of G and B in the pixel of R _{(2, 2)} in FIG. 7 are set as G = (G _{(2, 1) b} + G _{(2, 2) a} + G _{(3, 2) a} + G _{( 2, 2) b} ) / 4, B = (B _{(2, 1)} + B _{(3, 2)} + B _{(2, 2)} + B _{(3, 2)} ) / 4 There is an average method. In this case, the values of R and G in the pixel of B _{(2, 2)} are similarly R = (R _(1/2) + R _{(2, 2)} + R _{(1, 3)} + R _{(2, 3 )} ) / 4, G = (G _{(2,2) a} + G _{(1/2) b} + G _{(2,2) b} + G _{(2,3) a} ) / 4. The values of R and B in the pixel of G _{(2, 2) a} are R = (R _(1/2) + R _{(2, 2)} ) / 2, B = (B _{(2, 1)} + B _{(2 2) It} can be calculated by the average of two surrounding pixels as in) / 2. This method is hereinafter referred to as “full decoding”.

  However, the resolution of an image taken with a digital still camera (hereinafter referred to as a digital camera) is very high, and the pixel interpolation processing of RAW data requires a very long time. Therefore, various devices have been devised for speeding up processing in an imaging apparatus such as a digital still camera that handles RAW data.

  For example, in order to speed up the creation of a reduced RGB image, there is a method of directly obtaining an RGB image having the original 1/4 pixel number when performing pixel interpolation of RAW data. This method is hereinafter referred to as “half decoding”.

  Conventionally, when a reduced image is created from RAW data having a resolution of 2m × 2n, an RGB image having a resolution of 2m × 2n is once created, and a reduced image is created therefrom. In half-decoding, as shown in FIG. 8, an RGB image of m × n resolution is directly created from RAW data of 2m × 2n resolution by setting one block of RAW data as one pixel of the RGB image. Accelerate the creation of reduced RGB images.

  An example of a pixel interpolation method when half decoding is performed will be described with reference to FIG. FIG. 9A shows a pixel array included in a block in the i-th column and j-th row of RAW data and 8 blocks around the block. FIG. 9C shows a reduced RGB image obtained by interpolating FIG. 9A. In FIG. 9B, the pixels of the RAW data that are referred to when calculating the R, G, and B values of the pixels in the i-th column and the j-th row of the reduced RGB image are represented by diagonal lines.

If the R, G, and B values of the pixel in the i-th row and j-th row of the reduced RGB image are R ′ _{(i, j)} , G ′ _{(i, j)} , and B ′ _{(i, j)} , respectively, each value Refer to the pixels indicated by diagonal lines in FIG.
R´ _{(i, j)} = R _{(i, j)}
G ′ _{(i, j)} = (G _{(i, j) a} + G _{(i, j) b} ) / 2 (1)
B´ _{(i, j)} = B _{(i, j)}
Can be calculated.

The following techniques have been proposed as prior art in the technical field (see, for example, Patent Document 1, Patent Document 2, and Patent Document 3).
JP 2003-348335 A JP 2004-056441 A JP 2006-227698 A

  However, when an RGB image is generated from the Bayer array RAW data, full decoding has a slow processing speed, and half decoding has a problem that display image quality at a display resolution of 100% display or higher is bad. Conventionally, in general, it has been decided whether to use full decoding or half decoding at the time of design according to the application software application, or which one to use based on the option when executing the application software. Accordingly, it has been difficult to properly select full decoding and half decoding particularly in an apparatus in which an operator can freely change the screen resolution when executing application software.

  According to Patent Document 1 (Japanese Patent Application Laid-Open No. 2003-348335), a full-decoded image created by full-decoding is reduced to create a reduced image. The reduced image is first developed and displayed, and then the full-decoded image is developed. indicate. Although this method can shorten the development time, since the most time-consuming pixel interpolation process is executed first, there is a problem in that the time required to display an image cannot be sufficiently increased.

  According to Patent Document 2 (Japanese Patent Application Laid-Open No. 2004-056441), a thumbnail image of an image to be processed is created and embedded in a file to display an image at high speed. This method first displays a thumbnail image of a bitstream that is independent of a RAW image, and does not need to be decoded for simple image confirmation, and the decoding itself cannot be accelerated. There was a problem.

  Further, according to Patent Document 3 (Japanese Patent Laid-Open No. 2006-227698), half decoding and full decoding are switched according to display resolution or printing resolution. This method has a problem that it cannot be applied to an apparatus in which the operator can freely change the screen resolution when the application is executed as described above.

  An object of the present invention is to provide an image processing apparatus, a control method, a program, and a storage medium capable of realizing both high-speed processing until an image is displayed and high-quality image display.

  To achieve the above object, an image processing apparatus of the present invention is an image processing apparatus that generates an image from an image signal of an original image composed of pixels of a plurality of colors having different periodicity of color arrangement, and the image signal A storage means for storing a compressed image signal obtained by compressing the compressed image signal, a signal processing means for decoding the compressed image signal, and a reduced image obtained by reducing the original image by thinning out the image signal decoded by the signal processing means. A first image generating means, a second image generating means for generating an equal-sized image having the same size as the original image by subjecting the image signal decoded by the signal processing means to pixel interpolation, and an image to be displayed on the display means. A resolution designating unit for designating the display resolution, a display of the reduced image generated by the first image generating unit based on the display resolution designated by the resolution designating unit, And switching means for switching a display of the equal-magnification image generated by the second image generating means, characterized in that it comprises a.

  According to the present invention, on the basis of the designated display resolution, a reduced image is displayed by reducing the original image by thinning out the decoded image signal, and the decoded image signal is interpolated by the pixel to be the same size as the original image. Switch between the same size image display. As a result, it is possible to realize both high-speed processing until an image is displayed and high-quality image display.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing a configuration of an information processing apparatus as an image processing apparatus according to the first embodiment of the present invention.

  In FIG. 1, the information processing apparatus 100 is configured as, for example, a personal computer (hereinafter referred to as a PC), and includes a CPU 101, a ROM 102, a RAM 103, and a hard disk drive (hereinafter referred to as an HDD) 104. The information processing apparatus further includes a floppy (registered trademark) disk drive (hereinafter referred to as FDD) 105, a keyboard 106, a mouse 107, a display unit 108, and a printer interface (hereinafter referred to as printer I / F) 109.

  The CPU 101 controls the entire information processing apparatus, and executes various processes including a process shown in a flowchart of FIG. 4 described later by executing a control program. The ROM 102 stores a control program. The RAM 103 provides a work area and a temporary storage area for the CPU 101, and caches Bayer data and compressed RAW data described later. The HDD 104 stores the compressed RAW data so that it can be written to and read from the HD. Note that the control program may be stored in the HD of the HDD 104.

  The FDD 105 stores arbitrary data so that it can be written to and read from the FD. A keyboard 106 and a mouse 107 are used to input various data and various instructions to the information processing apparatus, respectively. The display unit 108 displays a screen shown in FIG. 2, which will be described later, by a CRT display method or a liquid crystal display method based on control by the CPU 101. The printer I / F 109 manages an interface between the information processing apparatus 100 and the printer 200.

  FIG. 2 is a diagram illustrating a screen configuration example of application software of the information processing apparatus.

  In FIG. 2, the application software screen is displayed on the display unit 108, and includes an image display area 61, a display resolution designation slider 62, an image adjustment slider 63, and scroll bars 64 and 65. The display resolution designation slider 62 is operated by the operator via the mouse 107 or the like when designating the display resolution. The image adjustment slider 63 is operated by the operator via the mouse 107 or the like when determining development parameters to be described later. The scroll bars 64 and 65 are operated by the operator via the mouse 107 or the like when controlling the position of the image in the image display area 61.

  The HDD 104 stores the compressed RAW data as described above. The CPU 101 processes RAW data according to a procedure described later to generate an image suitable for display on the display unit 108 and displays the image in the image display area 61.

  The operator uses the display resolution designation slider 62 to select the resolution at which the image is to be displayed. In the example of FIG. 2, the display resolution designation slider 62 is set at the “Fit” position, so that the image display area 61 is scaled and displayed so that the entire image just fits. When the display resolution designation slider 62 is set to the “50%” position, the image data is reduced to 50% and displayed in the image display area 61. The same applies when the positions are set to “100%” and “200%”.

  Here, when an image is displayed in the image display area 61, the entire image does not necessarily fit in the display area 61. Therefore, when the image is larger than the image display area 61, the operator uses the scroll bars 64 and 65 to scroll the display part of the image display area 61 so that a desired part of the image is displayed.

  The image adjustment slider 63 is operated when determining development parameters (image adjustment parameters) to be applied to an image in development processing described later. The development parameter is a numerical value that determines exposure, for example. The larger the value of the development parameter, that is, the more the image adjustment slider 63 is moved to the right, the brighter the entire image is displayed in the image display area 61.

  On the other hand, as the numerical value of the development parameter is smaller, that is, as the image adjustment slider 63 is moved to the left, the image is displayed in the image display area 61 in a state where the entire image becomes dark. The operator can adjust the exposure of the image to be appropriate by operating the image adjustment slider 63 while viewing the image display area 61 displayed on the display unit 108.

  Next, the operation of the information processing apparatus of the present embodiment having the above configuration will be described in detail with reference to FIGS.

  First, the flow of RAW development processing in the information processing apparatus will be described with reference to FIG.

  FIG. 3 is a diagram illustrating a data flow of RAW development processing in the information processing apparatus.

  In FIG. 3, compressed RAW data 71 is image data captured by a digital camera (not shown), and is stored in the HDD 104. The decoded RAW data expanded from the compressed RAW data 71 in the compressed state, that is, the Bayer data 72 described above is cached in the RAM 103. Up to this point, the processing is common to half decoding and full decoding, but thereafter, the processing proceeds to separate processing for half decoding and full decoding.

  The upper part of FIG. 3 shows the flow of the half decoding process. The Bayer data 72 becomes ½ resolution RAW data 73 by the reduction process (pixel thinning process) already described. The 1/2 resolution RAW data 73 is color space data based on the characteristics of the image sensor of the digital camera, and is not suitable for display on the display unit 108 as it is. Therefore, known gain correction processing, gamma correction processing, and white balance correction processing are performed on the ½ resolution RAW data 73 to convert the half-resolution RAW data 73 into known sRGB color space data suitable for screen display of the display unit 108. Hereinafter, these processes are collectively referred to as a development process.

  The value of the image adjustment slider 63 displayed on the display unit 108 is applied as a development parameter when executing a gain correction process included in the development process. Accordingly, different development results can be obtained in accordance with instructions based on the operation of the image adjustment slider 63 by the operator. Processing parameters can also be received for gamma correction processing and white balance processing, and a separate user interface may be provided on the display unit 108 and an operator may instruct.

  The half-resolution RAW data 73 becomes a half-decoded image 74 through the above development process. The half-decoded image 74 is subjected to a scaling process such as a known bilinear interpolation process according to the display resolution specified by the display resolution specifying slider 62 by the operator, and is displayed in the image display area 61 of the display unit 108. .

  At this time, it is considered that the half-decoded image 74 has already been reduced to the original display resolution of 50%. In other words, when the display resolution designation slider 62 indicates “50%”, since the display resolution is already appropriate, scaling is not necessary. When the display resolution designation slider 62 indicates “200%”, the display resolution is set to 200% in total by performing the 4 × enlargement interpolation process. The same applies to other display resolutions.

  The lower part of FIG. 3 shows the flow of the full decoding process. The Bayer data 72 becomes full resolution RAW data 75 by the pixel interpolation processing already described. The full resolution RAW data 75 is subjected to a false color mitigation process using a known smoothing filter or the like, and then undergoes the above development process to become a full decoded image 77. The full-decoded image 77 is subjected to a scaling process such as a known bilinear interpolation process according to the display resolution designated by the display resolution designation slider 62 by the operator, and is displayed in the image display area 61 of the display unit 108. .

  Here, the full resolution RAW data 75 in the full decoding process has a display resolution of 100% unlike the half resolution RAW data 73 in the half decoding process. Therefore, for example, when the display resolution designation slider 62 indicates “50%”, a reduction process of 1/2 is performed according to the value.

  As will be described later, the full decoding process is always executed after the half decoding process. Therefore, the Bayer data cached in the RAM 103 when the half decoding process is performed can be used for the full decoding process, and therefore it is not necessary to perform the decompression process again when the full decoding process is performed. By adopting such a configuration, it is possible to reduce the decompression process and reduce the load on the entire process.

  Next, half decoding processing and full decoding processing in the information processing apparatus will be described with reference to FIG.

  FIG. 4 is a flowchart showing a flow of half decoding processing and full decoding processing in the information processing apparatus.

  In FIG. 4, the CPU 101 of the information processing apparatus performs half-decoding processing in the main thread to obtain 1/2 resolution RAW data 73 (step S101). Next, the CPU 101 performs development processing based on a development parameter (image adjustment parameter) that is an adjustment value of the image adjustment slider 63 set by the operator (step S102). Next, the CPU 101 performs an image scaling process based on the display resolution that is an adjustment value of the display resolution designation slider 62 set by the operator, and displays the image in the image display area 61 of the display unit 108 (step). S103).

  Next, the CPU 101 determines whether or not the adjustment value (display resolution) of the display resolution designation slider 62 set by the operator is less than 100% (step S104). When it is determined that the display resolution is less than 100%, the process proceeds to step S106, and when it is determined that the display resolution is not less than 100%, the process proceeds to step S105. In the present embodiment, the display resolution is less than 100% when the value of the display resolution designation slider 62 indicates “50%”.

  Further, when the value of the display resolution designation slider 62 indicates “Fit”, the following may be performed. That is, by comparing the number of pixels of the image display area 61 with the number of pixels of the image data, and determining whether the number of pixels of the image data is smaller than the number of pixels of the image display area 61, it becomes more strict. It may be determined whether the display resolution is less than 100%.

  When the display resolution is not less than 100%, the CPU 101 activates a sub thread to start full decoding processing (step S105), and proceeds to step S106. When it is determined in step S104 that the display resolution is less than 100% or when step S105 is completed, the CPU 101 determines whether or not the display resolution has changed due to the operation of the display resolution designation slider 62 by the operator (step S106). If it is determined that the display resolution has changed, the process returns to step S102. If it is determined that the display resolution has not changed, the process proceeds to step S107.

  If the display resolution has not changed, the CPU 101 determines whether or not the development parameter has changed due to the operation of the image adjustment slider 63 by the operator (step S107). If it is determined that the development parameter has changed, the process returns to step S102. If it is determined that the development parameter has not changed, the process proceeds to step S108.

  If the development parameters have not changed, the CPU 101 determines whether or not the main image has been replaced by a sub-thread full decoding process described later (step S108). If it is determined that the main image has been replaced, the process returns to step S102. If it is determined that the main image has not been replaced, the process proceeds to step S109.

  When the main image is replaced, the CPU 101 determines whether to end the main thread (step S109). When it is determined that the main thread is to be terminated, the main thread is terminated, and when it is determined that the main thread is not to be terminated, the process returns to step S106. That is, from step S106 to step S109, a loop for monitoring the operation of the operator and the operation by the sub thread is formed, and when the image to be displayed in the image display area 61 changes, the development process is performed again. Control to update the display.

  When the sub thread is activated in step S105 of the main thread, the CPU 101 performs full decoding processing in the sub thread to obtain full resolution RAW data 75 (step S151). As already described, since the Bayer data 72 is cached in the RAM 103, the process of decompressing the compressed RAW data can be omitted. Next, the CPU 101 discards the 1/2 resolution RAW data 73 to be developed in the main thread, replaces it with the full resolution RAW data 75 (step S152), and ends the sub thread. The process of step S152 is hereinafter referred to as “main image replacement”.

  By the processing on the sub thread side, when viewed from the operator, the image displayed in the image display area 61 of the display unit 108 appears to change to a high-definition image asynchronously with the operation of the operator himself. However, since the original RAW data is the same and the same development processing is performed in step S102, the image change is minute and does not hinder the operator's work.

  In addition, when an image is displayed with a display resolution originally reduced to less than 100%, the change in the image becomes even finer and the difference is hardly discernable by the operator. Therefore, if the display resolution is less than 100% as judged on the main thread side, the sub thread is not activated, and therefore the main image is not replaced. Thus, by omitting useless full decoding processing, the processing load on the entire system is reduced.

  Next, a difference between a system using both half decoding and full decoding according to the present embodiment and a system using only half decoding or full decoding as conventionally performed will be described.

  A conventional system using only half decoding has a problem that when the display resolution is 100% or 200%, the image resolution is not sufficient and the image quality is lowered. In addition, in the conventional system using only full decoding, since it takes time until the image is displayed after full decoding is started, there is a problem that the work efficiency of the operator is lowered.

  On the other hand, in this embodiment, first, half decoding is performed, and development processing and display processing are performed. As a result, an image can be displayed quickly, and the operator's work is not hindered. Also, full decoding is performed while the operator is performing image adjustment and the like, and when the preparation is completed, the main image is replaced and the display is updated. As a result, even when the operator performs more detailed work such as verifying the details of the image by increasing the display resolution, the image quality does not appear to be degraded. With the above operation, it is possible to realize both high-speed processing of the display target image and high-quality image display.

  In addition, the system of the present embodiment and so-called thumbnail data for simple display separately from the image main body, which has been separately performed in the past, are held, the thumbnail image is once displayed on the screen, and the decoding of the image main body is completed. Differences from the system that replaces images at the time will be described.

  The conventional system has the following problems. The display of the thumbnail image is only for simple display, and generally has a resolution and image quality that is very different from the main image, so it is difficult to adjust the image while viewing the thumbnail image. . Also, the work is not completed with only the thumbnail image enlarged and displayed on the screen, and the main image must be decoded and replaced.

  On the other hand, in the present embodiment, the operation can be performed without any problem even while the half-decoded image is displayed. In addition, when the half-decoded image is sufficient for display, full decoding is not performed, so that there is an effect that the overall processing load can be reduced while improving work efficiency.

  Further, in the present embodiment, the half-decoding and the full-decoding process are the same until the middle, so the Bayer data 72 is cached in the RAM 103. Thereby, the load is further reduced by not repeating the same process. Since the thumbnail data is a bit stream that is generally independent of the main image data (image main body), the conventional method cannot obtain such an effect.

  In this respect, a conventional system that performs display step by step using so-called hierarchical code data such as FlashPix and JPEG2000, which are standard encoding methods, is equivalent to a conventional system that uses thumbnail data. In the hierarchical code image, the bit stream is separated for each resolution. In FlashPix, it is a completely independent bitstream. In JPEG2000, some bitstreams can be shared by configuration. In any case, it is not possible to have the same bit stream between layers.

  Therefore, in the conventional system, as the Bayer data 72 is cached in the present embodiment, the data being processed cannot be reused, and the load on the entire system cannot be reduced sufficiently.

  In contrast, in the present embodiment, the unique property of Bayer array RAW data captured by a digital camera is used. This makes it possible to achieve both high-speed display of an image and high-quality image display, which was impossible with a conventional system using thumbnail data and hierarchical code data.

  As described above, according to the present embodiment, first, half decoding is performed to display an image on the display unit 108, full decoding is further performed, and the display image on the display unit 108 is replaced. Further, in accordance with the current display resolution, full decoding is not performed when the resolution of the half-decoded image is sufficient, and full decoding is performed when the display resolution becomes high, and the display image on the display unit 108 is replaced. Since half decode and full decode use common data, the decoded RAW data obtained by decoding the compressed image is cached. That is, the processing is further speeded up by not repeatedly performing the decoding process. As a result, it is possible to realize both high-speed processing until an image is displayed and high-quality image display.

[Second Embodiment]
The second embodiment of the present invention is different from the first embodiment in which the compressed RAW data is cached after decoding in the point described with reference to FIG. The other elements of the present embodiment are the same as the corresponding ones of the first embodiment (FIGS. 1 and 2), and thus description thereof is omitted.

  FIG. 5 is a diagram showing a data flow of RAW development processing in the information processing apparatus according to the present embodiment.

  5 differs from FIG. 3 only in the use of the cache, and the difference will be mainly described. In this embodiment, the compressed RAW data read from the HDD 104 is cached, and the cached compressed RAW data is repeatedly decoded as necessary. That is, when displaying an image on the display unit 108, half decoding is first executed. At this time, the compressed RAW data 71-1 of the HDD 104 is cached in the RAM 103. Thereafter, when full decoding is performed, the cached compressed RAW data 71-2 is again decoded and used.

  Since the present embodiment is different from the first embodiment in that the decoding process is performed twice, the processing speed is reduced. However, since the compressed RAW data cached in the RAM 103 is in a compressed state and has a small amount of data, the capacity of the RAM 103 required for processing can be saved and the cost can be reduced. Therefore, an appropriate embodiment may be selected in consideration of both processing speed and cost.

  Also, the present embodiment and the first embodiment are not necessarily implemented exclusively, and the two embodiments are switched as appropriate with reference to the free capacity of the RAM 103 when processing is executed. You may do it. That is, the first embodiment may be employed when the RAM 103 has a sufficiently large free space, and the present embodiment may be employed when the RAM 103 has a small free space. The reason is that, particularly when the present invention is implemented on a general-purpose PC, the free capacity of the RAM 103 changes dynamically depending on the state of other processes being executed simultaneously.

  As described above, according to the present embodiment, since the common data is used for half decoding and full decoding, the compressed image data read from the HDD 104 is cached in the RAM 103. That is, the processing is further speeded up by not repeatedly reading out the image data. As a result, it is possible to realize both high-speed processing until an image is displayed and high-quality image display.

[Other embodiments]
In the above embodiment, the configuration is such that when the full decoding process is executed, the half-decoded image is discarded and replaced, but the present invention is not limited to this. It is also possible to store both the full-decoded image and the half-decoded image and determine which image to use as appropriate according to the display resolution. For example, if there are both a full-decoded image and a half-decoded image at a display resolution of 40%, it is more effective to reduce the half-decoded image to 80% than to reduce the full-decoded image to 40%. The time required is short and the image quality is good.

  Moreover, although the said embodiment has considered the process in PC, it is not limited to this. For example, the present invention can also be applied when an image is displayed on the liquid crystal display unit on the back side of the digital camera. In this case, the display unit 108 of the PC may be appropriately replaced with a liquid crystal display unit on the back of the digital camera, the keyboard 106 may be replaced with operation buttons, and the HDD 104 may be replaced with a flash memory.

  In the above embodiment, depending on the type of RAW data and the like, full decoding may not always be a very heavy process. For example, when processing RAW data with a small number of pixels in an image taken with an old or low-priced digital camera, or when the full decoding process itself is set to a simple setting. In such a case, the entire half decoding process is simply wasted, so it is only necessary not to perform half decoding. Specifically, since the number of pixels of the image is known when the compressed RAW data is read from the HDD 104, half-decoding is not performed when the number of pixels is smaller than an appropriately determined threshold, and full decoding is performed from the beginning. You can do it.

  The object of the present invention is achieved by executing the following processing. That is, a storage medium storing software program codes for realizing the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus is stored in the storage medium. This is a process of reading the program code.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code and the storage medium storing the program code constitute the present invention.

  Moreover, the following can be used as a storage medium for supplying the program code. For example, floppy (registered trademark) disk, hard disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM or the like. Alternatively, the program code may be downloaded via a network.

  Further, the present invention includes a case where the function of the above-described embodiment is realized by executing the program code read by the computer. In addition, an OS (operating system) running on the computer performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Cases are also included.

  Furthermore, the present invention includes a case where the functions of the above-described embodiment are realized by the following processing. That is, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing.

It is a block diagram which shows the structure of the information processing apparatus as an image processing apparatus which concerns on the 1st Embodiment of this invention. FIG. 3 is a diagram illustrating a screen configuration example of application software of the information processing apparatus. FIG. 10 is a diagram illustrating a data flow of RAW development processing in the information processing apparatus. It is a flowchart which shows the flow of the half decoding process in an information processing apparatus, and a full decoding process. It is a figure which shows the data flow of the RAW image development process in the information processing apparatus which concerns on the 2nd Embodiment of this invention. It is a figure which shows the arrangement | sequence of each pixel of a Bayer arrangement | sequence. It is a figure which shows the designation | designated method of each pixel of a Bayer arrangement | sequence. It is a figure which shows the image of half decoding. It is a figure which shows the example of the pixel interpolation method at the time of performing half decoding.

Explanation of symbols

61 Image display area 62 Display resolution designation slider (resolution designation means)
63 Image adjustment slider (image adjustment designation means)
101 CPU (switching means)
102 ROM
103 RAM (second storage means, third storage means)
104 HDD (storage means)
108 Display section (display means)

Claims (8)

An image processing apparatus that generates an image from an image signal of an original image composed of pixels of a plurality of colors having different periodicity of color arrangement,
Storage means for storing a compressed image signal obtained by compressing the image signal;
Signal processing means for decoding the compressed image signal;
First image generation means for generating a reduced image obtained by reducing the original image by thinning out the image signal decoded by the signal processing means;
Second image generating means for pixel-interpolating the image signal decoded by the signal processing means to generate the same size image as the original image;
Resolution specifying means for specifying the display resolution of the image to be displayed on the display means;
Based on the display resolution designated by the resolution designation means, the display of the reduced image generated by the first image generation means and the display of the same size image generated by the second image generation means. Switching means for switching;
An image processing apparatus comprising: An image adjustment designating unit for designating an image adjustment parameter of an image to be displayed on the display unit;
The image processing apparatus according to claim 1, wherein when the reduced image is displayed on the display unit, the image adjustment parameter designated by the image adjustment designation unit is applied to the reduced image. A second storage means for caching the image signal decoded by the signal processing means;
The decoded image signal is cached in the second storage unit when the first image generation unit performs processing, and the decoded image signal cached in the second storage unit is cached in the second storage unit. The image processing apparatus according to claim 1, wherein the image processing apparatus is used when processing is performed by the two image generation units. Further comprising third storage means for caching the compressed image signal;
The compressed image signal is cached in the third storage means when processed by the first image generation means, and the compressed image signal cached in the third storage means is generated in the second image generation. The image processing apparatus according to claim 1, wherein the image processing apparatus is used when processing is performed by a means.   The image processing apparatus according to claim 1, wherein the apparatus on which the image processing apparatus is mounted is selected from a group including an information processing apparatus and an imaging apparatus. A control method of an image processing apparatus for generating an image from an image signal of an original image composed of pixels of a plurality of colors having different periodicity of color arrangement,
A signal processing step of decoding a compressed image signal obtained by compressing the image signal;
A first image generation step for generating a reduced image obtained by reducing the original image by thinning out the image signal decoded by the signal processing step;
A second image generation step of generating an equal-magnification image having the same size as the original image by subjecting the image signal decoded in the signal processing step to pixel interpolation;
A resolution specifying step for specifying the display resolution of the image displayed on the display means;
Based on the display resolution specified by the resolution specifying step, the reduced image generated by the first image generating step and the equal-size image generated by the second image generating step are displayed. A switching step to switch,
A control method comprising: A program for causing a computer to execute a control method of an image processing apparatus that generates an image from an image signal of an original image composed of pixels of a plurality of colors having different color arrangement periodicity, the control method comprising:
A signal processing step of decoding a compressed image signal obtained by compressing the image signal;
A first image generation step for generating a reduced image obtained by reducing the original image by thinning out the image signal decoded by the signal processing step;
A second image generation step of generating an equal-magnification image having the same size as the original image by subjecting the image signal decoded in the signal processing step to pixel interpolation;
A resolution specifying step for specifying the display resolution of the image displayed on the display means;
Based on the display resolution specified by the resolution specifying step, the reduced image generated by the first image generating step and the equal-size image generated by the second image generating step are displayed. A switching step to switch,
A program comprising:   A computer-readable storage medium storing the program according to claim 7.

Images