JP2018182550A - Image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize image quality confirmation equivalent to that at the time of editing work simultaneously with confirmation of the angle of view at a shooting site of a movie or the like.SOLUTION: An image processing apparatus includes target region setting means that sets a target region in image data, first image processing means that performs image processing for realizing image quality desired by a user on the target region, second image processing means that performs image processing for realizing image quality substantially coincident with the first image processing means on the whole image data at high speed, and image synthesizing means that synthesizes the image data generated by the first processing means and the image data generated by the second image processing means.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image display for displaying a still image or a moving image.

  In current film production, digital photography with RAW data is becoming common, and the resolution is also improved from the conventional 2K to 4K. In addition, editing operations (for example, RAW development processing, cut editing, grading, CG composition, and the like) are performed after shooting. Therefore, in order to shoot a moving image suitable for editing, it is desirable that RAW development processing be performed at the shooting site with the same development parameters as at the time of editing, and that shooting conditions such as camera settings and illumination be adjusted. In order to do this efficiently, it is necessary to perform development processing equivalent to that during editing work in real time while capturing RAW data of 4K resolution.

  However, since development processing applied to RAW data of 4K resolution at the time of editing work includes high-quality processing such as false color relaxation processing, noise reduction processing, and lens aberration correction processing, the processing load is extremely high. Therefore, it is difficult to apply this as it is at the shooting site.

  Therefore, a technique for speeding up the RAW development process is known as a conventional technique (Patent Document 1). This is to reduce the processing load by performing correction processing of the optical system at the time of enlarged display and changing development parameters so as not to perform correction processing of the optical system at the time of FIT display.

JP, 2012-10190, A

  However, since the prior art is processing on the premise of enlarged display, it can not respond to the user's request to determine shooting conditions such as camera settings and illumination while simultaneously checking both the image quality and the angle of view at the time of editing. There was a problem called.

  Therefore, it is an object of the present invention to realize image quality confirmation equivalent to that at the time of editing work at the same time as confirmation of the angle of view at the shooting site such as a movie.

In order to achieve the above object, an image processing apparatus according to the present invention is
An attention area setting means for setting an attention area in image data, a first image processing means for performing image processing for realizing the image quality desired by the user to the attention area, and the whole image data A second image processing means for performing image processing to realize an image quality substantially corresponding to the first image processing means at high speed; image data generated by the first image processing means and the second image And image combining means for combining the image data generated by the processing means.

  The image processing apparatus according to the present invention has the effect of reducing the risk of re-shooting due to an image quality problem in a digital cinema production workflow, and further improving the efficiency of the shooting condition determination work at the time of shooting.

It is a system configuration figure of an image processing device. FIG. 2 is a block diagram showing a logical configuration of the image processing apparatus in Embodiment 1. 5 is a flowchart showing the flow of image processing in Embodiment 1. 5 is a flowchart showing the flow of high-quality RAW development processing. 5 is a flowchart showing the flow of high-speed RAW development processing. It is a figure which shows an attention area. FIG. 6 is a diagram showing a display method of a display image in the first embodiment. FIG. 8 is a diagram showing a method of setting a region of interest by the GUI in the first embodiment. 7 is a flowchart showing the flow of image processing in the second embodiment. FIG. 7 is a view showing a display method of a display image in the second embodiment. 15 is a flowchart showing the flow of image processing in the third embodiment. FIG. 18 is a diagram showing processing timing and a display image in the third embodiment. FIG. 7 is a block diagram showing a logical configuration of the image processing apparatus in Embodiment 2. It is a flowchart which shows the flow of an image quality evaluation process. FIG. 13 is a block diagram showing a logical configuration of the image processing apparatus in Embodiment 3.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing a system configuration of an image processing apparatus in the present embodiment.

  The image processing apparatus includes a CPU 101, a RAM 102, a ROM 103, an HDD 104, an input interface (I / F) 105, a display interface (I / F) 107, an imaging interface (I / F) 109, and a system bus 111. The input I / F 105 is, for example, a serial bus interface such as USB or IEEE 1394. The input I / F 105 connects an input device 106 such as a keyboard or a mouse for the user to issue various operation instructions. The output I / F 107 is an image output interface such as DVI or HDMI (registered trademark), for example, and connects a display device 108 such as a liquid crystal display. An imaging I / F 109 is, for example, an image input interface such as 3G / HD-SDI or HDMI, and connects an imaging device 110 such as a digital camera, a digital video camera, or a digital cinema camera.

  In the following, various processes realized by operating various software (computer programs) stored in the HDD 104 by the CPU 101 will be described.

  First, the CPU 101 activates an image processing application stored in the HDD 104 and expands the image processing application on the RAM 102 and displays a user interface (UI) on the display device 108. Subsequently, various data stored in the HDD 104, an image captured by the imaging device 110, an instruction from the input device 106, and the like are transferred to the RAM 102. Furthermore, in accordance with the processing in the image processing application, the data stored in the RAM 102 performs various calculations based on an instruction from the CPU 101. Then, the calculation result is displayed on the display device 108 or stored in the HDD 104.

  The image processing application according to the invention will now be described. As described at the beginning, for example, at a shooting site such as a movie, there is a demand to apply the same processing as the RAW development processing performed at the time of editing work to check the image quality. Therefore, in this embodiment, RAW development processing for realizing the image quality (image quality at the time of editing work) desired by the user is performed on the attention area on the RAW moving image data, and high-speed processing is performed on the entire image. Perform executable high-speed RAW development processing. Then, by combining these two development results and outputting them, both the confirmation of the angle of view and the image quality confirmation equivalent to that at the editing operation are realized simultaneously. In the present embodiment, the following description will be made assuming that RAW moving image data is a set of frame image data configured in a general Bayer arrangement.

<Logical Configuration of Image Processing Device>
FIG. 2 is a block diagram showing the logical configuration of the image processing apparatus in this embodiment.

  The image data acquisition unit 201 acquires RAW moving image data from the imaging device 110 or the HDD 104 based on an instruction from the CPU 101. The attention area information acquisition unit 202 acquires attention area information from the HDD 104 or the input device 106 based on an instruction from the CPU 101. The high-quality RAW development processing unit 203 performs high-quality RAW development processing on a target area of processing target frame image data in RAW moving image data based on an instruction from the CPU 101, and generates high-quality RAW developed image data. . The generated image data is stored in the RAM 102. The high-speed RAW development processing unit 204 performs high-speed RAW development processing on the entire processing target frame image data in the RAW moving image data based on an instruction from the CPU 101 to generate high-speed RAW developed image data. The generated image data is stored in the RAM 102. The image data output unit 205 outputs the high-quality RAW developed image data and the high-speed RAW developed image data to the display device 108 or the HDD 104 based on an instruction from the CPU 101.

<Main processing flow>
Hereinafter, details of each process in the logical configuration of the image processing apparatus described with reference to FIG. 2 will be described using the flowchart of FIG. 3.

  In step S301, the image data acquisition unit 201 acquires RAW moving image data with a resolution of width W and height H as input image data.

In step S302, the attention area information acquisition unit 202 acquires attention area information set in advance. The attention area information is information including at least the position and size of the area, and for example, as shown in FIG. 6 in the present embodiment, the central coordinates (X _roi , Y _roi ) of the area and the width W _{roi of the} area and the height It consists of H _roi . Note that the size of the attention area is set to a size that allows high-quality RAW development processing to be performed in real time in accordance with the performance of the image processing apparatus.

In step S303, the high-quality RAW development processing unit 203 performs high-quality RAW development processing on the target area of the processing target frame image data in the RAW moving image data acquired in step S301, and the width W _roi , height H _roi Generate high quality RAW developed image data of resolution of. Details of the high image quality RAW development processing will be described later.

  In step S304, the high-speed RAW development processing unit 204 performs high-speed RAW development processing on the entire processing target frame image data in the RAW moving image data acquired in step S301, and performs high-speed RAW development with a resolution of width W and height H. Generated image data. Details of the high-speed RAW development processing will be described later.

  In step S305, the image data output unit 205 combines the high-quality RAW developed image data generated in step S303 and the high-speed RAW developed image data generated in step S304 to generate display image data. Display image data in the present embodiment is shown in FIG. The high quality RAW developed image data is displayed for the attention area, and the high speed RAW developed image is displayed except for the attention area.

<High-quality RAW development processing>
Hereinafter, details of the high-image-quality RAW development processing in step S303 of FIG. 3 will be described using the flowchart of FIG.

In step S401, based on the attention area information acquired in step S302, image data corresponding to the attention area is acquired from the processing target frame image data in the RAW moving image data acquired in step S301. That is, image data composed of a Bayer array of resolution of width W _roi and height H _roi is obtained. Note that since information of peripheral pixels of the processing target pixel may be required depending on an algorithm of various filter processes to be described later, a margin of several pixels may be provided with upper, lower, left, and right of the attention area.

  In step S402, known white balance processing is performed on the image data of the region of interest acquired in step S401.

  In step S403, the image processing after the white balance processing obtained in step S402 is subjected to the debayering processing. The debayering process is a process of converting the image data of the Bayer array into image data in which all the color components of RGB are uniformed for each pixel. In the Bayer arrangement, each pixel holds only one of R, G, and B color components, and for the other color components, it is necessary to interpolate surrounding pixels from the surrounding pixels. For this interpolation processing, a basic interpolation method such as a bilinear method or a bicubic method may be used, or for example, a method for achieving high image quality using color correlation may be used. Various DeBeer algorithms are applicable. In addition, it is possible to simultaneously apply false resolution alleviation processing, false color processing, and the like.

  In step S404, noise reduction processing is performed on the image data after the debayering processing obtained in step S403 using a bilateral filter, which is an edge preserving smoothing filter. Note that various known noise reduction algorithms can be applied to the noise reduction process. For example, a basic smoothing filter or median filter may be used.

  In step S405, color conversion processing from the device RGB of the imaging apparatus to a prescribed color space such as sRGB is performed on the image data after noise reduction processing obtained in step S404 using an ICC profile. In addition to the method of using the ICC profile, various color conversion processes such as a method of using a LUT or a matrix can be applied to this color conversion process.

  In step S406, gamma correction processing is performed on the image data after conversion processing obtained in step S405.

  In step S407, edge enhancement processing is performed on the image data after gamma correction processing obtained in step S406 by the unsharp mask method. Note that various known edge enhancement algorithms other than the unsharp mask method can be applied to the edge enhancement processing.

<High-speed RAW development processing>
Details of the high-speed RAW development processing in step S304 of FIG. 3 will be described below using the flowchart of FIG.

  In step S501, processing target frame image data in the RAW moving image data acquired in step S301 is acquired. That is, image data composed of a Bayer array of resolution of width W and height H can be obtained.

  In step S502, white balance processing is performed on the image data acquired in step S501. The process is the same as that in step S402, and thus the detailed description is omitted.

  In step S503, the image processing after the white balance processing obtained in step S502 is subjected to the debayering processing. The process is the same as that in step S403, and thus the detailed description is omitted.

  In step S504, color conversion processing is performed on the image data after the debayering processing obtained in step S503. The process is the same as that of step S405, and thus the detailed description is omitted.

  In step S505, gamma processing is performed on the color-converted image data obtained in step S504.

  According to the above processing, the user can desire the user to apply the high quality RAW development processing equivalent to that at the editing work to the attention area and apply the high speed RAW development processing to the other areas. Both confirmation of image quality and confirmation of angle of view can be realized simultaneously.

In the present embodiment, an example of acquiring the attention area from the HDD or the like has been described, but instead, attention area information may be set by the user. FIG. 8 shows an example of the attention area setting UI. The user inputs information on the central coordinate (X _roi , Y _roi ) of the region of interest, the width W _{roi of} the region, and the height H _roi through the edit box. At this time, it is determined whether high-quality RAW development processing can be performed in real time with respect to the set attention area, and if it can not be performed in real time, a warning that the processing can not be performed in real time is displayed Present to the user by voice etc. The determination process is performed by actually performing processing on image data of one frame, for example. Alternatively, the maximum value of the size of the attention area that can be processed in real time may be determined in advance, and the input from the user may be limited based on this. In the present embodiment, although the area setting method by the edit box is described, the area setting method by the user is not limited to this. For example, it goes without saying that the coordinates and the size may be set using a mouse, a line-of-sight input device or the like.

  Further, the processing content and processing order of the high-quality RAW development processing and the high-speed RAW development processing are not limited to the processing described in the present embodiment. In other words, high quality RAW development processing to realize the image quality desired by the user is applied to the attention area, and high speed RAW development processing to realize real time processing over a wide range is applied to the other areas. As long as it is a thing, what kind of process and process order may be used. For example, for the attention area, the high-quality RAW development process may include other high-quality processing such as false color alleviation processing and lens aberration correction processing. Further, also for high-speed RAW development processing, all kinds of high-speed processing can be applied, such as processing in which the vertical and horizontal resolutions are reduced to half in order to perform debayer processing at high speed. Furthermore, it goes without saying that the entire high-speed RAW development processing may be executed before the entire high-quality RAW development processing, or these may be executed in parallel.

  A display mode setting unit may be provided which allows the user to select whether or not to execute the process described in the present embodiment, and the process described in the present embodiment may be applied only when the user intends to execute the process. Absent. For example, a preview mode in which the entire image is subjected to RAW development with the same parameters and displayed, and a display mode for confirming the image quality desired by the user by applying the processing described in this embodiment are provided. The processing described in the present embodiment may be applied only when selected.

  In the first embodiment, processing for generating image data by outputting RAW moving image data to an image processing application and performing development processing with different development parameters for each of the entire image and the area of interest has been described. . In this embodiment, an image quality evaluation process is further performed on image data after development processing of the attention area, and a process of outputting the image quality evaluation value together with the image data will be described.

  FIG. 13 is a block diagram showing the logical configuration of the image processing apparatus in the present embodiment. The image quality evaluation processing unit 1301 is added to the block diagram showing the logical configuration of the image processing apparatus according to the first embodiment described with reference to FIG.

  The image quality evaluation processing unit 1301 performs image quality evaluation processing on the high-quality RAW developed image based on an instruction from the CPU 101, and derives an image quality evaluation value. The description of the same parts as in the first embodiment will be omitted.

  Hereinafter, details of each process in the logical configuration of the image processing apparatus described with reference to FIG. 13 will be described with reference to the flowchart of FIG.

  In step S901, the image data acquisition unit 201 acquires RAW moving image data with a resolution of width W and height H as input image data.

In step S902, the attention area information acquisition unit 202 acquires attention area information set in advance. The attention area information is information including at least the position and size of the area, and for example, as shown in FIG. 6, the center coordinates (X _roi , Y _roi ) of the area, the width W _{roi of the} area, and the height H _roi Configured Note that the size of the attention area needs to be set to a size that allows high-quality RAW development processing to be performed in real time in accordance with the performance of the image processing apparatus.

In step S903, the high-quality RAW development processing unit 203 performs high-quality RAW development processing on the target area of the processing target frame image data in the RAW moving image data acquired in step S901, and the width W _roi , height H _roi Generate high quality RAW developed image data of resolution of. The details of the high-quality RAW development processing are the same as in the first embodiment, and thus the description thereof is omitted.

  In step S904, the image quality evaluation processing unit 1301 performs image quality evaluation processing on the high-quality RAW developed image data generated in step S903, and calculates an image quality evaluation value. Details of the image quality evaluation process will be described later.

  In step S905, the high-speed RAW development processing unit 204 performs high-speed RAW development processing on the entire processing target frame image data in the RAW moving image data acquired in step S901, and performs high-speed RAW development with resolution of width W and height H. Generated image data. The details of the high-speed RAW development processing are the same as in the first embodiment, and thus the description thereof is omitted.

  In step S906, the image data output unit 205 combines the high-quality RAW developed image data generated in step S903 and the high-speed RAW developed image data generated in step S905 to generate display image data, and calculation is performed in step S904. Output together with the evaluated image quality evaluation value. An example of the display method of the display image in the present embodiment is shown in FIG. For example, high quality RAW developed image data is displayed for the area of interest, and a high speed RAW developed image is displayed for areas other than the area of interest. Further, the image quality evaluation value of the region of interest is superimposed and displayed on the image (FIG. 10A). On the other hand, it is also conceivable to display an image subjected to high-speed RAW development processing over the entire image and to display the image quality evaluation value of the attention area superimposed thereon (FIG. 10 (b)). For example, in the present embodiment, the information is presented by the method of FIG.

<Image quality evaluation process>
In the present embodiment, noise is described as an image quality item to be evaluated. A method of calculating the amount of noise as an image quality evaluation value for an image will be described using the flowchart of FIG.

In step S1401, RGB values of each pixel in high-quality RAW developed image data are acquired.
In step S1402, the RGB values of each pixel are converted from RGB values into XYZ values which are tristimulus values. Conversion is performed by a specified method such as sRGB or Adobe RGB.

α, β, γ and a11 to a33 are prescribed coefficients.

  In step S1403, the XYZ values of each pixel are converted into Lab values using a conversion equation defined by CIE.

In step S1404, standard deviations σ _L , σ _a , σ _b are calculated using Lab of each pixel.

  In step S1405, a sum obtained by weighting each standard deviation as the evaluation value P is calculated.

The weighting factors A, B and C are arbitrary coefficients, and if the values of A, B and C are determined in advance so as to coincide with the amount of noise perceived by the lightness L and the color component ab The matched noise amount P can be calculated. The calculation method is not limited to this, and may be, for example, Wiener spectrum or RMS granularity, but it is desirable that the calculated amount of noise matches the perceived noise intensity. Also, the amount of noise of a moving image may be calculated by analyzing an image between a plurality of frames.

  Although the noise amount has been described as the target of the image quality evaluation processing in this embodiment, other image quality items such as gradation, contrast, focus, jaggy, jerkiness, color reproducibility and the like are also targets of the image quality evaluation processing other than noise. It may be set. Also, the image quality evaluation process may be executed by combining a plurality of these.

  By the above-described processing, it is possible to simultaneously check both the image quality and the angle of view desired by the user, and by calculating and displaying the image quality evaluation value, quantitative confirmation of the image quality is realized.

  Needless to say, as in the first embodiment, the high-speed RAW development process may be performed before the high-quality RAW development process.

  In this embodiment, when the processing capability of the image processing apparatus that executes each processing described in the first embodiment is low, a method of maintaining the accuracy of image quality confirmation by preferentially executing processing on the attention area will be described.

  In order to properly confirm the angle of view and the image quality desired by the user, each process described in the first embodiment needs to be completed in real time. For example, in the case of processing a 24 fps moving image, all processing needs to be completed within 1/24 seconds. However, if the processing capacity of the image processing apparatus that executes these processes is low, all the processes may not be in real time. If these processes do not finish in real time, a frame drop will occur on the display. In other words, a situation occurs in which a 24 fps moving image is displayed at, for example, 12 fps every other frame, which makes it difficult to properly confirm the image quality of the moving image. For example, in a shooting site such as a movie, a notebook PC with low performance is often used as an image processing apparatus, and in such a case, the above-mentioned problem is likely to occur.

  In the present embodiment, the processing for the region of interest is preferentially executed, and the processing for the areas other than the region of interest is performed in the remaining time, thereby suppressing the frame dropping of the region of interest. In order to lower the priority for processing in areas other than the area of interest, dropping frames may occur in some cases, but confirmation of the angle of view is necessarily performed in full frame unless the angle of view is largely changed. Even if it is not displayed, it is possible enough, and this is not a big disadvantage.

  Next, the logical configuration of the image processing apparatus in the present embodiment and the details of each process will be described. FIG. 15 is a block diagram showing the logical configuration of the image processing apparatus in this embodiment. A processing order control unit 1501 is added to the block diagram showing the logical configuration of the image processing apparatus in the first embodiment described with reference to FIG. The processing order control unit 1501 controls the processing order so that high image quality RAW development processing is preferentially performed based on an instruction from the CPU 101. The description of the same parts as in the first embodiment will be omitted.

  The details of each process in the present embodiment in the logical configuration of the image processing apparatus described with reference to FIG. 2 will be described below using the flowchart of FIG.

  In step S1101, the processing order control unit 1501 acquires the frame number of the frame image data to be processed in each of the high image quality RAW development processing and the high speed RAW development processing, and the processing state in each development processing. The processing state is information indicating how far the development processing has ended for the frame image data. For example, the processing state in the present embodiment includes pixel positions in the x direction and y direction indicating the start position of the next processing, a flag indicating which processing in the flow of development processing has been completed, and the like.

  In step S1102, the image data acquisition unit 201 acquires RAW moving image data with a resolution of width W and height H as input image data. Note that this RAW moving image data includes data corresponding to the processing target frame number acquired in step S1101.

In step S1103, the attention area information acquisition unit 202 acquires attention area information set in advance. The attention area information is information including at least the position and size of the area, and for example, as shown in FIG. 6, the center coordinates (X _roi , Y _roi ) of the area, the width W _{roi of the} area, and the height H _roi Configured The size of the region of interest needs to be set to a size that allows high-quality RAW development processing to be performed in real time in accordance with the performance of the image processing apparatus.

In step S1104, the high image quality RAW development processing unit 203 acquires frame image data corresponding to the processing target frame number acquired in step S1101 from the RAW moving image data acquired in step S1102 as processing object frame image data. Then, high quality RAW development processing is performed on the attention area of the processing target frame image data to generate high quality RAW developed image data having a resolution of width W _roi and height H _roi . The details of the high-quality RAW development processing are the same as in the first embodiment, and thus the description thereof is omitted.

  In step S1105, the high-speed RAW development processing unit 204 acquires frame image data corresponding to the processing target frame number acquired in step S1101 from the RAW moving image data acquired in step S1102 as processing object frame image data. Then, high-speed RAW development processing is performed on the entire processing target frame image data to generate high-speed RAW developed image data having a resolution of width W and height H. The details of the high-speed RAW development processing are the same as in the first embodiment, and thus the description thereof is omitted.

  In step S1106, the processing order control unit 1501 determines that all processing of the development processing flow for the frame image data to be processed is completed in the development processing of the high-quality RAW development processing and the high-speed RAW development processing. , Updates the frame number to the next frame number to be processed. If all processing has not been completed, the frame number is not updated. Furthermore, in each development process, a pixel position in the x direction and y direction indicating the start position of the next process, and a flag indicating which process of the process flow has been completed are stored as a process state.

  In step S1107, the image data output unit 205 combines the high-quality RAW developed image data generated in step S1104 and the high-speed RAW developed image data generated in step S1105 to generate and output display image data. At this time, the most recent frame image of the frames for which all processing has been completed is used with reference to the processing state.

  Next, FIG. 12 shows an example of processing timing of each development processing and display image data in the present embodiment. In FIG. 12, time t is taken on the horizontal axis, and an example of processing and displaying 24 fps RAW moving image data is shown.

Focusing on the processing of 1/24 seconds from time t _n-1 to t _n , first, the high-quality RAW development processing on the attention area of the image data of frame number f _n is executed with the highest priority, and the remaining time is a frame High-speed RAW development processing is performed on the entire image data of number f _n . In this 1/24 second, the processing for the attention area is 100% and the processing for the entire image is 50% completed, and processing states indicating this state are stored for each development processing. Specifically, for the region of interest, the process target frame number is updated by 1 to be f _{n + 1,} and for the entire image, the process target frame number remains f _n . Further, information that the processing has been completed for the attention area and only 50% of the processing for the entire image is also stored. The image displayed on the screen at this time is the image data of the frame number f _n for the attention area, and the processing for the frame number f _n is not completed for the other areas, so the processing is already completed. The image data of the frame number f _n-2 is displayed on the screen as a display image.

Next, focusing on the processing of 1/24 seconds from time t _n to t _{n + 1} , first, the high-quality RAW development processing on the attention area of the image data of the frame number f _{n + 1} is executed with the highest priority. High-speed RAW development processing is performed on the entire image of the image data of the frame number f _n . In the latter high-speed RAW development processing, a processing state in which processing has been completed up to 50% in the previous 1/24 second processing is stored, and processing is performed from this continuation in this 1/24 second. In this 1/24 second, the processing for the region of interest is 100% for the image data of frame number f _{n + 1} , and the processing for the entire image is 100% for the image data of frame number f _n. A process state is stored that indicates this state for the process. Specifically, for the region of interest and f _{n + 2} by updating only the processing target frame number, for the entire image is updated processed frame number in accordance with the region of interest f _{n + 2.} In addition, information indicating that the processing has been completed for each of the attention area and the entire image is also stored. The image displayed on the screen at this time is the image data of the frame number f _{n + 1 for} the region of interest, and the image data of the frame number f _n for the other regions.

  Thereafter, the processing is repeated in the same manner, and the processing is performed in real time on the attention area, so the display is updated at 24 fps, and the display is updated at 12 fps for the other areas.

  Through the above processing, the processing of the attention area is preferentially executed to suppress the frame dropping of the attention area, so that the quality of the image quality confirmation in the shooting site using the image processing apparatus such as a notebook PC etc. Both the angle of view check and the image quality check at the time of editing can be realized simultaneously without dropping the.

  The process described in the present embodiment is also applicable to the case where the image evaluation process described in the second embodiment is simultaneously performed. In this case, in addition to the high-quality RAW development process, the image evaluation process may be preferentially executed, and the high-speed RAW development process may be performed using the remaining time as soon as these processes are completed.

101 CPU, 102 RAM, 103 ROM, 104 HDD,
105 input interface (I / F), 107 display interface (I / F),
109 Imaging interface (I / F), 111 system bus

Claims (6)

An attention area setting unit for setting an attention area in the image data;
First image processing means for performing image processing for realizing the image quality desired by the user with respect to the region of interest;
A second image processing means for performing image processing for realizing an image quality matching the first image processing means at high speed with respect to the entire image data;
An image processing apparatus comprising: image combining means for combining the image data generated by the first image processing means and the image data generated by the second image processing means.   The image processing apparatus according to claim 1, further comprising an image display unit for displaying the image data combined by the combining unit.   The image processing apparatus according to claim 1, wherein the attention area setting unit allows the user to set the position and the size of the attention area.   The said attention area setting means derives the upper limit of the magnitude | size of the said attention area from the result of having performed image processing by said 1st image processing means, Any one of the Claims 1 to 3 characterized by the above-mentioned. The image processing apparatus according to claim 1.   5. The image processing apparatus according to claim 4, wherein the attention area setting unit issues a warning when the size of the attention area set exceeds the upper limit of the size of the attention area.   5. The image processing apparatus according to claim 4, wherein the attention area setting unit limits the size of the attention area that can be set to the upper limit value of the size of the attention area.