JP2013219589A - Image processing device, image processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve a reproduction frame rate by image processing having a low processing load while image moving data is reproduced, and to enable confirmation of a processing result similar to a final file output, while the reproduction is suspended.SOLUTION: When performing image processing on the moving image data by adjusting a plurality of image processing parameters, an image processing device displays an operation screen to set the plurality of image processing parameters, to reproduce the moving image data on a display unit as a moving image, on the basis of the image processing parameters. On the basis of the image processing parameters set on the operation screen, the image processing device image processes the moving image data to generate a moving image file having a predetermined file format. During reproduction operation, the image processing device makes at least a portion of the image processing parameters on the operation screen into an inoperable state, whereas during the suspension of the reproduction operation, the image processing device makes the image processing parameters, which are made into the inoperable state during the reproduction operation, into an operable state.

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program for processing moving image data.

  In general, when recording still image data obtained as a result of shooting in a digital camera, which is one of the imaging devices, in the case of shooting in a high image quality mode, the image sensor output is recorded immediately after A / D conversion. RAW recording is performed, or recording is performed with the minimum necessary image processing.

  When moving image data is recorded in a video camera, it is generally recorded as a moving image file on a random access medium such as a flash medium or a hard disk. Since moving image data has a large data size, recording is performed by reducing the data size by image compression.

  On the other hand, there is a video camera in which each frame is RAW-recorded when moving image data is recorded with high image quality due to an increase in capacity and speed of recording media. Hereinafter, a file in which moving image data is RAW recorded is referred to as a RAW moving image file.

  By the way, when creating a video work using a RAW moving image file, first, development processing of the RAW moving image file is performed, and then the RAW moving image file after development processing is subjected to subsequent editing processing, color adjustment, and the like. It is necessary to convert to a file format that can be read by an image processing apparatus for processing. Further, when performing development processing on a RAW moving image file, it is necessary to perform reproduction processing in order to confirm the material of the RAW moving image file and to adjust the image quality.

  However, since the data size of the RAW moving image file is large, the processing load for performing each of the above image processing is high, and if the image processing is performed for all the frames, the reproduction frame rate is inevitably lowered. .

  In order to reduce the processing load when playing back a RAW moving image file, for example, when playback is stopped by switching between a speed priority mode that prioritizes processing speed and an image quality priority mode that prioritizes image quality according to the state of the playback operation. In some cases, high image quality processing is performed in the image quality priority mode (see Patent Document 1).

JP 2004-56264 A

  By the way, when outputting an image file as a result of image processing, it is desirable to match the processing related to the image displayed on the screen when playback is stopped with the image processing when outputting the image file. However, in the image processing described in Patent Document 1, the processing according to the output setting of the image file is not performed. As a result, the image file after the image processing (final file output) is the processing content Different images may be played back and displayed.

  In other words, in the image processing described in Patent Document 1, the same processing result as that of the final file output may not be confirmed while reproduction is stopped.

  Accordingly, an object of the present invention is to improve the reproduction frame rate by image processing with a low processing load during reproduction, and to confirm the processing result similar to the final file output when reproduction is stopped. An image processing method and a program are provided.

  In order to achieve the above object, an image processing apparatus according to the present invention is an image processing apparatus that reads moving image data and performs image processing on the moving image data by adjusting a plurality of image processing parameters. A screen display control unit for displaying an operation screen for setting the plurality of image processing parameters on a display unit, and a reproduction processing unit for reproducing the moving image data as a moving image on the display unit based on the plurality of image processing parameters. And a file generation means for generating a moving image file in a predetermined file format by performing image processing on the moving image data based on the image processing parameters set on the operation screen, and the screen display control means, During a reproduction operation in which a moving image is reproduced on the display unit by the reproduction processing means, operation of at least some image processing parameters on the operation screen is performed. It was impossible state, the stopped playback operation, characterized in that the image processing parameter operation is impossible state in the operation screen during playback operation and operational.

  A control method according to the present invention is a method for controlling an image processing apparatus that reads moving image data and performs image processing on the moving image data by adjusting a plurality of image processing parameters. A screen display control step for displaying an operation screen for setting parameters on the display unit, a reproduction processing step for reproducing the moving image data as a moving image on the display unit based on the plurality of image processing parameters, and the operation screen. A file generation step for generating a moving image file in a predetermined file format by performing image processing on the moving image data based on the set image processing parameter, and in the screen display control step, During a reproduction operation for reproducing a moving image on the display unit, operation of at least a part of the image processing parameters on the operation screen is performed. It was impossible state, the stopped playback operation, characterized in that the image processing parameter operation is impossible state in the operation screen during playback operation and operational.

  The program according to the present invention is a program used in an image processing apparatus that reads moving image data and performs image processing on the moving image data by adjusting a plurality of image processing parameters. A screen display control step for causing the computer to display an operation screen for setting the plurality of image processing parameters on a display unit; and reproducing the moving image data as a moving image on the display unit based on the plurality of image processing parameters. The screen display control is performed by executing a reproduction processing step and a file generation step of generating an image file of a predetermined file format by performing image processing on the moving image data based on an image processing parameter set on the operation screen. In the step, during the reproduction operation of reproducing the moving image on the display unit in the reproduction processing step The operation of at least a part of the image processing parameters on the operation screen is disabled, and the image processing parameters that cannot be operated on the operation screen can be operated during the playback operation while the playback operation is stopped. It is characterized by being in a state.

  According to the present invention, it is possible to improve the playback frame rate by image processing with a low processing load during playback, and to check the processing result similar to the final file output while playback is stopped.

1 is a lock diagram illustrating a configuration of an image processing apparatus according to an embodiment of the present invention. 2A and 2B are diagrams for explaining image data processed by the PC shown in FIG. 1, in which FIG. 1A is a diagram showing pixel values (RAW image data) of 6 rows × 6 columns arranged in a Bayer array, and FIG. The figure which shows the red (R) image data after performing the interpolation process with respect to data, (c) is the figure which shows the green (G) image data after performing the interpolation process with respect to RAW data, (d) FIG. 4 is a diagram showing blue (B) image data after performing interpolation processing on RAW data. It is a figure which shows an example of the screen structure which the image processing application performed with PC shown in FIG. 1 displays. 3 is a flowchart for explaining processing by an image processing application operating on the PC shown in FIG. 1. 5 is a flowchart for explaining in detail a development UI display process shown in FIG. 4. FIG. 4 is a diagram for explaining UI display of a slider control, a development mode check box, and a file output button according to a difference in a file selection state, a development mode setting, and a reproduction operation state on the development UI display screen shown in FIG. ) Is a diagram showing a first state of the UI display, (b) is a diagram showing a second state of the UI display, (c) is a diagram showing a third state of the UI display, and (d) is a diagram showing the third state of the UI display. The figure which shows the 4th state of the display which shows UI, (e) is a figure which shows the 5th state of the display which shows UI. 5 is a flowchart for explaining in detail the development processing shown in FIG. 4. 8A and 8B are diagrams for explaining the simple interpolation process and the interpolation process shown in FIG. 7, in which FIG. 7A is a diagram illustrating a part of RAW image data with a Bayer array, and FIG. FIG. 7C is a diagram showing R image data as a result of the above, and FIG. 8C is a diagram showing G image data as a result of performing interpolation processing on RAW image data.

  Hereinafter, an example of an image processing apparatus according to an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a lock diagram showing a configuration of an image processing apparatus according to an embodiment of the present invention.

  In FIG. 1, the illustrated image processing apparatus is, for example, a personal computer (PC) 100, and an image processing application installed in the PC 100 executes image processing.

  The PC 100 includes a CPU 101, and the ROM 102 stores a control program that describes the procedure of processing executed by the CPU 101. The RAM 103 is used as a work memory and temporarily stores control programs and data.

  The PC 100 has an HDD 104, and various programs such as an application, an operating system (OS), and data are stored in the HDD 104. The PC 100 is provided with an external interface (IF) 105 for connecting an external recording medium 111 such as a flash memory card 150 or an external HDD 160. The PC 100 is provided with a user IF 106 for processing user input given from an input device 112 such as a mouse 113 and a keyboard 114.

  As illustrated, the PC 100 includes a VRAM 107, an image processing unit 108, a display control unit 109, and a display 110 (display unit) such as a liquid crystal display. The VRAM 107 stores image data to be displayed as an image on the display 110. Is done. The above-described components (blocks) are connected to each other by an internal bus 115 that is a transmission path for control signals and data signals.

  FIG. 2 is a view for explaining image data processed by the PC 100 shown in FIG. FIG. 2A is a diagram showing pixel values (RAW image data) of 6 rows × 6 columns arranged in a Bayer array, and FIG. 2B is a red color after interpolation processing is performed on the RAW data. (R) It is a figure which shows image data. FIG. 2C is a diagram showing the green (G) image data after the interpolation processing is performed on the RAW image data, and FIG. 2D is a diagram after the interpolation processing is performed on the RAW data. It is a figure which shows blue (B) image data.

  In FIG. 2A, R (red), G (green), and B (blue) color filters are alternately arranged in each pixel of an image sensor (imaging device: not shown). Then, a so-called Bayer array in which a set of four pixels is formed is formed. Note that R, G, and B shown in FIG. 2A are photoelectric conversion units (light receiving units) including red, green, and blue color filters.

  The pixel values photoelectrically converted in the Bayer-arrayed light receiving units are digitized and then subjected to image processing. The pixel value data in the Bayer array is generally called RAW image data. In contrast to the RAW image data, normal image data is data in which each pixel value is composed of R, G, and B values. As shown in FIGS. 2 (b) to 2 (d), 6 columns × Six rows of pixels are composed of 6 columns × 6 rows of R, G, and B pixels.

  In order to create the image data of 6 columns × 6 rows shown in FIGS. 2B to 2D, interpolation processing is performed on the pixel values of 6 columns × 6 rows shown in FIG. There is a need. Interpolation processing for RAW image data is called debayer processing. Further, processing for generating normal image data by performing image processing such as debayer processing and color processing on RAW image data is called development processing.

  When processing such as editing, addition of special effects, and color adjustment is performed on a RAW moving image file, the processing cannot be performed with RAW image data (moving image data) as it is. For this reason, it is necessary to use a general file format after development processing. The image processing application used in the image processing apparatus shown in FIG. 1 is an application that performs development processing on RAW image data (moving image data) and outputs a file.

  FIG. 3 is a diagram showing an example of a screen configuration displayed by the image processing application executed on the PC 100 shown in FIG. This image processing application is executed by the CPU 101, and the CPU 101 controls the image processing unit 108 to display the image processing screen (also referred to as a development UI display screen) 300 shown in FIG. 3 on the display 110 via the display control unit 109. To do.

  The image processing screen (that is, the operation screen) 300 has a moving image file selection area 301. In this moving image file selection area 301, for example, a RAW moving image file recorded in the HDD 104 is displayed, and the user selects a desired RAW moving image file from the moving image files displayed in the moving image file selection area 301. . In the illustrated example, folders “Folder1” to “Folder3” in which RAW moving image files are recorded are displayed in the moving image file selection area 301. By selecting any of the folders “Folder1” to “Folder3”, A user-desired RAW moving image file is selected.

  The preview area 302 is an area for displaying a preview of the RAW moving image file selected in the moving image file selection area 301. The information display area 303 is an area where information regarding the selected RAW moving image file is displayed. For example, the information display area 303 displays the time code and the length of the RAW moving image file relating to the frame being previewed.

  Further, on the image processing screen (operation screen) 300, a RAW moving image file playback button 304 and a playback pause button 305 are displayed, and slider controls 306 to 309 are displayed. Slider controls (also referred to as development UIs) 306, 307, 308, and 309 are each a plurality of image quality parameters (also referred to as image processing parameters) that define processing relating to brightness, hue, sharpness, and noise when a RAW image file is developed. For adjusting or adjusting).

  The development mode check box 310 is a check box for switching a development processing mode to be applied when a moving image file is output. An image processing application operating in the image processing unit 108 has a high-speed development mode for giving priority to processing speed and a high-quality development mode for giving priority to image quality. When the development mode check box 310 is checked, the image processing application performs high-speed development processing. On the other hand, if the development mode check box 310 is unchecked, the image processing application performs high-quality development processing. High-speed development processing and high-quality development processing will be described later.

  The file output button 311 is used when outputting the selected RAW moving image file in a general predetermined file format (that is, a moving image file).

  FIG. 4 is a flowchart for explaining processing by the image processing application operating on the PC 100 shown in FIG.

  When the image processing application is activated, the CPU 101 determines whether or not the user has selected a RAW moving image file recorded in the HDD 104 in the moving image file selection area 301 (step S401). If no RAW moving image file is selected (NO in step S401), the CPU 101 stands by.

  On the other hand, when a RAW moving image file is selected (YES in step S401), the CPU 101 determines a RAW image frame in which the RAW image data (moving image data) of the first frame is secured in the RAM 103 from the selected RAW moving image file. The data is read into the memory (step S402). Subsequently, the CPU 101 sets a value FALSE indicating that the reproduction is stopped to a variable Play indicating the internal state in the moving image reproduction (step S403).

  Next, the CPU 101 performs display processing of the development UIs 306 to 311 shown in FIG. 3 (step S404). The process of step S404 will be described later. Thereafter, the CPU 101 performs development processing of the raw image data read into the raw image frame memory, and writes the developed image data in the image data frame memory secured in the RAM 103 (step S405). The developing process in step S405 will be described later.

  Subsequently, the CPU 101 controls the image processing unit 108 to display the image data written in the image frame memory via the display control unit 109 in the preview area 302 (step S406).

  Next, the CPU 101 determines whether or not the playback button 304 has been pressed (step S407). If play button 304 is not pressed (NO in step S407), CPU 101 determines whether any of slider controls 306, 307, 308, and 309 has been operated (step S408). That is, the CPU 101 determines whether or not the image quality parameter has been operated.

  When the image quality parameter is operated (YES in step S408), the CPU 101 returns to the process of step S405, performs a development process corresponding to the operation of the image quality parameter, and updates the preview area 302. If the image quality parameter is not operated (NO in step S408), the CPU 101 determines whether or not the development mode check box 310 is checked (step S409).

  If development mode check box 310 is checked (YES in step S409), CPU 101 returns to the processing in step S404 and updates the development UI display. Then, the CPU 101 performs development processing according to the selected development mode, and updates the preview area 302.

  If development mode check box 310 is not checked (NO in step S409), CPU 101 determines whether or not the user has selected another RAW moving image file in moving image file selection area 301 (step S410). If another RAW moving image file has been selected (YES in step S410), the CPU 101 returns to the processing in step S402, performs development processing by reading the first frame of the selected RAW moving image file, and performs a preview area. 302 is updated.

  When another RAW moving image file has not been selected (NO in step S410), CPU 101 determines whether or not file output button 311 has been pressed (step S411). If file output button 311 is not pressed (NO in step S411), CPU 101 returns to the process in step S407.

  On the other hand, when the file output button is pressed (YES in step S411), the CPU 101 reads the RAW image data of the first frame into the RAW image frame memory secured in the RAM 103 (step S412). Then, the CPU 101 develops the RAW image data read into the RAW image frame memory, and writes the developed image data in the image data frame memory secured in the RAM 103 (step S413).

  Next, the CPU 101 outputs the image data written in the image frame memory to the HDD 104 in a predetermined file format (step S414). Then, the CPU 101 determines whether or not the developed frame is the last frame of the selected RAW moving image file (step S415). If it is not the last frame (NO in step S415), the CPU 101 returns to the process of step S412 and performs the process of the next frame. If it is the last frame (YES in step S415), the CPU 101 ends the file output process and proceeds to the process of step S407.

  When the playback button 304 is pressed in step S407 (YES in step S407), the CPU 101 sets a value TRUE indicating that playback is in progress to a variable Play indicating the internal state of moving image playback (step S416). Then, the CPU 101 updates the development UI display (step S417).

  Subsequently, the CPU 101 reads the RAW image data of the next frame of the frame displayed in the preview display into the RAW image frame memory secured in the RAM 103 (step S418). Then, the CPU 101 develops the RAW image data read into the RAW image frame memory, and writes the developed image data in the image data frame memory secured in the RAM 103 (step S419).

  Next, the CPU 101 displays the image data written in the image frame memory in the preview area 302 (step S420). Then, the CPU 101 determines whether or not the displayed frame is the last frame of the selected RAW moving image file (step S421).

  If it is not the last frame (NO in step S421), the CPU 101 determines whether or not the playback pause button 305 has been pressed (step S422). If playback pause button 305 is not pressed (NO in step S422), CPU 101 returns to the process in step S418 and performs a display process on preview area 302 for the next frame.

  If the displayed frame is the final frame (YES in step S421), the COU 101 returns to the processing of step S403, updates the development UI display and updates the preview area 302 with the moving image playback state set to the playback stopped state. Similarly, when playback pause button 305 is pressed (YES in step S422), CPU 101 returns to the processing of step S403, updates the development UI display, and updates preview area 302 with the playback state of the movie set as the playback stop state. I do.

  FIG. 5 is a flowchart for explaining in detail the development UI display process described in steps S404 and S417 shown in FIG.

  When the development UI display process is started, the CPU 101 determines whether or not a RAW moving image file to be processed is selected (step S501). If no RAW moving image file has been selected (NO in step S501), first, the CPU 101 sets the slider control 306 to an inoperable state in order to adjust the brightness (step S502: Disable). Further, the CPU 101 sets the slider control 307 to an inoperable state in order to adjust the hue (step S503: Disable). Then, the CPU 101 sets the slider control 308 in an inoperable state in order to adjust sharpness (step S504: Disable), and sets the slider control 309 in an inoperable state in order to adjust noise (step S505: Disable). ).

  In addition, after setting the development mode check box 310 to an inoperable state (step S506: Disable), the CPU 101 sets the file output button 311 to an inoperable state (step S507: Disable). Then, the CPU 101 proceeds to the development processing in step S405 or the frame reading in step S418 shown in FIG.

  6A to 6E show slider controls 306 to 309, a development mode check box 310, and a file output according to differences in the file selection state, the development mode setting, and the reproduction operation state on the development UI display screen shown in FIG. It is a figure which shows UI display of the button 311. FIG.

  As described above, when the RAW moving image file is not selected, the processing in steps S502 to S507 is performed, and the development UI display is in the first state shown in FIG. In this first state, brightness, hue, sharpness, noise, development mode, and file output are all set to be inoperable. In FIG. 6 (a), hatching indicates that the operation is impossible.

  When the RAW moving image file is selected (YES in step S501), the CPU 101 sets the slider control 306 to an operable state (that is, an adjustable state) in order to adjust the brightness (step S508: Enable). . Further, the CPU 101 sets the slider control 307 to an operable state in order to adjust the hue (step S509: Enable). Note that brightness and hue are adjustment items that are commonly adjusted in both high-speed development processing and high-quality development processing.

  Subsequently, the CPU 101 determines which of the high-speed development mode and the high-quality development mode is set as the development mode (step S510). When the development mode is the high-speed development mode (first image processing mode) (high-speed development in step S501), the CPU 101 sets the slider control 308 to an inoperable state in order to adjust the sharpness (step S511: Disable). ). Further, the CPU 101 sets the slider control 309 to an inoperable state (that is, an unadjustable state) in order to adjust noise (step S512: Disable).

  Next, the CPU 101 determines the state of the current reproduction operation. That is, the CPU 101 determines whether or not the reproduction operation is being performed (step S513). If the reproduction operation is being performed (TRUE in step S513), the CPU 101 performs the processes of steps S506 and S507 described above.

  As described above, when the RAW moving image file is selected and the high-speed development mode is selected and the reproduction operation is being performed, the processes of steps S508 to S509, S511 to S512, and S506 to S507 are performed, and the development UI display is performed. Is in the second state shown in FIG. In this second state, the brightness and hue are set to an operable state (operable state), and the sharpness, noise, development mode, and file output are set to an inoperable state (inoperable state). The

  When playback is stopped (FALSE in step S513), the CPU 101 sets the development mode check box 310 in an operable state (step S514: Enable). Further, the CPU 101 sets the file output button 311 to an operable state (step S515: Enable). That is, the CPU 101 performs image processing on the RAW moving image data so that it can be output as a moving image file.

  As described above, when the RAW moving image file is selected, and in the high-speed development mode and the reproduction is stopped, the processes of steps S508 to S509, S511 to S512, and S514 to S515 are performed, and the development UI display is performed. Will be in the third state shown in FIG. In this third state, brightness, hue, development mode, and file output are set to be operable, and sharpness and noise are set to be inoperable.

  When the development mode is the high image quality development mode (second image processing mode) (high image quality development in step S510), the CPU 101 sets the slider control 308 for adjusting the sharpness to an operable state (step S516). : Enable). Further, the CPU 101 sets the slider control 309 for adjusting noise to an operable state (step S517: Enable). Then, the CPU 101 proceeds to the process of step S513.

  Accordingly, when a RAW moving image file is selected, and in the high image quality development mode and during the reproduction operation, the processes of steps S508 to S509, S516 to S517, and S506 to S507 are performed, and the development UI display is performed. The fourth state shown in FIG. In this fourth state, the brightness and hue are set so that sharpness and noise can be manipulated, and the development mode and file output are set so as not to be manipulated.

  If the RAW moving image file is selected and the playback mode is stopped in the high image quality development mode, the processes of steps S508 to S509, S516 to S517, and S514 to S515 are performed, and the development UI display is performed. Then, the fifth state shown in FIG. In the fifth state, brightness, hue, sharpness, noise, development mode, and file output are set to be operable.

  In this way, when the development UI display process described with reference to FIG. 5 is performed, the development UI in which only the necessary functions are enabled according to the selection state of the RAW moving image file, the set development mode, and the reproduction mode. Can be provided to the user.

  FIG. 7 is a flowchart for explaining in detail the development processing described in steps S405, S413, and S419 shown in FIG.

  When the development process is started, the CPU 101 acquires the brightness parameter set by the brightness adjustment slider control 306. Then, the CPU 101 multiplies each pixel of the RAW image data in the Bayer array of one frame read into the RAW image frame memory secured in the RAM 103 by a coefficient corresponding to the value of the brightness parameter. Thus, the CPU 101 adjusts the brightness of one frame of RAW image data (step S601).

  Subsequently, the CPU 101 acquires a hue parameter set by the slider control 307 for hue adjustment. The CPU 101 multiplies each pixel of one frame of RAW image data by a coefficient corresponding to the value of the hue parameter. Thereby, the CPU 101 adjusts the hue by adjusting the white balance (step S602).

  Next, the CPU 101 acquires the state of the development mode check box 310 and determines the development mode. That is, the CPU 101 determines whether the development mode is the high speed development mode or the high image quality development mode (step S603). If the development mode is the high-speed development mode (high-speed development in step S603), the CPU 101 performs simple interpolation filter processing on the RAW image data in the Bayer array to generate RGB image data (step S604).

  Then, the CPU 101 writes RGB image data into the image data frame memory secured in the RAM 103 (step S605), and ends the development process. Thereafter, the CPU 101 proceeds to the process of step S406, S414, or S420.

  If the development mode is the high image quality development mode (high image quality development in step S603), the CPU 101 performs interpolation filter processing on the RAW image data in the Bayer array to generate RGB image data (step S606). Thereafter, the CPU 101 acquires the sharpness parameter set by the slider control 308 for sharpness adjustment. Then, the CPU 101 performs edge enhancement processing corresponding to the sharpness parameter value on the RGB image data (step S607: sharpness processing).

  Subsequently, the CPU 101 acquires the noise parameter set by the slider control 309 for noise adjustment. Then, the CPU 101 performs noise removal processing corresponding to the value of the noise parameter on the RGB image data after the sharpness processing (step S608). Thereafter, the CPU 101 proceeds to the process of step S605.

  FIG. 8 is a diagram for explaining the simple interpolation process and the interpolation process described in steps S604 and S606 shown in FIG. FIG. 8A is a diagram illustrating a part of the RAW image data in the Bayer array, and FIG. 8B is a diagram illustrating R image data that is a result of performing interpolation processing on the RAW image data. is there. FIG. 8C is a diagram showing the G image data as a result of the interpolation processing performed on the RAW image data.

  In FIG. 8B and FIG. 8C, the pixels indicated by capital letters “R” and “G” are pixels at the same positions as the “R” and “G” pixels shown in FIG. Yes, these pixels are not interpolated and have the same value as the RAW image data. On the other hand, pixels indicated by lowercase letters “r” and “g” are pixels generated by interpolation processing.

  When the pixel values of “r11”, “r15”, “r16” shown in FIG. 8B and “g8” shown in FIG. 8C are generated by interpolation processing, the simple interpolation processing in step S604 shown in FIG. In order to give priority to the processing speed, the number of pixels is limited and the pixel value is calculated by the following equation (1).

一方、ステップＳ６０６の補間処理においては画質を向上させるため画素数を簡易補間処理よりも多くして、次の式（２）によって画素値を算出する。

On the other hand, in the interpolation process in step S606, the number of pixels is increased as compared with the simple interpolation process in order to improve the image quality, and the pixel value is calculated by the following equation (2).

このようにして、簡易補間処理および補間処理を選択的に行う際で、使用する画素数および計算式を変更することによって、高速な処理と高画質な処理とを切り替えることができる。

In this way, when the simple interpolation process and the interpolation process are selectively performed, the high-speed process and the high-quality process can be switched by changing the number of pixels to be used and the calculation formula.

  As described above, in the embodiment of the present invention, the image processing item is changed according to the reproduction operation state and the development mode setting at the time of file output, and the simple interpolation process and the interpolation process are switched. Therefore, it is possible to perform high-speed development processing during file reproduction to prevent a decrease in frame rate, and to display a preview of the final output image according to the file output setting while reproduction is stopped.

  As is clear from the above description, in the example shown in FIG. 1, the CPU 101, the image processing unit 108, and the display control unit 109 function as a screen display control unit and a reproduction processing unit, and the CPU 101 and the image processing unit 108 are a file. It functions as a generation means.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, Various forms of the range which does not deviate from the summary of this invention are also contained in this invention. .

  For example, the functions of the above embodiments may be used as an image processing method, and this image processing method may be executed by an image processing apparatus such as a PC. Further, a computer having the function of the above-described embodiment may be executed by a computer included in the image processing apparatus. The program is recorded on a computer-readable recording medium, for example.

  At this time, each of the image processing method and the program has at least a screen display control step, a reproduction processing step, and a file generation step.

  The present invention can also be realized by executing the following processing. That is, software (program) for realizing the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

101 CPU
102 ROM
103 RAM
105 External IF
106 User IF
108 Image Processing Unit 109 Display Control Unit 110 Display 111 Storage Medium 112 Input Device

Claims (8)

An image processing apparatus that reads moving image data and performs image processing on the moving image data by adjusting a plurality of image processing parameters,
Screen display control means for displaying an operation screen for setting the plurality of image processing parameters on a display unit;
Reproduction processing means for reproducing the moving image data as a moving image on a display unit based on the plurality of image processing parameters;
File generating means for generating a moving image file in a predetermined file format by performing image processing on the moving image data based on an image processing parameter set on the operation screen;
The screen display control means includes
During the reproduction operation for reproducing the moving image on the display unit by the reproduction processing unit, the operation of at least a part of the image processing parameters on the operation screen is disabled.
While the reproduction operation is stopped, an image processing parameter that is in an operation impossible state on the operation screen during the reproduction operation is set to an operable state.   The image processing apparatus according to claim 1, wherein image processing corresponding to an image processing parameter that disables the operation is not performed during a reproduction operation.   3. The image processing apparatus according to claim 1, wherein image processing parameters operable on the operation screen during the reproduction operation are smaller than those during the reproduction operation being stopped.   4. The moving image data according to claim 1, wherein the moving image data is moving image data in which an output of an image pickup device in which pixels are arranged in a Bayer array is recorded in a memory without performing a debayer process. 5. Image processing apparatus.   5. The file processing unit according to claim 1, wherein when the interpolation processing is performed on the moving image data, the file generation unit increases the number of pixels used for the interpolation processing as compared with the reproduction processing unit. Image processing device.   As the image processing parameters, at least a brightness parameter that defines brightness processing in the moving image data, a hue parameter that defines hue processing in the moving image data, and a sharpness parameter that defines sharpness processing in the moving image data The image processing apparatus according to claim 1, further comprising: a noise parameter that defines noise processing in the moving image data. A control method of an image processing apparatus that reads moving image data and adjusts a plurality of image processing parameters to perform image processing on the moving image data,
A screen display control step for displaying an operation screen for setting the plurality of image processing parameters on a display unit;
A reproduction processing step of reproducing the moving image data as a moving image on a display unit based on the plurality of image processing parameters;
A file generating step for generating a moving image file in a predetermined file format by performing image processing on the moving image data based on an image processing parameter set on the operation screen;
In the screen display control step,
During the reproduction operation of reproducing the moving image on the display unit in the reproduction processing step, the operation of at least some image processing parameters on the operation screen is disabled,
While the reproduction operation is stopped, an image processing parameter that has been inoperable on the operation screen during the reproduction operation is set to an operable state. A program used in an image processing apparatus that reads moving image data and performs image processing on the moving image data by adjusting a plurality of image processing parameters,
In the computer provided in the image processing apparatus,
A screen display control step for displaying an operation screen for setting the plurality of image processing parameters on a display unit;
A reproduction processing step of reproducing the moving image data as a moving image on a display unit based on the plurality of image processing parameters;
Based on the image processing parameters set on the operation screen, a file generation step of performing image processing on the moving image data to generate a moving image file in a predetermined file format is executed.
In the screen display control step,
During the reproduction operation of reproducing the moving image on the display unit in the reproduction processing step, the operation of at least some image processing parameters on the operation screen is disabled,
A program characterized in that, during the stop of the reproduction operation, an image processing parameter that has been inoperable on the operation screen during the reproduction operation is set in an operable state.

Images