JP2016127505A - Image processing apparatus and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce processing load when parameters for use in development of RAW image data are obtained.SOLUTION: An image processing apparatus comprises: a first parameter generator which analyzes RAW image data and generates a first parameter for use in development of RAW image data; a second parameter generator which generates a second parameter for use in development of the RAW image data on the basis of Exif information given to the RAW image data; and a RAW image developer which develops the RAW image data by using the first parameter generated by the first parameter generator and the second parameter generated by the second parameter generator.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an image processing apparatus and an image processing method, and more particularly to a technique for developing RAW image data.

  Patent Document 1 discloses a camera system that generates development parameters for skipped frames at predetermined intervals of RAW moving image data, and stores the RAW moving image data and the development parameters in association with each other in a recording medium. Yes.

  Further, Patent Document 2 discloses an imaging apparatus that is capable of recording development parameters necessary for interpolation processing as compared with the technique disclosed in Patent Document 1. In order to achieve this object, this imaging apparatus records development parameters of RAW image frames before and after a scene change is detected.

Japanese Patent No. 4831017 Japanese Patent No. 56033641

  However, the techniques disclosed in Patent Document 1 and Patent Document 2 both acquire all development parameters by analyzing RAW image data. If all the development parameters are acquired by analyzing the RAW image data, there is a problem that the processing load for acquiring the development parameters increases.

  The present invention has been made based on the above-described knowledge, and can provide an image processing apparatus and an image processing method capable of reducing a processing load when obtaining parameters used for developing RAW image data. .

  An image processing apparatus according to a first aspect of the present invention analyzes a RAW image data, generates a first parameter used in developing the RAW image data, and the RAW image. Based on the Exif information added to the data, a second parameter generation unit that generates a second parameter used in the development of the RAW image data, and a first parameter generated by the first parameter generation unit And a RAW image development unit that develops the RAW image data using the parameter and the second parameter generated by the second parameter generation unit.

  The image processing method according to the second aspect of the present invention analyzes RAW image data to generate a first parameter used in the development of the RAW image data, and the Exif added to the RAW image data. A parameter generating step for generating a second parameter used in developing the RAW image data based on the information; and the RAW based on the first parameter and the second parameter generated in the parameter generating step. And a RAW image development step for developing image data.

  According to each aspect of the present invention described above, it is possible to provide an image processing apparatus and an image processing method capable of reducing the processing load when obtaining parameters used for developing RAW image data.

It is a figure which shows the structure of the raw video data processing system which concerns on embodiment. It is a figure which shows the structure of the imaging device which concerns on embodiment. It is a figure which shows the structure of the developing device which concerns on embodiment. It is a figure which shows the relationship between the structure of the RAW moving image data which concerns on embodiment, and the parameter produced | generated from the RAW moving image data. It is a figure which shows the functional block of the developing device which concerns on embodiment. It is a sequence diagram which shows the process of the developing device which concerns on embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Specific numerical values and the like shown in the following embodiments are merely examples for facilitating understanding of the embodiments, and are not limited thereto unless otherwise specified. In the following description and drawings, matters obvious to those skilled in the art are omitted and simplified as appropriate for the sake of clarity.

<Configuration of RAW video data processing system>
First, the configuration of a RAW moving image data processing system 1 according to an embodiment of the present invention will be described with reference to FIG. The RAW moving image data processing system 1 is a system that generates moving image data that can be used for streaming from RAW moving image data. As shown in FIG. 1, the RAW moving image data processing system 1 includes an imaging device 2, a PC (Personal Computer) 3, and a developing device 4.

  The imaging device 2 captures a subject and generates RAW moving image data. More specifically, the imaging device 2 captures a subject at a predetermined time interval and generates a plurality of RAW image data (RAW still image data). That is, the above-mentioned RAW moving image data is composed of a plurality of RAW image data.

  The PC 3 can be connected to the imaging device 2 via a USB cable. The RAW moving image data is transferred from the imaging device 2 to the PC 3 by communication via a USB cable. The PC 3 can be connected to the developing device 4 by a USB cable. The RAW moving image data transferred from the imaging device 2 is transferred from the PC 3 to the developing device 4 by communication via a USB cable.

  The developing device 4 develops the RAW moving image data transferred from the PC 3. Hereinafter, the moving image data generated by developing the RAW moving image data is also referred to as “development moving image data”. The development moving image data is transferred from the development device 4 to the PC 3 by communication via the USB cable.

  The PC 3 can reproduce the developed moving image data transferred from the developing device 4 and display it on a display device (not shown) connected to the PC 3. As this display device, for example, an arbitrary display device among various display devices such as a liquid crystal display, an organic EL display, or a plasma display may be used.

<Configuration of imaging device>
Next, the configuration of the imaging device 2 according to the embodiment of the present invention will be described with reference to FIG. As shown in FIG. 2, the imaging device 2 includes an image sensor 11, a preprocess circuit 12, a CPU (Central Processing Unit) 13, a display 14, a USB (Universal Serial Bus) host bus adapter 15, a RAM ( Random Access Memory) 16, an SD card 17, and an image processing block 18. Hereinafter, the USB host bus adapter is also referred to as “USB adapter”.

  The image sensor 11 generates image information indicating an image of the object scene with a voltage value via a lens (not shown).

  The preprocess circuit 12 converts the image information generated by the image sensor 11 into digital data, and generates RAW image data from the image information by performing preprocessing such as defective pixel correction of the image sensor 11. The defective pixel correction is a process of complementing information corresponding to a defective pixel of the image sensor 11 that has been recognized in advance based on information of surrounding pixels. The preprocess circuit 12 stores the generated RAW image data in the RAM 16. Here, the preprocess circuit 12 repeatedly generates RAW image data at predetermined time intervals. Thereby, RAW moving image data composed of a plurality of RAW image data is generated.

  The CPU 13 comprehensively controls the imaging device 2. CPU13 performs the process which controls the imaging device 2, for example by running the program stored in RAM16. That is, the program stored in the RAM 16 includes a code that causes the CPU 13 to execute processing for controlling the imaging device 2. Needless to say, this program may be loaded into the RAM 16 from a nonvolatile storage device (for example, a flash memory or a hard disk) included in the imaging apparatus 2 and executed by the CPU 13.

  The display 14 is a display device that displays an arbitrary image. As the display 14, any display device among the above-described various display devices may be used.

  The USB adapter 15 is connected to the USB cable described above. The USB adapter 15 transfers RAW moving image data stored in the SD card 17 to the PC 3 as will be described later in accordance with control from the CPU 13.

  The RAM 16 is a volatile memory that stores arbitrary data used by the imaging device 2. As described above, the RAM 16 stores RAW moving image data (a plurality of RAW image data), a program, and the like.

  The SD card 17 is a memory card that stores RAW moving image data. A plurality of RAW image data sequentially stored in the RAM 16 by the preprocess circuit 12 is finally stored in the SD card 17 as RAW moving image data.

  More specifically, the CPU 13 writes a plurality of RAW image data stored in the RAM 16 to the SD card 17 at a predetermined timing. The predetermined timing is, for example, a timing at predetermined time intervals or a timing when the total size of the plurality of RAW image data stored in the RAM 16 reaches a predetermined amount. At this time, the CPU 13 generates shooting information and Exif information based on shooting conditions and the like, and assigns them to the RAW image data. As a result, the RAW moving image data including all the RAW image data generated until the shooting is completed and the shooting information and the Exif information assigned to the RAW image data is stored in the SD card 17. Note that one piece of shooting information and Exif information may be assigned to one RAW image data, or one piece may be assigned to a plurality of RAW image data.

  The image processing block 18 is a circuit that performs image processing of RAW moving image data stored in the RAM 16 in accordance with control from the CPU 13. This image processing includes processing for developing each of the plurality of RAW image data included in the RAW moving image data, and processing for reducing the RAW image data according to the size of the display 14. That is, a plurality of RAW image data sequentially stored in the RAM 16 by the preprocess circuit 12 is written to the SD card 17 as described above, and image processing is sequentially performed by the image processing block 18. The image processing block 18 outputs the image data generated by developing the RAW image data in the image processing to the display 14. Hereinafter, the image data generated by developing the RAW image data is also referred to as “developed image data”. The display 14 displays an image indicated by the developed image data output from the image processing block 18. As a result, a preview moving image of developed moving image data constituted by a plurality of developed image data is displayed on the display 14.

<Configuration of developing device>
Next, the configuration of the developing device 4 according to the embodiment of the present invention will be described with reference to FIG. As illustrated in FIG. 3, the developing device 4 includes a CPU 21, a USB adapter 22, a RAM 23, a RAW analysis block 24, an image processing block 25, and a moving image codec 26.

  The CPU 21 comprehensively controls the developing device 4. The CPU 21 executes a process for controlling the developing device 4 by executing a program stored in the RAM 23, for example. That is, the program stored in the RAM 23 includes a code that causes the CPU 21 to execute processing for controlling the developing device 4. Needless to say, this program may be loaded into the RAM 23 from the nonvolatile storage device (for example, flash memory or hard disk) of the developing device 4 and executed by the CPU 21.

  The USB adapter 22 is connected to the USB cable described above. The USB adapter 22 receives the RAW moving image data transferred from the PC 3 in accordance with control from the CPU 21 and stores it in the RAM 23. In addition, the USB adapter 22 acquires, from the RAM 23, developed moving image data generated from the RAW moving image data as described later, and transfers it to the PC 3 in accordance with control from the CPU 21.

  The RAM 23 is a volatile memory that stores arbitrary data used by the imaging device 2. As described above, the RAM 23 stores RAW moving image data (a plurality of RAW image data), developed moving image data (a plurality of developed image data), a program, and the like.

  The RAW analysis block 24 is a circuit that analyzes RAW moving image data stored in the RAM 23 in accordance with control from the CPU 21. The RAW analysis block 24 analyzes each of the plurality of RAW image data included in the RAW moving image data, and extracts each feature amount of the plurality of RAW image data. The CPU 21 generates parameters used for developing the RAW image data based on the feature amount generated by the RAW analysis block 24. Note that a feature amount for the RAW image data may be calculated from one RAW image data, or a feature amount for each of the plurality of RAW image data may be calculated from a plurality of RAW image data.

  The image processing block 25 is a circuit that performs image processing of RAW moving image data stored in the RAM 3 in accordance with control from the CPU 21. This image processing includes development processing for developing each of the plurality of RAW image data included in the RAW moving image data. This development processing includes processing for performing various corrections on the RAW image data. The CPU 21 designates a parameter generated based on the Exif information added to the RAW image data and a parameter generated based on the feature amount of the RAW image data, and performs image processing of the RAW image data on the image processing block 25. To do. As a result, the image processing block 25 performs appropriate development processing using the parameters specified by the CPU 21. The image processing block 25 stores the developed moving image data generated by developing the RAW moving image data in the RAM 23.

  The moving image codec 26 converts the developed moving image data stored in the RAM 23 into developed moving image data that can be used for streaming under the control of the CPU 21. Hereinafter, the moving image data available for streaming is also referred to as “moving image stream”. The moving image codec 26 stores the moving image stream generated by converting the developed moving image data in the RAM 23. The moving image stream is, for example, moving image data in MPEG (Moving Picture Experts Group) format.

<Parameter generation method in developing device>
Subsequently, with reference to FIGS. 4 and 5, a parameter generation method in the imaging device 2 and the developing device 4 according to the embodiment of the present invention will be described. FIG. 4 is a diagram showing a relationship between the configuration of the RAW moving image data according to the embodiment of the present invention and parameters generated from the RAW moving image data. FIG. 5 is a functional block diagram of the developing device 4 according to the embodiment of the present invention.

  As illustrated in FIG. 4, the RAW moving image data includes shooting information, a plurality of Exif information, and a plurality of RAW image data.

  The shooting information is included in the header of the RAW moving image data. That is, FIG. 4 shows an example in which one piece of shooting information is assigned to all RAW image data included in the RAW moving image data. The shooting information is information indicating shooting conditions when RAW moving image data is generated by shooting. The shooting information includes information such as subject brightness information, ISO sensitivity information, lens information, light source information, shooting aperture information, and shooting shutter speed information. These pieces of information are included in the shooting information in a format conforming to Exif, for example.

  The subject luminance information is information indicating the luminance of the photographed subject. The ISO sensitivity information is information indicating the ISO sensitivity at the time of shooting. The lens information is information indicating, for example, the lens type and focal length. The light source information is information indicating, for example, the type of light source and the color temperature at the time of shooting. The shooting aperture information is information indicating an aperture value (F value) at the time of shooting. The shooting shutter speed information is information indicating the shutter speed at the time of shooting.

  Each of the plurality of pieces of Exif information is given to each of a predetermined number of units of RAW image data. FIG. 4 shows an example in which one Exif information is assigned to N RAW image data (N is a predetermined positive integer). The Exif information includes, for example, information such as a white balance (WB) coefficient, an optical black (OB) coefficient, and a color matrix (CCM) in the manufacturer note portion therein.

  As shown in FIG. 5, the developing device 4 includes, as function blocks, an information acquisition unit 31, a RAW image analysis unit 32, a first parameter calculation unit 33, a second parameter calculation unit 34, and a RAW. And an image developing unit 35.

  Here, the CPU 21 functions as an information acquisition unit 31, a first parameter calculation unit 33, and a second parameter calculation unit 34. The RAW analysis block 24 functions as the RAW image analysis unit 32. The image processing block 25 functions as the RAW image developing unit 35.

  The information acquisition unit 31 acquires shooting information and Exif information from RAW moving image data stored in the RAM 23.

  The RAW image analysis unit 32 analyzes each of the plurality of RAW image data included in the RAW moving image data. The RAW image analysis unit 32 analyzes the RAW image data and extracts the feature amount. As this feature amount, for example, noise amount, color reproducibility, luminance distribution, off-axis chromatic aberration, edge strength, and the like in RAW image data are extracted.

  Based on the feature amount extracted by the RAW image analysis unit 32, the first parameter calculation unit 33 generates a first parameter used for developing the RAW image data from which the feature amount has been extracted. That is, a first parameter group (first parameter set) that is a correction amount for correcting each of noise amount, color reproducibility, luminance distribution, off-axis chromatic aberration, and edge intensity in RAW image data is generated. .

  The first parameter may be generated using an arbitrary technique among existing techniques. For example, the first parameter is generally generated as follows.

  The first parameter for the noise amount is a correction amount used in noise amount correction processing (noise reduction) in image processing by the image processing block 25. As a first parameter for the amount of noise, a correction amount that increases the strength of noise reduction is calculated as the amount of noise extracted as a feature amount increases.

  The first parameter for color reproducibility is a correction amount used in the color reproducibility correction process in the image processing by the image processing block 25. As a first parameter for color reproducibility, based on the color reproducibility extracted as a feature amount, a correction amount that causes more color drop is calculated as the pixel becomes brighter or darker.

  The first parameter for the luminance distribution is a correction amount used in the luminance distribution correction processing (gamma correction) in the image processing by the image processing block 25. That is, the luminance correction process is a process for correcting a gamma curve (tone curve). As a first parameter for the luminance distribution, a gamma curve correction amount is calculated based on the luminance distribution extracted as the feature amount.

  The first parameter for the off-axis chromatic aberration is a correction amount used in the off-axis chromatic aberration correction process in the image processing by the image processing block 25. As a first parameter for the off-axis chromatic aberration, a correction amount for correcting the shift between the red and blue positions in the RAW image data is calculated based on the off-axis chromatic aberration extracted as the feature amount.

  The first parameter for the edge strength is a correction amount used in the edge strength correction processing in the image processing by the image processing block 25. As the first parameter for the edge strength, a correction amount for increasing the edge strength is calculated as the edge strength extracted as the feature amount decreases.

  At this time, the first parameter calculation unit 33 corrects the first parameter using arbitrary information among the shooting information acquired by the information acquisition unit 31. Here, examples of (1) correcting the first parameter using shooting aperture information and (2) correcting the first parameter using ISO sensitivity information in the shooting information will be described. To do.

(1) Shooting Aperture Information Generally, the sharpness of an image can be known from the aperture at the time of shooting. It is known that blurring of an image becomes stronger as the aperture at the time of shooting becomes stronger. This is called a diffraction phenomenon. Therefore, the first parameter calculation unit 33 corrects the first parameter for the edge strength so that the edge strength becomes stronger as the photographing aperture indicated by the photographing aperture information becomes stronger. According to this, a more optimal correction amount can be calculated as the first parameter for the edge strength.

(2) ISO sensitivity information In the analysis of the noise amount, a portion where the pixel value is flat in the RAW image data is detected, and a change in the pixel value based on the pixel value of the portion is calculated as the noise amount. However, if a portion with a flat pixel value cannot be detected well, a change in a normal pixel value may be erroneously detected as noise.

  On the other hand, it is generally known that noise increases as ISO sensitivity at the time of shooting increases. Therefore, the first parameter calculation unit 33 determines whether or not the first parameter with respect to the noise amount is within a predetermined normal range. If it is determined that the first parameter is outside the normal range, the first parameter is calculated. Is corrected to the first parameter derived based on the ISO sensitivity indicated by the ISO sensitivity information. On the other hand, when the first parameter calculation unit 33 determines that the first parameter with respect to the noise amount is within a predetermined normal range, the first parameter calculation unit 33 does not correct the first parameter.

  As described above, the relationship between the ISO sensitivity and the noise amount is known, and the noise amount can be estimated from the ISO sensitivity. In other words, the correction amount for the noise amount correction process can be estimated in advance based on the ISO sensitivity. Therefore, information in which the ISO sensitivity is associated with the first parameter for the noise amount estimated by the ISO sensitivity is prepared in the imaging device 2 in advance. This information is stored in, for example, the RAM 23 of the developing device 4 or a nonvolatile storage device. And the 1st parameter calculation part 33 should just derive | lead-out a 1st parameter from the ISO sensitivity which ISO sensitivity information shows based on the information.

  Based on the Exif information acquired by the information acquisition unit 31, the second parameter calculation unit 34 generates a second parameter used for developing the RAW image data to which the Exif information is added. That is, each of the white balance coefficient, the optical black coefficient, and the color matrix included in the Exif information is generated as a second parameter group (second parameter set).

  The second parameter indicated by the white balance coefficient is a correction amount used in the color reproducibility correction processing in the image processing by the image processing block 25. The second parameter indicated by the optical black coefficient is a correction amount used in the luminance distribution correction processing in the image processing by the image processing block 25. The second parameter indicated by the color matrix is a correction amount used in the color reproducibility correction processing in the image processing by the image processing block 25.

  In the above description, an example of correcting all of the noise amount, color reproducibility, luminance distribution, off-axis chromatic aberration, and edge intensity has been described, but the present invention is not limited to this. Of these, at least one may be corrected. In that case, only the feature amount corresponding to the correction to be performed may be extracted.

  Further, the first parameter calculation unit 33 and the second parameter calculation unit 34 perform hysteresis control on the parameter so that the parameter does not change suddenly. Hereinafter, the method will be described with reference to FIG.

  In FIG. 4, two second parameters “parameter A” and “parameter B” are generated based on the Exif information, and N pieces of RAW image data to which the Exif information is added are analyzed to obtain two parameters. An example in which the first parameters “parameter C” and “parameter D” are generated is shown.

  Based on the first information group “Exif information 1”, “RAW image data 1-1” to “RAW image data 1-N”, the second parameters “parameter A1”, “parameter B1”, and the first Parameters “parameter C1” and “parameter D1” are generated. Based on these parameters, development processing of “RAW image data 1-1” to “RAW image data 1-N” is performed in the image processing block 25.

  Based on the second information group “Exif information 2”, “RAW image data 2-1” to “RAW image data 2-N”, the second parameter “parameter A2”, “parameter B2”, and the first Parameters “parameter C2” and “parameter D2” are generated.

  At this time, the second parameter calculation unit 34 averages each of “parameter A2” and “parameter B2” generated this time and each of “parameter A1” and “parameter B1” generated last time. More specifically, “parameter A2” and “parameter A1” are added and divided by the number of parameters “2” as a final parameter “parameter A2 ′”. The result obtained by adding “parameter B2” and “parameter B1” and dividing the result by “2” is the final parameter “parameter B2 ′”.

  The first parameter calculation unit 33 also averages each of the “parameter C2” and “parameter D2” generated this time and each of the “parameter C1” and “parameter D1” generated last time. More specifically, “parameter C2” and “parameter C1” are added and divided by the number of parameters “2” as a final parameter “parameter C2 ′”. The result obtained by adding “parameter D2” and “parameter D1” and dividing the result by the number of parameters “2” is the final parameter “parameter D2 ′”.

  Based on these parameters “parameter A2 ′”, “parameter B2 ′”, “parameter C2 ′”, “parameter D2 ′”, “RAW image data 1-2” to “RAW image data 2-” in the image processing block 25. N "development processing is performed.

  Based on the third information group “Exif information 3”, “RAW image data 3-1” to “RAW image data 3-N”, the second parameter “parameter A3”, “parameter B3”, and the first Parameters “parameter C3” and “parameter D3” are generated.

  At this time, the second parameter calculation unit 34 averages each of “parameter A3” and “parameter B3” generated this time and each of “parameter A2 ′” and “parameter B2 ′” generated last time. . More specifically, “parameter A3” and “parameter A2 ′” are added and divided by the number of parameters “2” as the final parameter “parameter A2 ′”. The result of adding “parameter B3” and “parameter B2 ′” and dividing by the number of parameters “2” is the final parameter “parameter B3 ′”.

  In addition, the first parameter calculation unit 33 also averages each of the “parameter C3” and “parameter D3” generated this time and each of the “parameter C2 ′” and “parameter D2 ′” generated last time. More specifically, “parameter C3” and “parameter C2 ′” are added and divided by the number of parameters “2” as a final parameter “parameter C3 ′”. The result obtained by adding “parameter D3” and “parameter D2 ′” and dividing the result by “2” is the final parameter “parameter D3 ′”.

  Based on these parameters “parameter A3 ′”, “parameter B3 ′”, “parameter C3 ′”, and “parameter D3 ′”, in the image processing block 25, “RAW image data 1-2” to “RAW image data 2- N "development processing is performed.

  Similarly thereafter, the first parameter calculation unit 33 and the second parameter calculation unit 34 generate, as a final parameter, a parameter obtained by averaging the parameter generated this time and the parameter generated last time. According to this, it is possible to suppress a rapid change in parameters for each of a series of RAW image data included in the RAW moving image data. For this reason, it is possible to suppress a sudden image change in the developed moving image data generated using these parameters, and to reproduce a moving image with more natural and good image quality.

  In the above description, an example in which an arithmetic average of parameters is calculated as parameter averaging has been described. However, the present invention is not limited to this. As the parameter averaging, other averaging methods such as a geometric average and a weighted average may be adopted. In addition to the averaging process, a process of limiting the parameter range by the clipping process may be performed.

  Moreover, although the above description demonstrated the example which implements hysteresis control about both the 1st parameter and the 2nd parameter, it is not restricted to this. Hysteresis control may be performed for at least one of the first parameter and the second parameter. However, preferably, the hysteresis control is performed on both the first parameter and the second parameter as described above, so that it is possible to reproduce a moving image with more natural and good image quality.

  The RAW image development unit 35 develops the RAW image data based on the first parameter generated by the first parameter calculation unit 33 and the second parameter generated by the second parameter calculation unit 34.

<Processing of developing device>
Next, with reference to FIG. 6, the flow of processing of the developing device 4 according to the embodiment of the present invention will be described.

  The USB adapter 22 stores the RAW moving image data received from the PC 3 in the RAM 23 (S1). The RAW analysis block 24 (RAW image analysis unit 32) acquires and analyzes the RAW moving image data stored in the RAM 23 (S2, S3). The RAW analysis block 24 outputs the feature amount as the analysis result to the CPU 21 (S4).

  The CPU 21 (information acquisition unit 31, first parameter calculation unit 33, second parameter calculation unit 34) outputs the shooting information and Exif information acquired from the RAW moving image data stored in the RAM 23 and the RAW analysis block 24. A parameter is generated based on the feature amount (S5, S6). The CPU 21 outputs the generated parameter to the image processing block 25 (S7).

  The image processing block 25 (RAW image developing unit 35) acquires the RAW moving image data stored in the RAM 23, and develops it based on the parameters output from the CPU 21 (S8, S9). The image processing block 25 stores the developed moving image data generated by the development in the RAM 23 (S10).

  The moving image codec 26 acquires the developed moving image data stored in the RAM 23 and converts it into a moving image stream (S11, S12). The moving image codec 26 stores the generated moving image stream in the RAM 23 (S13). The USB adapter 22 acquires the moving image stream stored in the RAM 23 and transmits it to the PC 3 (S14).

<Effects of the present embodiment>
As described above, in the present embodiment, the first parameter calculation unit 33 analyzes the RAW image data, generates the first parameter used in the development of the RAW image data, and generates the second parameter. The parameter calculation unit 34 generates a second parameter used for developing the RAW image data based on the Exif information included in the RAW image. Then, the RAW image development unit 35 develops the RAW image data using the first parameter generated by the first parameter calculation unit 33 and the second parameter generated by the second parameter calculation unit. Like to do.

  According to this, it is possible to develop RAW image data without analyzing and generating RAW image data for some parameters (second parameters) among parameters used for developing RAW image data. It becomes. Therefore, according to the present embodiment, it is possible to reduce the processing load when obtaining parameters used for developing RAW image data. For example, it is possible to save the trouble of analyzing the RAW image data to calculate the white balance feature amount and calculating the second parameter (white balance coefficient) based on the feature amount.

  In the present embodiment, the first parameter calculation unit 33 corrects the first parameter based on the shooting information indicating the shooting condition when the RAW image data is generated. According to this, it is possible to further improve the image quality of the developed image data by correcting the first parameter to a more appropriate value.

  In the present embodiment, the first parameter calculation unit 33 and the second parameter calculation unit 34 use at least one of the first parameter and the second parameter for developing the first RAW image data. The averaged parameter and the parameter generated from the second RAW image data after the first RAW image data are averaged. Then, the RAW image developing unit 35 develops the second RAW image data using the parameters averaged by the first parameter calculating unit 33 and the second parameter calculating unit 34.

  According to this, a sudden change is eliminated between the parameter used for the first RAW image data and the parameter used for the second RAW image data after the first RAW image data. Can do. According to this, the parameter can be corrected to a value suitable for a moving image.

  In the present embodiment, when a moving image stream is generated from RAW moving image data, the RAW moving image data is analyzed in real time and appropriate parameters are automatically set. Therefore, compared with a technique in which parameters obtained by analyzing RAW video data are included in the RAW video data in advance, in the present embodiment, such parameters are not included in the RAW video data. The amount of data can be reduced. Further, it is not necessary for the user to perform a complicated Edit operation on the parameters included in the RAW moving image data, and a high-quality moving image stream can be easily obtained from the RAW moving image data. Further, since it is possible to employ a configuration in which no parameters are included in the RAW moving image data, the parameters used for developing the RAW moving image data are not fixed in advance, and the development can be executed without being limited to a specific developing device.

  Note that the present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the present invention.

  In the above-described embodiment, the example in which the developing device 4 generates the moving image stream from the RAW moving image data has been described. However, the imaging device 2 has the function of the developing device 4, and May be generated.

  In the above-described embodiment, the example in which the RAW moving image data processing system has one developing device 4 has been described. However, the RAW moving image data processing system may have a plurality of developing devices 4.

  In the above-described embodiment, an example in which the CPU 21 generates parameters has been described. However, the parameters may be generated by a dedicated hardware block (circuit) provided separately from the CPU 21.

  In the above-described embodiment, the example in which the moving image stream is stored in the RAM 23 has been described. For example, the developing device 4 may have an SD card, and the moving image stream may be stored in the SD card.

  In the above-described embodiment, an example in which a moving image is targeted has been described, but a still image may be targeted. For example, RAW image data generated by photography can be similarly developed.

  The program executed by the CPU 21 of the developing device 4 described above is stored using various types of non-transitory computer readable media and supplied to the computer (developing device 4). be able to. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROM (Read Only Memory) CD-R, CD -R / W, semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

1 Raw video data processing system 2 Imaging device 3 PC
4 Developing Device 11 Image Sensor 12 Preprocess Circuit 13 CPU
14 Display 15 USB adapter 16 RAM
17 SD card 18 Image processing block 21 CPU
22 USB adapter 23 RAM
24 RAW analysis block 25 image processing block 26 video codec 31 Exif information acquisition unit 32 RAW image analysis unit 33 first parameter calculation unit 34 second parameter calculation unit 35 RAW image development unit

Claims (6)

A first parameter generation unit that analyzes RAW image data and generates a first parameter used in development of the RAW image data;
A second parameter generation unit configured to generate a second parameter used in the development of the RAW image data based on the Exif information given to the RAW image data;
A RAW image development unit for developing the RAW image data using the first parameter generated by the first parameter generation unit and the second parameter generated by the second parameter generation unit;
An image processing apparatus. The RAW image data is provided with shooting information indicating shooting conditions when the RAW image data is generated by shooting,
The image processing apparatus further includes a parameter correction unit that corrects the first parameter based on the shooting information.
The image processing apparatus according to claim 1. The shooting information includes shooting aperture information indicating an aperture at the time of shooting,
The first parameter is a parameter used in edge strength correction performed in the development of the RAW image data.
The parameter correction unit corrects the first parameter so that the edge strength is corrected more strongly in the edge strength correction as the diaphragm indicated by the photographing aperture information becomes stronger.
The image processing apparatus according to claim 2. The shooting information includes shooting ISO sensitivity information indicating ISO sensitivity at the time of shooting,
The first parameter is a parameter used in noise correction performed in the development of the RAW image data,
The parameter correction unit corrects the first parameter to a parameter derived based on the ISO sensitivity indicated by the ISO sensitivity information when the first parameter is outside a predetermined normal range.
The image processing apparatus according to claim 2. The image processing device develops RAW moving image data including a plurality of RAW image data,
The image processing apparatus further includes, for at least one of the first parameter and the second parameter, a parameter used for developing the first RAW image data, and a parameter after the first RAW image data. A parameter averaging unit that generates a parameter obtained by averaging the parameter generated from the second RAW image data;
The RAW image development unit develops the second RAW image data using a parameter averaged by the parameter averaging unit for at least one of the first parameter and the second parameter. ,
The image processing apparatus according to claim 1. The RAW image data is analyzed to generate a first parameter used in the development of the RAW image data, and is used in the development of the RAW image data based on the Exif information given to the RAW image data. A parameter generating step for generating a second parameter;
A RAW image development step for developing the RAW image data based on the first parameter and the second parameter generated in the parameter generation step;
An image processing method comprising:

Images