JP2016213747A - Image processing apparatus, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To generate a display image which does not damage feeling of resolution belonging to a captured image such as a RAW image, while reducing a load of generating the display image.SOLUTION: A first display image generation circuit (131) acquires only specific color component values out of plural color component values for determining the colors of respective pixels constituting a captured image. Then, the first display image generation circuit (131) configures the specific color component values acquired from the captured image as the pixel values of luminances respectively corresponding to the respective pixels constituting the captured image, and generates the respective pixel values of an image for display.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  In recent years, with the increase in digital video cameras capable of shooting UHD (Ultra High Definition) images such as so-called 4K images, production of high-resolution images has been spreading. For this reason, in the field of photography, there is an increasing demand for confirming the focus of a digital video camera and details of images using a 4K monitor or the like.

  However, for example, when video output to a display device such as a 4K monitor is performed in real time simultaneously with high-resolution video shooting such as 4K, the processing load on the digital video camera side increases. In particular, when RAW shooting is performed on a high-resolution video such as 4K, the processing load inside the digital video camera increases. In other words, the storage processing of the RAW image data in the storage medium, the processing of generating the display image from the RAW image data, the processing of outputting the display image to the display device, and the like are performed in real time, so that the processing load inside the digital video camera is extremely To increase.

  As described above, when the processing load in the digital video camera increases, other processing flows are compressed. For this reason, it is desirable to reduce the processing load for generating a display image from RAW image data.

  As a technique capable of reducing the amount of calculation when generating a display image from a high-resolution RAW image, for example, in Patent Document 1, a reduced image is generated from RAW image data stored in a storage medium, and the reduced image is captured. A technique for displaying as a result is disclosed. In the technique described in Patent Document 1, the amount of calculation is reduced by setting a reduced image constituent pixel for a RAW image and limiting the pixels to be a display image calculation target to the reduced image constituent pixel. .

JP 2008-21129 A

  The technique described in Patent Literature 1 can reduce the amount of calculation when generating a display image from a RAW image (reducing the burden of display image generation processing). However, in the technique described in Patent Document 1, since a high-resolution RAW image is reduced to generate a low-resolution display image, the fineness of the appearance of the image (hereinafter referred to as resolution) is reduced. There is a problem of doing.

  The present invention has been made in view of such problems, and can reduce the burden of display image generation processing and can generate a display image that does not impair the sense of resolution of a captured image such as a RAW image. An object of the present invention is to provide an image processing apparatus, an image processing method, and a program.

  The image processing apparatus according to the present invention includes one or more specific colors that are smaller than the number of color component values that determine the color of the pixel among a plurality of color component values that determine the color of each pixel that constitutes the captured image. An acquisition unit that acquires only component values; and the acquired specific color component value is set as a pixel value of luminance corresponding to each pixel constituting the captured image, and each pixel value of the display image is set. And generating means for generating.

  ADVANTAGE OF THE INVENTION According to this invention, the display image which does not impair the sense of resolution which picked-up images, such as a RAW image, have can be produced | generated, reducing the burden of the display image production | generation process.

It is a figure which shows schematic structure of the imaging device of embodiment. It is a figure which shows schematic structure of a 1st display image generation circuit. It is a figure which shows schematic structure of a 2nd display image generation circuit. It is the schematic of the luminance image generation by the 1st display image generation circuit. It is a figure which shows the example of the data structure of a RAW image. It is a figure which shows the example of the data structure of a display image. It is the schematic of the display image generation by the 2nd display image generation circuit. It is a flowchart of the process from imaging | photography of a RAW image to memory | storage. It is a flowchart of a process until a display image is produced | generated from a RAW image.

  Hereinafter, an imaging apparatus such as a digital video camera will be described as an application example of the image processing apparatus of the present embodiment. FIG. 1 is a diagram illustrating a schematic configuration of an imaging apparatus 1 according to the present embodiment. The imaging device 1 includes an imaging circuit 11, a correction processing circuit 12, a display image generation circuit 13, a 3G-SDI controller 14, a 3G-SDI terminal 15, a memory card controller 16, a CPU 17, a memory 18, a key / electronic dial 19, an LCD 20, A bus 21 is provided.

  The display image generation circuit 13 includes an acquisition unit and a first display image generation circuit 131 that is an example of a generation unit, and a second display image generation circuit 132 that is an example of a reduced image generation unit. As shown in FIG. 2, the first display image generation circuit 131 includes a pixel interpolation processing circuit 131a and an averaging processing circuit 131b. As shown in FIG. 3, the second display image generation circuit includes a RAW reduction processing circuit 132a and a development processing circuit 132b.

  The monitor 22 is connected to the imaging device 1 via a 3G-SDI terminal 15 which is an example of a connection unit. Note that 3G-SDI is an interface standard defined by SMPTE 424 and SMPTE 425. In addition, the connection interface standard between the monitor 22 and the imaging apparatus 1 may be a standard such as so-called HDMI (registered trademark), DVI, or DisplayPort, and is not limited to 3G-SDI. The memory card 23 is inserted into the memory card slot of the imaging device 1 and connected to the imaging device 1 via the memory card controller 16. An example of the memory card is a CFast card (CFast is an international registered trademark).

  The imaging circuit 11 has an imaging sensor in which a plurality of light receiving elements are arranged on the imaging surface. The imaging sensor receives a subject image formed on an imaging surface by an imaging optical system (lens or the like) (not shown), performs photoelectric conversion, and outputs an analog imaging signal by the photoelectric conversion. The imaging circuit 11 converts the analog imaging signal output from the imaging sensor into digital imaging data, thereby generating RAW image data that is a captured image. The image sensor is a single-plate image sensor composed of, for example, a CMOS, and a so-called Bayer type color filter is disposed on the image pickup surface of the single-plate image sensor.

  The Bayer color filter is configured by arranging color filters for red (R), green (G Gr and Gb), and blue (B) color components in a pattern as shown in FIG. 4A, for example. Has been. FIG. 4A shows only a part of the color filter. In the case of the Bayer method, as shown in FIG. 5, the RAW image data 201 includes data of each color component of the R channel, the Gr channel, the Gb channel, and the B channel. Each color data of the R channel, the Gr channel, the Gb channel, and the B channel is data for determining the color of each pixel of the RAW image.

  The imaging sensor may be a so-called three-plate imaging sensor or a multilayer sensor that receives light of different colors in each layer. In the case of a three-plate image sensor, for example, incident light is split into R, G, and B color components by a dichroic prism or the like, and a subject image is received by each image sensor arranged corresponding to each color component. In the case of a multilayer sensor, each layer receives light of different color components. In any of the above-described single-plate image sensor, three-plate image sensor, and multilayer sensor, a plurality of color component values are acquired in order to determine the color of each pixel constituting the captured image.

  The correction processing circuit 12 performs correction processing such as defective pixel correction and black level correction on the RAW image data generated by the imaging circuit 11. The RAW image data that has been corrected by the correction processing circuit 12 is temporarily stored in the memory 18.

  The display image generation circuit 13 is one color less than the number of color component values that determine the color of the pixel among a plurality of color component values for determining the color of each pixel constituting the RAW image stored in the memory 18. A display image to be output to the monitor 22 is generated using the specific color component values described above. Further, the display image generation circuit 13 uses all the color component values of the plurality of color component values for determining the color of each pixel constituting the reduced image obtained by reducing the RAW image stored in the memory 18, It is also possible to generate a reduced display image to be output to the monitor 22.

  Specifically, the first display image generation circuit 131 of the display image generation circuit 13 determines the color of the pixel among a plurality of color component values for determining the color of each pixel constituting the RAW image. Only specific color component values of one or more colors smaller than the number of color component values are acquired from the RAW image. Further, the first display image generation circuit 131 generates each pixel value of the display image corresponding to each pixel constituting the RAW image using only the specific color component value acquired from the RAW image. . In other words, the first display image generation circuit 131 uses only a specific color component value among a plurality of color component values for determining the color of each pixel of the RAW image, and has the same resolution as that of the RAW image. A display image is generated. The first display image generation circuit 131 may set an effective pixel area for the RAW image and generate a display image for the effective pixel area.

  On the other hand, the second display image generation circuit 132 of the display image generation circuit 13 generates a reduced image obtained by reducing the RAW image stored in the memory 18. Further, the second display image generation circuit 132 forms a reduced image using all the color component values of a plurality of color component values for determining each color of each pixel constituting the reduced image. Each pixel value of the reduced display image corresponding to each pixel is generated. In other words, the second display image generation circuit 132 uses all the color component values of the plurality of color component values for determining the color of each pixel constituting the reduced image, and has a resolution lower than the resolution of the RAW image. A reduced display image is generated. Note that the second display image generation circuit 132 may set an effective pixel area for the RAW image and generate a reduced display image for the effective pixel area.

  Hereinafter, the first display image generation circuit 131 will be described in detail. In the present embodiment, the specific color component value is, for example, the G (Gr and Gb) color component value among the R, G (Gr and Gb) and B color component values. In the following description, the color component value is expressed as color data.

  The pixel interpolation processing circuit 131a of the first display image generation circuit 131 includes Gr and Gb colors among the R, G (Gr and Gb) and B color data in each pixel of the RAW image stored in the memory 18. Get data only. The pixel interpolation processing circuit 131a performs pixel interpolation (so-called demosaic processing) for each of the color data Gr and Gb.

  Here, as shown in FIG. 4A, the Bayer color filters arranged on the imaging surface of the single-plate imaging sensor have three primary color filters of R, G (Gr and Gb), and B alternately. Is arranged. The so-called dot-by-dot method has only one color information for each pixel of the RAW image data, and therefore a missing pixel occurs in each color RAW image (hereinafter referred to as a color plane). In other words, the Gr and Gb color planes read from the memory 18 and supplied to the first display image generation circuit 131 include missing pixels 601 as shown in FIGS. 4B and 4D, for example. It will exist. FIG. 4B illustrates a Gr color plane, and FIG. 4D illustrates a Gb color plane.

  Therefore, the pixel interpolation processing circuit 131a performs a demosaic process of estimating the value of the missing pixel from the pixel values near the missing pixel 601 and interpolating the pixel value of the missing pixel 601 based on the estimated pixel value. For example, when it is not necessary to obtain a display image having the same resolution as the RAW image, or when a missing pixel is not generated by using a three-plate image sensor or a multilayer sensor, the pixel interpolation processing circuit 131a is May be omitted.

  The averaging processing circuit 131b of the first display image generation circuit 131 calculates an average value for each pixel of the corresponding coordinates of each color plane of Gr and Gb subjected to pixel interpolation by the pixel interpolation processing circuit 131a. Process. Then, the averaging processing circuit 131b sets each average pixel value calculated from each pixel of each color plane of Gr and Gb as a luminance pixel value. In addition, the averaging processing circuit 131b sets predetermined color values for the U and V color difference values in each pixel for constituting a display image expressed in the YUV space. In the present embodiment, zero value (0) is used as a predetermined value, and zero padding processing is performed with respect to U and V color difference values to zero values (0) for all pixels.

  As a specific example, the coordinates (0, 0) will be described with reference to color data of Gr (0, 0) in FIG. 4C and Gb (0, 0) in FIG. The averaging processing circuit 131b first obtains an average value of the color data of Gr (0, 0) and Gb (0, 0), and sets the average value as the luminance pixel value Y (0, 0). In addition, the averaging processing circuit 131b sets zero values for the U and V color difference values. The averaging processing circuit 131b performs such luminance generation processing on the pixel values of the respective coordinates, and performs processing for setting the color difference to a predetermined value (zero padding processing), so that FIG. A grayscale display image consisting only of such luminance components is generated. Thereby, as shown in FIG. 6, the display image 202 has a data structure of a YUV color space in which each pixel is composed of a luminance component (Y) and a zero-value color difference component (U, V). It becomes. In the present embodiment, the pixel values of U and V are all zero values, but may be predetermined values other than zero values.

  Here, in the generation of the luminance image, the reason why the color data of Gr and Gb is used is that, first, among the three primary colors of R, G, and B, the G component has a lot of luminance information (part representing the structure of the subject). Secondly, human vision is highly sensitive to the G component. In the above description, the display image to be output to the monitor 22 is generated from both color data of Gr and Gb, which are G components, out of the color data of the RAW image data. For example, either one of Gr and Gb is generated. A display image may be generated from only the color data. In this case, the averaging processing circuit 131b does not perform the averaging processing for calculating the average value of Gr and Gb described above.

  Next, a reduced display image having a resolution lower than the resolution of the RAW image is generated using all of a plurality of color component values for determining the color of each pixel constituting the RAW image stored in the memory 18. The second display image generation circuit 132 will be described below.

  First, the RAW reduction processing circuit 132 a of the second display image generation circuit 132 reduces the size of the RAW image data read from the memory 18. Specifically, the RAW reduction processing circuit 132a generates a RAW reduced image as shown in FIG. 7B by performing pixel thinning on the RAW image as shown in FIG. 7A, for example. Note that various known algorithms such as general 1 / N thinning (N is an integer) can be used as an algorithm for generating a reduced image from RAW image data, and description of these algorithms is omitted here.

  The development processing circuit 132b of the second display image generation circuit 132 performs processing related to development such as demosaic processing such as pixel interpolation and debayer processing on the RAW reduced image data supplied from the RAW reduction processing circuit 132a.

  More specifically, taking the Bayer method as an example, the development processing circuit 132b starts with the R color plane shown in FIG. 7C from the RAW reduced image data shown in FIG. The color planes Gr and Gb shown in (d) and the color plane B shown in FIG. 7E are generated. The Gr and Gb color planes may be divided into a Gr color plane and a Gb color plane, or may be combined into one color plane as shown in FIG.

  Further, the development processing circuit 132b interpolates the missing pixels of each color plane shown in FIGS. 7C to 7E by the demosaic process similar to the pixel interpolation processing circuit 131a described above. Then, the development processing circuit 132b creates one image for each of the three colors R, G, and B as shown in FIGS. 7F, 7G, and 7H by debayer processing. Thereafter, the development processing circuit 132b generates display image data including Y, U, and V from the R, G, and B data. That is, the development processing circuit 132 b performs development processing on the RAW reduced image data, thereby converting the RAW reduced image data into a data format suitable for output to the monitor 22. The development processing circuit 132b may include image quality adjustment processing such as white balance correction, noise reduction, gamma conversion, and color adjustment.

  The CPU 17 develops a program in the memory 18 in accordance with an input operation from the user via the key / electronic dial 19 and controls the entire imaging apparatus 1. The memory 18 stores RAW image data generated by the correction processing circuit 12, data of a display image or reduced display image generated by the display image generation circuit 13, a program executed by the CPU 17, and the like.

  The Key / electronic dial 19 is an example of a user input unit, and sends an operation input signal corresponding to a user operation to the CPU 17. The LCD 20 is a display device for the user to visually confirm the operation mode of the imaging apparatus 1 of the present embodiment, the contents of the selection operation using the key / electronic dial 19, and the like. Note that the imaging device 1 may include other display devices such as an EVF (electronic viewfinder). The bus 21 functions as a transmission path for CPU instructions and data.

  Here, as described above, the display image by the first display image generation circuit 131 is color data of G (Gr and Gb) among the R, G (Gr and Gb), and B color components of the RAW image. Is set as the luminance, and the color difference is generated by being zero-padded. For this reason, even if the RAW image is a high-resolution image of a moving image such as 4K video, for example, the processing load when the imaging device 1 generates the display image is not so large. Further, since the resolution of the display image is the same as the resolution of the RAW image, the resolution of the RAW image is not impaired.

  Therefore, for example, when a display image is generated from a RAW image and displayed on the monitor 22 capable of high-definition display such as 4K while performing high-resolution shooting such as 4K, the user can focus or Shooting can be performed while checking details in real time. However, since the display image is a grayscale image composed only of a luminance image generated using G (Gr and Gb) color data, it cannot be displayed on the monitor 22 as a color image.

  On the other hand, since the above-described reduced display image is an image obtained by performing reduction processing such as thinning on the RAW image, the processing load when the imaging apparatus 1 generates the reduced display image is not so large. The resolution is lower than that of the RAW image. However, since the reduced display image is a Y, U, V image generated using all the color data of the RAW image, the color image is displayed on the monitor 22.

  Therefore, when the reduced display image is generated from the RAW image and displayed, the user can check the color of the video, for example. In this case, it is possible to use the monitor 22 that does not support high-definition display such as 4K.

  For this reason, the imaging apparatus 1 according to the present embodiment can switch between the display image generation process and the reduced display image generation process. Specifically, the CPU 17 of the imaging device 1 causes the display image generation circuit 13 to generate a display image by the first display image generation circuit 131 and a reduced display image by the second display image generation circuit 132. It is possible to switch which of the generation processes is performed. The CPU 17 can perform such switching control based on an operation input signal from the user from the key / electronic dial 19 and automatically based on the resolution of the monitor 22 connected to the imaging apparatus 1. be able to.

  In the case of switching control based on an operation input signal by the user from the key / electronic dial 19, the CPU 17 displays a display image generation mode selection screen on the screen of the LCD 20, for example. The display image generation mode selection screen can select either a display image generation mode by the first display image generation circuit 131 or a reduced display image generation mode by the second display image generation circuit 132. It is a screen for showing a certain thing to the user. When the user operates the key / electronic dial 19 while visually confirming the selection items on the LCD 20 and selects any one of the display images, the CPU 17 generates a display image according to the user selection. The display image generation circuit 13 is controlled to perform the processing.

  In the case of switching control based on the resolution of the monitor 22, the CPU 17 acquires monitor performance information such as EDID that specifies the recommended resolution of the monitor 22 using bidirectional communication used in HDMI, DVI, DisplayPort, and the like. Then, the CPU 17 controls display image generation processing in the display image generation circuit 13 based on the monitor performance information. That is, when the CPU 17 determines that the monitor 22 supports high-definition display such as 4K based on the monitor performance information, the CPU 17 performs display image generation processing by the first display image generation circuit 131 described above. Make it. On the other hand, if it is determined from the monitor performance information that the monitor 22 can only support a low resolution, the reduced display image generation processing by the second display image generation circuit 132 is performed. In addition, EDID refers to Extended Display Identification Data. In addition, the CPU 17 can also control switching of these display images based on an input operation from an external controller or the like.

  Next, the flow of processing executed by the imaging apparatus 1 from the start of imaging until RAW image data is stored in the memory card 23 will be described with reference to the flowchart of FIG. In FIG. 8, first, as processing of step S <b> 101, the CPU 17 of the imaging apparatus 1 performs shooting start determination processing. For example, when an operation input signal corresponding to a user's shooting start operation is received from the Key / electronic dial 19, the CPU 17 transmits an imaging command to the imaging circuit 11. After step S <b> 101, the process in the imaging apparatus 1 transitions to the process in step S <b> 102 performed by the imaging circuit 11.

  The imaging circuit 11 that has received the imaging command from the CPU 17 causes the imaging sensor to perform imaging as processing in step S102. Then, the imaging circuit 11 performs AFE (Analog Front End) processing on the imaging signal obtained by imaging with the imaging sensor to generate RAW image data. This raw image data is sent to the correction processing circuit 12. After step S102, the process in the imaging apparatus 1 transitions to the process in step S103 by the correction processing circuit 12.

  The correction processing circuit 12 performs correction processing such as the defective pixel correction and the black level correction described above on the RAW image data generated by the imaging circuit 11 as the processing in step S103. After step S103, the process of the imaging apparatus 1 transitions to the process of step S104 by the CPU 17.

  The CPU 17 transmits a storage command to the correction processing circuit 12 as the process of step S104. The correction processing circuit 12 that has received this storage command stores the RAW image data after the above correction processing at the address of the memory 18 instructed by the CPU 17. After step S104, the CPU 17 advances the process to step S105.

  In step S <b> 105, the CPU 17 transmits a storage command to the memory card controller 16. The memory card controller 16 that has received the storage command reads the RAW image data stored at the address instructed by the CPU 17 from the memory 18. Then, the memory card controller 16 stores the RAW image data read from the memory 18 in the memory card 23.

  The imaging apparatus 1 can store the RAW image data of video composed of a plurality of continuous frames in the memory card 23 by sequentially repeating the processing from step S101 to step S105 for each frame.

  Next, a flow of processing for generating the above-described display image or reduced display image from the RAW image data in the imaging apparatus 1 will be described with reference to the flowchart of FIG. In the flowchart of FIG. 9, the CPU 17 first determines in step S201 whether to use a display image generation mode or a reduced display image generation mode as the display image generation mode. For example, when the user operates the key / electronic dial 19 to select any generation mode, the CPU 17 branches the process according to the generation mode selected by the user. When the display image generation mode is automatically selected according to the performance of the monitor 22, the CPU 17 determines whether to use the display image generation mode or the reduced display image generation mode based on the monitor performance information. Then, the process is branched according to the determination result.

  If it is determined in step S201 that the display image generation mode is to be used, the CPU 17 transmits a display image generation command to the first display image generation circuit 131. In this case, the process of the imaging apparatus 1 transitions from step S201 to the process of step S202 by the first display image generation circuit 131. On the other hand, if it is determined in step S201 that the reduced display image generation mode is to be used, the CPU 17 transmits a display image generation command to the second display image generation circuit 132. In this case, the process of the imaging apparatus 1 transitions from step S201 to the process of step S205 by the second display image generation circuit 132.

  In step S202, the first display image generation circuit 131 acquires the color data of the Gr channel and Gb channel of the RAW image data stored at the address of the memory 18 instructed by the CPU 17. After step S202, the processing of the imaging device 1 transitions to the processing of step S203 by the pixel interpolation processing circuit 131a of the first display image generation circuit 131.

  In step S203, the pixel interpolation processing circuit 131a performs the above-described pixel interpolation on each color plane of the Gr channel and the Gb channel. After step S202, the processing of the imaging device 1 transitions to the processing of step S204 by the averaging processing circuit 131b of the first display image generation circuit 131.

  In step S204, the averaging processing circuit 131b calculates the average value of each pixel as described above for the Gr and Gb color planes generated by the pixel interpolation processing circuit 131a, and sets the average value as the luminance Y. To do. Then, the averaging processing circuit 131b generates, as a display image, a grayscale image composed of only a luminance image in which the pixel values of the U and V color differences are all zero-padded. In step S <b> 204, the CPU 17 transmits a storage command to the first display image generation circuit 131. The first display image generation circuit 131 that has received the storage command stores the display image data at the address of the memory 18 instructed by the CPU 17. After step S204, the process of the imaging device 1 transitions to the process of step S208 by the CPU 17.

  In step S205, the second display image generation circuit 132 acquires all the color planes R, Gr, Gb, and B of the RAW image data stored at the address of the memory 18 instructed by the CPU 17. After step S205, the processing of the imaging device 1 transitions to the processing of step S206 by the RAW reduction processing circuit 132a of the second display image generation circuit 132.

  In step S206, the RAW reduction processing circuit 132a performs reduction processing such as pixel thinning on the R, G (Gr and Gb), and B color planes to reduce the image size. After step S206, the processing of the imaging device 1 transitions to the processing of step S207 by the development processing circuit 132b of the second display image generation circuit 132.

  In step S207, the development processing circuit 132b performs demosaic processing and debayer processing on the color plane generated by the RAW reduction processing circuit 132a to generate each image composed of R, G, and B. Further, the development processing circuit 132b generates display image data composed of Y, U, and V from the R, G, and B image data. In step S207, the CPU 17 transmits a storage command to the second display image generation circuit 132. The second display image generation circuit 132 that has received the storage command stores the reduced display image data at the address of the memory 18 instructed by the CPU 17. After step S207, the process of the imaging apparatus 1 transitions to the process of step S208 by the CPU 17.

  In step S <b> 208, the CPU 17 transmits a display command to the 3G-SDI controller 14. The 3G-SDI controller 14 that has received the display command outputs display image data stored in the address of the memory 18 instructed by the CPU 17 to the monitor 22 via the 3G-SDI terminal 15. As a result, a display image or a reduced display image is displayed on the monitor 22.

  As described above, according to the imaging apparatus 1 of the present embodiment, when the display image is generated from the RAW image by the first display image generation circuit 131, the resolution does not change before and after the generation process, and thus the RAW image A display image that does not impair the resolution of the image can be displayed. Further, the process of generating the display image from the RAW image can be realized without imposing a processing burden on the imaging apparatus 1. For this reason, according to the present embodiment, in the imaging apparatus 1 such as a digital video camera, a plurality of high-load processes such as recording of 4K RAW image data on a recording medium and generation of a moving image display image from the RAW image data. Can be performed in real time.

  In other words, the imaging apparatus 1 of the present embodiment is effective when, for example, the focus of a digital video camera and the details of an image are confirmed using a 4K monitor or the like at a shooting site. Moreover, according to this embodiment, since the processing load of the imaging device 1 can be reduced, it is possible to suppress, for example, a task start delay that is periodically performed and a bus bandwidth compression. Furthermore, in the present embodiment, the display image is generated from G (green) color data, and is thus effective for confirming the degree of missing green background, for example, in so-called chroma key photography.

  In the imaging apparatus 1 of the present embodiment, it is possible to switch between generation of a display image that is a high-resolution but grayscale image and generation of a reduced display image that can be displayed in color at a low resolution. It has been. Therefore, according to the present embodiment, when shooting is performed while checking a video with a monitor having the same number of pixels as a RAW image at a shooting site or the like, the processing speed is secured by using the display image. Checking with high-resolution images is possible. On the other hand, when shooting is performed while checking a video on a general monitor having a smaller number of pixels than that of a RAW image, the color can be checked while reducing the processing load by using the reduced display image. In addition, according to the present embodiment, the generation switching of the display image and the reduced display image is performed by both manual switching according to an instruction from the user and automatic switching according to the performance of the monitor to which the display image data is output. It corresponds to.

  Note that the above-described image processing for display image generation in the present embodiment can be applied to a captured image having values representing a plurality of color components that determine the color of each pixel. Therefore, the captured image data that is the target of display image generation in the present embodiment is not limited to the above-described RAW image data, JPEG image data after development processing, or the like. In addition, this embodiment can be applied not only to moving images but also to still images.

  The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

  DESCRIPTION OF SYMBOLS 1 Imaging device, 11 Imaging circuit, 12 Correction processing circuit, 13 Display image generation circuit, 131 1st display image generation circuit, 131a Pixel interpolation processing circuit, 131b Averaging processing circuit, 132 2nd display image generation circuit, 132a RAW reduction processing circuit, 132b development processing circuit, 14 3G-SDI controller, 15 3G-SDI terminal, 16 memory card controller, 17 CPU, 18 memory, 19 Key / electronic dial, 20 LCD, 21 bus, 22 monitor, 23 memory card

Claims (9)

Acquisition means for acquiring only one or more specific color component values less than the number of color component values for determining the color of the pixel among a plurality of color component values for determining the color of each pixel constituting the captured image When,
Generation means for setting the acquired specific color component value as a pixel value of brightness corresponding to each pixel constituting the captured image, and generating each pixel value of the display image. An image processing apparatus. The plurality of color component values are R, G, B color component values,
The acquisition means acquires only the G color component value among the R, G, B color component values as the specific color component value,
The generation unit sets the acquired G color component value as the luminance pixel value, sets a color difference pixel value as a predetermined value, and sets the luminance pixel value and the predetermined value as the predetermined value. The image processing apparatus according to claim 1, wherein the pixel value of the color difference obtained is used as a pixel value of the display image. The G color component value is composed of two color component values, Gr and Gb.
The acquisition means acquires only the two color component values Gr and Gb as the specific color component value,
The generation unit sets an average value of the two color component values of the acquired Gr and Gb as the pixel value of the luminance, and sets the predetermined value of the color difference to a zero value. Item 3. The image processing apparatus according to Item 2.   A reduced image obtained by reducing the captured image is generated, and all the color component values of a plurality of color component values for determining the color of each pixel constituting the reduced image are used to configure each reduced image. The image processing apparatus according to claim 1, further comprising reduced image generation means for generating each pixel value of a reduced display image corresponding to each pixel.   Acquisition of a specific color component value by the acquisition unit, generation of each pixel value of the display image by the generation unit, generation of a reduced image by the reduced image generation unit, and generation of each pixel value of the reduced display image The image processing apparatus according to claim 4, further comprising a control unit configured to perform any one of the above. A user input means for a user to select whether to generate the display image or the reduced display image;
In accordance with a selection from the user via the user input unit, the control unit acquires a specific color component value by the acquisition unit, generates each pixel value of the display image by the generation unit, and reduces the reduction The image processing apparatus according to claim 5, wherein the generation of a reduced image by the image generation unit and generation of each pixel value of the reduced display image are determined. Having a connection means to which the monitor device is connected;
The control means, according to the resolution of the monitor device connected via the connection means, acquisition of a specific color component value by the acquisition means and generation of each pixel value of the display image by the generation means, The image processing apparatus according to claim 5, wherein the generation of a reduced image by the reduced image generation unit and generation of each pixel value of the reduced display image are determined. Of the plurality of color component values for determining the color of each pixel that constitutes the captured image, the acquisition unit obtains only one or more specific color component values that are smaller than the number of color component values that determine the color of the pixel A step to obtain,
Generating means for setting the acquired specific color component value as a pixel value having a luminance corresponding to each pixel constituting the captured image, and generating each pixel value of the display image. An image processing method.   The program for functioning a computer as each means of the image processing apparatus of any one of Claims 1-7.

Images