JP7279365B2 - Display control device, display device, display control method and program - Google Patents

Description

The present application relates to a display control device, a display device, a display control method, and a program.

A technique is known that leaves only a specific color in an image and displays the other colors in monochrome (for example, see Patent Document 1). In the technique described in Japanese Patent Laid-Open No. 2002-200011, while the user is prompted to perform a selection operation, a color in the image is output in a non-monochromatic color, and after the user has completed the selection operation, a color other than the specified color in the image is output. Output in a single color.

JP 2013-228689 A

On the screen where the user selects the color to be left in partial color processing, if the area of the color to be left is small, or if multiple other colors are mixed in the vicinity of the color to be left, select the color to be left appropriately can be difficult to do. Thus, the partial color processing has room for improvement.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a display control device, a display device, a display control method, and a program capable of more appropriately performing partial color processing.

In order to solve the above-described problems and achieve the object, a display control device according to the present invention performs an operation of selecting a partial area of an image displayed on a display unit as an extraction area on an operation unit. an extraction area setting unit for setting a selected area in the image displayed on the display unit as an extraction area, and extracting a color from the extraction area set by the extraction area setting unit when this is detected. a color extracting unit; and when detecting that an operation for selecting a color range has been performed on the operating unit based on the extracted colors extracted by the color extracting unit, the selected color range is designated as a color. and a process of leaving the designated color set by the color setting unit and making the other colors of the designated color monochromatic for the image displayed on the display unit. and a display control unit that causes the display unit to display post-processing video data processed by the partial color processing unit.

A display device according to the present invention includes at least one of the display control device described above, a display section for displaying images, and a storage section for recording images.

In the display control method according to the present invention, when it is detected that an operation for selecting a part of an image displayed on a display unit as an extraction area has been performed, the image displayed on the display unit is selected. an extraction area setting step of setting the extracted area as an extraction area; a color extraction step of extracting a color from the extraction area set by the extraction area setting step; and based on the extraction color extracted by the color extraction step a color setting step of setting the selected color range as a designated color range when it is detected that an operation for selecting a color range has been performed; a partial color processing step of executing a process of leaving the designated color set by the color setting step and making the colors other than the designated color monochromatic; and displaying the processed video data processed by the partial color processing step. and a display control step for displaying on the unit.

The program according to the present invention, when detecting that an operation of selecting a part of an image displayed on a display unit as an extraction area has been performed, selects an image displayed on the display unit. an extraction region setting step of setting a region as an extraction region; a color extraction step of extracting a color from the extraction region set by the extraction region setting step; a color setting step of setting the selected color range as a specified color range when it is detected that an operation for selecting a range of is performed; a partial color processing step of executing a process of leaving the designated color set by the step and making the other colors of the designated colors monochromatic; and a display control step for causing a display to be executed by a computer operating as a display control device.

ADVANTAGE OF THE INVENTION According to this invention, it is effective in the ability to provide the display control apparatus, display apparatus, display control method, and program which can perform part color processing more appropriately.

FIG. 1 is a block diagram showing a configuration example of a display device according to an embodiment. FIG. 2 is a diagram for explaining an example of extraction area setting processing in a video processing unit according to the embodiment; FIG. 3 is a diagram illustrating an example of color setting processing in a video processing unit according to the embodiment; FIG. 4 is a diagram illustrating an example of processing area setting processing in the video processing unit according to the embodiment; FIG. 5 is a diagram illustrating another example of processing area setting processing in the video processing unit according to the embodiment. FIG. 6 is a diagram illustrating an example of correction processing in the video processing unit according to the embodiment; 7 is a flowchart illustrating an example of processing executed by a video processing unit according to the embodiment; FIG.

Exemplary embodiments of a video processing unit (display control device), a display device, a display control method, and a program according to the present invention will be described below in detail with reference to the accompanying drawings. In addition, the present invention is not limited by the following embodiments.

FIG. 1 is a block diagram showing a configuration example of a display device according to an embodiment. The display device 10 is, for example, an imaging device such as a camera or a video camera. In this embodiment, a video camera will be described as an example of the display device 10 . The display device 10 has a function of executing partial color processing. The display device 10 includes an imaging section 20 , a storage section 30 , a card I/F 40 , an input/output I/F 50 , a monitor 60 , a touch panel (operation section) 70 and an image processing section 80 .

The image capturing unit 20 captures an image. The imaging unit 20 is a camera with an optical axis LA. The imaging unit 20 has, for example, a zoom lens 21, a focus lens 22, an aperture 23, and an imaging element 24. The zoom lens 21 is driven by a zoom actuator (not shown) to move along the optical axis LA. The focus lens 22 is driven by a focus actuator (not shown) to move along the optical axis LA. The aperture 23 is driven by an aperture actuator (not shown) to operate. The imaging element 24 is, for example, a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The imaging device 24 converts the light that has passed through the zoom lens 21, the focus lens 22, and the diaphragm 23 into electrical signals to generate analog video signals. The imaging unit 20 sends the generated analog video signal to the bus 100 via the analog signal processing unit 25, the analog/digital conversion unit (hereinafter referred to as “A/D conversion unit”) 26, and the video input controller 27. Output.

The analog signal processing section 25 amplifies the analog video signal output from the imaging section 20 and outputs the amplified signal to the A/D conversion section 26 .

The A/D converter 26 converts the amplified analog video signal into digital video data. The A/D converter 26 outputs the converted digital video data to the video input controller 27 as a video signal.

The video input controller 27 acquires the digital video data output from the A/D converter 26 as captured video data. The video input controller 27 records the acquired captured video data in the storage unit 30 via the bus 100 .

The storage unit 30 is used for temporary storage of data in the display device 10 . The storage unit 30 is, for example, a semiconductor memory device such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, or a storage device such as a hard disk or an optical disk.

A card-type recording medium (not shown) can be attached to and detached from the card I/F 40 . Here, the card-type recording medium is, for example, a card-type external memory such as an SD card or compact flash (registered trademark). In the card-type recording medium, for example, video data including captured video data of captured video captured by the imaging unit 20 is compressed and recorded. The card-type recording medium functions as an external storage unit. The card I/F 40 writes data to the card-type recording medium and reads recorded data according to instructions from the video processing unit 80 via the media control unit 41 .

The input/output I/F 50 connects the display device 10 and the input/output unit. A monitor 60 and a touch panel 70 are connected to the input/output I/F 50 .

The monitor 60 displays, for example, captured images, various images including recorded images read from the external memory attached to the card I/F 40, and various information on the display surface 60a. The monitor 60 is a touch panel type display, and can input various operations. The monitor 60 includes, for example, a liquid crystal display (LCD) or an organic EL (Organic Electro-Luminescence) display. The monitor 60 displays various images and various information on the display surface 60 a based on the control signal from the image processing section 80 . Among the images displayed on the display surface 60a, a captured image or a recorded image is referred to as a display image.

Touch panel 70 is capable of accepting operations on display device 10 . The touch panel 70 is a touch-type input device arranged to face the display surface 60 a of the monitor 60 . The touch panel 70 can accept an operation on the video or image displayed on the display surface 60a. The touch panel 70 has a detection area for detecting a touch operation corresponding to the display surface 60a. Upon receiving a touch operation, touch panel 70 outputs operation information to bus 100 via input/output I/F 50 .

The video processing unit 80 performs partial color processing on captured video data of a captured video or recorded video data of a recorded video to generate processed video data. The video processing unit 80 is, for example, an arithmetic processing device (control unit) including a CPU (Central Processing Unit), a video processing processor, and the like. The video processing unit 80 loads a program stored in the storage unit 30 into memory and executes instructions included in the program. The video processing unit 80 may be configured with one or more devices. The video processing unit 80 has a display control unit 81 , an extraction area setting unit 82 , a color extraction unit 83 , a color setting unit 84 , a processing area setting unit 85 , a partial color processing unit 86 and a correction processing unit 87 .

The display control unit 81 generates and outputs a video signal for displaying an image or various information on the display surface 60 a of the monitor 60 . The display control unit 81 generates and outputs a video signal to be displayed on the display surface 60a based on the captured video data when capturing the video. The display control unit 81 generates and outputs a video signal to be displayed on the display surface 60a based on the recorded video data when reproducing the recorded video. The display control unit 81 generates and outputs a video signal to be displayed on the display surface 60a based on the post-processing video data when executing the partial color processing. The display control unit 81 generates and outputs a video signal for displaying various setting screens on the display surface 60a.

The extraction area setting unit 82 sets an area including the color (specified color) left in the partial color processing as an extraction area. When the extraction area setting unit 82 detects that an operation to select a partial area of the display image displayed on the display surface 60a of the monitor 60 as an extraction area has been performed on the touch panel 70, A selected area of the displayed image is set as an extraction area. More specifically, the user touches an area of the display image displayed on the display surface 60a that includes the color left by the partial color processing. When detecting that the user has touched the touch panel 70 to set an extraction area in the displayed image, the extraction area setting unit 82 sets the selected area as an extraction area. The extraction area setting unit 82 acquires extraction area information indicating the set extraction area.

The extraction region setting unit 82 will be described in detail with reference to FIG. FIG. 2 is a diagram for explaining an example of extraction area setting processing in a video processing unit according to the embodiment; For example, first, when the user selects an item image for partial color processing from the menu screen, the extraction area setting operation shown in FIG. 2 becomes possible. As shown in FIG. 2( a ), the user touches an area including a color to be left in the partial color processing on the display image displayed on the display surface 60 a of the monitor 60 . In FIG. 2A, the user touches a red apple shown in the displayed image.

As shown in FIG. 2B, when detecting that the user has performed a touch operation on the touch panel 70, the extraction area setting unit 82 displays a frame icon 200 centered on the position of the touch operation on the display surface 60a. . The frame icon 200 has, for example, a rectangular shape, a circular shape, an elliptical shape, or a shape that matches the shape of the photographed object at the touch-operated position. In this embodiment, the frame icon 200 has a square shape with a side of about several tens of pixels. In FIG. 2B, part of the red apple is located inside the frame icon 200. In FIG.

As shown in FIG. 2C, the user changes the size of the frame icon 200 displayed on the display surface 60a to change the size of the extraction area indicated by the frame icon 200. FIG. In FIG. 2( c ), the user enlarges the frame icon 200 so that the whole red apple is positioned inside the frame icon 200 .

As shown in FIG. 2D, the user changes the position of the extraction area indicated by the frame icon 200 by changing the position of the frame icon 200 displayed on the display surface 60a. In FIG. 2D , the user moves the frame icon 200 so that the red apple is positioned in the center of the frame icon 200 .

By the procedure shown in FIGS. 2(c) and 2(d), the user aligns the frame icon 200 with the portion of the color left in the partial color processing.

FIG. 2(e) shows the frame icon 200 for which the setting has been completed. In FIG. 2( e ), the entire red apple is positioned inside the frame icon 200 , and the red apple is positioned in the center of the frame icon 200 . After completing the setting of the frame icon 200, the user presses, for example, a setting completion button to execute the completion operation. When the user's completion action is detected, the extraction area setting unit 82 sets an area defined by the position and size of the frame icon 200 shown in FIG. 2(e) as an extraction area. The extraction area setting unit 82 acquires extraction area information of the set extraction area.

The color extraction section 83 extracts colors from the extraction area set by the extraction area setting section 82 . The color extraction unit 83 extracts the color of the object included in the extraction area set by the extraction area setting unit 82, in other words, the RBG (Red Green Blue) value of the color left in the partial color processing. For example, the color extraction unit 83 may extract the average value of the RGB values of all pixels included in the extraction region as the RBG value of the color left in the partial color processing. For example, the color extraction unit 83 may extract the RGB values of the pixel positioned at the center of the extraction region as the RBG values of the color left in the partial color processing. A color extracted by the color extractor 83 is called an extracted color. The color extraction unit 83 acquires information on the extracted extraction color.

A color setting unit 84 sets a range of colors to be left in the partial color processing. The method of setting colors in the color setting section 84 is not limited. For example, the color setting unit 84 may set the color range based on the six colors of red, green, blue, cyan, magenta, and yellow in the RGB color space. In this embodiment, the color setting unit 84 sets the range of colors to be left in the partial color processing as a range of colors in HSV (Hue Saturation Value-Brightness) color space.

The HSV color space defines color in terms of hue, saturation, and lightness. The hue angle can take values from 0° to 360°. Each color can be represented by a hue angle, for example green is represented by a hue angle of 120°. Saturation defines the vividness and depth of color defined by hue. Saturation can take values between 0% and 100%. Lightness defines the lightness/darkness of a color defined by hue. Brightness can take a value of 0% or more and 100% or less.

When the color setting unit 84 detects that an operation for selecting a saturation range and a hue range has been performed on the touch panel 70 based on the extracted colors extracted by the color extraction unit 83, the selection The color range defined by the specified saturation range and hue range is set as the specified color range. More specifically, the user selects a color range by setting a saturation range and a hue range by a touch operation while referring to the color selection image 210 indicating extracted colors displayed on the display surface 60a. When detecting that the user has touched the touch panel 70 to set the saturation range and the hue range, the color setting unit 84 sets the selected color range as the designated color range. do. The color setting unit 84 acquires information on the selected designated color range.

The color setting unit 84 will be described in detail with reference to FIG. FIG. 3 is a diagram illustrating an example of color setting processing in a video processing unit according to the embodiment; When the extraction area setting process ends, the color setting operation shown in FIG. 3 becomes possible. As shown in FIG. 3A, the color setting unit 84 converts the RGB values of the extracted colors extracted by the color extraction unit 83 into HSV values, and converts the HSV values into the color selection image 210 on the display surface 60a of the monitor 60. to display. Color selection image 210 includes hue circle image 211 , frame icon 212 , saturation image 213 , saturation icon 214 , hue image 215 , and hue icon 216 . The hue circle image 211 is an image showing the hue circle of the HSV color space. A frame icon 212 is superimposed on the color wheel image 211 and indicates a range of colors. The saturation image 213 is an image showing the saturation of colors in the HSV color space. A saturation icon 214 is displayed superimposed on the saturation image 213 to indicate the saturation of the color. Hue image 215 shows the hue range of colors in the HSV color space. A hue icon 216 is displayed overlaid on the hue image 215 to indicate the hue range of colors. In FIG. 3A, the frame icon 212 indicates a color range defined by a predetermined saturation range and a predetermined hue range based on the HSV value of the extracted color. Saturation icon 214 indicates the saturation based on the HSV value of the extracted color. Hue icon 216 indicates the hue range based on the HSV values of the extracted colors. FIG. 3A shows the range of "red", which is the extracted color.

As shown in FIG. 3B, the user changes the horizontal width of the frame icon 212 to select the range of saturation of colors to be left in the partial color processing. In FIG. 3B, the width of the frame icon 212 is widened to widen the range of saturation.

As shown in FIG. 3C, the user changes the vertical width of the frame icon 212 to select the range of hue angles to be left in the partial color processing. In FIG. 3C, the vertical width of the frame icon 212 is increased to widen the hue angle range.

By the procedure shown in FIGS. 3B and 3C, the user aligns the frame icon 212 with the range of colors left in the partial color processing. After completing the setting of the frame icon 212, the user presses, for example, a setting completion button to execute the completion operation. When the user's completion action is detected, the color setting unit 84 sets an area defined by the position and size of the frame icon 212 as the designated color range. The color setting unit 84 acquires information on the specified color range that has been set.

The processing area setting unit 85 sets a processing area for executing partial color processing. When the processing area setting unit 85 detects that an operation for selecting an area for performing partial color processing in the image displayed on the display surface 60a has been performed on the touch panel 70, the processing area setting unit 85 selects the selected area. Set as processing area. More specifically, the user selects a processing area on which partial color processing is to be performed in the display image displayed on the display surface 60a by a touch operation. The processing area can be set to the whole or part of the display image displayed on the display surface 60a. When detecting that the user has performed a touch operation on the touch panel 70 to set a processing area in the displayed image, the processing area setting section 85 sets the selected area as the processing area. The processing area setting unit 85 acquires information on the selected processing area.

With reference to FIG. 4, a case will be described in which the processing area setting unit 85 sets a part of the display image as the processing area and performs partial color processing on the processing area. FIG. 4 is a diagram illustrating an example of processing area setting processing in the video processing unit according to the embodiment; When the color setting process is finished, the setting operation of the processing area shown in FIG. 4 can be continued. As shown in FIG. 4( a ), the user touches a processing area for performing partial color processing on a display image displayed on the display surface 60 a of the monitor 60 . In FIG. 4A, the user touches the red apple on the right side of the displayed image.

As shown in FIG. 4B, when the processing area setting unit 85 detects that the user has touched the touch panel 70, the frame icon 220 centered on the touched position is displayed on the display surface 60a. The frame icon 220 has, for example, a rectangular shape, a circular shape, an elliptical shape, or a shape that matches the shape of the photographed object at the touch-operated position. In this embodiment, the frame icon 220 has a circular shape with a radius of about several tens of pixels. In FIG. 4B , part of the red apple on the right side is located inside the frame icon 220 .

As shown in FIG. 4C, the user changes the size of the displayed frame icon 220 so that the processing area indicated by the frame icon 220 includes the red apple on the right. In FIG. 4C , the user enlarges the frame icon 220 so that the entire red apple on the right side is positioned inside the frame icon 220 . Other apples are positioned outside the frame icon 220 .

After completing the setting of the frame icon 220, the user presses, for example, a setting completion button to execute the completion operation. When the user's completion action is detected, the processing area setting unit 85 sets an area defined by the position and size of the frame icon 220 as a processing area. The processing area setting unit 85 acquires processing area information of the set processing area. When the processing in the processing area setting section 85 is completed, the partial color processing is performed by the partial color processing section 86 .

FIG. 4(d) shows a processed image in which partial color processing has been performed on the selected processing area. In FIG. 4(d), only the red apple on the right side is displayed in red, and the other apples are displayed in a single color. For example, a single color is assumed to be monochrome.

With reference to FIG. 5, a case will be described in which part of the display image is set as the processing area by the processing area setting unit 85, and partial color processing is performed by adding gradation processing to the processing area. FIG. 5 is a diagram illustrating another example of processing area setting processing in the video processing unit according to the embodiment. As shown in FIG. 5( a ), the user touches the processing area on the display image displayed on the display surface 60 a of the monitor 60 . In FIG. 5A, the user touches the red apple on the right side of the displayed image.

As shown in FIG. 5B, when the processing area setting unit 85 detects that the user has performed a touch operation on the touch panel 70, the circular frame icon 220 centered on the touch operation position is displayed on the display surface 60a. do. In FIG. 5B, part of the red apple on the right side is located inside the frame icon 220. In FIG.

As shown in FIG. 5(c), the user changes the size of the displayed frame icon 220 so that the processing area indicated by the frame icon 220 includes the red apple on the right. In FIG. 5C , the user enlarges frame icon 220 so that the entire red apple on the right side is positioned inside frame icon 220 . The apple and banana on the left are positioned outside the frame icon 220 .

After completing the setting of the frame icon 220, the user presses, for example, a setting completion button to execute the completion operation. When the user's completion action is detected, the processing area setting unit 85 sets an area defined by the position and size of the frame icon 220 as a processing area. The processing area setting unit 85 acquires processing area information of the set processing area. When the processing in the processing area setting section 85 is completed, the partial color processing including gradation processing is executed by the partial color processing section 86 .

FIG. 5(d) shows a processed image that has been subjected to partial color processing in which a gradation process that makes the color lighter toward the outside from the center of the processing region is applied to the selected processing region. In FIG. 5(d), only the red apple on the right side is displayed in red gradation, and the apple and banana on the left side are displayed in a single color.

The partial color processing unit 86 performs a process of leaving the designated color that has been set in the captured image data or the recorded image data and making the colors other than the designated color monochromatic. When the correction processing unit 87 executes the correction processing of the video signal, the partial color processing unit 86 executes the partial color processing on the post-correction video data. The partial color processing unit 86 leaves the specified color range, and makes colors that are not included in the specified color range monochromatic. The processing method for partial color processing may be any known method, and is not limited. The partial color processing section 86 may perform partial color processing including gradation processing. The partial color processing unit 86 generates post-processing video data that has undergone partial color processing.

The correction processing unit 87 performs processing for adjusting the so-called white balance when executing the partial color processing. More specifically, the correction processing unit 87 stores the reference RGB value ratio for each pixel for all pixels included in the specified color range in the display image when the color setting unit 84 sets the specified color. The correction processing unit 87 determines whether or not the ratio of the RGB values of the pixels included in the specified color range in the captured image data or the recorded image data has changed from the reference ratio of the RGB values of the pixels. When determining that there has been a change, the correction processing unit 87 determines that the white balance needs to be adjusted, and sets the R gain for correcting the R value and the B value based on the G value among the RGB values of the pixel. and the B gain value. The correction processing unit 87 performs signal processing for correcting the image signal of the imaged image data or the recorded image data by adding the R gain value and the B gain value to the R value and the B value of the RGB values. When determining that there is no change, the correction processing unit 87 determines that white balance adjustment is not necessary, and does not perform correction processing of the video signal. In this manner, when the correction processing unit 87 determines that the white balance needs to be adjusted, the correction processing unit 87 corrects the ratio of RGB values to generate post-correction image data in which the ratio of RGB values is approximated to the reference ratio.

Processing of the correction processing unit 87 will be described in detail with reference to FIG. FIG. 6 is a diagram illustrating an example of correction processing in the video processing unit according to the embodiment; FIG. 6(a) shows an image of an apple captured under sunlight and the ratio of the reference RGB values of the red color of the apple. Here, it is assumed that the red color of an apple has the same RGB value for all pixels.

FIG. 6(b) shows an image of an apple photographed under illumination light with the light source changed from the state shown in FIG. 6(a), and the ratio of the RGB values of the apple. The apple appears brown due to the lighting effect. The RGB values of the apple have a decreasing R value, an increasing G value, and a decreasing B value. The ratio of RGB values is changed with respect to the ratio of RGB values of the reference. Therefore, correction is performed to control the R value and the B value using the G value as a reference so that the ratio of the RGB values approaches the reference ratio of the RGB values. The R gain value is added to the video signal to increase the R value, and the B gain value is added to increase the B value.

FIG. 6C shows an image of an apple after correcting the ratio of RGB values and the ratio of RGB values of the apple. The ratio of RGB values is corrected to bring it closer to the reference ratio of RGB values. The apple has been corrected to red.

Next, with reference to FIG. 7, the method and action of processing executed by the video processing unit 80 will be described. 7 is a flowchart illustrating an example of processing executed by a video processing unit according to the embodiment; FIG.

When the user selects an item image for partial color processing from the menu screen displayed on the display surface 60a of the monitor 60, the processing shown in FIG. 7 is executed. When the partial color processing is performed while the captured image is being displayed on the display surface 60a, the partial color processing is performed while the captured image is being captured, and the processed image is displayed on the display surface 60a. When the partial color processing is performed while the recorded image is being displayed on the display surface 60a, the partial color processing is performed while the recorded image is being reproduced, and the processed image is displayed on the display surface 60a.

The video processing unit 80 executes a process of setting the extraction region of the display video displayed on the display surface 60a by the extraction region setting unit 82 (step S101). More specifically, when detecting that the user has performed a touch operation on the touch panel 70, the extraction area setting unit 82 displays a rectangular frame icon 200 centered on the position of the touch operation on the display surface 60a. After completing the setting of the frame icon 200, the user presses, for example, a setting completion button to execute the completion operation. When the user's completion action is detected, the extraction area setting unit 82 sets an area defined by the position and size of the frame icon 200 displayed on the display surface 60a as an extraction area. The extraction area setting unit 82 acquires extraction area information of the set extraction area. The video processing unit 80 proceeds to step S102.

The video processing unit 80 uses the color extraction unit 83 to extract the RGB values of the colors left in the partial color processing from the extraction region (step S102). For example, the color extraction unit 83 extracts the average value of the RGB values of all pixels included in the extraction region as the RBG value of the color left in the partial color processing. The color extraction unit 83 acquires information on the extracted extraction color. The video processing unit 80 proceeds to step S103.

The image processing unit 80 uses the color setting unit 84 to set the range of colors to be left in the partial color processing (step S103). The color setting section 84 displays a color selection image 210 indicating an extracted color on the display surface 60a. When the color setting unit 84 detects that an operation for selecting a saturation range and a hue range has been performed on the touch panel 70, the color setting unit 84 defines the selected saturation range and hue range. set the specified color range as the specified color range. The color setting unit 84 acquires information on the selected designated color range. The video processing unit 80 proceeds to step S104.

The image processing unit 80 uses the processing area setting unit 85 to set a processing area for executing partial color processing in the display image displayed on the display surface 60a (step S104). When the processing area setting unit 85 detects that an operation for selecting an area for performing partial color processing in the image displayed on the display surface 60a has been performed on the touch panel 70, the processing area setting unit 85 selects the selected area. Set as processing area. The video processing unit 80 proceeds to step S105.
.

The video processing unit 80 determines whether white balance adjustment is necessary (step S105). The image processing unit 80 determines whether or not the ratio of the RGB values of the designated color included in the captured image data or the recorded image data has changed from the reference ratio of the RGB values. If the image processing unit 80 determines that the ratio of the standard RGB values has changed, it determines that the white balance needs to be adjusted (Yes in step S105). The video processing unit 80 proceeds to step S106. If the video processing unit 80 determines that there is no change with respect to the reference RGB value ratio, it determines that white balance adjustment is not necessary (No in step S105). The video processing unit 80 proceeds to step S107.

If the white balance needs to be adjusted (Yes in step S105), the video processing unit 80 causes the correction processing unit 87 to perform correction processing (step S106). More specifically, when the ratio of the RGB values of the designated color included in the captured image data or the recorded image data changes from the reference ratio of the RGB values (Yes in step S105), the correction processing unit 87 corrects the displayed image. by correcting the ratio of the RGB values of the designated color included in the , and generating post-correction image data that is closer to the ratio of the reference RGB values. The video processing unit 80 proceeds to step S107.

The video processing unit 80 executes the partial color processing in which the set designated color is left by the partial color processing unit 86 and the colors other than the designated color are made monochromatic (step S107). When the correction processing is performed in step S106, the partial color processing unit 86 generates the post-processing video by performing the partial color processing on the post-correction video. If the correction process is not performed in step S106, the display control unit 81 generates a processed image by performing partial color processing on the display image. The video processing unit 80 proceeds to step S108.

The image processing unit 80 causes the display control unit 81 to display the image after the partial color processing on the display surface 60a of the monitor 60 (step S108). When the correction processing is performed in step S106, the display control unit 81 performs the correction processing and further performs the partial color processing, and displays the post-processing image. When the correction process is not performed in step S106, the display control unit 81 displays the image after the partial color process on the display surface 60a.

The image processing unit 80 ends the process when the user performs an operation to end the partial color processing, when the image capturing process is finished, or when the video reproduction process is finished.

If there are a plurality of colors to be left in the partial color processing, the processing of steps S101 to S104 is repeated to perform setting processing for a plurality of colors.

In this way, when the extraction area setting unit 82 detects that an operation of selecting a partial area of the display image displayed on the display surface 60a is performed on the touch panel 70, the extraction area setting unit 82 displays an image on the display surface 60a. A region selected from the displayed image is set as an extraction region. When the color setting unit 84 detects that an operation for selecting a saturation range and a hue range has been performed on the touch panel 70 based on the extracted colors extracted by the color extraction unit 83, the selection The color range defined by the specified saturation range and hue range is set as the specified color range. When the processing area setting unit 85 detects that an operation for selecting an area for performing partial color processing in the image displayed on the display surface 60a has been performed on the touch panel 70, the processing area setting unit 85 selects the selected area. Set as processing area. Based on the information set by these processes, the part color processing unit 86 performs processing in which the set specified color is left in the imaged video data or the recorded video data, and the colors other than the specified color are made monochromatic. do. Furthermore, when the ratio of the RGB values of the specified color included in the captured video data or recorded video data changes from the reference RGB value ratio, the correction processing unit 87 adjusts the ratio of the RGB values included in the captured video data or recorded video data. Correct the RGB value ratio of the designated color to bring it closer to the standard RGB value ratio.

As described above, in the present embodiment, when the extraction region setting unit 82 detects that an operation for selecting a partial region of the display image displayed on the display surface 60a is performed on the touch panel 70, , a region selected from the display image displayed on the display surface 60a can be set as an extraction region. According to this embodiment, even if the area of the portion of the color to be left in the displayed image is small, or even if a plurality of other colors are mixed in the vicinity of the color to be left, the area including the color to be left can be set. can appropriately set the extraction area.

In the present embodiment, it is determined that an operation for selecting a saturation range and a hue range has been performed on the touch panel 70 by the color setting unit 84 based on the extracted colors extracted by the color extraction unit 83. If detected, the color range defined by the selected saturation range and hue range can be set as the specified color range. According to the present embodiment, even when the area of the portion of the color to be left in the displayed image is small, or when a plurality of other colors are mixed in the vicinity of the color to be left, the color to be left can be appropriately set. can be done. According to this embodiment, even if the extraction area set by the extraction area setting unit 82 is shifted from the desired position, the color to be left can be appropriately set by the color setting processing by the color setting unit 84 .

In the present embodiment, when the processing area setting unit 85 detects that an operation for selecting an area for performing partial color processing in the image displayed on the display surface 60a has been performed on the touch panel 70, A selected area can be set as a processing area. According to this embodiment, the user can appropriately set the processing area for executing the partial color processing.

In this embodiment, based on the information set by the above processing, the part color processing unit 86 leaves the set specified color in the captured video data or recorded video data, and the other specified color is a single color. can be executed. According to this embodiment, partial color processing can be performed more appropriately.

Furthermore, in this embodiment, if the ratio of the RGB values of the designated color included in the captured video data or recorded video data changes from the ratio of the reference RGB values, the correction processing unit 87 corrects the captured video data or the recorded video data. By correcting the ratio of the RGB values of the designated color included in the video data, the ratio of the RGB values can be brought closer to the reference ratio of the RGB values. According to this embodiment, even if the light source changes and the color changes after setting the specified color, the specified color included in the processing area can be displayed in a color close to the reference color. This embodiment can perform partial color processing more appropriately and enhance the rendering effect even when the light source changes.

On the other hand, when the correction processing by the correction processing unit 87 is not executed, there is a possibility that the color left in the partial color processing cannot appropriately follow the change of the light source. In this way, the partial color processing cannot be performed properly, and there is a risk of impairing the rendering effect.

Although the display device 10 according to the present invention has been described so far, it may be embodied in various different forms other than the embodiments described above.

Each component of the illustrated display device 10 is functionally conceptual, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to the illustrated one, and all or part of it may be functionally or physically distributed or integrated in arbitrary units according to the processing load and usage conditions of each device. may

The configuration of the display device 10 is realized by, for example, a program loaded in the memory as software. In the above embodiments, functional blocks realized by cooperation of these hardware or software have been described. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

The components described above include those that can be easily assumed by those skilled in the art and those that are substantially the same. Furthermore, the configurations described above can be combined as appropriate. Also, various omissions, substitutions, or modifications of the configuration are possible without departing from the gist of the present invention.

10 display device 20 imaging unit 60 monitor (display unit)
70 touch panel (operation unit)
80 Video processing unit (display control device)
81 display control unit 82 extraction area setting unit 83 color extraction unit 84 color setting unit 85 processing area setting unit 86 partial color processing unit 87 correction processing unit

Claims (6)

When it is detected that an operation to select a partial area of an image displayed on the display unit as an extraction area has been performed on the operation unit, the selected area of the image displayed on the display unit is extracted. an extraction area setting unit for setting an extraction area;
a color extraction unit that extracts a color from the extraction area set by the extraction area setting unit;
Based on the extracted colors extracted by the color extraction unit, when it is detected that an operation for selecting a color range has been performed on the operation unit, the selected color range is set as the specified color range. a color setting unit;
a partial color processing unit for executing a process of leaving the designated color set by the color setting unit and making the colors other than the designated color monochromatic for the image displayed on the display unit;
a display control unit that causes the display unit to display post-processing video data processed by the partial color processing unit;
For all pixels included in the range of the specified color, the ratio of the RGB values of each pixel when the color setting unit sets the specified color is stored as a reference ratio. a correction processing unit that brings the ratio of RGB values closer to the reference ratio when the ratio changes from the reference ratio;
A display control device comprising: The specified color range is defined by a saturation range and a hue range,
The display control device according to claim 1. A process of setting the selected area as a processing area when it is detected that an operation for selecting a processing area for performing partial color processing has been performed on the operation unit in the image displayed on the display unit. area setting unit,
The display control device according to claim 1 or 2, comprising: A display device comprising the display control device according to any one of claims 1 to 3,
A display device further comprising at least one of a display unit for displaying images and a storage unit for recording images. When it is detected that an operation of selecting a part of the image displayed on the display unit as an extraction area has been performed, the selected area of the image displayed on the display unit is set as the extraction area. an extraction region setting step;
a color extraction step of extracting a color from the extraction region set by the extraction region setting step;
a color setting step of setting the selected color range as a specified color range when it is detected that an operation of selecting a color range has been performed based on the extracted colors extracted by the color extraction step;
a partial color processing step of performing a process of leaving the designated color set by the color setting step and making the other colors of the designated color monochromatic for the image displayed on the display unit;
a display control step for displaying the processed image data processed by the partial color processing step on the display unit;
For all pixels included in the range of the specified color, the ratio of the RGB values of each pixel when the color setting unit sets the specified color is stored as a reference ratio. a correction processing step of bringing the ratio of RGB values closer to the reference ratio when the reference ratio is changed;
A display control method comprising: When it is detected that an operation of selecting a part of the image displayed on the display unit as an extraction area has been performed, the selected area of the image displayed on the display unit is set as the extraction area. an extraction region setting step;
a color extraction step of extracting a color from the extraction region set by the extraction region setting step;
a color setting step of setting the selected color range as a specified color range when it is detected that an operation of selecting a color range has been performed based on the extracted colors extracted by the color extraction step;
a partial color processing step of performing a process of leaving the designated color set by the color setting step and making the other colors of the designated color monochromatic for the image displayed on the display unit;
a display control step for displaying the processed image data processed by the partial color processing step on the display unit;
For all pixels included in the range of the specified color, the ratio of the RGB values of each pixel when the color setting unit sets the specified color is stored as a reference ratio. a correction processing step of bringing the ratio of RGB values closer to the reference ratio when the reference ratio is changed;
A program for causing a computer operating as a display control device to execute.

Images