US8199372B2 - White balance processing apparatus and processing method thereof - Google Patents

White balance processing apparatus and processing method thereof Download PDF

Info

Publication number
US8199372B2
US8199372B2 US12/406,514 US40651409A US8199372B2 US 8199372 B2 US8199372 B2 US 8199372B2 US 40651409 A US40651409 A US 40651409A US 8199372 B2 US8199372 B2 US 8199372B2
Authority
US
United States
Prior art keywords
white balance
image
histogram
processing
taken
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/406,514
Other versions
US20090180002A1 (en
Inventor
Hisashi Suekane
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
Original Assignee
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2002205013A external-priority patent/JP2004048523A/en
Priority claimed from JP2002334852A external-priority patent/JP4090851B2/en
Application filed by Olympus Corp filed Critical Olympus Corp
Priority to US12/406,514 priority Critical patent/US8199372B2/en
Assigned to OLYMPUS OPTICAL CO., LTD. reassignment OLYMPUS OPTICAL CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SUEKANE, HISASHI
Assigned to OLYMPUS CORPORATION reassignment OLYMPUS CORPORATION CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: OLYMPUS OPTICAL CO., LTD.
Publication of US20090180002A1 publication Critical patent/US20090180002A1/en
Application granted granted Critical
Publication of US8199372B2 publication Critical patent/US8199372B2/en
Assigned to OLYMPUS CORPORATION reassignment OLYMPUS CORPORATION CHANGE OF ADDRESS Assignors: OLYMPUS CORPORATION
Adjusted expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • H04N1/6027Correction or control of colour gradation or colour contrast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • H04N1/6011Colour correction or control with simulation on a subsidiary picture reproducer

Definitions

  • the present invention relates to white balance processing apparatus and processing method thereof in which pickup images can be readily processed at white balance values of desired color tone, and also relates to a program for executing such processing method and to digital cameras using such white balance processing apparatus.
  • white balance adjustment is indispensable in recording taken images.
  • the techniques for such white balance adjustment include an automatic white balance, preset white balance, one-touch white balance, manual white balance, etc.
  • APB automatic white balance
  • a fetched pickup image is analyzed at the inside of the imaging apparatus to compute an optimal white balance value, and white balance processing is effected on the taken image by using the computed white balance value. Since, however, the white balance adjustment is an adjustment of color condition and involves highly subjective elements, a white balance adjustment based on a theoretically correct white balance value obtained by the automatic white balance technique is not necessarily preferred.
  • the white balance processing is effected by a white balance value which is designated by the photographer from those white balance values previously stored to the imaging apparatus before its shipping from factory, i.e., white balance values corresponding for example to the light sources of fluorescent lamp, incandescent lamp, outdoors, etc.
  • one-touch white balance adjustment there is a technique referred to as one-touch white balance adjustment.
  • a preliminary image of a white object is taken before the main image taking under the image taking condition to previously set a white balance value, and white balance processing is effected on the pickup image by such set white balance value.
  • Japanese patent application laid-open No. 2000-299814 discloses a technique in which the setting of white balance is selected from an automatic setting and a customized setting of the user.
  • Japanese patent application laid-open Hei-10-304386 discloses for example a technique in which an automatic white balance (AWB) function is also locked concurrently with AF and AE functions by the half-pressed manipulation (1st manipulation) of the release switch in taking an image.
  • AVB automatic white balance
  • Japanese patent application laid-open Hei-11-355784 discloses a digital camera capable of selecting from an automatic white balance adjustment mode and a manual white balance adjustment mode in which the photographer can manually make an adjustment based on a color temperature information.
  • Japanese patent application laid-open No. 2002-185972 discloses a digital camera in which an achromatic color region is distinguishably displayed on image displayed on an image displaying LCD monitor of digital camera so that a suitable white balance can be set while checking such displayed image.
  • a white balance processing apparatus including: white balance processing means for effecting white balance processing on a taken image based on a set white balance value; storage means for storing white balance values employed in the white balance processing of past taken images; and employed value setting means for setting a white balance value employed in the past, stored in the storage means as the white balance value for the taken image.
  • the white balance processing apparatus further includes detected value setting means for detecting and setting a white balance value to be set for the white balance processing from the taken image.
  • the storage means stores the white balance value set by the detected value setting means and employed in the white balance processing as a white balance value employed in the past.
  • the white balance processing apparatus includes: selection means for selecting the employed value setting means or the detected value setting means as means for setting the white balance value; and forced setting means for, when the detected value setting means is selected by the selection means, switching the detected value setting means to the employed value setting means only during a specifically designated period.
  • the white balance processing apparatus further includes register means for causing the white balance value employed in the white balance processing of the taken image displayed on a display means to be stored to the storage means.
  • the white balance processing apparatus further includes: preset value storage means for storing preset white balance values that are previously set white balance values; correction means for correcting the preset white balance values; and corrected preset value setting means for setting the corrected preset white balance value for the white balance processing.
  • the storage means stores the corrected preset white balance value set and employed in the white balance processing as a white balance value employed in the past.
  • the white balance processing apparatus further includes: retaining means for retaining a white balance value employed in the white balance processing at the white balance processing means; and a register means for registering the white balance value retained at the retaining means to the storage means.
  • the retaining means of the white balance processing apparatus retains a plurality of white balance values employed in the white balance processing, and the register means selects a predetermined white balance value from the plurality of white balance values and registers it to the storage means.
  • a white balance processing apparatus including: white balance processing means for effecting white balance processing on a taken image based on a set white balance value; and setting means for setting, as the white balance value for the white balance processing, a white balance value read out from recorded taken image data, employed in white balance processing of that taken image.
  • the white balance processing apparatus further includes setting enabling means for enabling a setting of white balance value only when there is a coincidence between presence/absence of flash emission for the taken image and presence/absence of flash emission for image taken at the time of acquiring the white balance value set for the white balance processing of the taken image.
  • a digital camera having the white balance processing apparatus according to any one of the first to eighth aspects mounted thereon.
  • a digital camera having the white balance processing apparatus according to the ninth aspect mounted thereon.
  • a white balance processing method including the steps of: storing a white balance value employed in white balance processing of past taken image; and effecting white balance processing on a taken image by using the stored white balance value employed in the past as the white balance value for the taken image.
  • the stored white balance value employed in the past in the white balance processing method according to the twelfth aspect is a white balance value detected from a taken image processed in the past and is the white balance value employed in the white balance processing of the taken image.
  • a white balance processing program for causing a computer to execute the procedures of: storing a white balance value employed in white balance processing of past taken image; and effecting white balance processing on a taken image by using the stored white balance value employed in the past as the white balance value for the taken image.
  • a white balance processing apparatus including: white balance processing means for effecting white balance processing on an image to be taken; color histogram processing means for effecting histogram processing by color components in accordance with the image to be taken processed of white balance by the white balance processing means; and display means for displaying histograms by color components obtained by the color histogram processing means.
  • the color histogram processing means of the white balance processing apparatus effects histogram processing by color components by separating the image to be taken of an entire image frame and the image to be taken of a specific regional portion set within the image frame.
  • the display means in the white balance processing apparatus displays by color components the histogram concerning the entire image frame and the histogram concerning the specific regional portion by the color histogram processing means so that they can be compared with each other.
  • the white balance processing apparatus according to any one of the fifteenth to seventeenth aspects further includes display control means for effecting control to display the histograms by color components on the display means when a setting screen for setting white balance is displayed on the display means.
  • the display means in the white balance processing apparatus concurrently displays information concerning adjusting conditions of white balance of the white balance processing means.
  • the information concerning the adjusting conditions of white balance in the white balance processing apparatus is information indicating types of mode of white balance that can be selected.
  • the information concerning the adjusting conditions of white balance in the white balance processing apparatus is information concerning ratio about a specific color component processed of the histogram processing.
  • the display means in the white balance processing apparatus according to any one of the fifteenth to twenty-first aspects in addition concurrently displays the image to be taken.
  • the display means in the white balance processing apparatus additionally displays a white balance detecting region on the image to be taken.
  • the color histogram processing means in the white balance processing apparatus effects histogram processing by the three color components of RGB.
  • a digital camera having the white balance processing apparatus according to any one of the fifteenth to twenty-fourth aspects mounted thereon.
  • a white balance processing method including the steps of: effecting white balance processing on an image to be taken; effecting histogram processing by color components in accordance with the image to be taken processed of the white balance processing; and displaying a histogram by color components obtained by the histogram processing together with the image to be taken.
  • a white balance processing program for causing a computer to execute the procedures of: effecting white balance processing with respect to an image to be taken; effecting histogram processing by color components in accordance with the image to be taken processed of the white balance processing; and displaying histograms by color components obtained by the histogram processing together with the image to be taken.
  • FIG. 1 is a block diagram schematically showing a digital camera to which a first embodiment of the white balance processing apparatus and processing method thereof according to the present invention is applied.
  • FIG. 2 is a flowchart for explaining an operation of the first embodiment shown in FIG. 1 .
  • FIG. 3 shows a white balance menu display in the first embodiment.
  • FIG. 4 is a flowchart for explaining the operation of registering/storing process of custom white balance value in the first embodiment
  • FIG. 5 is a flowchart for explaining operation of a second embodiment of the invention.
  • FIG. 6 is a flowchart for explaining the manner of manipulating a white balance lock button in the second embodiment.
  • FIG. 7 is a block diagram for schematically showing a digital camera to which a third embodiment of the invention is applied.
  • FIG. 8 shows a file structure (layout) of media in the third embodiment.
  • FIG. 9 is flowchart for explaining operation of a fifth embodiment of the invention.
  • FIG. 10 is a block diagram schematically showing a digital camera to which a sixth embodiment of the invention is applied.
  • FIG. 11 illustrates the conventional white balance processing technique shown for comparison in explaining the basic techniques of the white balance processing in the sixth embodiment shown in FIG. 10 .
  • FIGS. 12A , 12 B and 12 C illustrate basic techniques of white balance processing in the sixth embodiment shown in FIG. 10 .
  • FIG. 13 is a flowchart for explaining setting operation of white balance value in the sixth embodiment shown in FIG. 10 .
  • FIG. 14 illustrates the operation of the flowchart shown in FIG. 13 .
  • FIG. 15 is a flowchart for explaining setting operation of white balance correcting value in the sixth embodiment shown in FIG. 10 .
  • FIG. 16 illustrates the operation of the flowchart shown in FIG. 15 .
  • FIG. 17 is a flowchart for explaining setting operation of the one-touch white balance value in the six embodiment shown in FIG. 10 .
  • FIG. 18 illustrates the operation of the flowchart shown in FIG. 17 .
  • FIG. 19 illustrates the manner of using a histogram display in adjusting exposure.
  • FIG. 20 illustrates the manner where the histogram target region in a histogram display is made movable.
  • FIG. 1 is a block diagram schematically showing a digital camera to which a first embodiment of the white balance processing apparatus and processing method thereof according to the invention is applied.
  • FIG. 1 includes: 1 , a lens for forming an object image; 2 , an imaging device such as CCD for converting the incoming object light image into electrical signals; 3 , AGC ⁇ A/D conversion circuit for controlling gain of and effecting analog-to-digital conversion of image pickup signals from the imaging device 2 ; 4 , a signal processing circuit including a white balance processing section 5 ; 6 , a white balance value detecting section for detecting white balance values from taken images: 7 , a preset white balance value storage section for storing preset white balance values previously set at the time of shipping from factory; 8 , a white balance correcting section for correcting the white balance values (AWB value) detected at the white balance value detecting section 6 or the preset white balance values stored at the preset white balance storage section 7 ; and 9 , a white balance input
  • the instructions effected from the above described manipulation inputting section 22 for example includes: the switching of the automatic, preset and custom white balance modes; registration of a custom white balance value from the white balance value retaining section 10 to the white balance value storage section 11 ; selection of custom white balance value; and correction value of white balance value.
  • the white balance value setting modes in this embodiment are: AWB mode for setting a white balance value detected from taken image; custom white balance mode for setting a stored custom white balance value; and preset white balance mode for setting a preset white balance value.
  • AWB mode for setting a white balance value detected from taken image
  • custom white balance mode for setting a stored custom white balance value
  • preset white balance mode for setting a preset white balance value.
  • the photographer causes a white balance menu having choices of white balance as shown in FIG. 3 to be displayed and sets AWB (automatic) mode as the white balance mode.
  • AWB automatic
  • the image taking is started by the pressing of a release button, it is first judged as AWB mode at the determining step of white balance mode (step S 1 ).
  • a white balance value is then detected at the white balance value detecting section 6 for each image taking (step S 2 ).
  • the detected white balance value is inputted to the white balance correcting section 8 through the white balance input changeover switch 9 and it is decided by the photographer (user) whether a correction is necessary or not (step S 3 ).
  • the correction is made according to a white balance correcting value (fine adjustment between red and blue) set by the photographer (step S 4 ).
  • the corrected detected white balance value or the detected white balance value without requiring correction is retained at the white balance value retaining section 10 (step S 5 ).
  • the taken image on the other hand is processed of white balance at the white balance processing section 5 by the corrected or not-corrected detected white balance value outputted from the white balance correcting section 8 through the white balance output changeover switch 12 (step S 6 ).
  • the taken image processed at the white balance processing section 5 is stored to the image memory 13 and then compressed at the compression circuit 14 (step S 7 ) and recorded to the media 16 through the recording/reading section 15 (step S 8 ).
  • the image data read out from the image memory 13 is displayed on the monitor 19 through the display circuit 18 (rec-view).
  • the photographer if judges it as a desirable white balance value, causes the white balance value retained at the white balance value retaining section 10 corresponding to the taken image to be stored to the white balance value storage section 11 as a custom white balance value.
  • the storing operation to the storage section 11 as a custom white balance value is shown in the flowchart of FIG. 4 .
  • this storing operation is effected by a menu manipulation, it is first determined whether an instruction for registration as a custom white balance value has been given or not (step S 11 ). If an instruction for registration has been given, the white balance value retained at the white balance value retaining section 10 is stored to the white balance value storage section 11 (step S 12 ).
  • the white balance value storage section 11 is formed of a memory for example a RAM with back-up power supply or a rewritable ROM such as flash memory which does not lose information even when the power is turned off.
  • the white balance value at the white balance value retaining section 10 may be updated at every image taking or it is also possible to retain the respective white balance values of a plurality of image taking. If a plurality of white balance values are retained at the white balance value retaining section 10 , the storing to the white balance value storage section 11 is selectively effected. The operation in this manner is advantageous for example when a plurality of images are to be taken by one time of image taking operation in taking a multiple of images at short intervals or bracket imaging (taking of a multiple of image in a short time period with changing the imaging condition).
  • the image taking operation at the time of custom white balance mode will now be described.
  • the photographer causes the white balance menu shown in FIG. 3 to be displayed and sets white balance mode to the custom white balance mode. It is thereby judged as the custom white balance mode at the determining step S 1 of white balance mode.
  • a custom white balance value stored at the white balance value storage section 11 is read out through the white balance output changeover switch 12 (step S 10 ).
  • a white balance processing is then performed on taken image at the white balance processing section 5 by using the custom white balance value (step S 6 ). Thereafter, a compression processing is similarly effected and the recording to media 16 is made.
  • the photographer similarly causes the white balance menu shown in FIG. 3 to be displayed and selects and sets a preset white balance value (white balance value corresponding to the clear sky, cloudy sky, incandescent lamp or fluorescent lamp) provided in the preset white balance value storage section 7 previously set to the camera for example at the time of shipping from factory. It is thereby judged as the preset white balance mode at the determining step S 1 of white balance mode.
  • the selected preset white balance value is then read out from the preset white balance value storage section 7 (step S 9 ).
  • the selected preset white balance value is then inputted to the white balance correcting section 8 through the white balance input changeover switch 9 and, if required, is corrected by a white balance correcting value set by the photographer (steps S 3 , S 4 ).
  • the preset white balance value corrected or not corrected at the white balance correcting section 8 is supplied to the white balance processing section 5 through the white balance output changeover switch 12 so as to effect white balance processing of the taken image by the preset white balance value.
  • the preset white balance value corrected at the white balance correcting section 8 is at the same time retained at the white balance value retaining section 10 .
  • the photographer then causes the corrected preset white balance value to be stored to the white balance value storage section 11 as a custom white balance value so that it can be used at the time of the custom white balance mode.
  • the corrected preset white balance value as a custom white balance value, advantages are obtained as follows. For example, there are various types of fluorescent lamps from daylight to white and the color tone thereof is delicately different from one maker to another. It is thus convenient to store the preset white balance value suitably corrected by the photographer corresponding to such color tone as a custom white balance value, since it can be readily used in the next image taking.
  • a second embodiment of the invention will now be described.
  • the fundamental construction of a digital camera to which this embodiment is applied is similar to that of the first embodiment shown in FIG. 1 and a diagrammatic explanation thereof will be omitted.
  • the first embodiment has been shown as one in which the retained white balance value detected/acquired in AWB mode is stored as a custom white balance value so that it can be used at the time of the custom white balance mode.
  • a white balance lock means (not separately shown) is directed by the manipulation inputting section 22 when an image is being taken in AWB mode to effect a white balance lock by the white balance lock means. Only in the period during which the white balance lock is effected, the white balance processing by the white balance value stored at the white balance value storage section 11 is possible.
  • the white balance lock manipulation is effected, the corrected white balance value retained at the white balance value retaining section 10 is stored to the white balance value storage section 11 .
  • white balance processing of taken image is effected by the white balance value stored at the white balance value storage section 11 (step S 23 ).
  • the white balance processing is effected in the same manner as before by using a white balance value corrected after its detection from the taken image (step S 24 ).
  • a compression processing is similarly effected (step S 25 ) and the recording to media 16 is made (step S 26 ).
  • FIG. 6 is a flowchart showing the manner of operation in the case where the white balance lock manipulation is effected by using a specialized white balance lock button. The manner of such operation will be briefly described.
  • the white balance lock button has been manipulated, if in a locked condition of white balance at that time at step S 31 for determining whether a white balance lock is effected or not, the white balance lock is unlocked (step S 32 ). If it is not in a locked condition of white balance at that point in time, on the other hand, the white balance value retained at the white balance value retaining section 10 is first stored to the white balance value storage section 11 (step S 33 ) and a locked condition of white balance is then effected (step S 34 ).
  • the white balance value storage section in this embodiment suffices to effect a temporary storage, it can be formed of a general-purpose RAM. Further, the white balance lock is so constructed that it is automatically unlocked when the image taking mode or white balance mode has been changed.
  • FIG. 7 is a block diagram schematically showing a digital camera to which the third embodiment is applied, where like components as in the first embodiment shown in FIG. 1 are denoted by like reference numerals.
  • the white balance (AWB) value detected from a taken image at the time of image taking is stored so that it can be used as a custom white balance value.
  • the white balance value of a reproduced image in the reproducing mode be stored as a custom white balance value.
  • the manner as described above can be executed.
  • the white balance value corrected after its detection from taken image and retained at the white balance value retaining section 10 is to be recorded to an image information region of media 16 through the recording/reading section 15 .
  • image data is read out from the media 16 and at the same time the white balance value is read out from the image information region so that it can be stored to the white balance value storage section 11 as a custom white balance value.
  • the white balance value detected from taken image at the white balance value detecting section 6 is retained at the white balance value retaining section 10 together with the white balance correcting value set by the photographer at the white balance correcting section 8 .
  • the taken image is then processed of white balance at the white balance processing section 5 by using the white balance value corrected at the white balance correcting section 8 and, after compression processing, is recorded to the media 16 through the recording/reading section 15 .
  • the detected white balance value and white balance correcting value retained at the white balance value retaining section 10 are recorded to the image information region (EXIF (registered trademark), Tag information region).
  • the photographer selects an image of one's choice at the time of reproduction and causes the detected white balance value and white balance correcting value recorded at the time of the image taking to be read out from the image information region of the selected reproduction image and be stored to the white balance value storage section 11 by a manipulation input from the manipulation inputting section 22 .
  • white balance processing can be effected by using the white balance value and white balance correcting value stored at the white balance value storage section 11 . It is thereby possible to obtain a taken image which is processed of white balance at a white balance value of one's choice in previously recorded taken image.
  • white balance values are inputted and stored as custom white balance value to the white balance value storage section 11 from an external personal computer (PC) 24 by a communication means through I/F 23 and CPU 21 .
  • PC personal computer
  • the photographer can effect white balance processing by using the stored white balance values as the above.
  • a white balance value for special light source previously provided on the personal computer is fetched into the white balance value storage section through a communication means as an optimal white balance values for the case of taking an image by the special light source such as the reddish glow after sunset, and it is stored as a custom white balance value. It is thereby possible to effect a suitable white balance processing at the time of taking an image by special light source.
  • a fifth embodiment of the invention will now be described.
  • the fundamental construction of a digital camera to which this embodiment is applied is also similar to that of the first or third embodiment shown in FIG. 1 or FIG. 7 and a diagrammatic explanation thereof will be omitted.
  • This embodiment is constructed such that, since a flash emission causes the light source to be changed so that a white balance value without change cannot be used, a suitable white balance processing is effected corresponding to the presence/absence of flash emission. In essence, if a white balance value detected from an image taken by flash emission is stored, it can be used only for those images taken at the time of flash emission. If a white balance value detected from an image taken without flash emission is stored, use of the stored white balance value is prohibited when an image is to be taken by flash emission and a white balance value of detected value or a special white balance value for flash emission is used.
  • step S 41 it is determined whether a flash emission is effected in the image taking or not. If accompanied by flash emission, it is determined whether the white balance value stored as the custom white balance value is a white balance value at the time of flash emission or not (step S 43 ). If YES at the determining step S 43 , the white balance processing is effected by such custom white balance value (step S 44 ), and the compression processing and recording are effected (steps S 45 , S 46 ).
  • white balance processing is effected by a white balance value (AWB) detected from the taken image or by a separately provided, special white balance value for flash emission (step S 47 ), and the compression processing and recording are effected.
  • ABB white balance value
  • step S 48 white balance processing is effected by a white balance value (AWB) detected from the taken image (step S 49 ), and the compression processing and recording are effected.
  • ABB white balance value
  • step S 48 the white balance value stored as custom white balance value is used to effect white balance processing (step S 50 ), and the compression processing and recording are effected.
  • FIG. 10 is a block diagram schematically showing a digital camera to which the sixth embodiment is applied. Here a description will be given with including those portions in common with the first and third embodiments shown in FIGS. 1 and 7 .
  • FIG. 10 is a block diagram schematically showing a digital camera to which the sixth embodiment is applied. Here a description will be given with including those portions in common with the first and third embodiments shown in FIGS. 1 and 7 .
  • FIG. 10 is a block diagram schematically showing a digital camera to which the sixth embodiment is applied.
  • FIG. 10 is a block diagram schematically showing a digital camera to which the sixth embodiment is applied.
  • FIG. 10 is a block diagram schematically showing a digital camera to which the sixth embodiment is applied.
  • a lens for forming an object image includes: 101 , a lens for forming an object image; 102 , an imaging device such as CCD for converting incoming object light image into electrical signals; 103 , AGC A/D conversion circuit for controlling gain of and effecting analog-to-digital conversion of image pickup signals from the imaging device 102 ; 104 , a signal processing circuit including a white balance processing section 105 ; 106 , a white balance value detecting section for detecting white balance values from taken image data: 107 , a preset white balance value storage section formed of a nonvolatile memory such as flash memory or EEPROM, for storing preset white balance values previously set at the time of shipping from factory; and 108 , a one-touch white balance value storage section formed of RAM which stores one-touch white balance value acquired by the one-touch white balance value setting processing to be described later.
  • AVB value automatic white balance value
  • Denoted by numeral 120 is CPU for controlling the respective component sections and 121 is a manipulation inputting section for effecting various inputs to CPU 120 .
  • Those which can be effected from the manipulation inputting section 121 for example includes: the switching of automatic, preset and one-touch white balance modes; and instruction for selection in the respective processing operation menus of the setting of white balance value, white balance correction, setting of one-touch white balance value, etc.
  • a white balance mode in the present embodiment, by contrast, at the same time of displaying the through image on the monitor, histograms (luminance distribution) by the respective color components of RGB of the through image are prepared and displayed on the monitor screen. The user, while watching the histogram display, is then allowed to set an optimum white balance value by objectively judging the respective color distributions of the colors of RGB. It is thereby possible to eliminate the disadvantages in the conventional white balance setting.
  • the histograms by color components of RGB acquired from the entire through image are displayed on the through image which is displayed on the monitor 115 .
  • the luminance distribution (histogram) of each of the colors of RGB at a histogram target region 115 a as indicated by double rectangular mark at the center of the screen frame of the through image is computed and is displayed as a black region on the histogram of the entire screen.
  • FIG. 12A shows histograms of the entire screen and luminance distributions of the histogram target region 115 a when “clear sky” is selected as the white balance mode.
  • the peak of the luminance distribution of R of the target region 115 a is shifted toward the lower side and the peak of the luminance distribution of B is shifted toward the higher side. From this, it can be objectively judged that the color tone at the target region 115 a of the through image is bluish. Accordingly, if the color of the object in the histogram target region 115 a is white, it is seen that an unsuitable white balance value at a color temperature lower than actual color temperature is being set.
  • FIG. 12B shows the histograms of the entire screen and the luminance distributions of the histogram target when “cloudy sky” is selected as the white balance mode.
  • the peak of the luminance distribution of R of the target region is shifted toward the higher side and the peak of the luminance distribution of B is shifted toward the lower side. From this, it can be objectively judged that the color tone at the target region 115 a of the through image is reddish. Accordingly, if the color of the object in the histogram target region 115 a is white, it is seen that an unsuitable white balance value at a color temperature higher than actual color temperature is being set.
  • FIG. 12C shows the histograms of the entire screen and the luminance distributions of the histogram target region when “automatic” is selected as the white balance mode.
  • the peak of the luminance distribution of each color of the target region is concentrated to the same position. From this, it can be objectively checked that a setting of suitable white balance value is effected. This case has been shown as one in which a proper white balance value is set when “automatic” is selected as the white balance mode. If, however, the peak of luminance distribution of each color in the target region with respect to a white object is concentrated to the same position as shown in FIG. 12C when another white balance mode such as “fluorescent lamp” is selected, the white balance mode, “fluorescent lamp”, selected and set at that time becomes a proper white balance mode.
  • another white balance mode such as “fluorescent lamp”
  • the white balance processing operation in the sixth embodiment will now be described.
  • the white balance processing operations that can be effected by the user in this embodiment are generally divided into three categories of operations, i.e., the white balance value setting operation, the white balance value correcting operation, and the one-touch white balance value setting operation.
  • the white balance value setting operation will be described by way of the flowchart shown in FIG. 13 .
  • a white balance value setting screen is first displayed on the monitor 115 (step S 51 ). In this case, as shown in FIG.
  • a through image is displayed on the monitor 115 ; the white balance mode menu is displayed on the right side of the screen; and the respective histograms of the colors of RGB of the entire screen and the histogram target region of the through image detected at the histogram detecting section 113 are displayed on the left side of the screen.
  • a cross key manipulation by the user is then accepted (step S 52 ). While the cross key is being manipulated, the user selects and sets the white balance mode in the order of “automatic” WB, “clear sky”, “cloudy sky”, “fluorescent lamp”, “incandescent lamp”, and “one-touch” (step S 53 ). It should be noted that, if the cross key is not manipulated at step S 52 for determining the cross key, the processing proceeds to step S 54 for selecting and determining the automatic white balance to be described next, since the automatic white balance mode is set as a default.
  • step S 54 If the automatic white balance is selected as the white balance mode (step S 54 ), a white balance value detected at the white balance value detecting section 106 from the through image is outputted (step S 55 ). If a preset white balance mode of “clear sky”, “cloudy sky”, “fluorescent lamp”, or “incandescent lamp” other than the automatic white balance is selected and set (step S 56 ), a preset white balance value adjusted and stored at the preset white balance value storage section 107 at the time of shipping from factory is read out (step S 57 ).
  • step S 58 If the one-touch white balance mode is selected and set, readout is obtained of the one-touch white balance value which has previously been acquired by the user through the one-touch white balance value setting operation and caused to be stored to the one-touch white balance value storage section 108 (step S 58 ).
  • One of the above described automatic white balance value, preset white balance value, and one-touch white balance value selected by the setting of the respective white balance modes is inputted to the white balance correcting section 109 to effect a fine adjustment (to be described later in detail) where the white balance value selected and set as described above is corrected (step S 59 ).
  • the corrected white balance value is then used to render white balance processing at the white balance processing section 105 on the taken image data obtained from CCD imaging device 102 (step S 60 ).
  • the image data processed of white balance is then stored to the image memory 112 , and the stored image data is read out and displayed on the monitor 115 as a taken image (step S 61 ).
  • histogram detection by color components of RGB of the entire screen and the histogram target region is effected at the histogram detecting section 113 with respect to the image data stored at the image memory 112 .
  • the obtained histograms by color components of RGB are then concurrently displayed on the taken image which is being displayed on the monitor 115 (step S 62 ).
  • step S 63 When selection and setting of an optimum white balance value are confirmed based on the histograms displayed on the monitor 115 , the OK key is pressed to end the setting operations of white balance value.
  • the displaying of the white balance mode menu and the histograms on the monitor 115 is then eliminated to restore a normal through image display (step S 64 ).
  • the white balance conditions can be specifically grasped in this manner while referring to the histograms by color components of RGB displayed on the white balance value setting screen. It is thereby possible to set an accurate white balance value.
  • the white balance correcting operation to be effected at the white balance correcting section 109 in this embodiment will now be described by way of the flowchart of FIG. 15 .
  • a white balance correcting screen is displayed on the monitor 115 (step S 71 ).
  • FIG. 16 a through image processed of white balance by the white balance value selected and set by the previously described white balance value setting operation shown in FIG. 13 is displayed.
  • a white balance correcting menu consisting of a gain adjusting knob 115 b which can be moved in the range of blue to red is then displayed on the right side of the screen, and the histograms by color components of RGB of the entire screen and histogram target region of the through image detected at the histogram detecting section 113 are displayed on the left side of the screen.
  • step S 72 change and adjustment of the white balance correcting value are then effected (step S 73 ).
  • the user effects such change and adjustment of the white balance correcting value by manipulating the gain adjusting knob 115 b in an up and down direction while referring to the histograms by color components of RGB on the monitor display screen so as to adjust the gains of blue and red.
  • a correcting value for emphasizing the bluish tone is set by causing the gain adjusting knob 115 b to be slid up toward the blue side so as to up the blue gain and down the red gain.
  • a correcting value for emphasizing the reddish tone is set by causing the gain adjusting knob 115 b to be slid down toward the red side so as to down the blue gain and up the red gain.
  • the white balance value (automatic, preset, one-touch white balance values) selected and set by the white balance value setting operation as preciously shown in FIG. 13 is then corrected at the white balance correcting section 109 by using the white balance correcting value thus set by the user (step S 74 ). It should be noted that, if the cross key is not manipulated at the cross key determining step S 72 , the processing proceeds to the above described white balance correction step S 74 .
  • the white balance correcting value obtained as described above is first used similarly to the white balance value setting operation as previously shown in FIG. 13 to render white balance processing at the white balance processing section 105 with respect to the taken image data obtained from CCD imaging device 102 (step S 75 ).
  • the image data processed of white balance is then stored to the image memory 112 , and the stored image data is read out and displayed on the monitor 115 as a taken image (step S 76 ).
  • histogram detection by the color components of RGB of the entire screen and histogram target region is performed at the histogram detecting section 113 with respect to the image data stored at the image memory 112 .
  • the obtained histograms by color components of RGB are then concurrently displayed on the taken image which is being displayed on the monitor 115 (step S 77 ).
  • step S 78 When the setting of an optimum white balance correcting value is confirmed while looking at the histograms displayed on the monitor, the OK key is pressed to end the white balance value correcting operation (step S 79 ).
  • the white balance correcting menu (gain adjusting knob) is adjusted and set while referring to the histograms by color components of RGB that are displayed on the white balance correcting value setting screen. It is thereby possible to set an accurate white balance correcting value with making an objective judgment based on the histogram display.
  • An automatic white balance value or preset white balance value is the value automatically measured by the camera or adjusted and set at the time of the shipping of the camera from factory.
  • the user adjusts and sets the white balance value by taking an image of white object such as a piece of paper so as to render the taken image on the monitor display white by using the light source at the location of photography.
  • a one-touch white balance value setting screen is displayed on the monitor 115 (step S 81 ).
  • a through image obtained by taking an image of the white paper is displayed on the monitor 115 .
  • the histograms by color components of RGB of the entire through image frame and histogram target region 115 a are displayed on the left side of the screen, and one-touch setting menu 115 c , “SET ⁇ OK”, is displayed on the lower-right side of the screen.
  • step S 82 the processing enters a setting operation of new one-touch white balance value so that a white balance value by which the taken image screen taking an image of the white paper displayed on the monitor 115 is rendered white is detected at the white balance detecting section 106 based on CCD image pickup signals (step S 83 ).
  • the detected white balance value is stored to the one-touch white balance value storage section 108 as the one-touch white balance value of the occasion (step S 84 ).
  • the one-touch white balance value stored at the one-touch white balance value storage section 108 is then read out to set a white balance correcting value at the white balance correcting section 109 by using the correcting value (gain value) set by the user (step S 85 ).
  • step S 86 a previously stored one-touch white balance value is used (step S 86 ), and a correction is made on the previously stored one-touch white balance value similarly by using a correcting value set by the user at the white balance correcting section 109 .
  • the one-touch white balance correcting value obtained as described is then used to effect white balance processing at the white balance processing section 105 on the taken image data obtained from CCD imaging device 102 (step S 87 ).
  • the image data processed of white balance is stored to the image memory 112 , and the stored image data is read out to be displayed on the monitor 115 as a taken image (step S 88 ).
  • histogram detection by the color components of RGB of the entire screen and histogram target region is effected at the histogram detecting section 113 with respect to the image data stored at the image memory 112 .
  • the obtained histograms by color components of RGB are concurrently displayed on the taken image which is displayed on the monitor 115 (step S 89 ).
  • step S 90 an END key (the left side of a cross key for example) is pressed.
  • the END key is pressed to end the setting operation of one-touch white balance value (step S 91 ).
  • step S 91 the suitability can be objectively checked while similarly referring to the histograms by color components of RGB when setting the white balance value so that the taken image frame of white paper displayed on the one-touch white balance value setting screen is rendered white.
  • a technique has been described of obtaining a suitable white balance value or white balance correcting value by using the histogram display by color components of RGB in the setting of a white balance value, setting of a white balance correcting value or setting of one-touch white balance value.
  • the displaying of histogram can also be used in taking an image in an ordinary manner.
  • the histograms by color components of RGB are not required, and it suffices as shown in FIG. 19 to display a histogram 115 d of luminance distribution.
  • Such luminance distribution histogram can be used in adjusting exposure.
  • the histograms by color components have been shown as those detecting and displaying the histograms by the color components of three-primary colors of RGB.
  • the histograms by color components to be displayed are not limited to those of three-primary colors of RGB.
  • G component in the three-primary colors has a lower contribution to the setting of white balance value, it can be omitted while detecting and displaying only the histograms (luminance distribution) of R, B components.
  • the above sixth embodiment has been shown as that in which the histograms are displayed of the entire screen and of the histogram target region 115 a set at the center of the screen of the white balance value setting screen or white balance correcting value setting screen.
  • the histogram target region 115 a set as fixed to the center region of the screen can be modified so as to be movable.
  • the luminance distribution of the histogram target region 115 a is such that the luminance of blue is high and red and green are of low luminance whereby the vividness of the blue sky portion can be confirmed.
  • the moving of the histogram target region 115 a can be effected for example by concurrently manipulating a histogram target displaying button and a cross key.
  • the respective functions of the embodiments are achieved by operations of the respective sections in accordance with control of CPU.
  • the functions of white balance processing and displaying as explained by the respective flow charts shown in the figures can also be achieved mostly by CPU under programs previously stored to an internally provided nonvolatile memory such as EEPROM (not shown) in the digital camera.
  • EEPROM electrically provided nonvolatile memory
  • the programs themselves and the storage medium storing such programs constitute the present invention. It should be noted that such programs can also be supplied to an imaging apparatus such as digital camera as a recording medium or by the means of communication from an external source.
  • the first aspect of the invention it is possible according to the first aspect of the invention to effect white balance processing of a freshly taken image by using white balance value used in the white balance processing of a past taken image so that a taken image having a similar color tone as the past taken image can be readily obtained.
  • the white balance processing of a freshly taken image can be effected by using a white balance value detected and set from a past taken image, i.e., AWB value, a color tone of image taken by AWB in the past can be readily reproduced.
  • a white balance value in the white balance processing of a past taken image can be at any time used even in the AWB processing.
  • a white balance value used in the white balance processing of taken image displayed on a display means by a preview or rec-view manipulation is stored, it is possible to readily reuse the white balance value of a favorite color tone which has been checked on the display means.
  • a corrected preset white balance value used in white balance processing is stored as a white balance value used in the past, it is possible to readily recall the white balance value which has been set in preset white balance processing in the past.
  • the sixth aspect before the storing of a white balance value to be stored to a storage means, it is temporarily retained at a retaining means so that registration of predetermined white balance values to the storage means can be securely and readily effected.
  • a white balance value used in recorded taken image can be readily reused.
  • a suitable white balance value can be set corresponding to presence/absence of flash emission on the taken image.
  • the white balance processing according to the thirteenth aspect can be achieved by means of software.
  • a histogram processing by color components is effected on taken image processed of white balance and the obtained histograms by color components are displayed on a display means so that the actual condition of white balance can be readily grasped and an accurate white balance value can be readily adjusted and set.
  • histogram processing by color components is effected separately for the entire screen and for a specific regional portion, a histogram comparison by color components is readily possible of the entire portion and the specific regional portion which serves as a detecting portion.
  • histogram related to the entire screen and histogram related to a specific regional portion are displayed in a manner capable of being compared by color components so that a comparison becomes even more easier of the histogram related to the entire screen and the histogram of the specific regional portion.
  • histogram by color component is concurrently displayed when the screen for setting white balance is displayed, comparison between the white balance setting screen and the histogram by color components becomes easier.
  • histogram by color components and information related to the adjusting conditions of white balance are concurrently displayed, it is readily possible to effect a comparison between the actual conditions and adjusting conditions of white balance.
  • histogram by color components and information indicating the types of white balance mode that can be selected are concurrently displayed, a white balance mode that can be chosen can be readily selected while looking at the histogram.
  • the twenty-first aspect since histogram by color components and information related to ratio concerning a specific color component subjected to histogram processing are concurrently displayed, a setting by color components in white balance can be readily effected.
  • histogram by color components and taken image are concurrently displayed so that the taken image and the histogram by color components can be compared to more readily judge for example the suitability of white balance.
  • a white balance detecting region is displayed on taken image which is displayed together with histogram by color components, it is readily possible to check the white balance detecting region.
  • histogram processing is effected and displayed by three color components of RGB which are the most generally used color components, the actual condition of white balance can be even more readily grasped.
  • the white balance processing according to the twenty-sixth aspect can be achieved by means of software.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Color Television Image Signal Generators (AREA)
  • Processing Of Color Television Signals (AREA)

Abstract

Disclosed herein is a white balance processing apparatus comprising white balance processing means for effecting white balance processing on an image to be taken, color histogram processing means for effecting histogram processing by color components in accordance with the image to be taken processed of white balance by the white balance processing means, and display means for displaying histograms by color components obtained by the color histogram processing means.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
This application is a divisional of U.S. patent application Ser. No. 10/620,118, filed on Jul. 15, 2003 which claims benefits of Japanese Patent Application No. 2002-205013, filed on Jul. 15, 2002, and No. 2002-334852, filed on Nov. 19, 2002, the contents of which are incorporated herein by reference.
BACKGROUND OF THE INVENTION
The present invention relates to white balance processing apparatus and processing method thereof in which pickup images can be readily processed at white balance values of desired color tone, and also relates to a program for executing such processing method and to digital cameras using such white balance processing apparatus.
In imaging apparatus such as a digital camera, white balance adjustment is indispensable in recording taken images. The techniques for such white balance adjustment include an automatic white balance, preset white balance, one-touch white balance, manual white balance, etc.
The most frequently used technique is the automatic white balance (AWB). In this technique, a fetched pickup image is analyzed at the inside of the imaging apparatus to compute an optimal white balance value, and white balance processing is effected on the taken image by using the computed white balance value. Since, however, the white balance adjustment is an adjustment of color condition and involves highly subjective elements, a white balance adjustment based on a theoretically correct white balance value obtained by the automatic white balance technique is not necessarily preferred.
By contrast, there is a technique referred to as preset white balance adjustment. In this technique, the white balance processing is effected by a white balance value which is designated by the photographer from those white balance values previously stored to the imaging apparatus before its shipping from factory, i.e., white balance values corresponding for example to the light sources of fluorescent lamp, incandescent lamp, outdoors, etc.
Further, there is a technique referred to as one-touch white balance adjustment. In this technique, a preliminary image of a white object is taken before the main image taking under the image taking condition to previously set a white balance value, and white balance processing is effected on the pickup image by such set white balance value.
Among other prior-art techniques relating to white balance processing, Japanese patent application laid-open No. 2000-299814 discloses a technique in which the setting of white balance is selected from an automatic setting and a customized setting of the user. Further, Japanese patent application laid-open Hei-10-304386 discloses for example a technique in which an automatic white balance (AWB) function is also locked concurrently with AF and AE functions by the half-pressed manipulation (1st manipulation) of the release switch in taking an image.
Further, Japanese patent application laid-open Hei-11-355784 discloses a digital camera capable of selecting from an automatic white balance adjustment mode and a manual white balance adjustment mode in which the photographer can manually make an adjustment based on a color temperature information.
Furthermore, Japanese patent application laid-open No. 2002-185972 discloses a digital camera in which an achromatic color region is distinguishably displayed on image displayed on an image displaying LCD monitor of digital camera so that a suitable white balance can be set while checking such displayed image.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide a white balance processing apparatus and processing method thereof in which taken images can be readily processed by a white balance value of desired color tone. Further, it is another object of the invention to provide a white balance processing apparatus, processing method thereof, and digital camera using same in which an adjustment and setting of white balance value of desired color tone can be objectively and readily effected at high accuracy.
In a first aspect of the invention, there is provided a white balance processing apparatus including: white balance processing means for effecting white balance processing on a taken image based on a set white balance value; storage means for storing white balance values employed in the white balance processing of past taken images; and employed value setting means for setting a white balance value employed in the past, stored in the storage means as the white balance value for the taken image.
In a second aspect of the invention, the white balance processing apparatus according to the first aspect further includes detected value setting means for detecting and setting a white balance value to be set for the white balance processing from the taken image. The storage means stores the white balance value set by the detected value setting means and employed in the white balance processing as a white balance value employed in the past.
In a third aspect of the invention, the white balance processing apparatus according to the second aspect includes: selection means for selecting the employed value setting means or the detected value setting means as means for setting the white balance value; and forced setting means for, when the detected value setting means is selected by the selection means, switching the detected value setting means to the employed value setting means only during a specifically designated period.
In a fourth aspect of the invention, the white balance processing apparatus according to the third aspect further includes register means for causing the white balance value employed in the white balance processing of the taken image displayed on a display means to be stored to the storage means.
In a fifth aspect of the invention, the white balance processing apparatus according to the first aspect further includes: preset value storage means for storing preset white balance values that are previously set white balance values; correction means for correcting the preset white balance values; and corrected preset value setting means for setting the corrected preset white balance value for the white balance processing. The storage means stores the corrected preset white balance value set and employed in the white balance processing as a white balance value employed in the past.
In a sixth aspect of the invention, the white balance processing apparatus according to any one of the first to fifth aspects further includes: retaining means for retaining a white balance value employed in the white balance processing at the white balance processing means; and a register means for registering the white balance value retained at the retaining means to the storage means.
In a seventh aspect of the invention, the retaining means of the white balance processing apparatus according to the sixth aspect retains a plurality of white balance values employed in the white balance processing, and the register means selects a predetermined white balance value from the plurality of white balance values and registers it to the storage means.
In an eighth aspect of the invention, there is provided a white balance processing apparatus including: white balance processing means for effecting white balance processing on a taken image based on a set white balance value; and setting means for setting, as the white balance value for the white balance processing, a white balance value read out from recorded taken image data, employed in white balance processing of that taken image.
In a ninth aspect of the invention, the white balance processing apparatus according to any one of the first to eighth aspects further includes setting enabling means for enabling a setting of white balance value only when there is a coincidence between presence/absence of flash emission for the taken image and presence/absence of flash emission for image taken at the time of acquiring the white balance value set for the white balance processing of the taken image.
In a tenth aspect of the invention, there is provided a digital camera having the white balance processing apparatus according to any one of the first to eighth aspects mounted thereon.
In an eleventh aspect of the invention, there is provided a digital camera having the white balance processing apparatus according to the ninth aspect mounted thereon.
In a twelfth aspect of the invention, there is provided a white balance processing method including the steps of: storing a white balance value employed in white balance processing of past taken image; and effecting white balance processing on a taken image by using the stored white balance value employed in the past as the white balance value for the taken image.
In a thirteenth aspect of the invention, the stored white balance value employed in the past in the white balance processing method according to the twelfth aspect is a white balance value detected from a taken image processed in the past and is the white balance value employed in the white balance processing of the taken image.
In a fourteenth aspect of the invention, there is provided a white balance processing program for causing a computer to execute the procedures of: storing a white balance value employed in white balance processing of past taken image; and effecting white balance processing on a taken image by using the stored white balance value employed in the past as the white balance value for the taken image.
In a fifteenth aspect of the invention, there is provided a white balance processing apparatus including: white balance processing means for effecting white balance processing on an image to be taken; color histogram processing means for effecting histogram processing by color components in accordance with the image to be taken processed of white balance by the white balance processing means; and display means for displaying histograms by color components obtained by the color histogram processing means.
In a sixteenth aspect of the invention, the color histogram processing means of the white balance processing apparatus according to the fifteenth aspect effects histogram processing by color components by separating the image to be taken of an entire image frame and the image to be taken of a specific regional portion set within the image frame.
In a seventeenth aspect of the invention, the display means in the white balance processing apparatus according to the sixteenth aspect displays by color components the histogram concerning the entire image frame and the histogram concerning the specific regional portion by the color histogram processing means so that they can be compared with each other.
In an eighteenth aspect of the invention, the white balance processing apparatus according to any one of the fifteenth to seventeenth aspects further includes display control means for effecting control to display the histograms by color components on the display means when a setting screen for setting white balance is displayed on the display means.
In a nineteenth aspect of the invention, the display means in the white balance processing apparatus according to any one of the fifteenth to eighteenth aspects concurrently displays information concerning adjusting conditions of white balance of the white balance processing means.
In a twentieth aspect of the invention, the information concerning the adjusting conditions of white balance in the white balance processing apparatus according to the nineteenth aspect is information indicating types of mode of white balance that can be selected.
In a twenty-first aspect of the invention, the information concerning the adjusting conditions of white balance in the white balance processing apparatus according to the nineteenth aspect is information concerning ratio about a specific color component processed of the histogram processing.
In a twenty-second aspect of the invention, the display means in the white balance processing apparatus according to any one of the fifteenth to twenty-first aspects in addition concurrently displays the image to be taken.
In a twenty-third aspect of the invention, the display means in the white balance processing apparatus according to the twenty-second aspect additionally displays a white balance detecting region on the image to be taken.
In a twenty-fourth aspect of the invention, the color histogram processing means in the white balance processing apparatus according to any one of the fifteenth to twenty-third aspects effects histogram processing by the three color components of RGB.
In a twenty-fifth aspect of the invention, there is provided a digital camera having the white balance processing apparatus according to any one of the fifteenth to twenty-fourth aspects mounted thereon.
In a twenty-sixth aspect of the invention, there is provided a white balance processing method including the steps of: effecting white balance processing on an image to be taken; effecting histogram processing by color components in accordance with the image to be taken processed of the white balance processing; and displaying a histogram by color components obtained by the histogram processing together with the image to be taken.
In twenty-seventh aspect of the invention, there is provided a white balance processing program for causing a computer to execute the procedures of: effecting white balance processing with respect to an image to be taken; effecting histogram processing by color components in accordance with the image to be taken processed of the white balance processing; and displaying histograms by color components obtained by the histogram processing together with the image to be taken.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram schematically showing a digital camera to which a first embodiment of the white balance processing apparatus and processing method thereof according to the present invention is applied.
FIG. 2 is a flowchart for explaining an operation of the first embodiment shown in FIG. 1.
FIG. 3 shows a white balance menu display in the first embodiment.
FIG. 4 is a flowchart for explaining the operation of registering/storing process of custom white balance value in the first embodiment
FIG. 5 is a flowchart for explaining operation of a second embodiment of the invention.
FIG. 6 is a flowchart for explaining the manner of manipulating a white balance lock button in the second embodiment.
FIG. 7 is a block diagram for schematically showing a digital camera to which a third embodiment of the invention is applied.
FIG. 8 shows a file structure (layout) of media in the third embodiment.
FIG. 9 is flowchart for explaining operation of a fifth embodiment of the invention.
FIG. 10 is a block diagram schematically showing a digital camera to which a sixth embodiment of the invention is applied.
FIG. 11 illustrates the conventional white balance processing technique shown for comparison in explaining the basic techniques of the white balance processing in the sixth embodiment shown in FIG. 10.
FIGS. 12A, 12B and 12C illustrate basic techniques of white balance processing in the sixth embodiment shown in FIG. 10.
FIG. 13 is a flowchart for explaining setting operation of white balance value in the sixth embodiment shown in FIG. 10.
FIG. 14 illustrates the operation of the flowchart shown in FIG. 13.
FIG. 15 is a flowchart for explaining setting operation of white balance correcting value in the sixth embodiment shown in FIG. 10.
FIG. 16 illustrates the operation of the flowchart shown in FIG. 15.
FIG. 17 is a flowchart for explaining setting operation of the one-touch white balance value in the six embodiment shown in FIG. 10.
FIG. 18 illustrates the operation of the flowchart shown in FIG. 17.
FIG. 19 illustrates the manner of using a histogram display in adjusting exposure.
FIG. 20 illustrates the manner where the histogram target region in a histogram display is made movable.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
Some embodiments of the invention will now be described. FIG. 1 is a block diagram schematically showing a digital camera to which a first embodiment of the white balance processing apparatus and processing method thereof according to the invention is applied. FIG. 1 includes: 1, a lens for forming an object image; 2, an imaging device such as CCD for converting the incoming object light image into electrical signals; 3, AGC·A/D conversion circuit for controlling gain of and effecting analog-to-digital conversion of image pickup signals from the imaging device 2; 4, a signal processing circuit including a white balance processing section 5; 6, a white balance value detecting section for detecting white balance values from taken images: 7, a preset white balance value storage section for storing preset white balance values previously set at the time of shipping from factory; 8, a white balance correcting section for correcting the white balance values (AWB value) detected at the white balance value detecting section 6 or the preset white balance values stored at the preset white balance storage section 7; and 9, a white balance input changeover switch for switching the input to the white balance correcting section 8 between the preset white balance value and the detected white balance value (AWB value).
It further includes: 10, a white balance value retaining section for temporarily retaining a corrected white balance value; 11, a white balance value storage section for storing the corrected white balance value retained at the white balance value retaining section 10 as a custom white balance value; and 12, a white balance output changeover switch for providing output to the white balance processing section 5 by switching between the corrected, detected white balance value or preset white balance value and the custom white balance value.
It furthermore includes: 13, an image memory for storing image data after the white balance processing; 14, a compression circuit for compressing image data read out from the image memory 13; 15, a recording/reading section for recording compressed image data to media 16 such as a memory card and reading the image data from the media 16; 17, an expanding circuit for expanding the image data read out from the media 16; 18, a display circuit for displaying the image data stored at the image memory 13 onto a monitor 19; 20, a flash mechanism for flash photography; 21, CPU for controlling the respective component members; 22, a manipulation inputting section for effecting various inputs to CPU 21 from the respective sections; and 24 an external personal computer connected to CPU 21 through an interface 23.
It should be noted that the instructions effected from the above described manipulation inputting section 22 for example includes: the switching of the automatic, preset and custom white balance modes; registration of a custom white balance value from the white balance value retaining section 10 to the white balance value storage section 11; selection of custom white balance value; and correction value of white balance value.
A description will now be given with reference to the flowchart of FIG. 2 with respect to an image taking operation of the digital camera to which the first embodiment having such construction is applied. The white balance value setting modes in this embodiment are: AWB mode for setting a white balance value detected from taken image; custom white balance mode for setting a stored custom white balance value; and preset white balance mode for setting a preset white balance value. The operation in AWB mode will be first described.
The photographer (user) causes a white balance menu having choices of white balance as shown in FIG. 3 to be displayed and sets AWB (automatic) mode as the white balance mode. When the image taking is started by the pressing of a release button, it is first judged as AWB mode at the determining step of white balance mode (step S1). A white balance value is then detected at the white balance value detecting section 6 for each image taking (step S2). The detected white balance value is inputted to the white balance correcting section 8 through the white balance input changeover switch 9 and it is decided by the photographer (user) whether a correction is necessary or not (step S3). If a correction is decided to be necessary, the correction is made according to a white balance correcting value (fine adjustment between red and blue) set by the photographer (step S4). The corrected detected white balance value or the detected white balance value without requiring correction is retained at the white balance value retaining section 10 (step S5).
The taken image on the other hand is processed of white balance at the white balance processing section 5 by the corrected or not-corrected detected white balance value outputted from the white balance correcting section 8 through the white balance output changeover switch 12 (step S6). The taken image processed at the white balance processing section 5 is stored to the image memory 13 and then compressed at the compression circuit 14 (step S7) and recorded to the media 16 through the recording/reading section 15 (step S8). At the same time, the image data read out from the image memory 13 is displayed on the monitor 19 through the display circuit 18 (rec-view).
Seeing the displayed image on the monitor 19 by the rec-view operation or the recorded image reproduced and displayed onto the monitor 19 from media 16 by a quick reproducing operation, the photographer, if judges it as a desirable white balance value, causes the white balance value retained at the white balance value retaining section 10 corresponding to the taken image to be stored to the white balance value storage section 11 as a custom white balance value.
The storing operation to the storage section 11 as a custom white balance value is shown in the flowchart of FIG. 4. In particular, while this storing operation is effected by a menu manipulation, it is first determined whether an instruction for registration as a custom white balance value has been given or not (step S11). If an instruction for registration has been given, the white balance value retained at the white balance value retaining section 10 is stored to the white balance value storage section 11 (step S12).
It should be noted that the white balance value storage section 11 is formed of a memory for example a RAM with back-up power supply or a rewritable ROM such as flash memory which does not lose information even when the power is turned off. Further, the white balance value at the white balance value retaining section 10 may be updated at every image taking or it is also possible to retain the respective white balance values of a plurality of image taking. If a plurality of white balance values are retained at the white balance value retaining section 10, the storing to the white balance value storage section 11 is selectively effected. The operation in this manner is advantageous for example when a plurality of images are to be taken by one time of image taking operation in taking a multiple of images at short intervals or bracket imaging (taking of a multiple of image in a short time period with changing the imaging condition).
The image taking operation at the time of custom white balance mode will now be described. The photographer causes the white balance menu shown in FIG. 3 to be displayed and sets white balance mode to the custom white balance mode. It is thereby judged as the custom white balance mode at the determining step S1 of white balance mode. In this case, a custom white balance value stored at the white balance value storage section 11 is read out through the white balance output changeover switch 12 (step S10). A white balance processing is then performed on taken image at the white balance processing section 5 by using the custom white balance value (step S6). Thereafter, a compression processing is similarly effected and the recording to media 16 is made.
The image taking operation at the time of the preset white balance mode will now be described. In this case, the photographer similarly causes the white balance menu shown in FIG. 3 to be displayed and selects and sets a preset white balance value (white balance value corresponding to the clear sky, cloudy sky, incandescent lamp or fluorescent lamp) provided in the preset white balance value storage section 7 previously set to the camera for example at the time of shipping from factory. It is thereby judged as the preset white balance mode at the determining step S1 of white balance mode. The selected preset white balance value is then read out from the preset white balance value storage section 7 (step S9). The selected preset white balance value is then inputted to the white balance correcting section 8 through the white balance input changeover switch 9 and, if required, is corrected by a white balance correcting value set by the photographer (steps S3, S4). The preset white balance value corrected or not corrected at the white balance correcting section 8 is supplied to the white balance processing section 5 through the white balance output changeover switch 12 so as to effect white balance processing of the taken image by the preset white balance value.
Further, the preset white balance value corrected at the white balance correcting section 8 is at the same time retained at the white balance value retaining section 10. The photographer then causes the corrected preset white balance value to be stored to the white balance value storage section 11 as a custom white balance value so that it can be used at the time of the custom white balance mode. By storing the corrected preset white balance value as a custom white balance value, advantages are obtained as follows. For example, there are various types of fluorescent lamps from daylight to white and the color tone thereof is delicately different from one maker to another. It is thus convenient to store the preset white balance value suitably corrected by the photographer corresponding to such color tone as a custom white balance value, since it can be readily used in the next image taking.
A second embodiment of the invention will now be described. The fundamental construction of a digital camera to which this embodiment is applied is similar to that of the first embodiment shown in FIG. 1 and a diagrammatic explanation thereof will be omitted. The first embodiment has been shown as one in which the retained white balance value detected/acquired in AWB mode is stored as a custom white balance value so that it can be used at the time of the custom white balance mode. In the present embodiment, a white balance lock means (not separately shown) is directed by the manipulation inputting section 22 when an image is being taken in AWB mode to effect a white balance lock by the white balance lock means. Only in the period during which the white balance lock is effected, the white balance processing by the white balance value stored at the white balance value storage section 11 is possible.
The image taking operation of the second embodiment will now be described in more detail with reference to the flowchart shown in FIG. 5. When an image is taken in AWB mode by the photographer, white balance processing of the taken image is effected by a white balance value obtained by correcting a detected white balance value and at the same time the corrected white balance value is retained at the white balance value retaining section 10. If a white balance value is already retained thereat, it is replaced by the new white balance value. If, while such image taking in AWB mode is being performed, the photographer finds that a favorable white balance value is obtained for the taken image displayed on the monitor 19 by a rec-view or quick reproduction, a white balance lock is effected by manipulating a lock button at the manipulation inputting section 22. In this case, as shown in the flowchart of FIG. 5, it is judged as AWB mode at the white balance mode determining step S21 and judged as white balance lock at the white balance lock determining step S22.
If the white balance lock manipulation is effected, the corrected white balance value retained at the white balance value retaining section 10 is stored to the white balance value storage section 11. Until the unlocking of the white balance lock by a lock button manipulation at the manipulation inputting section 22, then, white balance processing of taken image is effected by the white balance value stored at the white balance value storage section 11 (step S23). If on the other hand the white balance lock is not effected, the white balance processing is effected in the same manner as before by using a white balance value corrected after its detection from the taken image (step S24). Thereafter, a compression processing is similarly effected (step S25) and the recording to media 16 is made (step S26).
FIG. 6 is a flowchart showing the manner of operation in the case where the white balance lock manipulation is effected by using a specialized white balance lock button. The manner of such operation will be briefly described. When the white balance lock button has been manipulated, if in a locked condition of white balance at that time at step S31 for determining whether a white balance lock is effected or not, the white balance lock is unlocked (step S32). If it is not in a locked condition of white balance at that point in time, on the other hand, the white balance value retained at the white balance value retaining section 10 is first stored to the white balance value storage section 11 (step S33) and a locked condition of white balance is then effected (step S34).
It should be noted that, since the white balance value storage section in this embodiment suffices to effect a temporary storage, it can be formed of a general-purpose RAM. Further, the white balance lock is so constructed that it is automatically unlocked when the image taking mode or white balance mode has been changed.
A third embodiment of the invention will now be described. FIG. 7 is a block diagram schematically showing a digital camera to which the third embodiment is applied, where like components as in the first embodiment shown in FIG. 1 are denoted by like reference numerals. In those shown in the first and second embodiments, the white balance (AWB) value detected from a taken image at the time of image taking is stored so that it can be used as a custom white balance value. In such case, it is also possible that the white balance value of a reproduced image in the reproducing mode be stored as a custom white balance value. In the present embodiment, at the same time of being capable of white balance processing in AWB mode, the manner as described above can be executed.
In particular, as shown in FIG. 7, the white balance value corrected after its detection from taken image and retained at the white balance value retaining section 10 is to be recorded to an image information region of media 16 through the recording/reading section 15. At the time of reproduction, then, image data is read out from the media 16 and at the same time the white balance value is read out from the image information region so that it can be stored to the white balance value storage section 11 as a custom white balance value.
The operation of the third embodiment having such construction will now be described. The white balance value detected from taken image at the white balance value detecting section 6 is retained at the white balance value retaining section 10 together with the white balance correcting value set by the photographer at the white balance correcting section 8. The taken image is then processed of white balance at the white balance processing section 5 by using the white balance value corrected at the white balance correcting section 8 and, after compression processing, is recorded to the media 16 through the recording/reading section 15. At the same time of the recording of the taken image (image data), as shown by the file structure of media 16 of FIG. 8, the detected white balance value and white balance correcting value retained at the white balance value retaining section 10 are recorded to the image information region (EXIF (registered trademark), Tag information region).
The photographer then selects an image of one's choice at the time of reproduction and causes the detected white balance value and white balance correcting value recorded at the time of the image taking to be read out from the image information region of the selected reproduction image and be stored to the white balance value storage section 11 by a manipulation input from the manipulation inputting section 22. By setting to the custom white balance mode in taking a new image afresh, then, white balance processing can be effected by using the white balance value and white balance correcting value stored at the white balance value storage section 11. It is thereby possible to obtain a taken image which is processed of white balance at a white balance value of one's choice in previously recorded taken image.
A fourth embodiment of the invention will now be described. The fundamental construction of a digital camera to which this embodiment is applied is also similar to that of the first embodiment shown in FIG. 1 and a diagrammatic explanation thereof will be omitted. In this embodiment, white balance values are inputted and stored as custom white balance value to the white balance value storage section 11 from an external personal computer (PC) 24 by a communication means through I/F 23 and CPU 21. In the custom white balance mode, the photographer can effect white balance processing by using the stored white balance values as the above.
Particularly, in this embodiment, a white balance value for special light source previously provided on the personal computer is fetched into the white balance value storage section through a communication means as an optimal white balance values for the case of taking an image by the special light source such as the reddish glow after sunset, and it is stored as a custom white balance value. It is thereby possible to effect a suitable white balance processing at the time of taking an image by special light source.
A fifth embodiment of the invention will now be described. The fundamental construction of a digital camera to which this embodiment is applied is also similar to that of the first or third embodiment shown in FIG. 1 or FIG. 7 and a diagrammatic explanation thereof will be omitted. This embodiment is constructed such that, since a flash emission causes the light source to be changed so that a white balance value without change cannot be used, a suitable white balance processing is effected corresponding to the presence/absence of flash emission. In essence, if a white balance value detected from an image taken by flash emission is stored, it can be used only for those images taken at the time of flash emission. If a white balance value detected from an image taken without flash emission is stored, use of the stored white balance value is prohibited when an image is to be taken by flash emission and a white balance value of detected value or a special white balance value for flash emission is used.
The operation of this embodiment will now be described by way of the flowchart of FIG. 9. When an image is taken in the custom white balance mode, it is determined whether a flash emission is effected in the image taking or not (steps S41, S42). If accompanied by flash emission, it is determined whether the white balance value stored as the custom white balance value is a white balance value at the time of flash emission or not (step S43). If YES at the determining step S43, the white balance processing is effected by such custom white balance value (step S44), and the compression processing and recording are effected (steps S45, S46). If NO at the above determining step S43, on the other hand, white balance processing is effected by a white balance value (AWB) detected from the taken image or by a separately provided, special white balance value for flash emission (step S47), and the compression processing and recording are effected.
Further, if the image taking is not accompanied by flash emission at the step S42 for determining whether flash emission is effected at the image taking or not, it is then determined whether the white balance value stored as custom white balance value is a white balance value at the time of flash emission or not (step S48). If YES at the determining step S48, white balance processing is effected by a white balance value (AWB) detected from the taken image (step S49), and the compression processing and recording are effected.
On the other hand, if NO at the above determining step S48, the white balance value stored as custom white balance value is used to effect white balance processing (step S50), and the compression processing and recording are effected.
By the above processing steps, it is possible to effect a suitable white balance processing corresponding to presence/absence of flash emission in taking the image.
A sixth embodiment of the invention will now be described. FIG. 10 is a block diagram schematically showing a digital camera to which the sixth embodiment is applied. Here a description will be given with including those portions in common with the first and third embodiments shown in FIGS. 1 and 7. FIG. 10 includes: 101, a lens for forming an object image; 102, an imaging device such as CCD for converting incoming object light image into electrical signals; 103, AGC A/D conversion circuit for controlling gain of and effecting analog-to-digital conversion of image pickup signals from the imaging device 102; 104, a signal processing circuit including a white balance processing section 105; 106, a white balance value detecting section for detecting white balance values from taken image data: 107, a preset white balance value storage section formed of a nonvolatile memory such as flash memory or EEPROM, for storing preset white balance values previously set at the time of shipping from factory; and 108, a one-touch white balance value storage section formed of RAM which stores one-touch white balance value acquired by the one-touch white balance value setting processing to be described later.
It further includes: 109, a white balance correcting section for correcting an automatic white balance value (AWB value) detected at the white balance value detecting section 106, or a preset white balance value stored at the preset white balance value storage section 107, or a one-touch white balance value stored at the one-touch white balance value storage section 108; 110, a white balance input changeover switch for switching the input to the white balance correcting section 109 among the preset white balance value, the automatic white balance value (AWB value) detected at the white balance processing section and the one-touch white balance value; and 111, a one-touch white balance input switch for controlling ON/OFF of the inputting of one-touch white balance value to the one-touch white balance value storage section 108.
It furthermore includes: 112, an image memory for storing image data processed of white balance at the white balance processing section 105 by the white balance value corrected at the white balance correcting section 109; 113, a histogram detecting section for detecting luminance distribution histogram by color components of RGB by using image data read out from the image memory 112; 114, a display circuit for displaying on a monitor 115 image data stored at the image memory 112 and the histogram by the color components of RGB detected at the histogram detecting section 113; 116, a compression circuit for compressing image data read out from the image memory 112; 117, a recording/reading section for recording compressed image data to media 118 for example of a memory card and reading image data from the media 118; and 119, an expanding circuit for expanding the image data read out from the media 118.
Denoted by numeral 120 is CPU for controlling the respective component sections and 121 is a manipulation inputting section for effecting various inputs to CPU 120. Those which can be effected from the manipulation inputting section 121 for example includes: the switching of automatic, preset and one-touch white balance modes; and instruction for selection in the respective processing operation menus of the setting of white balance value, white balance correction, setting of one-touch white balance value, etc.
A description will now be given with respect to the white balance processing operation in a digital camera to which the sixth embodiment having such construction is applied. First, a fundamental operation of the white balance processing in this embodiment will be described in contrast to the conventional white balance processing. In the conventional setting of white balance values, as shown in FIG. 11, at the same time of displaying a through image on the monitor, a white balance mode menu such as “automatic”, “clear sky”, “cloudy sky”, “fluorescent lamp”, “incandescent lamp”, and “one-touch” is displayed on the screen displaying the through image. The user, while observing the through image on the monitor, selects and sets a white balance mode appearing to be suitable from the white balance mode menu.
In this conventional setting system, since judgment is to be made while observing the through image, a small screen on the monitor is hard to be seen and it is difficult to make the judgment. There are also disadvantages for example that, when located outdoors, the display screen is hard to be seen due to reflection on the monitor surface, and that, since the monitor itself is colored, a shift from actual color occurs.
In setting a white balance mode in the present embodiment, by contrast, at the same time of displaying the through image on the monitor, histograms (luminance distribution) by the respective color components of RGB of the through image are prepared and displayed on the monitor screen. The user, while watching the histogram display, is then allowed to set an optimum white balance value by objectively judging the respective color distributions of the colors of RGB. It is thereby possible to eliminate the disadvantages in the conventional white balance setting.
In particular, as shown in FIG. 12A, the histograms by color components of RGB acquired from the entire through image are displayed on the through image which is displayed on the monitor 115. Further, the luminance distribution (histogram) of each of the colors of RGB at a histogram target region 115 a as indicated by double rectangular mark at the center of the screen frame of the through image is computed and is displayed as a black region on the histogram of the entire screen. FIG. 12A shows histograms of the entire screen and luminance distributions of the histogram target region 115 a when “clear sky” is selected as the white balance mode. In this case, the peak of the luminance distribution of R of the target region 115 a is shifted toward the lower side and the peak of the luminance distribution of B is shifted toward the higher side. From this, it can be objectively judged that the color tone at the target region 115 a of the through image is bluish. Accordingly, if the color of the object in the histogram target region 115 a is white, it is seen that an unsuitable white balance value at a color temperature lower than actual color temperature is being set.
FIG. 12B, on the other hand, shows the histograms of the entire screen and the luminance distributions of the histogram target when “cloudy sky” is selected as the white balance mode. In this case, the peak of the luminance distribution of R of the target region is shifted toward the higher side and the peak of the luminance distribution of B is shifted toward the lower side. From this, it can be objectively judged that the color tone at the target region 115 a of the through image is reddish. Accordingly, if the color of the object in the histogram target region 115 a is white, it is seen that an unsuitable white balance value at a color temperature higher than actual color temperature is being set.
By contrast, FIG. 12C shows the histograms of the entire screen and the luminance distributions of the histogram target region when “automatic” is selected as the white balance mode. In this case, the peak of the luminance distribution of each color of the target region is concentrated to the same position. From this, it can be objectively checked that a setting of suitable white balance value is effected. This case has been shown as one in which a proper white balance value is set when “automatic” is selected as the white balance mode. If, however, the peak of luminance distribution of each color in the target region with respect to a white object is concentrated to the same position as shown in FIG. 12C when another white balance mode such as “fluorescent lamp” is selected, the white balance mode, “fluorescent lamp”, selected and set at that time becomes a proper white balance mode.
The white balance processing operation in the sixth embodiment will now be described. The white balance processing operations that can be effected by the user in this embodiment are generally divided into three categories of operations, i.e., the white balance value setting operation, the white balance value correcting operation, and the one-touch white balance value setting operation. First, the white balance value setting operation will be described by way of the flowchart shown in FIG. 13. When an instruction for setting white balance value is given by the manipulation inputting section 121 to effect the white balance value setting operation and a menu therefor is opened, a white balance value setting screen is first displayed on the monitor 115 (step S51). In this case, as shown in FIG. 14, a through image is displayed on the monitor 115; the white balance mode menu is displayed on the right side of the screen; and the respective histograms of the colors of RGB of the entire screen and the histogram target region of the through image detected at the histogram detecting section 113 are displayed on the left side of the screen.
A cross key manipulation by the user is then accepted (step S52). While the cross key is being manipulated, the user selects and sets the white balance mode in the order of “automatic” WB, “clear sky”, “cloudy sky”, “fluorescent lamp”, “incandescent lamp”, and “one-touch” (step S53). It should be noted that, if the cross key is not manipulated at step S52 for determining the cross key, the processing proceeds to step S54 for selecting and determining the automatic white balance to be described next, since the automatic white balance mode is set as a default.
If the automatic white balance is selected as the white balance mode (step S54), a white balance value detected at the white balance value detecting section 106 from the through image is outputted (step S55). If a preset white balance mode of “clear sky”, “cloudy sky”, “fluorescent lamp”, or “incandescent lamp” other than the automatic white balance is selected and set (step S56), a preset white balance value adjusted and stored at the preset white balance value storage section 107 at the time of shipping from factory is read out (step S57). If the one-touch white balance mode is selected and set, readout is obtained of the one-touch white balance value which has previously been acquired by the user through the one-touch white balance value setting operation and caused to be stored to the one-touch white balance value storage section 108 (step S58).
One of the above described automatic white balance value, preset white balance value, and one-touch white balance value selected by the setting of the respective white balance modes is inputted to the white balance correcting section 109 to effect a fine adjustment (to be described later in detail) where the white balance value selected and set as described above is corrected (step S59). The corrected white balance value is then used to render white balance processing at the white balance processing section 105 on the taken image data obtained from CCD imaging device 102 (step S60).
The image data processed of white balance is then stored to the image memory 112, and the stored image data is read out and displayed on the monitor 115 as a taken image (step S61). At the same time, histogram detection by color components of RGB of the entire screen and the histogram target region is effected at the histogram detecting section 113 with respect to the image data stored at the image memory 112. The obtained histograms by color components of RGB are then concurrently displayed on the taken image which is being displayed on the monitor 115 (step S62).
The above operation steps are repeated until the pressing of OK key on the menu screen by the user (step S63). When selection and setting of an optimum white balance value are confirmed based on the histograms displayed on the monitor 115, the OK key is pressed to end the setting operations of white balance value. The displaying of the white balance mode menu and the histograms on the monitor 115 is then eliminated to restore a normal through image display (step S64).
In the setting operation of white balance value, the white balance conditions can be specifically grasped in this manner while referring to the histograms by color components of RGB displayed on the white balance value setting screen. It is thereby possible to set an accurate white balance value.
The white balance correcting operation to be effected at the white balance correcting section 109 in this embodiment will now be described by way of the flowchart of FIG. 15. When the white balance correcting operation is designated by the user from the manipulation inputting section 121 and a menu therefor is opened to effect a fine adjustment of the white balance value, a white balance correcting screen is displayed on the monitor 115 (step S71). In this case, as shown in FIG. 16, a through image processed of white balance by the white balance value selected and set by the previously described white balance value setting operation shown in FIG. 13 is displayed. A white balance correcting menu consisting of a gain adjusting knob 115 b which can be moved in the range of blue to red is then displayed on the right side of the screen, and the histograms by color components of RGB of the entire screen and histogram target region of the through image detected at the histogram detecting section 113 are displayed on the left side of the screen.
In accordance with a cross key manipulation by the user (step S72), change and adjustment of the white balance correcting value are then effected (step S73). The user effects such change and adjustment of the white balance correcting value by manipulating the gain adjusting knob 115 b in an up and down direction while referring to the histograms by color components of RGB on the monitor display screen so as to adjust the gains of blue and red. In particular, when bluish tone is to be intensified, a correcting value for emphasizing the bluish tone is set by causing the gain adjusting knob 115 b to be slid up toward the blue side so as to up the blue gain and down the red gain. On the other hand, when reddish tone is to be emphasized, a correcting value for emphasizing the reddish tone is set by causing the gain adjusting knob 115 b to be slid down toward the red side so as to down the blue gain and up the red gain.
The white balance value (automatic, preset, one-touch white balance values) selected and set by the white balance value setting operation as preciously shown in FIG. 13 is then corrected at the white balance correcting section 109 by using the white balance correcting value thus set by the user (step S74). It should be noted that, if the cross key is not manipulated at the cross key determining step S72, the processing proceeds to the above described white balance correction step S74.
In the operations thereafter, the white balance correcting value obtained as described above is first used similarly to the white balance value setting operation as previously shown in FIG. 13 to render white balance processing at the white balance processing section 105 with respect to the taken image data obtained from CCD imaging device 102 (step S75). The image data processed of white balance is then stored to the image memory 112, and the stored image data is read out and displayed on the monitor 115 as a taken image (step S76). At the same time, histogram detection by the color components of RGB of the entire screen and histogram target region is performed at the histogram detecting section 113 with respect to the image data stored at the image memory 112. The obtained histograms by color components of RGB are then concurrently displayed on the taken image which is being displayed on the monitor 115 (step S77).
The above operation steps are repeated until the OK key is pressed on the menu screen by the user (step S78). When the setting of an optimum white balance correcting value is confirmed while looking at the histograms displayed on the monitor, the OK key is pressed to end the white balance value correcting operation (step S79).
In this manner, also in the setting operation of white balance correcting value, the white balance correcting menu (gain adjusting knob) is adjusted and set while referring to the histograms by color components of RGB that are displayed on the white balance correcting value setting screen. It is thereby possible to set an accurate white balance correcting value with making an objective judgment based on the histogram display.
The setting operation of one-touch white balance value will now be described by way of the flowchart of FIG. 17. An automatic white balance value or preset white balance value is the value automatically measured by the camera or adjusted and set at the time of the shipping of the camera from factory. In deriving the one-touch white balance value, by contrast, the user adjusts and sets the white balance value by taking an image of white object such as a piece of paper so as to render the taken image on the monitor display white by using the light source at the location of photography.
In particular, when the user designates the processing operation for setting one-touch white balance value and opens the setting menu in order to set the one-touch white balance value, a one-touch white balance value setting screen is displayed on the monitor 115 (step S81). In this case, as shown in FIG. 18, a through image obtained by taking an image of the white paper is displayed on the monitor 115. The histograms by color components of RGB of the entire through image frame and histogram target region 115 a are displayed on the left side of the screen, and one-touch setting menu 115 c, “SET→OK”, is displayed on the lower-right side of the screen.
If OK key is then pressed (step S82), the processing enters a setting operation of new one-touch white balance value so that a white balance value by which the taken image screen taking an image of the white paper displayed on the monitor 115 is rendered white is detected at the white balance detecting section 106 based on CCD image pickup signals (step S83). The detected white balance value is stored to the one-touch white balance value storage section 108 as the one-touch white balance value of the occasion (step S84). The one-touch white balance value stored at the one-touch white balance value storage section 108 is then read out to set a white balance correcting value at the white balance correcting section 109 by using the correcting value (gain value) set by the user (step S85).
If OK key is not pressed at the above described step S82 for determining the OK key, a previously stored one-touch white balance value is used (step S86), and a correction is made on the previously stored one-touch white balance value similarly by using a correcting value set by the user at the white balance correcting section 109. The one-touch white balance correcting value obtained as described is then used to effect white balance processing at the white balance processing section 105 on the taken image data obtained from CCD imaging device 102 (step S87). The image data processed of white balance is stored to the image memory 112, and the stored image data is read out to be displayed on the monitor 115 as a taken image (step S88). At the same time, histogram detection by the color components of RGB of the entire screen and histogram target region is effected at the histogram detecting section 113 with respect to the image data stored at the image memory 112. The obtained histograms by color components of RGB are concurrently displayed on the taken image which is displayed on the monitor 115 (step S89).
The above operation steps are repeated until an END key (the left side of a cross key for example) is pressed (step S90). When the setting of an optimum one-touch white balance value is confirmed based on the histograms displayed on the monitor 115, the END key is pressed to end the setting operation of one-touch white balance value (step S91). In this manner, also in the setting of one-touch white balance value, its suitability can be objectively checked while similarly referring to the histograms by color components of RGB when setting the white balance value so that the taken image frame of white paper displayed on the one-touch white balance value setting screen is rendered white.
In the above description of operations according to the sixth embodiment, a technique has been described of obtaining a suitable white balance value or white balance correcting value by using the histogram display by color components of RGB in the setting of a white balance value, setting of a white balance correcting value or setting of one-touch white balance value. The displaying of histogram, however, can also be used in taking an image in an ordinary manner. In the case of such ordinary image taking, the histograms by color components of RGB are not required, and it suffices as shown in FIG. 19 to display a histogram 115 d of luminance distribution. Such luminance distribution histogram can be used in adjusting exposure.
In the above description of the sixth embodiment, the histograms by color components have been shown as those detecting and displaying the histograms by the color components of three-primary colors of RGB. The histograms by color components to be displayed however are not limited to those of three-primary colors of RGB. For example, since G component in the three-primary colors has a lower contribution to the setting of white balance value, it can be omitted while detecting and displaying only the histograms (luminance distribution) of R, B components. Further it is also possible to detect and display the histograms of three color components of a complementary-color system of Cy (cyan), Mg (magenta), Ye (yellow). It is furthermore possible to formulate and display a histogram related to the hue components Cb, Cr.
Further, the above sixth embodiment has been shown as that in which the histograms are displayed of the entire screen and of the histogram target region 115 a set at the center of the screen of the white balance value setting screen or white balance correcting value setting screen. The histogram target region 115 a set as fixed to the center region of the screen, however, can be modified so as to be movable. For example, if the histogram target region 115 a is set in the blue sky portion in an upper part of the screen as shown in FIG. 20, the luminance distribution of the histogram target region 115 a is such that the luminance of blue is high and red and green are of low luminance whereby the vividness of the blue sky portion can be confirmed. It should be noted that the moving of the histogram target region 115 a can be effected for example by concurrently manipulating a histogram target displaying button and a cross key.
In the description of the above embodiments, the respective functions of the embodiments are achieved by operations of the respective sections in accordance with control of CPU. On the other hand, the functions of white balance processing and displaying as explained by the respective flow charts shown in the figures can also be achieved mostly by CPU under programs previously stored to an internally provided nonvolatile memory such as EEPROM (not shown) in the digital camera. In the case where CPU effects a part or whole of the processing of the above described embodiments according to such programs to achieve the above described functions of the respective embodiments by such processing, the programs themselves and the storage medium storing such programs constitute the present invention. It should be noted that such programs can also be supplied to an imaging apparatus such as digital camera as a recording medium or by the means of communication from an external source.
Further, while an example applied to digital camera has been described in the above embodiments, it is naturally also possible to apply the present invention to a camera section for example of mobile phone.
As has been described by way of the above embodiments, it is possible according to the first aspect of the invention to effect white balance processing of a freshly taken image by using white balance value used in the white balance processing of a past taken image so that a taken image having a similar color tone as the past taken image can be readily obtained. According to the second aspect, since the white balance processing of a freshly taken image can be effected by using a white balance value detected and set from a past taken image, i.e., AWB value, a color tone of image taken by AWB in the past can be readily reproduced. According to the third aspect, since, even at the time of AWB processing where the detection value setting means is selected, switching can be forcibly made to the used value setting means during a specific designated period, a white balance value in the white balance processing of a past taken image can be at any time used even in the AWB processing.
According to the fourth aspect, a white balance value used in the white balance processing of taken image displayed on a display means by a preview or rec-view manipulation is stored, it is possible to readily reuse the white balance value of a favorite color tone which has been checked on the display means. According to the fifth aspect, since a corrected preset white balance value used in white balance processing is stored as a white balance value used in the past, it is possible to readily recall the white balance value which has been set in preset white balance processing in the past. According to the sixth aspect, before the storing of a white balance value to be stored to a storage means, it is temporarily retained at a retaining means so that registration of predetermined white balance values to the storage means can be securely and readily effected.
According to the seventh aspect, since a plurality of white balance values are retained at a retaining means and are selectively registered to the storage means, registration of only the desired white balance values to the storage means can be readily effected. According to the eighth aspect, a white balance value used in recorded taken image can be readily reused. According to the ninth aspect, a suitable white balance value can be set corresponding to presence/absence of flash emission on the taken image. According to the tenth and eleventh aspects, it is possible to achieve a digital camera in which white balance processing of taken image can be readily effected in a favorite color tone. According to the twelfth aspect, since white balance processing of a freshly taken image is effected by using a white balance value used in the white balance processing of a past taken image, it is possible to achieve a white balance processing method by which a taken image having a color tone similar to the past taken image can be readily produced. According to the thirteenth aspect, since white balance processing of a freshly taken image is effected by using a white balance value obtained in AWB processing of a past taken image, it is possible to achieve a white balance processing method by which the color tone of taken image by AWB in the past can be readily recalled. According to the fourteenth aspect, the white balance processing according to the thirteenth aspect can be achieved by means of software.
According to the fifteenth aspect of the invention, a histogram processing by color components is effected on taken image processed of white balance and the obtained histograms by color components are displayed on a display means so that the actual condition of white balance can be readily grasped and an accurate white balance value can be readily adjusted and set. According to the sixteenth aspect, since histogram processing by color components is effected separately for the entire screen and for a specific regional portion, a histogram comparison by color components is readily possible of the entire portion and the specific regional portion which serves as a detecting portion. According to the seventeenth aspect, histogram related to the entire screen and histogram related to a specific regional portion are displayed in a manner capable of being compared by color components so that a comparison becomes even more easier of the histogram related to the entire screen and the histogram of the specific regional portion. According to the eighteenth aspect, histogram by color component is concurrently displayed when the screen for setting white balance is displayed, comparison between the white balance setting screen and the histogram by color components becomes easier. According to the nineteenth aspect, since histogram by color components and information related to the adjusting conditions of white balance are concurrently displayed, it is readily possible to effect a comparison between the actual conditions and adjusting conditions of white balance. According to the twentieth aspect, since histogram by color components and information indicating the types of white balance mode that can be selected are concurrently displayed, a white balance mode that can be chosen can be readily selected while looking at the histogram.
According to the twenty-first aspect, since histogram by color components and information related to ratio concerning a specific color component subjected to histogram processing are concurrently displayed, a setting by color components in white balance can be readily effected. According to the twenty-second aspect, histogram by color components and taken image are concurrently displayed so that the taken image and the histogram by color components can be compared to more readily judge for example the suitability of white balance. According to the twenty-third aspect, since a white balance detecting region is displayed on taken image which is displayed together with histogram by color components, it is readily possible to check the white balance detecting region. According to the twenty-fourth aspect, histogram processing is effected and displayed by three color components of RGB which are the most generally used color components, the actual condition of white balance can be even more readily grasped. According to the twenty-fifth aspect, it is possible to achieve a digital camera having an improved white balance performance because it is provided with the white balance processing apparatus constructed as the above. According to the twenty-sixth aspect, it is possible to achieve a white balance processing method by which, since histogram by color components is displayed together with a taken image, the taken image and the histogram by color components can be contrasted to execute white balance processing while readily making a judgment for example as to the suitability of white balance. According to the twenty-seventh aspect, the white balance processing according to the twenty-sixth aspect can be achieved by means of software.

Claims (11)

1. A white balance processing apparatus comprising:
white balance processing means for effecting white balance processing on an image to be taken;
color histogram processing means for effecting histogram processing by color components in accordance with said image to be taken processed of white balance by the white balance processing means; and
display means for displaying histograms by color components obtained by the color histogram processing means;
wherein said color histogram processing means effects histogram processing by color components by separating said image to be taken of an entire image frame and said image to be taken of a specific regional portion set within the image frame;
and wherein said display means displays by color components the histogram concerning said entire image frame and the histogram concerning the specific regional portion by said color histogram processing means so that they can be compared with each other.
2. The white balance processing apparatus according to claim 1 further comprising:
display control means for effecting control to display said histograms by color components on said display means when a setting screen for setting white balance is displayed on said display means.
3. The white balance processing apparatus according to claim 1, wherein said display means concurrently displays information concerning adjusting conditions of white balance of said white balance processing means.
4. The white balance processing apparatus according to claim 3, wherein said information concerning the adjusting conditions of white balance comprises information indicating types of mode of white balance that can be selected.
5. The white balance processing apparatus according to claim 3, wherein said information concerning the adjusting conditions of white balance comprises information concerning ratio about a specific color component processed of said histogram processing.
6. The white balance processing apparatus according to claim 1, wherein said color histogram processing means effects histogram processing by three color components of RGB.
7. The white balance processing apparatus according to claim 1, wherein said display means in addition concurrently displays said image to be taken.
8. The white balance processing apparatus according to claim 7, wherein said display means additionally displays a white balance detecting region on said image to be taken.
9. A white balance processing method for an imaging apparatus having an image memory and a processor comprising the steps of:
effecting white balance processing on an image to be taken;
effecting histogram processing by color components in accordance with said image to be taken processed of said white balance processing; and
displaying on a display histograms by color components obtained by said histogram processing together with said image to be taken;
wherein the step of effecting histogram processing effects histogram processing by color components by separating said image to be taken of an entire image frame and said image to be taken of a specific regional portion set within the image frame;
and wherein the step of displaying histograms displays by color components the histogram concerning said entire image frame and the histogram concerning the specific regional portion by said color histogram processing means so that they can be compared with each other.
10. A computer-readable medium encoded with computer-executable white balance processing instructions of:
effecting white balance processing with respect to an image to be taken;
effecting histogram processing by color components in accordance with said image to be taken processed of said white balance processing; and
displaying histograms by color components obtained by said histogram processing together with said image to be taken;
wherein the instruction of effecting histogram processing effects histogram processing by color components by separating said image to be taken of an entire image frame and said image to be taken of a specific regional portion set within the image frame;
and wherein the instruction of displaying histograms displays by color components the histogram concerning said entire image frame and the histogram concerning the specific regional portion by said color histogram processing means so that they can be compared with each other.
11. A digital camera, including a white balance processing apparatus, the apparatus comprising:
white balance processing means for effecting white balance processing on an image to be taken;
color histogram processing means for effecting histogram processing by color components in accordance with said image to be taken processed of white balance by the white balance processing means; and
display means for displaying histograms by color components obtained by the color histogram processing means;
wherein said color histogram processing means effects histogram processing by color components by separating said image to be taken of an entire image frame and said image to be taken of a specific regional portion set within the image frame;
and wherein said display means displays by color components the histogram concerning said entire image frame and the histogram concerning the specific regional portion by said color histogram processing means so that they can be compared with each other.
US12/406,514 2002-07-15 2009-03-18 White balance processing apparatus and processing method thereof Expired - Fee Related US8199372B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/406,514 US8199372B2 (en) 2002-07-15 2009-03-18 White balance processing apparatus and processing method thereof

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP2002-205013 2002-07-15
JP2002205013A JP2004048523A (en) 2002-07-15 2002-07-15 Device and method for processing white balance
JP2002-334852 2002-11-19
JP2002334852A JP4090851B2 (en) 2002-11-19 2002-11-19 White balance processing apparatus, white balance processing method, and digital camera
US10/620,118 US7525697B2 (en) 2002-07-15 2003-07-15 White balance processing apparatus and processing method thereof
US12/406,514 US8199372B2 (en) 2002-07-15 2009-03-18 White balance processing apparatus and processing method thereof

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/620,118 Division US7525697B2 (en) 2002-07-15 2003-07-15 White balance processing apparatus and processing method thereof

Publications (2)

Publication Number Publication Date
US20090180002A1 US20090180002A1 (en) 2009-07-16
US8199372B2 true US8199372B2 (en) 2012-06-12

Family

ID=30772202

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/620,118 Expired - Fee Related US7525697B2 (en) 2002-07-15 2003-07-15 White balance processing apparatus and processing method thereof
US12/406,514 Expired - Fee Related US8199372B2 (en) 2002-07-15 2009-03-18 White balance processing apparatus and processing method thereof

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/620,118 Expired - Fee Related US7525697B2 (en) 2002-07-15 2003-07-15 White balance processing apparatus and processing method thereof

Country Status (1)

Country Link
US (2) US7525697B2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140192223A1 (en) * 2013-01-08 2014-07-10 Hitachi, Ltd. Imaging device, imaging system, and imaging method
CN113228614A (en) * 2018-12-25 2021-08-06 索尼集团公司 Imaging apparatus, control method, and program

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7525697B2 (en) * 2002-07-15 2009-04-28 Olympus Corporation White balance processing apparatus and processing method thereof
JP4584544B2 (en) * 2003-04-11 2010-11-24 富士フイルム株式会社 Image reproducing device and solid-state imaging device
JP4378141B2 (en) * 2003-09-29 2009-12-02 キヤノン株式会社 Image pickup apparatus and image pickup apparatus control method
JP4467988B2 (en) * 2004-01-08 2010-05-26 キヤノン株式会社 IMAGING DEVICE, IMAGING METHOD AND PROGRAM FOR IMAGING DEVICE
KR101014662B1 (en) * 2004-01-14 2011-02-16 삼성전자주식회사 Method for setting and adapting preset white balance of digital photographing apparatus
US7636473B2 (en) * 2004-03-12 2009-12-22 Seiko Epson Corporation Image color adjustment
US7570881B2 (en) * 2006-02-21 2009-08-04 Nokia Corporation Color balanced camera with a flash light unit
JP4914651B2 (en) * 2006-06-12 2012-04-11 オリンパスイメージング株式会社 Electronic imaging apparatus and electronic imaging method
KR100797417B1 (en) * 2006-07-11 2008-01-23 삼성전자주식회사 Device and method for adjusinng white balance
JP4781296B2 (en) * 2007-02-20 2011-09-28 キヤノン株式会社 IMAGING DEVICE, ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM
JP5262378B2 (en) * 2007-08-09 2013-08-14 ペンタックスリコーイメージング株式会社 Imaging device
JP5262377B2 (en) * 2007-08-09 2013-08-14 ペンタックスリコーイメージング株式会社 Imaging device
JP4941758B2 (en) * 2007-09-11 2012-05-30 ソニー株式会社 Imaging device
CN101540837A (en) * 2008-03-17 2009-09-23 鸿富锦精密工业(深圳)有限公司 Image pick-up device and image color adjusting method thereof
JP5366584B2 (en) * 2009-02-16 2013-12-11 キヤノン株式会社 Imaging apparatus, image processing method, and program
KR101595254B1 (en) * 2009-02-20 2016-02-18 삼성전자주식회사 Method for controlling white balance of an image medium of recording the method and apparatus applying the method
US8547450B2 (en) * 2010-02-22 2013-10-01 Texas Instruments Incorporated Methods and systems for automatic white balance
US20110285745A1 (en) * 2011-05-03 2011-11-24 Texas Instruments Incorporated Method and apparatus for touch screen assisted white balance
US8934050B2 (en) 2010-05-27 2015-01-13 Canon Kabushiki Kaisha User interface and method for exposure adjustment in an image capturing device
KR20110135720A (en) * 2010-06-11 2011-12-19 삼성전자주식회사 Apparatus and method for generating lens shading compensation table according to photographing environment
WO2011163438A1 (en) * 2010-06-25 2011-12-29 Thomson Licensing Graphical user interface for tone mapping high dynamic range video
US8625021B2 (en) * 2010-08-30 2014-01-07 Canon Kabushiki Kaisha Image capture with region-based adjustment of imaging properties
US20120154617A1 (en) * 2010-12-20 2012-06-21 Samsung Electronics Co., Ltd. Image capturing device
JP5693271B2 (en) * 2011-02-03 2015-04-01 キヤノン株式会社 Image processing apparatus and method
JP6041561B2 (en) * 2012-07-19 2016-12-07 キヤノン株式会社 Image processing apparatus and control method thereof
TWI504253B (en) * 2013-01-10 2015-10-11 Realtek Semiconductor Corp White balance adjusting method with scene detection and device thereof
EP3043557A4 (en) * 2013-11-08 2017-04-19 Nubia Technology Co., Ltd. White balance adjustment method and device
CN106101680B (en) * 2015-05-06 2018-12-25 小米科技有限责任公司 Acquisition parameters setting method and device
KR20190040360A (en) * 2016-09-23 2019-04-17 생-고뱅 세라믹스 앤드 플라스틱스, 인코포레이티드 Chemical mechanical planarization slurry and method of forming the same
JP7066552B2 (en) * 2018-06-29 2022-05-13 キヤノン株式会社 Imaging control device, control method of imaging control device, program, storage medium
JP2020108057A (en) * 2018-12-28 2020-07-09 ソニー株式会社 Imaging apparatus, imaging method, and program
US11800056B2 (en) 2021-02-11 2023-10-24 Logitech Europe S.A. Smart webcam system
US11800048B2 (en) 2021-02-24 2023-10-24 Logitech Europe S.A. Image generating system with background replacement or modification capabilities
JP2022135677A (en) * 2021-03-05 2022-09-15 キヤノン株式会社 Image processing apparatus, method for controlling the same, and program

Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4731671A (en) * 1985-05-06 1988-03-15 Eastman Kodak Company Contrast adjustment in digital image processing method employing histogram normalization
US5194945A (en) * 1987-08-11 1993-03-16 Canon Kabushiki Kaisha Color image processing apparatus
US5917556A (en) * 1997-03-19 1999-06-29 Eastman Kodak Company Split white balance processing of a color image
US6285398B1 (en) * 1997-11-17 2001-09-04 Sony Corporation Charge-coupled device video camera with raw data format output and software implemented camera signal processing
US20030035156A1 (en) * 2001-08-15 2003-02-20 Sony Corporation System and method for efficiently performing a white balance operation
US6526167B1 (en) * 1998-05-26 2003-02-25 Sony Corporation Image processing apparatus and method and provision medium
US20030103671A1 (en) * 1998-05-06 2003-06-05 Takahiro Matsuura Image processing apparatus and method
US6594388B1 (en) * 2000-05-25 2003-07-15 Eastman Kodak Company Color image reproduction of scenes with preferential color mapping and scene-dependent tone scaling
US20030176768A1 (en) * 2000-07-21 2003-09-18 Kazuhiro Gono Endoscope apparatus
US6636635B2 (en) * 1995-11-01 2003-10-21 Canon Kabushiki Kaisha Object extraction method, and image sensing apparatus using the method
US6664973B1 (en) * 1996-04-28 2003-12-16 Fujitsu Limited Image processing apparatus, method for processing and image and computer-readable recording medium for causing a computer to process images
US6711287B1 (en) * 1998-12-21 2004-03-23 Ricoh Company, Ltd. Image-feature extraction method and computer-readable record medium with a program for making a computer execute steps of the method recorded therein
US6859552B2 (en) * 2000-11-07 2005-02-22 Minolta Co., Ltd. Image retrieving apparatus
US20050174590A1 (en) * 2004-02-10 2005-08-11 Fuji Photo Film Co., Ltd. Image correction method, image correction apparatus, and image correction program
US7068328B1 (en) * 1999-08-17 2006-06-27 Fuji Photo Film Co., Ltd. Method, apparatus and recording medium for image processing
US7283667B2 (en) * 2002-02-13 2007-10-16 Nikon Corporation Image processing unit, image processing method, and image processing program
US7512329B2 (en) * 2004-01-30 2009-03-31 Canon Kabushiki Kaisha Image pickup method, image pickup apparatus, program for implementing the method, and storage medium storing the program
US7525697B2 (en) * 2002-07-15 2009-04-28 Olympus Corporation White balance processing apparatus and processing method thereof
US7756331B2 (en) * 2004-07-12 2010-07-13 Canon Kabushiki Kaisha Image processing apparatus and method for displaying images and corresponding histograms
US7826662B2 (en) * 2005-10-26 2010-11-02 Casio Computer Co., Ltd. Digital camera provided with gradation correction function
US7835639B2 (en) * 2005-12-09 2010-11-16 Casio Computer Co., Ltd. Imaging apparatus with strobe consecutive shooting mode
US7869064B2 (en) * 2006-02-07 2011-01-11 Seiko Epson Corporation Printing device
US7962007B2 (en) * 2000-04-27 2011-06-14 Sony Corporation Signal processing device and signal processing method
US8089155B2 (en) * 1998-12-21 2012-01-03 Megica Corporation High performance system-on-chip discrete components using post passivation process

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02298194A (en) * 1988-10-03 1990-12-10 Hitachi Ltd Color video printer device
US5585942A (en) * 1991-06-20 1996-12-17 Canon Kabushiki Kaisha Image pickup apparatus
US5479206A (en) * 1992-02-04 1995-12-26 Fuji Photo Film Co., Ltd. Imaging system, electronic camera, computer system for controlling said electronic camera, and methods of controlling same
US6046827A (en) * 1995-05-26 2000-04-04 Minolta Co., Ltd. Film image reading system
US5821993A (en) * 1996-01-25 1998-10-13 Medar, Inc. Method and system for automatically calibrating a color camera in a machine vision system
JPH10304386A (en) 1997-04-30 1998-11-13 Canon Inc Image pickup device
JPH11355784A (en) 1998-06-09 1999-12-24 Olympus Optical Co Ltd Electronic camera
US6628830B1 (en) * 1998-06-24 2003-09-30 Canon Kabushiki Kaisha Image processing method and apparatus and storage medium
JP2000299814A (en) 1999-04-13 2000-10-24 Seiko Epson Corp Digital camera
US6906744B1 (en) * 1999-09-28 2005-06-14 Nikon Corporation Electronic camera
US6958834B1 (en) * 2000-07-11 2005-10-25 Kabushiki Kaisha Toshiba Image reading apparatus
JP2002185972A (en) 2000-12-18 2002-06-28 Fuji Photo Film Co Ltd Image pickup device
JP3877544B2 (en) * 2001-05-11 2007-02-07 三洋電機株式会社 Digital camera
JP4826028B2 (en) * 2001-05-24 2011-11-30 株式会社ニコン Electronic camera
US7158174B2 (en) * 2002-04-04 2007-01-02 Eastman Kodak Company Method for automatic white balance of digital images
US7433099B2 (en) * 2002-05-01 2008-10-07 Canon Kabushiki Kaisha Image sensing apparatus, image sensing method, program, and storage medium
US7414758B2 (en) * 2002-08-01 2008-08-19 Eastman Kodak Company Four-way calibration of a digital camera using patch information acquired from a scene

Patent Citations (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4731671A (en) * 1985-05-06 1988-03-15 Eastman Kodak Company Contrast adjustment in digital image processing method employing histogram normalization
US5194945A (en) * 1987-08-11 1993-03-16 Canon Kabushiki Kaisha Color image processing apparatus
US6636635B2 (en) * 1995-11-01 2003-10-21 Canon Kabushiki Kaisha Object extraction method, and image sensing apparatus using the method
US6664973B1 (en) * 1996-04-28 2003-12-16 Fujitsu Limited Image processing apparatus, method for processing and image and computer-readable recording medium for causing a computer to process images
US5917556A (en) * 1997-03-19 1999-06-29 Eastman Kodak Company Split white balance processing of a color image
US6285398B1 (en) * 1997-11-17 2001-09-04 Sony Corporation Charge-coupled device video camera with raw data format output and software implemented camera signal processing
US20030103671A1 (en) * 1998-05-06 2003-06-05 Takahiro Matsuura Image processing apparatus and method
US6526167B1 (en) * 1998-05-26 2003-02-25 Sony Corporation Image processing apparatus and method and provision medium
US8089155B2 (en) * 1998-12-21 2012-01-03 Megica Corporation High performance system-on-chip discrete components using post passivation process
US6711287B1 (en) * 1998-12-21 2004-03-23 Ricoh Company, Ltd. Image-feature extraction method and computer-readable record medium with a program for making a computer execute steps of the method recorded therein
US7468759B2 (en) * 1999-08-17 2008-12-23 Fujifilm Corporation Method, apparatus and recording medium for image processing
US7068328B1 (en) * 1999-08-17 2006-06-27 Fuji Photo Film Co., Ltd. Method, apparatus and recording medium for image processing
US7962007B2 (en) * 2000-04-27 2011-06-14 Sony Corporation Signal processing device and signal processing method
US6594388B1 (en) * 2000-05-25 2003-07-15 Eastman Kodak Company Color image reproduction of scenes with preferential color mapping and scene-dependent tone scaling
US20030176768A1 (en) * 2000-07-21 2003-09-18 Kazuhiro Gono Endoscope apparatus
US7892169B2 (en) * 2000-07-21 2011-02-22 Olympus Corporation Endoscope apparatus
US6859552B2 (en) * 2000-11-07 2005-02-22 Minolta Co., Ltd. Image retrieving apparatus
US20030035156A1 (en) * 2001-08-15 2003-02-20 Sony Corporation System and method for efficiently performing a white balance operation
US7283667B2 (en) * 2002-02-13 2007-10-16 Nikon Corporation Image processing unit, image processing method, and image processing program
US7525697B2 (en) * 2002-07-15 2009-04-28 Olympus Corporation White balance processing apparatus and processing method thereof
US7512329B2 (en) * 2004-01-30 2009-03-31 Canon Kabushiki Kaisha Image pickup method, image pickup apparatus, program for implementing the method, and storage medium storing the program
US20050174590A1 (en) * 2004-02-10 2005-08-11 Fuji Photo Film Co., Ltd. Image correction method, image correction apparatus, and image correction program
US7756331B2 (en) * 2004-07-12 2010-07-13 Canon Kabushiki Kaisha Image processing apparatus and method for displaying images and corresponding histograms
US7826662B2 (en) * 2005-10-26 2010-11-02 Casio Computer Co., Ltd. Digital camera provided with gradation correction function
US7835639B2 (en) * 2005-12-09 2010-11-16 Casio Computer Co., Ltd. Imaging apparatus with strobe consecutive shooting mode
US7869064B2 (en) * 2006-02-07 2011-01-11 Seiko Epson Corporation Printing device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140192223A1 (en) * 2013-01-08 2014-07-10 Hitachi, Ltd. Imaging device, imaging system, and imaging method
US9105105B2 (en) * 2013-01-08 2015-08-11 Hitachi, Ltd. Imaging device, imaging system, and imaging method utilizing white balance correction
CN113228614A (en) * 2018-12-25 2021-08-06 索尼集团公司 Imaging apparatus, control method, and program
CN113228614B (en) * 2018-12-25 2023-06-20 索尼集团公司 Imaging apparatus, control method, and program

Also Published As

Publication number Publication date
US7525697B2 (en) 2009-04-28
US20040017594A1 (en) 2004-01-29
US20090180002A1 (en) 2009-07-16

Similar Documents

Publication Publication Date Title
US8199372B2 (en) White balance processing apparatus and processing method thereof
US7417671B2 (en) Image processing system capable of providing color correction
US7057650B1 (en) Image sensing apparatus and method for synthesizing a composite image
US8830349B2 (en) Image capturing apparatus, image capturing method, and program
US7626615B2 (en) Printer system and image processing system having image correcting function
US7522191B2 (en) Optical image capturing device
JP4090851B2 (en) White balance processing apparatus, white balance processing method, and digital camera
US8558912B2 (en) Image pickup apparatus and control method thereof
US8164648B2 (en) Image processing apparatus and image processing apparatus control method
US20060139669A1 (en) Image pickup apparatus and control method of the apparatus
US20130057726A1 (en) Image processing apparatus and image processing method
US20040196383A1 (en) Image pickup device, white balance processing method, program, and storage medium
JP5211926B2 (en) Digital camera, image processing apparatus, and image processing program
US20030108337A1 (en) Electronic instrument
JP3821729B2 (en) Digital camera
US20030081954A1 (en) Digital camera
JP4178788B2 (en) Color chart, image data generation device, profile creation method using color chart, and recording medium recording profile creation program
JP3706708B2 (en) Image forming system and image forming method
JP2005064630A (en) Image pickup apparatus
JP2002185972A (en) Image pickup device
JP4850966B2 (en) Image processing apparatus, image processing apparatus control method, computer program, and storage medium
JPH11187412A (en) Image-pickup device

Legal Events

Date Code Title Description
AS Assignment

Owner name: OLYMPUS OPTICAL CO., LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SUEKANE, HISASHI;REEL/FRAME:022421/0156

Effective date: 20030626

Owner name: OLYMPUS CORPORATION, JAPAN

Free format text: CHANGE OF NAME;ASSIGNOR:OLYMPUS OPTICAL CO., LTD.;REEL/FRAME:022421/0170

Effective date: 20031001

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

AS Assignment

Owner name: OLYMPUS CORPORATION, JAPAN

Free format text: CHANGE OF ADDRESS;ASSIGNOR:OLYMPUS CORPORATION;REEL/FRAME:039344/0502

Effective date: 20160401

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20200612