WO2014118167A1 - Procédé d'équilibrage des blancs pour présentation d'images et système de caméra pour véhicule à moteur - Google Patents

Procédé d'équilibrage des blancs pour présentation d'images et système de caméra pour véhicule à moteur Download PDF

Info

Publication number
WO2014118167A1
WO2014118167A1 PCT/EP2014/051614 EP2014051614W WO2014118167A1 WO 2014118167 A1 WO2014118167 A1 WO 2014118167A1 EP 2014051614 W EP2014051614 W EP 2014051614W WO 2014118167 A1 WO2014118167 A1 WO 2014118167A1
Authority
WO
WIPO (PCT)
Prior art keywords
color space
pixels
color
values
space area
Prior art date
Application number
PCT/EP2014/051614
Other languages
English (en)
Inventor
Vladimir Zlokolica
Brian Michael Thomas DEEGAN
Patrick Eoghan Denny
Original Assignee
Connaught Electronics Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Connaught Electronics Ltd. filed Critical Connaught Electronics Ltd.
Publication of WO2014118167A1 publication Critical patent/WO2014118167A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/88—Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control

Definitions

  • the invention relates to a method for white balance of an image presentation, which is displayed on a display device of a motor vehicle, wherein an image of an environmental region of the motor vehicle is provided by means of at least one camera of the motor vehicle and the image presentation for display on the display device is generated from at least one region of the image. Pixels of the image are mapped into a predetermined color space, and herein color values of the pixels in this color space are determined. A subset of the pixels is selected according to a preset selection criterion, and a color temperature of the image is determined based on the color values of the selected subset of the pixels. The white balance is then performed depending on the color temperature.
  • the invention relates to a camera system for a motor vehicle, which is formed for performing such a method.
  • Methods for performing the white balance of an image are already prior art.
  • a plurality of cameras to a motor vehicle, which capture the environment around the motor vehicle.
  • an image presentation can be displayed on a display of the motor vehicle, which is based on the images of the cameras.
  • the so-called "bird eye view” can be provided from the images of all of the cameras, i.e. a top view presentation showing the motor vehicle and its environment from a bird's eye view.
  • This top view presentation is generated from respective partial regions of the images of all of the cameras, wherein that partial region of the image is respectively used, which images the respective
  • the invention is not restricted to the provision of such a top view as the image
  • image presentations can also be generated from each one partial region of the images.
  • three-dimensional views are exemplarily mentioned, which can include a projection to a concave surface, such as for example to the surface of a hemisphere, a paraboloid, a hyperboloid or a similar concave surface.
  • the generation of a top view from images of several cameras is for example known from the document US 201 1/0156887 A1 .
  • the document EP 2 012 271 A2 too describes a method serving for providing a top view presentation from images of several cameras. That an image presentation for display on a display can be generated from images of several cameras, is additionally known from the document US 7 139 412 B2.
  • it is proposed to compensate for the differences in the color values of the images by for example averaging the color values of the images.
  • a method for performing the white balance in an image presentation obtained from several images is furthermore known from the document WO 201 1 /082716 A1 .
  • Color correcting methods i.e. white balance methods, generally serve for correcting color casts caused in the images by different lighting sources located in the imaged
  • the known methods for the automatic white balance usually involve two different steps: first, the color temperature of the image is determined, and then the color correction is performed based on the determined color temperature.
  • very different approaches are known from the prior art, how the color temperature and thus the color casts in the images can be determined.
  • One of the known approaches entails using exclusively a subset of pixels for determining the color temperature of the image, the color values of which (for example in the UV color space) satisfy a predetermined selection criterion.
  • a predetermined selection criterion For example in the UV color space
  • In calculating the color temperature exclusively those pixels can be taken into account, which are in the UV color space around the origin of this color space and thus around the zero value. In this color space area, namely, grey pixels are expected, which present a reliable basis for the calculation of the color temperature.
  • this object is solved by a method as well as by a camera system having the features according to the respective independent claims.
  • a method according to the invention serves for white balance of an image presentation, which is displayed on a display device of a motor vehicle, wherein an image of an environmental region of the motor vehicle is provided by means of at least one camera of the motor vehicle and the image presentation is generated from at least one region of the image. Pixels of the image are mapped into a predetermined color space by determining color values of the pixels in the color space. A subset of the pixels is selected according to a preset selection criterion, and a color temperature of the image is then determined based on the color values exclusively of the selected subset of the pixels. The white balance is performed depending on the color temperature. In the preset color space, a main color space area is defined around an origin, i.e. especially the zero point, of the color space.
  • a further color space area different from this main color space area is also defined. It is checked if a preset minimum number of the pixels required for the determination of the color temperature is within the main color space area. If this criterion is satisfied, those pixels are selected for determining the color temperature according to the selection criterion, which are within the main color space area.
  • the white balance is performed independently of the color temperature.
  • main color space area which is defined around the origin of the color space and in which usually grey pixels are expected in an image without color casts
  • at least one additional color space area is defined, into which optionally the searched grey pixels can have been shifted due to color casts in the image.
  • the pixels are used for determining the color temperature, which are in the further color space area.
  • the method according to the invention therefore "searches" for the grey pixels, which normally are in the main color space area around the origin of the color space, but which can have been shifted with respect to the origin of the color space by color casts in the image. In this manner, the color temperature of the image can always be determined with great accuracy and in reliable manner such that the white balance too can be effectively performed and an image presentation can be displayed on the display device, which realistically images the environment of the motor vehicle.
  • the pixels are mapped into a UV color space or a color space isometric to the UV space (e.g. HSV space) and the chrominance values of the pixels are determined as the color values, i.e. the U values as well as the V values. Then, an average of U values of the selected pixels and/or an average of V values of the selected pixels can be determined as the color temperature.
  • This can be configured such that the color temperature of the image is represented by the average of U values of the selected pixels on the one hand and by the average of V values of the selected pixels on the other hand.
  • this embodiment has the advantage that those pixels can be located in the UV color space without much effort, which represents grey pixels.
  • a gain factor of at least one color channel of the camera is adjusted depending on the determined color temperature.
  • the gain factor of the red color channel and/or the gain factor of the blue color channel of the camera are preferably adjusted.
  • exclusively the gain factor of the red color channel and/or the gain factor of the blue color channel are adjusted depending on the color temperature, while the green color channel of the camera is not corrected.
  • the red color channel of the camera is preferably corrected depending on the V values of the selected pixels, while the blue color channel of the camera is preferably adapted depending on the U values of the selected pixels.
  • the camera is a video camera, by means of which a temporal sequence of individual images (so-called frames) is provided.
  • the white balance can be performed by iterative adaptation of the gain factor of at least one color channel across the frames depending on the color temperature of the respectively preceding image.
  • regulation of the color temperature across the frames is effected in a closed control loop considering the current color temperature.
  • the adjustment of the gain factor of the at least one color channel of the camera can for example be configured such that the gain factor of the respective color channel, which is usually adjusted by the camera itself, is corrected with an adaptation factor, which is for example added to the gain factor.
  • a control device separate from the camera can iteratively increase or decrease this adaptation factor depending on whether the current gain factor is too high or too low.
  • the camera can include a register, into which a variation value (for example +1 or -1 or 0) can be input to each image, by which the adaptation factor is to be varied.
  • the current gain factor thus results as a sum of the previous gain factor on the one hand and the adaptation factor on the other hand, which in turn can be increased or decreased across the frames.
  • the iterative adaptation of the gain factor has the advantage that erratic variations of the coloring of the displayed image presentation are prevented and the coloring is very smoothly and uniformly changed.
  • the white balance can be controlled by means of a control device separate from the camera, by means of which the image presentation for display on the display device is generated.
  • This control device can also receive images of several cameras and provide the image presentation from the images of several cameras.
  • Control signals can be communicated from the control device to the camera, due to which the white balance is performed within the camera, in particular the mentioned gain factor of at least one color channel is adjusted.
  • This control can be configured such that the current variation value (+1 or -1 or 0) is communicated from the control device to the camera, by which the mentioned adaptation factor of the respective color channel gain factor is to be altered.
  • a separate control device usually has a considerably greater computing power than the camera itself such that the color temperature of the image can be very fast determined with highest accuracy.
  • the camera itself for its part also can have an additional white balance algorithm, which can for example be based on the so-called "grey world assumption".
  • This hypothesis states that the averages of all of the color channels are to result in a grey value on average.
  • the red, green and blue color components can be influenced within the camera such that the color averages of all of the three color channels are identical.
  • a monochromatic object can be located in the imaged environment, which can influence the color averages and thus the white balance algorithm within the camera.
  • the gain factors of the color channels are additionally influenced or adapted by the external control device, which determines the color temperature of the image based on grey pixels and is able to influence the internal white balance of the camera.
  • an area is defined as the main color space area, which exclusively includes pixels, the chrominance values of which satisfy the following condition: wherein U and V denote the chrominance values of a pixel and T1 denotes a first limit value.
  • the main color space area includes pixels, the chrominance values of which are limited to the top. Namely, grey pixels can usually be expected within this area.
  • the above condition can also be configured as follows: -T1 ⁇ U ⁇ T1 and -T1 ⁇ V ⁇ T1.
  • This simplified condition implies that the main color space area only includes pixels, the chrominance values of which are within a square defined around the origin of the color space.
  • the main color space area can be restricted such that it includes exclusively pixels, the chrominance values of which satisfy the following condition:
  • T2 denotes a second limit value, which can be a relatively low positive value or can also be set to zero in the special case. If T2 is equal to zero, thus, an area is defined as the main color space area, in which the chrominance values of a pixel have opposite signs. This means that the U value of a pixel has a sign opposite to its V value. Thus, the main color space area is exclusively in the second and the fourth quadrant of the color space, but not in the first and the third one.
  • This embodiment is based on the realization that the pixels, which are in the first or the third quadrant of the color space, are associated with colored objects (for example monochromatic objects) with very high likelihood and therefore are uninteresting to the determination of the color temperature.
  • the pixels are not contained with high likelihood, which would correspond to grey pixels shifted by a color cast, which are searched for determining the color temperature.
  • the at least one further color space area can exclusively be within a quadrant of the color space.
  • This further color space area can for example be bounded by axes of the color space on one hand and additionally by a preset limit function on the other hand.
  • grey pixels can be located, which possibly can have been shifted in the color space by color casts in the image.
  • the mentioned limit function can for example be configured such that the further color space area is bounded by the axes of the color space on the one hand and by a straight line on the other hand, which intersects the two axes.
  • the color space area is a triangular area.
  • the limit function can also be defined by two straight lines, one of which extends perpendicularly to the U axis and the other of which extends perpendicularly to the V axis of the color space.
  • the further color space area is a rectangular area.
  • the maximum value can be respectively determined from magnitudes of all of the color values (in particular of all of the chrominance values) of the respective color space area. If the number of the pixels located within the main color space area is less than the preset minimum number, thus, depending on a comparison of the maximum values of the further color space areas, it can be determined, which one of the further color space areas is selected, the pixels of which are taken as a basis for determining the color temperature.
  • that color space area is selected, the maximum color value of which is less than the maximum color value of the other color space area.
  • This embodiment is based on the realization that colored, for example monochromatic objects usually cause higher color values, while the grey pixels influenced by color casts usually have lower color values. For determining the color temperature, thus, that quadrant is more reliable, which has relatively low color values. In contrast, if high color values are present, thus, they rather indicate a monochromatic object such that the pixels of this quadrant cannot be used for determining the color temperature.
  • the respectively optimum color space area can be selected, the pixels of which are used for determining the color temperature.
  • the preset minimum number of pixels is within the main color space area, but a period of time, for which the color temperature is outside of a preset range of set values, exceeds a preset threshold, and/or the color temperature diverges from the preset range of set values, it can be provided that the main color space area is no longer selected for determining the color temperature, but the second or the fourth further color space area. Namely, it can occur that although the required minimum number of pixels is available within the main color space area, nevertheless the color temperature cannot be regulated to the range of set values, because for example the grey pixels have been shifted from the origin of the color space into one of the quadrants due to a relatively intense color cast. This can be accordingly recognized and the determination of the color temperature can be performed based on the second or the fourth color space area.
  • a counter can be defined, by which the number of iterations (number of frames) is counted, in which the color temperature is outside of a preset range of set values and thus cannot converge. If the counter exceeds a preset counter limit value, the second or the fourth further color space area can be selected instead of the main color space area and the pixels of this selected color space area can be taken as a basis for the
  • a dummy parameter is defined, which is equated to the mentioned adaptation factor, but - unlike the adaptation factor - is not limited and thus can be artificially iteratively increased or reduced even beyond a limit value of the adaptation factor. If this dummy parameter reaches a preset parameter limit value, thus, the second or the fourth further color space area can be selected instead of the main color space area and the pixels of this selected color space area can be taken as a basis for determining the color temperature.
  • the selection of one of the color space areas for the determination of the color temperature is preferably omitted and the white balance is performed independently of the color temperature.
  • an offset value can for example be applied to the gain factor of at least one color channel of the camera in order to counteract the internal white balance of the camera.
  • the image presentation for display on the display device is generated from a partial region of the image, and exclusively pixels of the displayed partial region are taken as a basis for the determination of the color temperature.
  • the determination of the color temperature thus, exclusively those pixels are considered, which are displayed on the display device and thus contribute to the generation of the image presentation.
  • color casts in the image presentation can be prevented, which otherwise could be caused by high color values of pixels, which are outside of the used partial region of the image.
  • At least two cameras of the motor vehicle each provide an image of an environmental region of the motor vehicle and the image presentation for display on the display device is generated from respective partial regions of the images. Then, the white balance of the respective partial regions can be individually performed for each camera.
  • the partial regions of the images overlap each other in an overlap area.
  • the luminance values of the partial region in the overlap area can be acquired.
  • the size of the main color space area can then be determined depending on the luminance values in the overlap area, in particular depending on an average of the luminance values in the overlap area. In this manner, the size of the main color space area is adjusted depending on the brightness of the overlap area and can therefore respectively be optimally determined for different brightness levels.
  • the main color space area has a fixed, preset size, which is not altered in the operation.
  • a camera system according to the invention for a motor vehicle includes at least one camera for providing images of an environmental region of the motor vehicle as well as an electronic control device formed for performing a method according to the invention.
  • the control device can be a component separate from the camera or it can alternatively be integrated in the camera and thus be an internal control unit of the camera.
  • a motor vehicle according to the invention in particular a passenger car, includes a camera system according to the invention.
  • FIG. 1 in schematic illustration a motor vehicle with a camera system
  • FIG. 2 in schematic illustration a block diagram of the camera system
  • Fig. 3 to 7 each a color space, wherein different color space areas are explained in more detail;
  • FIG. 8 to 10 flow diagrams for explaining a method according to an embodiment of the invention.
  • a motor vehicle 1 illustrated in Fig. 1 is for example a passenger car.
  • the motor vehicle 1 includes a camera system 2 having a plurality of cameras 3, 4, 5, 6 in the embodiment, which are disposed distributed on the motor vehicle 1 .
  • four cameras 3, 4, 5, 6 are provided, wherein the invention is not restricted to such a number and arrangement of the cameras 3, 4, 5, 6.
  • any number of cameras can be used, which can be mounted at different locations of the motor vehicle 1 .
  • a single camera can also be used.
  • a first camera 3 is for example disposed on the front bumper of the motor vehicle 1 .
  • a second camera 4 is for example disposed in the rear region, for instance on the rear bumper or on a tailgate.
  • the two lateral cameras 5, 6 can for example be integrated in the respective exterior mirrors.
  • the cameras 3, 4, 5, 6 are electrically coupled to a control device 7, which in turn is coupled to a display device 8.
  • the display device 8 can be an LCD display.
  • the cameras 3, 4, 5, 6 are video cameras, which each can capture a sequence of images per time unit and communicate it to the control device 7.
  • the cameras 3, 4, 5, 6 have a large opening angle, for instance in a range of values from 150° to 200 °. They can also be so-called fish-eye cameras.
  • the camera 3 captures an environmental region 9 in front of the motor vehicle 1 .
  • the camera 4 captures an environmental region 10 behind the motor vehicle 1 .
  • the camera 5 captures a lateral environmental region 1 1 to the left of the motor vehicle 1 , while the camera 6 captures an environmental region 12 on the right side of the motor vehicle 1 .
  • the cameras 3, 4, 5, 6 provide images of the respective environmental regions 9, 10, 1 1 , 12 and communicate these images to the control device 7. As is apparent from Fig. 1 , the imaged environmental regions 9, 10, 1 1 , 12 mutually overlap in pairs.
  • control device 7 From the images of the cameras 3, 4, 5, 6, the control device 7 generates an image presentation, which is then displayed on the display device 8.
  • a block diagram of the camera system 2 is illustrated in highly abstract illustration.
  • the cameras 3, 4, 5, 6 communicate images I3, I4, I5, I6 to the control device
  • control device 7 then generates the image presentation 13 from respective partial regions I3', I4', I5'. I6' of the images I3, I4, I5, I6, which is presented on the display device
  • This image presentation 13 can for example be a top view presentation, which shows the motor vehicle 1 and its environment 9, 10, 1 1 , 12 from a bird's eye view.
  • This image presentation 13 is generated from the respective partial regions I3', I4', I5', I6', which show the respective environmental region 9, 10, 1 1 , 12 up to a predetermined distance from the motor vehicle 1 and which are processed together to the image presentation 13.
  • the image of the motor vehicle 1 itself can be stored in a memory of the control device 7
  • the cameras 3, 4, 5, 6 can communicate exclusively the partial regions I3', I4', I5', I6' to the control device 7 such that the "cutting out" of the partial regions is performed internally in the cameras 3, 4, 5, 6.
  • the control device 7 also controls the white balance of the images I3, I4, I5, I6.
  • the white balance is performed individually for each camera 3, 4, 5, 6 such that the images I3, I4, I5, I6 are subjected to the white balance independently of each other.
  • the control of the white balance is performed by means of the control device 7, which communicates with the individual cameras 3, 4, 5, 6 via control lines illustrated in Fig. 2. This data communication can also be bidirectionally effected.
  • the white balance within the respective camera 3, 4, 5, 6 is performed by adjusting gain factors of the color channels.
  • a gain factor FR, FG, FB is respectively defined, which can be arbitrarily varied.
  • the adjustment of the color channels is effected within the camera 3 by means of gain factors FR3, FG3, FB3.
  • the corresponding gain factors of the other cameras 4, 5, 6 are labeled in Fig. 2 in analogous manner.
  • the control device 7 is configured to influence the color channels of the camera 3. Therein, in the embodiment, it is provided that the control device 7 can influence exclusively the gain factor FR3 of the red color channel as well as the gain factor FB3 of the blue color channel, but not the gain factor FG3 of the green color channel.
  • the influence of the gain factors FR3, FB3 by the control device 7 is performed such that an adaptation factor is respectively added to these gain factors: FR3 + FRA3 as well as FB3 + FBA3.
  • FRA3, FBA3 denote the respective adaptation factors. They can be varied by means of the control device 7.
  • variation values are input into a register of the camera 3 (via the control lines), by which the respective adaptation factor FRA3, FBA3 is to be varied.
  • the variation of the adaptation factors FRA3, FBA3 can for example be effected stepwise by ⁇ 1 or ⁇ 2.
  • the variation of the adaptation factors FRA3, FBA3 is effected with the same frequency, with which the images I3 are also captured. This means that the register can be fed with new variation values to each frame I3.
  • the control device 7 can read out the current values of the gain factors FR3, FB3 as well as the current adaptation factors FRA3, FBA3 via the control lines.
  • the adjustment of the gain factors FR3, FB3 is effected depending on a color temperature of the current image I3 or of the partial region I3' in the embodiment.
  • the color temperature is determined based on chrominance values U and V of the image I3.
  • not all of the pixels of this partial region I3' are used for determining the color temperature, but only pixels, which are selected according to a certain selection criterion and thus are associated with a certain color space area.
  • the YUV color space is used.
  • the invention is not restricted to the processing of the pixels in this color space and can also be implemented in other color spaces.
  • the invention can be used in any color space isometric to the YUV space, for example the HSV space.
  • the color temperature of the image and thus the optionally present color cast can be determined based on grey pixels, which should be in the range of the origin of the UV color space in the ideal case (i.e. without color casts).
  • grey pixels at this point, for example, an image of the grey road surface is mentioned, which usually has a grey coloring. In the normal case, thus, grey pixels should always be present in the range of the origin of the UV color space.
  • the coloring of the grey pixels is artificially varied by the camera 3 and these pixels are shifted away from the origin in the UV color space.
  • this monochromatic surface causes a color cast and thus shift of the grey pixels in the UV color space.
  • the grey pixels should basically be in the range of the origin of the UV color space, first, a main color space area is defined around the origin of the UV color space, in which grey pixels are to be expected normally in an image without color casts.
  • a main color space area 20 is defined around the origin 21 of the UV color space.
  • This main color space area 20 is defined such that all of the pixels are associated with this area, which satisfy the following conditions: ⁇ + ⁇ ⁇ ⁇ as well as
  • T1 denotes a first limit value
  • T2 denotes a second limit value, wherein it preferably applies: T2 ⁇ T1 .
  • the main color space area 20 can also be defined corresponding to Fig. 4.
  • the above mentioned first condition is replaced with the following condition: - T1 ⁇ U ⁇ T1 as well as -T1 ⁇ V ⁇ T1 .
  • the above mentioned second condition remains the same, as it is indicated in Fig. 4 with the second limit value T2.
  • the first limit value T1 can for example be 10. However, it is also possible to determine this first limit value T1 depending on the luminance values of the pixels of the image I3 in the overlap areas 9/1 1 as well as 9/12, as they are illustrated in Fig. 1 . If for example Y1 is the average of luminance values of the image I3 in the overlap area 9/1 1 and Y2 is the average of the luminance values of the image I3 in the overlap area 9/12, thus, the first limit value T1 can be adjusted according to the following equation:
  • T1 k(Y1 +Y2), wherein k denotes a parameter to be determined, which can be in a range of values from 0.1 to 0.3.
  • each further color space area 22, 23, 24, 25 are also defined, as they are for example illustrated in Fig. 5.
  • the first further color space area 22 is exclusively located in the first quadrant Q1
  • the second color space area 23 is located in the second quadrant Q2
  • the third color space area 24 is located in the third quadrant Q3
  • the fourth further color space area 25 is located in the fourth quadrant Q4.
  • the further color space areas 22, 23, 24, 25 are therefore bounded by the two axes of the UV color space on the one hand and each by a limit function 26 on the other hand. This limit function 26 can now be defined in different manner.
  • the first further color space area 22 is defined such that this color space area 22 includes exclusively pixels satisfying the following conditions:
  • T3 denotes a third limit value greater than T2.
  • FIG. 6 A further example for the further four color space areas 22 to 25 is illustrated in Fig. 6.
  • the further color space areas 22 to 25 are square areas, which are located in the respective quadrant Q1 , Q2, Q3, Q4.
  • FIG. 7 A still further example is illustrated in Fig. 7.
  • the further color space areas 22 to 25 are bounded by a common limit function 26, which has the shape of a circle.
  • the center of this circle 26 is located in the origin 21 of the UV color space, while the radius is equal to T3.
  • T3 the radius
  • the pixels located in this selected color space area are then taken as a basis for determining the color temperature for performing the white balance.
  • the color temperature is determined either based on the main color space area 20 or based on the color space areas 23 or 25, while the color space areas 22, 24 are only used for examining certain criteria, as is described in more detail below.
  • one of the color space areas 20, 22 to 25 is selected, thus, its pixels are used for determining the color temperature.
  • the determination of the color temperature is effected such that an average is calculated from all of the U values of the selected color space area, which is denoted by UC below. Furthermore, an average is calculated from all of the V values of the selected color space area, which is denoted by VC below.
  • the color temperature is therefore represented by a pair of values UC, VC.
  • the white balance is performed as follows:
  • the adaptation factor FBA3 of the blue color channel of the camera 3 is for example decreased by 2. However, if the value UC is greater than a limit value TBS, which in turn is less than the above limit value TBL, such that TBS ⁇ UC ⁇ TBL, then, the adaptation factor FBA3 of the blue color channel is only decreased by 1 . Otherwise, the adaptation factor is kept constant.
  • the adaptation factor FBA3 is increased by 2.
  • the adaptation factor FBA3 is only increased by 1 , if it applies: -TBL ⁇ UC ⁇ -TBS.
  • Analogue can also apply to the adaptation factor FRA3 of the red color channel: if the value VC is greater than a limit value TRL, the adaptation factor FRA3 can be decreased by 2. If the value VC is less than TRL, but greater than a lower limit value TRS, then, the adaptation factor FBA3 is reduced by 1 . Else, the adaptation factor is kept constant.
  • the adaptation factor FRA3 is increased by 2, if VC ⁇ -TRL. Finally, the adaptation factor FRA3 is increased by 1 , if -TRL ⁇ VC ⁇ -TRS.
  • the above mentioned adaptation is based on the fact that the U values of the pixels are proportional to the blue color channel (in the RGB color space), while the V values are proportional to the red color channel.
  • the limit values TBL, TRL, TBS, TRS can be correspondingly adapted.
  • FRA3, FBA3, limit values can also be defined, which must not be exceeded/deceeded. Maximally allowable adaptation values can for example be 16 and -16 for positive and negative values, respectively. The reason for this is that high variations of the gain factors FR3, FB3 are to be avoided. This is considered as a tradeoff between the stability of the entire algorithm on the one hand and the power of the algorithm on the other hand.
  • the adaptation factors FRA3, FBA3 are iteratively varied across the frames until the determined color temperature UC, VC is in a preset range of set values around the zero value.
  • This range of set values can for example be between -1 .5 and 1 .5.
  • a dummy parameter (quasi as a counter) is defined, which is equal to the adaptation factor, but also may exceed and deceed the above mentioned maximally allowable values 16 and -16, respectively.
  • a dummy parameter FRAS3 is defined; for the adaptation factor FBA3, a dummy parameter FBAS3 is defined. The meaning of these dummy parameters is described in more detail below.
  • the method begins in a first step S1 , in which for each color space area 20, 22, 23, 24, 25 an average is calculated from all of the U values as well as an average is calculated from all of the V values of the respective color space area 20, 22, 23, 24, 25, respectively.
  • the values UC and VC are calculated.
  • a minimum number TN0 of pixels required for determining the color temperature exists within the main color space area 20. In other words, it is checked whether or not an actual number NO of the pixels within the main color space area 20 is greater than or equal to a minimum number TN0. If this is the case, thus, the method proceeds to a step S3; otherwise, the method proceeds to a step S4.
  • step S3 further steps are performed, which are described based on the flow diagram according to Fig. 9. If the criterion according to step S2 is satisfied, thus, first it is checked according to step S301 whether the magnitude of the dummy parameter FRAS3 is less than a preset limit value (for example 24) and the magnitude of the dummy parameter FBAS3 is less than a limit value (for example 24). If both of these criteria are satisfied, thus, this means that a sufficient number of pixels are present in the main color space area 20, and the color cast UC and VC are expected to have been shifted back to its normal (regular) limits within the main color space area 20.
  • a preset limit value for example 24
  • a limit value for example 24
  • the color temperature estimation is performed using only the pixels from the main color space area 20 according to step S303, and the parameters FBAS3 and FRAS3 are reset to zero values. Otherwise, if one of the dummy parameters FRAS3 or FBAS3 exceeds the limit value in step S301 , it is considered that UC and VC cannot be corrected based on the pixels from the main color space area 20. This means in other words that a preset period of time is elapsed, for which the color temperature UC, VC remains outside of the range of set values and the method proceeds to step S302 and after that either to step S305 or to step S306 depending on the step S304.
  • the dummy parameters FRAS3 and FBAS3 are set to the respective adaptation factor FRA3 and FBA3, respectively, in step S302. This is only performed if the following criterion is satisfied: wherein VC 2 denotes average of the V values within the second further color space area 23, VC 4 denotes average of the V values within the fourth further color space area 25, UC 2 denotes average of the U values within the second further color space area 23, UC 4 denotes average of the U values within the fourth further color space area 25 and TL denotes a preset limit value.
  • the method proceeds to a further step S304, in which it is decided whether the pixels of the second further color space area 23 or else the pixels of the fourth further color space area 25 are taken as a basis for the determination of the color temperature and thus the white balance.
  • the maximum value is determined from the absolute values of all of the U values (U 2 ) and all of the V values (V 2 ) within the second further color space area 23: Max(
  • the maximum value is also determined from the absolute values of all of the U values (U 4 ) and of all of the V values (V 4 ) within the fourth further color space area 25: Max(
  • step S304 in Fig. 9 the method proceeds to a step S305, in which the pixels of the second further color space area 23 are taken as a basis for the determination of the color temperature. Otherwise, the method proceeds to a step 306, in which the pixels of the fourth further color space area 25 are taken as a basis for the determination of the color temperature for the white balance. This is based on the fact that grey pixels usually are to have lower color values than the pixels of colored objects.
  • This threshold TN2, TN4 is preferably a bit smaller than the minimum number TNO. If the latter is not satisfied, no corrections will be performed in order to ensure high reliability of this correction step.
  • step S2 If in step S2 according to Fig. 8, it is detected that the actual number NO of the pixels within the main color space 20 is less than the minimum number TNO, the method proceeds to the step S4, within which several steps are performed, which are explained based on the flow diagram according to Fig. 10.
  • step S401 it is first checked whether the first or the third color space area 22 or 24 includes the greatest number of pixels relative to the other color space areas 23 and 25. If the first or the third color space area 22 or 24 includes the greatest number of pixels, the method proceeds to a step S402, in which the white balance is performed independently of the color temperature and thus independently of the color space areas.
  • an offset value is applied to at least one of the gain factors FR3 and/or FB3, namely such that the respective gain factor FR3 and/or FB3 is controlled to the opposite direction than it would be performed by the camera 3 within the scope of the internal white balance. In other words, it is counteracted to the internal white balance of the camera 3.
  • step S403 it is checked if the absolute values of the dummy parameters FRAS3 and FBAS3 are not too large, for example exceed a limit value of 24.
  • step S403 If according to step S403, it is determined that N2 ⁇ TN2 and N4 ⁇ TN4 or the absolute values of the dummy parameters FRAS3 or FBAS3 are too high, then, the method proceeds to a step S404.
  • the two gain factors FR3 and FB3 are iteratively and thus stepwise reset to the zero value across the frames. This is effected iteratively such that the gain factors FR3, FB3 are stepwise incremented or decremented.
  • step S405 in which similarly to step S304, it is decided, which one of the further color space areas 22 or 24 is taken as a basis for the determination of the color temperature for the white balance. If the maximum color value is within the fourth color space area 25, thus, the second color space area 23 is selected (step S406). Otherwise, the fourth color space area 25 is selected (step S407).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Of Color Television Signals (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

L'invention porte sur un procédé d'équilibrage des blancs applicable à une image fournie par la caméra d'un véhicule à moteur, lequel procédé consiste à : déterminer les valeurs de couleur (U, V) de pixels dans un espace couleur (U, V); sélectionner un sous-ensemble des pixels conformément à un critère de sélection prédéfini; déterminer la température de couleur de l'image sur la base des valeurs de couleur (U, V) du sous-ensemble de pixels sélectionné; et procéder à l'équilibrage des blancs en fonction de la température de couleur. Dans l'espace couleur prédéfini (U, V) sont délimitées une zone d'espace couleur principale autour de l'origine (21) de l'espace couleur (U, V), et au moins une autre zone d'espace couleur (22, 23, 24, 25) différente de la zone d'espace couleur principale. On vérifie si un nombre minimal prédéfini de pixels requis pour déterminer la température de couleur se trouvent dans les limites de la zone d'espace couleur principale et si tel est le cas, on sélectionne les pixels se trouvant dans les limites de la zone d'espace couleur principale conformément au critère de sélection. Sinon, on sélectionne conformément au critère de sélection les pixels qui se trouvent dans les limites d'une autre zone d'espace couleur (22, 23, 24, 25).
PCT/EP2014/051614 2013-01-31 2014-01-28 Procédé d'équilibrage des blancs pour présentation d'images et système de caméra pour véhicule à moteur WO2014118167A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102013001644.4A DE102013001644A1 (de) 2013-01-31 2013-01-31 Verfahren zum Weißabgleich einer Bilddarstellung und Kamerasystem für ein Kraftfahrzeug
DE102013001644.4 2013-01-31

Publications (1)

Publication Number Publication Date
WO2014118167A1 true WO2014118167A1 (fr) 2014-08-07

Family

ID=50064559

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2014/051614 WO2014118167A1 (fr) 2013-01-31 2014-01-28 Procédé d'équilibrage des blancs pour présentation d'images et système de caméra pour véhicule à moteur

Country Status (2)

Country Link
DE (1) DE102013001644A1 (fr)
WO (1) WO2014118167A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10742850B2 (en) * 2017-04-17 2020-08-11 Canon Kabushiki Kaisha Image processing apparatus and control method thereof for white balance adjustment
CN114630095A (zh) * 2022-03-15 2022-06-14 锐迪科创微电子（北京）有限公司 目标场景图像的自动白平衡方法及装置、终端
WO2023183560A1 (fr) * 2022-03-24 2023-09-28 Connaught Electronics Ltd. Procédé de réduction d'un écart de couleur de pixels d'image d'une image pour un véhicule automobile capturé par une caméra

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102010003668B4 (de) * 2010-04-07 2020-03-26 Robert Bosch Gmbh Farbmaske für einen Bildsensor einer Fahrzeugkamera
DE102014116414A1 (de) * 2014-11-11 2016-05-12 Connaught Electronics Ltd. Verfahren zum Korrigieren eines Bilds, Kamerasystem und Kraftfahrzeug
CN114584752B (zh) * 2020-11-30 2024-02-02 华为技术有限公司 图像颜色还原方法及相关设备

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002007426A2 (fr) * 2000-07-18 2002-01-24 Sony Electronics, Inc. Detection et elimination de la dominante de couleur dans des images numeriques
EP1585345A2 (fr) * 2004-03-30 2005-10-12 OmniVision Technologies, Inc. Procédé et appareil de balance des blancs automatique
US7139412B2 (en) 2001-04-24 2006-11-21 Matsushita Electric Industrial Co., Ltd. Image synthesis display method and apparatus for vehicle camera
EP2012271A2 (fr) 2007-07-02 2009-01-07 Nissan Motor Co., Ltd. Système et procédé de traitement d'image
US20090021647A1 (en) * 2007-07-16 2009-01-22 Yoon Seok Choi Apparatus for controlling color temperature
US20110156887A1 (en) 2009-12-30 2011-06-30 Industrial Technology Research Institute Method and system for forming surrounding seamless bird-view image
WO2011082716A1 (fr) 2010-01-08 2011-07-14 Valeo Schalter Und Sensoren Gmbh Dispositif de formation d'image pour véhicule et équipement d'aide à la conduite comportant un tel dispositif de formation d'image et procédé de formation d'une image globale
US20120288145A1 (en) * 2011-05-12 2012-11-15 Fuji Jukogyo Kabushiki Kaisha Environment recognition device and environment recognition method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7804525B2 (en) * 2006-08-24 2010-09-28 Micron Technology, Inc. Method, apparatus, and system for selecting pixels for automatic white balance processing
DE102010003668B4 (de) * 2010-04-07 2020-03-26 Robert Bosch Gmbh Farbmaske für einen Bildsensor einer Fahrzeugkamera

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002007426A2 (fr) * 2000-07-18 2002-01-24 Sony Electronics, Inc. Detection et elimination de la dominante de couleur dans des images numeriques
US7139412B2 (en) 2001-04-24 2006-11-21 Matsushita Electric Industrial Co., Ltd. Image synthesis display method and apparatus for vehicle camera
EP1585345A2 (fr) * 2004-03-30 2005-10-12 OmniVision Technologies, Inc. Procédé et appareil de balance des blancs automatique
EP2012271A2 (fr) 2007-07-02 2009-01-07 Nissan Motor Co., Ltd. Système et procédé de traitement d'image
US20090021647A1 (en) * 2007-07-16 2009-01-22 Yoon Seok Choi Apparatus for controlling color temperature
US20110156887A1 (en) 2009-12-30 2011-06-30 Industrial Technology Research Institute Method and system for forming surrounding seamless bird-view image
WO2011082716A1 (fr) 2010-01-08 2011-07-14 Valeo Schalter Und Sensoren Gmbh Dispositif de formation d'image pour véhicule et équipement d'aide à la conduite comportant un tel dispositif de formation d'image et procédé de formation d'une image globale
US20120288145A1 (en) * 2011-05-12 2012-11-15 Fuji Jukogyo Kabushiki Kaisha Environment recognition device and environment recognition method

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10742850B2 (en) * 2017-04-17 2020-08-11 Canon Kabushiki Kaisha Image processing apparatus and control method thereof for white balance adjustment
CN114630095A (zh) * 2022-03-15 2022-06-14 锐迪科创微电子（北京）有限公司 目标场景图像的自动白平衡方法及装置、终端
CN114630095B (zh) * 2022-03-15 2024-02-09 锐迪科创微电子（北京）有限公司 目标场景图像的自动白平衡方法及装置、终端
WO2023183560A1 (fr) * 2022-03-24 2023-09-28 Connaught Electronics Ltd. Procédé de réduction d'un écart de couleur de pixels d'image d'une image pour un véhicule automobile capturé par une caméra

Also Published As

Publication number Publication date
DE102013001644A1 (de) 2014-07-31

Similar Documents

Publication Publication Date Title
WO2014118167A1 (fr) Procédé d'équilibrage des blancs pour présentation d'images et système de caméra pour véhicule à moteur
US11057573B2 (en) Multi camera image processing
US10166921B2 (en) Brightness and color matching video from multiple-camera system
TWI242373B (en) Image processing system, projector and image processing method
US10250859B2 (en) Projector
CN100593341C (zh) 摄像装置
US10230900B2 (en) Apparatus for controlling exposure of multi-view camera, system including the same, and method for controlling exposure of multi-view camera
KR101205428B1 (ko) 타겟 위치 특정 장치
CN106851122A (zh) 基于双摄像头系统的自动曝光参数的标定方法和装置
US9984444B2 (en) Apparatus for correcting image distortion of lens
CN105578021A (zh) 双目相机的成像方法及其装置
EP3293697A1 (fr) Dispositif de traitement d'images, dispositif d'imagerie, procédé de traitement d'images et support de stockage stockant un programme de traitement d'images pour un dispositif de traitement d'images
KR101705558B1 (ko) Avm 시스템의 공차 보정 장치 및 방법
KR20170111504A (ko) Avm 시스템 어라운드 영상 정합성 평가방법 및 장치
CN107172323B (zh) 大视场摄像头的图像去暗角方法及装置
EP2843937B1 (fr) Procédé pour adapter la courbe gamma d'un système de caméra d'un véhicule automobile, système de caméra et véhicule à moteur
CN111355880B (zh) 半导体器件、图像处理系统和方法及计算机可读存储介质
WO2013156417A1 (fr) Procédé d'équilibre des blancs d'une image prenant en compte la coloration du véhicule automobile
KR20180028354A (ko) 다중 뷰 모드에서의 영상 디스플레이 방법
US11812156B2 (en) Device and method for reducing backlight effect on a camera of a robot
JP2017225036A (ja) 撮像装置及び画像処理方法
JP2011259087A (ja) カラーターゲット位置決定装置
KR101762117B1 (ko) Avm 시스템의 공차 보정 장치 및 방법
WO2014095782A1 (fr) Procédé d'équilibrage des blancs d'une présentation d'image en prenant uniquement en compte des valeurs de couleurs d'un sous-ensemble de pixels, système de caméra et véhicule automobile doté d'un système de caméra
CN116051379A (zh) Avm图像融合方法及装置、车辆、可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14702784

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14702784

Country of ref document: EP

Kind code of ref document: A1