CN111064900A - Self-adaptive white balance method and vehicle-mounted panoramic looking-around system - Google Patents

Self-adaptive white balance method and vehicle-mounted panoramic looking-around system Download PDF

Info

Publication number
CN111064900A
CN111064900A CN201911356608.7A CN201911356608A CN111064900A CN 111064900 A CN111064900 A CN 111064900A CN 201911356608 A CN201911356608 A CN 201911356608A CN 111064900 A CN111064900 A CN 111064900A
Authority
CN
China
Prior art keywords
image
channel image
channel
white balance
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911356608.7A
Other languages
Chinese (zh)
Inventor
李龙春
魏谦
苟皓然
吴友盼
张圣峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yibin Cowin Auto Co Ltd
Original Assignee
Yibin Cowin Auto Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yibin Cowin Auto Co Ltd filed Critical Yibin Cowin Auto Co Ltd
Priority to CN201911356608.7A priority Critical patent/CN111064900A/en
Publication of CN111064900A publication Critical patent/CN111064900A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/88—Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

The invention discloses a self-adaptive white balance method and a vehicle-mounted panoramic system, wherein the method comprises the following steps: s1, calculating R, G, B channel images of the current frame and calculating R, G, B component gain values respectively; s2, calculating the appointed exposure time of the next frame image based on the gain values of the three components, and fusing the R, G and B channel image of the current frame with the R, G and B channel image of the previous frame to form a new R, G and B channel image respectively; s3, detecting whether the current frame image is the 30 th frame image, if so, white balancing the new R, G and B channel images, if not, taking the new R, G and B channel images as the R image, G image and B channel images of the current frame, and executing step S1. The corresponding data components are obtained by utilizing different exposure time, the influence of the light source color on the imaging of the image sensor is reduced, the imaging of the image sensor is subjected to self-adaptive white balance adjustment, and the brightness and white balance difference among different cameras is reduced.

Description

Self-adaptive white balance method and vehicle-mounted panoramic looking-around system
Technical Field
The invention belongs to the technical field of image detection, and particularly relates to a self-adaptive white balance method and a vehicle-mounted panoramic looking-around system.
Background
The human visual system has the characteristic of color constancy, so that the observation of things by everyone can not be influenced by the color of the light source. However, the image sensor itself has no characteristic of color constancy, so that images captured under different light rays are influenced by the color of the light source and change.
Since the color sensing of the image sensor lacks adaptive characteristics, the illumination change will affect the color sensing of the object by the image sensor. In the image processing process, images used for splicing can be shot in different environments, so that a unified image can be obtained only by correcting the color of the images, in the image recognition, the extraction of object features and the recognition of image modes are established on the basis of image color data, in order to better verify the white balance adjusting effect of the vehicle-mounted 360-degree panoramic all-around system, the images are shot in different environments for processing, and the self-adaptive white balance simulates the color constancy characteristic of a visual system to eliminate the influence of the color of a light source on the images.
The image sensor is equivalent to a visual system of a human body and is a device for converting optical signals into electric signals, and a CMOS (complementary metal oxide semiconductor) process is adopted by a COMS (complementary metal oxide semiconductor) image sensor chip for integrating an image acquisition unit and a signal processing unit into the same chip.
When a traditional 360-degree panoramic all-round looking system shoots, parameters of a vehicle-mounted camera are required to be strictly consistent, exposure parameters and white balance are automatically adjusted according to scenes, the influence of external environment illumination is particularly large, and brightness and color differences exist between images, so that the problem that the 360-degree panoramic camera is overlapped for splicing traditional images, and the algorithm cannot splice images with brightness and white balance differences is solved.
Disclosure of Invention
The invention provides a self-adaptive white balance method, which is used for carrying out white balance on images acquired by different cameras and reducing the white balance difference among the images acquired by the different cameras.
The invention is realized in such a way that a self-adaptive white balance method specifically comprises the following steps:
s1, acquiring an R channel image, a G channel image and a B channel image of the current frame by each camera based on the appointed exposure time, and calculating the R channel image, the G channel image and the B channel image of the current frame to respectively calculate R components, G components and B component Gain values GainR, Gain G and GainB;
s2, calculating the appointed exposure time of the next frame image based on GainR, Gain G and GainB, and fusing the R channel image, the G channel image and the B channel image of the current frame with the R channel image, the G channel image and the B channel image of the previous frame respectively to obtain new R channel image, G channel image and B channel image;
s3, detecting whether the current frame image is the 30 th frame image, if so, performing white balance processing on the fused new R channel image, G channel image and B channel image, and if not, taking the fused new R channel image, G channel image and B channel image as the R channel image, G channel image and B channel image of the current frame, and executing step S1.
Further, the calculation formula of the specified exposure time of the next frame is specifically as follows:
Figure BDA0002336097330000021
wherein S is an image transmission frequency per unit time, E0Is the image acquisition frequency per unit time.
Further, the calculation formula of the pixel value I (x, y) of the pixel point at the x-th row and the y-th column in the new R channel image, G channel image or B channel image formed by fusion is specifically as follows:
Figure BDA0002336097330000031
In-1(x, y) is the pixel value of the pixel point of the x row and y column in the previous frame of R channel image, G channel image or B channel image, IR n(x, y) is the pixel value of the pixel point pixel of the x row and y column in the current frame R channel image, G channel image or B channel image.
The invention is thus achieved, a vehicle mounted look-around system, said look-around system comprising: the self-adaptive white balance method comprises a front-view camera arranged in front of a vehicle, a rear-view camera arranged behind the vehicle, a left-view camera arranged on the left side of the vehicle, and a right-view camera arranged on the right side of the vehicle, wherein the front-view camera, the rear-view camera, the left-view camera and the right-view camera are all connected with an image processor through LVDS coaxial cables, the image processor is connected with a vehicle-mounted display screen through the LVDS coaxial cables, the image processor respectively performs the self-adaptive white balance method according to any one of claims 1 to 3 on the basis of images acquired by the four cameras, performs splicing on the basis of the images after white balance, and sends the spliced images to the vehicle-mounted display screen for display.
The self-adaptive white balance method provided by the invention has the following beneficial technical effects: the corresponding data components are obtained by utilizing different exposure time, the influence of the light source color on the imaging of the image sensor is reduced, the imaging of the image sensor is subjected to self-adaptive white balance adjustment, and the brightness and white balance difference among different cameras is reduced.
Drawings
Fig. 1 is a flow chart of an adaptive white balance method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a vehicle-mounted all-round viewing system according to an embodiment of the present invention.
Detailed Description
The following detailed description of the embodiments of the present invention will be given in order to provide those skilled in the art with a more complete, accurate and thorough understanding of the inventive concept and technical solutions of the present invention.
Fig. 1 is a flowchart of a method for adaptive white balance according to an embodiment of the present invention, where the method specifically includes the following steps:
s1, acquiring an R channel image, a G channel image and a B channel image of the current frame by each camera based on the appointed exposure time, and calculating the R channel image, the G channel image and the B channel image of the current frame to respectively calculate R components, G components and B component Gain values GainR, Gain G and GainB;
s2, calculating the appointed exposure time of the next frame image based on GainR, Gain G and GainB, and fusing the R channel image, the G channel image and the B channel image of the current frame with the R channel image, the G channel image and the B channel image of the previous frame respectively to obtain new R channel image, G channel image and B channel image;
in the embodiment of the present invention, the calculation formula of the specified exposure time of the next frame is specifically as follows:
Figure BDA0002336097330000041
wherein S is an image transmission frequency per unit time, E0Is the image acquisition frequency per unit time.
S3, detecting whether the current frame image is the 30 th frame image, if so, performing white balance processing on the new R channel image, the G channel image, and the B channel image that are fused, and if not, taking the R channel image, the G channel image, and the B channel image that are fused as the R channel image, the G channel image, and the B channel image of the current frame, and executing step S1.
In the embodiment of the invention, the pixel value I of the pixel point at the x-th row and the y-th column in the new R channel image formed by fusionR(x, y) is calculated using equation (2):
Figure BDA0002336097330000042
IR n-1(x, y) is the pixel value of the pixel point of the x-th row and y-th column in the previous frame R channel image, IR n(x, y) is the pixel value of the pixel point pixel of the x row and y column in the R channel image of the current frame;
the pixel value I of the pixel point of the x row and the y column in the new G channel image formed by fusionG(x, y) is calculated using equation (3):
Figure BDA0002336097330000051
IG n-1(x, y) is the pixel value of the pixel point of the x-th row and y-th column in the previous frame of G channel image, IG n(x, y) is the pixel value of the pixel point pixel of the x row and y column in the current frame G channel image;
the pixel value I of the pixel point of the x row and the y column in the new B channel image formed by fusionB(x, y) is calculated using equation (4):
Figure BDA0002336097330000052
IB n-1(x, y) is the pixel value of the pixel point of the x row and y column in the previous frame of B channel image, IB n(x, y) is the pixel value of the pixel point pixel of the x row and y column in the B channel image of the current frame.
Fig. 2 is a schematic structural diagram of a vehicle-mounted all-around system according to an embodiment of the present invention, and for convenience of description, only a part related to the embodiment of the present invention is shown.
This look around system includes: locate the foresight camera in vehicle the place ahead, locate the back vision camera in vehicle rear, locate the left side of vehicle and look the camera, locate the right side of vehicle right side and look the camera, foresight camera, back vision camera, left side look camera and right side look the camera and all be connected with image processor through LVDS coaxial cable, image processor passes through LVDS coaxial cable and is connected with the on-vehicle display screen, image processor carries out respectively as above based on the image that four cameras were gathered image self-adaptation white balance handles, splices based on the image after the white balance handles, sends the image that the concatenation formed to on-vehicle display screen and shows.
The self-adaptive white balance method provided by the invention has the following beneficial technical effects: the corresponding data components are obtained by utilizing different exposure time, the influence of the light source color on the imaging of the image sensor is reduced, the imaging of the image sensor is subjected to self-adaptive white balance adjustment, and the brightness and white balance difference among different cameras is reduced.
The invention has been described above with reference to the accompanying drawings, it is obvious that the invention is not limited to the specific implementation in the above-described manner, and it is within the scope of the invention to apply the inventive concept and solution to other applications without substantial modification.

Claims (4)

1. A self-adaptive white balance method is characterized by specifically comprising the following steps:
s1, acquiring an R channel image, a G channel image and a B channel image of the current frame by each camera based on the appointed exposure time, and calculating the R channel image, the G channel image and the B channel image of the current frame to respectively calculate R components, G components and B component Gain values GainR, Gain G and GainB;
s2, calculating the appointed exposure time of the next frame image based on GainR, Gain G and GainB, and fusing the R channel image, the G channel image and the B channel image of the current frame with the R channel image, the G channel image and the B channel image of the previous frame respectively to obtain new R channel image, G channel image and B channel image;
s3, detecting whether the current frame image is the 30 th frame image, if so, white balancing the fused new R, G, and B channel images, and if not, taking the fused new R, G, and B channel images as the R, G, and B channel images of the current frame, and performing step S1.
2. The adaptive white balance method according to claim 1, wherein the calculation formula of the specified exposure time of the next frame is specifically as follows:
Figure FDA0002336097320000011
wherein S is an image transmission frequency per unit time, E0Is the image acquisition frequency per unit time.
3. The adaptive white balance method according to claim 1 or 2, wherein a calculation formula of a pixel value I (x, y) of an x-th row and y-th column pixel point in the new R-channel image, G-channel image, or B-channel image formed by fusion is specifically as follows:
Figure FDA0002336097320000012
In-1(x, y) is the pixel value of the pixel point of the x row and y column in the previous frame of R channel image, G channel image or B channel image, IR n(x, y) is the pixel value of the pixel point pixel of the x row and y column in the current frame R channel image, G channel image or B channel image.
4. An on-board look-around system, the look-around system comprising: the self-adaptive white balance method comprises a front-view camera arranged in front of a vehicle, a rear-view camera arranged behind the vehicle, a left-view camera arranged on the left side of the vehicle, and a right-view camera arranged on the right side of the vehicle, wherein the front-view camera, the rear-view camera, the left-view camera and the right-view camera are all connected with an image processor through LVDS coaxial cables, the image processor is connected with a vehicle-mounted display screen through the LVDS coaxial cables, the image processor respectively performs the self-adaptive white balance method according to any one of claims 1 to 3 on the basis of images acquired by the four cameras, performs splicing on the basis of the images after white balance, and sends the spliced images to the vehicle-mounted display screen for display.
CN201911356608.7A 2019-12-25 2019-12-25 Self-adaptive white balance method and vehicle-mounted panoramic looking-around system Pending CN111064900A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911356608.7A CN111064900A (en) 2019-12-25 2019-12-25 Self-adaptive white balance method and vehicle-mounted panoramic looking-around system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911356608.7A CN111064900A (en) 2019-12-25 2019-12-25 Self-adaptive white balance method and vehicle-mounted panoramic looking-around system

Publications (1)

Publication Number Publication Date
CN111064900A true CN111064900A (en) 2020-04-24

Family

ID=70303378

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911356608.7A Pending CN111064900A (en) 2019-12-25 2019-12-25 Self-adaptive white balance method and vehicle-mounted panoramic looking-around system

Country Status (1)

Country Link
CN (1) CN111064900A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114430463A (en) * 2022-04-01 2022-05-03 青岛大学附属医院 Optimization method and system for self-adaptive medical-grade image effect
CN115134492A (en) * 2022-05-31 2022-09-30 北京极豪科技有限公司 Image acquisition method, electronic device and computer readable medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06261248A (en) * 1993-03-03 1994-09-16 Toshiba Corp Video camera
CN1632688A (en) * 2004-12-24 2005-06-29 北京中星微电子有限公司 Method for implementing automatic exposure
KR20100060095A (en) * 2008-11-27 2010-06-07 삼성전기주식회사 Method for autofocus of camera module
CN102196183A (en) * 2010-03-01 2011-09-21 英属开曼群岛商恒景科技股份有限公司 Adaptive frame rate control system and method for image sensor
CN107066954A (en) * 2017-03-23 2017-08-18 浙江零跑科技有限公司 A kind of vehicle-mounted 360 degree are looked around display methods and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06261248A (en) * 1993-03-03 1994-09-16 Toshiba Corp Video camera
CN1632688A (en) * 2004-12-24 2005-06-29 北京中星微电子有限公司 Method for implementing automatic exposure
KR20100060095A (en) * 2008-11-27 2010-06-07 삼성전기주식회사 Method for autofocus of camera module
CN102196183A (en) * 2010-03-01 2011-09-21 英属开曼群岛商恒景科技股份有限公司 Adaptive frame rate control system and method for image sensor
CN107066954A (en) * 2017-03-23 2017-08-18 浙江零跑科技有限公司 A kind of vehicle-mounted 360 degree are looked around display methods and system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114430463A (en) * 2022-04-01 2022-05-03 青岛大学附属医院 Optimization method and system for self-adaptive medical-grade image effect
CN114430463B (en) * 2022-04-01 2022-06-28 青岛大学附属医院 Optimization method and system for self-adaptive medical-grade image effect
CN115134492A (en) * 2022-05-31 2022-09-30 北京极豪科技有限公司 Image acquisition method, electronic device and computer readable medium
CN115134492B (en) * 2022-05-31 2024-03-19 北京极光智芯科技有限公司 Image acquisition method, electronic device, and computer-readable medium

Similar Documents

Publication Publication Date Title
CN107948519B (en) Image processing method, device and equipment
KR102279436B1 (en) Image processing methods, devices and devices
KR102306304B1 (en) Dual camera-based imaging method and device and storage medium
CN109690628B (en) Image processing apparatus
CN108712608B (en) Terminal equipment shooting method and device
CN108154514B (en) Image processing method, device and equipment
US20100194902A1 (en) Method for high dynamic range imaging
EP3480784A1 (en) Image processing method, and device
CN107872631B (en) Image shooting method and device based on double cameras and mobile terminal
WO2019105254A1 (en) Background blur processing method, apparatus and device
US9214034B2 (en) System, device and method for displaying a harmonized combined image
KR101478980B1 (en) System for multi channel display to use a fish-eye lens
KR20110067437A (en) Apparatus and method for processing image obtained by a plurality of wide angle camera
WO2020011112A1 (en) Image processing method and system, readable storage medium, and terminal
CN111064900A (en) Self-adaptive white balance method and vehicle-mounted panoramic looking-around system
KR20190041586A (en) Electronic device composing a plurality of images and method
CN113658058B (en) Brightness balancing method and system in vehicle-mounted looking-around system
JP5190715B2 (en) In-vehicle monitor system, parking support apparatus using the in-vehicle monitor system, and color adjustment method for in-vehicle monitor system
CN112714301A (en) Dual-mode image signal processor and image sensor
JP6453193B2 (en) Stereo camera device
CN108307179A (en) A kind of method of 3D three-dimensional imagings
CN113066011B (en) Image processing method, device, system, medium and electronic equipment
CN112702588B (en) Dual-mode image signal processor and dual-mode image signal processing system
KR20180028354A (en) Method for displaying image in multiple view modes
KR101241012B1 (en) Method for improving images of around view monitor system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200424