KR20170031982A - Monitoring system for vehicle - Google Patents
Monitoring system for vehicle Download PDFInfo
- Publication number
- KR20170031982A KR20170031982A KR1020150129627A KR20150129627A KR20170031982A KR 20170031982 A KR20170031982 A KR 20170031982A KR 1020150129627 A KR1020150129627 A KR 1020150129627A KR 20150129627 A KR20150129627 A KR 20150129627A KR 20170031982 A KR20170031982 A KR 20170031982A
- Authority
- KR
- South Korea
- Prior art keywords
- image
- backlight
- area
- region
- processing unit
- Prior art date
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/12—Fluid-filled or evacuated lenses
-
- H04N5/2258—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Mathematical Physics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
Abstract
Description
BACKGROUND OF THE
Generally, the vehicle is equipped with a side mirror that allows the driver to grasp the road conditions on the left or right or rear of the vehicle.
The side mirrors are installed near the front doors or the front doors on both sides of the vehicle, and allow the driver to recognize the surrounding vehicles located laterally or rearwardly through the side mirrors, and to securely change lanes or maintain safety distances. It plays a role.
However, since the side mirrors are installed so as to protrude from both sides of the vehicle to a considerable size in the outward direction, there is a problem that the air resistance increases when the vehicle is running, the fuel consumption is lowered, the noise is increased, .
In the absence of a side mirror, air resistance can be reduced by up to 7%, and fuel consumption due to reduced air resistance can be reduced by about 3%. Accordingly, in order to design a high-efficiency and high-performance car, research is underway to replace a conventional side mirror with a camera.
However, there is a disadvantage that it is difficult to secure a clock when backlight is generated in an image photographed by a camera.
A problem to be solved by the present invention is to provide a vehicle monitoring system capable of avoiding backlighting.
The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description.
According to another aspect of the present invention, there is provided a vehicle monitoring system including a camera for capturing an outside of a vehicle, the camera including a fluid lens having a variable curvature, an image processor for detecting a backlight region in an image captured by the camera, A lens controller for controlling the curvature of the fluid lens so that the image is shifted in a direction in which at least a part of the backlight region is avoided in the image to maintain the focal distance of the fluid lens and change the focal position of the fluid lens, And a display unit for visually expressing the image.
Wherein the image processing unit divides the image into a plurality of regions and calculates a luminance average value for each region, and calculates a cumulative luminance average value of the regions of the images photographed at a past time point within a predetermined time from the photographing time of the backlight detection subject image, And determine that the backlight region is present in an area in which the luminance average value of each of the plurality of areas in the backlight detection subject image is greater than or equal to a first reference value that is greater than the accumulated luminance average value in each area.
The image processing unit may determine an area having the highest luminance in the area where the backlighting area is determined to exist as the backlighting area among the plurality of areas of the backlight detection subject image.
Wherein the image processing unit sequentially calculates a luminance value of a plurality of pixels constituting an area in which the backlight region is determined to be present among the plurality of areas of the backlight detection subject image in accordance with a predetermined rule, And a pixel whose luminance value is greater than or equal to a second reference value than the cumulative luminance average value for each area can be determined as the backlight region.
The image processing unit may determine that the pixels surrounding the pixel determined as the backlight region have the luminance value that is equal to or greater than the second reference value to the cumulative luminance average value per region as the backlight region.
Wherein the image processing unit determines the pixels as the backlight region when the luminance value among the pixels surrounding the pixel determined as the backlight region is equal to or greater than the reference number of pixels having the second reference value or more than the cumulative luminance average value .
Wherein the image processing unit calculates the center point of the backlight region and the center point of the image and the lens control unit controls the lens unit such that the image is moved in a direction of a virtual extension line connecting the center point of the backlight region and the center point of the image, The curvature of the lens can be controlled.
The image processing unit may calculate a center point of the backlight area based on an average of coordinate values of pixels constituting the outermost region of the backlight region.
The moving distance of the image may be inversely proportional to the distance between the center point of the backlight region and the center point of the image.
Wherein the image processing unit sets a virtual center area at the center of the image and determines whether an area included in the center area of the backlight area is less than a preset threshold ratio, The control unit controls the fluid lens such that at least a part of the backlight region is avoided in the image when it is determined that an area included in the central region of the backlight region is equal to or less than the threshold ratio.
Wherein when the image processing unit determines that an area included in the central area of the backlight area is less than or equal to the threshold ratio, the image processor corrects a center point of an area not included in the center area and a center point And the lens control unit controls the curvature of the fluid lens such that the image is moved in a direction of a virtual extension line connecting the center point of the region not included in the center region and the center point of the image in the backlight region .
The camera may include a first camera for photographing the left rear side of the vehicle and a second camera for photographing the right rear side of the vehicle.
Other specific details of the invention are included in the detailed description and drawings.
The embodiments of the present invention have at least the following effects.
Backlight can be avoided in an image when backlight appears in an image taken by a camera.
The effects according to the present invention are not limited by the contents exemplified above, and more various effects are included in the specification.
1 is a block diagram showing a monitoring system for a vehicle according to an embodiment of the present invention.
2 is a cross-sectional view schematically illustrating a fluid lens according to an embodiment of the present invention.
3 is a view showing an example of a vehicle equipped with a vehicle monitoring system according to an embodiment of the present invention.
4 is a view showing another example of a vehicle equipped with a vehicle monitoring system according to an embodiment of the present invention.
5 to 7 are flowcharts illustrating a backlight avoidance control method using a vehicle monitoring system according to an embodiment of the present invention.
8 is a diagram for explaining steps S10 and S11 of FIG.
9 is a view for explaining a method of moving the focus position of the fluid lens using the lens operation switch in the manual control mode.
FIGS. 10 to 13 are diagrams for explaining a method of moving a focus position of a fluid lens when a backlight region exists in one of the regions divided in the automatic control mode. FIG.
14 is a diagram for explaining a method of moving a focus position of a fluid lens in a case where a backlight region exists in three regions out of the regions divided in the automatic control mode.
15 is a diagram for explaining a method of moving a focus position of a fluid lens in a case where backlight regions continuous to two regions out of the regions divided in the automatic control mode exist.
BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.
Further, the embodiments described herein will be described with reference to cross-sectional views and / or schematic drawings that are ideal illustrations of the present invention. Thus, the shape of the illustrations may be modified by manufacturing techniques and / or tolerances. In addition, in the drawings of the present invention, each component may be somewhat enlarged or reduced in view of convenience of explanation. Like reference numerals refer to like elements throughout the specification.
Hereinafter, the present invention will be described with reference to the drawings for explaining a vehicle monitoring system and a backlight avoidance control method using the same according to an embodiment of the present invention.
FIG. 1 is a block diagram showing a monitoring system for a vehicle according to an embodiment of the present invention, and FIG. 2 is a cross-sectional view schematically showing a fluid lens according to an embodiment of the present invention.
1, a
The
The
Alternatively, the
The curvatures of the
The
The
When the
Alternatively, when the
Fig. 2 schematically shows the structure of a fluid lens using electrowetting phenomenon as an example of the
As shown in Fig. 2, the
The two
Are filled with two fluids F1 and F2 which do not mix with each other in the sealing space between the two
2 is a cross-sectional view of the
The surface tension of the first fluid Fl changes according to the voltage applied to the
Specifically, when the voltage applied to the
As a result, as shown in FIG. 2, the focus position changes and the image entering the
For example, when the shape of the interface changes from the dotted line to the one-dot chain line, the image photographed by the
On the other hand, when Fig. 2 is taken as a vertical cross-sectional view of the
The surface tension of the first fluid F1 is changed in accordance with the voltage applied to the
For example, when the shape of the interface changes from a dotted line to a one-dot chain line, an image photographed by the
The focal positions of the
The
When the
In addition, the
The
The
On the other hand, the
When the driver selects the automatic control mode using the
When the driver selects the manual control mode by using the
In the manual control mode, the driver can see the displayed image through the
Although not shown, the lens operation switch may include a button for selecting either the
Even in the automatic control mode, when the driver operates the
3 is a view showing an example of a vehicle equipped with a vehicle monitoring system according to an embodiment of the present invention.
3, the
As shown in FIG. 3, the
As shown in Fig. 3, the
The vehicle according to the embodiment of FIG. 3 is a vehicle in which the driver secures the right and left rearview fields of the vehicle through both side mirrors 2 and 3 or the
4 is a view showing another example of a vehicle equipped with a vehicle monitoring system according to an embodiment of the present invention.
As shown in Fig. 4, the vehicle according to the present embodiment does not have left and right side mirrors, and there are a
The
Similar to the case of Fig. 3, the
4, the
An image captured by the
Alternatively, as in the case of Fig. 3, a
Hereinafter, a backlight avoidance control method using the
5 to 7 are flowcharts illustrating a backlight avoidance control method using a vehicle monitoring system according to an embodiment of the present invention.
As shown in FIG. 5, the backlight avoidance control method according to an embodiment of the present invention includes a step S1 of determining whether or not the mode is an automatic control mode.
In step S1, it is determined whether the
When the
In the manual control mode, the
The
The driver can select the camera to adjust the shooting direction by using the camera selection switch, and adjust the shooting direction of the selected camera by using the direction control switch.
In step S2, the
9 is a view for explaining a method of moving the focus position of the fluid lens using the lens operation switch in the manual control mode, showing an image photographed by the
As shown in FIG. 9, when there is a strong backlight C in the image, the trailing vehicle may not be properly displayed in the image due to light blur. In such a case, there is a possibility that the lane can not be changed to the left side because the view to the left rear side is not sufficiently secured, or the accident may be caused by the lane change.
When the backlight C is in the sunlight, it is inevitable to operate the image while viewing the image in which the backlight C exists for a considerable time during the straight running.
Accordingly, the driver selects the
The
As the focus of the
The backlight C is avoided in the image of the dotted line box, so that the light blur due to the backlight C is relieved and the trailing vehicle on the left side is expressed more clearly in the image.
Hereinafter, the backlight avoidance control method according to the automatic control mode will be described.
If it is determined in step S1 that the
The
As shown in FIGS. 10 to 15, the backlight avoidance control method according to the present embodiment will be described on the basis of dividing an image frame into four regions (Q1, Q2, Q3, and Q4) of a 2X2 array. The method of dividing the video frame may vary according to the embodiment.
For convenience of explanation, the Q1 region is referred to as a first quadrant, the Q2 region as a second quadrant, the Q3 region as a third quadrant, and the Q4 region as a fourth quadrant.
Thereafter, the
In step S6, the
The
Thereafter, the
In step S7, the
For example, the
Alternatively, the
As the time elapses, new image frames are added to the calculation object and the image frames of the past time are excluded from the calculation object, so that the average value of the luminance of each of the regions Q1, Q2, Q3, and Q4 may change with passage of time .
Thereafter, the
For example, when the first reference value is set to 30 and the cumulative luminance average value of the first quadrant Q1 is 100, the
In a similar manner, the
If there is no quadrant (Q1, Q2, Q3, Q4) in which the luminance average value of each region in the backlight detection object image is larger than the accumulated luminance average value in each region larger than the first reference value in Step S8, the process goes back to Step S1.
On the other hand, when there are quadrants Q1, Q2, Q3, and Q4 in which the luminance average value of each region in the backlight detection object image is larger than the first accumulated luminance intensity average value in Step S8, The quadrant is determined as a high luminance region in which the backlight region exists or is likely to exist, and the number of the quadrants Q1, Q2, Q3, and Q4 is determined (S9, S14).
When the average luminance value of each region in the image of a specific quadrant is larger than the first reference value, the strong light appears in the corresponding quadrant, and therefore there is a high possibility that backlight exists in the quadrant.
In step S9, it is determined whether the number of high brightness areas is one or not.
In step S9, if the number of high brightness areas is 1, the process goes to step S10. If the number of high brightness areas exceeds one, the process goes to step S14.
Since the control method of the
First, the case where the number of high luminance regions is one will be described.
If it is determined in step S9 that the number of high luminance areas is one, the
For convenience of explanation, steps S10 and S11 will be described with reference to FIG.
8, when backlight C exists only in the first quadrant Q1 among the quadrants Q1, Q2, Q3, and Q4 of the backlight detection subject image I1, in step S8, (Q1) is judged to be a high luminance region.
In step S10, the
When the deviation between the luminance value of the specific pixel P1 and the accumulated luminance average value of the first quadrant Q1 is lower than the second reference value, the luminance value of the next specific pixel is compared with the accumulated luminance average value of the first quadrant Q1.
The criterion for selecting the specific pixel P1 and the next specific pixel among the plurality of pixels constituting the first quadrant Q1 may be determined by various rules. For example, a rule may be adopted in which the next pixel is selected in a zigzag manner starting from the pixel located at the uppermost right end of the first quadrant Q1, or the most luminance among the plurality of pixels constituting the first quadrant Q1 A rule may be adopted in which the next pixel is selected in descending order of the luminance value starting from the pixel having the higher value.
If there is no pixel whose luminance value is equal to or greater than the second reference value of the cumulative luminance average value of the first quadrant Q1 among the individual pixels constituting the first quadrant Q1 according to a predetermined rule, the process proceeds to S1.
On the other hand, if a specific pixel P1 whose luminance value is equal to or greater than a second reference value of the accumulated luminance average value of the first quadrant Q1 is found, The luminance value of the surrounding pixels surrounding the specific pixel P1 is compared with the cumulative luminance average value of the first quadrant Q1 and it is determined whether the difference between the luminance values is equal to or greater than a predetermined second reference value at step S11.
If the pixels P2, P3 and P4 whose luminance value is equal to or greater than the second reference value of the cumulative luminance average value of the first quadrant Q1 are found out of the surrounding pixels, Repeat step S11 for surrounding pixels. At this time, the pixel P1 in which the luminance value has already been compared with the accumulated luminance average value of the first quadrant Q1 can be excluded from the calculation in the judgment.
The pixels P1, P2, P3, and P4 which are equal to or greater than the second reference value of the cumulative luminance average value of the first quadrant Q1 in the steps S10 and S11 are determined to be the backlight region.
Steps S10 and S11 can be repeatedly performed until the luminance value of all the pixels of the first quadrant Q1 is compared with the accumulated luminance average value of the first quadrant Q1.
If a pixel whose luminance value is no more than the second reference value of the cumulative luminance average value of the first quadrant Q1 is found, the flow proceeds to step S13 in which the curvature of the fluid lens is controlled to avoid backlighting.
In the case where a plurality of backlight regions constituted by groups of adjacent pixels in the first quadrant Q1 are determined through steps S10 and S11, the
8, it is assumed that the backlight region exists in the first quadrant Q1. However, even if the other quadrants Q2, Q3, and Q4 are selected as the high brightness region, Proceed in a similar manner.
FIGS. 10 to 13 are diagrams for explaining a method of moving a focus position of a fluid lens when a backlight region exists in one of the regions divided in the automatic control mode. FIG.
10, when a part of the pixels in the first quadrant Q1 in the image I1 is determined to be the backlight region C, the
The
Further, the image processing section calculates the center point P1 of the image I1. The center point P1 of the image I1 can be the center of the four corner coordinates of the image I1.
The
The
So that the center point P1 of the shifted image I2 and the center point P1 of the image I1 in which the backlight region C exists and the center point P2 of the backlight region C are located on the same straight line, Is shifted along a virtual extension line connecting the center point P1 of the image I1 and the center point P2 of the backlight region C. [
The moving distance of the image may be inversely proportional to the distance r1 between the center point P1 of the image I1 and the center point P2 of the backlight area C. [ When the center point P2 of the backlight area C is located far from the center point P1 of the image I1, the backlight area C is located close to the outer edge of the image I1, When the backlight region C is avoided in the image I2 that has been captured and the center point P2 of the backlight region C is located close to the center point P1 of the image I1, The backlight region C is avoided in the shifted
However, when the backlight region C is located at the center of the image I1, the moving distance of the image for avoiding the backlight region C becomes excessively long, so that an abnormal point that is not necessary for the operation is photographed.
In order to prevent this, the
The
12 and 13, when a part of the backlight region C is included in the central region Z, the
The
A threshold ratio may be set in the
Fig. 12 shows an example in which the ratio of the area included in the central region Z in the backlight region C exceeds the critical ratio, and Fig. 13 shows an example in which the ratio of the area included in the central region Z in the backlight region C Area ratio is equal to or less than a critical ratio.
12, when the ratio of the area included in the central area Z of the backlight area C to the area of the backlight area C exceeds the threshold ratio, the
13, if the ratio of the area included in the central region Z of the backlight region C to the area of the backlight region C is less than the threshold ratio, the
The
On the other hand, if it is determined through step S10 and step S11 that there are a plurality of backlight regions constituted by groups of adjacent pixels in one quadrant Q1, the
After step S13, the process proceeds to step S1 again.
Hereinafter, a case where the number of quadrants Q1, Q2, Q3, and Q4 in which the variation amount of the luminance average value is equal to or larger than the reference variation amount or exceeds the reference variation amount is described.
As shown in FIG. 6, if it is determined in step S9 that the number of high brightness areas exceeds one, the process proceeds to step S14.
As shown in Fig. 7, in step S14, it is determined whether the number of high brightness areas is two or not.
If it is determined in step S14 that the number of high brightness areas is two, the
If a specific pixel whose luminance value is equal to or greater than a second reference value of the cumulative luminance average value of the quadrant is found in at least one of the two quadrants, the
If a pixel in which the luminance value of the neighboring pixels is equal to or greater than the second reference value of the cumulative luminance average value of the quadrant is found, step S18 is repeated for neighboring pixels of each of the found pixels.
The detailed contents of steps S17 and S18 are similar to those of steps S10 and S11 described above, and a description thereof will be omitted.
If it is determined in step S19 that a pixel whose luminance value is no less than the second reference value of the cumulative luminance average value of the quadrant is found, control proceeds to step S20 in which curvature of the fluid lens is controlled to avoid backlight.
After step S20, the process goes back to step S1. A detailed description of step S20 will be described later.
Hereinafter, the case where the number of high luminance regions exceeds two will be described.
As shown in FIG. 7, if it is determined in step S14 that the number of high luminance areas exceeds two, the process proceeds to step S16.
If it is determined in step S14 that the number of high luminance areas exceeds two, the
The description of step S16 will be made with reference to FIG.
14 is a diagram for explaining a method of moving a focus position of a fluid lens in a case where a backlight region exists in three regions out of the regions divided in the automatic control mode.
As shown in Fig. 14, the backlight regions C1, C2, and Q3 are provided on the first quadrant Q1, the second quadrant Q2, and the third quadrant Q3, of the four quadrants Q1, Q2, Q3, The
For example, when the luminance average value of the third quadrant Q3 among the three quadrants Q1, Q2 and Q3 is selected as the highest quadrant, the third quadrant Q3 is selected as the high luminance region, It is determined whether or not the curvature of the
The
Since the backlight C3 having the highest luminance value among the high luminance areas C1, C2, and C3 is avoided in the shifted image I2, the light blur due to the backlight C3 is relaxed.
After step S13, the process proceeds to step S1 again.
Alternatively, in step S16, the
On the other hand, FIG. 15 is a diagram for explaining a method of moving the focus position of the fluid lens in the case where there are continuous backlight regions in two regions of the regions divided in the automatic control mode.
14, when the plurality of backlight regions C1, C2, and C3 are spaced apart from each other, the fluid lens can be controlled in accordance with the above-described manner, but as shown in Fig. 15, The backlight region formed in the first quadrant Q1 and the backlight region formed in the fourth quadrant Q2 can not be separately considered.
15, when there are continuous backlight regions in two quadrants Q1 and Q4 among the divided regions, the
The
The
In addition, the curvature control of the
It will be understood by those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.
1:
4: Steering wheel 5: Monitor
10: first camera 20: second camera
50: display unit 51: first display unit
52: second display portion
Claims (12)
An image processing unit for detecting a backlight area in an image taken by the camera;
A lens controller for controlling a curvature of the fluid lens such that the image is shifted in a direction in which at least a part of the backlight region is avoided in the image to maintain a focal distance of the fluid lens and change a focal position of the fluid lens; And
And a display unit for visually expressing the image.
Wherein the image processing unit comprises:
Dividing the image into a plurality of regions, calculating a luminance average value for each region,
Calculating a cumulative luminance average value for each region of the image photographed at a time point within a predetermined time from the photographing time of the backlight detection subject image,
Wherein the backlight detection unit determines that the backlight region exists in an area in which the brightness average value of each of the plurality of areas of the backlight detection subject image is greater than or equal to a first reference value that is greater than the accumulated brightness average value of each area.
Wherein the image processing unit comprises:
And determines an area having the highest luminance within the area in which the backlight area is determined to exist as the backlight area, among the plurality of areas of the backlight detection subject image.
Wherein the image processing unit comprises:
Comparing the luminance values of a plurality of pixels constituting an area determined as having the backlight area among the plurality of areas of the backlight detection subject image with the cumulative luminance average value per area in accordance with a predetermined rule,
And determines a pixel whose luminance value is equal to or greater than a second reference value that is greater than the cumulative luminance average value for each region as the backlight region.
Wherein the image processing unit comprises:
Wherein the pixels surrounding the pixel determined as the backlight region determine the pixels whose luminance value is equal to or greater than the second reference value to the cumulative luminance average value for each region as the backlight region.
Wherein the image processing unit comprises:
And determines the pixels as the backlight region when the luminance value among the pixels surrounding the pixel determined as the backlight region is equal to or greater than the reference number of pixels having the second reference value or greater than the accumulated luminance average value for each region.
Wherein the image processing unit calculates a center point of the backlight region and a center point of the image,
Wherein the lens control unit controls the curvature of the fluid lens such that the image is moved in a direction of a virtual extension line connecting the center point of the backlight region and the center point of the image.
Wherein the image processing unit comprises:
And calculates a center point of the backlight area based on an average of coordinate values of pixels constituting the outermost region of the backlight region.
Wherein the moving distance of the image is inversely proportional to the distance between the center point of the backlight region and the center point of the image.
Wherein the image processing unit sets a virtual center area at the center of the image and determines whether an area included in the center area of the backlight area is less than a preset threshold ratio,
Wherein the lens control unit controls the fluid lens such that at least a part of the backlight area is avoided in the image when the area of the backlight area included in the central area is judged to be less than the threshold ratio by the image processing unit, Vehicle monitoring system.
Wherein the image processing unit comprises:
When an area included in the central area of the backlight area is determined by the image processing unit to be equal to or less than the threshold ratio,
Calculating a center point of an area not included in the center area and a center point of the image,
Wherein the lens control unit controls the curvature of the fluid lens such that the image is moved in a direction of a virtual extension line connecting the center point of the region not included in the central region and the center point of the image, .
The camera comprises:
A first camera for photographing the left rear of the vehicle, and a second camera for photographing the right rear of the vehicle.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150129627A KR20170031982A (en) | 2015-09-14 | 2015-09-14 | Monitoring system for vehicle |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150129627A KR20170031982A (en) | 2015-09-14 | 2015-09-14 | Monitoring system for vehicle |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20170031982A true KR20170031982A (en) | 2017-03-22 |
Family
ID=58497427
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150129627A KR20170031982A (en) | 2015-09-14 | 2015-09-14 | Monitoring system for vehicle |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20170031982A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20230042996A (en) * | 2021-09-23 | 2023-03-30 | 한국자동차연구원 | Camera control system for responding to backlight based on camera angle adjustment |
EP4239588A1 (en) * | 2022-03-02 | 2023-09-06 | Hyundai Mobis Co., Ltd. | Method and apparatus for detecting backlight of image |
-
2015
- 2015-09-14 KR KR1020150129627A patent/KR20170031982A/en unknown
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20230042996A (en) * | 2021-09-23 | 2023-03-30 | 한국자동차연구원 | Camera control system for responding to backlight based on camera angle adjustment |
EP4239588A1 (en) * | 2022-03-02 | 2023-09-06 | Hyundai Mobis Co., Ltd. | Method and apparatus for detecting backlight of image |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6084434B2 (en) | Image processing system and image processing method | |
US7646889B2 (en) | Rain sensor | |
CN111447358B (en) | Image pickup apparatus | |
KR102263725B1 (en) | Method and apparatus for providing driving information | |
US20120056902A1 (en) | Multi-display apparatus | |
JP2014116756A (en) | Periphery monitoring system | |
WO2007111220A1 (en) | Road division line detector | |
US9317755B2 (en) | Travel lane boundary line detection apparatus | |
JP5171723B2 (en) | Obstacle detection device and vehicle equipped with the device | |
JP6750519B2 (en) | Imaging device, imaging display method, and imaging display program | |
EP2770478B1 (en) | Image processing unit, imaging device, and vehicle control system and program | |
US20140055572A1 (en) | Image processing apparatus for a vehicle | |
EP2698292A1 (en) | Wiper control apparatus | |
JP2010088045A (en) | Night view system, and nighttime walker display method | |
US20170136962A1 (en) | In-vehicle camera control device | |
US11077793B2 (en) | Rearview display device, rearview display method, and program | |
WO2015129280A1 (en) | Image processing device and image processing method | |
CN111038383B (en) | Vehicle and control method thereof | |
KR20170002330A (en) | Driver-customized display variable apparatus and method for controlling the same | |
JP2018007038A (en) | Electronic device, automobile, imaging device, and image recording device | |
KR20170031982A (en) | Monitoring system for vehicle | |
US20130222376A1 (en) | Stereo image display device | |
US10089731B2 (en) | Image processing device to reduce an influence of reflected light for capturing and processing images | |
KR20150079004A (en) | Dispay apparatus of vehicle and contolling method for the same | |
KR101278237B1 (en) | Method and apparatus for recognizing vehicles |