CN107640160A - Safe driving of vehicle accessory system and its control method - Google Patents

Safe driving of vehicle accessory system and its control method Download PDF

Info

Publication number
CN107640160A
CN107640160A CN201610556833.5A CN201610556833A CN107640160A CN 107640160 A CN107640160 A CN 107640160A CN 201610556833 A CN201610556833 A CN 201610556833A CN 107640160 A CN107640160 A CN 107640160A
Authority
CN
China
Prior art keywords
driver
image
vehicle
sunshading board
sunglasses
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610556833.5A
Other languages
Chinese (zh)
Other versions
CN107640160B (en
Inventor
唐帅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Audi AG
Original Assignee
Audi AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Audi AG filed Critical Audi AG
Priority to CN201610556833.5A priority Critical patent/CN107640160B/en
Publication of CN107640160A publication Critical patent/CN107640160A/en
Application granted granted Critical
Publication of CN107640160B publication Critical patent/CN107640160B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The present invention relates to safe driving of vehicle accessory system and its control method.The safe driving of vehicle accessory system includes:Image-capture portion, its external environment condition image and internal environment image for being configured to capture this vehicle;First processing unit, it is configured to the road environment based on the external environment condition image recognition this vehicle periphery;Second processing portion, it is configured to whether the driver based on this vehicle described in the internal environment spectral discrimination wears sunglasses or/and whether use sunshading board;And control unit, it is configured to the result of determination of recognition result and the second processing portion based on first processing unit and gives early warning to driver.Vehicle according to the invention safe driving assistant system, is capable of the wearing state of the sunglasses of basis or the road environment of the use state of sunshading board and this vehicle front, and corresponding early warning is given to driver, so as to avoid driver in danger situation down train.

Description

Safe driving of vehicle accessory system and its control method
Technical field
Present invention relates in general to vehicle safety control field, more particularly to vehicle drive safety assisting system and its control Method.
Background technology
Generally, when driver is in the stronger road environment down train of the light such as sunny or snowfield, generally Sunglasses, sunshading board etc. can be selected to be in the light equipment to mitigate caused by eye strain or the strong light stimulus caused by pupil regulation Eye injuries.In some cases, driver may not realize that above-mentioned strong light stimulus when driving, therefore also just not have Have or even forget that selection uses sunglasses or sunshading board.But driver do not wear sunglasses or using sunshading board but it is long when Between it is extremely dangerous in the stronger road environment down train of light.Therefore, now need to carry out appropriate early warning to driver.
In addition, although driver selects sunglasses, sunshading board etc. to avoid strong light under the stronger road environment of light Stimulate, still, when after the sun sets or in the road environment that vehicle enters the darks such as tunnel, garage, if driven The person of sailing is continued to wear sunglasses or driven a vehicle using sunshading board, then may deteriorate eyes and dark environment is not suitable with.Cause This, it is also extremely dangerous that driver drives a vehicle in this case, is now also required to carry out necessary early warning to driver.
The content of the invention
In view of said circumstances, it is an object of the invention to provide a kind of vehicle drive assist system, its can basis too The wearing state of positive mirror or the road environment of the use state of sunshading board and this vehicle periphery, given to driver corresponding pre- Alert prompting, so as to avoid driver in danger situation down train.It is a kind of for realizing the car the present invention also aims to provide The control method of safe driving assistant system.
According to one embodiment of present invention, it is proposed that a kind of safe driving of vehicle accessory system, including:Image capture Portion, its external environment condition image and internal environment image for being configured to capture this vehicle;First processing unit, it is configured to be based on The road environment of this vehicle periphery described in the external environment condition image recognition;Second processing portion, it is configured to based on described interior Portion's ambient image judges whether the driver of described vehicle wears sunglasses or/and whether use sunshading board;And control unit, It is configured to the result of determination of recognition result and the second processing portion based on first processing unit and given to driver Early warning.
According to a preferred embodiment of the invention, first processing unit is construed as including:Calculating part, it is configured to count Calculate the average brightness value of the external environment condition image;And determination unit, its be configured to by by the average brightness value with it is more Individual threshold value is compared to identify the road environment of described vehicle front.
According to a preferred embodiment of the invention, the control unit is also structured to:Sentence when described in first processing unit Determine portion and be determined as that the average brightness value is less than first threshold and when the second processing portion is determined as that driver has worn too Positive mirror or/and when having used sunshading board, the early warning removed sunglasses or/and pack up sunshading board is given to driver.
According to a preferred embodiment of the invention, the control unit is also structured to:Sentence when described in first processing unit Determining portion is determined as the average brightness value continuously less than first threshold up to scheduled time slot and when the second processing portion is determined as When driver has worn sunglasses or/and used sunshading board, given to driver and remove sunglasses or/and pack up sunshading board Early warning.
According to a preferred embodiment of the invention, the control unit is also structured to:Sentence when described in first processing unit Determine portion and be determined as that the average brightness value is more than Second Threshold and when the second processing portion is determined as that driver does not wear too When positive mirror or/and unused sunshading board, the early warning worn sunglasses or/and put down sunshading board is given to driver.
According to a preferred embodiment of the invention, the control unit is also structured to:Sentence when described in first processing unit Determine portion and be determined as that the average brightness value is persistently more than Second Threshold up to scheduled time slot and when the second processing portion is determined as When driver does not wear sunglasses or/and unused sunshading board, give wearing sunglasses to driver or/and put down sunshading board Early warning.
According to a preferred embodiment of the invention, the second processing portion is configured to:Using face detection method from by described The face-image of driver is separated in the internal environment image of image-capture portion capture;From it is separated go out face-image in Extract the provincial characteristics of the circumference of eyes of driver;And judge whether driver wears too based on the provincial characteristics extracted Positive mirror.
According to a preferred embodiment of the invention, the second processing portion is configured to:Captured from by described image capture portion The internal environment image in separate driver face-image;And using shadow Detection method to it is separated go out face scheme As being analyzed to judge whether driver uses sunshading board.
According to another embodiment of the present invention, it is proposed that a kind of controlling party for realizing aforementioned vehicle safe driving assistant system Method, comprise the following steps:Image capture step, capture the external environment condition image and internal environment image of this vehicle;First processing Step, the road environment based on this vehicle periphery described in the external environment condition image recognition;Second processing step, based on described interior Portion's ambient image judges whether the driver of described vehicle wears sunglasses or/and whether use sunshading board;And control step Suddenly, the result of determination of recognition result and the second processing step based on first processing step gives early warning to driver Prompting.
According to a preferred embodiment of the invention, first processing step includes:Calculation procedure, calculate the external environment condition The average brightness value of image;And determination step, by the way that the average brightness value and multiple threshold values are compared to identify institute State the road environment of this vehicle front.
According to a preferred embodiment of the invention, the rate-determining steps include:When being determined as that the average brightness value is less than the When one threshold value and driver have worn sunglasses or/and used sunshading board, given to driver and remove sunglasses or/and receipts Play the early warning of sunshading board.
According to a preferred embodiment of the invention, the rate-determining steps include:When be determined as the average brightness value continue it is small When first threshold has worn sunglasses or/and used sunshading board up to scheduled time slot and driver, give and pluck to driver Fall sunglasses or/and pack up the early warning of sunshading board.
According to a preferred embodiment of the invention, the rate-determining steps include:When being determined as that the average brightness value is more than the When two threshold values and driver do not wear sunglasses or/and unused sunshading board, given to driver and wear sunglasses or/and put The early warning of lower sunshading board.
According to a preferred embodiment of the invention, the rate-determining steps also include:When being determined as that the average brightness value continues More than Second Threshold up to scheduled time slot and driver do not wear sunglasses or/and unused sunshading board when, given to driver Wear sunglasses or/and put down the early warning of sunshading board.
According to a preferred embodiment of the invention, the second processing step includes:Using face detection method from the inside The face-image of driver is separated in ambient image;From it is separated go out face-image in extract driver circumference of eyes area Characteristic of field;And whether sunglasses is worn judging driver based on the provincial characteristics extracted or/and whether uses sunshading board.
According to a preferred embodiment of the invention, the second processing step includes:Separated from the internal environment image The face-image of driver;And using shadow Detection method to it is separated go out face-image analyzed to judge that driver is It is no to use sunshading board.
Therefore, vehicle according to the invention safe driving assistant system and its control method, it is capable of the sunglasses of basis The road environment of the use state and this vehicle periphery of wearing state or sunshading board, give corresponding early warning to driver and carry Show, so as to avoid driver in danger situation down train.
Brief description of the drawings
Fig. 1 shows the summary block diagram of the safe driving of vehicle accessory system according to the first embodiment of the present invention.
Fig. 2 shows the specific block diagram of the safe driving of vehicle accessory system according to the first embodiment of the present invention.
Fig. 3 shows the summary flow chart of control method according to the second embodiment of the present invention.
Fig. 4 shows the particular flow sheet of the processing for the road environment for identifying this vehicle periphery.
Fig. 5 shows the particular flow sheet for judging the processing whether driver wears sunglasses.
Embodiment
In order that the goal of the invention and technique effect of the present invention are clearer, the reality of the present invention is described below with reference to accompanying drawings Apply example.However, it is understood that following detailed description and drawings are used for the principle for exemplarily illustrating the present invention, the present invention is not It is limited to described preferred embodiment, the scope of the present invention is defined by the claims.
Fig. 1 shows the summary block diagram of the safe driving of vehicle accessory system 100 according to the first embodiment of the present invention With specific schematic diagram.As shown in figure 1, the safe driving of vehicle accessory system 100 includes image-capture portion 10, the first processing unit 20th, second processing portion 30 and control unit 40.
As shown in Fig. 2 image-capture portion 10 includes the first image-capture portion 11 and the second image-capture portion 12, it is respectively used to Capture the external environment condition image and internal environment image of this vehicle.First image-capture portion 11 for example can be wide angle cameras, It is installed to the vehicle body surrounding of this vehicle to obtain 360 ° of panoramic pictures.Preferably, the first image-capture portion 11 can be installed to At the front bumper or windshield of this vehicle, to capture the external environment condition image of this vehicle front.Second image-capture portion 12 Can also be wide angle cameras, it is arranged on above the instrument board of this vehicle, room mirror is nearby or on the A posts of left side.Second Image-capture portion 12 can capture the internal environment image of the face-image including driver, upper part of the body image etc..
First processing unit 20 is based on external environment condition image recognition this vehicle periphery captured by the first image-capture portion 11 Road environment.For example, as shown in Fig. 2 the first processing unit 20 includes calculating part 21, for calculating the average bright of external environment condition image Angle value;And determination unit 22, for by will be entered by the average brightness value that calculating part 21 obtains and multiple threshold values set in advance Row relatively judges the road environment of this vehicle front.
The external environment condition image captured by the first image-capture portion 11 is changed into multiple pixel (examples by calculating part 21 first Such as, resolution ratio is 800 × 600 480,000 pixel), wherein each pixel has corresponding (R, G, B) numerical value.Then, count Calculation portion 21 calculates the brightness of each pixel.For example, calculating part 21 (R, G, B) numerical value of each pixel can be converted into (L, a, B) model, wherein numerical value L represent the brightness value of respective pixel.Then, brightness number of the calculating part 21 to the plurality of pixel is averaging Value, so as to obtain the average brightness value of the external environment condition image.
Determination unit 22 is by the average brightness value obtained by calculating part 21 and multiple threshold values set in advance (for example, the first threshold Value, more than Second Threshold of first threshold etc.) be compared, and the road ring of this vehicle front is judged based on the comparative result Border.For example, when the average brightness value of external environment condition image is less than first threshold, determination unit 22 is determined as the road of this vehicle front Road light is relatively dark, it means that, for example, being exactly now, or this vehicle may be sitting at tunnel, garage the dusk time-division In.On the contrary, when the average brightness value of external environment condition image is more than Second Threshold, determination unit 22 is determined as the road of this vehicle front Road light is relatively bright, it means that, for example, now sunlight is more dazzling or this vehicle may be travelled just on snowfield.
Whether worn based on the internal environment spectral discrimination driver captured by the second image-capture portion 12 in second processing portion 30 Wear sunglasses.For example, second processing portion 30 is analyzed by the second image-capture portion by using computer vision and pattern classification The internal environment image of capture, to judge whether driver wears sunglasses.Specifically, second processing portion 30 passes through face first The face-image that driver is separated in the internal environment image that is captured from the second image-capture portion 12 is detected, then from isolating Face-image in extract driver eye around provincial characteristics (for example, shape, texture, color etc.), will then be extracted Provincial characteristics compared with the individual features prestored, be finally based on comparative result to judge whether driver wears too Positive mirror.
The result of determination of result of determination and second processing portion 30 of the control unit 40 based on the first processing unit 20 is sent out to driver Send the early warning for wearing/removing sunglasses.For example, when the determination unit 22 of the first processing unit 20 is determined as by the first image capture The average brightness value for the external environment condition image that portion 11 captures is less than first threshold and when second processing portion 30 is determined as driver When having worn sunglasses, it means that driver is wearing sunglasses or will drive car under the road environment of dark , and this situation is than relatively hazardous, thus control unit 40 sends the early warning for removing sunglasses to driver.And for example, when The determination unit 22 of one processing unit 20 is determined as that the average brightness value of the external environment condition image captured by the first image-capture portion 11 is big In Second Threshold and when second processing portion 30 is determined as that driver does not wear sunglasses, it means that driver does not wear too Positive mirror but vehicle will be driven or under the stronger road environment of light, and this situation is also than relatively hazardous, thus control unit 40 send the early warning for wearing sunglasses to driver.
Therefore, according to the safe driving of vehicle accessory system 100 of the first embodiment of the present invention, can be worn according to driver The state of sunglasses and the road environment of this vehicle front are worn, the early warning for wearing/removing sunglasses is given to driver, So as to avoid driver in danger situation down train.
Moreover it is preferred that second processing portion 30 is also sentenced based on the internal environment image captured by the second image-capture portion 12 Determine whether driver uses sunshading board.Specifically, second processing portion 30 is caught by Face datection method from by the second image first Obtain portion 12 capture internal environment image in separate driver's face-image, then by shadow Detection method to it is separated go out face Portion's image is analyzed to judge whether driver uses sunshading board.For example, can judging driver's face shade to be present and When not having shade around upper body, judgement has used sunshading board.Then, when the determination unit 22 of the first processing unit 20 is determined as by first The average brightness value for the external environment condition image that image-capture portion 11 captures is less than first threshold and when second processing portion 30 judges When having used sunshading board for driver, it means that driver has used sunshading board but or by the weaker road ring of light Drive vehicle under border, and this situation is than relatively hazardous, thus control unit 40 sends the early warning for packing up sunshading board to driver. And for example, being averaged when the external environment condition image that the determination unit 22 of the first processing unit 20 is judged to being captured by the first image-capture portion 11 Brightness value is more than Second Threshold and when second processing portion 30 is determined as that sunshading board is not used in driver, it means that driver Sunshading board is not used but drives vehicle under the stronger road environment of light, and this situation is also than relatively hazardous, thus control unit 40 send the early warning for putting down sunshading board to driver.
Therefore, vehicle according to the invention safe driving assistant system 100, also sunglasses can be used according to driver The road environment of state and this vehicle front, given to driver put down/pack up sunshading board, so as to avoid driver in danger Situation down train.
In addition, as Additional embodiments or alternately, the determination unit 22 of the first processing unit 20 can be with Judge whether this vehicle is continuously in a certain specified link environment (for example, tunnel or snowfield etc.), i.e., determination unit 22 also judge by Whether whether the average brightness value for the external environment condition image that calculating part 21 is calculated continuously less than first threshold or continue big Scheduled time slot (for example, 3 minutes) is reached in Second Threshold.Also, when determination unit 22 is judged to being captured by the first image-capture portion 11 External environment condition image average brightness value continuously less than first threshold up to scheduled time slot and when second processing portion 30 is determined as When driver has worn sunglasses or has used sunshading board, it means that driver has worn sunglasses or used sunshading board to exist Vehicle is driven under the road environment of dark and continue for a period of time, thus control unit 40 sends to driver and removed too Positive mirror or the early warning for packing up sunshading board.And for example, when determination unit 22 is determined as the outside that is captured by the first image-capture portion 11 The average brightness value of ambient image is persistently more than Second Threshold up to scheduled time slot and when second processing portion 30 is determined as driver When not wearing sunglasses or unused sunshading board, it means that driver does not wear sunglasses or unused sunshading board but in light Vehicle is driven under stronger road environment and continue for a period of time, thus control unit 40 sends to driver and wears sunglasses Or put down the early warning of sunshading board.The length of scheduled time slot, such as several seconds can be set as the case may be to several minutes.With This mode, the early warning in particular cases excessively continually given early warning at some or give mistake can be avoided, For example, outside road of the vehicle continuously across short intervals between a series of short culvert or several sections of longer tunnels, car By short-range tree shade region or short-range light area etc. on road.
In the case, for instance, it is preferred that as shown in Fig. 2 determination unit 22 can include timer 221, for calculate by First image-capture portion 11 capture external environment condition image average brightness value continuously less than first threshold duration or hold The continuous duration more than Second Threshold.For example, when determination unit 22 is determined as that the average brightness value of external environment condition image is less than the During one threshold value (the road light of this vehicle front is relatively dark), now timer 221 is triggered to start to calculate external rings For the average brightness value of border image continuously less than the duration of first threshold, i.e. driver is descending in the road environment of dark The duration sailed, and afterwards when determination unit 22 is determined as that the average brightness value of external environment condition image is not less than first threshold When, timer 221 is reset, such as is recovered to original state or clearing.If by timer 221 is calculating, external rings The average brightness value of border image is more than the scheduled time continuously less than the duration of first threshold and second processing portion 30 is determined as When driver has worn sunglasses or used sunshading board, control unit 40 will be sent to driver to be removed sunglasses or packs up sunshade The early warning of plate.
For another example, when determination unit 22 is determined as that the average brightness value of external environment condition image is more than Second Threshold (i.e. before this vehicle The road light of side is relatively bright) when, now, timer 221 is also triggered to start to calculate the average bright of external environment condition image Angle value be more than Second Threshold duration, i.e. driver in the duration of the brighter road environment downward driving of light, and Afterwards when determination unit 22 is determined as that the average brightness value of external environment condition image is not more than Second Threshold, timer 221 is by again Set, such as recover to original state or clearing.If the external environment condition image captured by the first image-capture portion 11 is averaged Duration of the brightness value persistently more than Second Threshold is more than scheduled time slot but driver is still without wearing sunglasses or use Sunshading board.Thus, control unit 40 will be more than scheduled time slot in the duration calculated by timer 221 and second processing portion 30 is sentenced When being set to driver and not wearing sunglasses or unused sunshading board, sent to driver and wear sunglasses or put down the pre- of sunshading board Alert prompting.
Therefore, according to the safe driving of vehicle accessory system 100 of the first embodiment of the present invention, can be according to driver The no state worn sunglasses or used sunshading board and driver certain specified link environment down train it is lasting when Between ,/remove sunglasses, put down/is given and worn to driver and packs up the early warning of sunshading board, so as to avoid driver in danger Situation down train.
Preferably, early warning includes vision early warning, sense of hearing early warning or tactile early warning.For example, control Portion 40 can show text informations such as " please wear/remove sunglasses " or " use/please pack up sunshading board " on Vehicular display device, Wherein, Vehicular display device can be head-up display, Vehicular navigation system display, be mounted or connected to any of main vehicle Other displays.Control unit 40 can also control specific light to light or flash to provide visual cues.Control unit 40 may be used also To be sounded the alarm or " please wear/remove sunglasses " or " please make using speaker systems such as loudspeaker, buzzer, loudspeaker With/pack up sunshading board " etc. voice.In addition, control unit 40 can also be given by the vibration of pilot set, steering wheel to driver Give tactile pre-warning signal.
Below with reference to Fig. 3, Fig. 4 and Fig. 5 come describe according to the second embodiment of the present invention, realize above-mentioned vehicle drive The control operation step of accessory system 100, wherein Fig. 3 show the flow of control method according to the second embodiment of the present invention Figure, Fig. 4 shows the particular flow sheet of the processing step for the road environment for judging this vehicle periphery, and Fig. 5 shows judgement Whether driver wears the particular flow sheet of the processing step of sunglasses.
As shown in figure 3, in step S1, capture this vehicle internal environment image and external environment condition image (image capture walks Suddenly).
In step S2, the road environment (based on external environment condition image recognition this vehicle periphery captured in step sl One processing step), its recognition result is then output to step S4.
As shown in figure 4, in step S21, the average brightness value of the captured external environment condition image of calculating.Specifically, by institute The external environment condition image of capture changes into multiple pixels (for example, for example, resolution ratio is 800 × 600 480,000 pixel), Wherein each pixel has corresponding brightness, then calculates the average value of the brightness of the plurality of pixel, so as to obtain the external rings The average brightness value of border image.In step S22, by by average brightness value resulting in the step s 21 with it is set in advance Multiple threshold values (for example, first threshold, more than Second Threshold of first threshold etc.) are compared to judge the road of this vehicle front Road environment.For example, in step S22, judge whether average brightness value resulting in the step s 21 is less than first by comparing Whether threshold value is more than Second Threshold.If the average brightness value of external environment condition image is less than first threshold, it is determined as this The road light of vehicle front is relatively dark, it means that, for example, be exactly now, or this vehicle may normotopia. the dusk time-division In tunnel, garage.On the contrary, when if the average brightness value of external environment condition image is more than Second Threshold, it is determined as this vehicle The road light in front is relatively bright, it means that, for example, now sunlight is more dazzling or this vehicle may be just in snowfield Upper traveling.Then, if being determined as "Yes" in step 22, i.e., resulting average brightness value is less than first in the step s 21 Threshold value or during more than Second Threshold, exports result of determination in step S23, i.e., its result of determination is output into S4.
In addition, after step S23 exports result of determination, further judge in step 24 in the outside that step S1 is captured Whether whether the average brightness value of ambient image continuously less than first threshold or persistently reach scheduled time slot more than Second Threshold.If It is determined as "Yes", then processing is forwarded to step S25, and the result of determination is also output into S4.
In step S3, whether sunglasses (is worn based on the internal environment spectral discrimination driver captured in step sl Two processing steps), and its result of determination is also then output to S4.
As shown in figure 5, in step S31, driver is separated from the internal environment image captured by Face datection method Face-image;In step S32, the provincial characteristics around driver eye is extracted from the face-image isolated (for example, shape Shape, texture, color etc.);In step S33, by by the provincial characteristics extracted compared with the individual features prestored To judge whether driver has worn sunglasses;Then result of determination is exported in step S34, i.e., its result of determination is output to step Rapid S4.
In step S4, the result of determination of result of determination and step S3 based on step S2 gives corresponding early warning to driver Prompting.For example, ought be determined as in step s 2 captured internal environment image average brightness value be less than first threshold and When being determined as that driver has worn sunglasses in step s3, the early warning for removing sunglasses is given to driver.When in step Be determined as in rapid S2 the average brightness value of captured internal environment image continuously less than first threshold up to scheduled time slot and When being determined as that driver has worn sunglasses in step S3, the early warning for removing sunglasses is given to driver again.
And for example, in step s 4, when the average brightness value for being determined as captured internal environment image in step s 2 is big When being determined as when Second Threshold and in step s3 that driver wears sunglasses, given to driver and wear the pre- of sunglasses Alert prompting.When the average brightness value for being determined as captured internal environment image in step s 2 is persistently more than Second Threshold up in advance During timing section and when being determined as that driver does not wear sunglasses in step s3, the early warning for wearing sunglasses is given to driver Prompting.
Therefore, according to the control method of the present invention, before state and this vehicle that sunglasses can be used according to driver The road environment of side, the early warning for removing/wearing sunglasses is given to driver, so as to avoid driver under danger situation Driving.
In addition, control method as shown in Figure 3 can also be used to the early warning of sunshading board, only difference is that The judgement whether used sunshading board.Specifically, when judging whether driver uses sunshading board, should be examined first by face Survey method separates the face-image of driver and the image of driver's upper part of the body from the internal environment image captured in step S1, Then by shadow Detection method to it is separated go out face-image and the image of the upper part of the body analyzed whether to judge driver Use sunshading board.
Although describe some examples for vehicle according to the invention safe driving assistant system above with reference to accompanying drawing Property example, still, these illustrative examples not with limitation the present invention, other embodiment is also feasible.
In the aforementioned embodiment, the second image-capture portion is arranged on above the instrument board of this vehicle, near room mirror Or on the A posts of left side, to capture the internal environment image relevant with driver, and second processing portion passes through face detection and figure Judge the use state of sunshading board as the methods of classification.But the present invention is not limited thereto.For example, the second image-capture portion It can also be arranged on above the seat of driver, the internal environment image of sunshading board be included with capture, then second processing Portion is directly based upon the use state that the internal environment image including sunshading board decides that sunshading board.So, it is possible to reduce mistake Judgement.
In the aforementioned embodiment, safe driving of vehicle accessory system passes through the external environment condition figure to being captured by image-capture portion As being analyzed to judge the road environment of this vehicle front.But the present invention is not limited thereto.For example, safe driving of vehicle Accessory system can also know the road environment of this vehicle front using the navigation data of global positioning system (GPS).
While the invention has been described with reference to exemplary embodiments thereof, however, it is understood that the present invention is not limited to above-mentioned reality Apply the construction and method of example.On the contrary, it is intended to cover various modifications and equivalent arrangements.In addition, although in various examples Property combination and construction in show the various elements and method and step of disclosed invention, but including more, less element Or other combinations of method are also fallen within the scope of the present invention.

Claims (10)

1. a kind of safe driving of vehicle accessory system, including:
Image-capture portion, its external environment condition image and internal environment image for being configured to capture this vehicle;
First processing unit, it is configured to the road environment based on this vehicle periphery described in the external environment condition image recognition;
Second processing portion, it is configured to whether the driver based on this vehicle described in the internal environment spectral discrimination wears too Positive mirror or/and whether use sunshading board;And
Control unit, its be configured to the result of determination of recognition result and the second processing portion based on first processing unit to Driver gives early warning.
2. safe driving of vehicle accessory system according to claim 1, wherein, first processing unit is configured to wrap Include:
Calculating part, it is configured to the average brightness value for calculating the external environment condition image;And
Determination unit, it is configured to by the way that the average brightness value and multiple threshold values are compared to before identifying described vehicle The road environment of side.
3. safe driving of vehicle accessory system according to claim 2, wherein, the control unit is configured to:
When the determination unit of first processing unit is determined as that the average brightness value is less than first threshold and when described the When two processing units are determined as that driver has worn sunglasses or/and used sunshading board, given to driver remove sunglasses or/ With the early warning for packing up sunshading board.
4. safe driving of vehicle accessory system according to claim 2, wherein, the control unit is also structured to:
When the determination unit of first processing unit is determined as that the average brightness value reaches pre- timing continuously less than first threshold Section and when the second processing portion is determined as that driver has worn sunglasses or/and used sunshading board, given to driver Give the early warning removed sunglasses or/and pack up sunshading board.
5. safe driving of vehicle accessory system according to claim 2, wherein, the control unit is configured to:
When the determination unit of first processing unit is determined as that the average brightness value is more than Second Threshold and when described the When two processing units are determined as that driver does not wear sunglasses or/and unused sunshading board, to driver give wear sunglasses or/ With the early warning for putting down sunshading board.
6. safe driving of vehicle accessory system according to claim 2, wherein, the control unit is also structured to:
When the determination unit of first processing unit is determined as that the average brightness value is persistently more than Second Threshold up to pre- timing Section and when the second processing portion is determined as that driver does not wear sunglasses or/and unused sunshading board, given to driver Give the early warning worn sunglasses or/and put down sunshading board.
7. safe driving of vehicle accessory system according to claim 1, wherein, the second processing portion is configured to:
The face of driver is separated from the internal environment image captured by described image capture portion using face detection method Image;
From it is separated go out face-image in extract driver circumference of eyes provincial characteristics;And
Judge whether driver wears sunglasses based on the provincial characteristics extracted.
8. safe driving of vehicle accessory system according to claim 1, wherein, the second processing portion is configured to:
The face-image of driver is separated from the internal environment image captured by described image capture portion;
Using shadow Detection method to it is separated go out face-image analyzed to judge whether driver uses sunshading board.
9. a kind of control method, comprises the following steps:
Image capture step, capture the external environment condition image and internal environment image of this vehicle;
First processing step, the road environment based on this vehicle periphery described in the external environment condition image recognition;
Second processing step, the driver based on this vehicle described in the internal environment spectral discrimination whether wear sunglasses or/ Whether sunshading board is used;And
Rate-determining steps, the result of determination of recognition result and the second processing step based on first processing step is to driving Member gives early warning.
10. control method according to claim 9, wherein, first processing step includes:
Calculation procedure, calculate the average brightness value of the external environment condition image;And
Determination step, by giving the average brightness value and multiple threshold values to comparison to identify the road of described vehicle front Environment.
CN201610556833.5A 2016-07-14 2016-07-14 Vehicle safe driving auxiliary system and control method thereof Active CN107640160B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610556833.5A CN107640160B (en) 2016-07-14 2016-07-14 Vehicle safe driving auxiliary system and control method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610556833.5A CN107640160B (en) 2016-07-14 2016-07-14 Vehicle safe driving auxiliary system and control method thereof

Publications (2)

Publication Number Publication Date
CN107640160A true CN107640160A (en) 2018-01-30
CN107640160B CN107640160B (en) 2021-08-20

Family

ID=61108861

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610556833.5A Active CN107640160B (en) 2016-07-14 2016-07-14 Vehicle safe driving auxiliary system and control method thereof

Country Status (1)

Country Link
CN (1) CN107640160B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111169483A (en) * 2018-11-12 2020-05-19 奇酷互联网络科技(深圳)有限公司 Driving assisting method, electronic equipment and device with storage function
CN112572110A (en) * 2019-09-30 2021-03-30 北京车和家信息技术有限公司 Sun shield control method and device and vehicle
CN113989889A (en) * 2021-10-28 2022-01-28 上海商汤临港智能科技有限公司 Shading plate adjusting method and device, electronic equipment and storage medium
CN114516270A (en) * 2022-03-11 2022-05-20 禾多科技(北京)有限公司 Vehicle control method, device, electronic equipment and computer readable medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE20303145U1 (en) * 2003-02-26 2003-05-08 Power Digital Comm Co Sun visor panel for attaching to the windshield of a vehicle and provided with a digital sound system and alarm system
CN102848884A (en) * 2012-09-25 2013-01-02 浙江吉利汽车研究院有限公司杭州分公司 Intelligent adjusting system of automobile sun-shading plate
CN103770708A (en) * 2012-10-22 2014-05-07 通用汽车环球科技运作有限责任公司 Dynamic rearview mirror adaptive dimming overlay through scene brightness estimation
CN204956041U (en) * 2015-08-06 2016-01-13 北汽福田汽车股份有限公司 Sunshading board control system of vehicle and have its vehicle
CN105549222A (en) * 2016-01-25 2016-05-04 重庆工业职业技术学院 Light-control sunglasses special for driver
CN105644320A (en) * 2015-12-29 2016-06-08 小米科技有限责任公司 Sun visor adjustment method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE20303145U1 (en) * 2003-02-26 2003-05-08 Power Digital Comm Co Sun visor panel for attaching to the windshield of a vehicle and provided with a digital sound system and alarm system
CN102848884A (en) * 2012-09-25 2013-01-02 浙江吉利汽车研究院有限公司杭州分公司 Intelligent adjusting system of automobile sun-shading plate
CN103770708A (en) * 2012-10-22 2014-05-07 通用汽车环球科技运作有限责任公司 Dynamic rearview mirror adaptive dimming overlay through scene brightness estimation
CN204956041U (en) * 2015-08-06 2016-01-13 北汽福田汽车股份有限公司 Sunshading board control system of vehicle and have its vehicle
CN105644320A (en) * 2015-12-29 2016-06-08 小米科技有限责任公司 Sun visor adjustment method and device
CN105549222A (en) * 2016-01-25 2016-05-04 重庆工业职业技术学院 Light-control sunglasses special for driver

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111169483A (en) * 2018-11-12 2020-05-19 奇酷互联网络科技(深圳)有限公司 Driving assisting method, electronic equipment and device with storage function
CN112572110A (en) * 2019-09-30 2021-03-30 北京车和家信息技术有限公司 Sun shield control method and device and vehicle
CN113989889A (en) * 2021-10-28 2022-01-28 上海商汤临港智能科技有限公司 Shading plate adjusting method and device, electronic equipment and storage medium
CN114516270A (en) * 2022-03-11 2022-05-20 禾多科技(北京)有限公司 Vehicle control method, device, electronic equipment and computer readable medium
CN114516270B (en) * 2022-03-11 2023-09-12 禾多科技(北京)有限公司 Vehicle control method, apparatus, electronic device, and computer-readable medium

Also Published As

Publication number Publication date
CN107640160B (en) 2021-08-20

Similar Documents

Publication Publication Date Title
CN106709420B (en) Method for monitoring driving behavior of commercial vehicle driver
JP5171629B2 (en) Driving information providing device
KR101579098B1 (en) Stereo camera, driver assistance apparatus and Vehicle including the same
US8823792B2 (en) Wakefulness level estimation apparatus
CN107640160A (en) Safe driving of vehicle accessory system and its control method
KR101631439B1 (en) Camera and Vehicle including the same
EP1769969A2 (en) Apparatus and method for controlling notification, recording media, and program
US9787892B2 (en) Safety device for motorcycle riders and method for operating a safety device for motorcycle riders
CN104972967B (en) Warning for vehicle is adjusted based on response time study
KR101546893B1 (en) System for checking doze at the vehicle
JP2016103249A (en) Driving support device and driving support method
JP2008199515A (en) Fellow passenger sitting posture detecting/determining apparatus and method
CN108482367A (en) A kind of method, apparatus and system driven based on intelligent back vision mirror auxiliary
CN102555982A (en) Safety belt wearing identification method and device based on machine vision
CN108701415A (en) Drive assistance device, driving assistance method and driving auxiliary program
US20160232415A1 (en) Detection detection of cell phone or mobile device use in motor vehicle
KR101410182B1 (en) Sensing system for safety alight of passenger using camera and method thereof
JP6481969B2 (en) Driver state estimation device
JP2009166783A (en) Symptom inference device
WO2017063892A1 (en) Method for examining a perception of a visual warning notice by a vehicle user, driver assistance system and motor vehicle
CN110313007B (en) System and method for identifying vehicle driver fatigue
US11772563B2 (en) In-vehicle multi-monitoring device for vehicle
CN105572869A (en) Intelligent glasses and control method of the intelligent glasses
KR101360412B1 (en) A system for monitoring loose/droway driver using head moving information
KR101421065B1 (en) Black Box For Vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant