CN114132328A

CN114132328A - Driving assistance system and method for automatically adjusting driving environment and storage medium

Info

Publication number: CN114132328A
Application number: CN202111507451.0A
Authority: CN
Inventors: 张伟; 徐向敏
Original assignee: Zhiji Automobile Technology Co Ltd
Current assignee: Zhiji Automobile Technology Co Ltd
Priority date: 2021-12-10
Filing date: 2021-12-10
Publication date: 2022-03-04
Anticipated expiration: 2041-12-10
Also published as: CN114132328B

Abstract

The invention discloses an assistant driving system and method for automatically adjusting driving environment, and a storage medium, wherein the system comprises: the state acquisition module is used for acquiring physiological state information and emotional state information of a driver in the driving process in real time; the environment acquisition module is used for acquiring environment information in the vehicle and environment information outside the vehicle in the driving process in real time; the information processing module is used for judging influence factor information causing the emotional state change of the driver according to the physiological state information, the emotional state information, the environment information in the vehicle and the environment information outside the vehicle; and the environment adjusting module is used for adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the influence factor information judged by the information processing module. The potential driving safety hidden danger can be eliminated through the invention.

Description

Driving assistance system and method for automatically adjusting driving environment and storage medium

Technical Field

The embodiment of the application relates to the technical field of automatic driving, in particular to an auxiliary driving system and method for automatically adjusting driving environment and a storage medium.

Background

With the rapid development of automobile technology, the automatic driving research is rapidly developed due to the rapid progress of diversified sensor technology, high-performance computing platform technology and high-safety control technology, so that the automatic driving research has great influence on the development of the industry and leads to the great change of future travel modes. With the advent of the era of automatic driving, more and more vehicles are added to the automatic driving line, which brings great convenience to the life of people. With the development of intelligent systems and the development of automobile control systems, the automatic driving and assistant driving technologies have been widely concerned and researched. The automatic driving technology is an important way for improving the intelligent level of road traffic and promoting transformation and upgrading of the traffic transportation industry.

When the driving body of the vehicle is changed from a human to a machine, the status of the driver during driving is faded and the role of the driver has been transferred from the driving body to the role of the passenger. For an autonomous vehicle, the effective take-over time of the driver is a very important indicator when the autonomous driving system is unable to handle the vehicle. The narrow space in the vehicle greatly influences the riding experience of a driver and the take-over state in danger; meanwhile, in a relatively closed driving environment, in the process of continuous long-time driving, the emotion and the state of a driver may be changed by the change of environmental factors inside the vehicle, such as illumination, temperature, humidity, oxygen content, carbon dioxide content and the like, and may also be influenced by environmental factors outside the vehicle, such as road conditions, weather, traffic environment and the like. Environmental factors inside and outside the vehicle can influence the driving experience and comfort level, and if the automatic driving process lacks humanized consideration to drivers, discomfort of the drivers can be caused, and even an accident situation is caused. Research shows that the driving behaviors may be affected by the emotional fluctuation of the driver due to various subjective and objective reasons, especially by the adverse physiological and psychological reactions, for example, unstable states such as violent driving and emergency braking are generated, and traffic accidents are easy to occur. Meanwhile, for an automatic driving system, the driving environment is extremely important for driving safety and comfort. Therefore, regulation of the environment in the vehicle becomes more and more important.

In the prior art, a method for controlling the emotion of a driver is as follows: the emotion information of the driver is collected, and if bad emotion is found, music is played, and an alarm sound or vibration is given. However, this method is likely to cause a driver to feel tired in a long-term repeated use, and fails to consider the influence of the driving environment on the driver's takeover time, and to consider the overall regulation of the environment in the cabin according to the road traffic environment in which the driver actually travels.

Therefore, how to improve the riding experience, adjust the state of the driver and eliminate potential driving safety hazards is a technical problem which needs to be solved by technical personnel in the field at present.

Disclosure of Invention

In view of the foregoing problems in the prior art, an object of the present application is to provide a driving assistance system and method for automatically adjusting a driving environment, and a storage medium, which can automatically adjust the driving environment by integrating an automatic driving function of a vehicle, a driving environment, and a driver state, thereby improving driving experience, adjusting the driver state, and eliminating potential driving safety hazards.

To achieve the above object, in a first aspect of embodiments of the present invention, there is provided a driving assistance system that automatically adjusts a driving environment, the system including:

the state acquisition module is used for acquiring physiological state information and emotional state information of a driver in the driving process in real time;

the environment acquisition module is used for acquiring environment information in the vehicle and environment information outside the vehicle in the driving process in real time;

the information processing module is used for judging influence factor information causing the emotional state change of the driver according to the physiological state information, the emotional state information, the environment information in the vehicle and the environment information outside the vehicle;

and the environment adjusting module is used for adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the influence factor information judged by the information processing module.

Optionally, the state acquisition module includes:

the emotion recognition module is used for judging the emotional state of the driver by utilizing micro expression recognition according to the collected facial image information of the driver;

the sensor module is used for collecting a plurality of physiological parameters of the driver for representing emotional states, and the physiological parameters at least comprise body temperature, heart rate and/or blood pressure of the driver.

Optionally, the environment acquisition module further comprises:

and the difference processing module is used for calculating the difference between the inside and the outside of the target vehicle according to the road type outside the target vehicle, the traffic state, the weather state, the light intensity outside the target vehicle, the temperature and humidity outside the target vehicle, the light intensity inside the target vehicle and the temperature and humidity inside the target vehicle.

Optionally, the information processing module includes:

the influence factor calculation module is used for acquiring the past physiological state information, the in-vehicle environment information and the out-vehicle environment information corresponding to the previous driver emotional state information when the driver emotional state information changes; and comparing the past physiological state information, the vehicle internal environment information and the vehicle external environment information with the physiological state information, the vehicle internal environment information and the vehicle external environment information corresponding to the current driver emotional state information to obtain whether influence factors influencing the change of the driver emotional state are formed by the driver physiological state, the vehicle internal environment and the vehicle external environment.

Optionally, the influence factor calculation module includes an information comparison unit, where the information comparison unit is configured to determine whether the change state of the physiological state information, the vehicle internal environment information, and the vehicle external environment information exceeds a threshold, and if the change state exceeds the threshold, determine whether the current emotional state of the driver corresponds to the changed physiological state information, the vehicle internal environment information, and the vehicle external environment information.

Optionally, the environment adjusting module comprises an emotion adjusting module and a comfort adjusting module;

the emotion adjusting module is used for adjusting and correspondingly adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle when the physiological state information, the environment information in the vehicle and the environment information outside the vehicle become influence factors of the emotional state of the driver;

and the comfort adjusting module is used for adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle corresponding to the historical comfort adjusting data of the driver when the influence factors of the emotional state of the driver are unknown.

Optionally, the environmental conditioning module further comprises:

the negative ion controller is used for detecting the concentration of negative ions in the vehicle and adjusting the concentration of the negative ions in the vehicle according to the concentration of the negative ions of the target vehicle internal environment parameter;

the gas concentration sensors are respectively arranged at the front row seats and the rear row seats of the vehicle and are used for detecting the oxygen concentration and/or the carbon dioxide concentration in the vehicle;

the air conditioner controller is used for adjusting the ambient temperature, the ambient humidity, the air conditioner air outlet speed and the air circulation mode in the vehicle according to the temperature, the humidity and the air speed in the vehicle in the target vehicle environmental parameters;

and the vehicle body controller is used for controlling the opening and closing of the sun-shading curtain in the vehicle and adjusting the light intensity of the light in the vehicle and the driving speed according to the light intensity in the vehicle in the target vehicle environment parameters.

Optionally, the riding mode includes a set riding mode initially calibrated according to a system development state and a custom riding mode recorded by driver self-collected data.

Optionally, the user-defined driving mode is formed by enabling a driver to drive the vehicle to a target environment, and enabling the system to acquire and store data parameters of the current environment in real time after the vehicle is driven to a preset distance in an idling straight line mode.

Optionally, the environment adjusting module is further configured to receive a driving mode selected by the driver autonomously and perform current in-vehicle environment parameter adjustment.

In a second aspect of the embodiments of the present invention, there is provided a driving assistance method for automatically adjusting a driving environment, the method including:

collecting vehicle environment information in a driving process in real time, and collecting physiological state information of a driver in the driving process in real time;

inquiring a pre-stored emotion database according to the physiological state information to match the emotional state of the driver;

acquiring current driving environment information according to the vehicle environment information and the emotional state of the driver;

inquiring a first corresponding relation table of the pre-stored current driving environment information and the corresponding driving mode according to the current driving environment information so as to match the driving mode;

inquiring a second corresponding relation table of the pre-stored driving mode and the corresponding target vehicle internal environment parameter according to the matched driving mode to obtain the target vehicle internal environment parameter;

and adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter.

In a third aspect of the embodiments of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the driving assistance method of automatically adjusting a driving environment as described above.

Compared with the prior art, the driving assistance system and the driving assistance method for automatically adjusting the driving environment can adjust the driving environment in the automobile in real time according to the environmental information of the automobile and the emotional state of the driver in the driving process, improve the driving experience of the driver and maintain a good take-over state for the driver; therefore, once danger which is difficult to handle by the automatic driving system occurs, the automatic driving system actively gives an alarm to remind a driver to take over, and the taking over quality of the driver in a dangerous state is greatly improved.

Drawings

FIG. 1 is a schematic diagram of an architecture of a driver assistance system for automatically adjusting a driving environment provided by the present application;

FIG. 2 is a schematic flow chart of a driving assistance method for automatically adjusting a driving environment according to the present application;

fig. 3 is another schematic flow chart of the driving assistance method for automatically adjusting the driving environment provided by the application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It is noted that the terms "comprises" and "comprising," and variations thereof, as referred to in the specification of the present application, are intended to cover non-exclusive inclusions. The terms "first," "second," and the like are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order, unless otherwise clearly indicated by the context, and it is to be understood that the data so used is interchangeable under appropriate circumstances. In addition, the embodiments and features of the embodiments in the present application may be combined with each other without conflict. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present application.

Please refer to fig. 1-2 together, in which fig. 1 is a schematic diagram of an architecture of an assistant driving system for automatically adjusting a driving environment according to the present application, and fig. 2 is a schematic diagram of an embodiment of an assistant driving system for automatically adjusting a driving environment according to the present application.

As shown in fig. 1, the driving assistance system 10 for automatically adjusting a driving environment according to the present embodiment includes: a state acquisition module 11, an environment acquisition module 12, a storage module 13 and an environment regulation module 14. Specifically, the state collecting module 11 is used for collecting the physiological state information and emotional state information of the driver in the driving process in real time, the environment collecting module 12 is used for collecting the environmental information in the vehicle and the environmental information outside the vehicle in the driving process in real time, the information processing module 13 is used for judging the influence factor information causing the emotional state change of the driver according to the physiological state information, the emotional state information, the environment information in the vehicle and the environment information outside the vehicle, the environment adjusting module 14 interacts with the state collecting module, the environment collecting module and the information processing module respectively through buses, the environment adjusting module is used for adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the influence factor information judged by the information processing module.

That is, in this embodiment, the environment adjusting module 14 may automatically match a suitable target driving environment according to the current physiological state information, vehicle environment information, emotional state, and the like of the driver, and adjust the current in-vehicle environment parameter to the target in-vehicle environment parameter corresponding to the driving mode, so as to improve driving comfort and driving safety. The state of the driver is adjusted by improving the driving environment, a comfortable driving environment and a safe and stable driving state are created, so that the driving experience is improved, the taking-over quality of the driver in a dangerous state is greatly improved, and potential safety hazards are eliminated.

In some embodiments, the state collecting module 11 includes an emotion recognition module for judging the emotional state of the driver by using micro expression recognition based on the facial image information of the driver. The environment adjusting module 14 further matches the emotional state of the driver according to the facial image information, so that the comfort in the vehicle can be adjusted subsequently by combining the emotional state of the driver. It will be appreciated that the mood of the driver may be varied, such as: joy, calm, boring, drowsiness, irritability, sadness, mania, anger, etc., and emotions may have an effect on driving conditions, such as a driver may be speeding due to a sudden temper of spleen qi. The facial expressions more or less show an internal emotion, and even when a person who is happy and not looking like a color is concentrating on driving a vehicle, the change in emotion brings about a slight change in the facial expressions (particularly, a change in eyes and lips), and the facial expressions can be realized by using a micro expression recognition technology.

In the embodiment, the camera is used for shooting the facial area of the driver, the facial image information of the driver is collected, the facial image information is identified and converted into data, and the emotion state of the driver is obtained by comparing the facial image information with the emotion database stored in advance. Because there is the difference in driver's height, the scope that mood identification module can gather through the camera includes the scope of whole main driving position as far as possible, can clearly shoot driver's five sense organs, and the camera is installed on the vehicle front windshield who matches with main driving position. It can be understood that the camera used in this embodiment does not collect all details of the face of the driver, but collects features of collected points where some obvious facial features of the face of the driver change, and then obtains the emotional state of the driver according to the information of the feature points and a pre-stored emotion database.

The camera used in this embodiment is only required to be capable of collecting facial image information of the driver, and may be, for example, an infrared camera capable of being used both in the day and at night; the present embodiment does not specifically limit the type and resolution of the camera used, and those skilled in the art can select the camera according to the actual application.

In some embodiments, the state collecting module 11 further includes a sensor module, configured to collect a plurality of physiological parameters of the driver for characterizing an emotional state, where the physiological parameters include at least a body temperature, a heart rate, and/or a blood pressure of the driver, and the environmental conditioning module 14 further matches the emotional state of the driver according to the heart rate and/or the blood pressure, so that the in-vehicle comfort conditioning may be subsequently performed in combination with the emotional state of the driver, for example, when the first sensor 112 is a heart rate sensor disposed on a steering wheel, it detects that the heart rate of the driver is between 60 to 80 times/minute, and the environmental conditioning module 14 may compare the heart rate with a pre-stored emotional database to obtain that the emotional state of the driver is in a calm state.

The environment adjusting module 14 further matches the emotional state of the driver according to the facial image information and the heart rate and/or the blood pressure, so that comfort adjustment in a vehicle can be performed subsequently in combination with the emotional state of the driver, generally speaking, the emotion of the driver can be transmitted in various ways, for example, the physiological information of the driver is collected by using contact type collecting components such as the heart rate, the blood pressure, the pulse and the like, and then emotion judgment is performed; or non-contact acquisition components such as a camera and the like are adopted to acquire facial image information of the driver, so that the emotion of the driver is obtained; or a contact and non-contact combined mode is adopted to improve the detection precision.

In some embodiments, the environment acquisition module 14 further comprises: and the difference processing module is used for calculating the difference between the inside and the outside of the target vehicle according to the road type outside the target vehicle, the traffic state, the weather state, the light intensity outside the target vehicle, the temperature and humidity outside the target vehicle, the light intensity inside the target vehicle and the temperature and humidity inside the target vehicle. Specifically, the camera can be used for shooting an image of the outside of the vehicle in the driving process to acquire the road type, the traffic state, the weather state and the like outside the vehicle, and the light ray intensity inside and outside the vehicle can be acquired by respectively arranging a light ray sensor inside and outside the vehicle. In other embodiments, the vehicle speed may be acquired by radar (including, but not limited to, millimeter wave radar, laser radar, etc.), and the determination of road type and traffic state may be assisted. The road type in the vehicle external environment information includes: highways, elevated, tunnels, national roads, urban roads, rural roads, and the like; the traffic state in the vehicle external environment information includes: rare traffic, traffic jam, pedestrian presence, non-motor vehicle presence, red road lamp intersection and the like; the weather condition in the vehicle external environment information includes: daytime, evening, night, cloudy day, rainy day, snowy day, foggy day, backlight, etc.

In some embodiments, the environmental conditioning module 14 includes: an air conditioner controller and a vehicle body controller. Specifically, the air conditioner controller is used for adjusting the ambient temperature, humidity, air conditioner air outlet speed and air circulation mode in the vehicle according to the temperature, humidity and air speed in the vehicle in the target vehicle environmental parameters. The vehicle body controller is used for controlling the opening and closing of a sun-shading curtain in the vehicle according to the light intensity in the vehicle in the target vehicle environmental parameters and adjusting the light intensity of the light in the vehicle. That is, the environmental adjustment module 14 can receive the physiological status information and the vehicle environmental information of driver in the driving process through the bus, adjust the environmental parameter in the car in real time to adjust the driving environment in the car, make the driver can maintain a good takeover state under comfortable driving environment, for example, detect that the vehicle is traveling on the vehicle is numerous, rainy day slippery highway, and when driver's expression is fidgety and uncomfortable, the environmental adjustment module 14 can do the adaptability adjustment: the air conditioner controller adjusts the ambient temperature in the vehicle to a target temperature (for example, about 25 ℃), increases the air conditioner air outlet speed to a target air speed (for example, a medium air outlet speed), and reduces the ambient humidity in the vehicle to a target humidity (for example, about 45%); the vehicle body controller adjusts the light in the vehicle to a target light intensity (e.g., 100-200 LUX). When it is detected that the vehicle is driving on a sunny, and poor highway with wide road and the driver is tired, the environmental conditioning module 14 will make an adaptation: the ambient humidity in the vehicle is increased to a target humidity (for example, about 60%), and the air-conditioning outlet speed is decreased to a target air speed (for example, a low-grade outlet speed). The driver is tired and sleepy, and voice reminding can be performed until the driver recovers to a normal driving state, so that the driver can take over the driving in time when the automatic driving system is dangerous and the driver needs to take over the driving.

In some embodiments, the environmental conditioning module 14 further includes gas concentration sensors disposed at the front and rear seats of the vehicle, respectively, for detecting the oxygen concentration and/or the carbon dioxide concentration in the vehicle. That is, the vehicle environment information further includes an in-vehicle oxygen concentration and/or a carbon dioxide concentration. Correspondingly, the environmental regulation module 14 further includes a gas concentration controller for regulating the oxygen concentration in the vehicle according to the oxygen concentration of the target vehicle environmental parameter, and/or regulating the carbon dioxide concentration in the vehicle according to the carbon dioxide concentration of the target vehicle environmental parameter.

In some embodiments, the environmental conditioning module 14 further includes an anion controller for detecting the in-vehicle anion concentration and adjusting the in-vehicle anion concentration according to the anion concentration of the target in-vehicle environmental parameter. That is, the vehicle environment information further includes an in-vehicle negative ion concentration. Accordingly, the environment adjusting module 14 further comprises an anion concentration controller for adjusting the in-vehicle anion concentration according to the anion concentration of the target in-vehicle environment parameter, such as increasing the in-vehicle anion concentration.

In some embodiments, the ride mode includes a set ride mode that is initially calibrated for system development status and a custom ride mode that is entered by the driver for autonomous collection of data. Specifically, the set driving mode of the initial calibration of the system development state may include: grassland mode, mountain mode, seaside mode, forest mode, desert mode, mountain mode, home mode, rural road mode, and the like; the environmental parameters in the vehicle related to each mode include, but are not limited to: illumination, temperature, humidity, oxygen concentration, carbon dioxide concentration, anion concentration, wind speed, and the like. The parameter values corresponding to different modes can be initially calibrated in the system development state. In particular, the driver's self-defined driving mode, in which data entry is collected autonomously, can be achieved by driving the vehicle into the target environment by the driver, after the idling straight-line driving for a preset distance, the system collects the data parameters of the current environment in real time and stores the data parameters to form the idle straight-line driving system, for example, when a driver drives a vehicle to a silent road in a forest, the idling straight-line driving is about 500 meters, the system (the environment adjusting module 14 in the system) can start a self-defined collecting mode to collect the data parameters (illumination, temperature, humidity, oxygen concentration, carbon dioxide concentration, anion concentration, wind speed and the like) of the current environment in real time, preferably, the data parameters of the current environment are collected in real time to support manual adjustment, namely, the user can finely adjust the collected data to adapt to the self condition, wherein the idle running is the vehicle running without refueling the accelerator, and the revolution of the engine is maintained at the idle speed stage.

As an adjusting mode, a storage module is used for storing a first corresponding relation table of the current driving environment information and the corresponding target driving mode, a second corresponding relation table of the target driving mode and the corresponding target vehicle internal environment parameters, and the emotion database vehicle external environment information. And the environment adjusting module is interacted with the state acquisition module, the environment acquisition module and the storage module through buses respectively, and is used for matching the emotional state of the driver according to the physiological state information, further acquiring the current driving environment information according to the vehicle environment information and the emotional state of the driver, so as to match a target driving mode, and adjusting the current in-vehicle environment parameters to the target in-vehicle environment parameters corresponding to the target driving mode.

In some embodiments, the current driving environment information and the corresponding driving mode are stored as a first correspondence table, and the driving environment information and the corresponding driving mode may be in a one-to-one correspondence relationship, or may be in a many-to-one or one-to-many correspondence relationship. For example, the current driving environment information, which includes a lot of vehicles and is wet and slippery in rainy days, and the expression of the driver is dysphoric, may correspond to the driving mode of the grassland mode or the home mode; the information of the current driving environment with tired drivers on the expressway with bright sunshine and thin road width can correspond to the driving mode in the forest mode and the driving mode in the mountain mode.

In some embodiments, the environmental conditioning module 14 is further configured to receive a driving mode selected by the driver and make current in-vehicle environmental parameter adjustments. Namely, the driving assistance system for automatically adjusting the driving environment provides an interactive interface to support manual setting and manual selection of the driver. When the driver manually sets the relevant matching principle of the current driving environment information and the corresponding driving mode, the environment adjusting module 14 preferentially responds to the autonomous selection of the driver, so as to adjust the current in-vehicle environment parameter to the corresponding target in-vehicle environment parameter, and when the environment adjusting module 14 matches a plurality of driving modes, the system provides an interactive interface for the driver to autonomously select the driving mode.

When the L3 automatic driving mode is started, the automatic driving system automatically controls the vehicle to run; the auxiliary driving system for automatically adjusting the driving environment realizes real-time adjustment of the driving environment in the vehicle according to the vehicle environment information and the emotional state of the driver in the driving process; in case of danger which is difficult to handle by the automatic driving system, the automatic driving system can actively give an alarm to remind a driver to take over, and meanwhile, the driving environment is properly adjusted by the auxiliary driving system for automatically adjusting the driving environment, so that the driving experience of the driver is improved, a good take-over state is maintained for the driver, and the take-over quality of the driver in a dangerous state is greatly improved.

As an adjusting mode, firstly, an emotion recognition module is used for judging the emotional state of a driver by micro expression recognition according to the collected facial image information of the driver; the method comprises the steps of collecting a plurality of physiological parameters of a driver for representing emotional states by utilizing a sensor module, wherein the physiological parameters at least comprise body temperature, heart rate and/or blood pressure of the driver. And meanwhile, the environment acquisition module is used for acquiring the environment information in the vehicle and the environment information outside the vehicle in the driving process in real time.

Wherein the emotional state of the driver may be correlated with the plurality of physiological parameters, the in-vehicle environmental information, and the out-vehicle environmental information, and if the change in the external environment or the physiological parameter affects the emotion of the driver, the emotion of the driver may be relieved in a targeted conditional environment. Therefore, a knowledge graph can be established among the emotional state of the driver, the human physiological parameters and the external environment, and the history of the driver in the driving process, the various physiological parameters, the environmental information in the vehicle and the environmental information outside the vehicle can be established according to the time sequence relation; so that it can be determined whether the state changes due to the influence of known influencing factors when the emotional state of the driver changes.

Further, the environment adjusting module may adjust the environment in the target car, the driving mode of the target car, and the media function of the target car according to the influence factor information determined by the information processing module. For example, the environment acquisition module comprises a difference processing module, the difference processing module calculates the difference between the inside and outside environment of the target vehicle according to the road type outside the target vehicle, the traffic state, the weather state, the light intensity outside the vehicle, the temperature and humidity outside the vehicle, the light intensity inside the vehicle and the temperature and humidity inside the vehicle, for example, the external road is a minor road, and is relatively bumpy, the weather is heavy rain, the light glare outside the vehicle can affect the emotional change of the driver, the light intensity inside the vehicle and the temperature and humidity are also the same affecting factors, and the comparison and judgment can be carried out to obtain the difference, because the emotional change of the driver has various factors, if the difference is not the affecting factors, the normal emotion relieving mode can be used to stabilize the emotion of the driver; for example, playing relaxing music, starting fragrance atmosphere, etc.

Specifically, when the emotional state information of the driver changes, the influence factor calculation module of the information processing module 13 is used to obtain the past physiological state information, the environmental information in the vehicle, and the environmental information outside the vehicle corresponding to the previous emotional state information of the driver; and comparing the past physiological state information, the vehicle internal environment information and the vehicle external environment information with the physiological state information, the vehicle internal environment information and the vehicle external environment information corresponding to the current driver emotional state information to obtain whether influence factors influencing the change of the driver emotional state are formed by the driver physiological state, the vehicle internal environment and the vehicle external environment.

The influence factor calculation module comprises an information comparison unit, wherein the information comparison unit is used for judging whether the change states of the physiological state information, the environment information in the vehicle and the environment information outside the vehicle exceed a threshold value, and if the change states exceed the threshold value, judging whether the current emotion state of the driver corresponds to the changed physiological state information, the environment information in the vehicle and the environment information outside the vehicle.

For example, when the emotional state of the driver is detected to be changed from calm to fidgety, the corresponding influence factors of the emotional state of the driver in a period of time before the emotional state of the driver is acquired at the current time node, the heart rate is found to be 60-80 times/minute through comparison, the method is normal, the light intensity of the interior of the vehicle and the parking space is suddenly increased, the facial expression of the driver is obviously changed, the emotional state of the driver can be solved in a mode of adjusting the sunshade curtain, if the emotional state of the driver is not changed into calm, the influence factors can be continuously judged, for example, the environmental information sound in the vehicle is too high, the noise reduction function can be started, and the emotional state of the driver is continuously monitored until the emotional state of the driver is alleviated.

In some embodiments, the influence factor of the emotional state of the driver is not influenced by the environment inside or outside the vehicle, perhaps caused by physiological pain, or famous dysphoria, or other vexation, so that the driving environment adjustment may not be realized in a targeted manner, and the universal adjustment may be realized by adopting a preset driving mode.

Further, the environment adjusting module 14 includes an emotion adjusting module and a comfort adjusting module.

The emotion adjusting module is used for adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle when the physiological state information, the environment information in the vehicle and the environment information outside the vehicle become influence factors of the emotional state of the driver, and specifically, the condition description of the influence factors can be referred to.

Comfortable adjusting module for when unknown driver emotional state's influence factor, correspond the driver history comfort level and adjust the environment in the data correspondence accent program target car, the driving mode of target car and the media function of target car, for example adjust the interior humiture of car to comfortable parameter, reduce driving speed, play the sound that the driver likes, video, adjust the atmosphere lamp, open modes such as champignon and realize.

According to the content, the driving assistance system capable of automatically adjusting the driving environment can adjust the driving environment in the automobile in real time according to the environment information of the automobile and the emotional state of the driver in the driving process, improve the driving experience of the driver and maintain a good take-over state for the driver; therefore, once danger which is difficult to process by the automatic driving system occurs, the automatic driving system actively gives an alarm to remind a driver to take over, and the taking over quality of the driver in a dangerous state is greatly improved.

The term "module" as used above may be a combination of software and/or hardware that implements a predetermined function. Although the system described in the above embodiments is preferably implemented in hardware, implementations in software, or a combination of software and hardware are also possible and contemplated.

Based on the same inventive concept, the application also provides an auxiliary driving method for automatically adjusting the driving environment, and the auxiliary driving system for automatically adjusting the driving environment can be adopted. Because the principle of solving the problem by the method is similar to that of the system, the embodiment of the method can be referred to the implementation of the system, and repeated details are not repeated.

Referring to fig. 2, the driving assistance method for automatically adjusting a driving environment provided by the present application includes the following steps:

s21: acquiring physiological state information and emotional state information of a driver in a driving process in real time; and acquiring the environmental information in the vehicle and the environmental information outside the vehicle in the driving process in real time.

And calculating the difference between the inside and outside environments of the target vehicle according to the road type outside the target vehicle, the traffic state, the weather state, the light intensity outside the vehicle, the temperature and humidity outside the vehicle, the light intensity inside the vehicle and the temperature and humidity inside the vehicle.

S22: and judging influence factor information causing the emotional state change of the driver according to the physiological state information, the emotional state information, the environment information in the vehicle and the environment information outside the vehicle.

When the emotional state information of the driver changes, the past physiological state information, the environmental information in the vehicle and the environmental information outside the vehicle corresponding to the previous emotional state information of the driver are obtained; and comparing the past physiological state information, the vehicle internal environment information and the vehicle external environment information with the physiological state information, the vehicle internal environment information and the vehicle external environment information corresponding to the current driver emotional state information to obtain whether influence factors influencing the change of the driver emotional state are formed by the driver physiological state, the vehicle internal environment and the vehicle external environment.

And judging whether the change state of the physiological state information, the in-vehicle environment information and the out-vehicle environment information exceeds a threshold value, and if so, judging whether the current emotional state of the driver corresponds to the changed physiological state information, the in-vehicle environment information and the out-vehicle environment information.

S23: and adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the influence factor information judged by the information processing module.

The embodiment described in fig. 1 can be referred to for details; in addition, in some embodiments, when the physiological state information, the in-vehicle environment information and the out-vehicle environment information become influence factors of the emotional state of the driver, adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle correspondingly; and when influence factors of the emotional state of the driver are unknown, adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle corresponding to the historical comfort degree adjusting data of the driver.

Referring to fig. 3, which is a flow chart of an assistant driving method for automatically adjusting a driving environment according to the present application, as shown in fig. 3, the method may include the following steps:

s31, collecting vehicle environment information in the driving process in real time, and collecting physiological state information of a driver in the driving process in real time;

s32, inquiring a pre-stored emotion database according to the physiological state information to match the emotion state of the driver;

s33, acquiring current driving environment information according to the vehicle environment information and the emotional state of the driver;

s34, inquiring a first corresponding relation table of the pre-stored current driving environment information and the corresponding driving mode according to the current driving environment information to match the driving mode;

s35, inquiring a second corresponding relation table of the pre-stored driving mode and the corresponding target vehicle internal environment parameter according to the matched driving mode to obtain the target vehicle internal environment parameter;

and S36, adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter.

It should be noted that the actions or steps described above may be performed in a different order than in the embodiments and still achieve desirable results, and further, that the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

In some embodiments, a camera may be used to collect facial image information of a driver as the physiological state information, so as to match the emotional state of the driver according to the facial image information. Or acquiring the heart rate and/or the blood pressure of the driver as the physiological state information by adopting a sensor so as to match the emotional state of the driver according to the heart rate and/or the blood pressure, or acquiring the facial image information of the driver by adopting a camera and acquiring the heart rate and/or the blood pressure of the driver by adopting the sensor so as to match the emotional state of the driver according to the facial image information and the heart rate and/or the blood pressure.

In some embodiments, the vehicle environment information includes a road type outside the vehicle, a traffic state, a weather state, and an intensity of light outside the vehicle, and an intensity of light inside the vehicle, and the adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter in step S36 includes: adjusting the ambient temperature, humidity, air conditioner air outlet speed and air circulation mode in the vehicle according to the temperature, humidity and air speed in the vehicle in the target vehicle environmental parameters; and controlling the opening and closing of the sunshade curtain in the vehicle according to the light intensity in the vehicle in the target vehicle environmental parameters, and adjusting the light intensity of the light in the vehicle.

In some embodiments, the vehicle environment information further includes an in-vehicle oxygen concentration and/or a carbon dioxide concentration. Adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter in step S36 further includes: and adjusting the oxygen concentration in the vehicle according to the oxygen concentration of the target vehicle internal environment parameter, and/or adjusting the carbon dioxide concentration in the vehicle according to the carbon dioxide concentration of the target vehicle internal environment parameter.

In some embodiments, the vehicle environment information further includes an in-vehicle negative ion concentration, and the adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter at step S36 further includes: and adjusting the concentration of the negative ions in the vehicle according to the concentration of the negative ions of the target vehicle internal environment parameter, for example, increasing the concentration of the negative ions in the vehicle.

In some embodiments, the riding mode comprises a set riding mode initially calibrated by the system development state and a custom riding mode automatically entered by the driver for autonomously collecting data, and specifically, the set riding mode initially calibrated by the system development state may comprise: grassland mode, mountain mode, seaside mode, forest mode, desert mode, mountain mode, home mode, rural road mode, and the like; the environmental parameters in the vehicle related to each mode include, but are not limited to: the system comprises a system development state, a lighting system, a temperature monitoring system, a humidity monitoring system, an oxygen concentration monitoring system, a carbon dioxide concentration monitoring system, an anion concentration monitoring system, a wind speed monitoring system, a data acquisition system and a data acquisition system, wherein the lighting system, the temperature monitoring system, the humidity monitoring system, the anion concentration monitoring system and the wind speed monitoring system are arranged in the system development state, the lighting system, the temperature monitoring system, the humidity monitoring system and the wind speed monitoring system, the lighting system, the humidity monitoring system and the wind speed monitoring system are arranged in the system development state, and the parameter values corresponding to different modes can be initially calibrated in the system development state, specifically, a self-defined driving mode for inputting data by a driver in an independent acquisition mode is formed by enabling the driver to drive a vehicle to a target environment and enabling the system to be in real time and store the data parameters of the current environment after the driver drives the vehicle to a silent forest, the vehicle to be in an idle straight line for about 500 meters, the system enters the self-defined acquisition mode, the data parameters (the lighting system, the temperature, the humidity, the anion concentration, the wind speed monitoring system, the wind speed and the wind speed monitoring system can be manually adjusted in real time, the data parameters of the lighting system development state, to adapt itself better.

In some embodiments, the first correspondence table of the current driving environment information and the corresponding driving mode may be a one-to-one correspondence, or a many-to-one or one-to-many correspondence. For example, the current driving environment information, which includes a lot of vehicles and is wet and slippery in rainy days, and the expression of the driver is dysphoric, may correspond to the driving mode of the grassland mode or the home mode; the information of the current driving environment with tired drivers on the expressway with bright sunshine and thin road width can correspond to the driving mode in the forest mode and the driving mode in the mountain mode.

In some embodiments, the method further comprises: the method comprises the steps of receiving a driving mode selected by a driver independently and adjusting current in-vehicle environment parameters, namely, supporting manual setting and manual selection of the driving mode by the driver, and when the driver manually sets a relevant matching principle of current driving environment information and a corresponding driving mode, preferentially responding to the independent selection of the driver during matching so as to adjust the current in-vehicle environment parameters to corresponding target in-vehicle environment parameters, and when a plurality of driving modes are matched, receiving the driving mode selected by the driver independently.

According to the content, the driving assistance method for automatically adjusting the driving environment can adjust the driving environment in the automobile in real time according to the environment information of the automobile and the emotional state of the driver in the driving process, improve the driving experience of the driver and maintain a good take-over state for the driver; therefore, once danger which is difficult to process by the automatic driving system occurs, the automatic driving system actively gives an alarm to remind a driver to take over, and the taking over quality of the driver in a dangerous state is greatly improved.

It should be noted that the embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same/similar parts in the embodiments may be referred to each other. For the method embodiment disclosed by the embodiment, since the method embodiment corresponds to the system embodiment disclosed by the embodiment, the description is relatively simple, and the relevant points can be referred to the partial description of the system embodiment.

Those skilled in the art will appreciate that all or part of the steps in the above method embodiments may be implemented by a program to instruct relevant hardware to perform the steps, and the program may be stored in a computer-readable storage medium, referred to herein as a storage medium, such as: ROM/RAM, magnetic disk, optical disk, etc. That is, the present application also discloses a computer-readable storage medium, in which a computer-executable program is stored, and when the computer-executable program is executed by a processor, the method described in the above embodiment of the present application is implemented. The computer executable program may be located in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

Those of skill would further appreciate that the various illustrative systems and method steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application.

Claims

1. A driving assistance system that automatically adjusts a driving environment, the system comprising:

2. The system of claim 1, wherein the state acquisition module comprises:

3. The system of claim 1 or 2, wherein the environment acquisition module further comprises:

4. The system of claim 1, wherein the information processing module comprises:

5. The system according to claim 4, wherein the influencing factor calculating module comprises an information comparing unit, and the information comparing unit is configured to determine whether the change states of the physiological state information, the in-vehicle environment information, and the out-of-vehicle environment information exceed a threshold value, and if the change states exceed the threshold value, determine whether the current emotional state of the driver corresponds to the changed physiological state information, the in-vehicle environment information, and the out-of-vehicle environment information.

6. The system of claim 5, wherein the environmental conditioning module comprises an emotion conditioning module and a comfort conditioning module;

7. The system of claim 1, wherein the environmental reconciliation module comprises:

and the vehicle body controller is used for controlling the opening and closing of the sun-shading curtain in the vehicle and adjusting the light intensity of the light in the vehicle and the driving speed according to the light intensity in the vehicle in the target vehicle environmental parameters.

8. The system of claim 1, wherein the environmental capture module further comprises an anion controller configured to detect an in-vehicle anion concentration and adjust the in-vehicle anion concentration based on the anion concentration of the target in-vehicle environmental parameter.

9. The system of claim 1, wherein the ride mode comprises a set ride mode initially calibrated for system development status and a custom ride mode for driver autonomous collection data entry.

10. The system of claim 9, wherein the customized ride mode is formed by a driver driving the vehicle into a target environment, and the system collects and stores data parameters of a current environment in real time after idling for a preset distance.

11. The system of claim 1, wherein the environmental conditioning module is further configured to receive a driver-selected driving mode and make current in-vehicle environmental parameter adjustments.

12. A driving assist method that automatically adjusts a driving environment, the method comprising:

13. A computer-readable storage medium, characterized in that the storage medium stores a computer-executable program, which when executed by a processor implements the steps of the method as claimed in claim 12.