CN114132328B - Auxiliary driving system and method for automatically adjusting driving environment and storage medium - Google Patents
Auxiliary driving system and method for automatically adjusting driving environment and storage medium Download PDFInfo
- Publication number
- CN114132328B CN114132328B CN202111507451.0A CN202111507451A CN114132328B CN 114132328 B CN114132328 B CN 114132328B CN 202111507451 A CN202111507451 A CN 202111507451A CN 114132328 B CN114132328 B CN 114132328B
- Authority
- CN
- China
- Prior art keywords
- vehicle
- environment
- information
- driver
- driving
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000008451 emotion Effects 0.000 claims abstract description 73
- 230000035790 physiological processes and functions Effects 0.000 claims abstract description 49
- 230000002996 emotional effect Effects 0.000 claims abstract description 46
- 230000008569 process Effects 0.000 claims abstract description 23
- 230000008859 change Effects 0.000 claims abstract description 21
- 230000010365 information processing Effects 0.000 claims abstract description 17
- 230000007613 environmental effect Effects 0.000 claims description 42
- CURLTUGMZLYLDI-UHFFFAOYSA-N Carbon dioxide Chemical compound O=C=O CURLTUGMZLYLDI-UHFFFAOYSA-N 0.000 claims description 26
- 150000002500 ions Chemical class 0.000 claims description 22
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 claims description 13
- 229910002092 carbon dioxide Inorganic materials 0.000 claims description 13
- 239000001569 carbon dioxide Substances 0.000 claims description 13
- 230000001815 facial effect Effects 0.000 claims description 13
- 229910052760 oxygen Inorganic materials 0.000 claims description 13
- 239000001301 oxygen Substances 0.000 claims description 13
- 230000036772 blood pressure Effects 0.000 claims description 11
- 230000003750 conditioning effect Effects 0.000 claims description 11
- 230000001105 regulatory effect Effects 0.000 claims description 11
- 230000033772 system development Effects 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 7
- 230000001276 controlling effect Effects 0.000 claims description 5
- 230000008909 emotion recognition Effects 0.000 claims description 5
- 230000036760 body temperature Effects 0.000 claims description 4
- 238000013479 data entry Methods 0.000 claims description 4
- 239000007789 gas Substances 0.000 claims description 4
- 230000000875 corresponding effect Effects 0.000 description 34
- 230000006870 function Effects 0.000 description 13
- 238000005516 engineering process Methods 0.000 description 7
- 150000001450 anions Chemical class 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 230000018109 developmental process Effects 0.000 description 4
- 238000005286 illumination Methods 0.000 description 4
- 206010013954 Dysphoria Diseases 0.000 description 3
- 206010041349 Somnolence Diseases 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008921 facial expression Effects 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 2
- 206010026749 Mania Diseases 0.000 description 1
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013019 agitation Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000000222 aromatherapy Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000003205 fragrance Substances 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00735—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models
- B60H1/00742—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00735—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models
- B60H1/0075—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models the input being solar radiation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00735—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models
- B60H1/00785—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models by the detection of humidity or frost
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00814—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation
- B60H1/00821—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation the components being ventilating, air admitting or air distributing devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00814—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation
- B60H1/00878—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation the components being temperature regulating devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H3/00—Other air-treating devices
- B60H3/0007—Adding substances other than water to the air, e.g. perfume, oxygen
- B60H3/0035—Adding substances other than water to the air, e.g. perfume, oxygen characterised by the control methods for adding the substance
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/005—Handover processes
- B60W60/0053—Handover processes from vehicle to occupant
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0872—Driver physiology
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/22—Psychological state; Stress level or workload
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/221—Physiology, e.g. weight, heartbeat, health or special needs
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2555/00—Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
- B60W2555/20—Ambient conditions, e.g. wind or rain
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Thermal Sciences (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mathematical Physics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Sustainable Development (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses an auxiliary driving system and method for automatically adjusting driving environment and a storage medium, wherein the system comprises the following components: the state acquisition module is used for acquiring physiological state information and emotion state information of a driver in the driving process in real time; the environment acquisition module is used for acquiring the environment information in the vehicle and the environment information outside the vehicle in the driving process in real time; the information processing module is used for judging influence factor information causing the change of the emotional state of the driver according to the physiological state information, the emotional state information, the in-vehicle environment information and the in-vehicle environment information; the environment adjusting module is respectively interacted with the state acquisition module, the environment acquisition module and the information processing module through buses, and is used for adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the influence factor information judged by the information processing module. The invention can eliminate potential driving safety hazards.
Description
Technical Field
The embodiment of the application relates to the technical field of automatic driving, in particular to an auxiliary driving system and method for automatically adjusting driving environment and a storage medium.
Background
With the rapid development of automobile technology, the automatic driving research is rapidly developed by benefiting from rapid progress of diversified sensor technology, high-performance computing platform technology and high-safety control technology, and the automatic driving research has great influence on industry development and brings great change of future travel modes. With the arrival of the autopilot era, more and more vehicles are added into the autopilot train, and great convenience is brought to the life of people. With the development of intelligent systems and the development of automobile control systems, automatic driving and auxiliary driving technologies have been widely focused and studied. The automatic driving technology is an important way for improving the intelligent level of road traffic and promoting the transformation and upgrading of the traffic and transportation industry.
When the driving body of the vehicle changes from a person to a machine, the driver's position in driving is faded and the driver's character has been transferred from the driving body to the passenger's character. For an autonomous vehicle, the effective take over time of the driver is a very important indicator at the moment when the autonomous system is not able to handle. The small space in the vehicle has great influence on the riding experience of a driver and the state of the takeover in dangerous situations; meanwhile, in a relatively closed driving environment, the emotion and state of a driver can be changed due to changes of environmental factors in a vehicle such as illumination, temperature, humidity, oxygen content, carbon dioxide content and the like in a continuous long-time driving process, and the emotion and state of the driver can also be influenced by external environment factors of road conditions, weather, traffic environment and the like. The driving experience and comfort level can be influenced by the environmental factors inside and outside the vehicle, and if the humanized consideration of the driver is lacking in the automatic driving process, the discomfort of the driver can be caused, and even accidents are caused. There are researches that the driver's emotion fluctuation, especially bad physiological and psychological reactions, caused by various subjective and objective reasons during driving may influence the driving behavior, such as unstable states of violent driving, emergency braking, etc., and traffic accidents are easy to occur. Meanwhile, for an automatic driving system, the driving environment is abnormally important for driving safety and comfort. Thus, the regulation of the environment inside the vehicle becomes increasingly important.
In the prior art, the method for controlling the emotion of the driver is as follows: and collecting emotion information of a driver, and playing music, giving an alarm or vibrating if bad emotion is found. However, this method is prone to fatigue of the driver during long-term repeated use, and cannot take into consideration the influence of the driving environment on the take-over time of the driver, and cannot take into consideration the overall adjustment of the environment in the cabin according to the road traffic environment in which the vehicle is actually traveling.
Therefore, how to improve the driving experience, adjust the state of the driver, and eliminate the potential driving safety hazard is a technical problem that needs to be solved by the technicians in the field at present.
Disclosure of Invention
The application aims to solve the problems in the prior art, and provides an auxiliary driving system, an auxiliary driving method and a storage medium for automatically adjusting a driving environment, which can automatically adjust the driving environment by integrating an automatic driving function, a driving environment and a driver state of a vehicle, thereby improving driving experience, adjusting the state of the driver and eliminating potential driving safety hazards.
To achieve the above object, according to a first aspect of the embodiments of the present invention, there is provided a driving assistance system for automatically adjusting a driving environment, the system including:
The state acquisition module is used for acquiring physiological state information and emotion state information of a driver in the driving process in real time;
The environment acquisition module is used for acquiring the environment information in the vehicle and the environment information outside the vehicle in the driving process in real time;
The information processing module is used for judging influence factor information causing the change of the emotional state of the driver according to the physiological state information, the emotional state information, the in-vehicle environment information and the in-vehicle environment information;
The environment adjusting module is respectively interacted with the state acquisition module, the environment acquisition module and the information processing module through buses, and is used for adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the influence factor information judged by the information processing module.
Optionally, the state acquisition module includes:
The emotion recognition module is used for judging the emotion state of the driver by utilizing micro-expression recognition according to the collected facial image information of the driver;
a sensor module for acquiring a plurality of physiological parameters of the driver for characterizing the emotional state, the physiological parameters including at least a body temperature, a heart rate and/or a blood pressure of the driver.
Optionally, the environment collection module further includes:
The difference processing module is used for calculating the environmental difference inside and outside the target vehicle according to the road type, traffic state, weather state, light intensity outside the vehicle, temperature and humidity outside the vehicle, light intensity inside the vehicle and temperature and humidity inside the vehicle.
Optionally, the information processing module includes:
The influence factor calculation module is used for acquiring the past physiological state information, the vehicle internal environment information and the vehicle external environment information corresponding to the previous driver emotion state information when the driver emotion state information changes; and comparing the past physiological state information, the vehicle internal environment information and the vehicle external environment information with physiological state information, vehicle internal environment information and vehicle external environment information corresponding to the current driver emotional state information to obtain influence factors which influence the change of the driver emotional state by the physiological state of the driver, the vehicle internal environment and the vehicle external environment.
Optionally, the influence factor calculation module includes an information comparison unit, where the information comparison unit is configured to determine whether the physiological state information, the vehicle internal environment information, and the vehicle external environment information change state exceeds a threshold, and if so, determine whether the physiological state information, the vehicle internal environment information, and the vehicle external environment information change state correspond to the current emotional state of the driver.
Optionally, the environment adjusting module comprises an emotion adjusting module and a comfort adjusting module;
the emotion regulating module is used for regulating when the physiological state information, the in-vehicle environment information and the out-of-vehicle environment information become influencing factors of the emotion state of the driver, and correspondingly regulating the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle;
The comfort adjusting module is used for correspondingly adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the historical comfort adjusting data of the driver when the influence factors of the emotion states of the driver are unknown.
Optionally, the environment adjustment module further comprises:
the negative ion controller is used for detecting the concentration of negative ions in the vehicle and adjusting the concentration of the negative ions in the vehicle according to the negative ion concentration of the environmental parameter in the target vehicle;
The gas concentration sensors are respectively arranged at the front seat and the rear seat of the vehicle and are used for detecting the oxygen concentration and/or the carbon dioxide concentration in the vehicle;
The air conditioner controller is used for adjusting the environmental temperature, the humidity, the air outlet speed of the air conditioner and the air circulation mode in the vehicle according to the temperature, the humidity and the air speed in the vehicle in the environmental parameters of the target vehicle;
And the vehicle body controller is used for controlling the opening and closing of the sunshade curtain in the vehicle and adjusting the light intensity and the driving speed of the lamp light in the vehicle according to the light intensity in the vehicle in the target vehicle environment parameter.
Optionally, the driving mode comprises a set driving mode of initial calibration of a system development state and a custom driving mode of driver autonomous acquisition data entry.
Optionally, the self-defined driving mode is formed by driving the vehicle into a target environment by a driver, and acquiring and storing data parameters of the current environment in real time by the system after idling and straight driving for a preset distance.
Optionally, the environment adjustment module is further configured to receive a driving mode selected by the driver autonomously and make a current in-vehicle environment parameter adjustment.
In a second aspect of the embodiment of the present invention, there is provided a driving assistance method for automatically adjusting a driving environment, the method including:
Collecting vehicle environment information in the driving process in real time and collecting physiological state information of a driver in the driving process in real time;
inquiring a prestored emotion database according to the physiological state information so as to match the emotion state of the driver;
Acquiring current driving environment information according to the vehicle environment information and the emotion state of the driver;
Inquiring a first corresponding relation table of the pre-stored current driving environment information and the corresponding driving mode according to the current driving environment information so as to match the driving mode;
inquiring a second corresponding relation table of the prestored driving mode and the corresponding target in-vehicle environment parameter according to the matched driving mode so as to acquire the target in-vehicle environment parameter;
And adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter.
In a third aspect of embodiments of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the assisted driving method for automatically adjusting a driving environment as described above.
Compared with the prior art, the auxiliary driving system and the method for automatically adjusting the driving environment can realize the real-time adjustment of the driving environment in the vehicle according to the vehicle environment information and the emotion state of the driver in the driving process, improve the driving experience of the driver and maintain a good takeover state for the driver; therefore, when the danger which is difficult to be handled by the automatic driving system occurs, the automatic driving system actively alarms to remind the driver to take over, and the taking over quality of the driver in the dangerous state is greatly improved.
Drawings
FIG. 1 is a schematic diagram of an architecture of an assisted driving system for automatically adjusting a driving environment according to the present application;
FIG. 2 is a schematic flow chart of an assisted driving method for automatically adjusting a driving environment according to the present application;
fig. 3 is another flow chart of the auxiliary driving method for automatically adjusting the driving environment provided by the application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to fall within the scope of the application.
It should be noted that the terms "comprising" and "having" and their variants are referred to in the document of the present application and are intended to cover non-exclusive inclusion. The terms "first," "second," and the like are used to distinguish similar objects and not necessarily to describe a particular order or sequence unless otherwise indicated by context, it should be understood that the data so used may be interchanged where appropriate. In addition, the embodiments of the present application and the features in the embodiments may be combined with each other without collision. In addition, in the following description, descriptions of well-known structures and techniques are omitted so as not to unnecessarily obscure the present application.
Referring to fig. 1 to fig. 2, fig. 1 is a schematic diagram of an architecture of an auxiliary driving system for automatically adjusting a driving environment according to the present application, and fig. 2 is a schematic diagram of an embodiment of an auxiliary driving system for automatically adjusting a driving environment according to the present application.
As shown in fig. 1, the auxiliary driving system 10 for automatically adjusting the driving environment according to the present embodiment includes: a state acquisition module 11, an environment acquisition module 12, a storage module 13 and an environment adjustment module 14. Specifically, the state collection module 11 is configured to collect physiological state information and emotional state information of a driver during driving in real time, the environment collection module 12 is configured to collect in-vehicle environment information and in-vehicle environment information during driving in real time, the information processing module 13 is configured to determine factor information that causes a change in the emotional state of the driver according to the physiological state information, the emotional state information, the in-vehicle environment information and the in-vehicle environment information, and the environment adjustment module 14 is configured to interact with the state collection module, the environment collection module and the information processing module through buses, respectively, and the environment adjustment module is configured to adjust an environment in a target vehicle, a driving mode of the target vehicle and a media function of the target vehicle according to the factor information determined by the information processing module.
That is, in this embodiment, the environment adjustment module 14 automatically matches a suitable target driving environment according to the current physiological status information, the vehicle environment information, the emotional state, etc. of the driver, and adjusts the current in-vehicle environment parameter to the in-vehicle environment parameter corresponding to the driving mode, thereby improving the driving comfort and the driving safety. The state of the driver is adjusted by improving the driving environment, and the comfortable driving environment and the safe and stable driving state are created, so that the driving experience is improved, the taking-over quality of the driver in the dangerous state is greatly improved, and the potential safety hazard is eliminated.
In some embodiments, the state acquisition module 11 includes an emotion recognition module for determining an emotional state of the driver using microexpressive recognition according to acquired facial image information of the driver. The environmental adjustment module 14 further matches the driver's emotional state based on the facial image information so that in-vehicle comfort adjustment may be subsequently performed in combination with the driver's emotional state. It will be appreciated that there are a wide variety of emotions for the driver, such as: happiness, calm, boring, drowsiness, dysphoria, sadness, mania, anger, etc., while emotion may have an influence on driving status, such as a driver may be driving at overspeed due to dysphoria. Facial expressions show more or less internal emotion, and even when a person happing and not forming a color is focused on driving a vehicle, the change of emotion can bring about subtle changes of facial expressions (particularly eye and lip changes), and can be realized by utilizing a micro-expression recognition technology.
In the embodiment, a camera is adopted to shoot the face area of the driver, the face image information of the driver is collected, the face image information is identified and converted into data, and the emotion state of the driver is obtained by comparing a prestored emotion database. Because the heights of the drivers are different, the range acquired by the emotion recognition module through the camera can comprise the range of the whole main driving position as much as possible, namely, the five sense organs of the drivers can be clearly shot, and the camera is arranged on the front windshield of the vehicle matched with the main driving position. It can be understood that the camera used in this embodiment does not collect all details of the face of the driver, but performs feature collection for collection points of the face of the driver that generate some obvious facial feature changes, and then compares the information of these feature points with a pre-stored emotion database to obtain the emotion state of the driver.
The camera used in the embodiment may be an infrared camera that can be used in both day and night as long as the camera can collect facial image information of the driver; the model and resolution of the camera used in this embodiment are not specifically limited, and those skilled in the art may select according to practical application.
In some embodiments, the state acquisition module 11 further includes a sensor module for acquiring various physiological parameters of the driver for representing the emotional state, where the physiological parameters include at least a body temperature, a heart rate and/or a blood pressure of the driver, and the environmental adjustment module 14 further matches the emotional state of the driver according to the heart rate and/or the blood pressure, so that the in-vehicle comfort adjustment can be performed subsequently in combination with the emotional state of the driver, for example, when the first sensor 112 is a heart rate sensor arranged on the steering wheel, it detects that the heart rate of the driver is between 60 and 80 times/minute, and the environmental adjustment module 14 can compare the heart rate with a prestored emotion database to obtain that the emotional state of the driver is in a calm state.
The environmental adjustment module 14 further matches the emotional state of the driver according to the facial image information and the heart rate and/or the blood pressure, so that the in-vehicle comfort adjustment can be performed in combination with the emotional state of the driver, generally speaking, the emotion of the driver can be transmitted in various ways, for example, the physiological information of the driver is collected by adopting a heart rate, blood pressure, pulse and other contact acquisition components, and then emotion judgment is performed; or a non-contact acquisition component such as a camera is adopted to acquire the facial image information of the driver, so as to obtain the emotion of the driver; or a contact type and non-contact type combined mode is adopted to improve the detection precision.
In some embodiments, the environmental collection module 14 further comprises: the difference processing module is used for calculating the environmental difference inside and outside the target vehicle according to the road type, traffic state, weather state, light intensity outside the vehicle, temperature and humidity outside the vehicle, light intensity inside the vehicle and temperature and humidity inside the vehicle. Specifically, the external image of the vehicle during driving can be shot through the camera, the road type, traffic state, weather state and the like outside the vehicle can be obtained, and the light intensity inside and outside the vehicle can be obtained through arranging a light sensor inside and outside the vehicle respectively. In other embodiments, the vehicle speed can also be obtained through a radar (including but not limited to millimeter wave radar, laser radar and the like), so as to assist in judging the road type and the traffic state. The road types in the vehicle external environment information include: expressways, overhead, tunnels, national roads, urban roads, rural roads and the like; the traffic state in the vehicle external environment information includes: the traffic flow is rare, the traffic flow is jammed, pedestrians are on the road, non-motor vehicles are on the road, and the road lamp is at the road; the weather state in the vehicle exterior environment information includes: daytime, evening, night, cloudy, rainy, snowy, foggy, and backlit.
In some embodiments, the environmental conditioning module 14 includes: an air conditioner controller and a vehicle body controller. Specifically, the air conditioner controller is used for adjusting the temperature, humidity, air outlet speed and air circulation mode of the environment in the vehicle according to the temperature, humidity and air speed in the vehicle in the environment parameters of the target vehicle. The vehicle body controller is used for controlling the opening and closing of the sunshade curtain in the vehicle and adjusting the light intensity of the lamp light in the vehicle according to the light intensity in the vehicle in the target vehicle environment parameter. That is, the environment adjustment module 14 receives physiological status information of the driver and environmental information of the vehicle during driving through the bus, and adjusts environmental parameters in the vehicle in real time to adjust the driving environment in the vehicle, so that the driver can maintain a good take over state in a comfortable driving environment, for example, when the driver detects that the vehicle is running on a plurality of highways with wet and slippery vehicles in rainy days and the expression of the driver is annoying, the environment adjustment module 14 can adaptively adjust: the air conditioner controller adjusts the temperature of the environment in the vehicle to a target temperature (for example, about 25 degrees), increases the air outlet speed of the air conditioner to a target air speed (for example, a middle-gear air outlet speed), and reduces the humidity of the environment in the vehicle to a target humidity (for example, about 45 percent); the vehicle body controller adjusts the interior light to a target light intensity (e.g., 100-200 lux). Upon detecting that the vehicle is traveling on a sunny, wide-road, lean-road highway and that the driver is tired, the environment adjustment module 14 will make an adaptive adjustment: the humidity of the environment in the vehicle is increased to the target humidity (for example, about 60 percent), and the air outlet speed of the air conditioner is reduced to the target air speed (for example, low-gear air outlet speed). Because the driver is tired, the driver can also carry out voice reminding until the driver returns to a normal driving state, so that the driver can take over in time when the driver takes over driving in the case of danger in the automatic driving system.
In some embodiments, the environmental conditioning module 14 further includes gas concentration sensors disposed at the front seat and the rear seat of the vehicle, respectively, for detecting the oxygen concentration and/or the carbon dioxide concentration in the vehicle. That is, the vehicle environment information further includes an in-vehicle oxygen concentration and/or a carbon dioxide concentration. Accordingly, the environmental conditioning module 14 further includes a gas concentration controller for adjusting an in-vehicle oxygen concentration based on an oxygen concentration of the target in-vehicle environmental parameter and/or adjusting an in-vehicle carbon dioxide concentration based on a carbon dioxide concentration of the target in-vehicle environmental parameter.
In some embodiments, the environmental conditioning module 14 further includes a negative ion controller for detecting an in-vehicle negative ion concentration and adjusting the in-vehicle negative ion concentration based on the negative ion concentration of the target in-vehicle environmental parameter. That is, the vehicle environment information further includes an in-vehicle anion concentration. Accordingly, the environment adjustment module 14 further includes a negative ion concentration controller for adjusting the negative ion concentration in the vehicle, such as increasing the negative ion concentration in the vehicle, according to the negative ion concentration of the target vehicle interior environment parameter.
In some embodiments, the ride-on mode includes a set ride-on mode with initial calibration of system development states and a custom ride-on mode with driver autonomous acquisition data entry. Specifically, the setting the driving mode for initial calibration of the system development state may include: grassland mode, mountain mode, seaside mode, forest mode, desert mode, mountain mode, home mode, rural trail mode, etc.; the in-vehicle environmental parameters to which each mode relates include, but are not limited to: illumination, temperature, humidity, oxygen concentration, carbon dioxide concentration, anion concentration, wind speed, etc. Parameter values corresponding to different modes can be initially calibrated in a system development state. Specifically, the driver can autonomously collect the custom driving mode of data input, the driver can drive the vehicle into the target environment, the system collects the data parameters of the current environment in real time after the idle speed straight line driving is carried out for a preset distance and stores the data parameters, for example, the driver drives the vehicle onto a highway in a quiet forest, the idle speed straight line driving is about 500 meters, the system (the environment adjusting module 14 can be used for the system) can start the custom collection mode, the data parameters (illumination, temperature, humidity, oxygen concentration, carbon dioxide concentration, anion concentration, wind speed and the like) of the current environment are collected in real time, preferably, the data parameters of the current environment are collected in real time to support manual adjustment, namely, the user can finely adjust the collected data to adapt to the situation of the user, wherein the idle speed driving is the vehicle running without accelerator, and the revolution number of the engine is maintained at the idle speed.
As an adjusting mode, a first corresponding relation table of the current driving environment information and the corresponding target driving mode, a second corresponding relation table of the target driving mode and the corresponding target in-vehicle environment parameter and the information of the external environment of the vehicle in the emotion database are stored by using a storage module. The environment adjusting module is respectively interacted with the state acquisition module, the environment acquisition module and the storage module through buses and is used for matching the emotion state of a driver according to the physiological state information, further obtaining the current driving environment information according to the vehicle environment information and the emotion state of the driver, so as to match a target driving mode, and adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter corresponding to the target driving mode.
In some embodiments, the current driving environment information and the corresponding driving mode are stored as a first correspondence table, and the driving environment information and the corresponding driving mode may be in a one-to-one correspondence or in a many-to-one or one-to-many correspondence. For example, on a highway with a plurality of vehicles and wet and slippery rainy days, the current driving environment information with the uncomfortable expression of the driver can be corresponding to a driving mode of a grassland mode or a driving mode of a home mode; the current driving environment information of the driver, which is bright in sunlight and thin in road width and shows tired drowsiness, can be corresponding to a riding mode of a forest mode or a riding mode of a mountain forest mode.
In some embodiments, the environmental adjustment module 14 is further configured to receive a driving pattern autonomously selected by the driver and make a current in-vehicle environmental parameter adjustment. That is, the auxiliary driving system for automatically adjusting the driving environment provides an interactive interface to support manual setting and manual selection of a driver. When the driver manually sets the related matching rule between the current driving environment information and the corresponding driving mode, the environment adjustment module 14 will respond to the autonomous selection of the driver preferentially, and further adjust the current in-vehicle environment parameter to the corresponding target in-vehicle environment parameter, and when the environment adjustment module 14 matches multiple driving modes, the system provides an interactive interface for the driver to select the driving mode autonomously.
When the vehicle starts an L3 automatic driving mode, the automatic driving system automatically controls the vehicle to run; the auxiliary driving system for automatically adjusting the driving environment realizes real-time adjustment of the driving environment in the vehicle according to the vehicle environment information and the emotion state of the driver in the driving process; once the danger which is difficult to be processed by the automatic driving system occurs, the automatic driving system can actively give an alarm to remind the driver to take over, and meanwhile, the driving environment is properly regulated by the auxiliary driving system for automatically regulating the driving environment, so that the driving experience of the driver is improved, a good taking over state is maintained for the driver, and the taking over quality of the driver in the dangerous state is greatly improved.
As an adjustment mode, firstly, an emotion recognition module is utilized to judge the emotion state of a driver by utilizing micro-expression recognition according to collected facial image information of the driver; a plurality of physiological parameters of the driver for characterizing the emotional state including at least a body temperature, a heart rate, and/or a blood pressure of the driver are acquired with the sensor module. And meanwhile, the environment acquisition module is used for acquiring the environment information in the vehicle and the environment information outside the vehicle in the driving process in real time.
Wherein the emotional state of the driver can be correlated with the plurality of physiological parameters, the vehicle internal environment information and the vehicle external environment information, and if the external environment or the change of the physiological parameters affects the emotion of the driver, the emotion of the driver can be relieved by the targeted conditional environment. Therefore, a knowledge graph can be established between the emotion state of the driver and the physiological parameters of the human body and between the emotion state of the driver and the external environment, and the histories of the driver, the internal environment information of the vehicle and the external environment information of the vehicle in the driving process can be established according to the time sequence relation; so that it can be determined whether the state change is caused by the influence of the known influencing factors when the emotional state of the driver is changed.
Further, the environment adjusting module can adjust the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the influence factor information judged by the information processing module. For example, the environment collection module includes a difference processing module, and the difference processing module calculates the difference between the inside and the outside of the target vehicle according to the road type, traffic state, weather state, light intensity outside the vehicle, temperature and humidity outside the vehicle, light intensity inside the vehicle, temperature and humidity inside the vehicle, for example, the outside road is a small road relatively bumpy, weather is heavy rain, light glare outside the vehicle, etc. can influence the emotion change of the driver, the light intensity inside the vehicle and the temperature and humidity are also influencing factors, and the difference processing module needs to make a comparison judgment to obtain the difference, because the emotion change of the driver has various factors, if the difference is not influenced by the factors, the emotion of the driver can be stabilized by using a common emotion relieving mode; such as playing soothing music, opening fragrance atmosphere, etc.
Specifically, the influence factor calculation module of the information processing module 13 is utilized to obtain the past physiological state information, the vehicle internal environment information and the vehicle external environment information corresponding to the previous driver emotion state information when the driver emotion state information changes; and comparing the past physiological state information, the vehicle internal environment information and the vehicle external environment information with physiological state information, vehicle internal environment information and vehicle external environment information corresponding to the current driver emotional state information to obtain influence factors which influence the change of the driver emotional state by the physiological state of the driver, the vehicle internal environment and the vehicle external environment.
The influence factor calculation module comprises an information comparison unit, wherein the information comparison unit is used for judging whether the physiological state information, the vehicle internal environment information and the change state of the vehicle external environment information exceed a threshold value or not, and judging whether the physiological state information, the vehicle internal environment information and the vehicle external environment information correspond to the current emotion state of the driver or not according to the changed physiological state information, the changed vehicle internal environment information and the changed vehicle external environment information if the physiological state information, the vehicle internal environment information and the changed change state of the vehicle external environment information exceed the threshold value.
For example, when the current state of emotion of the driver is changed from calm to dysphoria, the influence factors corresponding to the state of emotion of the driver in driving in a period of time before the current time node is acquired are needed, the heart rate is found to be 60-80 times/minute, the heart rate is normal, the light intensity of the vehicle interior and the parking space is suddenly strengthened, the state of emotion of the driver can be solved by adjusting a sunshade curtain when the facial expression of the driver is obviously changed, and if the state of emotion of the driver does not become calm, the influence factors can be continuously judged, for example, the sound of environmental information in the vehicle is overhigh, the noise reduction function can be started, and the state of emotion of the driver can be continuously monitored until the state of emotion of the driver is relaxed.
In some embodiments, the influencing factor of the emotional state of the driver is not the environmental influence in the vehicle or outside the vehicle, may be physiological pain, or agitation of the molname, or other vexation, so that the driving environment adjustment may not be realized in a targeted manner, and the preset driving mode may be adopted to realize the universality adjustment.
Further, the environmental conditioning module 14 includes an emotion conditioning module and a comfort conditioning module.
The emotion regulating module is used for regulating when the physiological state information, the in-vehicle environment information and the out-of-vehicle environment information become influencing factors of the emotion state of the driver, correspondingly regulating the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle, and can be specifically described by referring to the conditions of the influencing factors.
The comfort adjusting module is used for correspondingly adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the historical comfort adjusting data of the driver when the influence factors of the emotion state of the driver are unknown, for example, adjusting the temperature and humidity in the vehicle to comfortable parameters, reducing the driving speed, playing the favorite audio and video of the driver, adjusting the atmosphere lamp, starting the aromatherapy and the like.
According to the above, the auxiliary driving system for automatically adjusting the driving environment can adjust the driving environment in the vehicle in real time according to the vehicle environment information and the emotion state of the driver in the driving process, improve the driving experience of the driver and maintain a good takeover state for the driver; therefore, when the automatic driving system actively alarms to remind the driver to take over once the danger which is difficult to treat by the automatic driving system occurs, the taking over quality of the driver in the dangerous state is greatly improved.
The term "module" as used above may be a combination of software and/or hardware that implements the intended function. While the system described in the above embodiments is preferably implemented in hardware, implementations of software, or a combination of software and hardware, are also possible and contemplated.
Based on the same conception, the application also provides an auxiliary driving method for automatically adjusting the driving environment, which can adopt the auxiliary driving system for automatically adjusting the driving environment. Since the principle of the solution of the problem is similar to that of the system, embodiments of the method can be referred to the implementation of the system, and the repetition is not repeated.
Referring to fig. 2, the driving assisting method for automatically adjusting a driving environment provided by the application comprises the following steps:
S21: collecting physiological state information and emotional state information of a driver in a driving process in real time; and acquiring the vehicle internal environment information and the vehicle external environment information in the driving process in real time.
And calculating the environmental difference between the interior and the exterior of the target vehicle according to the road type, traffic state, weather state, light intensity outside the target vehicle, temperature and humidity outside the target vehicle, light intensity inside the target vehicle and temperature and humidity inside the target vehicle.
S22: and judging influence factor information causing the change of the emotional state of the driver according to the physiological state information, the emotional state information, the in-vehicle environment information and the in-vehicle environment information.
When the emotional state information of the driver changes, acquiring the previous physiological state information, the vehicle internal environment information and the vehicle external environment information corresponding to the previous emotional state information of the driver; and comparing the past physiological state information, the vehicle internal environment information and the vehicle external environment information with physiological state information, vehicle internal environment information and vehicle external environment information corresponding to the current driver emotional state information to obtain influence factors which influence the change of the driver emotional state by the physiological state of the driver, the vehicle internal environment and the vehicle external environment.
And if the change states of the physiological state information, the vehicle internal environment information and the vehicle external environment information exceed the threshold values, judging whether the current emotional state of the driver corresponds to the changed physiological state information, the changed vehicle internal environment information and the changed vehicle external environment information.
S23: and adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the influence factor information judged by the information processing module.
The details may be as described with reference to the embodiment of fig. 1; in addition, in some embodiments, when the physiological state information, the in-vehicle environment information, and the out-of-vehicle environment information become influencing factors of the driver's emotional state, the in-vehicle environment, the driving mode of the target vehicle, and the media function of the target vehicle are adjusted correspondingly; when the influence factors of the emotional state of the driver are unknown, the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle are correspondingly adjusted according to the historical comfort level adjusting data of the driver.
Referring to fig. 3, a flow chart of an auxiliary driving method for automatically adjusting a driving environment according to the present application is shown in fig. 3, and the method may include the following steps:
s31, acquiring vehicle environment information in the driving process in real time and acquiring physiological state information of a driver in the driving process in real time;
s32, inquiring a prestored emotion database according to the physiological state information so as to match the emotion state of the driver;
S33, acquiring current driving environment information according to the vehicle environment information and the emotion state of the driver;
s34, inquiring a first corresponding relation table of the pre-stored current driving environment information and the corresponding driving mode according to the current driving environment information so as to match the driving mode;
S35, inquiring a second corresponding relation table of the prestored driving mode and the corresponding target in-vehicle environment parameter according to the matched driving mode so as to acquire the target in-vehicle environment parameter;
S36, adjusting the current in-vehicle environment parameters to the target in-vehicle environment parameters.
It should be noted that the above-described acts or steps may be performed in a different order than the embodiments and still achieve desirable results, and further, the processes depicted in the figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
In some embodiments, a camera may be used to collect facial image information of a driver as the physiological state information, so as to match the emotional state of the driver according to the facial image information. Or a sensor is adopted to collect heart rate and/or blood pressure of a driver as the physiological state information, so that the emotional state of the driver is matched according to the heart rate and/or the blood pressure, or a camera is adopted to collect facial image information of the driver, and a sensor is adopted to collect heart rate and/or blood pressure of the driver, so that the emotional state of the driver is matched according to the facial image information and the heart rate and/or the blood pressure.
In some embodiments, the vehicle environment information includes road type, traffic state, weather state, and light intensity outside the vehicle, and light intensity inside the vehicle, and the adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter in step S36 includes: according to the temperature, humidity and wind speed in the vehicle in the target vehicle environment parameters, adjusting the environment temperature, humidity, air-conditioner air outlet speed and air circulation mode in the vehicle; and controlling the opening and closing of the sunshade curtain in the vehicle and adjusting the light intensity of the lamp light in the vehicle according to the light intensity in the vehicle in the target vehicle environment parameter.
In some embodiments, the vehicle environment information further includes an in-vehicle oxygen concentration and/or a carbon dioxide concentration. The adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter in step S36 further includes: and adjusting the oxygen concentration in the vehicle according to the oxygen concentration of the environmental parameter in the target vehicle and/or adjusting the carbon dioxide concentration in the vehicle according to the carbon dioxide concentration of the environmental parameter in the target vehicle.
In some embodiments, the adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter in step S36 further includes: the in-vehicle negative ion concentration is adjusted, for example, increased, according to the negative ion concentration of the target in-vehicle environmental parameter.
In some embodiments, the ride-on mode includes a system development state initially calibrated set-up ride-on mode and a driver-autonomous acquisition data entry custom ride-on mode, and in particular, the system development state initially calibrated set-up ride-on mode may include: grassland mode, mountain mode, seaside mode, forest mode, desert mode, mountain mode, home mode, rural trail mode, etc.; the in-vehicle environmental parameters to which each mode relates include, but are not limited to: the parameter values corresponding to different modes can be initially calibrated in a system development state, specifically, a user-defined driving mode for automatically acquiring data input by a driver can be formed by enabling the driver to drive a vehicle to a target environment, enabling the system to acquire and store data parameters of the current environment in real time after idling for a preset distance, for example, enabling the driver to drive the vehicle to a highway in a silent forest, enabling the driver to drive at an idling speed for about 500 meters, entering the user-defined acquisition mode, acquiring and storing data parameters (illumination, temperature, humidity, oxygen concentration, carbon dioxide concentration, anion concentration, wind speed and the like) of the current environment in real time, preferably, enabling the data parameters of the current environment to be acquired in real time to support manual adjustment, namely, enabling the user to finely adjust the acquired data to adapt to the situation of the driver.
In some embodiments, the first correspondence table of the current driving environment information and the corresponding driving mode may be a one-to-one correspondence, or may be a many-to-one or a one-to-many correspondence. For example, on a highway with a plurality of vehicles and wet and slippery rainy days, the current driving environment information with the uncomfortable expression of the driver can be corresponding to a driving mode of a grassland mode or a driving mode of a home mode; the current driving environment information of the driver, which is bright in sunlight and thin in road width and shows tired drowsiness, can be corresponding to a riding mode of a forest mode or a riding mode of a mountain forest mode.
In some embodiments, the method further comprises: the method and the device for automatically adjusting the driving mode of the vehicle support the manual setting of the driver and manually selecting the driving mode, and when the driver manually sets the related matching principle of the current driving environment information and the corresponding driving mode, the driver can respond to the autonomous selection of the driver preferentially, so that the current driving environment parameter is adjusted to the corresponding target driving environment parameter, and when a plurality of driving modes are matched, the driving mode selected by the driver can also be received.
According to the above, the auxiliary driving method for automatically adjusting the driving environment can realize real-time adjustment of the driving environment in the vehicle according to the vehicle environment information and the emotion state of the driver in the driving process, improve the driving experience of the driver and maintain a good takeover state for the driver; therefore, when the automatic driving system actively alarms to remind the driver to take over once the danger which is difficult to treat by the automatic driving system occurs, the taking over quality of the driver in the dangerous state is greatly improved.
It should be noted that, in the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described as different from other embodiments, and identical/similar parts between the embodiments are referred to each other. For the method embodiments disclosed in the embodiments, since they correspond to the system embodiments disclosed in the embodiments, the description is relatively simple, and the relevant points refer to part of the description of the system embodiments.
Those of ordinary skill in the art will appreciate that implementing all or part of the steps in the above-described method embodiments may be accomplished by programming instructions in a computer readable storage medium, referred to herein as a storage medium, such as: ROM/RAM, magnetic disks, optical disks, etc. That is, the present application also discloses a computer-readable storage medium having stored therein a computer-executable program which, when executed by a processor, implements the method according to the above-described embodiments of the present application. The computer executable program may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Those of skill would further appreciate that the various illustrative systems and method steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of functionality in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application, but such implementation is not intended to be limiting.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application.
Claims (12)
1. An assisted driving system for automatically adjusting a driving environment, the system comprising:
The state acquisition module is used for acquiring physiological state information and emotion state information of a driver in the driving process in real time;
The environment acquisition module is used for acquiring the environment information in the vehicle and the environment information outside the vehicle in the driving process in real time;
The information processing module is used for judging influence factor information causing the change of the emotional state of the driver according to the physiological state information, the emotional state information, the in-vehicle environment information and the in-vehicle environment information; the information processing module comprises an influence factor calculation module, wherein the influence factor calculation module is used for acquiring the past physiological state information, the vehicle internal environment information and the vehicle external environment information corresponding to the previous driver emotion state information when the driver emotion state information changes; comparing the past physiological state information, the vehicle internal environment information and the vehicle external environment information with physiological state information, vehicle internal environment information and vehicle external environment information corresponding to the current driver emotional state information to obtain whether the physiological state, the vehicle internal environment and the vehicle external environment of the driver form influence factors influencing the change of the driver emotional state;
The environment adjusting module is respectively interacted with the state acquisition module, the environment acquisition module and the information processing module through buses, and is used for adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the influence factor information judged by the information processing module.
2. The system of claim 1, wherein the status acquisition module comprises:
The emotion recognition module is used for judging the emotion state of the driver by utilizing micro-expression recognition according to the collected facial image information of the driver;
a sensor module for acquiring a plurality of physiological parameters of the driver for characterizing the emotional state, the physiological parameters including at least a body temperature, a heart rate and/or a blood pressure of the driver.
3. The system of claim 1 or 2, wherein the environment acquisition module further comprises:
The difference processing module is used for calculating the environmental difference inside and outside the target vehicle according to the road type, traffic state, weather state, light intensity outside the vehicle, temperature and humidity outside the vehicle, light intensity inside the vehicle and temperature and humidity inside the vehicle.
4. The system according to claim 1, wherein the influence factor calculation module includes an information comparison unit, the information comparison unit is configured to determine whether the physiological state information, the in-vehicle environment information, and the change state of the in-vehicle environment information exceed a threshold value, and if so, determine whether the current emotional state of the driver corresponds to the changed physiological state information, in-vehicle environment information, and out-of-vehicle environment information.
5. The system of claim 4, wherein the environmental conditioning module comprises an emotion conditioning module and a comfort conditioning module;
The emotion regulating module is used for regulating when the physiological state information, the in-vehicle environment information and the out-of-vehicle environment information become influencing factors of the emotion state of the driver, and correspondingly regulating the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle;
The comfort adjusting module is used for correspondingly adjusting the environment in the target vehicle, the driving mode of the target vehicle and the media function of the target vehicle according to the historical comfort adjusting data of the driver when the influence factors of the emotion states of the driver are unknown.
6. The system of claim 1, wherein the environmental conditioning module comprises:
the negative ion controller is used for detecting the concentration of negative ions in the vehicle and adjusting the concentration of the negative ions in the vehicle according to the negative ion concentration of the environmental parameter in the target vehicle;
The gas concentration sensors are respectively arranged at the front seat and the rear seat of the vehicle and are used for detecting the oxygen concentration and/or the carbon dioxide concentration in the vehicle;
The air conditioner controller is used for adjusting the environmental temperature, the humidity, the air outlet speed of the air conditioner and the air circulation mode in the vehicle according to the temperature, the humidity and the air speed in the vehicle in the environmental parameters of the target vehicle;
And the vehicle body controller is used for controlling the opening and closing of the sunshade curtain in the vehicle and adjusting the light intensity and the driving speed of the lamp light in the vehicle according to the light intensity in the vehicle in the target vehicle environment parameter.
7. The system of claim 1, wherein the environmental collection module further comprises a negative ion controller for detecting a negative ion concentration in the vehicle and adjusting the negative ion concentration in the vehicle based on the negative ion concentration of the target in-vehicle environmental parameter.
8. The system of claim 1, wherein the ride mode comprises a set ride mode for initial calibration of system development states and a custom ride mode for driver autonomous acquisition data entry.
9. The system according to claim 8, wherein the custom driving mode is formed by driving the vehicle into the target environment by the driver, and the system collects and stores the data parameters of the current environment in real time after idling straight driving for a preset distance.
10. The system of claim 1, wherein the environmental adjustment module is further configured to receive a driving pattern autonomously selected by the driver and to make a current in-vehicle environmental parameter adjustment.
11. A method of assisted driving for automatically adjusting a driving environment, the method comprising:
Collecting vehicle environment information in the driving process in real time and collecting physiological state information of a driver in the driving process in real time;
inquiring a prestored emotion database according to the physiological state information so as to match the emotion state of the driver;
Acquiring current driving environment information according to the vehicle environment information and the emotion state of the driver;
Inquiring a first corresponding relation table of the pre-stored current driving environment information and the corresponding driving mode according to the current driving environment information so as to match the driving mode;
inquiring a second corresponding relation table of the prestored driving mode and the corresponding target in-vehicle environment parameter according to the matched driving mode so as to acquire the target in-vehicle environment parameter;
And adjusting the current in-vehicle environment parameter to the target in-vehicle environment parameter.
12. A computer-readable storage medium, characterized in that the storage medium stores a computer-executable program which, when executed by a processor, implements the steps of the method as claimed in claim 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111507451.0A CN114132328B (en) | 2021-12-10 | 2021-12-10 | Auxiliary driving system and method for automatically adjusting driving environment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111507451.0A CN114132328B (en) | 2021-12-10 | 2021-12-10 | Auxiliary driving system and method for automatically adjusting driving environment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114132328A CN114132328A (en) | 2022-03-04 |
| CN114132328B true CN114132328B (en) | 2024-05-14 |
Family
ID=80385836
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111507451.0A Active CN114132328B (en) | 2021-12-10 | 2021-12-10 | Auxiliary driving system and method for automatically adjusting driving environment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114132328B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115214303A (en) * | 2022-04-25 | 2022-10-21 | 广州汽车集团股份有限公司 | Method and system for regulating and controlling temperature in vehicle |
| CN115303281A (en) * | 2022-07-29 | 2022-11-08 | 一汽奔腾轿车有限公司 | Vehicle-mounted intelligent control system and control method based on emotion recognition |
| CN115891576A (en) * | 2023-01-17 | 2023-04-04 | 威驰腾(福建)汽车有限公司 | Electric vehicle temperature adjusting method, device, system and medium |
| CN116061959A (en) * | 2023-04-03 | 2023-05-05 | 北京永泰万德信息工程技术有限公司 | Human-computer interaction method for vehicle, vehicle and storage medium |
Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005149201A (en) * | 2003-11-17 | 2005-06-09 | Nissan Motor Co Ltd | Operator's mental state determining device |
| JP2006282111A (en) * | 2005-04-04 | 2006-10-19 | Denso Corp | User reception system for automobile |
| JP2008056059A (en) * | 2006-08-30 | 2008-03-13 | Equos Research Co Ltd | Driver state estimation device and driving support device |
| CN104859559A (en) * | 2014-12-22 | 2015-08-26 | 北汽福田汽车股份有限公司 | Method and device for controlling internal environment of vehicle |
| DE102014207807A1 (en) * | 2014-04-25 | 2015-10-29 | Bayerische Motoren Werke Aktiengesellschaft | Personal driver assistance |
| CN106652378A (en) * | 2015-11-02 | 2017-05-10 | 比亚迪股份有限公司 | Driving reminding method and system for vehicle, server and vehicle |
| US9878663B1 (en) * | 2016-12-07 | 2018-01-30 | International Business Machines Corporation | Cognitive dialog system for driving safety |
| CN107662611A (en) * | 2017-11-06 | 2018-02-06 | 吉林大学 | A kind of automatic driving mode switching system based on driver's Emotion identification |
| DE102017124900A1 (en) * | 2016-10-27 | 2018-05-03 | Ford Global Technologies, Llc | Method and device for adapting the vehicle to a driver's condition |
| CN109446375A (en) * | 2018-10-29 | 2019-03-08 | 广州小鹏汽车科技有限公司 | Adaptive method for playing music and system applied to vehicle |
| CN110765945A (en) * | 2019-10-23 | 2020-02-07 | 上海能塔智能科技有限公司 | Test driving management method, vehicle-mounted intelligent device and computer readable storage medium |
| KR20200029715A (en) * | 2018-09-11 | 2020-03-19 | 현대자동차주식회사 | Content display ranking determining device, controlling method of content display ranking determining device, vehicle which the content display ranking determining device installed in |
| CN110908576A (en) * | 2018-09-18 | 2020-03-24 | 阿里巴巴集团控股有限公司 | Vehicle system/vehicle application display method and device and electronic equipment |
| DE102019200597A1 (en) * | 2018-10-12 | 2020-04-16 | Vitesco Technologies Germany Gmbh | Method and device for adapting a driving mode of a vehicle to the emotional state of the driver |
| CN112137630A (en) * | 2020-09-27 | 2020-12-29 | 广州汽车集团股份有限公司 | Method and system for relieving negative emotion of driver |
| CN112172830A (en) * | 2019-06-17 | 2021-01-05 | 上海博泰悦臻网络技术服务有限公司 | Driver state monitoring method and system, readable storage medium and vehicle-mounted terminal |
| CN112277955A (en) * | 2020-10-30 | 2021-01-29 | 安徽江淮汽车集团股份有限公司 | Driving assistance method, device, equipment and storage medium |
| CN112370037A (en) * | 2020-11-24 | 2021-02-19 | 惠州华阳通用电子有限公司 | Safe driving method and system based on emotion recognition |
| CN112785837A (en) * | 2019-11-11 | 2021-05-11 | 上海博泰悦臻电子设备制造有限公司 | Method and device for recognizing emotion of user when driving vehicle, storage medium and terminal |
| CN113119894A (en) * | 2019-12-30 | 2021-07-16 | 上海仙豆智能机器人有限公司 | Vehicle auxiliary driving method and vehicle |
| WO2021196721A1 (en) * | 2020-03-30 | 2021-10-07 | 上海商汤临港智能科技有限公司 | Cabin interior environment adjustment method and apparatus |
| JP2021171539A (en) * | 2020-04-30 | 2021-11-01 | 株式会社Subaru | Passenger emotion transmission device |
| DE102021005092A1 (en) * | 2021-10-12 | 2021-11-25 | Daimler Ag | Method and device for recognizing emotional states of occupants of a vehicle |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102625398B1 (en) * | 2018-08-17 | 2024-01-17 | 현대자동차주식회사 | Vehicle and control method for the same |
-
2021
- 2021-12-10 CN CN202111507451.0A patent/CN114132328B/en active Active
Patent Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005149201A (en) * | 2003-11-17 | 2005-06-09 | Nissan Motor Co Ltd | Operator's mental state determining device |
| JP2006282111A (en) * | 2005-04-04 | 2006-10-19 | Denso Corp | User reception system for automobile |
| JP2008056059A (en) * | 2006-08-30 | 2008-03-13 | Equos Research Co Ltd | Driver state estimation device and driving support device |
| DE102014207807A1 (en) * | 2014-04-25 | 2015-10-29 | Bayerische Motoren Werke Aktiengesellschaft | Personal driver assistance |
| CN104859559A (en) * | 2014-12-22 | 2015-08-26 | 北汽福田汽车股份有限公司 | Method and device for controlling internal environment of vehicle |
| CN106652378A (en) * | 2015-11-02 | 2017-05-10 | 比亚迪股份有限公司 | Driving reminding method and system for vehicle, server and vehicle |
| DE102017124900A1 (en) * | 2016-10-27 | 2018-05-03 | Ford Global Technologies, Llc | Method and device for adapting the vehicle to a driver's condition |
| US9878663B1 (en) * | 2016-12-07 | 2018-01-30 | International Business Machines Corporation | Cognitive dialog system for driving safety |
| CN107662611A (en) * | 2017-11-06 | 2018-02-06 | 吉林大学 | A kind of automatic driving mode switching system based on driver's Emotion identification |
| KR20200029715A (en) * | 2018-09-11 | 2020-03-19 | 현대자동차주식회사 | Content display ranking determining device, controlling method of content display ranking determining device, vehicle which the content display ranking determining device installed in |
| CN110908576A (en) * | 2018-09-18 | 2020-03-24 | 阿里巴巴集团控股有限公司 | Vehicle system/vehicle application display method and device and electronic equipment |
| DE102019200597A1 (en) * | 2018-10-12 | 2020-04-16 | Vitesco Technologies Germany Gmbh | Method and device for adapting a driving mode of a vehicle to the emotional state of the driver |
| CN109446375A (en) * | 2018-10-29 | 2019-03-08 | 广州小鹏汽车科技有限公司 | Adaptive method for playing music and system applied to vehicle |
| CN112172830A (en) * | 2019-06-17 | 2021-01-05 | 上海博泰悦臻网络技术服务有限公司 | Driver state monitoring method and system, readable storage medium and vehicle-mounted terminal |
| CN110765945A (en) * | 2019-10-23 | 2020-02-07 | 上海能塔智能科技有限公司 | Test driving management method, vehicle-mounted intelligent device and computer readable storage medium |
| CN112785837A (en) * | 2019-11-11 | 2021-05-11 | 上海博泰悦臻电子设备制造有限公司 | Method and device for recognizing emotion of user when driving vehicle, storage medium and terminal |
| CN113119894A (en) * | 2019-12-30 | 2021-07-16 | 上海仙豆智能机器人有限公司 | Vehicle auxiliary driving method and vehicle |
| WO2021196721A1 (en) * | 2020-03-30 | 2021-10-07 | 上海商汤临港智能科技有限公司 | Cabin interior environment adjustment method and apparatus |
| JP2021171539A (en) * | 2020-04-30 | 2021-11-01 | 株式会社Subaru | Passenger emotion transmission device |
| CN112137630A (en) * | 2020-09-27 | 2020-12-29 | 广州汽车集团股份有限公司 | Method and system for relieving negative emotion of driver |
| CN112277955A (en) * | 2020-10-30 | 2021-01-29 | 安徽江淮汽车集团股份有限公司 | Driving assistance method, device, equipment and storage medium |
| CN112370037A (en) * | 2020-11-24 | 2021-02-19 | 惠州华阳通用电子有限公司 | Safe driving method and system based on emotion recognition |
| DE102021005092A1 (en) * | 2021-10-12 | 2021-11-25 | Daimler Ag | Method and device for recognizing emotional states of occupants of a vehicle |
Non-Patent Citations (1)
| Title |
|---|
| 新时代智能座舱面面观：更舒适、更懂你的人因工程;薛楠;智能网联汽车(第5期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114132328A (en) | 2022-03-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114132328B (en) | Auxiliary driving system and method for automatically adjusting driving environment and storage medium | |
| CN108688676B (en) | Vehicle driving support system and vehicle driving support method | |
| CN108688673B (en) | Vehicle driving support system | |
| CN108688675B (en) | Vehicle driving support system | |
| US20190016344A1 (en) | Method for adjusting at least one operating parameter of a transportation vehicle, system for adjusting at least one operating parameter of a transportation vehicle, and transportation vehicle | |
| JP4332813B2 (en) | Automotive user hospitality system | |
| US20080119994A1 (en) | Vehicular user hospitality system | |
| CN111391858A (en) | Intelligent cabin system control method and system and automobile | |
| CN106864453A (en) | Driving and environmental control system and method based on big data | |
| GB2486943A (en) | Driver assistance system with fatigue ascertainment devices | |
| JP2008013004A (en) | Driving support system by generating flavor | |
| JP2007145225A (en) | User hospitality system for vehicle | |
| US20180275652A1 (en) | Driving assistance device | |
| US9809057B2 (en) | System and method for determining the information transfer rate between a driver and vehicle | |
| CN110682792A (en) | Method, apparatus, system, and computer-readable storage medium for vehicle control | |
| CN112947759A (en) | Vehicle-mounted emotional interaction platform and interaction method | |
| JP4621983B2 (en) | Automotive user hospitality system | |
| CN114655226A (en) | Intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system | |
| CN118205507A (en) | Method, apparatus, related device and computer program product for assisting sleep of vehicle-mounted passenger | |
| US10077055B2 (en) | System and method for determining the information transfer rate between a driver and vehicle | |
| CN112046235B (en) | Method for purifying air in vehicle and vehicle-mounted terminal | |
| CN117842022A (en) | Driving safety control method and device for artificial intelligent cabin, vehicle and medium | |
| CN208559320U (en) | Driving assistance system | |
| JP4968532B2 (en) | Automotive user hospitality system | |
| JP2017199270A (en) | Safety drive support device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |