CN114655226A - Intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system - Google Patents

Intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system Download PDF

Info

Publication number
CN114655226A
CN114655226A CN202210314151.9A CN202210314151A CN114655226A CN 114655226 A CN114655226 A CN 114655226A CN 202210314151 A CN202210314151 A CN 202210314151A CN 114655226 A CN114655226 A CN 114655226A
Authority
CN
China
Prior art keywords
intelligent
driver
state
display screen
computer interaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210314151.9A
Other languages
Chinese (zh)
Inventor
臧力卓
尚家卉
李庆森
孟蕴豪
张玉霞
刘沣锐
李皓
崔明亮
李琪蕊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jilin University
Original Assignee
Jilin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jilin University filed Critical Jilin University
Priority to CN202210314151.9A priority Critical patent/CN114655226A/en
Publication of CN114655226A publication Critical patent/CN114655226A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W50/16—Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B60W2040/0836—Inactivity or incapacity of driver due to alcohol
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0872—Driver physiology
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means

Abstract

The invention is suitable for the technical field of intelligent cabins, and provides an intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system, which comprises an instrument display screen and a central control display screen, and further comprises: the intelligent steering wheel is provided with a grip sensor, and is also provided with a driver voice microphone and a steering wheel display screen; the intelligent interactive seat comprises a seat body and an intelligent functional system, wherein the intelligent functional system comprises a voice interactive loudspeaker, a heart rate sensor and a seat integration module; the system comprises a driver monitoring camera, a chat robot and a chat server, wherein one side of the driver monitoring camera is provided with the chat robot; and a force sensor. The system can fully consider various driving states influencing driving safety, improve user experience as far as possible while monitoring and adjusting the driving state of a driver, optimize the adjusting effect to the maximum extent and ensure the driving safety.

Description

Intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system
Technical Field
The invention belongs to the technical field of intelligent cabins, and particularly relates to an intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system.
Background
Nowadays, automobiles are indispensable vehicles when people go out, and the emotional conditions of drivers can directly influence the driving safety. Among them, the bad driving state is one of the major risks leading to traffic accidents. With the rapid development of science and technology, people continuously pursue the intellectualization of the driving process and the comfort level in the driving process, and the intelligent cabin concept starting from the demand of consumers is produced.
Although the traffic accident cannot be completely avoided, the condition of the driver is monitored and early warned, and the accident occurrence rate is reduced to a great extent. Meanwhile, the automatic driving technology is gradually maturing, and more automobile enterprises try to apply the automatic driving technology to help prevent traffic accidents.
In the existing scheme, monitoring and early warning of various negative driving states (such as fatigue state, distraction state, bad emotion, smoking, drunk driving and other behaviors) of a driver can be realized, but most of schemes can only monitor and early warn one driving state, and unification of four measures, namely recognition monitoring of various driver states, a complete warning system, good user experience and emergency measures of a vehicle in an emergency situation cannot be realized.
Disclosure of Invention
The embodiment of the invention aims to provide an intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system, and aims to solve the problem that equipment for monitoring various negative driving states of a driver in the existing scheme cannot realize the unification of four modes, namely recognition monitoring of various driver states, a complete warning system, good user experience and emergency measures of a vehicle in an emergency situation.
The embodiment of the invention is realized in such a way that the intelligent cabin multi-mode man-machine interaction driver state monitoring and adjusting system comprises an instrument display screen and a central control display screen, and further comprises:
the intelligent steering wheel is internally provided with a heating module and a vibration generating device, and is also provided with a driver voice microphone and a steering wheel display screen;
the intelligent interactive seat comprises a seat body and an intelligent functional system, wherein the intelligent functional system comprises a voice interactive loudspeaker, a heart rate sensor and a seat integration module, the voice interactive loudspeaker is arranged on the side part of a seat headrest, and the heart rate sensor is arranged in the center of the upper part of the seat;
the intelligent cockpit domain controller comprises a driver monitoring camera, an intelligent cockpit domain controller and a chat robot, wherein the driver monitoring camera is arranged above an instrument display screen and is used for identifying, capturing and extracting facial features of a driver and transmitting image information to the intelligent cockpit domain controller; and
install the dynamics sensor on the footboard.
According to the technical scheme, the steering wheel display screen is installed in the center of the intelligent steering wheel and used for displaying vehicle running information, and the driver voice microphone is installed above the steering wheel display screen and used for recognizing voice information of a driver and transmitting the voice information to the intelligent cabin domain controller.
The technical scheme is further characterized by further comprising an intelligent air-conditioning system, wherein an intelligent fragrance system is arranged in the intelligent air-conditioning system.
According to the further technical scheme, a head-up display system is further arranged at the front windshield of the vehicle.
According to a further technical scheme, the seat integration module comprises a heating unit, a ventilation unit, a massage unit and a vibration unit, and functions of heating, ventilation, massage, vibration and the like can be achieved respectively.
According to the further technical scheme, the force sensor is installed on the rear sides of an accelerator pedal and a brake pedal.
The technical scheme further comprises an atmosphere lamp in the vehicle and a media sound player, wherein the atmosphere lamp in the vehicle is controlled by the intelligent cabin domain controller to be turned on and turned off, and the media sound player is mainly used for playing music, guiding prompts and the like and is controlled by the intelligent cabin domain controller.
In the working process of the intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system provided by the embodiment of the invention, the intelligent cabin domain controller comprehensively calculates the state of a driver by comprehensive mechanical signals, image signals, audio signals and the like, and judges whether the driver is in a dangerous driving state or not. The driving state that can fully consider various influences driving safety promotes user experience as far as possible when monitoring adjustment driver driving state to furthest optimizes its regulatory action, guarantees driving safety.
Drawings
Fig. 1 is a front view of an intelligent cabin multi-modal human-computer interaction driver state monitoring and adjusting system provided by an embodiment of the invention;
fig. 2 is a side view of an intelligent cabin multi-modal human-computer interaction driver state monitoring and adjusting system according to an embodiment of the invention;
fig. 3 is a schematic diagram of a system monitoring, early warning and interactive adjustment working process in a fatigue state in an intelligent cabin multi-modal human-computer interaction driver state monitoring and adjusting system provided by an embodiment of the invention;
fig. 4 is a schematic diagram of a system monitoring, early warning and interaction adjustment working process in a distraction state in the intelligent cabin multi-modal human-computer interaction driver state monitoring and adjustment system provided by the embodiment of the invention;
fig. 5 is a schematic diagram of a system monitoring, early warning and interactive adjustment working process in an angry state of an intelligent cabin multi-modal human-computer interaction driver state monitoring and adjusting system provided by an embodiment of the invention;
fig. 6 is a schematic diagram of a system monitoring, early warning and interactive adjustment working process in a dropping state in the intelligent cabin multi-modal human-computer interaction driver state monitoring and adjusting system provided by the embodiment of the invention;
fig. 7 is a schematic diagram of a system monitoring, early warning and interactive adjustment working process in a drunk driving state in the intelligent cabin multi-modal human-computer interaction driver state monitoring and adjusting system provided by the embodiment of the invention.
In the drawings: an atmosphere lamp 1 in the vehicle; a media sound player 2; a grip force sensor 3; an intelligent steering wheel 4; a driver monitoring camera 5; a driver voice microphone 6; a steering wheel display screen 7; an instrument display screen 8; a chat robot 9; a central control display screen 10; an intelligent air conditioning system 11; an intelligent interactive seat 12; a head-up display system 13; a voice interaction speaker 14; a heart rate sensor 15; a seat integration module 16; a force sensor 17; an intelligent cockpit domain controller 18.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Specific implementations of the present invention are described in detail below with reference to specific embodiments.
Embodiment 1, as shown in fig. 1-3, an intelligent cabin multi-modal human-computer interaction driver state monitoring and adjusting system includes, but is not limited to, a fatigue state monitoring, early warning and interaction adjusting system. When the vehicle is in a driving state, the state of the driver is monitored in real time through the driver monitoring camera 5, the heart rate sensor 15 and the like, and the intelligent cabin domain controller 18 judges whether the driver is in a fatigue driving state or not according to signals of all units. When the driver is in a safe driving state, the subsequent system does not work. When the intelligent cabin domain controller 18 judges that the driver is in a fatigue state, the multi-mode interactive early warning system and the adjusting system start to work.
The fatigue state of the driver is divided into a severe fatigue state and a mild fatigue state. When the system judges that the driver is in a severe fatigue driving state, the vehicle automatically turns on the double-flash prompting lamp to remind the surrounding vehicles and pedestrians outside and convert the vehicle into an auxiliary driving mode, and the driver is prompted to stop at the side as soon as possible in the aspects of vision and hearing through the cooperation of the steering wheel display screen 7, the instrument display screen 8, the central control display screen 10, the head-up display system 13, the voice interaction loudspeaker 14 and the like. When the system judges that the driver is in a mild fatigue state, the state of the driver is adjusted in a multi-mode man-machine interaction mode in the intelligent cabin: in the aspect of visual adjustment, a driver is reminded through the atmosphere lamp 1 in the vehicle, the head-up display system 13, each display screen and the like, and the visual sense of the driver is stimulated by matching the expression display function of the chat robot 9 with voice interactive adjustment; in the aspect of auditory regulation, the media sound player 2 plays warning sound, and carries out voice interaction regulation on the driver through the driver voice microphone 6, the voice interaction loudspeaker 14 and the like; in the aspect of touch adjustment, the driver is reminded and adjusted through the functions of heating vibration of the intelligent steering wheel 4, heating massage of the intelligent interactive seat 12 and the like; in the aspect of smell regulation, the intelligent air conditioning system 11 with an intelligent fragrance system is arranged in the automobile to regulate the smell in the automobile, so that a refreshing atmosphere is created to reduce the fatigue degree of a driver.
After a certain time, the intelligent cockpit domain controller 18 judges whether the driver is still in a fatigue state, if the driver is still in the fatigue state, the regulation is regarded as invalid, and then the state of the driver is judged to be a severe fatigue state and corresponding work is carried out; if the driver is not in the fatigue state, the adjustment is considered to be successful, the multi-mode interaction early warning system and the multi-mode interaction adjusting system are closed, and the sensing system continues to monitor the state of the driver in real time.
Embodiment 2, as shown in fig. 1, 2 and 4, a state monitoring and regulating system for a multi-modal human-computer interaction driver of an intelligent cabin, including but not limited to a distraction state monitoring, early warning and interaction regulating system. When the vehicle is in a running state, the sensing system monitors the state of the driver in real time through the driver monitoring camera 5, the grip sensor 3 and the like, and the intelligent cabin domain controller 18 judges whether the driver is in a distracted driving state or not according to all unit signals. When the driver is in a safe driving state, the subsequent system does not work. When the intelligent cabin domain controller 18 judges that the driver is in a distraction state, the multi-mode interactive early warning system and the adjusting system start to work.
When the system judges that the driver is in the distraction state, the state of the driver is adjusted in a multi-mode man-machine interaction mode in the intelligent cabin. In the aspect of visual adjustment, a driver is reminded through the atmosphere lamp 1 in the vehicle, the head-up display system 13 and each display screen, and the visual sense of the driver is stimulated by matching the expression display function of the chat robot 9 with voice interactive adjustment; in the aspect of auditory regulation, the media sound player 2 plays warning sound, and carries out voice interaction regulation on the driver through the driver voice microphone 6, the voice interaction loudspeaker 14 and the like; in the aspect of touch adjustment, the driver is reminded and adjusted through the functions of heating vibration of the intelligent steering wheel 4, heating massage of the intelligent interactive seat 12 and the like; in the aspect of smell adjustment, the smell in the vehicle is adjusted through an intelligent air conditioning system 11 with an intelligent fragrance system.
After a certain period of time, the intelligent cabin domain controller 18 judges whether the driver is still in a distraction state, if the driver is still in the distraction state, the regulation is considered invalid, then the state of the driver is judged to be a severe dangerous driving state, the vehicle automatically turns on double-flash prompting lamps to remind the external surrounding vehicles and pedestrians and convert the state into an auxiliary driving mode, and the driver is prompted to stop at the side as soon as possible through the visual and auditory aspects of the head-up display system 13, the display screens, the voice interaction loudspeaker 14 and the like; and if the driver is in a safe state, the adjustment is considered to be successful, the multi-mode interaction early warning system and the adjustment system are closed, and the sensing system continues to monitor the state of the driver in real time.
Embodiment 3, as shown in fig. 1, 2 and 5, a state monitoring and regulating system for a multi-modal man-machine interaction driver of an intelligent cabin comprises but is not limited to an angry state monitoring, early warning and interaction regulating system. When the vehicle is in a running state, the sensing system monitors the state of the driver in real time through the driver monitoring camera 5, the grip sensor 3, the force sensor 17, the driver voice microphone 6, the heart rate sensor 15 and the like, and the intelligent cockpit area controller 18 judges whether the driver is in an angry state or not according to all unit signals. When the driver is in a safe driving state, the subsequent system does not work. And when the system judges that the driver is in an angry state, the multi-modal interactive early warning system and the adjusting system start to work.
The driver's angry state is divided into a heavy angry state and a light angry state. When the intelligent cockpit area controller 18 judges that the driver is in a severe angry state, the vehicle automatically turns on double-flashing warning lights to remind the vehicles around the outside and pedestrians of turning into an auxiliary driving mode, and the driver is prompted to stop at the side as soon as possible through visual and auditory aspects such as the head-up display system 13, the display screens (the steering wheel display screen 7, the instrument display screen 8 and the central control display screen 10) and the voice interaction loudspeaker 14. When the system judges that the driver is in a mild fatigue state, the state of the driver is adjusted in a multi-mode man-machine interaction mode in the intelligent cabin: in the aspect of visual adjustment, the atmosphere lamp 1 in the vehicle flickers, the head-up display system 13 and each display screen remind a driver, and the chatting robot 9 displays angry expressions and is matched with voice interactive adjustment to stimulate visual sense of the driver; in the aspect of auditory regulation, the media sound player 2 plays relaxing music and carries out voice interactive regulation on the driver through the driver voice microphone 6, the voice interactive loudspeaker 14 and the like; in the aspect of touch adjustment, the driver is adjusted through the functions of vibration of the intelligent steering wheel 4, heating massage of the intelligent interactive seat 12 and the like; in the aspect of smell adjustment, the smell in the vehicle is adjusted through an intelligent air conditioning system 11 with an intelligent fragrance system.
After a certain time, the intelligent cockpit domain controller 18 judges whether the driver is still in an angry state, if the driver is still in the angry state, the regulation is considered invalid, and then the state of the driver is judged to be a severe angry state and corresponding work is carried out; if the driver is not in the angry state, the adjustment is considered to be successful, and the sensing system continues to monitor the state of the driver in real time.
Embodiment 4, as shown in fig. 1, 2 and 6, an intelligent cockpit driver system, including but not limited to a dropout condition monitoring and warning interaction regulation system. Perception system real-time supervision when the vehicle is traveling, driver's facial feature is drawed to driver monitoring camera 5, and driver's pronunciation microphone 6 catches speech information, and heart rate sensor 15 detects driver's heart rate state to the information transfer who will gather gives intelligent passenger cabin territory controller 18.
The intelligent cockpit area controller 18 converts the driver state information transmitted by the sensing system, then judges whether the driver is in a sad state according to the converted information, if the driver is not in the sad state, the subsequent system does not work, and the sensing system continues to work; if the driver is in the sad state, the intelligent cockpit domain controller 18 will continue to determine whether the driver is in the severe sad state.
If the driver is in a mild sad state, the intelligent cockpit domain controller 18 controls the multi-mode interactive early warning system and the adjusting system to adjust the driver: in the aspect of vision, the atmosphere lamp 1 in the vehicle flashes, the head-up display system 13 and each display screen remind a driver, and the chatting robot 9 displays a sad expression; in the aspect of touch sense, the intelligent interactive seat 12 starts the functions of massage, vibration, ventilation and temperature control, and the intelligent steering wheel 4 heats vibration; in terms of hearing, the voice interaction loudspeaker 14 reminds, and the media sound player 2 plays joyful music to adjust the emotion of the driver; in smell sense, the intelligent air conditioning system 11 with the intelligent fragrance system is used for adjusting the smell in the vehicle and changing the atmosphere in the vehicle to adjust the emotion of the driver. If the driver is in a severe sad state, the multimode interactive early warning system and the multimode interactive adjusting system are also controlled to perform the functions, and meanwhile, the vehicle can automatically start the double-flash prompting lamp to remind surrounding vehicles and pedestrians, and then the vehicle is converted into an auxiliary driving mode and parked by the side.
The perception system can monitor the driving state of the driver all the time in the driver state adjusting process, continuously transmit information to the intelligent cabin domain controller 18, judge whether the driver is still in a sad state or not, control the multi-mode interactive early warning system and the adjusting system to be closed if the driver is out of the sad state, enable the perception system to work continuously, and control the relevant systems to work according to a severe sad state processing method if the driver is still in the sad state.
Embodiment 5, as shown in fig. 1, 2 and 7, an intelligent cockpit driver system includes, but is not limited to, a drunk driving condition monitoring, early warning and interactive regulation system. When the vehicle runs, the sensing system carries out monitoring, the driver monitoring camera 5 extracts facial features of the driver, the heart rate sensor 15 detects the heart rate state of the driver, and collected information is transmitted to the intelligent cabin domain controller 18.
The intelligent cockpit area controller 18 converts the driver state information transmitted by the sensing system, and then judges whether the driver is in a drunk driving state according to the obtained result. If the driver is in a drunk driving state, the intelligent cabin domain controller 18 controls the vehicle to be converted into an auxiliary driving mode, starts a double-flashing prompt lamp, reminds the driver to stop the vehicle firmly, and controls the multi-mode interactive early warning system and the adjusting system to adjust the state of the driver: in the aspect of vision, the atmosphere lamp 1 in the vehicle flashes, the head-up display system 13 and each display screen remind a driver, and the chatting robot 9 displays related expressions; in the aspect of touch sense, the intelligent interactive seat 12 starts the functions of massage, vibration, ventilation and temperature control, and the intelligent steering wheel 4 heats vibration; in terms of hearing, the voice interaction loudspeaker 14 reminds, and the media sound player 2 plays related music to adjust the state of the driver; in terms of smell, the intelligent air conditioning system 11 with the intelligent fragrance system adjusts the smell in the vehicle and changes the atmosphere in the vehicle to adjust the state of the driver. The sensing system continuously monitors.
After a certain time, the intelligent cockpit area system judges the driving state of the driver again, if the driver is still in a drunk driving state, the vehicle continues to keep an auxiliary driving mode, keeps the double-flash prompting lamp flashing and finds a chance to grasp parking; if the driver is separated from the drunk driving state, the multi-mode interactive early warning system and the multi-mode interactive early warning adjusting system are turned off, the auxiliary driving mode is exited, the double-flashing prompt lamp is turned off, the vehicle continues to run, and meanwhile the sensing system continues to work.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.

Claims (7)

1. The utility model provides an intelligence passenger cabin multi-modal human-computer interaction driver state monitoring governing system, includes instrument display screen and well accuse display screen, its characterized in that still includes:
the intelligent steering wheel is internally provided with a heating module and a vibration generating device, and is also provided with a driver voice microphone and a steering wheel display screen;
the intelligent interactive seat comprises a seat body and an intelligent functional system, wherein the intelligent functional system comprises a voice interactive loudspeaker, a heart rate sensor and a seat integration module, the voice interactive loudspeaker is arranged on the side of a seat headrest, and the heart rate sensor is arranged in the center of the upper part of the seat;
the intelligent cockpit area controller comprises a driver monitoring camera, a chat robot and a communication module, wherein the driver monitoring camera is arranged above an instrument display screen and is used for identifying, capturing and extracting facial features of a driver and transmitting image information to the intelligent cockpit area controller; and
install the dynamics sensor on the footboard.
2. The intelligent cockpit multi-modal human-computer interaction driver state monitoring and adjusting system according to claim 1, wherein the steering wheel display screen is installed in the center of the intelligent steering wheel for displaying vehicle driving information, and the driver voice microphone is installed above the steering wheel display screen for recognizing the driver's voice information and transmitting the voice information to the intelligent cockpit domain controller.
3. The intelligent cockpit multi-modal human-computer interaction driver state monitoring and adjusting system according to claim 1, further comprising an intelligent air conditioning system, wherein an intelligent fragrance system is built in the intelligent air conditioning system.
4. The intelligent cockpit multi-modal human-computer interaction driver state monitoring and adjusting system according to claim 1, wherein a head-up display system is further disposed at a front windshield of the vehicle.
5. The intelligent cockpit multi-modal human-computer interaction driver state monitoring and adjustment system of claim 1, wherein said seat integration module comprises a heating unit, a ventilation unit, a massage unit, and a vibration unit.
6. The intelligent cabin multi-modal human-computer interaction driver state monitoring and adjusting system of claim 1, wherein the force sensor is installed at the rear side of an accelerator pedal and a brake pedal.
7. The intelligent cockpit multi-modal human-computer interaction driver state monitoring and adjustment system of claim 1, further comprising an interior atmosphere light and a media sound player.
CN202210314151.9A 2022-03-28 2022-03-28 Intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system Pending CN114655226A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210314151.9A CN114655226A (en) 2022-03-28 2022-03-28 Intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210314151.9A CN114655226A (en) 2022-03-28 2022-03-28 Intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system

Publications (1)

Publication Number Publication Date
CN114655226A true CN114655226A (en) 2022-06-24

Family

ID=82034026

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210314151.9A Pending CN114655226A (en) 2022-03-28 2022-03-28 Intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system

Country Status (1)

Country Link
CN (1) CN114655226A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116853267A (en) * 2023-07-14 2023-10-10 润芯微科技(江苏)有限公司 Internet of things health mode system of multiple devices in vehicle and operation method thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116853267A (en) * 2023-07-14 2023-10-10 润芯微科技(江苏)有限公司 Internet of things health mode system of multiple devices in vehicle and operation method thereof

Similar Documents

Publication Publication Date Title
JP6860271B2 (en) Systems and methods that respond to driver behavior
US10875536B2 (en) Coordinated vehicle response system and method for driver behavior
US20190016344A1 (en) Method for adjusting at least one operating parameter of a transportation vehicle, system for adjusting at least one operating parameter of a transportation vehicle, and transportation vehicle
CN111439271A (en) Auxiliary driving method and auxiliary driving equipment based on voice control
WO2014149657A1 (en) Coordinated vehicle response system and method for driver behavior
CN111391858A (en) Intelligent cabin system control method and system and automobile
AU2012218054A1 (en) System and method for responding to driver behavior
CN114655226A (en) Intelligent cabin multi-mode human-computer interaction driver state monitoring and adjusting system
CN111252087A (en) Driver platform control system
CN114132328A (en) Driving assistance system and method for automatically adjusting driving environment and storage medium
CN110077417A (en) A kind of method and system of automobile guideboard acquisition of information prompt
JP2023128558A (en) Driving support device, driving support method, and vehicle
CN117842088A (en) Method for realizing steering wheel vibration
CN114194122A (en) Safety prompt system and car
CN116424360A (en) Vehicle-mounted accompanying type intelligent pet and automobile
CN116671920A (en) Real-time monitoring system and method for health state of driver

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination