CN117842053A

CN117842053A - Method and device for reminding driver state, computer equipment and storage medium

Info

Publication number: CN117842053A
Application number: CN202311677692.9A
Authority: CN
Inventors: 陈金尧; 赵默涵; 张惠; 于昊; 李昭璐; 郑温馨; 牛方艺; 叶展华
Original assignee: FAW Group Corp
Current assignee: FAW Group Corp
Priority date: 2023-12-07
Filing date: 2023-12-07
Publication date: 2024-04-09

Abstract

The application relates to the technical field of safe driving of automobiles, in particular to a reminding method and device for a driver state, computer equipment and a storage medium. The method comprises the following steps: acquiring state information of a driver, wherein the state information comprises facial expression information, body action information and health index information; pushing health reminding information through a vehicle-mounted terminal under the condition that at least one of facial expression information, body action information or health index information is abnormal, and adjusting a functional mode in a seat cabin to relieve the abnormal state of a driver; acquiring historical state information of a driver; and when the history state information is abnormal, switching the driving mode of the vehicle to a healthy driving mode. The method can actively care the driver state, so that the bad driver state can be effectively controlled and relieved, and the driver state of driving safety is improved.

Description

Method and device for reminding driver state, computer equipment and storage medium

Technical Field

The present disclosure relates to the field of safe driving technologies for automobiles, and in particular, to a method and apparatus for reminding a driver of a state, a computer device, and a storage medium.

Background

With the development of society and the improvement of living standard of people, automobiles become a riding tool which can be born by ordinary families, but traffic accidents also increase sharply.

The traffic accident is mainly three main reasons of fatigue driving, emotional driving and distraction, wherein the accident reason is more than the "health problem of the driver". Therefore, in the driving process, the new technology is adopted to actively care the health of the vehicle owner by utilizing the environment in the vehicle, so that the health problem of the vehicle owner can be effectively controlled and relieved, the good driving state of the vehicle owner is maintained, and another practical requirement of the safety of the vehicle is formed.

Therefore, a method, device, computer equipment and storage medium for reminding driver state are needed to actively care the driver state, so that bad driver state can be effectively controlled and relieved, and driving safety is improved.

Disclosure of Invention

In view of the foregoing, it is desirable to provide a method, an apparatus, a computer device, and a storage medium for prompting a driver state, which can actively care the driver state, effectively control and alleviate the bad driver state, and improve the driving safety.

In a first aspect, the present application provides a method for reminding a driver of a state, including:

acquiring state information of a driver, wherein the state information comprises facial expression information, body action information and health index information;

pushing health reminding information through a vehicle-mounted terminal under the condition that at least one of facial expression information, body action information or health index information is abnormal, and adjusting a functional mode in a seat cabin to relieve the abnormal state of a driver;

acquiring historical state information of a driver;

and when the history state information is abnormal, switching the driving mode of the vehicle to a healthy driving mode.

In one embodiment, the switching the driving mode of the vehicle to the healthy driving mode in the case that the history state information is abnormal includes:

acquiring historical state information of a driver;

drawing a driving health portrait of the driver according to the history state information;

acquiring a driving health trend of a driver according to the driving health image;

in case that the driving health trend tends to be abnormal, sending an inquiry request for switching to a healthy driving mode to the vehicle terminal;

And acquiring response information returned by the vehicle terminal based on the inquiry request and agreeing to switch to the healthy driving mode, and switching the driving mode of the vehicle to the healthy driving mode.

In one embodiment, the functional modes include a power amplifier mode, an air conditioner mode, a light mode and a driving mode; under the condition that at least one of the facial expression information, the body action information or the health index information is abnormal, health reminding information is pushed through a vehicle-mounted terminal, and an entertainment mode in a seat cabin is adjusted, wherein the method comprises the following steps:

under the condition that the abnormal expression appears in the facial expression information, acquiring the type of the abnormal expression;

according to the abnormal expression type, matching a corresponding power amplification mode, an air conditioning mode, a light mode and a driving mode in the cabin;

and adjusting a corresponding power amplification mode, an air conditioning mode, a light mode and a driving mode.

In one embodiment, the functional mode further includes an alarm mode; the method further comprises the steps of:

when the situation that the driver is in a coma state is identified according to the facial expression information, the body action information and the health index information, the air conditioning mode is adjusted to enhance the air mobility in the cabin, the power amplification mode is adjusted to carry out voice reminding, and the alarm mode is started to carry out call alarm;

And switching the driving mode of the vehicle into an auxiliary driving mode, wherein the auxiliary driving mode is used for controlling the vehicle to slow down the speed and stop by side.

In one embodiment, the healthy driving mode includes a rest mode of the vehicle; the sending, in the case where the driving health trend tends to be abnormal, an inquiry request for switching to a healthy driving mode to the vehicle terminal includes:

and under the condition that the driver is in a fatigue state for a plurality of days according to the driving health trend, adjusting a function mode in the cabin, and sending a query request for switching to the rest mode to the vehicle terminal.

In one embodiment, the method further comprises:

acquiring a soothing music list for soothing emotion under the condition that the driver is in an anger state for a plurality of days according to the driving health trend;

and adjusting the power amplification mode, and replacing the original music list to be played in the music application of the vehicle-mounted terminal with the comfortable music list.

In a second aspect, the present application further provides a driver status alert device, including:

the system comprises an acquisition module, a control module and a control module, wherein the acquisition module is used for acquiring state information of a driver, and the state information comprises facial expression information, body action information and health index information;

The control module is used for pushing health reminding information through the vehicle-mounted terminal under the condition that at least one of the facial expression information, the body action information or the health index information is abnormal, and adjusting the functional mode in the seat cabin so as to relieve the abnormal state of a driver;

the acquisition module is also used for acquiring the history state information of the driver;

and the control module is also used for switching the driving mode of the vehicle into a healthy driving mode under the condition that the historical state information is abnormal.

In a third aspect, the present application also provides a computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:

acquiring historical state information of a driver;

In a fourth aspect, the present application also provides a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of:

acquiring historical state information of a driver;

In a fifth aspect, the present application also provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of:

acquiring historical state information of a driver;

The reminding method, the reminding device, the computer equipment and the storage medium for the state of the driver detect abnormal conditions by acquiring the state information of the driver, including facial expression information, body motion information and health index information. Once abnormality is found, health reminding information is pushed through the vehicle-mounted terminal, and the function mode in the cabin is adjusted to relieve the abnormal state of the driver. In addition, historical state information of the driver can be obtained, and if the abnormal situation is found to exist continuously, the driving mode of the vehicle can be switched to the healthy driving mode, so that the safety of the driver is further ensured. The effect of this technique is to improve driving safety and reduce traffic accidents caused by health problems of the driver. The abnormal state of the driver can be timely found and reminded, so that the driver can be prompted to take appropriate measures, and the good driving state can be maintained. The technology can also help to control and relieve the bad state of the driver and improve the driving safety by actively and chronically caring the health of the driver.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the related art, the drawings that are required to be used in the embodiments or the related technical descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to the drawings without inventive effort for a person having ordinary skill in the art.

FIG. 1 is an application environment diagram of a method of reminding a driver of a state in one embodiment;

FIG. 2 is a flow chart of a method for reminding a driver of a driver state according to one embodiment;

FIG. 3 is a flow chart of a method for reminding a driver of a driver state according to another embodiment;

FIG. 4 is a block diagram of a driver status reminder in one embodiment;

fig. 5 is an internal structural diagram of a computer device in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.

The reminding method for the driver state provided by the embodiment of the application can be applied to an application environment shown in fig. 1. Wherein the terminal 102 communicates with the server 104 via a network. The data storage system may store data that the server 104 needs to process. The data storage system may be integrated on the server 104 or may be located on a cloud or other network server.

The server 104 acquires state information of the driver, including facial expression information, body motion information, and health index information; pushing health reminding information through a vehicle-mounted terminal under the condition that at least one of facial expression information, body action information or health index information is abnormal, and adjusting a functional mode in a seat cabin to relieve the abnormal state of a driver; acquiring historical state information of a driver; and when the history state information is abnormal, switching the driving mode of the vehicle to a healthy driving mode.

The terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, internet of things devices, and portable wearable devices, where the internet of things devices may be smart speakers, smart televisions, smart air conditioners, smart vehicle devices, and the like. The portable wearable device may be a smart watch, smart bracelet, headset, or the like. The server 104 may be implemented as a stand-alone server or as a server cluster of multiple servers.

In an exemplary embodiment, as shown in fig. 2, a method for reminding a driver of a state is provided, and an example in which the method is applied to the server in fig. 1 is described, including the following steps S202 to S208. Wherein:

step S202, obtaining state information of the driver, wherein the state information includes facial expression information, body motion information and health index information.

Specifically, facial expression changes of the driver are captured through a camera or a sensor, for example, the appearance of the expression features such as drowsiness, fatigue, distraction and the like of the driver are detected. This can help judge the driver's attention and emotional state, reminding them to resume concentration or rest in time. The driver's body movements and gestures, such as head tilt, blink frequency, hand movements, etc., are monitored by sensors or devices. Such information may be used to assess the driver's alertness and responsiveness, such as to detect an action that the driver is too tired or unsuitable for driving, and may be alerted or alerted. Physiological parameters and health indicators of the driver, such as heart rate, blood pressure, body temperature, etc., are monitored by sensors or devices. The indexes can reflect the health conditions of the driver, such as weakness, heart diseases and the like, help judge whether the driver is suitable for driving, and timely take necessary measures.

In a word, through obtaining facial expression, physical action and health index information of a driver, the health condition and driving state of the driver can be evaluated and monitored, so that targeted reminding and warning are provided, the driver is helped to keep a good driving state, and driving safety is improved.

Illustratively, information such as heart rate, respiratory rate, blood pressure, heart rate variability, facial expression, fatigue state, motion and the like of the driver is continuously collected through a corresponding sensor of a DMS (driver vision monitoring system) in the vehicle and uploaded to a cloud processing analysis. And carrying out big data intelligent analysis and operation on the data uploaded by the vehicle end at the cloud end, and recording data statistics.

Step S204, pushing health reminding information through the vehicle terminal under the condition that at least one of facial expression information, body action information or health index information is abnormal, and adjusting the functional mode in the seat cabin to relieve the abnormal state of the driver.

Specifically, the driver facial expression information is abnormal: when the system detects abnormal expression of the driver, such as drowsiness, fatigue, distraction and the like, health reminding information can be pushed through the vehicle-mounted terminal. This may include prompting the driver to rest, alerting them to inattention, alerting them to traffic safety, etc. Such reminders may help the driver to recognize his own abnormal state and take corresponding action to alleviate the problem in driving.

Abnormal body motion information of the driver: if the system detects that the body actions of the driver are abnormal, such as excessive head inclination, unstable hands and the like, health reminding information can be pushed through the vehicle terminal, and the functional mode in the cabin can be adjusted. This may include adjusting the position of the seat, prompting the driver to adjust the posture, reminding them to rest, or taking some relaxing action. By adjusting the functional modes in the cabin, the driver can be helped to change bad postures or actions, and further abnormal states can be relieved.

Abnormal information of health indexes of drivers: if the system monitors that the health index of the driver is abnormal, such as over-high heart rate, abnormal blood pressure and the like, health reminding information can be pushed through the vehicle-mounted terminal, and the functional mode in the cabin can be adjusted. This may include alerting the driver to ask them to seek medical attention, suggesting that they reduce speed, providing music appropriate for the health condition, adjusting temperature, etc. Through the adjustment, the driver can be helped to relieve abnormal health conditions, and safety and comfort in driving are maintained.

In this embodiment, the vehicle terminal sets the AI image of the virtual health assistant, and when any abnormal situation occurs to the driver, the virtual health assistant carries out a popup prompt on the screen of the vehicle terminal,

Step S206, history state information of the driver is acquired.

Specifically, acquiring the history state information of the driver means collecting and recording data such as facial expression information, body motion information, and health index information of the driver over a period of time. This may be achieved by an in-vehicle sensor, a monitoring camera, a wearable device, or other related technology.

Step S208, when abnormality occurs in the history state information, the driving mode of the vehicle is switched to the healthy driving mode.

Specifically, when the system detects that the driver's history state information is abnormal, such as long-time fatigue, excessive distraction, or other unsuitable driving state, measures may be taken to switch the driving mode of the vehicle from the normal mode to the healthy driving mode. This mode may be adjusted as follows:

1. the accelerating response of the driver is weakened, and the excessive excitation and the fatigue of the driver are avoided;

2. the power output of the vehicle is regulated to be more gentle, so that the load on the body of a driver is reduced;

3. more driving assistance functions such as lane keeping assistance, adaptive cruise control, etc. are provided to reduce the burden on the driver and increase safety.

The purpose of switching the driving mode of the vehicle to the healthy driving mode is to promote the health and safety of the driver. By adjusting the driving mode of the vehicle, the method can help the driver to relieve abnormal states, lighten driving load and avoid excessive fatigue, distraction or other unsuitable driving behaviors, thereby improving the concentration and reaction capacity of the driver.

It should be noted that switching the driving mode of the vehicle requires a reasonable balance between the health requirements of the driver and the driving safety. The adjusted driving mode should comprehensively consider the actual situations of the driver and the vehicle, and ensure that the adjustment of the driver does not affect traffic safety. In addition, explicit prompts and notifications to the driver are also required when switching driving modes to ensure that they understand the purpose and impact of such mode adjustments.

In the reminding method of the driver state, abnormal conditions are detected by acquiring state information of the driver, including facial expression information, body motion information and health index information. Once abnormality is found, health reminding information is pushed through the vehicle-mounted terminal, and the function mode in the cabin is adjusted to relieve the abnormal state of the driver. In addition, historical state information of the driver can be obtained, and if the abnormal situation is found to exist continuously, the driving mode of the vehicle can be switched to the healthy driving mode, so that the safety of the driver is further ensured. The effect of this technique is to improve driving safety and reduce traffic accidents caused by health problems of the driver. The abnormal state of the driver can be timely found and reminded, so that the driver can be prompted to take appropriate measures, and the good driving state can be maintained. The technology can also help to control and relieve the bad state of the driver and improve the driving safety by actively and chronically caring the health of the driver.

As shown in fig. 3, in one of the embodiments, in the case where the history state information is abnormal, the driving mode of the vehicle is switched to the healthy driving mode, including steps S302 to S310:

step S302, acquiring history state information of a driver;

step S304, drawing a driving health portrait of the driver according to the history state information;

step S306, according to the driving health image, obtaining the driving health trend of the driver;

step S308, in the case that the driving health trend tends to be abnormal, an inquiry request for switching to a healthy driving mode is sent to the vehicle terminal;

in step S310, the acquiring vehicle terminal switches the driving mode of the vehicle to the healthy driving mode based on the response information returned by the inquiry request and agreeing to switch to the healthy driving mode.

Specifically, past behavior and state information of the driver is collected and recorded by various sensors and devices mounted on the vehicle. Such information may include driving time, driving speed, braking frequency, steering wheel operation, driving mode usage, and the like. Based on the historical state information of the driver, a comprehensive representation of the driver's driving health is generated using data analysis and algorithmic techniques. The representation may include information on the behavior habit, driving style, fatigue tendency, attention state, and the like of the driver. By analyzing the driving health portrait of the driver, the driving health trend of the driver can be obtained. This may be an identification of the pattern of change in driver behaviour and state and used to predict the future driving health of the driver.

When the analysis finds that the driving health trend of the driver is abnormal, the vehicle system may send an inquiry request to the vehicle terminal asking whether the driver agrees to switch to the healthy driving mode. This request may be communicated to the driver through an interface, audible prompt, or otherwise on the onboard system. The vehicle terminal processes the inquiry request and returns a response message. If the driver agrees to switch to the healthy driving mode, the vehicle system switches the current driving mode to the healthy driving mode according to the response instruction, so as to adjust the vehicle performance and functions to adapt to the healthy demands of the driver and provide a safer driving environment.

In this embodiment, by drawing a driving health portrait of the driver, the system may adjust driving modes and vehicle settings according to different needs and health conditions of the driver, and provide a personalized driving experience. By analyzing the historical state information and the driving health trend of the driver, the system can identify the potential risk and fatigue trend of the driver and timely warn the driver or automatically switch to a healthy driving mode, so that the accident risk is reduced. Under the healthy state, the driver can enjoy more comfortable, stable and efficient driving experience. Through monitoring the physical condition and driving habit of a driver, and making corresponding adjustment and suggestion, the fatigue and discomfort of driving are reduced, and the pleasure and efficiency of driving are improved. By collecting and analyzing historical state information of the driver, the system can generate driving health portraits and driving health trends, providing valuable data and insight to the driver, vehicle manufacturers, and traffic management.

In one embodiment, the functional modes include a power amplifier mode, an air conditioner mode, a light mode, and a driving mode; under the condition that at least one of facial expression information, body action information or health index information is abnormal, health reminding information is pushed through a vehicle-mounted terminal, and an entertainment mode in a seat cabin is adjusted, wherein the method comprises the following steps:

under the condition that the abnormal expression of the facial expression information is recognized, acquiring the type of the abnormal expression; according to the abnormal expression type, matching a corresponding power amplification mode, an air conditioning mode, a light mode and a driving mode in the cabin; and adjusting a corresponding power amplification mode, an air conditioning mode, a light mode and a driving mode.

Specifically, the entertainment mode in the cabin is adjusted according to the facial expression information, the body motion information or the health index information so as to improve the health and driving experience of the driver. Specifically, when abnormal expressions or conditions are detected, the vehicle-mounted terminal can send health reminding information, and corresponding power amplification modes, air conditioning modes, light modes and driving modes are matched according to specific abnormal conditions. The purpose of doing so is to improve the physical and psychological state of the driver by adjusting the environment in the cabin, and to promote the comfort and safety of the driving experience.

For example, if the facial expression information shows that the driver is drowsy, the car terminal may automatically adjust the power amplification mode to a relaxing music or quiet mode to provide a comfortable environment; meanwhile, the air conditioning mode may be adjusted to a mode of providing fresh air to help the driver keep the mind; it is also possible to adjust the light pattern to provide a soft light to reduce eyestrain. In addition, depending on the specific abnormal expression type, the driving mode may be adjusted, for example, a safer or more comfortable driving mode may be selected to adapt to the state of the driver.

In this embodiment, by adjusting the entertainment mode in the cabin according to the abnormal expression or condition, a more appropriate, comfortable and safe driving environment can be provided, which is helpful for the driver to maintain a good health state and driving state.

In one embodiment, the functional modes further include an alarm mode; the method further comprises the steps of:

under the condition that the driver is in a coma state according to the facial expression information, the body action information and the health index information, adjusting an air conditioning mode to enhance the air flowability in the cabin, adjusting a power amplification mode to carry out voice reminding, and starting an alarm mode to carry out call alarm;

Specifically, to provide more oxygen and help wake up a comatose driver, the air conditioning mode will be adjusted to enhance air flow and ensure air quality in the vehicle. To wake the driver as soon as possible, the power amplifier mode will be adjusted to give a voice alert through the car audio system, such as a warning message or a reminder to wake the driver. In order to seek assistance and ensure driver safety, an alarm mode will be initiated, possibly by way of a car terminal or otherwise signaling a call alarm, so that emergency personnel can arrive quickly at the scene.

Furthermore, it is also mentioned to switch the driving mode of the vehicle to an assisted driving mode, which aims to slow down and to safely stop the vehicle at the road edge. This is done to ensure that the vehicle does not continue to travel, further protecting the safety of the driver and other road users.

In this embodiment, by monitoring the facial expression information, the body motion information, and the health index information, it is possible to timely identify an abnormal situation of the driver, such as drowsiness or coma. According to abnormal conditions, an air conditioning mode, a power amplification mode and the like of the cabin are adjusted to provide comfortable driving environment, increase air flowability, provide voice reminding and other functions, and help to wake up a driver and remind the driver to keep alert, so that the health condition of the driver is improved. According to the abnormal expression or state of the driver, the entertainment mode in the vehicle is automatically adjusted, such as music, air conditioner, light and other factors, so as to provide more comfortable and proper driving environment. This helps alleviate driver's pressure, fatigue and uncomfortable and feel, promotes the travelling comfort of driving experience. When the driver is identified to be in a coma state, an alarm mode is started and emergency measures such as calling alarm are taken besides adjusting the environment in the cabin. Thus, external help can be quickly sought, and the safety of a driver is ensured.

In one embodiment, the healthy driving mode includes a rest mode of the vehicle; in the case where the driving health tendency tends to be abnormal, sending an inquiry request to switch to the healthy driving mode to the vehicle terminal includes:

and under the condition that the driver is in a fatigue state for a plurality of days according to the driving health trend, adjusting the function mode in the cabin, and sending an inquiry request for switching to a rest mode to the vehicle terminal.

In particular, in order to provide a better resting environment, the functional mode within the cabin will be adjusted. In particular, various functions of the entertainment system, such as music, video, etc., may be turned off or reduced to reduce driver distraction and irritation, thereby helping to relax and rest. In order to solicit comments and confirmations of the driver, the system will send an inquiry request to the vehicle terminal asking whether to switch to the rest mode. Such a query may be in the form of a pop-up window, voice prompt, etc., to allow the driver to actively select whether a rest mode needs to be entered.

In this embodiment, when the health state of the driver shows a fatigue tendency, the vehicle provides a choice of a resting mode by adjusting the cabin function and asking the driver's opinion so that the driver can rest and resume energy at a proper time. This helps to reduce the risk of accidents caused by fatigue driving and enhances the safety of the driver.

In one embodiment, the method further comprises: acquiring a soothing music list for soothing emotion in the case that it is determined that the driver is in an anger state for a plurality of days according to the driving health tendency; and adjusting a power amplification mode, and replacing the original music list to be played in the music application of the vehicle terminal with a release music list.

Specifically, the system will obtain a specific list of music that contains a series of music tracks that are believed to help ease emotion and relax. Such music may be soft, slow or a wind with a soothing effect intended to help the driver relieve anger emotion and get a relaxed feeling. In order to play the soothing music list, the system adjusts the power amplification mode of the vehicle terminal. Specifically, the original music list to be played is replaced by the soothing music list, so that the driver can hear the soothing music to relax emotion.

In this embodiment, the vehicle system can help the driver relieve anger emotion and provide a more calm and relaxed driving environment. This helps to promote the driver's emotional state and driving experience and reduces inappropriate behavior or driving behavior that may be caused by anger emotion.

One embodiment of the present application in the most detail is:

(1) instant intervention interaction: through the monitoring of driver's facial expression and action, and health index, virtual health assistant pops up and carries out the pronunciation and reminds in the screen immediately, carries out opening and the regulation of cabin internal function simultaneously, alleviates driver's abnormal state, replaces among the prior art and only reminds and inform when user's health state is in the abnormality, and typical scene is as follows:

1. when the driver is detected to be smoking, the vehicle window is automatically opened, and the air conditioner rapid purification mode is opened.

2. When the facial expression of the driver is detected to be in an anger state or the heart rate and the respiratory frequency are continuously high, the virtual health assistant carries out active emotion pacifying and plays the soothing music, the whole car atmosphere lamp is changed into blue, and the driving mode is switched into the comfort mode.

3. When the facial expression of the driver is detected to be in a fatigue state, the virtual health assistant actively reminds and plays the inspired music: the external circulation of the air conditioner is started, more oxygen is inhaled, the seat is opened for ventilation, the seat is massaged, the refreshing fragrance in the vehicle is started, the temperature of the air conditioner is reduced, the safety belt is tightened for a plurality of times, and the red atmosphere lamp plays a role in waking up and refreshing until the fatigue state of the driver disappears, and the actions are recovered.

4. When the facial expression of the driver is detected to be a heart injury, the virtual health assistant carries out active emotion pacifying and plays cheerful music, and the whole-vehicle atmosphere lamp is changed into a music rhythm following mode.

5. When a driver coma is detected, the virtual health assistant tries to wake up the driver through voice and the opening of the seat massage and ventilation, the vehicle decelerates, assists the driver to take over the vehicle and stop by side, activates the vehicle emergency call function, informs the emergency call center of the vehicle enterprise, dials 120 the driver, and asks the user before the operation, and the user can interrupt the process at any time.

(2) Long-term care interaction: drawing user health portraits at the cloud according to long-term data statistics, analyzing health trends, and actively carrying out care and function recommendation aiming at long-term health conditions of users by virtual health assistants, including but not limited to diet adjustment advice, sleep supplementation reminding, music recommendation style proportion adjustment and vehicle-mounted medical asking and diagnosing functions aiming at high risk items. A typical scenario is as follows:

1. when the user is detected to be in a fatigue state for a plurality of days, the virtual health assistant reminds the user of recently replenishing sleep through voice, and inquires whether the user starts a rest mode of the vehicle when the vehicle is in a P-gear parking state, so that active care is provided.

2. When the user is detected to have a high or low daily heart rate continuously, the virtual health assistant opens the medical inquiry APP or reminds the user to go to the hospital for examination.

3. When detecting that the user frequently triggers anger states for a plurality of days, the virtual health assistant increases the duty ratio of the soothing music in the recommended song list of the music application, relieves the recent state of the user, automatically adjusts the power mode of the vehicle to be comfortable, and softly outputs power, thereby avoiding accidents (the user is informed in advance before the function is started).

4. Based on the DMS's recognition of the driver's face and monitoring the driver's recent changes in other physiological indicators, the virtual health assistant will provide dietary adjustment advice.

It should be understood that, although the steps in the flowcharts related to the above embodiments are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.

Based on the same inventive concept, the embodiment of the application also provides a driver state reminding device for realizing the above mentioned driver state reminding method. The implementation of the solution provided by the device is similar to the implementation described in the above method, so the specific limitation in the embodiment of the reminding device for the driver status provided below may refer to the limitation of the reminding method for the driver status hereinabove, and will not be repeated here.

In an exemplary embodiment, as shown in fig. 4, there is provided a driver status reminding device, including: an acquisition module 402, configured to acquire status information of a driver, where the status information includes facial expression information, body motion information, and health index information;

the control module 404 is configured to push health reminding information through the vehicle-to-machine terminal in case that at least one of facial expression information, body motion information or health index information is abnormal, and adjust a functional mode in the cabin to alleviate an abnormal state of the driver;

the obtaining module 402 is further configured to obtain historical state information of a driver;

the control module 404 is further configured to switch the driving mode of the vehicle to the healthy driving mode in the case that the history status information is abnormal.

In one embodiment, in the case of abnormality of the historical state information, the obtaining module 402 is further configured to obtain the historical state information of the driver;

the processing module is used for drawing a driving health portrait of the driver according to the history state information;

the processing module is also used for acquiring the driving health trend of the driver according to the driving health image;

the sending module is used for sending an inquiry request for switching to a healthy driving mode to the vehicle terminal under the condition that the driving healthy trend tends to be abnormal;

the obtaining module 402 is further configured to obtain response information returned by the vehicle terminal based on the query request and agreeing to switch to the healthy driving mode, and switch the driving mode of the vehicle to the healthy driving mode.

the obtaining module 402 is further configured to obtain a type of the abnormal expression when it is recognized that the facial expression information presents the abnormal expression;

The processing module is also used for matching a corresponding power amplification mode, an air conditioning mode, a light mode and a driving mode in the cabin according to the abnormal expression type;

the control module 404 is further configured to adjust a corresponding power amplifier mode, an air conditioner mode, a light mode, and a driving mode.

In one embodiment, the functional modes further include an alarm mode; the control module 404 is further configured to, when it is identified that the driver is in a coma state according to the facial expression information, the body motion information, and the health index information, adjust an air conditioning mode to enhance air flowability in the cabin, adjust a power amplification mode to perform voice reminding, and start an alarm mode to perform call alarm;

the control module 404 is further configured to switch a driving mode of the vehicle to an auxiliary driving mode, where the auxiliary driving mode is used to control the vehicle to slow down and stop at a side.

In one embodiment, the healthy driving mode includes a rest mode of the vehicle; the control module 404 is further configured to adjust a functional mode in the cabin if it is determined that the driver is in a fatigue state for a plurality of days according to the driving health trend, and the sending module is further configured to send an inquiry request for switching to a rest mode to the vehicle terminal.

In one embodiment, the obtaining module 402 is further configured to obtain a soothing music list for soothing emotion in a case where it is determined that the driver is in an anger state for a plurality of days according to the driving health trend;

the control module 404 is further configured to adjust a power amplification mode, and replace an original music list to be played in the music application of the vehicle terminal with a relaxed music list.

The above-described driver status reminder may be implemented in whole or in part by software, hardware, or a combination thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.

In one exemplary embodiment, a computer device is provided, which may be a terminal, and an internal structure diagram thereof may be as shown in fig. 5. The computer device includes a processor, a memory, an input/output interface, a communication interface, a display unit, and an input means. The processor, the memory and the input/output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input/output interface. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The input/output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless mode can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program, when executed by the processor, implements a method of alerting a driver of a state. The display unit of the computer device is used for forming a visual picture, and can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, can also be a key, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.

It will be appreciated by those skilled in the art that the structure shown in fig. 5 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.

In one exemplary embodiment, a computer device is provided comprising a memory and a processor, the memory having stored therein a computer program, the processor when executing the computer program performing the steps of:

under the condition that at least one of facial expression information, body action information or health index information is abnormal, pushing health reminding information through a vehicle-mounted terminal, and adjusting a functional mode in a seat cabin to relieve the abnormal state of a driver;

acquiring historical state information of a driver;

when abnormality occurs in the history state information, the driving mode of the vehicle is switched to the healthy driving mode.

In one embodiment, the processor when executing the computer program further performs the steps of:

In the event that the history state information is abnormal, switching the driving mode of the vehicle to the healthy driving mode includes:

acquiring historical state information of a driver;

drawing a driving health portrait of the driver according to the historical state information;

in the case that the driving health trend tends to be abnormal, sending an inquiry request for switching to a healthy driving mode to the vehicle terminal;

and the acquiring vehicle terminal switches the driving mode of the vehicle to the healthy driving mode based on response information returned by the inquiry request and agreeing to switch to the healthy driving mode.

the functional modes comprise a power amplification mode, an air conditioning mode, a lamplight mode and a driving mode; under the condition that at least one of facial expression information, body action information or health index information is abnormal, health reminding information is pushed through a vehicle-mounted terminal, and an entertainment mode in a seat cabin is adjusted, wherein the method comprises the following steps:

under the condition that the abnormal expression of the facial expression information is recognized, acquiring the type of the abnormal expression;

the functional modes also include an alarm mode; the method further comprises the steps of:

the healthy driving mode includes a rest mode of the vehicle; in the case where the driving health tendency tends to be abnormal, sending an inquiry request to switch to the healthy driving mode to the vehicle terminal includes:

acquiring a soothing music list for soothing emotion in the case that it is determined that the driver is in an anger state for a plurality of days according to the driving health tendency;

and adjusting a power amplification mode, and replacing the original music list to be played in the music application of the vehicle terminal with a release music list.

In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of:

acquiring historical state information of a driver;

In one embodiment, the computer program when executed by the processor further performs the steps of:

acquiring historical state information of a driver;

In one embodiment, a computer program product is provided comprising a computer program which, when executed by a processor, performs the steps of:

acquiring historical state information of a driver;

It should be noted that, the user information (including, but not limited to, user equipment information, user personal information, etc.) and the data (including, but not limited to, data for analysis, stored data, presented data, etc.) referred to in the present application are information and data authorized by the user or sufficiently authorized by each party, and the collection, use, and processing of the related data are required to meet the related regulations.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the various embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magnetic random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (Phase Change Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like. The databases referred to in the various embodiments provided herein may include at least one of relational databases and non-relational databases. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processors referred to in the embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic units, quantum computing-based data processing logic units, etc., without being limited thereto.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The above examples only represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the present application. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application shall be subject to the appended claims.

Claims

1. A method of alerting a driver of a state, the method comprising:

Acquiring historical state information of a driver;

2. The method according to claim 1, wherein, in the case where the history state information is abnormal, switching the driving mode of the vehicle to the healthy driving mode includes:

acquiring historical state information of a driver;

3. The method of claim 1, wherein the functional modes include a power amplifier mode, an air conditioning mode, a light mode, and a driving mode; under the condition that at least one of the facial expression information, the body action information or the health index information is abnormal, health reminding information is pushed through a vehicle-mounted terminal, and an entertainment mode in a seat cabin is adjusted, wherein the method comprises the following steps:

4. A method according to claim 3, wherein the functional mode further comprises an alarm mode; the method further comprises the steps of:

5. The method of claim 2, wherein the healthy driving mode comprises a rest mode of the vehicle; the sending, in the case where the driving health trend tends to be abnormal, an inquiry request for switching to a healthy driving mode to the vehicle terminal includes:

6. A method according to claim 3, characterized in that the method further comprises:

7. A driver status alert device, the device comprising:

8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any of claims 1 to 6 when the computer program is executed.

9. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 6.

10. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 6.