DE102021002597A1 - Method for determining a motor and / or cognitive state - Google Patents

Abstract

The invention relates to a method for determining a motor and / or cognitive state of a driver (2) in a vehicle (1). According to the invention it is provided that on the basis of a conversation conducted and recorded in the vehicle (1) it is determined whether the speaking person is the driver (2), if it is the driver (2), a speech analysis is carried out and a The value of a current language level and a current vocabulary complexity is determined, and if it is determined that the value falls below a value of the language level and the vocabulary complexity averaged over a past or the current value falls below a predetermined threshold value, a warning based on a suspected acute reduction motor skills and / or neurological impairment of the driver (2) is output, an automatic emergency call system is activated and the vehicle (1) is transferred to a secure operating mode, - if it is determined that the value falls below a predetermined further threshold, a warning based on one suspected n Overtiredness and / or lack of concentration of the driver (2) is output, - if it is determined that the value is continuously decreasing during a current driving operation, a warning is output due to a suspected gradual loss of motor skills of the driver (2) due to neurological impairment.

Description

The invention relates to a method for determining a motor and / or cognitive state of a driver in a vehicle.

From the DE 10 2013 222 645 A1 a recognition system in a vehicle for detecting the voice activity of a vehicle occupant is known. The detection system comprises a video detection device for detecting the posture of the head and / or the lip movements, an evaluation device and a signal generating device.

The invention is based on the object of specifying a method for determining a motor and / or cognitive state of a vehicle user in a vehicle.

The object is achieved according to the invention by a method which has the features specified in claim 1.

Advantageous refinements of the invention are the subject matter of the subclaims.

A method for determining a motor and / or cognitive state of a driver in a vehicle provides that a conversation held in the vehicle and recorded by the vehicle is used to determine whether the speaking person is the driver of the vehicle. In the event that the speaking person is the driver, a speech analysis is carried out on the basis of what the driver has spoken and a value of a current language level and a current vocabulary complexity of the driver is determined. If it is determined that the value of the current language level and the current vocabulary complexity falls below a value of the language level and the vocabulary complexity of the driver averaged over a past or the current value falls below a predetermined threshold value, an acoustic, visual and / or haptic warning is based on a suspected acute reduction in motor skills and / or neurological impairment of the driver in the vehicle is output, an automatic emergency call system of the vehicle is activated to make an emergency call and the vehicle is switched to a secure operating mode. In the event that it is determined that the value of the current language level and the current vocabulary complexity falls below a predetermined further threshold value, the predetermined threshold value being exceeded, an acoustic, visual and / or haptic warning is issued based on suspected fatigue and / or lack of concentration on the part of the driver output in the vehicle and if it is determined that the value of the current language level and the current vocabulary complexity is continuously decreasing during a current driving operation, an acoustic, visual and / or haptic warning is issued due to a suspected gradual loss of motor skills of the driver due to neurological impairment issued to the vehicle.

By using the method, the risk of an accident of the vehicle due to intoxication, due to acute neurological failures, due to fatigue and / or lack of concentration as well as a gradual loss of motor skills due to neurological impairment of the driver of the vehicle can be considerably reduced.

Embodiments of the invention are explained in more detail below with reference to drawings.

• 1 schematisch ein Fahrzeug und eine Vorrichtung zur Durchführung eines Verfahrens zur Ermittlung eines motorischen und/oder kognitiven Zustandes eines Fahrers in einem Fahrzeug,
• 2 schematisch den Fahrer des Fahrzeuges bei einem Trainieren eines Modells zur Ermittlung eines Wertes eines Sprachniveaus und einer Wortschatzkomplexität,
• 3 schematisch den Fahrer und verschiedene Einflussfaktoren auf das Sprachniveau und die Wortschatzkomplexität und
• 4 schematisch einen Ablauf des Verfahrens zur Ermittlung des motorischen und/oder kognitiven Zustandes des Fahrers in dem Fahrzeug.

Show:

• 1 schematically a vehicle and a device for performing a method for determining a motor and / or cognitive state of a driver in a vehicle,
• 2 schematically the driver of the vehicle while training a model to determine a value of a language level and a vocabulary complexity,
• 3 schematically the driver and various factors influencing the language level and vocabulary complexity and
• 4th schematically a sequence of the method for determining the motor and / or cognitive state of the driver in the vehicle.

Corresponding parts are provided with the same reference symbols in all figures.

1 shows a vehicle 1 with a device for carrying out a method for determining a motor and / or cognitive state of a driver 2 in the vehicle 1 .

In 2 is the driver 2 of the vehicle 1 in training a model for determining a value of a language level and a vocabulary complexity of the driver 2 and presented with various influencing factors on language level and vocabulary complexity. 3 shows a sequence of the method for determining the motor and / or cognitive state of the driver 2 in the vehicle 1 . The influencing factors include, in particular, alcohol A. , Medication M. , Drugs D. as well as fatigue U .

It is generally known that a large number of people killed in road traffic died as a result of an accident under the influence of alcohol and / or drugs. There are also neurological emergencies, such as an acute stroke S. , and neurological impairments, e.g. B. Alzheimer's, Parkinson's and / or the consequences of an unrecognized stroke cause accidents with and without personal injury. In particular, undiagnosed neurological, gradually deteriorating impairments represent a danger to the driver 2 of a vehicle 1 may not be aware that his cognitive and motor skills are declining and, under certain circumstances, to drive a vehicle 1 are no longer sufficient.

Both intoxications and a large number of neurological impairments are expressed in a reduction in motor skills. This is particularly evident in relation to an articulation of a person concerned, in particular in relation to the formation of tones and words. In addition, a language level is reduced, i.e. H. a used vocabulary and the ability to form and understand language.

The device available on the vehicle enables individual language patterns and an individual language level of the driver 2 to learn and to follow a respective change over a longer period of time. This makes it possible to establish a comparison between the language level determined over the longer period and a vocabulary complexity and a current language level and a current vocabulary complexity in order to determine an acute or even gradual impairment of the driver's motor skills 2 to recognize. In addition, the procedure provides that the driver 2 a warning is issued when impairment is detected and / or the vehicle 1 is transferred to a secure operating mode.

The device comprises a driver observation camera 3 , which while the vehicle is in motion 1 continuous image data of the driver 2 recorded. There are also a number of microphones in the vehicle interior 4th arranged, for example, for a speakerphone for making phone calls. By means of the number of microphones 4th conversations, in particular telephone calls, conducted, especially in the vehicle interior, are recorded and sent to a control unit to carry out a speech analysis 5 transmitted. The speech analysis is used to determine the language level and the vocabulary complexity in the control unit 5 carried out. In one possible embodiment, there is at least one of the microphones 4th designed as a so-called stereo microphone.

Furthermore is the control unit 5 of the device in terms of data technology with a computer unit 6th which are outside the vehicle 1 located, coupled.

As described above, the microphones present on the vehicle 4th Vocalizations and in particular spoken language by occupants and thus also by the driver 2 of the vehicle 1 recorded. It is possible to position and align the microphones 4th , in particular the stereo microphone, and by means of an algorithmic post-processing, z. B. by means of source separation by transit time difference to determine a source of the spoken word. If necessary, the overlapping of spoken words from different sources can be reduced by filtering. In particular, it is possible to clearly convey what is said to the driver 2 to be assigned when he speaks and when he has spoken.

The driver 2 and especially its presence in the vehicle 1 can be done using a variety of methods, e.g. B. by means of face recognition based on the image data recorded by the driver observation camera and / or by means of machine vision, for example by means of a folded neural network for face recognition, using a personalized vehicle key and / or using a personal PIN code. This enables the recorded conversations of the driver 2 , ie vocalizations, can be clearly assigned to this person as a person.

That from the driver 2 recorded speech is made locally by means of the control unit 5 and / or by means of the computer unit coupled with data technology 6th evaluated. What is spoken, i.e. the driver's language, is used for this purpose 2 , examined by means of computational linguistics or by means of linguistic data processing.

So z. B. a statistical analysis of the words used in the spoken and a word context in which the respective words were used, a determination of a vocabulary. In particular, it is determined how many words were used, what kind of words were used and how was the distribution of the words used. In addition, an individual representation of the vocabulary, which can also be referred to as an individual language pattern, is created.

A more detailed analysis of the vocabulary compared to reference values enables an algorithmic assignment of a speaker to a certain language level. In addition, machine learning methods can also be used can be used to assign the speaker's vocabulary to a level of a language level if such a classification model was previously trained with respect to corresponding data during development.

In addition, it is possible to express the emotions, e.g. B. based on facial, speech and / or physical signals based on detected signals of a corresponding sensor system on linguistic information, z. B. passengers or an infotainment system to analyze whether the linguistic information was understood. For example, a physiological stress and / or insecurity reaction to words that are not in the actively used vocabulary suggests a generally low language level, since this apparently also does not exist in the passive vocabulary.

Values for a language level, the vocabulary complexity and the created language patterns are automatically updated for the respective driver at regular time intervals 2 individually created and with the values of the corresponding driver 2 compared to earlier times.

If a difference, i.e. a deviation, between the determined current value and the values averaged over the past for the language level and the vocabulary complexity is very large, with the determined current values being very low and below a predetermined threshold value, this can indicate an acute one Reduction in motor skills of the driver 2 allow. This acute reduction in motor skills can be caused by intoxication, e.g. B. through alcohol and / or drug consumption, taking medication M. and / or through a variety of acute neurological impairments, e.g. B. a stroke S. , to be triggered.

In this case, it is provided that an acoustic, visual and / or haptic warning notice based on a suspected acute reduction in motor skills and / or neurological impairment of the driver 2 is issued and the vehicle 1 is transferred to a secure operating mode. In addition, the vehicle has an emergency call system 1 activated. For example, provision can also be made for a stored emergency call contact for the driver 2 to inform about a state of the same.

Is the deviation between the determined current values in relation to the language level and the vocabulary complexity and the values averaged over the past for the language level and the vocabulary complexity significant, the determined current values being comparatively low and falling below a predetermined further threshold value, but the predetermined threshold value exceed, this circumstance can lead to fatigue and / or lack of concentration on the part of the driver 2 Clues. Here, too, it is provided that an acoustic, visual and / or haptic warning is output so that the driver 2 in particular, his inattentiveness is pointed out and z. B. it is recommended to take a break.

If the values determined for language level and vocabulary complexity drop continuously, this can indicate a gradual loss of motor skills. This continuous decrease can be caused by a neurological impairment, for example by Alzheimer's or Parkinson's, a consequence of an undetected stroke S. and / or triggered by manifesting aging effects. To the driver 2 To indicate such a circumstance, an acoustic, visual and / or haptic warning is issued.

If, on the other hand, it is determined that the values of the language level and the vocabulary complexity are increasing, it can be concluded that the level of education and / or social advancement and the associated higher language level are provided as information to the driver 2 of the vehicle 1 can be made accessible and / or used to adapt service offerings.

The in 4th The procedure shown here begins with Start S. and ends with the end of E, with a yes with a J and a no with an N.

In a first process step V1 are using the driver observation camera 3 Image data recorded as well as by means of the microphones 4th in the vehicle 1 Spoken recorded. In addition, other sensor data relating to the vehicle 1 be tapped internally or externally.

In a second process step V2 becomes the driver 2 of the vehicle 1 identified, this in a third method step V3 is identified as a speaker.

This is followed in a fourth method step V4 determines whether the language level and the vocabulary complexity for this driver 2 have already been analyzed sufficiently well.

Used in the fourth step V4 it is determined that the speech analysis is inadequate in a fifth method step V5 a first or initial value for the language level and the vocabulary complexity for this driver 2 created and terminated the procedure.

Used in the fourth step V4 on the other hand, it is determined that the language level and the vocabulary complexity have already been analyzed sufficiently well in a sixth process step V6 a current value for the language level and the vocabulary complexity is determined and created.

In a seventh process step V7 it is determined whether the determined current value of the language level and the vocabulary complexity is much lower than a value of the language level and the vocabulary complexity averaged over the past or whether the determined current value falls below a predetermined threshold value, then in an eighth method step V8 an acoustic, visual and / or haptic warning due to a suspected acute reduction in motor skills and / or neurological impairment of the driver 2 in the vehicle 1 issued and the vehicle 1 is transferred to a secure operating mode. That is, the control unit 5 Initiates emergency measures, for example by having the vehicle 1 is delayed, an emergency call is made and / or a stored emergency contact of the driver 2 is informed.

Is the condition from the seventh process step V7 not fulfilled, the method jumps to a ninth method step V9 . If in the ninth step V9 it is determined that the determined current value of the language level and the vocabulary complexity of the driver 2 is comparatively low and falls below a predetermined further threshold value, the predetermined threshold value from the seventh method step V7 being exceeded, then in a tenth method step V10 an acoustic, visual and / or haptic warning is issued due to suspected fatigue and / or lack of concentration of the driver in the vehicle.

Are the conditions from the seventh process step V7 and the ninth step V9 not fulfilled, is in an eleventh process step V11 checks whether the value of the language level and the vocabulary complexity is continuously decreasing. Such a reduction can be due to a gradual loss of motor skills of the driver 2 Clues. The gradual loss of motor skills can be triggered by a neurological impairment, for example by Alzheimer's, Parkinson's, the consequences of an undetected stroke or by manifesting aging effects. If such a continuous reduction in the value of the language level and the vocabulary complexity is determined, the method jumps to the tenth method step V10 and issues a corresponding acoustic, optical and / or haptic warning. By means of the warning, the driver will 2 of the vehicle 1 Attention is drawn to the present circumstance and can then seek medical help if necessary.

However, it is in a twelfth process step V12 determines that the value of the language level and the vocabulary complexity has increased over a certain period of time, is carried out in a thirteenth procedural step V13 information to the driver in this regard 2 of the vehicle 1 issued.

List of reference symbols

1

vehicle

2

driver

3

Driver observation camera

4th

microphone

5

Control unit

6th

Computing unit

A.

alcohol

D.

Drugs

M.

Medication

S.

stroke

U

fatigue

V1 to V13

Process step

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• DE 102013222645 A1 [0002]

Claims (3)

Method for determining a motor and / or cognitive state of a driver (2) in a vehicle (1), characterized in that on the basis of a conversation conducted in the vehicle (1) and recorded by the vehicle, it is determined whether the speaking person is the Driver (2) of the vehicle (1), and in the event that it is determined that the speaking person is the driver (2), a speech analysis is carried out on the basis of what was spoken by the driver (2) and a value a current language level and a current vocabulary complexity of the driver (2) is determined, then - if it is determined that the value of the current language level and the current vocabulary complexity falls below a value of the language level and the vocabulary complexity of the driver (2) averaged over a past or the current value falls below a predetermined threshold value, an acoustic, visual and / or haptic warning s is issued due to a suspected acute reduction in motor skills and / or neurological impairment of the driver (2) in the vehicle (1), an automatic emergency call system of the vehicle (1) is activated to make an emergency call and the vehicle (1) is in a secured Operating mode is transferred, - if it is determined that the value of the current language level and the current vocabulary complexity falls below a predetermined further threshold value, the predetermined threshold value being exceeded, an acoustic, visual and / or haptic warning due to a suspected fatigue and / or lack of concentration of the Driver (2) in the vehicle (1) is output, - if it is determined that the value of the current language level and the current vocabulary complexity continuously decreases during a current driving operation, an acoustic, visual and / or haptic warning based on a suspected gradual Ve rlierens motor skills of the driver (2) due to neurological impairment in the vehicle (1). Procedure according to Claim 1 , characterized in that the driver (2) of the vehicle (1) and that he has conducted the conversation is determined at least on the basis of optically recorded signals from a driver observation camera (3). Procedure according to Claim 1 or 2 , characterized in that the speech analysis is carried out by means of a control unit (5) of the vehicle (1) and / or by means of a computer unit (6) coupled with the vehicle in terms of data technology.

Images