CN112451833A - System and method for detecting and relieving driving fatigue based on personalized music recommender - Google Patents

System and method for detecting and relieving driving fatigue based on personalized music recommender Download PDF

Info

Publication number
CN112451833A
CN112451833A CN202011247732.2A CN202011247732A CN112451833A CN 112451833 A CN112451833 A CN 112451833A CN 202011247732 A CN202011247732 A CN 202011247732A CN 112451833 A CN112451833 A CN 112451833A
Authority
CN
China
Prior art keywords
music
driver
fatigue
driving
personalized
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011247732.2A
Other languages
Chinese (zh)
Inventor
王福旺
康小刚
路斌
徐卿
李吉献
袁震
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northeast Electric Power University
Original Assignee
Northeast Dianli University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northeast Dianli University filed Critical Northeast Dianli University
Priority to CN202011247732.2A priority Critical patent/CN112451833A/en
Publication of CN112451833A publication Critical patent/CN112451833A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M21/02Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0027Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the hearing sense

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Veterinary Medicine (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychology (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Anesthesiology (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Developmental Disabilities (AREA)
  • Biophysics (AREA)
  • Hematology (AREA)
  • Child & Adolescent Psychology (AREA)
  • Acoustics & Sound (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Pain & Pain Management (AREA)
  • Pathology (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Traffic Control Systems (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The invention relates to a driving fatigue detection and relief system and a method based on a personalized music recommender, which is characterized in that: the system comprises an electroencephalogram acquisition terminal, an upper computer, a lower computer and a personalized music recommender which are sequentially connected, wherein the electroencephalogram acquisition terminal is used for acquiring electroencephalogram signals of a driver in real time; the upper computer is used for preprocessing the electroencephalogram signals, extracting slow wave frequency band signals in the electroencephalogram signals, calculating a slow wave average power spectrum and slow wave complexity, judging the driving state of a driver according to the average power spectrum and the complexity, and outputting the driving state data to the lower computer; the lower computer controls the personalized music recommender to start a corresponding working mode according to the driving fatigue state data; the personalized music recommender is used for entering a corresponding music playing mode according to a control instruction of the lower computer. The system has simple and applicable structure, low cost and high detection accuracy; the method is scientific and reasonable, has strong applicability and good effect, and can relieve driving fatigue and improve driving safety.

Description

System and method for detecting and relieving driving fatigue based on personalized music recommender
Technical Field
The invention relates to a driving fatigue detection and mitigation system and a driving fatigue detection and mitigation method, in particular to a driving fatigue detection and mitigation system and a driving fatigue detection and mitigation method based on an individualized music recommender.
Background
In recent years, as the number of automobiles is sharply increased, traffic accidents are also increased. There are many factors causing traffic accidents, and among them, fatigue driving by drivers is a main cause of traffic accidents. According to statistical data, the traffic accidents caused by driving fatigue account for about one third of the total accidents; statistics of the United states road traffic management department show that in the last five years, the number of traffic accidents caused by fatigue driving is about 12 thousands per year on average; the Australian traffic management related department finds that the traffic accidents caused by fatigue of drivers each year account for at least 17% of the total annual traffic accidents in the analysis of causes of national traffic accidents; the traffic accident statistics in japan also show that the traffic accidents due to driving fatigue are as high as 35% -45%. Therefore, it is important to accurately and rapidly detect the driving fatigue state of the driver and timely relieve the driving fatigue state.
The traditional methods for relieving mental fatigue of human beings are many, such as reducing the working intensity, having a short rest, drinking caffeine-containing beverage and taking special medicines. In recent years, electrical stimulation has been widely studied as a new method for relieving fatigue of the human body. Studies have shown that a moderate number of cognitive tasks are more beneficial for relieving mental fatigue than a small number of cognitive tasks. However, the above method for relieving driving fatigue adopts more modules, has higher cost and low efficiency, and in addition, the portability and the reliability of the equipment need to be further improved.
Disclosure of Invention
The invention aims to provide a driving fatigue detection and mitigation system based on an individualized music recommender, which has simple and applicable structure, low cost and high detection accuracy, aiming at the problems in the prior art; the driving fatigue detection and mitigation method based on the personalized music recommender is scientific and reasonable, high in applicability and good in effect, can relieve driving fatigue, improves driving safety, and reduces traffic hidden troubles caused by fatigue driving.
The technical scheme adopted for realizing one of the purposes of the invention is that the driving fatigue detection and mitigation system based on the personalized music recommender is characterized in that: the brain wave music recommendation system comprises a brain wave acquisition terminal, an upper computer, a lower computer and a personalized music recommender, wherein the brain wave acquisition terminal is used for acquiring brain wave signals of a driver in real time; the upper computer is used for preprocessing the electroencephalogram signals, extracting slow wave frequency band signals in the electroencephalogram signals, calculating a slow wave average power spectrum and slow wave complexity, judging the driving state of a driver according to the changes of the average power spectrum and the slow wave complexity, and outputting the driving state data to the lower computer; the lower computer controls the personalized music recommender to start a corresponding working mode according to the driving fatigue state data; the personalized music recommender is used for entering a corresponding music playing mode according to a control instruction of the lower computer; the input end of the electroencephalogram acquisition terminal is connected to the cerebral cortex of a driver, the output end of the electroencephalogram acquisition terminal is connected with the upper computer, the upper computer is connected with the lower computer, the lower computer is connected with the personalized music recommender, and the personalized music recommender enters a corresponding music playing mode according to an instruction sent by the lower computer.
Further, the personalized music recommender comprises: the vehicle-mounted terminal comprises a main control unit, an individualized music storage unit, a driver fatigue relieving mode control unit, an individualized music recommendation unit, an alarm unit, a vehicle-mounted terminal and a wireless radio frequency communication unit, wherein the main control unit is respectively connected with the individualized music storage unit, the driver fatigue relieving mode control unit, the individualized music recommendation unit, the alarm unit and the vehicle-mounted terminal through wireless radio frequency communication; the personalized music recommendation unit comprises a music uploading module and a personalized music recommendation module; the music uploading module uploads vehicle-mounted personalized music by using Bluetooth or a U disk and a TF card, the personalized music recommendation module carries out music recommendation according to the average power spectrum of slow waves and the change of the complexity of the slow waves, and the personal music storage unit is used for storing the vehicle-mounted personalized music; the alarm unit comprises a voice reminding module and an LED lamp flashing alarm module; the vehicle-mounted terminal comprises a music retrieval playing unit and a driver fatigue state display module.
Further, the driving fatigue detection and mitigation system based on the personalized music recommender is characterized in that: the working modes of the personalized music recommender comprise a personalized music periodic playing working mode, a personalized music non-periodic playing working mode and an alarm working mode.
Further, the driving fatigue detection and mitigation system based on the personalized music recommender is characterized in that: the personalized music periodic playing working mode is that a music retrieval playing unit of the vehicle-mounted terminal outputs periodic personalized music for relieving driving fatigue.
Further, the driving fatigue detection and mitigation system based on the personalized music recommender is characterized in that: the personalized music aperiodic playing working mode is that a music retrieval playing unit of the vehicle-mounted terminal outputs intermittent personalized music for relieving driving fatigue;
further, the driving fatigue detection and mitigation system based on the personalized music recommender is characterized in that: the alarm working mode is that the voice reminding module and the LED lamp flashing alarm module of the alarm unit prompt a driver to stop for rest.
The technical scheme adopted for realizing the second purpose of the invention is that the driving fatigue detection and mitigation method based on the personalized music recommender is characterized by comprising the following steps:
1) the electroencephalogram acquisition terminal acquires electroencephalogram signals of a driver in a driving process in real time;
2) transmitting the acquired driver electroencephalogram signals to an upper computer;
3) the upper computer utilizes an Independent Component Analysis (ICA) algorithm to preprocess the EEG signal of the AF3 channel, and removes the artifact interference of power frequency noise, the electric eye and the myoelectricity; extracting slow wave frequency band signals in the electroencephalogram signals, calculating a slow wave average power spectrum and slow wave complexity, judging the driving state of a driver according to changes of the average power spectrum and the complexity, and outputting driving state data to a lower computer;
performing Butterworth band-pass filtering on the preprocessed electroencephalogram signals of the driver, and extracting slow wave frequency band signals in the electroencephalogram signals;
calculating a fatigue index F, G:
Figure BDA0002770604790000031
in the formula, P and P0 are average power spectrums of delta (0.5-4 Hz) and theta (4-8 Hz) rhythms of the current time and the previous 15 minutes of the driver respectively, and L0 are complexity of the delta and theta rhythms of the current time and the previous 15 minutes of the driver respectively;
calculating the current electroencephalogram fatigue index of the driver in real time, and judging the driving state of the driver according to the change of the driving fatigue state of the current electroencephalogram fatigue index: if the fatigue index F is less than or equal to 1.2(1+ h) and G is less than or equal to 1.2(1+ h), the driver is in a normal driving state, and then the step 1 is returned; if the fatigue index is more than 1.2(1+ h) and less than or equal to F and less than or equal to 1.3(1+ h) and more than 1.2(1+ h) and less than or equal to G and less than or equal to 1.3(1+ h), the driver is in a mild fatigue driving state; if the fatigue index is more than 1.3(1+ h) and less than or equal to F and less than or equal to 1.5(1+ h) and more than 1.3(1+ h) and less than or equal to G and less than or equal to 1.5(1+ h), the driver is in a severe fatigue driving state; if F > 1.5(1+ h) and G > 1.5(1+ h), the driver is in an extreme fatigue state; h regulatory factors for individual tolerance differences;
fourthly, transmitting the driving fatigue state data of the driver to the lower computer;
4) the lower computer controls the personalized music recommender to start and enter a corresponding music playing mode according to the driving fatigue state data: if the driver is in a light fatigue driving state, entering an individualized music periodic playing working mode; if the driver is in a severe fatigue driving state, entering a personalized music aperiodic playing working mode; and if the driver is in the extreme fatigue driving state, entering an alarm working mode to prompt the driver to stop for rest.
Compared with the prior art, the driving fatigue detection and relieving system and method based on the personalized music recommender monitor the driving fatigue state of the driver in real time by adopting the electroencephalogram acquisition terminal and the upper computer, and play the personalized fatigue relieving music on the driver in time by adopting the personalized music recommender. The fatigue state of the driver is detected in real time through the electroencephalogram signal multiple fatigue indexes, and in addition, the lower computer can control the personalized music recommender to start and enter different working modes according to the driving state of the driver, so that the working load of the driver is reduced. The driving fatigue detection and mitigation system based on the personalized music recommender has the advantages of simple and applicable structure, low cost and high detection accuracy; the driving fatigue detection and relieving method based on the personalized music recommender is scientific and reasonable, high in applicability and good in effect, driving fatigue can be relieved, driving safety is improved, and traffic hidden dangers caused by fatigue driving are reduced.
Drawings
FIG. 1 is a block diagram of a driving fatigue detection and mitigation system based on a personalized music recommender according to the present invention;
FIG. 2 is a block diagram of the personalized music recommender of FIG. 1;
FIG. 3 is a schematic diagram of the circuit connection between the lower computer and the personalized music recommender in accordance with an embodiment of the present invention;
FIG. 4 is a flowchart of a driving fatigue detection and mitigation method based on a personalized music recommender according to the present invention;
fig. 5 is a flow chart of lower computer data processing and driving fatigue state determination according to an embodiment of the present invention.
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings.
The invention discloses a driving fatigue detection and mitigation system based on an individualized music recommender, which comprises an electroencephalogram acquisition terminal, an upper computer, a lower computer and an individualized music recommender, wherein the electroencephalogram acquisition terminal is connected with the upper computer;
the electroencephalogram acquisition terminal is used for acquiring electroencephalogram signals of a driver in real time;
the upper computer is used for preprocessing the electroencephalogram signals, extracting slow wave frequency band signals in the electroencephalogram signals, calculating a slow wave average power spectrum and slow wave complexity, judging the driving state of a driver according to the average power spectrum and the complexity, and outputting the driving state data to the lower computer;
the lower computer controls the personalized music recommender to start a corresponding music playing mode according to the driving fatigue state data;
the personalized music recommender is used for entering a corresponding music playing mode according to a control instruction of the lower computer;
the input end of the electroencephalogram acquisition terminal is connected to the cerebral cortex of a driver, the output end of the electroencephalogram acquisition terminal is connected with an upper computer, the upper computer is connected with a lower computer, the lower computer is connected with a personalized music recommender, the personalized music recommender is installed in a cab, and the personalized music recommender enters a corresponding music playing mode according to an instruction sent by the lower computer;
the brain wave collection terminal adopts the CUBand brain wave appearance, is produced by Beijing Zhongxi distance science and technology limited, and the host computer adopts the PC, and the subordinate computer adopts STM32F103RBT6 model singlechip, as shown in figure 2, individualized music recommender includes: the system comprises a main control unit, an individualized music storage unit, a driver fatigue relieving mode control unit, an individualized music recommendation unit, an alarm unit, a vehicle-mounted terminal and a wireless radio frequency communication unit. The main control unit is respectively connected with the personalized music storage unit, the driver fatigue relieving mode control unit, the personalized music recommendation unit, the alarm unit and the vehicle-mounted terminal through wireless radio frequency communication, and controls all the modules to work cooperatively; the driver fatigue relieving mode control unit comprises a driver fatigue state relieving music classification module and a lower computer instruction receiving module; the personalized music recommendation unit comprises a music uploading module and a personalized music recommendation module; the music uploading module uploads vehicle-mounted personalized music by using Bluetooth or a U disk and a TF card, the personalized music recommending module recommends music according to the average power spectrum of slow waves and the change of the complexity of the slow waves, and the personal music storage unit is used for storing the vehicle-mounted personalized music. The alarm unit comprises a voice reminding module and an LED lamp flashing alarm module; the vehicle-mounted terminal comprises a music retrieval playing unit and a driver fatigue state display module;
the circuit connection between the lower computer and the personalized music recommender of the embodiment is as shown in fig. 3, and comprises a main control unit (STM32F103RBT6 chip circuit), a personalized music recommendation unit, a personalized music storage unit, a driver release mode control unit, an alarm unit and a vehicle-mounted terminal;
as shown in fig. 3, the personalized music recommendation unit includes a CIC481 music integrated circuit, a USB interface and bluetooth as a music upload module, pins 15 and 16 of the CIC481 music integrated circuit are respectively connected with PB0 and PB10 of a main control chip STM32F103RBT6, pins 5 and 6 of a CH340CSOP16 are respectively connected with a PC11 and a PC12 of the main control chip STM32F103RBT6, and a USB to serial port chip controls the USB transceiving signal and the accurate baud rate of the serial port signal; the personalized music storage unit adopts a 24C02 data memory chip, and pins 5 and 6 of the 24C02 data memory chip are respectively connected with PA1 and PA4 of a main control chip STM32F103RBT6, so that personalized music storage is realized; the driver alleviation mode control unit adopts a numerical control potentiometer with the model number x9312 to be connected with a 555 timer (NE555 timing chip) as a control unit, pins 1, 2 and 3 of the numerical control potentiometer A1 are respectively connected with PC6, PB14 and PB15 of a main control chip STM32F103RBT6, and RW of A1 is connected with DIS of the 555 timer. The main control chip STM32F103RBT6 controls the digital potentiometer to output different voltages (0-5V) through pins PC6, PB14 and PB15, the 555 timer outputs pulses with different frequencies according to different voltage values, and finally the functions of automatically controlling the switch of the personalized music recommender and entering a corresponding music playing mode are achieved.
The communication unit is connected with the lower computer and is used for realizing data communication between the music recommender and the lower computer; the alarm unit adopts a loudspeaker Bell (model YHE12-05) and an LED lamp module and is used for prompting the driver to stop for rest when the driver is in an extreme fatigue state.
The realization of the function of relieving the driving fatigue of different music playing modes of the personalized music recommender:
and after receiving the driving state data, the single chip microcomputer (lower computer) judges and sends out an operation instruction to control the operation of the personalized music recommender.
When the personalized music periodically plays the working mode, the 555 timer is closed, and the music retrieval playing unit of the vehicle-mounted terminal outputs the periodically personalized music for relieving the driving fatigue;
when the personalized music non-periodic playing work mode is adopted, the 555 timer is started, and the music retrieval playing unit of the vehicle-mounted terminal outputs intermittent personalized music for relieving driving fatigue;
when the alarm work mode is used, the main control chip STM32F103RBT6 controls the on and off of a loudspeaker (alarm unit) through a pin PC13, and the voice reminding module and the LED lamp flashing alarm module prompt a driver to stop for rest.
The invention discloses a driving fatigue detection and mitigation method based on a personalized music recommender, which comprises the following steps as shown in fig. 4 and 5:
1) the electroencephalogram acquisition terminal acquires electroencephalogram signals of a driver in a driving process in real time;
2) transmitting the acquired driver electroencephalogram signals to an upper computer;
3) the upper computer utilizes an Independent Component Analysis (ICA) algorithm to preprocess the EEG signal of the AF3 channel, and removes the artifact interference of power frequency noise, the electric eye and the myoelectricity; extracting slow wave frequency band signals in the electroencephalogram signals, calculating a slow wave average power spectrum and slow wave complexity, judging the driving state of a driver according to changes of the average power spectrum and the complexity, and outputting driving state data to a lower computer;
performing Butterworth band-pass filtering on the preprocessed electroencephalogram signals of the driver, and extracting slow wave frequency band signals in the electroencephalogram signals;
calculating a fatigue index F, G:
Figure BDA0002770604790000051
in the formula, P and P0 are average power spectrums of delta (0.5-4 Hz) and theta (4-8 Hz) rhythms of the current time and the previous 15 minutes of the driver respectively, and L0 are complexity of the delta and theta rhythms of the current time and the previous 15 minutes of the driver respectively;
calculating the current electroencephalogram fatigue index of the driver in real time, and judging the driving state of the driver according to the change of the driving fatigue state of the current electroencephalogram fatigue index: if the fatigue index F is less than or equal to 1.2(1+ h) and G is less than or equal to 1.2(1+ h), the driver is in a normal driving state, and then the step 1 is returned; if the fatigue index is more than 1.2(1+ h) and less than or equal to F and less than or equal to 1.3(1+ h) and more than 1.2(1+ h) and less than or equal to G and less than or equal to 1.3(1+ h), the driver is in a mild fatigue driving state; if the fatigue index is more than 1.3(1+ h) and less than or equal to F and less than or equal to 1.5(1+ h) and more than 1.3(1+ h) and less than or equal to G and less than or equal to 1.5(1+ h), the driver is in a severe fatigue driving state; if F > 1.5(1+ h) and G > 1.5(1+ h), the driver is in an extreme fatigue state; h regulatory factors for individual tolerance differences;
fourthly, transmitting the driving fatigue state data of the driver to the lower computer;
4) the lower computer controls the personalized music recommender to start and enter a corresponding music playing mode according to the driving fatigue state data: if the driver is in a light fatigue driving state, entering an individualized music periodic playing working mode; if the driver is in a severe fatigue driving state, entering a personalized music aperiodic playing working mode; and if the driver is in the extreme fatigue driving state, entering an alarm working mode to prompt the driver to stop for rest.
The description of the present invention is not intended to be exhaustive or to limit the scope of the claims, and those skilled in the art will be able to conceive of other substantially equivalent alternatives, without inventive step, based on the teachings of the present invention.

Claims (7)

1. The utility model provides a driving fatigue detection alleviates system based on individualized music recommender which characterized in that: the brain wave music recommendation system comprises a brain wave acquisition terminal, an upper computer, a lower computer and a personalized music recommender, wherein the brain wave acquisition terminal is used for acquiring brain wave signals of a driver in real time; the upper computer is used for preprocessing the electroencephalogram signals, extracting slow wave frequency band signals in the electroencephalogram signals, calculating a slow wave average power spectrum and slow wave complexity, judging the driving state of a driver according to the changes of the average power spectrum and the slow wave complexity, and outputting the driving state data to the lower computer; the lower computer controls the personalized music recommender to start a corresponding working mode according to the driving fatigue state data; the personalized music recommender is used for entering a corresponding music playing mode according to a control instruction of the lower computer; the input end of the electroencephalogram acquisition terminal is connected to the cerebral cortex of a driver, the output end of the electroencephalogram acquisition terminal is connected with the upper computer, the upper computer is connected with the lower computer, the lower computer is connected with the personalized music recommender, and the personalized music recommender enters a corresponding music playing mode according to an instruction sent by the lower computer.
2. The system of claim 1, wherein the system comprises: the personalized music recommender includes: the vehicle-mounted terminal comprises a main control unit, an individualized music storage unit, a driver fatigue relieving mode control unit, an individualized music recommendation unit, an alarm unit, a vehicle-mounted terminal and a wireless radio frequency communication unit, wherein the main control unit is respectively connected with the individualized music storage unit, the driver fatigue relieving mode control unit, the individualized music recommendation unit, the alarm unit and the vehicle-mounted terminal through wireless radio frequency communication; the personalized music recommendation unit comprises a music uploading module and a personalized music recommendation module; the music uploading module uploads vehicle-mounted personalized music by using Bluetooth or a U disk and a TF card, the personalized music recommendation module carries out music recommendation according to the average power spectrum of slow waves and the change of the complexity of the slow waves, and the personal music storage unit is used for storing the vehicle-mounted personalized music; the alarm unit comprises a voice reminding module and an LED lamp flashing alarm module; the vehicle-mounted terminal comprises a music retrieval playing unit and a driver fatigue state display module.
3. The system for detecting and relieving driving fatigue based on the personalized music recommender as claimed in claim 1 or 2, wherein: the working modes of the personalized music recommender comprise a personalized music periodic playing working mode, a personalized music non-periodic playing working mode and an alarm working mode.
4. The system of claim 3, wherein the system comprises: the personalized music periodic playing working mode is that a music retrieval playing unit of the vehicle-mounted terminal outputs periodic personalized music for relieving driving fatigue.
5. The system of claim 3, wherein the system comprises: the personalized music aperiodic playing working mode is that the music retrieval playing unit of the vehicle-mounted terminal outputs intermittent personalized music for relieving driving fatigue.
6. The system of claim 3, wherein the system comprises: the alarm working mode is that the voice reminding module and the LED lamp flashing alarm module of the alarm unit prompt a driver to stop for rest.
7. The system for detecting and relieving driving fatigue based on the personalized music recommender as described in claim 1, wherein the method for detecting and relieving driving fatigue comprises the following steps:
1) the electroencephalogram acquisition terminal acquires electroencephalogram signals of a driver in a driving process in real time;
2) transmitting the acquired driver electroencephalogram signals to an upper computer;
3) the upper computer utilizes an Independent Component Analysis (ICA) algorithm to preprocess the EEG signal of the AF3 channel, and removes the artifact interference of power frequency noise, the electric eye and the myoelectricity; extracting slow wave frequency band signals in the electroencephalogram signals, calculating a slow wave average power spectrum and slow wave complexity, judging the driving state of a driver according to changes of the average power spectrum and the complexity, and outputting driving state data to a lower computer;
performing Butterworth band-pass filtering on the preprocessed electroencephalogram signals of the driver, and extracting slow wave frequency band signals in the electroencephalogram signals;
calculating a fatigue index F, G:
Figure FDA0002770604780000021
in the formula, P and P0 are average power spectrums of delta (0.5-4 Hz) and theta (4-8 Hz) rhythms of the current time and the previous 15 minutes of the driver respectively, and L0 are complexity of the delta and theta rhythms of the current time and the previous 15 minutes of the driver respectively;
calculating the current electroencephalogram fatigue index of the driver in real time, and judging the driving state of the driver according to the change of the driving fatigue state of the current electroencephalogram fatigue index: if the fatigue index F is less than or equal to 1.2(1+ h) and G is less than or equal to 1.2(1+ h), the driver is in a normal driving state, and then the step 1 is returned; if the fatigue index is more than 1.2(1+ h) and less than or equal to F and less than or equal to 1.3(1+ h) and more than 1.2(1+ h) and less than or equal to G and less than or equal to 1.3(1+ h), the driver is in a mild fatigue driving state; if the fatigue index is more than 1.3(1+ h) and less than or equal to F and less than or equal to 1.5(1+ h) and more than 1.3(1+ h) and less than or equal to G and less than or equal to 1.5(1+ h), the driver is in a severe fatigue driving state; if F > 1.5(1+ h) and G > 1.5(1+ h), the driver is in an extreme fatigue state; h regulatory factors for individual tolerance differences;
fourthly, transmitting the driving fatigue state data of the driver to the lower computer;
4) the lower computer controls the personalized music recommender to start and enter a corresponding music playing mode according to the driving fatigue state data: if the driver is in a light fatigue driving state, entering an individualized music periodic playing working mode; if the driver is in a severe fatigue driving state, entering a personalized music aperiodic playing working mode; and if the driver is in the extreme fatigue driving state, entering an alarm working mode to prompt the driver to stop for rest.
CN202011247732.2A 2020-11-10 2020-11-10 System and method for detecting and relieving driving fatigue based on personalized music recommender Pending CN112451833A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011247732.2A CN112451833A (en) 2020-11-10 2020-11-10 System and method for detecting and relieving driving fatigue based on personalized music recommender

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011247732.2A CN112451833A (en) 2020-11-10 2020-11-10 System and method for detecting and relieving driving fatigue based on personalized music recommender

Publications (1)

Publication Number Publication Date
CN112451833A true CN112451833A (en) 2021-03-09

Family

ID=74824916

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011247732.2A Pending CN112451833A (en) 2020-11-10 2020-11-10 System and method for detecting and relieving driving fatigue based on personalized music recommender

Country Status (1)

Country Link
CN (1) CN112451833A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114613233A (en) * 2022-03-09 2022-06-10 东北电力大学 Interactive installation is used in art teaching of digital media
CN116616794A (en) * 2023-05-18 2023-08-22 中国人民解放军海军特色医学中心 Underwater operator fatigue adjustment method and system based on electroencephalogram signals

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040044291A1 (en) * 2002-08-30 2004-03-04 Pioneer Corporation Reproduction controlling system for mobile unit, reproduction controlling method for mobile unit, reproduction controlling program for mobile unit, and recording medium recording reproduction controlling program
CN103111020A (en) * 2013-02-04 2013-05-22 东北大学 System and method for detecting and relieving driving fatigue based on electrical acupoint stimulation
CN103505224A (en) * 2012-06-27 2014-01-15 东北大学 Fatigue driving remote monitoring and alarm system and method based on physiological information analysis
CN105194785A (en) * 2015-09-30 2015-12-30 上海车音网络科技有限公司 Method, device and system for preventing driving fatigue
CN106371610A (en) * 2016-09-23 2017-02-01 重庆金瓯科技发展有限责任公司 Method for detecting driving fatigue based on electroencephalogram
CN106529421A (en) * 2016-10-21 2017-03-22 燕山大学 Emotion and fatigue detecting auxiliary driving system based on hybrid brain computer interface technology
CN108836324A (en) * 2018-05-16 2018-11-20 广东工业大学 A kind of fatigue driving method for early warning and system based on EEG signals monitoring
CN111839508A (en) * 2020-07-30 2020-10-30 陕西科技大学 Vehicle safe driving system based on mental state detection and control

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040044291A1 (en) * 2002-08-30 2004-03-04 Pioneer Corporation Reproduction controlling system for mobile unit, reproduction controlling method for mobile unit, reproduction controlling program for mobile unit, and recording medium recording reproduction controlling program
CN103505224A (en) * 2012-06-27 2014-01-15 东北大学 Fatigue driving remote monitoring and alarm system and method based on physiological information analysis
CN103111020A (en) * 2013-02-04 2013-05-22 东北大学 System and method for detecting and relieving driving fatigue based on electrical acupoint stimulation
CN105194785A (en) * 2015-09-30 2015-12-30 上海车音网络科技有限公司 Method, device and system for preventing driving fatigue
CN106371610A (en) * 2016-09-23 2017-02-01 重庆金瓯科技发展有限责任公司 Method for detecting driving fatigue based on electroencephalogram
CN106529421A (en) * 2016-10-21 2017-03-22 燕山大学 Emotion and fatigue detecting auxiliary driving system based on hybrid brain computer interface technology
CN108836324A (en) * 2018-05-16 2018-11-20 广东工业大学 A kind of fatigue driving method for early warning and system based on EEG signals monitoring
CN111839508A (en) * 2020-07-30 2020-10-30 陕西科技大学 Vehicle safe driving system based on mental state detection and control

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114613233A (en) * 2022-03-09 2022-06-10 东北电力大学 Interactive installation is used in art teaching of digital media
CN114613233B (en) * 2022-03-09 2023-10-27 东北电力大学 Interactive device for digital media art teaching
CN116616794A (en) * 2023-05-18 2023-08-22 中国人民解放军海军特色医学中心 Underwater operator fatigue adjustment method and system based on electroencephalogram signals
CN116616794B (en) * 2023-05-18 2024-02-20 中国人民解放军海军特色医学中心 Underwater operator fatigue adjustment method and system based on electroencephalogram signals

Similar Documents

Publication Publication Date Title
CN112451833A (en) System and method for detecting and relieving driving fatigue based on personalized music recommender
CN105054951B (en) A kind of fatigue driving eeg monitoring method based on frequency of wink identification
CN102263937B (en) Driver's driving behavior monitoring device and monitoring method based on video detection
CN103111020B (en) System and method for detecting and relieving driving fatigue based on electrical acupoint stimulation
CN101576772B (en) Brain-computer interface system based on virtual instrument steady-state visual evoked potentials and control method thereof
CN100536766C (en) Method and apparatus for monitoring and awakening fatigue doze
CN205405810U (en) Driver fatigue detection alarm system based on brain wave
CN111631697A (en) Intelligent sleep and fatigue state information monitoring control system and method and monitor
CN2770008Y (en) Dozing detection alarm
CN105615878A (en) Fatigue driving electroencephalographic monitoring method
CN106618562A (en) Wearable epilepsy brain-electricity seizure brain area positioning device and method
CN110604565A (en) Brain health screening method based on portable EEG equipment
CN108464839A (en) A kind of vehicle-mounted fatigue monitoring and early warning of driving system based on machine learning
CN103019383B (en) A kind of Steady State Visual Evoked Potential brain-machine interface signal recognition methods
CN111329497A (en) Wearable fatigue driving monitoring system and method based on forehead electroencephalogram signals
CN105595996A (en) Driving fatigue electroencephalogram monitoring method based on electrooculogram and electroencephalogram comprehensive determination
CN110103819B (en) Fatigue driving awakening method and system
CN108836324B (en) Fatigue driving early warning method and system based on electroencephalogram signal monitoring
CN104461007A (en) Driver-car interactive system assisting driver based on electroencephalograms
CN105662407A (en) System for detecting driver fatigue based on surface myoelectricity technology
CN209186698U (en) A kind of epilepsy early warning device based on FPGA
CN105011951A (en) Device for extracting eye blinking times by brain waves and method
CN106504477A (en) A kind of based on the fatigue driving determination methods of GPS, device and smart machine
CN110367975A (en) A kind of fatigue driving detection method for early warning based on brain-computer interface
CN105615879A (en) Multifractal detrended fluctuation analysis (MF-DFA)-based electroencephalogram lie detection method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210309

RJ01 Rejection of invention patent application after publication