WO2006000166B1 - Method and device for detecting operator fatigue or quality - Google Patents

Method and device for detecting operator fatigue or quality

Info

Publication number
WO2006000166B1
WO2006000166B1 PCT/CZ2005/000051 CZ2005000051W WO2006000166B1 WO 2006000166 B1 WO2006000166 B1 WO 2006000166B1 CZ 2005000051 W CZ2005000051 W CZ 2005000051W WO 2006000166 B1 WO2006000166 B1 WO 2006000166B1
Authority
WO
WIPO (PCT)
Prior art keywords
operator
fatigue
quality
operators
activity
Prior art date
Application number
PCT/CZ2005/000051
Other languages
French (fr)
Other versions
WO2006000166A1 (en
Inventor
Miloslav Pavelka
Tamer Keshi
Original Assignee
Miloslav Pavelka
Tamer Keshi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Miloslav Pavelka, Tamer Keshi filed Critical Miloslav Pavelka
Publication of WO2006000166A1 publication Critical patent/WO2006000166A1/en
Publication of WO2006000166B1 publication Critical patent/WO2006000166B1/en

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7253Details of waveform analysis characterised by using transforms
    • A61B5/726Details of waveform analysis characterised by using transforms using Wavelet transforms
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K28/00Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
    • B60K28/02Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
    • B60K28/06Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients

Abstract

The method of operator fatigue detection from operator muscular activity is performed by detecting at least one parameter affected by operator muscular activity, which parameter is assessed using fatigue assessment rules obtained using a data mining method from a corresponding parameter of at least one operator for whom the extent of fatigue is known. The device to perform the fatigue detection method comprises a programmable unit with a pre­programmed fatigue detection model - that is to say fatigue assessment rules obtained by measuring a signal of at least one of parameters generated by operator muscular activity for at least one fatigued operator and at least one alert operator -, a detector or detectors to measure or measure and process the signal of the parameter or parameters used by the model, connected to the input of the programmable unit to assess operator fatigue, while the programmable unit output is connected to a fatigue signaling device.

Claims

59AMENDED CLAIMS received by the International Bureau on 27 December 2005 (27.12.05)NEW CLAIMS
1. A method of operator fatigue detection or operator quality evaluation from an activity performed by the operator, said activity comprising operator's muscular activity, wherein a fatigue detection model or a quality evaluation model being capable of generalization is created, said model being based upon measuring parameters derived from the activity of different operators performing said activity, whereas the extent of their fatigue or quality is known beforehand, the fatigue or the quality evaluation model is created as a set of decision rules for evaluating operator fatigue or quality or for making a decision if the operator is capable of performing his activity or not.
2. A method according to claim 1, characterized by detecting at least one parameter affected by operator's muscular activity, which parameter is evaluated based on fatigue detection or quality evaluation model or rules obtained using a data mining method from a corresponding parameter of different operators for whom the extent of fatigue or quality is known beforehand.
3. A method according to claim 2 characterized in that the data mining method uses one of the following techniques: neural networks, decision trees, regression, random forests, genetic algorithms, splines, SVM3 CHAID, CART, non-parametric system identification models, non parametric regression, clustering, and any combination of those techniques.
4. A method according to any of claims 1 to 3, characterized by creating variables derived from parameters affected by the operator muscular activity, said variables express the fatigue difference between a fatigued operator and alert operator or the quality difference between a high-quality-operator and low-quality-operator.
5 A method according to claim 4, characterized by creating a table or structure comprising sets of input variables and a corresponding output variable set, the input variable values are derived from the parameter or parameters of individual operators in individual time intervals, the output variable value describes the corresponding extent of operator fatigue in each time interval for each individual operator. 60
6. A method according to any of Claims 1 to 5, characterized in that one parameter obtained by the activity of operators performing said activity is generated from a motor vehicle steering-wheel movement being detected from any suitable part of the vehicle including the steering-wheel itself, the parts between the steering-wheel and the axle, or the axle itself.
7. A method according to Claim 6, characterized in that further parameters derived from the activity of operators performing said activity are generated from at least one of the following components: speed control related to an accelerator pedal movement, speed control related to a brake pedal movement, vehicle speed, vehicle lateral acceleration, vehicle longitudinal acceleration, windscreen wiper switched on as a rain indicator, vehicle loading, outside temperature values measured, and vehicle's position on the street.
8. A method according to any of Claims 1 to 7, characterized in that the parameters are generated from the vehicle longitudinal and/or transverse acceleration.
9. A method of operator fatigue or quality evaluation from operator muscular activity, wherein: a) at least one parameter influenced by the operator muscular activity is detected to ensure generalization for at least two alert operators and at least two fatigued operators or at least two high-quality operators and at least two low-quality operators b) a set of data or preferably variables is obtained and stored in a suitable form, c) based on the stored data or variables a fatigue detection model or a quality evaluation model is created using a data mining method, d) at least one parameter measured in step a) is measured for the evaluated operator, e) values measured in step d) are used to create data or preferably variables in the same or similar way as in step b) f) data or variables are used as input data for the model created in step c), whilst the model output provides the fatigue detection or quality estimation of the evaluated operator. 61
10. A device for fatigue detection or quality evaluation capable of generalization, comprising a programmable unit, wherein the programmable unit includes fatigue or quality evaluation model for operator fatigue evaluation or for operator quality evaluation, the model being obtained by a data mining method using signal derived from at least one of parameters generated by operator muscular activity, the parameters being detected for different fatigued operators and for different alert operators or for different high-quality operators and for different low-quality operators, the device further comprising at least one detector to measure or to measure-and-process the signal derived from the parameter or parameters used by the model, the detector or detectors are connected to the input of the programmable unit to evaluate operator fatigue or quality, the programmable unit output being connected to a fatigue or quality signaling equipment, while the device advantageously also comprises at least one unit for signal or data processing to generate suitable inputs for the fatigue or quality evaluation model.
11. A device according to claim 10, characterized by performing signal measuring, signal processing into the form of input data or variables of the detection or evaluation model, and fatigue detection or quality estimation in real time, i.e. simultaneously with operator's routine activity.
12. A device for performing a method according to any of claims 1 to 9 for a real-time fatigue detection or quality evaluation, capable of generalization, comprising a programmable unit, wherein the programmable unit includes fatigue or quality evaluation model for operator fatigue evaluation or for operator quality evaluation, the model being obtained by a data mining method using a signal obtained from at least one of parameters generated by operator muscular activity for more than 5 fatigued operators and for more than 5 alert operators or for more than 5 high-quality operators and for more than 5 low-quality operators, the device further comprising at least one detector to measure or to measure-and-process the signal used by the model, the detector or detectors are connected to the input of the programmable unit to evaluate operator fatigue or quality, the programmable unit output being connected to a fatigue or quality signaling equipment, while the device preferably also comprises at least one unit for signal or data processing to generate suitable inputs for the fatigue or quality evaluation model, the device further performing signal measuring, signal processing into the 62
form of input data or variables of the detection or evaluation model, and fatigue or quality estimation m real time, i.e. simultaneously with operator's routine activity.
PCT/CZ2005/000051 2004-06-29 2005-06-29 Method and device for detecting operator fatigue or quality WO2006000166A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CZ20040770A CZ2004770A3 (en) 2004-06-29 2004-06-29 Method of detecting operator fatigue caused by muscle activity and apparatus for making the same
CZPV2004-770 2004-06-29

Publications (2)

Publication Number Publication Date
WO2006000166A1 WO2006000166A1 (en) 2006-01-05
WO2006000166B1 true WO2006000166B1 (en) 2006-05-11

Family

ID=35058858

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CZ2005/000051 WO2006000166A1 (en) 2004-06-29 2005-06-29 Method and device for detecting operator fatigue or quality

Country Status (2)

Country Link
CZ (1) CZ2004770A3 (en)
WO (1) WO2006000166A1 (en)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10370012B2 (en) 2017-03-09 2019-08-06 Ge Global Sourcing Llc Adaptive vehicle control system
GB0619753D0 (en) 2006-10-06 2006-11-15 Chroma Therapeutics Ltd Enzyme inhibitors
US7594122B2 (en) 2007-11-13 2009-09-22 Wavesynch Technologies, Inc. Method of determining whether a test subject is a specific individual
AT506667B1 (en) * 2008-04-03 2013-06-15 Gesunde Arbeitsplatzsysteme Gmbh METHOD FOR CHECKING THE TIRED DEGRESSION OF A PERSON OPERATING A DEVICE
US20120133514A1 (en) * 2009-06-30 2012-05-31 Asp Technology Aps Pause adviser system and use thereof
US10154382B2 (en) 2013-03-12 2018-12-11 Zendrive, Inc. System and method for determining a driver in a telematic application
NZ630770A (en) 2013-10-09 2016-03-31 Resmed Sensor Technologies Ltd Fatigue monitoring and management system
US20150223743A1 (en) * 2014-02-12 2015-08-13 Wipro Limited Method for monitoring a health condition of a subject
US10504068B2 (en) * 2015-07-14 2019-12-10 Omnitracs, Llc Driver log analytics system
EP3338105B1 (en) 2015-08-20 2022-01-05 Zendrive, Inc. Method for accelerometer-assisted navigation
CN105261152B (en) * 2015-09-30 2018-01-30 中国民用航空总局第二研究所 Air traffic controller's fatigue detection method based on cluster analysis, device and system
WO2018049416A1 (en) 2016-09-12 2018-03-15 Zendrive, Inc. Method for mobile device-based cooperative data capture
US10012993B1 (en) 2016-12-09 2018-07-03 Zendrive, Inc. Method and system for risk modeling in autonomous vehicles
JP2018102617A (en) * 2016-12-27 2018-07-05 オムロン株式会社 Emotion estimation apparatus, method, and program
US11065958B2 (en) 2017-01-03 2021-07-20 Transportation Ip Holdings, Llc Control system and method
US10328946B2 (en) 2017-01-03 2019-06-25 Ge Global Sourcing Llc Alerter augmentation system
JP2018142259A (en) * 2017-02-28 2018-09-13 オムロン株式会社 Manufacturing management device, method, and program
JP2018142258A (en) * 2017-02-28 2018-09-13 オムロン株式会社 Manufacturing management device, method, and program
WO2018158704A1 (en) * 2017-02-28 2018-09-07 Omron Corporation Work management apparatus, method, and program
WO2018158702A1 (en) * 2017-02-28 2018-09-07 Omron Corporation Production management apparatus, method, and program
US10304329B2 (en) * 2017-06-28 2019-05-28 Zendrive, Inc. Method and system for determining traffic-related characteristics
JP7070253B2 (en) * 2018-08-31 2022-05-18 オムロン株式会社 Performance measuring device, performance measuring method and performance measuring program
CN110796207B (en) * 2019-11-08 2023-05-30 中南大学 Fatigue driving detection method and system
US11775010B2 (en) 2019-12-02 2023-10-03 Zendrive, Inc. System and method for assessing device usage
US11938947B2 (en) 2022-01-05 2024-03-26 Honeywell International S.R.O. Systems and methods for sensor-based operator fatigue management
CN117271271B (en) * 2023-11-21 2024-03-22 深圳市利新联电子有限公司 Hand fatigue identification method, system and storage medium based on mouse usage monitoring

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2742706B1 (en) * 1995-12-22 1998-02-13 Peugeot METHOD FOR DETECTING THE DEVELOPMENT OF THE DRIVING BEHAVIOR OF A MOTOR VEHICLE DRIVER AND DEVICE FOR CARRYING OUT SUCH A METHOD
US5798695A (en) * 1997-04-02 1998-08-25 Northrop Grumman Corporation Impaired operator detection and warning system employing analysis of operator control actions
GB2366062A (en) * 2000-02-18 2002-02-27 Philip John Pearce Detecting fatigue in machine operator or vehicle driver

Also Published As

Publication number Publication date
CZ2004770A3 (en) 2006-02-15
WO2006000166A1 (en) 2006-01-05

Similar Documents

Publication Publication Date Title
WO2006000166B1 (en) Method and device for detecting operator fatigue or quality
US8521357B2 (en) Impaired operation detection method
KR20160084836A (en) Method and device for optimizing driver assistance systems
CN106740829B (en) Based on the double semi-dragging truck riding stability automatic identifications of cluster analysis and early warning system
US20190217886A1 (en) Hands-on/-off detection in a steer-by-wire system
CN106379318A (en) Adaptive cruise control profiles
CN103180179B (en) Sensor device for automobile
US20180105206A1 (en) Method and system for determining road properties in a vehicle
DE102005026456A1 (en) Method and device for detecting fatigue
CN103492252B (en) Vehicle information providing device
US20210153796A1 (en) Control device, system, and method for determining a comfort level of a driver
CN110143202A (en) A kind of dangerous driving identification and method for early warning and system
Shirazi et al. Detection of intoxicated drivers using online system identification of steering behavior
CN106882141A (en) Driving behavior detection method and device
CN109191788B (en) Driver fatigue driving judgment method, storage medium, and electronic device
CN113891823A (en) Method and device for monitoring the state of health of an occupant, in particular of an autonomous vehicle, regulated by a driving maneuver
CN108372759A (en) Method and system for the state of wear for determining at least one tire
CN106339692A (en) Fatigue driving state information determination method based on route offset detection and system
CN110446619A (en) Method and apparatus for determining the wheel weight on wheel of vehicle
JPH08268013A (en) Judging method of pressure reduction in tire of traveling vehicle
CN116353584A (en) Vehicle collision risk prediction system and vehicle
WO2024012928A1 (en) Method for training a neural network
CN106934556A (en) A kind of evaluation method of the outbound handling quality characteristic of bus driver
JP5838577B2 (en) Travel evaluation device
CN113335295A (en) Fatigue driving early warning method and device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
B Later publication of amended claims

Effective date: 20051227

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase