CN116665334A - Face recognition-based driver self-service reporting method and device - Google Patents

Face recognition-based driver self-service reporting method and device Download PDF

Info

Publication number
CN116665334A
CN116665334A CN202310937831.0A CN202310937831A CN116665334A CN 116665334 A CN116665334 A CN 116665334A CN 202310937831 A CN202310937831 A CN 202310937831A CN 116665334 A CN116665334 A CN 116665334A
Authority
CN
China
Prior art keywords
driver
self
reporting
reporting method
entering
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310937831.0A
Other languages
Chinese (zh)
Inventor
崔震苍
刘东升
黄山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beishite Technology Group Co ltd
Original Assignee
Beishite Technology Group Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beishite Technology Group Co ltd filed Critical Beishite Technology Group Co ltd
Priority to CN202310937831.0A priority Critical patent/CN116665334A/en
Publication of CN116665334A publication Critical patent/CN116665334A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D21/00—Measuring or testing not otherwise provided for
    • G01D21/02—Measuring two or more variables by means not covered by a single other subclass
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/021—Measuring pressure in heart or blood vessels
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/168—Evaluating attention deficit, hyperactivity
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A61B5/372—Analysis of electroencephalograms
    • A61B5/374—Detecting the frequency distribution of signals, e.g. detecting delta, theta, alpha, beta or gamma waves
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4845—Toxicology, e.g. by detection of alcohol, drug or toxic products
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/10—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people together with the recording, indicating or registering of other data, e.g. of signs of identity

Abstract

The invention provides a face recognition-based self-service driver reporting method and a face recognition-based self-service driver reporting device, wherein the self-service driver reporting method comprises the following steps: 1) Acquiring a face image of a driver through a conventional camera, and identifying and verifying the extracted face image based on pre-stored face information; 2) Judging whether the driver is in a drunk state or not; 3) Judging whether the driver is in a fatigue state; 4) Prompting the driver to wear the brain wave data acquisition device, and judging whether the attention of the driver meets the requirement or not based on the brain wave data; 5) The driver's sign data is detected. The invention detects drunk condition, fatigue degree, attention state and physical sign condition of the driver, comprehensively judges whether the driver is suitable for driving, and fundamentally ensures driving safety.

Description

Face recognition-based driver self-service reporting method and device
Technical Field
The invention relates to the field of intelligent traffic, in particular to a driver self-help reporting method and device based on face recognition.
Background
With the development of highway passenger transportation and mobile internet, internet technology enables enterprises to be applied to continuous promotion, and links such as vehicle case inspection, driver report, exit gate inspection and the like in traditional highway passenger transportation all adopt modes such as driver card swiping, manual report by dispatcher or manual registration, so that the problems of low efficiency, misoperation and the like are solved, the problems of missing detection, false report, replacement report and the like are solved, various problems are brought to enterprise operation, and important potential safety hazards are also brought to the aspect of passenger transportation.
The traditional process consumes a large amount of manpower and material resources on procedure transfer, so that the operation cost of enterprises can be increased, in addition, the information accuracy is poor, the state of a driver cannot be detected, and the driving safety is ensured.
Disclosure of Invention
In order to solve the technical problems that the traditional flow information in the prior art is poor in accuracy and the state of a driver cannot be detected, the self-service reporting method for the driver provided by the invention comprises the following steps:
s1, a driver looks forward at a conventional camera and an infrared camera, hands are placed on a detection table, face images of the driver are collected through the conventional camera, identification verification is carried out on the extracted face images based on pre-stored face information, if the verification is passed, S2 is carried out, and otherwise S7 is carried out;
s2, judging whether a driver is in a drunk state, if so, entering S7, otherwise, entering S3;
s3, judging whether a driver is in a fatigue state, if so, entering S4, otherwise, entering S5;
s4, prompting the driver to wear the brain wave data acquisition device, judging whether the attention of the driver meets the requirement based on the brain wave data, if so, entering S5, otherwise, entering S7;
s5, detecting sign data of a driver, entering S6 if the sign data are in a normal range, otherwise entering S7;
s6, automatically listing shift information to be reported by a display interface, selecting by a driver, finishing reporting the shift, and ending the reporting flow;
and S7, displaying that the verification is not passed by the display interface, not allowing reporting of the shifts, and ending the shift reporting process.
Preferably, in the step S2, the near infrared detection probe arranged above the detection table receives light of the hands of the driver, the spectral analysis element collects the alcohol content of the driver, the spectral analysis element analyzes the collected spectral information to calculate the alcohol content of the human body, if the alcohol content is greater than a first threshold value, the driver is determined to be in a drunk state, if the alcohol content is less than or equal to the first threshold value but greater than a second threshold value, an infrared image of the face is captured by the infrared camera, whether the driver is in a drunk state is determined according to the infrared image, and if the alcohol content is less than or equal to the second threshold value, the driver is determined not to be in a drunk state.
Preferably, in the step S2, the step of judging whether the driver is in the drunk state according to the infrared image specifically includes obtaining the temperature of the nose part and the temperature of the forehead part through infrared image recognition, calculating a difference value between the nose part and the forehead part, and if the difference value is greater than a temperature difference threshold, determining that the driver is in the drunk state, otherwise, determining that the driver is not in the drunk state.
Preferably, in the step S3, face images of a plurality of drivers are collected through a conventional camera, the range of eyes is determined based on the characteristic points of the eyes, the blood silk ratio of each face image is determined according to the ratio of the area of red pixels in the range of eyes to the area of the eyes, the average value of the blood silk ratios of the face images is calculated as the eye blood silk ratio, if the eye blood silk ratio is greater than the fatigue threshold, the driver is determined to be in a fatigue state, otherwise, the driver is determined not to be in a fatigue state.
Preferably, in the step S4, the α, β, θ bands in the brain waves are transmitted to the brain wave processing module, the brain wave processing module analyzes and calculates a ratio of the β wave intensity to the sum of the α, β, θ wave intensities, and when the calculated ratio is greater than the attention threshold, it is determined that the attention of the driver is at a normal level, and the process goes to step S5, otherwise, the process goes to step S7.
Preferably, in the step S4, the brain wave data acquisition device uses a TGAM brain wave module of the mind technology, and the brain wave data acquisition device is connected with the brain wave processing module through bluetooth.
Preferably, in S5, the millimeter wave radar arranged above the detection table is used to measure the tiny disturbance on the hand skin surface caused by the arterial pulse, and the data of heart rate and blood pressure can be obtained by calculating and processing the radar signal, if the data of heart rate and blood pressure are in the normal range, the process goes to S6, otherwise, the process goes to S7.
Preferably, in the step S5, the millimeter wave radar is an XENSIV radar chip of inflorescence.
Preferably, in S7, the specific item that is not passed by the verification is described to the driver by voice.
The driver self-service reporting device based on face recognition comprises a detection table, a near infrared detection probe, a millimeter wave radar, a display screen, a conventional camera, an infrared camera, an electroencephalogram processing module, a central processor and a memory, wherein the near infrared detection probe and the millimeter wave radar are arranged right above the detection table, and the electroencephalogram processing module, the central processor and the memory are arranged in the driver self-service reporting device;
the memory stores face information for identification, a computer program and data required by device operation, and the central processing unit can realize the self-service reporting method of the driver by operating the computer program.
Compared with the prior art, the invention has the following beneficial effects:
and detecting drunk conditions, fatigue degree, attention state and physical sign conditions of the driver, comprehensively judging whether the driver is suitable for driving, and fundamentally ensuring the driving safety.
Drawings
FIG. 1 is a flow chart of the driver self-help reporting method of the present invention;
fig. 2 is a schematic structural diagram of the self-service reporting device for drivers of the present invention.
In the figure, a 1-detection table, a 2-near infrared detection probe, a 3-millimeter wave radar, a 4-display screen, a 5-conventional camera and a 6-infrared camera.
Detailed Description
For a clearer understanding of technical features, objects, and effects of the present invention, a specific embodiment of the present invention will be described with reference to the accompanying drawings.
As shown in fig. 1, the driver self-service reporting method based on face recognition provided by the invention comprises the following steps:
s1, a driver looks forward at a conventional camera and an infrared camera, hands are placed on a detection table, face images of the driver are collected through the conventional camera, identification verification is carried out on the extracted face images based on pre-stored face information, if the verification is passed, S2 is entered, and otherwise S7 is entered.
S2, judging whether the driver is in a drunk state, if so, entering S7, otherwise, entering S3. The specific detection process is that the near infrared detection probe arranged above the detection table is used for receiving hand light of a driver, the spectral information of the alcohol content of the driver is collected, the spectral analysis element is used for analyzing the collected spectral information to calculate the alcohol content of a human body, if the alcohol content is larger than a first threshold value, the driver is considered to be in a drunk state, if the alcohol content is smaller than or equal to the first threshold value but larger than a second threshold value, an infrared image of the face is shot through the infrared camera, the temperature of the nose part and the temperature of the forehead part are obtained through image recognition, the difference value between the nose part and the forehead part is calculated, if the difference value is larger than a temperature difference threshold value, the driver is considered to be in the drunk state, otherwise, the driver is considered not to be in the drunk state, and if the alcohol content is smaller than or equal to the second threshold value, the driver is considered not to be in the drunk state. The principle of alcohol detection based on spectrum is that near infrared light has stronger penetrability to biological tissues, the penetrability of the alcohol detection based on spectrum can reach 5mm, the alcohol detection based on spectrum passes through skin epidermis to reach dermis, dermis contains rich blood vessels, alcohol is located at the position, the main component in the alcohol is alcohol, the absorption spectrum of the alcohol in a near infrared spectrum region is mostly oxygen-containing groups, the chemical structure of the alcohol is represented by the absorption spectrum of the groups, and the change of regularity is presented along with the change of concentration, so the concentration of the alcohol can be determined by detecting the absorption spectrum of the alcohol in blood according to the information characteristics of the position, absorption intensity and the like of the near infrared absorption spectrum of the groups. The principle of drunk according to the temperature difference is that after a person drinks, the skin can expand blood vessels under the stimulation of alcohol, so that the temperature of the nose part is higher, and the forehead part is cooler.
S3, judging whether the driver is in a fatigue state, if so, entering S4, otherwise, entering S5. The specific fatigue judgment process is that face images of a plurality of drivers are collected through a conventional camera, the range of eyes is determined based on characteristic points of the eyes, the blood silk ratio of each face image is determined according to the ratio of the area of red pixel points in the range of the eyes to the area of the eyes, the average value of the blood silk ratios of the face images is calculated to be used as the eye blood silk ratio, if the eye blood silk ratio is larger than a fatigue threshold value, the driver is determined to be in a fatigue state, otherwise, the driver is determined not to be in the fatigue state.
S4, prompting the driver to wear the brain wave data acquisition device, judging whether the attention of the driver meets the requirement based on the brain wave data, if so, entering S5, otherwise, entering S7. Specifically, the brain wave data acquisition device uses a TGAM brain wave module of the mind science and technology, the brain wave data acquisition device is connected with the brain wave processing module through Bluetooth, alpha, beta and theta wave bands in brain waves are transmitted to the brain wave processing module, the brain wave processing module analyzes and calculates the ratio of beta wave intensity to the sum of the alpha, beta and theta wave intensity, when the calculated ratio is larger than the attention threshold value, the attention of a driver is considered to be at a normal level, and S5 is entered, otherwise S7 is entered.
S5, detecting sign data of a driver, entering S6 if the sign data are in a normal range, otherwise entering S7. The specific blood pressure detection process is that micro disturbance on the surface of hand skin caused by arterial pulse is measured through a millimeter wave radar arranged above a detection table, heart rate and blood pressure data can be obtained through calculation processing of radar signals, if the heart rate and the blood pressure data are in normal ranges, the process enters S6, and otherwise, the process enters S7. Millimeter wave Lei Daxuan is an XENSIV radar chip for infliximab, which is a frequency modulated continuous wave radar operating at 60GHz, and is well suited for measuring small disturbances in the skin surface caused by arterial pulses.
And S6, automatically listing shift information to be reported by the display interface, selecting by a driver, finishing reporting the shift, and ending the reporting process.
And S7, displaying that the verification is not passed and the reporting of the shift is not allowed by the display interface, and describing specific items which are not passed by the verification to a driver by voice to finish the reporting of the shift.
As shown in fig. 2, the driver self-help reporting device comprises a detection table 1, a near infrared detection probe 2, a millimeter wave radar 3, a display screen 4, a conventional camera 5 and an infrared camera 6, wherein the near infrared detection probe 2 and the millimeter wave radar 3 are arranged right above the detection table 1, an electroencephalogram processing module, a central processing unit and a memory are further arranged in the driver self-help reporting device, face information for identification, a computer program and data required by device operation are stored in the memory, and the central processing unit can realize the driver self-help reporting method by running the computer program.
Compared with the prior art, the invention has the following beneficial effects:
and detecting drunk conditions, fatigue degree, attention state and physical sign conditions of the driver, comprehensively judging whether the driver is suitable for driving, and fundamentally ensuring the driving safety.
The foregoing description of the preferred embodiments of the present invention should not be construed as limiting the scope of the invention. It should be noted that equivalent changes to the solution of the present invention without departing from the design structure and principle of the present invention are considered as the protection scope of the present invention for those skilled in the art.

Claims (10)

1. The driver self-service reporting method based on face recognition is characterized by comprising the following steps of:
s1, a driver looks forward at a conventional camera and an infrared camera, hands are placed on a detection table, face images of the driver are collected through the conventional camera, identification verification is carried out on the extracted face images based on pre-stored face information, if the verification is passed, S2 is carried out, and otherwise S7 is carried out;
s2, judging whether a driver is in a drunk state, if so, entering S7, otherwise, entering S3;
s3, judging whether a driver is in a fatigue state, if so, entering S4, otherwise, entering S5;
s4, prompting the driver to wear the brain wave data acquisition device, judging whether the attention of the driver meets the requirement based on the brain wave data, if so, entering S5, otherwise, entering S7;
s5, detecting sign data of a driver, entering S6 if the sign data are in a normal range, otherwise entering S7;
s6, automatically listing shift information to be reported by a display interface, selecting by a driver, finishing reporting the shift, and ending the reporting flow;
and S7, displaying that the verification is not passed by the display interface, not allowing reporting of the shifts, and ending the shift reporting process.
2. The self-help reporting method for drivers according to claim 1, wherein in S2, the near infrared detection probe arranged above the detection table is used for receiving hand light of the driver, the spectral information is collected for alcohol content of the driver, the spectral analysis element is used for analyzing the collected spectral information to calculate alcohol content of the human body, if the alcohol content is greater than a first threshold value, the driver is considered to be in a drunk state, if the alcohol content is less than or equal to the first threshold value but greater than a second threshold value, the infrared camera is used for shooting infrared images of the human face, whether the driver is in a drunk state is judged according to the infrared images, and if the alcohol content is less than or equal to the second threshold value, the driver is considered not to be in a drunk state.
3. The self-help reporting method for drivers according to claim 2, wherein in S2, the step of judging whether the driver is in a drunk state according to the infrared image specifically includes obtaining the temperature of the nose part and the temperature of the forehead part through infrared image identification, calculating a difference value between the nose part and the forehead part, and if the difference value is greater than a temperature difference threshold value, determining that the driver is in the drunk state, otherwise, determining that the driver is not in the drunk state.
4. The self-help reporting method for drivers according to claim 1, wherein in S3, face images of a plurality of drivers are collected through a conventional camera, the range of eyes is determined based on characteristic points of the eyes, the blood silk ratio of each face image is determined according to the ratio of the area of red pixel points in the range of eyes to the area of eyes, the average value of the blood silk ratios of the face images is calculated as the eye blood silk ratio, if the eye blood silk ratio is larger than a fatigue threshold, the driver is determined to be in a fatigue state, otherwise, the driver is determined not to be in a fatigue state.
5. The self-help shift reporting method for drivers according to claim 1, wherein in S4, α, β, θ bands in brain waves are transmitted to the brain wave processing module, the brain wave processing module analyzes and calculates a ratio of β wave intensity to a sum of α, β, θ wave intensity, and when the calculated ratio is greater than an attention threshold, it is determined that the attention of the driver is at a normal level, and S5 is entered, otherwise S7 is entered.
6. The self-help shift reporting method of claim 5, wherein in S4, the brain wave data acquisition device uses a TGAM brain wave module of a mind technology, and the brain wave data acquisition device is connected with the brain wave processing module through bluetooth.
7. The self-help reporting method for drivers as set forth in claim 1, wherein in S5, the micro-disturbance of the hand skin surface caused by the arterial pulse is measured by the millimeter wave radar disposed above the detection table, the radar signal is processed by calculation to obtain heart rate and blood pressure data, if the heart rate and blood pressure data are in the normal range, the method goes to S6, otherwise, the method goes to S7.
8. The self-service shift reporting method for drivers as in claim 7, wherein in S5, the millimeter wave radar is an XENSIV radar chip of inflight.
9. The self-service shift reporting method for drivers according to claim 1, wherein in S7, the specific item which is not verified is described to the driver through voice.
10. The driver self-help reporting device based on face recognition is characterized by comprising a detection table, a near infrared detection probe, a millimeter wave radar, a display screen, a conventional camera, an infrared camera, an electroencephalogram processing module, a central processing unit and a memory, wherein the near infrared detection probe and the millimeter wave radar are arranged right above the detection table, and the electroencephalogram processing module, the central processing unit and the memory are arranged inside the driver self-help reporting device;
the memory stores face information for identification, a computer program and data required by device operation, and the central processing unit can realize the driver self-help reporting method according to any one of claims 1-9 by operating the computer program.
CN202310937831.0A 2023-07-28 2023-07-28 Face recognition-based driver self-service reporting method and device Pending CN116665334A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310937831.0A CN116665334A (en) 2023-07-28 2023-07-28 Face recognition-based driver self-service reporting method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310937831.0A CN116665334A (en) 2023-07-28 2023-07-28 Face recognition-based driver self-service reporting method and device

Publications (1)

Publication Number Publication Date
CN116665334A true CN116665334A (en) 2023-08-29

Family

ID=87717455

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310937831.0A Pending CN116665334A (en) 2023-07-28 2023-07-28 Face recognition-based driver self-service reporting method and device

Country Status (1)

Country Link
CN (1) CN116665334A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105718033A (en) * 2014-12-04 2016-06-29 富泰华工业（深圳）有限公司 Fatigue detection system and method
CN208864304U (en) * 2018-06-01 2019-05-17 上海燕理信息科技有限公司 A kind of health examination instrument
KR102088590B1 (en) * 2019-01-24 2020-04-23 예관희 Safety driving system having drunken driving preventing function
CN111476918A (en) * 2020-05-22 2020-07-31 集时通（福建）信息科技有限公司 Self-service class reporting system, method and storage medium
CN112258790A (en) * 2020-10-26 2021-01-22 上海工程技术大学 Rail transit train driver on-duty fatigue level and body state detection system
CN212808138U (en) * 2020-06-04 2021-03-26 上海工程技术大学 Device for testing driving state of subway driver before going on duty
CN113420961A (en) * 2021-05-31 2021-09-21 湖南森鹰智造科技有限公司 Railway locomotive driving safety auxiliary system based on intelligent sensing

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105718033A (en) * 2014-12-04 2016-06-29 富泰华工业（深圳）有限公司 Fatigue detection system and method
CN208864304U (en) * 2018-06-01 2019-05-17 上海燕理信息科技有限公司 A kind of health examination instrument
KR102088590B1 (en) * 2019-01-24 2020-04-23 예관희 Safety driving system having drunken driving preventing function
CN111476918A (en) * 2020-05-22 2020-07-31 集时通（福建）信息科技有限公司 Self-service class reporting system, method and storage medium
CN212808138U (en) * 2020-06-04 2021-03-26 上海工程技术大学 Device for testing driving state of subway driver before going on duty
CN112258790A (en) * 2020-10-26 2021-01-22 上海工程技术大学 Rail transit train driver on-duty fatigue level and body state detection system
CN113420961A (en) * 2021-05-31 2021-09-21 湖南森鹰智造科技有限公司 Railway locomotive driving safety auxiliary system based on intelligent sensing

Similar Documents

Publication Publication Date Title
US10022082B2 (en) Apparatus and method for detecting a state of a driver based on biometric signals of the driver
CN101593425B (en) Machine vision based fatigue driving monitoring method and system
CN104809445B (en) method for detecting fatigue driving based on eye and mouth state
US6854879B2 (en) System and method using thermal image analysis for polygraph testing
US7111980B2 (en) System and method using thermal image analysis and slope threshold classification for polygraph testing
CN101375796B (en) Real-time detection system of fatigue driving
US20110144522A1 (en) Single Trial Detection in Encephalography
KR102322029B1 (en) Method and Apparatus for acquiring a biometric information
US20040234103A1 (en) Method and apparatus for detection of drowsiness and quantitative control of biological processes
CN110958568B (en) WiFi-based ship cab personnel on-duty behavior identification method and system
Tang et al. Real-time image-based driver fatigue detection and monitoring system for monitoring driver vigilance
US20200352504A1 (en) Image Drunken Driving Judgment System and Related Method
CN116665334A (en) Face recognition-based driver self-service reporting method and device
US20240138692A1 (en) Method and system for heart rate extraction from rgb images
CN107145835B (en) Driver load detection vehicle-mounted device based on image recognition
US20190133526A1 (en) Wearable apparatus and method of controlling the same
Koukiou et al. Drunk person identification using local difference patterns
JPH09294729A (en) Drinking monitoring device
El Boussaki et al. Video-based Heart Rate Estimation using Embedded Architectures
Joshi et al. Eye state and head position technique for driver drowsiness detection
Dkhil et al. Towards a new system for drowsiness detection based on eye blinking and head posture estimation
Alioua et al. Fast MicroSleep and Yawning Detections to Assess Driver’s Vigilance Level
Rundo et al. Visual Saliency Detection in Advanced Driver Assistance Systems
Min-Gu et al. A Study on User Recognition Using 2D ECG Image Based on Ensemble Networks for Intelligent Vehicles
Kashihara Automatic discrimination of attention levels estimated by frontal EEG activity in drivers

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination