CN112000227A - Working state monitoring feedback system - Google Patents
Working state monitoring feedback system Download PDFInfo
- Publication number
- CN112000227A CN112000227A CN202010895044.0A CN202010895044A CN112000227A CN 112000227 A CN112000227 A CN 112000227A CN 202010895044 A CN202010895044 A CN 202010895044A CN 112000227 A CN112000227 A CN 112000227A
- Authority
- CN
- China
- Prior art keywords
- module
- fatigue
- tracking
- worker
- working
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 37
- 238000012545 processing Methods 0.000 claims abstract description 22
- 238000012795 verification Methods 0.000 claims abstract description 8
- 210000001747 pupil Anatomy 0.000 claims description 29
- 210000001508 eye Anatomy 0.000 claims description 28
- 238000001514 detection method Methods 0.000 claims description 26
- 230000004424 eye movement Effects 0.000 claims description 11
- 239000013598 vector Substances 0.000 claims description 10
- 230000008859 change Effects 0.000 claims description 5
- 210000005252 bulbus oculi Anatomy 0.000 claims description 4
- 238000007405 data analysis Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000000034 method Methods 0.000 description 5
- 230000004397 blinking Effects 0.000 description 4
- 230000002452 interceptive effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 210000004087 cornea Anatomy 0.000 description 3
- 238000007689 inspection Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 210000003786 sclera Anatomy 0.000 description 3
- 208000003464 asthenopia Diseases 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000010030 laminating Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 229910002804 graphite Inorganic materials 0.000 description 1
- 239000010439 graphite Substances 0.000 description 1
- -1 graphite alkene Chemical class 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/197—Matching; Classification
Abstract
The invention provides a working state monitoring feedback system, comprising: the front-end equipment comprises one or more display screens, a frame and a monitoring feedback module group, wherein the frame comprises hollow structures corresponding to the number of the display screens, and each display screen is fixedly arranged in a frame formed by the hollow structures; the monitoring feedback module group comprises an image acquisition module, a sight line tracking module and an identity recognition module; according to the invention, by tracking the sight of the working personnel during working and carrying out identity verification by combining with the collected identity verification information, the working state of the working personnel can be effectively detected and monitored and fed back, the working state of the working personnel is completely and comprehensively recorded, a data base is provided for subsequent analysis and processing, the working state rule of each working personnel can be conveniently counted on the basis, the working state of the working personnel is further pertinently improved, and meanwhile, the safety of important work is effectively ensured.
Description
Technical Field
The invention relates to the field of electronics, in particular to a working state monitoring feedback system.
Background
In real life, the result of things commonly used by people is used as a standard for measuring the occurrence quality of things, such as measuring the mastery degree of knowledge of students by using examination results, measuring the performance of employees by using production capacity, and the like. Indeed, this measure is straightforward, but the effect is not optimal. The things can generate a lot of process information in the process of happening, the information records the action relationship of people, things and environment in the things, the information is the most comprehensive and complete evidence chain for explaining the result of the things, and the information is also the important basis for improving the happening quality of the things. Therefore, it is very necessary to monitor the status of people, objects and environment during the occurrence process of things. For monitoring work, for example, X-ray image security inspection work in an environment such as an airport, attention during monitoring may be reduced due to fatigue, interference, and other factors, and in this case, it is particularly important for monitoring feedback of the working state.
However, currently, there are few professional technical means to effectively detect the working state of the staff, and a new intelligent software and hardware combination for recording, analyzing, converting and displaying the interaction information between the subject and the object is needed to solve the above problems.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, the present invention provides an operation status monitoring feedback system to solve the above-mentioned technical problems.
The working state monitoring feedback system provided by the invention comprises: the front-end equipment comprises a display screen, a frame and a monitoring feedback module group,
the frame comprises a plurality of display screens, the number of the display screens is one or more, the frame comprises hollow structures corresponding to the number of the display screens, and each display screen is fixedly arranged in a frame formed by the hollow structures;
the monitoring feedback module group comprises
The image acquisition module is used for acquiring image information;
the sight tracking module is used for tracking the sight of the staff;
and the identity recognition module is used for carrying out identity recognition on the working personnel.
Optionally, the frame is a flexible frame, a plurality of display screens can be connected in the vertical direction or the horizontal direction through the flexible frame, and the included angle formed between the display screens is adjustable.
Optionally, the monitoring feedback module group further includes a processing module, and the eye tracking module acquires an eye movement vector according to the collected eye image, generates a tracking result according to the eye movement vector, and transmits the tracking result to the processing module.
Optionally, when the worker passes the verification and starts to work, the processing module initializes, where the initialization includes initialization acquired by the image acquisition module and initialization of the state of the worker, determines an initialized fatigue parameter of the current worker according to image information acquired after the initialization, and obtains a variation of the fatigue parameter by comparing the fatigue parameter detected in real time with the initialized fatigue parameter.
Optionally, the monitoring feedback module group further comprises a fatigue detection module, the fatigue detection module judges the fatigue state of the staff according to the variation of the fatigue parameters, and the fatigue parameters comprise blinking frequency, eye opening size, pupil size, face pitch angle and mouth opening and closing type.
Optionally, the fatigue detection module is provided with a blink frequency threshold,
when the collected blink frequency of the worker does not reach a preset blink frequency threshold value, the fatigue detection module judges that the worker is not in a fatigue state and continues to detect the blink frequency;
when the collected blink frequency of the staff reaches a preset blink frequency threshold value, the fatigue detection module carries out fatigue detection on the staff and judges the fatigue state of the staff.
Optionally, the fatigue detection module comprehensively determines the fatigue state of the staff by detecting the pupil size and the eye opening size corresponding to the staff, and the offset of the face pitch angle and the change of the mouth opening and closing type.
Optionally, the identity information of each worker, the working content of the worker corresponding to the identity information, and the corresponding fatigue state are recorded according to the recognition result of the identity recognition module, and the state of the worker is predicted according to the historical data of sight tracking and fatigue detection.
Optionally, the monitoring feedback module group further includes a tracking control module for selecting a tracking mode according to the tracking parameter control of the collected staff, the tracking mode includes bright pupil tracking and dark pupil tracking, the tracking parameter includes a person parameter and an environmental parameter, the task parameter at least includes the age and the race information of the staff, and the environmental parameter at least includes an external environment light parameter.
Optionally, the gaze tracking module includes a three-dimensional eyeball model, and is configured to obtain the eye movement vector according to positions of a pupil and a corneal reflection point, and further obtain a position of the eye in space and a gaze position.
The invention has the beneficial effects that: the working state monitoring and feedback system can track the sight of the working personnel during working and carry out identity verification by combining with the collected identity verification information, can effectively detect the working state of the working personnel and carry out monitoring and feedback.
Drawings
Fig. 1 is a schematic structural diagram of a display screen of an operating condition monitoring and feedback system according to an embodiment of the present invention.
Fig. 2 is a schematic side view of an operation status monitoring and feedback system according to an embodiment of the present invention.
Fig. 3(a) is a schematic structural diagram of two vertical display screens of the operation state monitoring feedback system in the embodiment of the present invention.
Fig. 3(b) is a schematic structural diagram of two vertical display screens of the operation state monitoring feedback system in the embodiment of the present invention.
Fig. 3(c) is a schematic structural diagram of four display screens of the operation status monitoring feedback system in the embodiment of the present invention.
Fig. 4 is a schematic flow chart of the operation status monitoring feedback system in the embodiment of the present invention.
Description of reference numerals:
1-display screen
2-frame
3-image acquisition module
4-treatment module
5-fixed angle clamp
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
In the following description, numerous details are set forth to provide a more thorough explanation of embodiments of the present invention, however, it will be apparent to one skilled in the art that embodiments of the present invention may be practiced without these specific details, and in other embodiments, well-known structures and devices are shown in block diagram form, rather than in detail, in order to avoid obscuring embodiments of the present invention.
As shown in fig. 1, the working condition monitoring and feedback system in this embodiment includes:
the front-end equipment comprises a display screen 1, a frame 2 and a monitoring feedback module group,
the display screen 1 is one or more, the frame 2 comprises hollow structures corresponding to the number of the display screens 1, and each display screen 1 is fixedly arranged in a frame formed by the hollow structures;
the monitoring feedback module group comprises
The image acquisition module 3 is used for acquiring image information;
the sight tracking module is used for tracking the sight of the staff;
and the identity recognition module is used for carrying out identity recognition on the working personnel.
In this embodiment, the frame is a flexible frame, the plurality of display screens can be connected in the vertical direction or the horizontal direction through the flexible frame, and an included angle formed between the display screens is adjustable, optionally, the display screen 1 adopts a flexible screen which can be used as a touch control end, as shown in fig. 3(a) (b) (c), the plurality of flexible screens ( objects 1, 2, 3, 4) can be well seamlessly attached through the flexible frame. For example, under the airport X-ray machine security check environment, because the X-ray machine equipment of two visual angles is mostly adopted in present airport, under the scene that the security inspector carries out the X-ray image inspection, the combination condition of object may be two computer screens of vertical from top to bottom or two computer screens of horizontal about or, and two screens may have certain contained angle, through flexible touch-control end and flexible frame can be fine carry out seamless laminating between a plurality of display screens, and image acquisition module can carry out the initialization of collection state to the equipment after the laminating, guarantee that the different contained angles of screen do not influence the sight tracking of equipment to the main part and the contact information acquisition of touch-control end.
In this embodiment, the image acquisition module 3 may provide front-end image acquisition, which provides a data base for functions such as subsequent multi-modal identity authentication, subject line tracking, fatigue state detection of workers, and state alarm prompting, and may satisfy face and eye image acquisition through the image acquisition module, and may adopt a visible light camera, a near-infrared camera, and the like according to different acquisition requirements, and of course, may also adopt a gun camera, a ball camera, a miniature camera, a button camera, and the like according to different application scenarios, and may set different numbers of acquisition terminals according to different light source configurations and tracking requirements of the line tracking module. Optionally, filtering and conversion processing is further performed after image acquisition so as to effectively remove interference of ambient light on features of the face and the eyes, and the processed image is transmitted to the identity recognition module, the sight tracking module and the fatigue detection module.
In this embodiment, the monitoring feedback module group further includes a processing module 3, and the gaze tracking module acquires an eye movement vector according to the acquired eye image, generates a tracking result according to the eye movement vector, and transmits the result to the processing module. The eye movement condition of the worker is tracked in real time through the sight tracking module, the attention position, the attention duration and the attention sequence of the work content of the eyes of the worker are detected and compared with the pre-stored attention data, the attention deviation degree of the worker is evaluated, for example, when the deviation reaches a certain threshold value, the content with insufficient attention is intelligently prompted, the worker is guided to pay attention, and the prompting content is displayed on a screen of a touch terminal. Preferably, the alarm prompt can also be given to the condition that the staff watches the screen for a long time or is in a fatigue state. All the process data can be stored for subsequent data analysis, and after the data analysis, a data analysis report of the work of the worker can be output and displayed on a screen of the touch terminal when the worker finishes the work. The eye tracking module can analyze the characteristics of the collected eye images, determine the positions of pupils and corneal reflection points in the images, calculate the vectors of eye movements according to the angles of the pupils and the corneal reflection points, accurately calculate the positions of the eyes in the space and the positions of the sight lines by combining a built-in three-dimensional eyeball model, display the positions on the corresponding positions of a screen, and transmit position data to the processing module in real time.
In this embodiment, the gaze tracking module may switch between different light source configurations according to different factors such as the age, the race, and the external light environment of the staff to complete the pupil-corneal reflection tracking, and the selectable tracking modes include bright pupil tracking, dark pupil tracking, and bright/dark pupil dual-mode tracking. The tracking mode switching function enables the sight tracking module to always keep the highest accuracy for tracking.
In this embodiment, the fatigue detection module judges the fatigue state of the staff according to the fatigue parameters acquired from the acquired image, wherein the fatigue parameters include blinking frequency, eye opening size, pupil size, face pitch angle and mouth opening and closing type. In the embodiment, the fatigue detection module is provided with a blink frequency threshold value, and when the collected blink frequency of the worker does not reach the preset blink frequency threshold value, the fatigue detection module judges that the worker is not in a fatigue state and continues to detect the blink frequency; when the blink frequency of the collected staff reaches a preset blink frequency threshold value, the fatigue detection module carries out fatigue detection on the staff and judges the fatigue state of the staff. The blinking frequency, eye opening size, and pupil size in this embodiment are effective measures of visual fatigue. When the worker passes the verification and starts working, the processing module firstly initializes, the initialization comprises initialization acquired by the image acquisition module and initialization of the state of the worker, the initialization fatigue parameter of the current worker is determined according to the image information acquired after the initialization, and the fatigue parameter detected in real time is compared with the initialization fatigue parameter to obtain the variation of the fatigue parameter. Through the initialization of the image acquisition module, the condition that different included angles of the screen do not affect the sight tracking of the device on the main body and the contact information acquisition of the touch control end can be ensured. Initializing the state of a worker, determining the initialized fatigue parameter of the current worker according to the image information acquired after initialization, and comparing the fatigue parameter detected in real time with the initialized fatigue parameter to obtain the variation of the fatigue parameter. And then according to the determined initial blinking frequency, pupil and eye size, human face pitch angle and mouth opening and closing type. After initialization is completed, the opening and closing times of eyes are counted, whether the blink frequency reaches a certain threshold range or not is judged, if yes, the main body is possibly in a fatigue state, the size of the corresponding pupil and the size of the opened eyes are detected, the deviation of the face pitch angle and the change of the opening and closing type of the mouth are detected and analyzed, and the fatigue state of the main body is comprehensively judged.
In this embodiment, the identity recognition module includes a face recognition unit, an iris recognition unit, a sclera recognition unit, a fingerprint recognition unit and a voiceprint recognition unit, and through various identity recognition modes, prompt information can be sent out when the identity of a worker changes. In order to scientifically control the working condition of workers and intelligently guide the working mode, the positions, the attention duration and the attention sequence of the concerned contents of the target picture book can be pre-recorded in advance, and the recorded contents are stored. When a worker watches a target, the identity of the worker is firstly confirmed through identity verification modes such as a face recognition unit, an iris recognition unit, a sclera recognition unit, a fingerprint recognition unit and a voice-print recognition unit, historical working data of the worker can be loaded into a system memory after confirmation, and during working, if the identity of the worker is detected to be changed, the system gives an alarm prompt.
For example, for a security inspector of an airport X-ray machine, the identity of the security inspector can be checked through the identity recognition module, and the security inspector is guaranteed to be on duty according to the standard; the method comprises the following steps of (1) displaying, tracking and recording the position and the stay time of a security inspector observing an X-ray image in real time through a sight tracking module; the working state of a security inspector is detected in real time, fatigue is prompted and an alarm is given through a fatigue detection module, so that the security inspector is prevented from missing inspection due to fatigue; the time that the safety inspector is likely to be fatigued can be predicted through the data processing module according to the historical fatigue data of the safety inspector, early warning prompts can be given in advance, and weak points of image judgment which are likely to exist in the safety inspector can be analyzed and predicted and prompts of X-ray image key image judgment areas can be given according to the historical image judgment data of the safety inspector and the intelligent image judgment model trained by the intelligent interaction module. The intelligent image judging model can be generated by recording and storing image judging data of the security inspectors with abundant image judging experience and carrying out deep learning training on the data, so that the primary security inspectors can be assisted to accurately finish image judging work.
In this embodiment, the gaze tracking unit may determine positions of pupil and cornea reflection points in an image, calculate a vector of eye movement through angles of the pupil and cornea reflection points, accurately calculate a position of an eye in space and a gaze position by combining a built-in three-dimensional eyeball model, display the position and the gaze position on a screen, transmit position data to a background in real time, perform data analysis, and the background may switch to use different light source configurations to complete pupil and cornea reflection tracking according to different factors such as age, race, external light environment, and the like of a worker, where selectable tracking modes include bright pupil tracking, dark pupil tracking, and bright pupil/dark pupil dual-mode tracking.
In this embodiment, because the blink frequency, the eye opening size and the pupil size are effective measurement criteria for visual fatigue, the processing module may count the blink frequency and the eye opening and closing times, compare the pupil size, the blink frequency and the eye opening degree acquired by the gaze tracking module with preset threshold values respectively, to determine whether the blink frequency reaches a certain threshold range, and if the blink frequency reaches the threshold value, it indicates that the worker may be in a fatigue state, and then detect the corresponding pupil size and the eye opening size, preferably, the shift of the face pitch angle and the change of the mouth opening and closing type may be detected and analyzed, and the fatigue state of the worker is comprehensively determined, as shown in fig. 4.
In this embodiment, the identity module may include: the device comprises a face recognition unit, an iris recognition unit, a sclera recognition unit, a fingerprint recognition unit and a voiceprint recognition unit. The identity recognition module compares various biological characteristics of the main body with the current characteristic library stored in the module to realize reliable identity authentication, and transmits a processing result to the processing module to provide data and decision support for data analysis and screen control, thereby realizing intelligent personnel management and alarm prompt.
In this embodiment, the identity information of each worker, the work content of the worker corresponding to the identity information, and the corresponding fatigue state may be recorded according to the recognition result of the identity recognition module, and the state of the worker may be predicted according to the historical data of the gaze tracking and the fatigue detection. Existing sight tracking and fatigue detection historical data in the system are retrieved through the identity recognition data, the state of the main body is predicted by combining newly input related data, and corresponding instructions can be output to the intelligent interaction module at any time. Optionally, interactive data between the subject and the object can be recorded in real time, deep learning training is performed on the data to obtain an interactive relationship model between the subject and the object, and prediction and prompt of subject interactive behaviors for the similar object are achieved through the trained interactive relationship model.
As shown in fig. 2, in this embodiment, optionally, the frame 2 is provided with a fixing corner clip 5 for attaching a paper document, the fixing corner clip 5 may be one or more, and in this embodiment, the paper document is attached by the fixing corner clips disposed at four corners of the frame. Display screen 1 is flexible display screen, and frame 2 is flexible frame, and is optional, and display screen 1 also can regard as the touch-control end, and display screen 1 is the flexible screen that can bend at will, like graphite alkene flexible screen etc. the screen is transparent, sees through the clear visible of screen object, and the screen passes through interface module and links to each other with processing module. The flexible frame is a hollow structure made of materials capable of being bent and shaped at will and can be used for placing connecting lines of the acquisition end, the touch end and the processing end.
In this embodiment, the Processing module 4 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component. Optionally, the processing module in this embodiment adopts a Micro Controller Unit (MCU), which is mainly responsible for processing all the calculation tasks in this embodiment.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (10)
1. An operating condition monitoring feedback system, comprising: the front-end equipment comprises a display screen, a frame and a monitoring feedback module group,
the frame comprises a plurality of display screens, the number of the display screens is one or more, the frame comprises hollow structures corresponding to the number of the display screens, and each display screen is fixedly arranged in a frame formed by the hollow structures;
the monitoring feedback module group comprises
The image acquisition module is used for acquiring image information;
the sight tracking module is used for tracking the sight of the staff;
and the identity recognition module is used for carrying out identity recognition on the working personnel.
2. The system according to claim 1, wherein the frame is a flexible frame, a plurality of display screens can be connected in a vertical direction or a horizontal direction through the flexible frame, and an included angle formed between the display screens is adjustable.
3. The system of claim 1, wherein the set of modules further comprises a processing module, and the eye tracking module obtains an eye movement vector according to the collected eye image, generates a tracking result according to the eye movement vector, and transmits the tracking result to the processing module.
4. The working state monitoring and feedback system according to claim 2, wherein the processing module initializes when the worker passes the verification and starts working, the initialization includes initialization acquired by the image acquisition module and initialization of the state of the worker, determines an initialized fatigue parameter of the current worker according to the image information acquired after the initialization, and obtains a variation of the fatigue parameter by comparing the fatigue parameter detected in real time with the initialized fatigue parameter.
5. The system of claim 4, wherein the monitoring and feedback module set further comprises a fatigue detection module, and the fatigue detection module determines the fatigue state of the worker according to the variation of the fatigue parameters, wherein the fatigue parameters include blink frequency, eye opening size, pupil size, face pitch angle and mouth opening and closing type.
6. The health monitoring feedback system of claim 5, wherein the fatigue detection module is provided with a blink frequency threshold,
when the collected blink frequency of the worker does not reach a preset blink frequency threshold value, the fatigue detection module judges that the worker is not in a fatigue state and continues to detect the blink frequency;
when the collected blink frequency of the staff reaches a preset blink frequency threshold value, the fatigue detection module carries out fatigue detection on the staff and judges the fatigue state of the staff.
7. The working state monitoring and feedback system according to claim 6, wherein the fatigue detection module comprehensively determines the fatigue state of the staff by detecting the pupil size and the eye opening size corresponding to the staff, and the deviation of the face pitch angle and the change of the mouth opening and closing type.
8. The working state monitoring and feedback system according to claim 7, wherein the identity information of each worker, the working content of the worker corresponding to the identity information and the corresponding fatigue state are recorded according to the identification result of the identity identification module, and the state of the worker is predicted according to the historical data of sight line tracking and fatigue detection.
9. The system according to claim 1, wherein the monitoring and feedback module further comprises a tracking control module for controlling and selecting a tracking mode according to the collected tracking parameters of the staff, the tracking mode comprises bright pupil tracking and dark pupil tracking, the tracking parameters comprise human parameters and environment parameters, the task parameters at least comprise the age and race information of the staff, and the environment parameters at least comprise external environment light parameters.
10. The system according to claim 1, wherein the eye tracking module comprises a three-dimensional eyeball model for obtaining the eye movement vector according to the positions of the pupil and the corneal reflection point, and further obtaining the position of the eye in space and the position of the line of sight.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010895044.0A CN112000227A (en) | 2020-08-31 | 2020-08-31 | Working state monitoring feedback system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010895044.0A CN112000227A (en) | 2020-08-31 | 2020-08-31 | Working state monitoring feedback system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112000227A true CN112000227A (en) | 2020-11-27 |
Family
ID=73465564
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010895044.0A Pending CN112000227A (en) | 2020-08-31 | 2020-08-31 | Working state monitoring feedback system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112000227A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113280737A (en) * | 2021-05-14 | 2021-08-20 | 惠州中京电子科技有限公司 | Blind hole offset detection method for high-order HDI printed circuit board |
| CN114167947A (en) * | 2021-11-26 | 2022-03-11 | 深圳市思坦科技有限公司 | Eye protection device and method, blue light display device and storage medium |
| CN116189101A (en) * | 2023-04-28 | 2023-05-30 | 公安部第一研究所 | Method and system for identifying, judging and guiding visual operation specification of security inspector |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103714431A (en) * | 2013-12-26 | 2014-04-09 | 苏州清研微视电子科技有限公司 | Airport people identity authentication management system based on face recognition |
| CN105825631A (en) * | 2016-04-26 | 2016-08-03 | 成都远控科技有限公司 | Video intelligent algorithm-based fatigue detection method and system |
| CN107229922A (en) * | 2017-06-12 | 2017-10-03 | 西南科技大学 | A kind of fatigue driving monitoring method and device |
| CN108108684A (en) * | 2017-12-15 | 2018-06-01 | 杭州电子科技大学 | A kind of attention detection method for merging line-of-sight detection |
| CN207589060U (en) * | 2017-05-08 | 2018-07-06 | 上海大学 | A kind of naked-eye stereoscopic display device of combination visual fatigue detection |
| CN109634431A (en) * | 2019-01-22 | 2019-04-16 | 像航（上海）科技有限公司 | No medium floating projects visual pursuit interaction systems |
| CN110728922A (en) * | 2019-11-13 | 2020-01-24 | 湖南新亚胜光电股份有限公司 | Adjustable display screen, splicing type display device and radian adjusting method |
-
2020
- 2020-08-31 CN CN202010895044.0A patent/CN112000227A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103714431A (en) * | 2013-12-26 | 2014-04-09 | 苏州清研微视电子科技有限公司 | Airport people identity authentication management system based on face recognition |
| CN105825631A (en) * | 2016-04-26 | 2016-08-03 | 成都远控科技有限公司 | Video intelligent algorithm-based fatigue detection method and system |
| CN207589060U (en) * | 2017-05-08 | 2018-07-06 | 上海大学 | A kind of naked-eye stereoscopic display device of combination visual fatigue detection |
| CN107229922A (en) * | 2017-06-12 | 2017-10-03 | 西南科技大学 | A kind of fatigue driving monitoring method and device |
| CN108108684A (en) * | 2017-12-15 | 2018-06-01 | 杭州电子科技大学 | A kind of attention detection method for merging line-of-sight detection |
| CN109634431A (en) * | 2019-01-22 | 2019-04-16 | 像航（上海）科技有限公司 | No medium floating projects visual pursuit interaction systems |
| CN110728922A (en) * | 2019-11-13 | 2020-01-24 | 湖南新亚胜光电股份有限公司 | Adjustable display screen, splicing type display device and radian adjusting method |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113280737A (en) * | 2021-05-14 | 2021-08-20 | 惠州中京电子科技有限公司 | Blind hole offset detection method for high-order HDI printed circuit board |
| CN113280737B (en) * | 2021-05-14 | 2023-08-29 | 惠州中京电子科技有限公司 | Blind hole offset detection method for high-order HDI printed circuit board |
| CN114167947A (en) * | 2021-11-26 | 2022-03-11 | 深圳市思坦科技有限公司 | Eye protection device and method, blue light display device and storage medium |
| CN116189101A (en) * | 2023-04-28 | 2023-05-30 | 公安部第一研究所 | Method and system for identifying, judging and guiding visual operation specification of security inspector |
| CN116189101B (en) * | 2023-04-28 | 2023-08-04 | 公安部第一研究所 | Method and system for identifying, judging and guiding visual operation specification of security inspector |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112000227A (en) | Working state monitoring feedback system | |
| KR101898414B1 (en) | A 3-dimensional measurement method for eye movement and fully automated deep-learning based system for vertigo diagnosis | |
| US11087127B2 (en) | Method and system to control a workflow and method and system for providing a set of task-specific control parameters | |
| US9566004B1 (en) | Apparatus, method and system for measuring repetitive motion activity | |
| US20200073476A1 (en) | Systems and methods for determining defects in visual field of a user | |
| CN106343977B (en) | Unmanned plane operator's condition monitoring system based on Multi-sensor Fusion | |
| KR102155309B1 (en) | Method for predicting cognitive impairment, server, user device and application implementing the method | |
| CN111857355A (en) | Reading state monitoring feedback system | |
| US11928632B2 (en) | Ocular system for deception detection | |
| CA2579063A1 (en) | System and method for mental workload measurement based on rapid eye movement | |
| CN112957042B (en) | Non-contact target emotion recognition method and system | |
| CN110353622A (en) | A kind of vision testing method and eyesight testing apparatus | |
| KR101646720B1 (en) | Human factors analysis and evaluation system for nuclear power plant | |
| KR20160076488A (en) | Apparatus and method of measuring the probability of muscular skeletal disease | |
| JP7099377B2 (en) | Information processing equipment and information processing method | |
| US20210236023A1 (en) | TECHNOLOGY ADAPTED TO ENABLE IMPROVED COLLECTION OF INVOLUNTARY EYELlD MOVEMENT PARAMETERS, INCLUDING COLLECTION OF EYELlD MOVEMENT PARAMETERS TO SUPPORT ANALYSIS OF NEUROLOGICAL FACTORS | |
| CN113317792A (en) | Attention detection system and method based on binocular eye vector analysis | |
| CN113569671A (en) | Abnormal behavior alarm method and device | |
| Endo et al. | Initial response time measurement in eye movement for dementia screening test | |
| CN114399752A (en) | Eye movement multi-feature fusion fatigue detection system and method based on micro eye jump characteristics | |
| CN212433722U (en) | Children reading state monitoring facilities | |
| Agarwal et al. | Facial Gestures-Based Recommender System for Evaluating Online Classes | |
| CN110135744A (en) | Construction worker's safety behavior is accustomed to evaluation method | |
| CN113457110B (en) | Counting method, system and device in intelligent playground | |
| Murawski et al. | The contactless active optical sensor for vehicle driver fatigue detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201127 |