TWM606154U - System for warning regarding fatigue of a laborer - Google Patents

Abstract

A system for warning regarding fatigue of a laborer is provided, wherein the system includes an electronic device, a wearable device, an environment monitoring device and a backend processor. The electronic device executes a questionnaire module application program to generate a questionnaire collection result regarding subjective judgment of the laborer for fatigue level. The wearable device detects physiological features of the laborer to generate physiological information of the laborer. The environment monitoring device monitors environmental real-time information of at least one environmental factor in a workplace. The backend processor analyzes the above information to generate an analysis result, wherein the analysis result is configured to check or warn the risk of labor fatigue.

Description

A system for early warning of a worker’s fatigue

This creation is about the inspection or early warning of fatigue driving, especially a system for early warning of a worker’s fatigue status.

In the mass transportation industry, it is very common for drivers to take alcohol tests before driving. On the other hand, in addition to drunk driving, fatigue driving is also one of the potential risks when using transportation vehicles. In recent years, public transportation accidents, driving safety, and overwork have gradually attracted social attention. As the causes of overwork are quite complex, such as working environment factors, driver's mental state, and the driver's long-term working hours may affect the driver's fatigue, so the driver's fatigue status is difficult to carry out through existing devices or methods Appropriate evaluation.

Therefore, there is a need for a self-fatigue inspection tool for drivers of transportation vehicles, so that in addition to testing the alcohol level before driving, the driver can also perform pre-testing for fatigue risk, thereby reducing the occurrence of traffic accidents and expecting Be able to master the physical and mental health of professional driving, reduce occupational disasters in the transportation industry or prevent the occurrence of occupational diseases.

One of the purposes of this creation is to provide a system for early warning of a worker’s fatigue status, so as to analyze the worker’s status through the collection of a large amount of data (such as information about the workplace environment or information about the workers working in the workplace environment). The risk level and working conditions of the workplace environment are used to establish a device for fatigue risk detection before the worker starts work, thereby reducing the risk of fatigue (such as fatigue driving) of the worker at work.

At least one embodiment of the present invention provides a system for pre-warning the fatigue of a worker. The system may include an electronic device, a wearable device, an environmental monitoring device, and a back-end processor. The end processor can communicate with the electronic device, the wearable device and the environment monitoring device respectively through wireless communication. The electronic device can be used to execute a questionnaire module application program for collecting the fatigue degree of the worker subjectively judged to generate a questionnaire collection result. The wearable device is worn on the body of the worker, and can be used to detect the physiological characteristics of the worker and generate physiological information of the worker accordingly. The environment monitoring device is set in the workplace environment of the worker, and can be used to monitor real-time environmental information of at least one environmental factor of the workplace environment. The back-end processor can obtain the environmental real-time information of the past multiple working days from the environmental monitoring device to calculate the environmental cumulative information of the at least one environmental factor, and obtain the environmental information from the electronic device and the wearable device respectively The result of the questionnaire collection and the physiological information is used to generate an analysis result based on the accumulated information of the environment, the result of the questionnaire collection and the physiological information, wherein the analysis result is used to check or warn the risk of fatigue of the worker.

The system provided by the embodiment of the present creation can combine environmental factors, the labor's objective physiological condition and the correlation of the subjective psychological state with respect to fatigue, and establish a device that can be used to check or warn the worker's fatigue driving. In this way, drivers of transportation vehicles can not only check the alcohol concentration to confirm whether they are suspected of drunk driving, but also evaluate the condition of fatigue driving before starting to work, so as to avoid drivers with a higher risk of fatigue driving. Hit the road.

FIG. 1 is a schematic diagram of a system 10 for early warning of a worker's fatigue condition according to an embodiment of the invention, wherein the system 10 can be applied to the public transportation industry. As shown in Figure 1, the system 10 may include an electronic device 160, a wearable device 150 worn on a worker (for example, a driver), an environmental monitoring device such as a substance concentration sensor 110, and a back end Processor 170. In this embodiment, the system 10 may further include a recording device such as an image recording device 120, a positioning device 130, and a wireless transmission device 140, wherein the substance concentration sensor 110, the image recording device 120, the positioning device 130 and wireless transmission The device 140 may be installed in a workplace environment such as a public transportation vehicle 10A, and especially may be installed near the driver's seat. In addition, the back-end processor 170 can communicate with the electronic device 160, the wearable device 150, the substance concentration sensor 110, the image recording device 120, and the positioning device 130 respectively through wireless communication. For example, the substance concentration sensor 110, the image recording device 120, and the positioning device 130 can all be coupled to the wireless transmission device 140, so that the back-end processor 170 can communicate from the substance concentration sensor 110 and the image recording device 120 through wireless communication. And the positioning device 130 obtains relevant information. In addition, the electronic device 160 and the wearable device 150 may have built-in related wireless transmission modules to allow the back-end processor 170 to obtain relevant information from the electronic device 160 and the wearable device 150. For example, the wearable device 150 can send relevant data to the driver’s smartphone via Bluetooth communication, and then the smartphone can send the data to the back-end processor 170; another example is the wearable device 150 can directly transmit relevant data to a certain base station through Wi-Fi, 4G, or 5G wireless communication technologies, and then transmit from this base station to the back-end processor 170; but this creation is not limited to this.

In this embodiment, the electronic device 160 shown in Figure 1 can be a multi-function mobile phone, a tablet computer, a notebook computer, or any electronic device capable of running the questionnaire module application 160P. The second The figure shows a smart phone 300 running a questionnaire module application 160P according to an embodiment of this creation, and the smart phone 300 may be an example of the electronic device 160. As shown in Figure 3, the smart phone 300 may be equipped with a touch screen that can display the content of the questionnaire for the worker to answer, and thereby collect the worker’s subjectively judged fatigue level to generate a Questionnaire collection results. In addition, the wearable device 150 shown in FIG. 1 may be a wearable electronic device such as a smart bracelet. For example, the wearable device 150 can be worn on the body of the worker during working hours, so as to collect the heart rate condition of the worker during the working hours; for another example, the wearable device 150 can be worn on the body of the worker all-weather, In this way, the worker's sleep status, heart rate status, etc. can be collected in real time.

In this embodiment, the environmental monitoring device can be used to monitor the real-time environmental information of at least one environmental factor of the workplace environment, and the back-end processor 170 can obtain the real-time environmental information of the past multiple working days from the environmental monitoring device To calculate the cumulative environmental information of the at least one environmental factor. For example, the real-time environmental information may include a real-time concentration of at least one specific substance (for example, one or more specific substances) in the workplace environment (for example, in the public transportation vehicle 10A), such as the workplace environment (for example, in the public transportation vehicle 10A) The air composition or air quality, and the cumulative environmental information may include a cumulative concentration of the at least one specific substance, such as the cumulative concentration of the workplace environment (for example, in the public transportation vehicle 10A) during the above-mentioned past multiple working days or The average air composition or air quality.

In this embodiment, the aforementioned at least one specific substance may include carbon dioxide, volatile organic compounds (Total Volatile Organic Compound, TVOC for short), or suspended particles (eg, PM2.5 and other suspended particles containing one or more specific elements or compounds). The above specific substances can use the carbon dioxide instant sensor 111, the TVOC instant sensor 112, and the aerosol instant sensor 113 in the substance concentration sensor 110 to generate the corresponding concentration results. For example, the instant concentration may include carbon dioxide instant sensor The concentration, the real-time concentration of TVOC, and the real-time concentration of aerosols, where these concentration sensing results can be transmitted to the back-end processor 170 via the wireless transmission device 140 in real time, and the period of outputting the latest concentration sensing results is not limited to a specific period, such as At least a part of the substance concentration sensor 110 (for example, a part or all of the sensors) can generate the latest concentration sensing result every minute, and can also generate the latest concentration sensing result every five minutes. The worker's continuous update of the concentration measurement results during his working hours is within the scope of this creation.

In this embodiment, the image recording device 120 can be used to capture a motion image of a worker in the workplace environment. In addition, the back-end processor 170 can obtain the motion image from the video recording device 120 through wireless communication and analyze the motion image using a motion recognition algorithm to generate an image sensing result. In addition, the back-end processor 170 can use the motion recognition algorithm to analyze the physical movement of the worker to determine whether the physical movement of the worker is fatigued, and generate the image sensing result accordingly. For example, the image sensing result may include multiple real-time image sensing results in the past multiple working days (for example, the image sensing result used to indicate whether the worker made fatigue actions at a certain point in time), And a cumulative image sensing result is calculated according to the multiple image sensing results (for example, an image sensing result used to indicate whether the worker frequently performs fatigue actions for a long time).

FIG. 3 is a schematic diagram of an image 200 according to an embodiment of the present creation, and the image 200 may be an example of the motion image captured by the image recording device 120 described above. In this embodiment, the workplace environment is in a transportation vehicle (for example, in a public transportation vehicle 10A), and the image sensing result can indicate a driver's body movement on the transportation vehicle. In some embodiments, the image recording device 120 can capture the facial features of the driver for the back-end processor to focus on the facial features (for example, whether the eyes are closed for too long, the mouth Analyze whether the worker is in a state of fatigue. In this embodiment, in order to determine whether the driver is fatigued when the driver wears sunglasses or a hat and the facial features cannot be completely intercepted, through the image recognition technology, the recognition data 200D can be obtained from the image 200 Extracted to represent the driver’s body movements in the driver’s seat (for example, using image recognition technology to find out the pixel positions of the driver’s head, torso, and limbs in the image 200, and connect these pixel positions to form a composition ), after the back-end processor 170 obtains the image sensing result (for example, the complete image 200 recorded by the video recording device, or the identification data 200D extracted from the image 200), the back-end processor 170 can use the action to identify The algorithm analyzes the identification data 200D to determine whether the worker’s body movements are "sluggish," "yawning, covering his mouth," "stretching", etc., so as to achieve the above-mentioned purpose of judging whether the driver is in a state of fatigue. In addition, the back-end processor 170 can use the motion recognition algorithm to analyze the driver's head motion, and classify the driver's head state into "head forward", "head left turn", and "head "Turn right" to further enhance driving safety. For example, it can be judged whether the worker's physical movements have performed behaviors that should not occur during driving, such as lowering his head and using a mobile phone.

In addition, the motion recognition technology can also integrate positioning technology to further enhance driving safety. Specifically, the positioning device 130 can be used to detect the position of the transportation means to generate the positioning information of the transportation means. In this embodiment, the back-end processor 170 can obtain the positioning information from the positioning device 130 through wireless communication, and determine whether the driver is passing through at least one specific location according to the image sensing result and the positioning information. Perform at least one specific body movement. For example, since the positioning information can indicate the location of the vehicle, when the vehicle is about to turn, the back-end processor 170 can use the aforementioned motion recognition technology to determine whether the driver has made a "head swing" confirmation. The action of looking in the mirror is used to manage whether the driver follows the correct safety rules while driving.

It should be noted that the above-mentioned image processing-related technologies are not limited to be implemented by specific components. For example, the above-mentioned technology for identifying the position of the driver’s limbs can be implemented by the image processing circuit built in the video recording device 120 to execute related code. Implementation, and the back-end processor 170 can obtain the identification data 200D from the image recording device 120 through wireless communication for subsequent action identification; for example, the back-end processor 170 can obtain the complete image 200 from the image recording device 120 through wireless communication. The recognition of the position of the limbs and the recognition of the movement of the limbs are all performed by the back-end processor 170. In addition, the above-mentioned body position recognition and motion recognition techniques are not limited to the use of specific algorithms. Any image recognition that can extract the driver’s body motion information from the image 200 and determine whether the body motions meet certain fatigue characteristics. Technology belongs to the category of this creation.

As described above, the back-end processor 170 shown in Figure 1 can obtain the environmental cumulative information such as the cumulative concentration and the questionnaire collection from the substance concentration sensor 110, the electronic device 160, the wearable device 150, and the video recording device 120, respectively. The result, the physiological information, and the image sensing result are generated based on one or more (for example, part or all) of the cumulative environmental information such as the cumulative concentration, the questionnaire collection result, the physiological information, and the image sensing result An analysis result, wherein the analysis result is used to check or warn the risk of fatigue of the worker.

Specifically, the back-end processor 170 may record the environmental cumulative information (such as the cumulative concentration), the questionnaire collection result, the physiological information, and the respective correlation parameters of the image sensing result with respect to the fatigue action of the worker. , And the back-end processor 170 can use the respective correlation parameters as the weighting of the environmental cumulative information (such as the cumulative concentration), the questionnaire collection result, the physiological information, and the image sensing result, respectively, An overall fatigue index is calculated based on the cumulative information of the environment (such as the cumulative concentration), the results of the questionnaire, the physiological information, and the result of the image sensing to check or warn the risk of the worker's fatigue actions in the workplace environment. In order to obtain the above correlation parameters, the driver’s physiological characteristics (such as sleep hours, resting heart rate, work center rate, etc.), personal stress scale, work fatigue scale, life habits and other information can be compared with each other when fatigue occurs. The non-occurrences are collected in advance to analyze the correlation between each factor and fatigue, and these analyses can be conducted for multiple drivers to produce integrated results. In this way, the back-end processor 170 can use the regression model established based on the above analysis to integrate the information obtained from the substance concentration sensor 110, the video recording device 120, the wearable device 150, and the electronic device 160 to generate the Overall fatigue index. For example, the detected TVOC concentration may correspond to a TVOC concentration score F1, and its corresponding correlation parameter is W1; the detected carbon dioxide concentration may correspond to a carbon dioxide concentration score F2, and its corresponding correlation parameter is W2; the detected aerosol concentration can correspond to the aerosol concentration score F3, and its corresponding correlation parameter is W3; the detected resting heart rate can correspond to a resting heart rate score F4, and its corresponding correlation parameter It is W4; the total sleep hours detected or collected can correspond to a total sleep score F5, and its corresponding correlation parameter is W5; the heart rate level detected during driving can correspond to a driving center rate score F6 , Its corresponding correlation parameter is W6; and the driving distance of the vehicle (long and short distance) can correspond to a long and short distance score F7, and its corresponding correlation parameter is W7; the driver’s working hours in the previous day can correspond to In the previous day’s work hour score F8, the corresponding correlation parameter is W8; and the information obtained through image recognition (such as the above action recognition) can correspond to an image score F9, and its corresponding correlation parameter is W9; where calculation The fatigue index of the whole question is as follows: Fatigue risk (for example, it can be expressed by a value from 0 to 100) = W1 × F1 + W2 × F2 + W3 × F3 + W4 × F4 + W5 × F5 + W6 × F6 + W7 × F7 + W8 × F8 + W9 × F9; It should be noted that the above-mentioned W1, W2, W3, W4, W5, W6, W7, W8 and W9 are not limited to specific values (which can be positive or negative), and each value can also be changed in different situations, for example For self-driving cars, taxis, and buses, due to different actual situations, the correlation between various factors and driver fatigue is also different, so the above parameters need to be determined based on the results of pre-analysis.

Fig. 4 is a workflow of a method for alerting a worker’s fatigue condition according to an embodiment of the present creation, wherein the method is applicable to the system 10 shown in Fig. 1. It should be noted that the workflow shown in Figure 4 is for illustrative purposes only, and is not a limitation of this creation. One or more steps can be added, deleted or modified in the workflow. In addition, if the same result can be obtained, these steps do not necessarily have to be performed in the order shown in Figure 4.

In step 410, the system 10 can use an electronic device (such as the electronic device 160 shown in Figure 1) to execute a questionnaire module application (such as the questionnaire module application 160P shown in Figure 1) to collect the The labor subjectively judged the degree of fatigue to generate a questionnaire collection result.

In step 420, the system 10 may use a wearable device (such as the wearable device 150 shown in Figure 1) worn on the worker to detect the physiological characteristics of the worker and generate physiological information of the worker accordingly.

In step 430, the system 10 can use an environmental monitoring device (such as the substance concentration sensor 110 shown in Figure 1) to monitor the real-time environment of at least one environmental factor (such as carbon dioxide, TVOC, aerosols, etc.) in a workplace environment. Information (such as the real-time concentration of carbon dioxide, TVOC, aerosols).

In step 440, the system 10 can use a back-end processor (for example, the back-end processor 170 shown in Figure 1) to obtain the past data from the environmental monitoring device (such as the substance concentration sensor 110 shown in Figure 1). The real-time environmental information of the multiple working days of to calculate the cumulative environmental information of the at least one environmental factor (such as the cumulative concentration or average concentration of carbon dioxide, TVOC, and suspended particulates during the foregoing multiple working days).

In step 450, the system 10 can use a recording device (for example, the image recording device 120 shown in FIG. 1) to capture the motion images of the worker in the workplace environment.

In step 460, the system 10 can use the back-end processor (for example, the back-end processor 170 shown in Figure 1) to obtain the motion image from the recording device through wireless communication and analyze the motion image by using a motion recognition algorithm to Generate an image sensing result.

In step 470, the system 10 can use the back-end processor (for example, the back-end processor 170 shown in FIG. 1) to obtain the questionnaire collection results and the physiological information from the electronic device and the wearable device respectively, and according to the The cumulative information of the environment, the result of the questionnaire collection, the physiological information and the result of the image sensing generate an analysis result, wherein the analysis result is used to check or warn the risk of fatigue of the worker.

In summary, the embodiment of this creation provides a system for early warning of a worker’s fatigue status, which can detect the air quality in the workplace, the worker’s physical movements, and the worker’s physical and psychological conditions. The fatigue risk of labor (especially the driver in the transportation industry) is evaluated, and this evaluation can be applied to a driver to detect before driving to avoid that the driver is driving on the road when the risk of fatigue driving is too high, or to apply Real-time monitoring is carried out while the driver is driving, so that an early warning message can be generated when fatigue driving or dangerous driving has occurred or the risk is too high to inform the back-end command center, so that the command center can instantly Know the driver's driving safety status and reduce the risk of harm caused by fatigue at work.

10: System 10A: Public transportation 110: substance concentration sensor 111: Carbon dioxide instant sensor 112: TVOC instant sensor 113: Real-time suspended particle sensor 120: Video recording device 130: positioning device 140: wireless transmission device 150: wearable device 160: electronic device 160P: Questionnaire module application 170: back-end processor 200: image 200D: Identification data 300: smart phone 410,420,430,440,450,460,470: steps

Figure 1 is a system for early warning of a worker’s fatigue condition according to an embodiment of the invention. Figure 2 is a smartphone running a questionnaire module application according to an embodiment of this creation. Figure 3 is a schematic diagram of an image created according to an embodiment of the present invention. Figure 4 is a work flow of a method for alerting a worker's fatigue condition according to an embodiment of the invention.

10: System

10A: Public transportation

110: substance concentration sensor

111: Carbon dioxide instant sensor

112: TVOC instant sensor

113: Real-time suspended particle sensor

120: Video recording device

130: positioning device

140: wireless transmission device

150: wearable device

160: electronic device

160P: Questionnaire module application

170: back-end processor

Claims (9)

A system for early warning of a worker’s fatigue status, including: An electronic device used to execute a questionnaire module application for collecting the labor's own fatigue degree subjectively judged to generate a questionnaire collection result; A wearable device worn on the body of the worker to detect the physiological characteristics of the worker and generate physiological information of the worker accordingly; An environmental monitoring device, which is set in the workplace environment of the worker and is used to monitor real-time environmental information of at least one environmental factor of the workplace environment; A back-end processor communicates with the electronic device, the wearable device, and the environmental monitoring device through wireless communication, wherein the back-end processor obtains the real-time environment from the environmental monitoring device in the past multiple working days The information is used to calculate the environmental cumulative information of the at least one environmental factor, and the questionnaire collection result and the physiological information are obtained from the electronic device and the wearable device respectively, based on the environmental cumulative information, the questionnaire collection result, and the physiological information An analysis result is generated, where the analysis result is used to check or warn the worker's fatigue risk. For example, in the system described in claim 1, wherein the environmental monitoring device is a substance concentration sensor, the real-time environmental information includes a real-time concentration of at least one specific substance in the workplace environment, and the cumulative environmental information includes A cumulative concentration of the at least one specific substance. The system described in item 2 of the scope of patent application, wherein the at least one specific substance includes carbon dioxide, suspended particulates or volatile organic compounds. As the system described in item 1 of the scope of patent application, it also includes: A video recording device used to capture the motion images of the worker in the workplace environment; The back-end processor obtains the motion image from the recording device through wireless communication and uses a motion recognition algorithm to analyze the motion image to generate an image sensing result, and the back-end processor accumulates information and the questionnaire according to the environment The collection result, the physiological information, and the image sensing result generate the analysis result. For example, the system described in item 4 of the scope of patent application, wherein the back-end processor records the environmental accumulation information, the questionnaire collection results, the physiological information, and the respective correlations of the image sensing results with the fatigue actions of the worker Performance parameters, and the back-end processor uses the respective correlation parameters as the weighting of the environment accumulation information, the questionnaire collection result, the physiological information, and the image sensing result respectively, so as to accumulate according to the environment Information, the result of the questionnaire, the physiological information, and the result of the image sensing are used to calculate an overall fatigue index to check or warn the worker’s risk of fatigue actions in the workplace environment. For example, the system described in item 4 of the scope of patent application, wherein the back-end processor uses the motion recognition algorithm to analyze the physical movements of the worker to determine whether the worker’s physical movements are fatigued, and generate the image sense accordingly Test results. The system described in item 4 of the scope of patent application, wherein the image sensing result includes a plurality of real-time image sensing results in the past multiple working days, and one calculated based on the plurality of image sensing results Accumulate image sensing results. In the system described in item 4 of the scope of patent application, the workplace environment is in a transportation vehicle, and the image sensing result indicates the physical movement of a driver on the transportation vehicle. As the system described in item 8 of the scope of patent application, it also includes: A positioning device for detecting the location of the transportation means to generate positioning information of the transportation means; The back-end processor obtains the positioning information from the positioning device through wireless communication, and determines whether the driver performs at least one specific limb movement when the vehicle passes through at least one specific position according to the image sensing result and the positioning information .

Images