WO2021224728A1

WO2021224728A1 - Systems and methods for personal protective equipment compliance

Info

Publication number: WO2021224728A1
Application number: PCT/IB2021/053531
Authority: WO
Inventors: Marie D. MANNER; Caroline M. Ylitalo; Kiran S. Kanukurthy
Original assignee: 3M Innovative Properties Company
Priority date: 2020-05-07
Filing date: 2021-04-28
Publication date: 2021-11-11

Abstract

A worker safety compliance monitoring system is presented that includes a camera configured to capture an image of an environment, a worker identifier, configured to identify a worker within the environment, based on the image, a personal protective equipment identifier, configured to identify an article of personal protective equipment on the worker, based on the image, a compliance rule retrieval module configured to retrieve a rule for the environment in the image. And a compliance detector configured to compare the identified article of personal protective equipment with the retrieved rule and, based on the comparison, provide an indication of worker compliance with the retrieved rule. The worker safety compliance monitoring system operates in a compliance detection mode and an active learning mode. The rule retrieved by the compliance rule retrieval module was identified by the camera capturing an image of the environment containing a rule indication during the active learning mode.

Description

SYSTEMS AND METHODS FOR PERSONAL PROTECTIVE EQUIPMENT

COMPLIANCE

Background

Maintaining the safety and health of workers is a major concern across many industries. Various rules and regulations have been developed to aid in addressing this concern. Such rules provide sets of requirements to ensure proper administration of personnel health and safety procedures. To help in maintaining worker safety and health, some individuals may be required to don, wear, carry, or otherwise use a personal protective equipment (PPE) article, if the individuals enter or remain in work environments that have hazardous or potentially hazardous conditions.

Consistent with evolving rules and regulations related to safety, safety is an important concern in any workplace requiring the use of PPE. Companies or businesses employing workers wearing articles of PPE also want to ensure that workers are complying with relevant laws, regulations and company policies related to proper use and maintenance of PPE.

Summary

A worker safety compliance monitoring system is presented that includes a camera configured to capture an image of an environment, a worker identifier, configured to identify a worker within the environment, based on the image, a personal protective equipment identifier, configured to identify an article of personal protective equipment on the worker, based on the image, a compliance rule retrieval module configured to retrieve a rule for the environment in the image. And a compliance detector configured to compare the identified article of personal protective equipment with the retrieved rule and, based on the comparison, provide an indication of worker compliance with the retrieved rule. The worker safety compliance monitoring system operates in a compliance detection mode and an active learning mode. The rule retrieved by the compliance rule retrieval module was identified by the camera capturing an image of the environment containing a rule indication during the active learning mode. The details of one or more examples of the disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the disclosure will be apparent from the description and drawings, and from the claims.

Brief Description of the Drawings

FIGS 1A and IB illustrate worksites in which embodiments of the present invention may be useful.

FIGS. 2-5 illustrate embodiments of a PPE compliance system active in a worksite in accordance with embodiments herein.

FIG. 6 illustrates an example method of configuring a PPE compliance system in accordance with embodiments herein.

FIGS. 7A-7C and 8A-8D illustrate example training sequences for a PPE compliance system in accordance with embodiments herein.

FIG. 9 illustrates an example method of detecting compliance with PPE requirements in a worksite in accordance with embodiments herein.

FIG. 10 illustrates a block diagram of an example work environment in accordance with embodiments herein.

FIG. 11 illustrates an example method for PPE compliance in restricted spaces in accordance with embodiments herein.

FIGS. 12-14 illustrate example devices that can be used in embodiments herein.

FIGS. 15A-15B illustrate an example learning phase for a PPE compliance system.

FIGS. 16A-16C illustrate a mobile PPE compliance system and example PPE detection display output.

FIGS. 17A-17C illustrate example PPE compliance system outputs.

Detailed Description

Manually monitoring PPE use in a given workplace can be cumbersome and time consuming for supervisors or safety compliance officers. Improved methods and systems for monitoring safety compliance, PPE maintenance, and providing safety-related contextual information in a work environment requiring the use of PPE are needed.

FIGS 1A and IB illustrate worksites in which embodiments of the present invention may be useful. FIG. 1 is a block diagram illustrating an example network environment 2 for a worksite 8 A or 8B. The worksite environments 8 A and 8B may have one or more workers 10A-10N, each of which may need to interact with equipment or environments that require the use of personal protective equipment such as glasses, hard hats, fall protection equipment, respirators, gloves, etc. Workers 10A-10N may have a range of experience with a given worksite, with some knowing and complying with rules concerning personal protective equipment, and others who do not know, are still in training, or actively not complying with personal protective equipment requirements.

Environment includes a personal protection equipment compliance system 6 for detecting and managing compliance with posted rules concerning personal protection equipment (PPE). Compliance system 6 may reduce incidents of noncompliance by workers PPE rules, reducing the risk of injury and increasing safety within a worksite 2. Compliance system 6 may also allow safety professionals to manage area inspections, worker inspections, worker health and safety compliance training.

In general, PPE compliance system 6, as described in greater detail herein, is configured to leam rules for PPE usage within environments 8A and 8B, and monitor compliance with the PPE usage rules. System 6 may be connected, through network 4, to one or more devices or displays 16 within an environment, or devices or displays 18, remote from an environment. System 6 may provide alerts to workers 10A-10N when compliance is not detected, as well as provide feedback on types of PPE that may be appropriate for a given situation. System 6 may also be integrated into entry protocols for secured areas within an environment such that workers that do not have compliant PPE are restricted out of a secure area.

As shown in the example of FIG. 1A, system 2 represents a computing environment in which a computing device within of a plurality of physical environments 8A, 8B (collectively, environments 8) electronically communicate with PPE compliance system 6 via one or more computer networks 4. Each of physical environments 8 A and 8B represents a physical environment, such as a work environment, in which one or more individuals, such as workers 10, utilize personal protection equipment while engaging in tasks or activities within the respective environment.

In this example, environment 8A is shown as generally as having workers 10, while environment 8B is shown in expanded form to provide a more detailed example. In the example of FIG. 1A, a plurality of workers 10A-10N may be wearing a variety of different PPE, such as ear muff hearing protectors, in-ear hearing protectors, hard hats, gloves, glasses, goggles, masks, respirators, hairnets, scrubs, or any other suitable personal protective equipment.

In some embodiments herein, an article of PPE may include one or more of embedded sensors, communication components, monitoring devices and processing electronics. In addition, each article of PPE may include one or more output devices for outputting data that is indicative of operation of the PPE and/or generating and outputting communications to the respective worker 10. For example, PPE may include one or more devices to generate audible feedback (e.g., one or more speakers), visual feedback (e.g., one or more displays, light emitting diodes (LEDs) or the like), or tactile feedback (e.g., a device that vibrates or provides other haptic feedback).

In some examples, each of environments 8 include computing facilities, such as displays 16, or through associated PPEs, by which workers 10 can communicate with PPE compliance system 6. For examples, environments 8 may be configured with wireless technology, such as 802.11 wireless networks, 802.15 ZigBee networks, and the like. In the example of FIG. 1A, environment 8B includes a local network 7 that provides a packet- based transport medium for communicating with PPE computing system 6 via network 4. In addition, environment 8B includes a plurality of wireless access points 19A, 19B that may be geographically distributed throughout the environment to provide support for wireless communications throughout the work environment.

As shown in the example of FIG. 1, an environment, such as environment 8B, may also include one or more wireless-enabled beacons, such as beacons 17A-17C, that provide accurate location information within the work environment. For example, beacons 17A- 17C may be GPS-enabled such that a controller within the respective beacon may be able to precisely determine the position of the respective beacon. Alternatively, beacons 17A-17C may include a pre-programmed identifier that is associated in PPE compliance system 6 with a particular location. Based on wireless communications with one or more of beacons 17, or data hub 14 worn by a worker 10 is configured to determine the location of the worker within work environment 8B. In this way, event data reported to PPE compliance system 6 may be stamped with positional information. This may be helpful in the event a supervisor or safety officer needs to respond to a notice of noncompliant PPE usage. In example implementations, an environment, such as environment 8B, may also include one or more safety stations 15 distributed throughout the environment to provide viewing stations for accessing PPE compliance system 6. Safety stations 15 may allow one of workers 10 to check out articles of PPE and/or other safety equipment, verify that safety equipment is appropriate for a particular one of environments 8, and/or exchange data. For example, safety stations 15 may transmit alert rules, software updates, or firmware updates to articles of PPE or other equipment.

In addition, each of environments 8 include computing facilities that provide an operating environment for end-user computing devices 16 for interacting with PPE compliance system 6 via network 4. For example, each of environments 8 typically includes one or more safety managers or supervisors, represented by users 20 or remote users 24, are responsible for overseeing safety compliance within the environment. In general, each user 20 or 24 interacts with computing devices 16, 18 to access PPE compliance system 6. For example, the end-user computing devices 16, 18 may be laptops, desktop computers, mobile devices such as tablets or so-called smart cellular phones.

Users 20, 24 interact with PPE compliance system 6 to control and actively manage many aspects of safely equipment utilized by workers 10, such as accessing and viewing usage records, analytics and reporting. For example, users 20, 24 may review compliance and noncompliance information acquired and stored by PPE compliance system 6. In addition, users 20, 24 may interact with PPE compliance system 6 to review PPE rules in effect, add new rules based on new procedures or regulations or provide other updated information.

PPE compliance system 6 may be configured to actively monitor workers 10A-10N and other users 20 within an environment 8 both for compliance with existing PPE rules and to detect new ones. Referring to FIG. IB, a worksite may have one or more cameras 60, either fixed within the worksite, mobile (e.g. drone, robot or equipment-mounted) or associated with a worker 10A-10N (e.g. an augmented reality headset or other camera worn in association with PPE, etc.). Using the one or more cameras, PPE compliance system 6 can identify whether or not a worker 10A-10N is in compliance with known rules for a given area of the worksite. PPE compliance system 6 is also configured, using cameras 30, to identify signs 40 within a field of view 35 of a camera. A sign 40 may be identified by shape, or the detection of writing or symbols 45. PPE compliance system 6 may be able to detect, from the writing or symbols 45, that a PPE rule is in effect for a given area. For example, based on the detection and reading of sign 40 of FIG. IB, PPE compliance system 6 may add a “Safety Glasses Required” rule to a list of compliance requirements for an area where sign 40 is posted.

As another example, PPE compliance system 6 may further trigger an alert if noncompliance is detected, either once or repeatedly by a given worker. The alert may be sent to worker 10, either through a communication feature of a PPE, a separate communication device, or through a public address system within the environment. A noncompliance alert may also be sent to a supervisor or safety officer associated with the environment 8 as well. Noncompliance may also be tracked and stored within a database, as described herein. Additionally, noncompliance may serve as an indicator that a requirement has relaxed for an area, and that a PPE rule may be changed or changing.

Techniques and components of this disclosure may improve the safety of workers within an environment by improving PPE compliance within the environment. Systems and methods herein may also provide general information about whether additional PPE training is needed for a worker or group of workers, based on detected patterns of noncompliance. Additionally, systems and methods herein can help workers within an environment look out for each other by seeing alerts concerning noncompliance.

FIGS. 2-5 illustrate embodiments of a PPE compliance system active in a worksite in accordance with embodiments herein. As discussed below, a PPE compliance system may have an active learning component that allows the system to add new PPE compliance rules. Once PPE compliance rules are learned, PPE compliance system, by monitoring images captured from cameras located within an environment, may be able to identify workers and capture PPE usage and compliance data. PPE compliance system may also be integrated with a security or access system, such that individuals without compliant PPE may not enter a given area.

The illustrated view of FIGS. 2-5 may be an augmented view presented at a safety station, such as stations 15 illustrated in FIG. 1A, on a display to a supervisor or an augmented view presented in a heads-up display worn by another worker, supervisor or safety officer, in some embodiments. In other embodiments, the views of FIGS. 2-5, may simply illustrate the operation of PPE compliance system and may not actually be presented to a user on a display. FIGS. 2 A and 2B illustrate a PPE compliance system identifying PPE worn by workers 60 within an environment 50. As illustrated in FIG. 2A, a plurality of workers 60 are in environment 50. The PPE compliance system has identified, for each worker 60, a plurality of PPE articles, each of which may be a required item to enter a secured area. FIGS. 2A and 2B illustrate a PPE compliance system in a learning phase. As discussed below, in a learning phase, PPE compliance system identifies workers 60 and PPE they are wearing to detect PPE usage rules. As illustrated below in FIG. 7, PPE compliance system also leams by detecting signage and ‘reading’ the PPE rules on detected signs. As illustrated in FIG. 2A, compliance system has identified, on each worker, a scrubs top 62, a scrubs bottom 64, a hairnet 68 and a beardnet 66. As illustrated in parameters block 70, the PPE that is detected may be necessary to access an environment. A system may be able to identify workers needing specialized PPE, such as bearded men requiring a beardnet 66. For example, in some scenarios, workers wear different colored equipment based on an activity. Alternatively, a system could identify a worker, identify whether they have facial hair, then decide from that whether they need the beard net 66 based on the PPE rules for a given area. Similar rules apply to other PPE, for example a worker likely does not need a lifeline in a fall protection scenario if they are not wearing a harness. In some embodiments, there are additional rules, based on the PPE itself, the individual that might wear it, or the location / assignment of the worker, that determine if a particular individual needs a PPE item.

Similarly, in FIG. 2B, another worker 60 is detected passing through an environment 50 where PPE is needed. The worker 60 is also identified as wearing items of PPE.

FIGS. 3A and 3B illustrate a PPE compliance system determining whether a worker meets PPE access requirements for an environment.

During an active phase of operation, a PPE compliance system detects a worker 110 within an environment 100. As illustrated in FIGS. 3A and 3B, the worker 110 may be identified as a particular individual. In some embodiments, PPE compliance system may not be able to, or does not expend processing power to identify worker 110 as an individual worker. However, for some environment areas within a worksite, access may be restricted to specific personnel. In such instances, as discussed below, worker 110 may need to present a security badge or another identifier, either to PPE compliance system or another detector, and PPE compliance system may grant access based on a positive identification. Additionally, PPE compliance system may be configured to identify workers in a worksite using facial or other recognition techniques, by identifying a given PPE associated with a worker 110 (such as a checked-out protective hearing device, respirator, hazardous material suit, etc.).

As illustrated in FIG. 3A, PPE compliance system has a required PPE 114 of a hardhat for a given environment. The hardhat is not detected in FIG. 3A. While worker 110 is indicated as an allowed worker 116 for a given site, she does not have granted access because of the missing hardhat.

In FIG. 3B, worker 110 has donned a hardhat 122, and now the required PPE is satisfied 115. As such, access is granted, as indicated by indicator 120.

FIGS. 4A and 4B illustrate a PPE compliance system granting access based on PPE compliance.

FIG. 4A illustrates a view 130 of a PPE compliance system detecting an individual 134 wearing several pieces of PPE, namely a hard hat 132 and a respirator 136. In the example of a PPE compliance system as illustrated in FIG. 4B, a user must have a hard hat, a respirator, and gloves in order to enter a given area. The contents of display 135 of FIG. 4B may be communicated to a worker 134, for example on safety station display next to an access point, on a display screen within a worksite near worker 134, or in another suitable place within a worksite. Additionally, the contents of display 135, namely that worker 134 is missing “gloves” may be communicated audibly to the user, either through a speaker on an associated PPE, through a safety station, through a public address speaker, or through another suitable mechanism. Further, the contents of display 135 may be communicated in another suitable matter.

As illustrated in FIG. 4B, once gloves 138 are detected, worker 134 may receive access 140 to an area within the worksite. However, while “Access Granted” is illustrated as a result in FIG. 4B, it is expressly contemplated that a PPE compliance system may be configured only to monitor for compliance or noncompliance, and may not be integrated into, or in communication with a security access feature.

FIGS. 5A and 5B illustrate a PPE compliance system identifying a PPE in an embodiment herein. FIG. 5A and FIG. 5B illustrate views 150 of a PPE compliance system as it identifies a given PPE article, namely one of two earplugs 152, in FIG. 5A, and 156, in FIG. 5B. As illustrated in FIG. 5 A, PPE compliance system identifies an earplug 152 and can retrieve information for display 154 from a database (not shown) about the identified PPE. For example, as illustrated in FIG. 5 A, the earplug 152 is identified as an E-A-R™ Ultrafit™ test plug. FIG. 5B illustrates another example where an identified in-earplug 156 is detected to be an E-A-Rfit™ classic test plug in display portion 158. The PPE compliance system may also be able to provide information about usage of the PPE, for example how to insert it, whether it is being used properly, etc.

While only a single PPE article is identified in FIGS. 5A and 5B, it is contemplated that, in other embodiments, multiple pieces of PPE could be identified. Additionally, the type of PPE, including the brand, rating, etc. might be evaluated for compliance. If the selected PPE is not compliant with a given worksite area, the PPE compliance system may, in portion 154 or 158, provide a recommendation for a more suitable PPE.

In some instances, a worker may operate in multiple, different work environments in a single workday or other work interval (e.g., hour/week/month/year interval, project interval, and the like). Each work environment may have different safety requirements. A work environment may have different safety requirements as a result of different characteristics of the work environment. Characteristics of the work environment may include hazards (e.g., contaminants, low-lighting, uneven surfaces, voids, etc.), physical conditions (noise, heat, confined location, etc.), work environment operating times, or any other characteristic. Referring back to FIG. 1A, as an example, worker 10A may be equipped with PPE, such as a powered-air purifying respirator (PAPR) to filter contaminants from the air in work environments 8A and 8B. Work environment 8A may include contaminants that require a particulate filter in the PAPR, while work environment 8B may include contaminants that require both an organic vapor filter and a particulate filter in the PAPR.

In a single workday, worker 10A may work in both environment 8A and 8B. If worker 10A moves from work environment 8 A to 8B without adding an organic vapor filter to the PAPR, worker 10A may be exposed to harmful organic vapor filters as a result. Worker 10A may not add the organic vapor filter when moving between work environments for a variety of reasons. For instance, worker 10A not be aware of the differing characteristics of work environment 8 A and 8B, worker 10A may forget that characteristics of work environment 8 A and 8B differ, worker 10A may be distracted or fatigued, or worker 10A may not be aware that he or she has moved from one work environment to another, to name only a few examples of when noncompliance with PPE requirements may be inadvertent.

It is important, therefore, that a PPE compliance system not only identify whether a user is wearing the right type of PPE articles, but also be able to retrieve important data about the worn PPE articles and whether they are sufficient for a given work environment.

In block 210, the PPE compliance system enters a learning phase. The learning phase may occur online or offline, such that the PPE compliance system can, in some embodiments, be installed activated on-site and enter the learning mode in a live worksite. In other embodiments, the PPE compliance system undergoes at least some learning prior to activation in a live environment.

The learning phase involves the PPE compliance system learning existing rules for a given worksite. The PPE compliance system may leam by identifying a model worker (or workers) 212 within a worksite, such as a badge-wearing or PPE wearing worker. The PPE compliance system may identify the PPE worn by the model worker and assume the identified worker is wearing the PPE in compliance with existing regulations and site rules. To confirm that assumption, in some embodiments, the PPE compliance system identifies a second model worker, and continues identifying model workers until a consensus is reached on PPE required.

The learning phase may also involve the PPE compliance system identifying a model supervisor 214. Identifying a model supervisor may include identifying a known supervisor or safety officer for a worksite and identifying PPE articles worn by the identified supervisor. Alternatively, the model supervisor may identify themselves to the PPE compliance system (for example using a textual sign that the PPE compliance system can read) and the PPE compliance system can then identify the PPE worn by the supervisor and determine that the identified PPE is the required PPE for that area of the worksite.

The learning phase may also include identifying textual or symbol-based signs that may indicate whether PPE is required for a given area, as indicated in block 216. For example, a sign may symbolically illustrate falling debris, indicating that a hard hat is required. Alternatively, a sign may explicitly state that “hard hat required beyond here” indicating that the area beyond the sign requires a hard hat. The learning phase may also involve other steps or other components, as indicated in block 218. For example, while a stationary camera may be positioned to identify workers entering and leaving an area, the learning phase may be more comprehensive, and faster, if the PPE compliance system is connected to a mobile camera, such as a drone, which can systematically view the entire worksite to identify workers, as indicated in block 212, supervisors, as indicated in block 214, or signs of interest, as indicated in block 216.

In block 220, once a learning phase is complete, the PPE compliance system enters an active phase. In the active phase, the PPE compliance system identifies instances of compliance or noncompliance within a worksite. For example, the PPE compliance system may identify a worker, as indicated in block 222, within a worksite and check to determine whether the worker is in compliance with known PPE rules, as indicated in block 224. Compliance or noncompliance with PPE rules may be recorded for the worker, as indicated in block 226. The active phase may also involve other functionality, as indicated in block 228, such as providing an alert to a supervisor of noncompliance, or an alert to nearby workers of noncompliance, or an alert to the noncompliant worker. The alerts may also be stored and tracked in a database such that a supervisor or safety officer can review them to determine whether additional training is needed for a worker or group of workers.

In block 230, the PPE compliance system enters an active learning phase. In the active learning phase, the PPE compliance system actively looks for new PPE compliance rules or changes in existing PPE compliance rules. For example, a supervisor or safety officer may notify the PPE compliance system of a new rule, as indicated in block 232. Notification could include sending a communication to the PPE compliance system, typing or otherwise entering the new rule into the PPE compliance system using an input device like a keyboard, or another input mechanism. Notification could also include the supervisor or safety officer holding up a handwritten sign to a camera connected to the PPE compliance system. The PPE compliance system may identify the supervisor or safety officer as an individual authorized to submit new rules and enter the new rule into a database of PPE compliance rules.

The PPE compliance system, in an active learning phase, may detect a behavior change, as indicated in block 234. Detecting a behavior change may include the PPE compliance system reviewing instances of noncompliance and noticing that a large group of workers have discontinued use of a given PPE. For example, during a viral outbreak, it may be necessary for workers to wear additional PPE, such as facemasks, that are not normally required. When the risk of spreading the illness is gone, the workers may stop wearing their facemasks. Upon detecting that a significant percentage of workers have ceased using a given PPE, PPE compliance system may either automatically adjust PPE compliance rules, or send a request for confirmation of the rule change to a supervisor or safety officers.

The active learning phase may also include the PPE compliance system detecting a change in posted signs in the worksite, as indicated in block 236. A change in posted signage may include cameras detecting that a sign has been added, removed, changed in shape, size, color, or position, or otherwise been altered since a last review. Upon detecting that a sign has changed, the PPE compliance system may review the new sign for PPE rules. Often, signs may be updated or replaced with new font, details, or symbols, and no new PPE rules are actually implemented. However, if a new PPE rule is detected, it may be automatically added to a database of PPE compliance rules.

The active learning phase of block 230 may require significant power and / or data retrieval and analysis. Therefore, it may be desired for the PPE compliance system, after an initial learning phase, to periodically switch between the active phase of block 220 and the active learning phase of block 230. The active learning phase may be entered periodically, as indicated in block 242, for example once daily, once weekly, once monthly, or any other suitable interval for a worksite. In another embodiment, the active learning phase may only be entered based on a manual initiation, as indicated in block 244, such as a supervisor or safety officer initiating a new sweep of a worksite for signage or current worker behavior. Other suitable triggers are also envisioned, as indicated in block 246. For example, after detecting that more than about 30% of workers were recently or are currently non-compliant with a PPE rule, or more than about 40%, or more than about 50%, or more than about 60%, or more than about 70%, or more than about 80%, or more than about 90%, or substantially all workers are currently non-compliant.

Other suitable triggers may also include an indication that a “system has been rebooted”, or that a “supervisor has walked through the area”, or that a “model employee has walked through the area with a different set of PPE” than a rule indicated, or that “large machinery has moved through the area”, or that “the workspace has been reconfigured” (e.g. walls have come up or down, tables have moved, scaffolding has been removed) or a detection that a “camera location has moved.” Other potential suitable triggers are also expressly contemplated.

FIGS. 7 and 8 illustrate example training sequences for a PPE compliance system in accordance with embodiments herein. FIGS. 7 and 8 illustrate examples of some training sequences discussed herein for a PPE compliance system. However, others may also be suitable.

FIGS. 7A-7C illustrate a supervisor teaching a new rule to a PPE compliance system by holding up a sign with the new rule. As illustrated in FIG. 7A, in a worksite area 310, a worker 314 holds up a sign 312 in front of a camera connected to the PPE compliance system. The captured image is indicative of text, so the PPE compliance system scans the text and compares the words on the sign to a text / symbol dictionary. The comparison results in the PPE compliance system parsing out a new rule, namely that “Safety Glasses” are a required PPE for the area in which worker 314 is in.

In FIG. 7B, the PPE compliance system adds a new rule for the area, as indicated by block 318. As indicated in the transition between FIG. 7B and 7C, as soon as the new rule is in effect, the PPE compliance system checks for compliance and notes that the worker 314 is not wearing the required PPE.

In FIG. 7C, worker 314 has donned the required safety glasses 324, causing the rule indication 320 to change to indicate compliance. Additionally, in a scenario where compliance is required for entry to an area, access may be granted, as indicated in block 326. In other embodiments, instead of access being granted, compliance is recorded.

FIGS. 8A-8D illustrates a sequence of steps in which a PPE compliance system identifies a series of PPE required for an area by identifying PPE available at a safety station. In one embodiment, PPE compliance system is trained by a supervisor or safety officer showing the required PPE, as illustrated in FIGS. 8A-8C, where a hardhat 332 is identified and added to a rule list 330 in FIG. 8A, and a pair of safety glasses 334 are added to the rule list 330 in FIG. 8B, and a pair of gloves 336 are added to rule list 330 in FIG. 8C.

In FIG. 8D, the PPE compliance system detects a worker with all required PPE based on the rules for the area 340, and compliance is noted, as indicated by arrow 342.

FIG. 9 illustrates an example method of detecting compliance with PPE requirements in a worksite in accordance with embodiments herein. The example method 400 may be similar to the examples discussed above, and may be implemented using PPE compliance systems as discussed herein, or may be accomplished using another suitable PPE compliance system.

In block 410, the PPE rules are received. PPE rules may be retrieved for a given area, as indicated in block 414. For example, a camera communicatively coupled to a PPE compliance system may be in a fixed position monitoring access to a restricted area that requires workers to wear scrubs and hair nets. Alternatively, PPE rules may be retrieved for a general worksite, as indicated in block 414. The PPE rules may be received by the PPE compliance system accessing a stored PPE rule catalog, as indicated in block 416, which may include a database of rules for a worksite or area, such as identification badges, for example The PPE rules may also be newly detected, in block 418, for example by using cameras coupled to the PPE compliance system to detect signs that may indicate PPE rules, analyzing the signs to parse PPE rules from the signs, and adding the rules to a list of PPE rules for a given area.

In block 420, a worker is identified in an area. The worker may be identified using a camera or video camera feed and detecting movement indicative of a worker. While systems, methods and examples herein have discussed the term “worker” as indicative of an individual authorized to operate in a given area. However, it is expressly contemplated that the PPE compliance system will also receive indications of other individuals in an area, including guests or other employees. In fact, non-workers in an area may benefit most from a PPE compliance system providing prompts to comply with PPE rules that they might not be aware of.

Identifying a worker in block 420 may include associating a known identity with the worker, for example by recognizing a PPE article checked out to a given individual, by recognizing an ID badge, or using facial or other recognition techniques. However, PPE compliance system, in some embodiments, operates without identifying each worker individually.

Identifying a worker in block 420 may also include identifying PPE articles that the worker is wearing. For example, PPE articles may include, but are not limited to: hearing protection, hard hats or helmets, safety glasses or goggles, scrubs or drapes, respirators or masks, gloves, closed or steel toed shoes, fall protection harnesses, etc. Identifying PPE articles worn by an individual may include analyzing an incoming image or video feed for indications of PPE, such as the shape of a hardhat, the color or shape of goggles, etc. In block 430, a compliance check is completed by the PPE compliance system. Conducting a compliance check may include comparing the detected PPE articles on a given worker with a retrieved list of PPE articles needed for a given worksite or area within a worksite. If the worker is wearing at least all of the PPE articles needed for the worksite or area, compliance is detected and, as indicated in block 450, compliance is recorded. In embodiments where the PPE compliance system identifies workers individually, compliance may be recorded for the individual worker in a worker data file. Individual compliance or non-compliance may assist a safety officer for the worksite in determining whether additional training is needed on PPE use and compliance rules. Compliance may be recorded along with a timestamp, and may be recorded along with other detected conditions, such as temperature, lighting or noise levels, which may impact compliance or may impact a compliance analysis.

In block 440, if non-compliance is detected, the PPE compliance system may take additional action including recording non-compliance, as indicated in block 444. Additionally, the PPE compliance system may provide an alert, as indicated in block 446, informing a worker of needed PPE and, in some embodiments, directing the worker to a PPE dispenser to retrieve the needed PPE article. Additionally, in embodiments where the PPE compliance system is integrated into a locking mechanism for an area, the worker may be denied entry, as indicated in block 442, until compliance with PPE rules is achieved. Additionally, in some embodiments, other workers nearby may be notified, as indicated in block 448, so that they can assist the non-compliant worker or individual with finding the necessary PPE to be safe in a given area. The other workers notified in block 448 may include a supervisor or safety officer for an area.

FIG. 10 illustrates a block diagram of an example work environment in accordance with embodiments herein. FIG. 10 illustrates a worksite area 500. Worksite area 500 may include an entire worksite, or may be a portion of a worksite with different PPE requirements from a different area of the worksite, for example. Within worksite area 500 may be different signs 520, each of which may indicate a hazard 522, a PPE needed notice 524, or may convey other information 528.

Multiple PPE identifiers 530 may also be present within a worksite area 500, including one or more cameras 532 recording activity within the worksite area, or recording access to and from the area, one or more security checkpoints 536, such as a badge reader or other individual identifier. PPE identifiers may also include wireless readers, such as NFC, RFID, Bluetooth® or other detectors that may detect a PPE article on a worker as the worker passes near the reader 534.

One or more individuals 510 may enter or exit worksite area 500. Different types of individuals may elicit different responses from a PPE compliance system. For example, those new to an area, such as a guest, new employee or a non-worker employee (such as an HR or business manager), may be more likely to have issues within a worksite area 500, including noncompliance or potentially dangerous activity. PPE compliance system 540 may be able to identify higher risk individuals using an identifier 514 (such as a guest badge vs. normal badge, or even through the presence of non-traditional work clothes such as a suit) and respond differently to noncompliance, by escalating directly to a supervisor instead of attempting to first contact individual 510, for example.

An individual 510 may have one or more PPE articles 512 on their person. Using a PPE identifier 530, the PPE 512 may be detected as worn in a compliant position, such as an over-the-ear headset worn in a correct position as opposed to, for example, around the neck of individual 510. Individual 510 may also be associated with a piece of equipment 516 or in the area of a piece of equipment 516. For equipment 516 that requires additional PPE to operate, such requirements may be identified by a PPE compliance system 540. Individual 510 may also have a device 518 capable of receiving or sending information to or from PPE compliance system 540, such as a cellular phone, communications unit, or a PPE 512 with built-in communication functionality.

PPE compliance system 540 communicates with PPE identifiers 530 and a database 570 over a network encompassing worksite area 500, using a communication component 560. Database 570 may be stored, in some embodiments, in a memory associated with PPE compliance system, or may be stored elsewhere in worksite area 500, or even accessed through the network from a remote or cloud-based storage. PPE compliance system may receive images, or an image feed, from a PPE identifier 530 using a PPE data receiver 558. A sign detector 552 may, during an initial learning phase or an active learning phase, analyze incoming video or image data to check for signs that may include PPE related rules for a worksite area. Sign reader 554 may compare symbols or text detected on a sign with a dictionary 592 to determine whether a PPE rule is present and needs to be added to a site- specific list of rules 576. Results of an initial or active learning phase 556 may be communicated by PPE compliance system 540 to database 570, which may store them in a site-specific learning results 574 data store. However, during an active operation mode, sign detector 552, sign reader 554 and learning results communicator 556 may not be active, or may only be intermittently active. For example, active learning functionality may be active to record data for later use in identifying trends such as changing or evolving PPE requirements.

Learning results communicator 556 may also be used to provide additional data about best practices in an area. Using the output of the compliance system as an action tracker can provide a ‘best practices’ learning tool for a supervisor, safety officer, or regulator. For example, PPE usage and actions can be correlated with outcomes. For example, it may be detected that, while only “Wearing Scrubs” is a required PPE for an area, the combination of “Wearing Scrubs” and “Hand Washing” is associated with significantly better outcomes for patients than just Wearing Scrubs. In some embodiments, learning results communicator 556 may provide an alert when such a correlation is detected.

PPE data receiver 558 receives incoming streams of data from the one or more PPE identifiers 530 in worksite area 500. When a potential worker 510 is detected, by individual identifier 542, a PPE identifier 544 is activated to scan the identified worker for articles of PPE. A rule retriever 546 may access both site specific rules 576 and general worksite rules 588 that may be applicable to the identified worker. For example, site specific rules 572 may apply specifically to area 500, while general database 584 may include worksite rules 588 that apply to a greater facility of which worksite area 500 is a part. For example, a facility rule 588 may be that all individuals 510 wear an identification badge at all times. Once rules are retrieved for the identified individual 510, a compliance detector 548 checks the PPE identified by 544 against rules retrieved by retriever 546. Both compliance and noncompliance detected by compliance detector 548 are stored in a compliance record 586. In some embodiments, when noncompliance is detected, an alert generator 549 may send an alert to individual 510, either through PPE 512 or a device 518. Additionally, an alert generator 549 may project the alert on a safety station display (not shown in FIG. 10) near individual 510. Further, alert generator 549 may also alert nearby workers, a supervisor or a safety officer if intervention with noncompliant behavior is needed. Alert generator 549 may also, in embodiments where access is contingent on PPE compliance, send an alert to a door lock or other access barrier that individual 510 is compliant, and entry should be granted, or that individual 510 is noncompliant, and access should be refused. However, access to an area may also require individual 510 to be on an access list 578 stored in database 570.

In a learning mode or active learning mode, PPE compliance system 540 may also have a compliance analyzer 557 that reviews individuals identified by individual identifier 542 and PPE identified by PPE identifier 544 to detect rules that might be in place for a new worksite area 500. In an active learning mode, PPE compliance system may also retrieve compliance record 586 to determine whether recent spikes in noncompliance may be due to a change in PPE rules.

Database 570, as illustrated herein, includes one or more site specific databases 572, such as one for worksite area 500 and another for another worksite area. However, this is for ease of understanding only. Other database constructions are also expressly contemplated. Further, both site-specific and general information databases may also include other information 582, 594.

FIG. 11 illustrates an example method for PPE compliance in confined spaces in accordance with embodiments herein. In some areas that require PPE, such as a confined space, every bit of PPE (and generally, every item) that goes in to a space must thereafter come out of the space. The method 900 may be implemented in a PPE compliance system for a worksite that includes a confined space or otherwise includes PPE or equipment that requires inventory of PPE, mechanical or other components. While confined spaces are used as an example, other examples where method 900 may be useful include a flight deck on an air carrier, a production space with sensitive material, etc.

In block 910, a person is detected entering a confined, or other restricted, space. While FIG. 9 specifically illustrates the example of a confined space, other restricted or sensitive spaces may require individuals carry out all materials carried into the restricted space. Detecting may include a camera detecting the individual at an access point, detecting the individual in the area of the confined space, or detecting PPE indicative of the individual entering the confined space. Detecting that an individual is entering a confined space may trigger an inventory of items the individual has with them including equipment 912, PPE 914, and other materials 916, such as tools. The compliance system records the materials that the individual brings into the confined space. In block 920, the individual is detected exiting the confined space. Detecting that the individual has left may include detecting that the individual has re-emerged at the access point When the individual is detected exiting the confined space, the compliance system again inventories the items with the individual, including equipment 922, PPE 924, and other items 926.

In block 930, a check is conducted between the items taken into the confined space and the items taken out of the confined space. If all items are accounted for, no further action is taken. However, if something did not come out, the compliance system generates an alert, as indicated in block 940. The alert may include an inquiry to a worker of the discrepancy. The alert may be presented visually, audibly, or as haptic feedback. The alert may be presented directly to the user, for example using one of the detected PPE, or through another device, for example as an audio broadcast through a nearby speaker or visually on a nearby display.

There may be a reason for the discrepancy, for example the worker may have all the inventoried items, but the alleged missing one may be obscured from view, for example in a pocket or bag. Additionally, the worker may have left it on purpose, e.g. it was a replacement part for a machine and it needed to be left there. Alternatively, the worker may have forgotten the missing item and need to retrieve it. As indicated in block 950, the system may receive feedback from the user. For example, the user may withdraw the undetected item from its obscured location, and the compliance may be noted. If the person had forgotten it, then went back in to retrieve it, the system verifies that the worker exits with the same items as recorded during their first entry to the sensitive space, not the reduced number of items found during the exit and subsequent reentry.

In addition to alerting the worker, an alert may also be generated and sent to a supervisor or safety officer, as indicated in block 944. Other action may also be taken, such as recording the compliance or lack of compliance for later training. FIGS. 11-13 illustrate example devices that can be used in the embodiments shown in previous Figures. FIG. 11 illustrates an example mobile device that can be used in the embodiments shown in previous Figures. FIG. 11 is a simplified block diagram of one illustrative example of a handheld or mobile computing device that can be used as either a worker’s device or a supervisor / safety officer device, for example, in which the present system (or parts of it) can be deployed. For instance, a mobile device can be deployed in the operator compartment of computing device for use in generating, processing, or displaying the data.

FIG. 11 provides a general block diagram of the components of a mobile cellular device 616 that can run some components shown and described herein. Mobile cellular device 616 interacts with them or runs some and interacts with some. In the device 616, a communications link 613 is provided that allows the handheld device to communicate with other computing devices and under some embodiments provides a channel for receiving information automatically, such as by scanning. Examples of communications link 613 include allowing communication though one or more communication protocols, such as wireless services used to provide cellular access to a network, as well as protocols that provide local wireless connections to networks.

In other examples, applications can be received on a removable Secure Digital (SD) card that is connected to an interface 615. Interface 615 and communication links 613 communicate with a processor 617 (which can also embody a processor) along a bus 619 that is also connected to memory 621 and input/output (I/O) components 623, as well as clock 625 and location system 627.

I/O components 623, in one embodiment, are provided to facilitate input and output operations and the device 616 can include input components such as buttons, touch sensors, optical sensors, microphones, touch screens, proximity sensors, accelerometers, orientation sensors and output components such as a display device, a speaker, and or a printer port. Other I/O components 623 can be used as well.

Clock 625 illustratively comprises a real time clock component that outputs a time and date. It can also provide timing functions for processor 617.

Illustratively, location system 627 includes a component that outputs a current geographical location of device 616. This can include, for instance, a global positioning system (GPS) receiver, a LORAN system, a dead reckoning system, a cellular triangulation system, or other positioning system. It can also include, for example, mapping software or navigation software that generates desired maps, navigation routes and other geographic functions.

Memory 621 stores operating system 629, network settings 631, applications 633, application configuration settings 635, data store 637, communication drivers 639, and communication configuration settings 641. Memory 621 can include all types of tangible volatile and non-volatile computer-readable memory devices. It can also include computer storage media (described below). Memory 621 stores computer readable instructions that, when executed by processor 617, cause the processor to perform computer-implemented steps or functions according to the instructions. Processor 617 can be activated by other components to facilitate their functionality as well. It is expressly contemplated that, while a physical memory store 621 is illustrated as part of a device, that cloud computing options, where some data and / or processing is done using a remote service, are available.

FIG. 12 shows that the device can also be a smart phone 771. Smart phone 771 has a touch sensitive display 773 that displays icons or tiles or other user input mechanisms 775. Mechanisms 775 can be used by a user to run applications, make calls, perform data transfer operations, etc. In general, smart phone 771 is built on a mobile operating system and offers more advanced computing capability and connectivity than a feature phone. Note that other forms of the devices are possible.

FIG. 13 is one example of a computing environment in which elements of systems and methods described herein, or parts of them (for example), can be deployed. With reference to FIG. 13, an example system for implementing some embodiments includes a general-purpose computing device in the form of a computer 810. Components of computer 810 may include, but are not limited to, a processing unit 820 (which can comprise a processor), a system memory 830, and a system bus 821 that couples various system components including the system memory to the processing unit 820. The system bus 821 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. Memory and programs described with respect to systems and methods described herein can be deployed in corresponding portions of FIG. 13.

Computer 810 typically includes a variety of computer readable media. Computer readable media can be any available media that can be accessed by computer 810 and includes both volatile/nonvolatile media and removable/non-removable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media is different from, and does not include, a modulated data signal or carrier wave. It includes hardware storage media including both volatile/nonvolatile and removable/non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computer 810. Communication media may embody computer readable instructions, data structures, program modules or other data in a transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.

The system memory 830 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 831 and random-access memory (RAM) 832. A basic input/output system 833 (BIOS) containing the basic routines that help to transfer information between elements within computer 810, such as during start-up, is typically stored in ROM 831. RAM 832 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 820. By way of example, and not limitation, FIG. 13 illustrates operating system 834, application programs 835, other program modules 836, and program data 837.

The computer 810 may also include other removable/non-removable and volatile/nonvolatile computer storage media. By way of example only, FIG. 13 illustrates a hard disk drive 841 that reads from or writes to non-removable, nonvolatile magnetic media, nonvolatile magnetic disk 852, an optical disk drive 855, and nonvolatile optical disk 856. The hard disk drive 841 is typically connected to the system bus 821 through a non removable memory interface such as interface 840, and optical disk drive 855 are typically connected to the system bus 821 by a removable memory interface, such as interface 850.

Alternatively, or in addition, the functionality described herein can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field- programmable Gate Arrays (FPGAs), Application-specific Integrated Circuits (e.g., ASICs), Application-specific Standard Products (e.g., ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Fogic Devices (CPFDs), etc.

The drives and their associated computer storage media discussed above and illustrated in FIG. 13, provide storage of computer readable instructions, data structures, program modules and other data for the computer 810. In FIG. 13, for example, hard disk drive 841 is illustrated as storing operating system 844, application programs 845, other program modules 846, and program data 847. Note that these components can either be the same as or different from operating system 834, application programs 835, other program modules 836, and program data 837.

A user may enter commands and information into the computer 810 through input devices such as a keyboard 862, a microphone 863, and a pointing device 861, such as a mouse, trackball or touch pad. Other input devices (not shown) may include a joystick, game pad, satellite receiver, scanner, or the like. These and other input devices are often connected to the processing unit 820 through a user input interface 860 that is coupled to the system bus but may be connected by other interface and bus structures. A visual display 891 or other type of display device is also connected to the system bus 821 via an interface, such as a video interface 890. In addition to the monitor, computers may also include other peripheral output devices such as speakers 897 and printer 896, which may be connected through an output peripheral interface 895.

The computer 810 is operated in a networked environment using logical connections, such as a Local Area Network (LAN) or Wide Area Network (WAN) to one or more remote computers, such as a remote computer 880.

When used in a LAN networking environment, the computer 810 is connected to the LAN 871 through a network interface or adapter 870. When used in a WAN networking environment, the computer 810 typically includes a modem 872 or other means for establishing communications over the WAN 873, such as the Internet. In a networked environment, program modules may be stored in a remote memory storage device. FIG. 13 illustrates, for example, that remote application programs 885 can reside on remote computer 880.

In the present detailed description of the preferred embodiments, reference is made to the accompanying drawings, which illustrate specific embodiments in which the invention may be practiced. The illustrated embodiments are not intended to be exhaustive of all embodiments according to the invention. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present invention. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims.

Unless otherwise indicated, all numbers expressing feature sizes, amounts, and physical properties used in the specification and claims are to be understood as being modified in all instances by the term “about.” Accordingly, unless indicated to the contrary, the numerical parameters set forth in the foregoing specification and attached claims are approximations that can vary depending upon the desired properties sought to be obtained by those skilled in the art utilizing the teachings disclosed herein.

As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” encompass embodiments having plural referents, unless the content clearly dictates otherwise. As used in this specification and the appended claims, the term “or” is generally employed in its sense including “and/or” unless the content clearly dictates otherwise.

Spatially related terms, including but not limited to, “proximate,” “distal,” “lower,” “upper,” “beneath,” “below,” “above,” and “on top,” if used herein, are utilized for ease of description to describe spatial relationships of an element(s) to another. Such spatially related terms encompass different orientations of the device in use or operation in addition to the particular orientations depicted in the figures and described herein. For example, if an object depicted in the figures is turned over or flipped over, portions previously described as below or beneath other elements would then be above or on top of those other elements.

As used herein, when an element, component, or layer for example is described as forming a “coincident interface” with, or being “on,” “connected to,” “coupled with,” “stacked on” or “in contact with” another element, component, or layer, it can be directly on, directly connected to, directly coupled with, directly stacked on, in direct contact with, or intervening elements, components or layers may be on, connected, coupled or in contact with the particular element, component, or layer, for example. When an element, component, or layer for example is referred to as being “directly on,” “directly connected to,” “directly coupled with,” or “directly in contact with” another element, there are no intervening elements, components or layers for example. The techniques of this disclosure may be implemented in a wide variety of computer devices, such as servers, laptop computers, desktop computers, notebook computers, tablet computers, hand-held computers, smart phones, and the like. Any components, modules or units have been described to emphasize functional aspects and do not necessarily require realization by different hardware units. The techniques described herein may also be implemented in hardware, software, firmware, or any combination thereof. Any features described as modules, units or components may be implemented together in an integrated logic device or separately as discrete but interoperable logic devices. In some cases, various features may be implemented as an integrated circuit device, such as an integrated circuit chip or chipset. Additionally, although a number of distinct modules have been described throughout this description, many of which perform unique functions, all the functions of all of the modules may be combined into a single module, or even split into further additional modules. The modules described herein are only exemplary and have been described as such for better ease of understanding.

If implemented in software, the techniques may be realized at least in part by a computer-readable medium comprising instructions that, when executed in a processor, performs one or more of the methods described above. The computer-readable medium may comprise a tangible computer-readable storage medium and may form part of a computer program product, which may include packaging materials. The computer- readable storage medium may comprise random access memory (RAM) such as synchronous dynamic random access memory (SDRAM), read-only memory (ROM), non volatile random access memory (NVRAM), electrically erasable programmable read-only memory (EEPROM), FLASH memory, magnetic or optical data storage media, and the like. The computer-readable storage medium may also comprise a non-volatile storage device, such as a hard-disk, magnetic tape, a compact disk (CD), digital versatile disk (DVD), Blu- ray disk, holographic data storage media, or other non-volatile storage device.

The term “processor,” as used herein may refer to any of the foregoing structure or any other structure suitable for implementation of the techniques described herein. In addition, in some aspects, the functionality described herein may be provided within dedicated software modules or hardware modules configured for performing the techniques of this disclosure. Even if implemented in software, the techniques may use hardware such as a processor to execute the software, and a memory to store the software. In any such cases, the computers described herein may define a specific machine that is capable of executing the specific functions described herein. Also, the techniques could be fully implemented in one or more circuits or logic elements, which could also be considered a processor.

A worker safety compliance monitoring system is presented. The system includes a camera configured to capture an image of an environment. The system also includes worker identifier, configured to identify a worker within the environment, based on the image. The system also includes a personal protective equipment identifier, configured to identify an article of personal protective equipment on the worker, based on the image. The system also includes a compliance rule retrieval module configured to retrieve a rule for the environment in the image. The system also includes a compliance detector configured to compare the identified article of personal protective equipment with the retrieved rule and, based on the comparison, provide an indication of worker compliance with the retrieved rule. The worker safety compliance monitoring system operates in a compliance detection mode and an active learning mode. The rule retrieved by the compliance rule retrieval module was identified by the camera capturing an image of the environment containing a rule indication during the active learning mode.

The system may be implemented such that the camera has a fixed position within the environment.

The system may be implemented such that the fixed position comprises the camera mounted to a surface within the environment.

The system may be implemented such that the camera is moves within the worksite during the active learning mode.

The system may be implemented such that the camera is worn by an individual in the environment.

The system may be implemented such that the camera is mounted to a machine that moves within the environment.

The system may be implemented such that the worker identifier identifies an identity of the worker.

The system may be implemented such that the article of personal protective equipment is identified as worn by the worker.

The system may be implemented such that identifying the article of personal protective equipment comprises identifying a type of personal protective equipment. The system may be implemented such that identifying the article of personal protective equipment comprises identifying a brand, model or function of the article of personal protective equipment.

The system may be implemented such that it also includes a personal protective equipment retriever configured to retrieve information about the identified article of personal protective equipment.

The system may be implemented such that the information comprises instructions on usage of the article of personal protective equipment.

The system may be implemented such that the indication is a notification sent to a device associated with the worker.

The system may be implemented such that the indication is a notification provided to a device within the environment.

The system may be implemented such that the device displays the notification on a display component or audibly broadcasts the notification over a speaker.

The system may be implemented such that it also includes a storage component configured to store the indication of worker compliance.

The system may be implemented such that it also includes a compliance retriever configured to retrieve a stored indication associated with the worker and provide a training recommendation for worker.

The system may be implemented such that the rule indication is a translation of a sign posted in the environment. The sign includes text or symbols. The translation is provided by a sign reader that recognizes the sign as a potential rule indication and translates the text or symbol to detect a rule.

The system may be implemented such that the rule indication is a detection of a model worker wearing required articles of personal protective equipment.

The system may be implemented such that the rule indication is a communication from an individual in the environment.

The system may be implemented such that the rule indication is received during an initial setup period of the system.

The system may be implemented such that it also includes sending the indication to an access module that provides access to a portion of the environment based on a detected compliance with the retrieved rule. The system may be implemented such that the retrieved rule is specific to an area identified in the camera image. The area is less than an entire field of view of the camera.

A method of detecting compliance with safety requirements in a worksite is presented. The method includes learning, using an active learning module of a compliance system, a safety requirement for the worksite. The safety requirement is identified by detecting, using an image feed from a camera, a safety requirement indication for the worksite and analyzing the safety requirement indication to determine a rule for the worksite. The method also includes identifying a worker in the worksite. Identifying comprises detecting the worker on a received image feed from the camera with a field of view that covers a portion of the worksite. The method also includes retrieving the rule for the worksite. The rule is retrieved from a database of rules for the worksite. The rule comprises a required article of personal protective equipment required for the portion of the worksite in the field of view. The method also includes scanning the worker for an article of personal protective equipment. The method also includes comparing a scan result with the retrieved rule and, based on the comparison, providing a compliance indication.

The method may be implemented such that it also includes detecting an identity of the worker.

The method may be implemented such that the retrieved rule is specific to the portion of the worksite in the field of view.

The method may be implemented such that it includes providing access to a restricted area based on the compliance indication.

The method may be implemented such that it also includes sending the indication to a device associated with the worker.

The method may be implemented such that it includes sending the indication to a device within the environment.

The method may be implemented such that it also includes sending the indication to a datastore of worker compliance.

The method may be implemented such that the indication is associated with the portion of the worksite.

The method may be implemented such that the camera has a fixed position within the environment. The method may be implemented such that the fixed position comprises the camera mounted to a surface within the environment.

The method may be implemented such that the camera is a mobile camera.

The method may be implemented such that the camera is worn by an individual in the environment.

The method may be implemented such that the camera is mounted to a mobile machine within the environment.

The method may be implemented such that it also includes identifying the article of personal protective equipment as worn by the worker.

The method may be implemented such that identifying the article of personal protective equipment comprises identifying a type of personal protective equipment.

The method may be implemented such that identifying the article of personal protective equipment comprises identifying a brand, model or function of the article of personal protective equipment.

The method may be implemented such that it also includes retrieving information about the identified article of personal protective equipment.

The method may be implemented such that the information comprises instructions on usage of the article of personal protective equipment.

The method may be implemented such that learning, using the active learning module, comprises the camera capturing an image of the environment containing a rule indication, and translating the rule indication into the rule.

The method may be implemented such that the rule indication is a sign posted in the environment. The sign includes text or symbols and the translation is provided by a sign reader that recognizes the sign as a potential rule indication and translates the text or symbol to detect a rule.

The method may be implemented such that the rule indication is a detection of a model worker wearing required articles of personal protective equipment.

The method may be implemented such that the rule indication is a communication from an individual in the environment.

The method may be implemented such that the rule indication is received during a training period of the system. The method may be implemented such that it also includes sending the indication to an access module that provides access to a portion of the environment based on a detected compliance with the retrieved rule.

The method may be implemented such that the retrieved rule is specific to an area identified in the camera image. The area is less than the field of view of the camera.

A method of training a compliance system in a worksite is presented. The method includes initiating the compliance system, which includes communicatively coupling the system to a camera within the worksite. The method also includes scanning a worksite, by reviewing an image feed from the camera, for indications of personal protective equipment requirements for the worksite. The method also includes detecting, using a processor of the compliance system, an indication of a potential personal protective equipment rule in the image; translating the indication into a personal protective equipment rule. The method also includes storing the personal protective equipment rule in a rule database associated with the worksite.

The method may be implemented such that it includes detecting a worker in the worksite, comparing the worker with the personal protective equipment rule, and providing an indication of worker compliance based on the comparison.

The method may be implemented such that the indication is a sign in the worksite, and the sign is detected in a received image feed from the camera.

The method may be implemented such that translating comprises identifying a symbol on the sign and retrieving a translation of the symbol from a reference stored in a database accessed by the compliance system.

The method may be implemented such that the indication is a detected model worker within the image feed from the camera. Detecting comprises detecting personal protective equipment worn by the model worker.

The method may be implemented such that the indication is a received communication from an authorized user of the compliance system.

The method may be implemented such that the received communication is a detected sign held by the authorized user in front of the camera.

The method may be implemented such that the camera is a first camera in a first area of the worksite. The compliance system is communicatively coupled to a second camera in a second area of the worksite. A first personal protective equipment rule is detected for the first area. A second personal protective equipment rule is detected for the second area. The first and second rules are different.

The method may be implemented such that the first rule requires a hard hat for the first area. The second rule requires no hard hat for the second area.

The method may be implemented such that it includes detecting an identity of the worker.

The method may be implemented such that the rule is stored in the rules database as specific to the area of the worksite in a field of view of the camera.

The method may be implemented such that the camera has a fixed position within the environment.

The method may be implemented such that the fixed position comprises the camera mounted to a surface within the environment.

The method may be implemented such that the camera is a mobile camera.

A worksite compliance system is presented. The system includes a camera with a field of view. The camera captures an image feed. The system also includes a database storing a safety rule including a required personal protective equipment article for an area within the field of view. The database also includes a datastore of text and symbols corresponding to a plurality of potential safety rules. The system also includes a processor configured to receive the image feed and identify a person in the field of view, receive the safety rule, determine, based on an analysis of the image feed, whether the safety rule is satisfied for the identified person, and generate a compliance result for the individual. The system also includes a training module configured to, when activated: scan the field of view for a rule indication, determining whether the rule indication comprises a new safety rule by referencing the database, and add the new safety rule to the database.

The system may be implemented such that the rule indication is a sign posted in the field of view.

The system may be implemented such that the rule indication is an identification of the person as a model worker, supervisor or safety worker. The system may be implemented such that the person is identified as an authorized worker for the area.

The system may be implemented such that the database also comprises a worker access list. The worker is on the worker access list. Access to a portion of the area is granted based on the compliance result.

The system may be implemented such that the individual is identified as a supervisor. The training module generates a new rule based on a detected personal protective equipment article on the supervisor that is not a currently required personal protective equipment article.

The system may be implemented such that the processor stores the compliance result in the database.

The system may be implemented such that the compliance result is stored in the database associated with the identified person.

The system may be implemented such that the compliance result is stored in the database associated with the area.

The system may be implemented such that the training module retrieves and analyzes stored compliance results and provides a training recommendation for the individual based on detected noncompliance.

The system may be implemented such that the training module retrieves and analyzes stored compliance results and provides a training recommendation for the area based on detected noncompliance.

The system may be implemented such that it also includes the processor sending the compliance result to the worker, a supervisor, or a device in the worksite.

The system may be implemented such that sending the compliance result also comprises generating an alert based on the compliance result. The alert is an audio, visual or haptic feedback.

The system may be implemented such that the training module is automatically activated periodically.

The system may be implemented such that the training module is activated when the person is identified as a worker, supervisor or safety officer.

The system may be implemented such that the camera has a fixed position within the environment. The system may be implemented such that the fixed position comprises the camera mounted to a surface within the environment.

The system may be implemented such that the camera is a mobile camera.

The system may be implemented such that the camera is mounted to a mobile machine within the environment.

The system may be implemented such that the safety rule comprises a required article of personal protective equipment to be worn by the person in the area.

The system may be implemented such that determining whether the safety rule is satisfied comprises identifying an article of personal protective equipment on the person.

The system may be implemented such that identifying the article of personal protective equipment comprises identifying a type of personal protective equipment.

The system may be implemented such that identifying the article of personal protective equipment comprises identifying a brand, model or function of the article of personal protective equipment.

A method for tracking equipment is presented. The method includes detecting a worker entering an area, detecting comprises detecting a worker on a camera feed entering the area, and, based on the detection, identifying an entry inventory of items associated with the worker based on the camera feed. The method also includes detecting the worker leaving the area. Detecting comprises detecting the worker on the camera feed leaving the area, and, based on the detection, automatically identifying an exit inventory of items associated with the worker. The method also includes checking the entry inventory against the exit inventory. The method also includes detecting a discrepancy between the entry and exit inventories. The method also includes generating an alert to the worker. The alert includes a missing item from the exit inventory that is present on the entry inventory.

The method may be implemented such that the area is a confined space. The method may be implemented such that the area is a restricted area with a carry- in, carry-out policy.

The method may be implemented such that detecting the worker entering the area comprises detecting a worker, on the camera feed, approaching the area.

The method may be implemented such that detecting the worker entering the area comprises receiving, from an access point, an indication that the worker is entering the area.

The method may be implemented such that the generated alert comprises an audio, visual, or haptic alert reminding the worker of the missing item.

The method may be implemented such that the generated alert also comprises a response request from the worker.

The method may be implemented such that generating the alert also comprises communicating the alert to a device associated with the worker.

The method may be implemented such that the device is a PPE device worn by the worker.

The method may be implemented such that the device is a detected safety station, display component or speaker near the worker.

The method may be implemented such that it includes receiving an indication from the worker regarding the missing item.

The method may be implemented such that the indication comprises the camera feed detecting the worker revealing the missing item.

The method may be implemented such that the indication comprises a communication that the item was purposefully left in the area.

The method may be implemented such that the generated alert is communicated to a supervisor.

The method may be implemented such that the generated alert is only communicated to a supervisor if a response to the discrepancy is not received from the worker.

The method may be implemented such that the entry inventory comprises a PPE device worn by the worker.

The method may be implemented such that the entry inventory comprises a piece of equipment carried by the worker.

The method may be implemented such that the entry inventory comprises a tool carried by the worker. The method may be implemented such that identifying the entry inventory comprises detecting a plurality of items associated with the worker. The plurality of items are detected based on a camera image feed of the worker entering the area.

The method may be implemented such that identifying the entry inventory comprises detecting a plurality of items associated with the worker. The plurality of items are detected based on a received communication from each of the plurality of items.

The method may be implemented such that the received communication is a short- range wireless communication.

The method may be implemented such that the short-range wireless communication comprises Bluetooth, NFC, NFMI or Zigbee.

Examples

Example 1 : Learning Phase

FIGS. 14A and 14B illustrates an example learning phase for a PPE compliance system. Interfaces 1000 illustrate incoming camera feeds where workers and multiple PPE articles are identified. A running script 1010 illustrates that the PPE learning phase is continuing for another 6.8 seconds before the learning phase will be completed, in FIG. 14A. and the learning phase will continue for another 3.0 seconds. Several distinct PPE articles have been found including, for the worker in FIG. 14A, a “hardhaf ’ and a “safety vest” and for the figure in FIG. 14B, a “disp respirator” and “half_face_piece” and “hardhat.” Because the two workers in FIGS. 14A and 14B are in different areas of a worksite, the rules learned during the learning phase will apply only to the given areas illustrated in FIGS. 14A and 14B, and not to a worksite generally.

However, while this example illustrates a learning phase that is seconds long, it is also contemplated that the learning phase may take up to about 30 seconds, up to about 60 seconds, up to about 120 seconds, up to about 180 seconds, up to about 5 minutes, or up to about 15 minutes. The setup period may also be longer, particularly if multiple rules are present or different rules exist for different types of workers, in which case the learning phase may be an hour, four hours, 12 hours, 1 day, two days, or a week. Longer intervals can be specified, and may be preferred during the initial set up. Example 2: Mobile Camera Feed

FIGS. 15A-15C illustrate a mobile PPE compliance system and example PPE detection display output.

In FIG. 15A an individual 1100 is illustrated wearing a mobile camera unit 1110. Mobile camera unit 1110 is wirelessly connected to a PPE compliance system. The PPE compliance system outputs, as illustrated in FIG. 15B and 15B, through an interface supported by RealWearExplorer 4.0.0, using TensorFlowLite, available from RealWear Inc. The PPE compliance system used for this particular example, is an Android application packaged up and installed on the RealWear system. However, other architectures are expressly contemplated and would be understood by those skilled in the art.

As illustrated in FIG. 15B, using images captured by camera unit 1110, PPE 1130 is required for an area. In FIG. 15B, the PPE compliance system has detected a hardhat with a 99.61% confidence. In FIG. 15C, the PPE compliance system has further detected the needed glasses, with a 94.14% confidence, and gloves with a 99.22% confidence, resulting in an output 1140 that all required PPE were found. The confidence threshold was set to 50%

Similar functionality may be available for individuals wearing PPE configured with a heads-up display.

Example 3 : Compliance Data Output

FIGS. 17A-17C illustrate example outputs from a PPE compliance system. As illustrated in FIG. 17A, compliance rates may be charted overtime in chart 700. A number of workers seen 702, compared to a number of workers 704 in compliance with PPE rules. As illustrated around noon, a spike of activity 706, of a number of workers seen and slight drop in compliance rate could occur, for example during a shift change.

As seen in FIG. 17B, a compliance chart 720 may also illustrate a percent compliance of workers with PPE requirements on a daily basis. A sharp increase 725 illustrates a increase in PPE compliance due to a recent OSHA inspector visit.

As illustrated in FIG. 17C, tracking PPE compliance may result in increased safety culture overtime in chart 750. During the initial data gathering period 760, no additional PPE enforcement is provided. New workers started at the charted location on August 18 and September 3, which is the reason for the compliance rate drops 760. And, at point 770, a safety manager reviews PPE compliance, and does additional training based on detected noncompliance.

Claims

What is claimed is:

1. A worker safety compliance monitoring system comprising: a camera configured to capture an image of an environment; a worker identifier, configured to identify a worker within the environment, based on the image; a personal protective equipment identifier, configured to identify an article of personal protective equipment on the worker, based on the image; a compliance rule retrieval module configured to retrieve a rule for the environment in the image; a compliance detector configured to compare the identified article of personal protective equipment with the retrieved rule and, based on the comparison, provide an indication of worker compliance with the retrieved rule; and wherein the worker safety compliance monitoring system operates in a compliance detection mode and an active learning mode, and wherein the rule retrieved by the compliance rule retrieval module was identified by the camera capturing an image of the environment containing a rule indication during the active learning mode.

2. The system of claim 1, wherein the camera has a fixed position within the environment.

3. The system of claim 2, wherein the fixed position comprises the camera mounted to a surface within the environment.

4. The system of claim 1, wherein the camera is worn by an individual in the environment.

5. The system of claim 1, wherein the camera is mounted to a machine that moves within the environment.

6. The system of any of claims 1-5, wherein the worker identifier identifies an identity of the worker.

7. The system of any of claims 1-6, wherein the article of personal protective equipment is identified as worn by the worker.

8. The system of any of claims 1-7, wherein identifying the article of personal protective equipment comprises identifying a type of personal protective equipment.

9. The system of claim 8, wherein identifying the article of personal protective equipment comprises identifying a brand, model or function of the article of personal protective equipment, and further comprising a personal protective equipment retriever configured to retrieve information about the identified article of personal protective equipment.

10. The system of any of claims 1-9, wherein the indication is a notification sent to a device associated with the worker.

11. The system of any of claims 1-10, wherein the indication is a notification provided to a device within the environment.

12. The system of any of claims 1-11, and further comprising: a storage component configured to store the indication of worker compliance.

13. The system of any of claims 1-12, wherein the rule indication is a translation of a sign posted in the environment, wherein sign includes text or symbols, and wherein the translation is provided by a sign reader that recognizes the sign as a potential rule indication and translates the text or symbol to detect a rule.

14. The system of any of claims 1-13, wherein the rule indication is a detection of a model worker wearing required articles of personal protective equipment.

15. The system of any of claims 1-14, wherein the rule indication is a communication from an individual in the environment.

16. The system of any of claims 1-15, and further comprising: sending the indication to an access module that provides access to a portion of the environment based on a detected compliance with the retrieved rule.

17. The system of any of claims 1-16, wherein the retrieved rule is specific to an area identified in the camera image, and wherein the area is less than an entire field of view of the camera.

18. A method of detecting compliance with safety requirements in a worksite, the method comprising: learning, using an active learning module of a compliance system, a safety requirement for the worksite, wherein the safety requirement is identified by: detecting, using an image feed from a camera, a safety requirement indication for the worksite; and analyzing the safety requirement indication to determine a rule for the worksite; identifying a worker in the worksite, wherein identifying comprises detecting the worker on a received image feed from the camera with a field of view that covers a portion of the worksite; retrieving the rule for the worksite, wherein the rule is retrieved from a database of rules for the worksite, wherein the rule comprises a required article of personal protective equipment required for the portion of the worksite in the field of view; scanning the worker for an article of personal protective equipment; and comparing a scan result with the retrieved rule and, based on the comparison, providing a compliance indication.

19. The method of claim 18, wherein the retrieved rule is specific to the portion of the worksite in the field of view.

20. The method of any of claims 18-19, and further comprising: providing access to a restricted area based on the compliance indication.

21. The method of any of claims 18-20, and further comprising sending the indication to a device associated with the worker.

22. The method of any of claims 18-21, and further comprising sending the indication to a device within the environment.

23. The method of any of claims 18-22, and further comprising identifying the article of personal protective equipment as worn by the worker.

24. The method of claim 23, wherein identifying the article of personal protective equipment comprises identifying a type of personal protective equipment, a brand, a model or a function of the article of personal protective equipment.

25. The method of any of claims 18-24, wherein learning, using the active learning module, comprises the camera capturing an image of the environment containing a rule indication, and translating the rule indication into the rule.

26. The method of claim 25, wherein the rule indication is a sign posted in the environment, wherein sign includes text or symbols, and wherein the translation is provided by a sign reader that recognizes the sign as a potential rule indication and translates the text or symbol to detect a rule.

27. The method of claim 26, wherein the rule indication is a detection of a model worker wearing required articles of personal protective equipment.

28. The method of any of claims 18-27, and further comprising: sending the indication to an access module that provides access to a portion of the environment based on a detected compliance with the retrieved rule.

29. A worksite compliance system comprising: a camera with a field of view, wherein the camera captures an image feed; a database storing: a safety rule, wherein the safety rule comprises a required personal protective equipment article for an area within the field of view; a datastore of text and symbols corresponding to a plurality of potential safety rules; a processor configured to: receive the image feed and identify a person in the field of view; receive the safety rule; determine, based on an analysis of the image feed, whether the safety rule is satisfied for the identified person; and generate a compliance result for the individual; and a training module configured to, when activated: scan the field of view for a rule indication; determining whether the rule indication comprises a new safety rule by referencing the database; and adding the new safety rule to the database.

30. The system of claim 29, wherein the rule indication is a sign posted in the field of view.

31. The system of claim 29 or 30, wherein the rule indication is an identification of the person as a model worker, supervisor or safety worker.

32. The system of any of claims 29-31, wherein the person is identified as an authorized worker for the area.

33. The system of claim 29, wherein the database also comprises a worker access list, and wherein the worker is on the worker access list, and wherein access to a portion of the area is granted based on the compliance result.

34. The system of any of claims 29-33, and wherein processor stores the compliance result in the database and wherein the compliance result is stored in the database associated with the identified person or associated with the area.

35. The system of claim 29, wherein the training module retrieves and analyzes stored compliance results and provides a training recommendation for the individual based on detected noncompliance.

36. The system of any of claims 29-35, and further comprising the processor sending the compliance result to the worker, a supervisor, or a device in the worksite.

37. The system of claim 29, wherein sending the compliance result also comprises generating an alert based on the compliance result, wherein the alert is an audio, visual or haptic feedback.

38. The system of any of claims 29-37, wherein the safety rule comprises a required article of personal protective equipment to be worn by the person in the area.

39. The system of claim 29, wherein determining whether the safety rule is satisfied comprises identifying an article of personal protective equipment on the person.

40. The system of claim 29, wherein identifying the article of personal protective equipment comprises identifying a type of personal protective equipment, a brand, a model or a function of the article of personal protective equipment.