WO2022195383A1

WO2022195383A1 - Systems and methods for worksite safety compliance

Info

Publication number: WO2022195383A1
Application number: PCT/IB2022/051641
Authority: WO
Inventors: Marie D. MANNER; Kiran S. Kanukurthy
Original assignee: 3M Innovative Properties Company
Priority date: 2021-03-16
Filing date: 2022-02-24
Publication date: 2022-09-22

Abstract

A compliance monitoring system is presented. The system includes a sensor in an environment. The sensor generates a sensor signal. The system also includes a hazard identifier configured to identify a hazard within the environment, based on the sensor signal. The system also includes a compliance checklist identifier configured to identify a compliance checklist, based on the identified hazard. The system also includes a compliance checklist retriever configured to retrieve a checklist for the hazard in the image. The checklist has a compliance checklist item. The system also includes a compliance detector configured to analyze the environment for completion of the checklist compliance item, and, based on the comparison, provide an indication of compliance checklist completion. The compliance monitoring system operates in either a compliance detection mode or an active learning mode. The compliance checklist retrieved by the compliance checklist retrieval module was compiled by the compliance monitoring system during an active learning mode based on the sensor signal.

Description

SYSTEMS AND METHODS FOR WORKSITE SAFETY COMPLIANCE

Background

Maintaining the safety and health of workers is a major concern across many industries. Various rules and regulations have been developed to aid in addressing this concern. Such rules provide sets of requirements to ensure proper administration of personnel health and safety procedures. To help in maintaining worker safety and health, some individuals may be required to don, wear, carry, or otherwise use a personal protective equipment (PPE) article, if the individuals enter or remain in work environments that have hazardous or potentially hazardous conditions.

Consistent with evolving rules and regulations related to safety, safety is an important concern in any workplace. Companies or businesses employing workers wearing articles of PPE also want to ensure that workers are complying with relevant laws, regulations and company policies related to proper use and maintenance of PPE.

Summary

A compliance monitoring system is presented. The system includes a sensor in an environment, wherein the sensor generates a sensor signal. The system also includes a hazard identifier configured to identify a hazard within the environment, based on the sensor signal. The system also includes a compliance checklist identifier configured to identify a compliance checklist based on the identified hazard. The system also includes a compliance checklist retriever configured to retrieve a checklist for the hazard in the image. The checklist has a compliance checklist item. The system also includes a compliance detector configured to analyze the environment for completion of the checklist compliance item, and, based on the comparison, provide an indication of compliance checklist completion. The compliance monitoring system operates in either a compliance detection mode or an active learning mode. The compliance checklist retrieved by the compliance checklist retrieval module was compiled by the compliance monitoring system during an active learning mode based on the sensor signal.

The details of one or more examples of the disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the disclosure will be apparent from the description and drawings, and from the claims. Brief Description of the Drawings

FIGS 1A and IB illustrate worksites in which embodiments of the present invention may be useful.

FIGS. 2A-2D illustrate a compliance detection system in accordance with embodiments herein.

FIG. 3 illustrates an example method of configuring a compliance system in accordance with embodiments herein.

FIG. 4 illustrates a compliance system in an example toxic environment.

FIG. 5 illustrates a compliance system in an industrial environment.

FIG. 6 illustrates a compliance system in an example elevated environment.

FIG. 7 illustrates a compliance system in an example high volume environment.

FIG. 8 illustrates a block diagram of an example environment in accordance with embodiments herein.

FIG. 9 illustrates an example method for monitoring safety compliance in accordance with embodiments herein.

FIGS. 10-12 illustrate example devices that can be used in embodiments herein.

Detailed Description

Manually monitoring compliance with PPE use and other safety rules in a given workplace can be cumbersome and time consuming for supervisors or safety compliance officers. Improved methods and systems for monitoring safety compliance, PPE maintenance, and providing safety-related contextual information in a work environment requiring the use of PPE are needed.

One way to monitor safety in a working environment is by using compliance checklists for safety in an environment. One problem facing safety officers, particularly in a new environment (such as a new plant, a new construction site, a renovated area, etc.) is creating and uploading checklists for known hazards into a system. Prior art systems include checklist generators that receive information about an individual and generate a checklist (such as U.S. PAP 2016/0092635 to Samsung Electronics), or generating maintenance checklists and due dates based on medical technology (such as U.S. PAP 2005/0055225 to Siemens). However, a system is desired that can detect hazards in an environment, populate relevant checklist items based on the detected hazards, and generate safety checklists, without requiring a safety officer to manually input checklist items and associate checklists with given areas or hazards for a worksite. Additionally, it is desired for the same system to then monitor compliance with the generated checklists. In some embodiments here, the safety checklists are modifiable, such that a safety officer can add, modify or remove checklist items from checklists.

Many industrial environments have camera systems for security monitoring. Systems and methods herein use camera systems in place to monitor environments to detect areas and hazards that may require safety checklists to enter or interact with. Systems and methods herein can also integrate with communication systems present in an environment, such as PPE systems and safety stations, which can receive audio, visual or haptic feedback regarding potentially overlooked checklist items.

As used herein, the term “hazard” refers to anything in an environment to which a checklist, or item on a checklist, may be associated. For example, an individual worker is a “hazard” in that the individual may be injured if they do not complete all items on a safety checklist. Similarly, equipment, such as power tools, vehicles, or machinery are considered “hazards” in that improper usage can cause injury or damage to the machine. Areas within a larger environment may also be “hazards” - such as confined spaces, lab spaces, etc. - because failure to meet safety checklist requirements can cause injury. Additionally, items like PPE can be hazards as, without proper maintenance and inspection, they can cause, or fail to prevent, injury to a user.

FIGS 1A and IB illustrate worksites in which embodiments of the present invention may be useful. FIG. 1A is a block diagram illustrating an example network environment 2 for a worksite 8 A or 8B. The worksite environments 8 A and 8B may have one or more workers 10A-10N, each of which may need to interact with equipment or environments that require the use of personal protective equipment such as glasses, hard hats, fall protection equipment, respirators, gloves, etc. Workers 10A-10N may have a range of experience with a given worksite, with some knowing and complying with safety rules, and others who do not know, are still in training, or actively not complying with all safety requirements.

Environment includes a compliance system 6 for detecting hazards, generating compliance checklists, and managing compliance with those checklists. As described herein, individual checklist items may be generated based on posted signs or rules concerning personal protection equipment (PPE) requirements in an area. However, compliance checklists may come from other sources as well. For example, medical checkups may be required based on exposure. Training requirements may also be generated based on detected hazards. Fit test requirements may also be required based on a given PPE worn by a worker. Maintenance requirements for PPE, equipment and machinery in an area may also be sources of checklist items.

Compliance system 6 may reduce incidents of noncompliance by workers’ PPE rules, reducing the risk of injury and increasing safety within a worksite 2. Compliance system 6 may also allow safety professionals to more easily manage area inspections, worker inspections, worker health and safety compliance training, without the typical onboarding or updating process required for new machinery, new PPE or other safety rules, or other environment changes.

In general, compliance system 6, as described in greater detail herein, is configured to leam rules for environments 8A and 8B, generate checklists for individuals and safety managers in the environments, and monitor compliance with those safety requirements. System 6 may be connected, through network 4, to one or more devices or displays 16 within an environment, or devices or displays 18, remote from an environment. System 6 may provide alerts to workers 10A-10N when checklist items are not completed, or not completed correctly, as well as provide feedback on types of PPE that may be appropriate for a given situation. System 6 may also provide an alert or indication when a required checklist item may be complete, but cannot be verified. For example, in-ear hearing protection, worn under a helmet, may not be readily identified using image feeds from cameras in a worksite.

System 6 may also be integrated into entry protocols for secured areas within an environment such that workers that do not have compliant PPE, or completed a different checklist requirement are restricted out of a secure or dangerous area.

As shown in the example of FIG. 1A, system 2 represents a computing environment in which a computing device within of a plurality of physical environments 8A, 8B (collectively, environments 8) electronically communicate with PPE compliance system 6 via one or more computer networks 4. Each of physical environments 8 A and 8B represents a physical environment, such as a work environment, in which one or more individuals, such as workers 10, utilize personal protection equipment while engaging in tasks or activities within the respective environment.

In this example, environment 8A is shown as generally as having workers 10, while environment 8B is shown in expanded form to provide a more detailed example. In the example of FIG. 1A, a plurality of workers 10A-10N may be wearing a variety of different PPE, such as ear muff hearing protectors, in-ear hearing protectors, hard hats, gloves, glasses, goggles, masks, respirators, hairnets, scrubs, or any other suitable personal protective equipment. As illustrated in FIGS. 3-7, workers 10A-10N may be in a variety of different situations in an environment.

In some embodiments herein, an article of PPE may include one or more of embedded sensors, communication components, monitoring devices and processing electronics. In addition, each article of PPE may include one or more output devices for outputting data that is indicative of operation of the PPE and/or generating and outputting communications to the respective worker 10A-10N. For example, PPE may include one or more devices to generate audible feedback (e.g., one or more speakers), visual feedback (e.g., one or more displays, light emitting diodes (LEDs) or the like), or tactile feedback (e.g., a device that vibrates or provides other haptic feedback).

In some examples, each of environments 8 include computing facilities, such as displays 16, or through associated PPEs, by which workers 10 can communicate with PPE compliance system 6. For examples, environments 8 may be configured with wireless technology, such as 802.11 wireless networks, 802.15 ZigBee networks, and the like. In the example of FIG. 1A, environment 8B includes a local network 7 that provides a packet- based transport medium for communicating with PPE computing system 6 via network 4. In addition, environment 8B includes a plurality of wireless access points 19A, 19B that may be geographically distributed throughout the environment to provide support for wireless communications throughout the work environment.

As shown in the example of FIG. 1A, an environment, such as environment 8B, may also include one or more wireless-enabled beacons, such as beacons 17A-17C, that provide accurate location information within the work environment. For example, beacons 17A-17C may be GPS-enabled such that a controller within the respective beacon may be able to precisely determine the position of the respective beacon. Alternatively, beacons 17A-17C may include a pre-programmed identifier that is associated in compliance system 6 with a particular location. Based on wireless communications with one or more of beacons 17, or data hub 14 worn by a worker 10, compliance system 6 is configured to determine the location of the worker within work environment 8B. In this way, event data reported to compliance system 6 may be stamped with positional information. This may be helpful in the event a supervisor or safety officer needs to respond to a missed compliance checklist item.

In example implementations, an environment, such as environment 8B, may also include one or more safety stations 15 distributed throughout the environment to provide viewing stations for accessing compliance system 6. Safety stations 15 may allow one of workers 10 to check out articles of PPE and/or other safety equipment, verify that safety equipment is appropriate for a particular one of environments 8, and/or exchange data. For example, safety stations 15 may transmit alert rules, software updates, or firmware updates to articles of PPE or other equipment.

In addition, each of environments 8 include computing facilities that provide an operating environment for end-user computing devices 16 for interacting with compliance system 6 via network 4. For example, each of environments 8 typically includes one or more safety managers or supervisors, represented by users 20 or remote users 24, are responsible for overseeing safety compliance within the environment. In general, each user 20 or 24 interacts with computing devices 16, 18 to access compliance system 6. For example, the end-user computing devices 16, 18 may be laptops, desktop computers, mobile devices such as tablets or so-called smart cellular phones.

Users 20, 24 interact with compliance system 6 to control and actively manage many aspects of safely equipment utilized by workers 10, such as accessing and viewing usage records, analytics and reporting. For example, users 20, 24 may review compliance and noncompliance information acquired and stored by compliance system 6. In addition, users 20, 24 may interact with compliance system 6 to review or edit checklists currently in effect, add new checklists or checklist items based on new procedures or regulations or provide other updated information.

Compliance system 6 may be configured to actively monitor workers 10A-10N and other users 20 within an environment 8 both for compliance with existing checklist items and to detect new ones. Referring to FIG. IB, a worksite may have one or more cameras 30, either fixed within the worksite, mobile (e.g. drone, robot or equipment-mounted) or associated with a worker 10A-10N (e.g. an augmented reality headset or other camera worn in association with PPE, etc.). Using the one or more cameras, compliance system 6 can identify whether or not a worker 10A-10N is in compliance with known rules for a given area of the worksite. Compliance system 6 is also configured, using cameras 30, to identify signs 40 within a field of view 35 of a camera. A sign 40 may be identified by shape, or the detection of writing or symbols 45. Compliance system 6 may be able to detect, from the writing or symbols 45, that a safety rule is in effect for a given area, and create a checklist item accordingly. For example, based on the detection and reading of sign 40 of FIG. IB, compliance system 6 may add a “Safety Glasses Required” checklist item to a checklist of compliance requirements for an area where sign 40 is posted.

As another example, compliance system 6 may further trigger an alert if a checklist item is missed, either once or repeatedly by a given worker. The alert may be sent to worker 10, either through a communication feature of a PPE, a separate communication device, or through a public address system within the environment. A noncompliance alert may also be sent to a supervisor or safety officer associated with the environment 8 as well. Noncompliance with checklist items may also be tracked and stored within a database, as described herein. Additionally, noncompliance may serve as an indicator that a requirement has relaxed for an area, and that a checklist item may be changed or changing, and may be removed.

Techniques and components of this disclosure may improve the safety of workers within an environment by improving PPE and safety compliance within a work environment. Systems and methods herein may also provide general information about when additional training, medical checkups, or other safety requirements are needed for a worker or group of workers. Additionally, systems and methods herein can help workers within an environment look out for each other by seeing alerts concerning missed checklist items.

FIGS. 2A-2D illustrate an active learning mode of a compliance system in a worksite in accordance with embodiments herein. As discussed below, a compliance system may have an active learning component that allows the system to add new compliance checklist items. Once PPE compliance rules and other safety rules for a worksite are learned, PPE compliance system can generate compliance checklists and monitor the worksite for completion of checklist items by workers and other individuals. The compliance system may be able to identify workers and capture PPE usage and compliance data, missed checklist items, as well as other safety data. The compliance system may also be integrated with a security or access system, such that failure to complete all checklist items may result in an alarm, denied access to a restricted area, or an inoperable device. The compliance system may be able to grant access, or permit device operation, and / or cease an alarm when a missing checklist item is completed.

The illustrated view of FIGS. 2A-2D illustrate how the compliance system works, and may or may not be presented to a user. In some embodiments, the views of FIGS. 2A- 2D may be an augmented view presented at a safety station, such as stations 15 illustrated in FIG. 1A, on a display to a supervisor or an augmented view presented in a heads-up display worn by another worker, supervisor or safety officer, in some embodiments. In other embodiments, the views of FIGS. 2A-2D, may simply illustrate the operation of a compliance system and may not actually be presented to a user on a display.

FIGS. 2A and 2B illustrate a compliance system determining whether a worker meets each checklist item to access an environment. As illustrated in FIG. 2A, an environment 100 requires a hardhat to enter.

During an active phase of operation, a compliance system detects a hazard 110 within an environment 100. Detecting a hazard may include detecting movement in an environment, for example using a motion sensor or by detecting motion in a video feed captured by a camera in the environment. The hazard 110 may be identified as a worker 110 and, based on that identification, a safety checklist for the area may be retrieved from a database. As illustrated in FIGS. 2A and 2B, in additional to other safety requirements, area 100 includes a hardhat requirement that must be satisfied for worker 110 to safely operate in environment 100.

As illustrated in FIGS. 2A and 2B, the worker 110 may be identified as a particular individual. Not illustrated in FIGS. 2A and 2B may be an additional checklist item, for example that worker 110 be an individual who is authorized to be in environment 100. For example, worker 110 may also have required training on particular equipment, or otherwise to enter environment 100.

In such instances worker 110 may need to present a security badge or another identifier, either to compliance system or another detector in communication with the compliance system, and the compliance system may grant access based on a positive identification. Additionally, the compliance system may be configured to identify workers in a worksite using facial or other recognition techniques, by identifying a given PPE associated with a worker 110 (such as a checked-out protective hearing device, respirator, hazardous material suit, etc.).

As illustrated in FIG. 2A, PPE compliance system has a checklist item for a required PPE 114 of a hardhat for a given environment. The hardhat is not detected in FIG. 2A. While worker 110 is indicated as an allowed worker 116 for a given site, she does not have granted access because of the missing hardhat.

In FIG. 2B, worker 110 has donned a hardhat 122, and now the “hardhat required” checklist item is satisfied 115. As such, access is granted, as indicated by indicator 120. In between FIG. 2A and 2B, the compliance system may have, for example, generated a visual, audio, or haptic alert delivered through lights or speakers in environment 100, or through a PPE device that worker 110 is wearing, or using another suitable method.

FIG. 2C illustrates a view 130 of a compliance system detecting an individual 134 wearing several pieces of PPE, namely a hard hat 132 and a respirator 136. In the illustrated example, a compliance system as illustrated in FIG. 2C detects a worker 134 in an environment 130, and retrieves a compliance checklist for the worker 134 to be in environment 130. As illustrated in FIG. 2C, a checklist 135 requires a user to have a hard hat, a respirator, and gloves in order to enter a given area. Checklist 135 may be communicated to a worker 134, for example on safety station display next to an access point, on a display screen within a worksite near worker 134, or in another suitable place within a worksite. Additionally, the missing checklist item from checklist 135, namely that worker 134 is missing “gloves” may be communicated audibly to the user, either through a speaker on an associated PPE, through a safety station, through a public address speaker, or through another suitable mechanism. Further, the contents of checklist 135 may be communicated in another suitable matter.

As illustrated in FIG. 2D, once gloves 138 are detected, checklist 135 may be completed and worker 134 may receive access 140 to an area within the worksite. However, while “Access Granted” is illustrated as a result in FIG. 2D, it is expressly contemplated that a compliance system may be configured only to monitor for compliance or noncompliance, and may not be integrated into, or in communication with, a security access feature. In some instances, a worker may operate in multiple, different work environments in a single workday or other work interval (e.g., hour/week/month/year interval, project interval, and the like). Each work environment may have different safety requirements. A work environment may have different safety requirements as a result of different characteristics of the work environment. Characteristics of the work environment may include hazards (e.g., contaminants, low-lighting, uneven surfaces, voids, etc.), physical conditions (noise, heat, confined location, etc.), work environment operating times, or any other characteristic. Referring back to FIG. 1A, as an example, worker 10A may be equipped with PPE, such as a powered-air purifying respirator (PAPR) to filter contaminants from the air in work environments 8A and 8B. Work environment 8 A may include contaminants that require a particulate filter in the PAPR, while work environment 8B may include contaminants that require both an organic vapor filter and a particulate filter in the PAPR.

In a single workday, worker 10A may work in both environment 8A and 8B. If worker 10A moves from work environment 8 A to 8B without adding an organic vapor filter to the PAPR, worker 10A may be exposed to harmful organic vapor filters as a result. Worker 10A may not add the organic vapor filter when moving between work environments for a variety of reasons. For instance, worker 10A not be aware of the differing characteristics of work environment 8 A and 8B, worker 10A may forget that characteristics of work environment 8 A and 8B differ, worker 10A may be distracted or fatigued, or worker 10A may not be aware that he or she has moved from one work environment to another, to name only a few examples of when noncompliance with PPE requirements may be inadvertent.

Similarly, a worker 10A may not be aware of training requirements needed to be in a given area, or may not have realized they require training on a given machine or are overdue for a health or fitness check. Integrating safety checklists with such requirements into a compliance monitoring system that can directly communicate, using PPE, safety stations or other communication channels within an environment, helps to keep a specific worker 10A safe and up to date, and may also prevent injury to other workers.

It is important, therefore, that a compliance system not only identify whether a user is wearing the right type of PPE articles, but also be able to retrieve important data about other safety requirements to ensure that a worker has satisfied all checklist items to safely interact with a given work environment. FIG. 3 illustrates an example method of configuring a compliance system in accordance with embodiments herein. A compliance system may, as indicated by arrow 240, move between an active phase and an active learning phase, after undergoing an initial learning phase for a worksite.

In block 210, the compliance system enters a learning phase. The learning phase may occur online or offline, such that the compliance system can, in some embodiments, be installed activated on-site and enter the learning mode in a live worksite. In other embodiments, the PPE compliance system undergoes at least some learning prior to activation in a live environment.

The learning phase involves the compliance system learning existing rules for a given worksite. The compliance system may leam by identifying indications of potential hazards 212 and checklist items 214. Some checklist items 214 may be identified by identifying workers 212 within a worksite, such as a badge-wearing or wearing worker, and determining what PPE is work by said workers 212. The compliance system may identify the PPE worn by the model worker and assume the identified worker is wearing the PPE in compliance with existing regulations and site rules. To confirm that assumption, in some embodiments, the compliance system identifies a second worker, and continues identifying model workers until a consensus is reached on PPE required in an area. A similar process may be done for other potential checklist items.

Other hazards 212 may be identifiable by accessing stored hazard information in a database. For example, heavy construction machinery may be readily identifiable by its shape and / or by an observed brand name, or make and model. Additionally, equipment, such as distillation towers or pipelines, may also be readily identifiable by referencing a database. Additionally, in some embodiments, hazards can be identified by a safety officer or supervisor providing them to the compliance system, either through an I/O device or using the camera system, for example by holding up a sign next to a piece of unidentified machinery that the compliance system may use to identify the machinery. Compliance system also learns by detecting signage and ‘reading’ safety warnings on signs detected in an environment. Signs may be detected on walls, floors, on machinery, or elsewhere. The compliance system, having detected a sign, may parse a safety rule by referencing

Identifying checklist items 214 may be done, in some embodiments, by using a camera system to identify patterns of behavior by workers in an environment. For example, if workers in an environment are all wearing N95 respirators, face shields, and gloves, compliance system may infer that said PPE are three checklist items 214 to enter the area.

The learning phase may also involve the compliance system identifying a model supervisor. Identifying a model supervisor may include identifying a known supervisor or safety officer for a worksite and identifying PPE articles worn by the identified supervisor. Alternatively, the model supervisor may identify themselves to the compliance system (for example using a textual sign that the PPE compliance system can read) and the compliance system can then identify the PPE worn by the supervisor and determine that the identified PPE is the required PPE for that area of the worksite.

Identifying checklist items in the learning phase may also include identifying textual or symbol-based signs that may indicate whether PPE is required, or whether other safety requirements are present for a given area. For example, a sign may symbolically illustrate falling debris, indicating that a hard hat is required. Alternatively, a sign may explicitly state that “hard hat required beyond here” indicating that the area beyond the sign requires a hard hat. Further, a sign may indicate that “fit testing recommended” next to a hearing protection dispensing area.

Additionally, other checklist items may be populated based on identified features in an environment, or by identified hazards 212. For example, since an N95 respirator was identified, each worker must undergo a fit test for an N95 respirator to ensure that they know how to safely wear a respirator. Additionally, the worker may need to meet training or security requirements in order to access a worksite area. Therefore, a full checklist for a worker in an environment may include wearing an N95 respirator, wearing a face shield, wearing gloves, having an up to date fit test training, and having a security clearance for the area.

In block 216, the checklists and checklist items are associated with an identified hazard. For example, an entire area may be identified as a hazard because all workers in the area wear the same PPE. Identified PPE requirements, safety requirements and required training may then be compiled into a checklist and associated with a hazard such that, when the hazard is identified, the checklist is retrievable in the active mode. Some hazards may be a combination of items, such as not only a worker, but a worker in area A, which may trigger retrieval of a different checklist than a worker in area B. The learning phase may also involve other steps or other components, as indicated in block 218. For example, while a stationary camera may be positioned to identify workers entering and leaving an area, the learning phase may be more comprehensive, and faster, if the compliance system is connected to a mobile camera, such as a drone, which can systematically view the entire worksite to identify hazards and checklist items.

In block 220, once a learning phase is complete, the PPE compliance system enters an active phase. In the active phase, the PPE compliance system identifies compliance- related items and potential hazards within a worksite. For example, the PPE compliance system may identify a hazard indicial, as indicated in block 222, within a worksite and check to determine whether the hazard indicia is associated with a checklist or checklist item, and retrieve the associated checklist item as indicated in block 224. For example, a worker could be detected, and an associated checklist for a worker in the environment could be retrieved. The worker could be wearing a respirator, which may indicate the presence of gas, which may be associated with another checklist, that could be pulled.

Once a checklist is retrieved, the compliance system determines whether each checklist item has been met, as indicated in block 226. Compliance or noncompliance with PPE rules may be recorded for each checklist item, for an entire checklist, or both, as indicated in block 228. Completion of a checklist item may be tracked, for example with a worker ID of a worker completing the checklist item, and a time completed. Additionally, a compliance system may provide an alert to a supervisor of an incomplete checklist item, or an alert to nearby workers of an incomplete checklist item, or an alert to the noncompliant worker. The alerts may also be stored and tracked in a database such that a supervisor or safety officer can review them to determine whether additional training is needed for a worker or group of workers. Other functionality may also be provided while in the active phase, as indicated in block 229. For example, while the system is described as based on video feeds provided by cameras in an environment, other sensory information may also be provided to the system, such as an air quality sampling system, a weather-monitoring system, or another system that may provide other hazard indicia. For example, hazards in an environment may only be present when certain conditions are met. A surface may only be slippery when wet, and some areas may be off limits in a thunderstorm.

In block 230, the compliance system enters an active learning phase. In the active learning phase, the compliance system actively looks for new hazard indicia, compliance rules or other changes that may require updated checklist items, new checklist items, or removal of existing checklist items. For example, a supervisor or safety officer may notify the compliance system of a new checklist item, as indicated in block 232. Notification could include sending a communication to the compliance system, typing or otherwise entering the new checklist item into compliance system using an input device like a keyboard, or another input mechanism. Notification could also include the supervisor or safety officer holding up a handwritten sign to a camera connected to the compliance system. The compliance system may identify the supervisor or safety officer as an individual authorized to submit new rules and enter the new checklist item into a database of checklist items.

The compliance system, in an active learning phase, may detect a behavior change, as indicated in block 234. Detecting a behavior change may include the compliance system reviewing instances of missed checklist items and noticing, for example, that a large group of workers have discontinued use of a given PPE. For example, during a viral outbreak, it may be necessary for workers to wear additional PPE, such as facemasks, that are then not required when the outbreak subsides. When the risk of spreading the illness is gone, the workers may stop wearing their facemasks. Upon detecting that a significant percentage of workers have ceased using facemasks, compliance system may either automatically adjust a checklist to remove the ‘facemask’ checklist item, or send a request for confirmation of the change to a supervisor or safety officers.

The active learning phase may also include the compliance system detecting a change in an environment, as indicated in block 236. For example, posted signs in the worksite may change over time as safety rules and regulations change. A change in posted signage may include cameras detecting that a sign has been added, removed, changed in shape, size, color, or position, or otherwise been altered since a last review. Upon detecting that a sign has changed, the compliance system may review the new sign for safety rules that may indicate new checklist items are needed. Often, signs may be updated or replaced with new font, details, or symbols, and no new safety rules are actually implemented. However, if a new safety rule is detected, it may be automatically added to a database of checklist items and associated with one or more hazard indicia.

Detecting an environment change may also include detecting new equipment, such as a new piece of machinery that may require implementation of a new checklist for the environment, or new checklist items for existing checklists. For example, the new piece of machinery may be loud when in operation, causing a “hearing protection” PPE requirement to be added to a “worker” checklist retrieved when a worker is within a vicinity of the new machine while it is operating.

The active learning phase may also include other functionality 238, such as receiving new information from other sources, including other sensory systems. Additionally, when implemented in a networked environment, an active learning phase may include comparing stored checklists to cloud-based checklists to search for other applicable checklist items.

The active learning phase of block 230 may require significant power and / or data retrieval and analysis. Therefore, it may be desired for the compliance system, after an initial learning phase, to periodically switch between the active phase of block 220 and the active learning phase of block 230, as indicated by arrow 240. The active learning phase may be entered periodically, as indicated in block 242, for example once daily, once weekly, once monthly, or any other suitable interval for a worksite. In another embodiment, the active learning phase may only be entered based on a manual initiation, as indicated in block 244, such as a supervisor or safety officer initiating a new sweep of a worksite for signage or current worker behavior. Other suitable triggers are also envisioned, as indicated in block 246. For example, after detecting that more than about 30% of workers were recently or are currently skipping a checklist item, or more than about 40%, or more than about 50%, or more than about 60%, or more than about 70%, or more than about 80%, or more than about 90%, or substantially all workers are currently non-compliant.

Other suitable triggers may also include an indication that a “system has been rebooted”, or that a “supervisor has walked through the area”, or that a “model employee has walked through the area with a different set of PPE” than a rule indicated, or that “large machinery has moved through the area”, or that “the workspace has been reconfigured” (e.g. walls have come up or down, tables have moved, scaffolding has been removed) or a detection that a “camera location has moved.” Other potential suitable triggers are also expressly contemplated.

FIGS. 4-7 illustrate example checklist generation scenarios in accordance with embodiments herein.

FIG. 4 illustrates a sample image retrieved from a camera in an example toxic environment. The image may be one of many in a video feed captured by a stationary or mobile camera communicated to a compliance system for environment 400. A worker 400 is detected wearing a self-contained breathing apparatus (SCBA) 406, a high visibility vest 404, and a gas detector 402 and is carrying a flashlight 408. It may be assumed that each of PPE 402, 404 and 406 are required items for the area.

The compliance system generates a checklist based on the detected PPE of any detected workers based on known regulatory requirements. Worker 410 requires: (1) a medical exam annually and (2) a breathing test for SCBAs annually, for example. Additionally, if it is detected that either worker 410 or the other worker are in a confined space (either by signage or other indicia), annual confined space training is also required. Regulatory-based checklist items may be stored in a remote database (e.g. on the cloud), or an on-premises server. In some embodiments, based on PPE or other items detected by the camera, the system requests checklist items and receives them from the server. In another embodiment, regulatory-based checklist items are stored locally on the camera system and accessed by a local operating system. For example, there are currently smart cameras (e.g. Amazon DeepLens) that could have the database locally. The database itself could be as simple as a local text JSON file or as complicated as a remote Azure SQL blob storage database or another suitable configuration.

Additionally, checklists are generated for the detected PPE. Gas detector 402 requires a daily bump and calibration test, and the SCBA 406 requires a monthly respirator inspection. Therefore, a checklist that may be retrieved when worker 410 is detected in the area may include:

1) SCBA

2) High vis vest

3) gas detector

4) annual medical exam

5) SCBA breathing test

6) Gas detector bump and calibration test

7) SCBA monthly respirator inspection

The compliance system may also have access to a database which may provide information on whether items #4, 5 and 7 have been done within a suitable time frame. If #6 is not detected by the camera (e.g. if the calibration test was done in a different environment), or the data is not available in a database, the compliance system may indicate that the item is incomplete, or may send a query to gas detector 402 (if it is a networked device) or to worker 410. As illustrated in FIG. 4, items #1-3 can be detected in the image of environment 400.

In the example of FIG. 4, then, a worker checklist may be considered completed, and full compliance with the checklist recorded.

It is also expressly contemplated that the automatically generated checklists may be modified. For example, worker 410 may be identified as “John Smith” or as “Employee X1234”. A safety officer may also add or modify inspections, for example requiring “John Smith” to also have an “annual eye exam” and an “annual breathing test.” Additional checklist items may be added, including a “fall protection harness” that either was not detected during the initial learning phase or is newly required. Additional worker lists, inspection requirements, assets and asset inspections may also be imported into the system.

FIG. 5 illustrates a compliance system in an industrial environment. In some embodiments, the system may also have access to mobile cameras, such as image 500 taken from a head-mounted camera and display system, in addition to closed-circuit television from security cameras. Mobile cameras may be useful for the learning phase of a compliance system to capture more hazard indicia quickly.

For example, video footage may record four different areas in an environment, each with different hazard indicia. For example, Area A contains hoists, forklifts, ladders, fire extinguishers, Area B contains reusable respirators, welding helmets, and welding machinery, Area C contains powered air-purifying respirators, spill carts, exhaust hoods and Area D (illustrated in image 500) contains jumbo rollers, hoists, and many workers.

An asset inspection list may be generated for the environment, including 7 hoists, 2 forklifts, 5 ladders, and 2 fire extinguishers in Area A. An inspection checklist may then be generated for each asset, in each area. For example, a hoist 520 requires examining brakes, hooks, hook latches, load chains, nuts and bolts and metal surfaces. A jumbo roller 530 requires examining lights, brakes and hooks. Workers 510 may need to wear close-toed shoes.

In an active learning phase, a safety officer may review the suggested checklists, and add modifications as needed. For example, an “Area A” may be renamed to “Loading dock” and additional checklist items may be added or time requirements changed, for example a hoist checklist may initially be set for a weekly inspection and changed to daily. Additional machinery may be added (e.g. an additional fire extinguisher not detectable by the head- mounted camera) and additional area lists, assets lists, and asset inspection lists may also be uploaded.

FIG. 6 illustrates a compliance system in an example elevated environment 600. Many construction sites require workers 610 to work at higher levels using fall protection equipment such as a harness 626 connected to a lifeline 628. A worker 610 may need to wear a hardhat 624 and hearing protection 622. For example, hearing protection 622 may not only protect a user’s hearing, but may also provide a communication mechanism to other workers within environment 600.

Using the video footage from the camera(s), for example drones for work environment at heights, system detects worker 610 wearing PPE (622-628) in an environment 600.

Based on the detected hazard indicia (e.g. worker 610 and PPE 622-628), a compliance system generates a worker inspection list that includes:

1) Annual medical exam

2) Fall protection training

3) Hearing protection fit and noise reduction rating (NRR) test (e.g. yearly)

4) Hearing test (boom mic on this hearing protection model indicates audible conversation is needed on the job)

A separate checklist may be generated based on the detected PPE, which may include:

1) Fall protection harness 626 needs on-demand inspection of webbing and metal buckles for discoloration, cuts, holes, and rust by user 610

2) Fall protection harness 626 requires yearly inspection by competent person

3) Hearing protection 622 requires monthly testing of channel reception, audio levels, and microphone

4) Lifeline 628 needs on-demand inspection of the gate, spring, other metal pieces, and webbing for damage such as rust, holes, sun damage, and cuts

The compliance system may also generate an area inspection list based on the PPE and worker configuration found that may include: 1) Fall protection anchor points 630 need weekly inspection by competent person (e.g., because worker was found to be wearing both fall protection harness and lifeline)

2) Fall protection structure anchor points (e.g. where a worker stands or is connected via fall-arresting lifeline) must be inspected weekly by a competent person (e .g . a trained inspector, worker 610, or both)

A safety officer may review each of the suggested lists and make appropriate changes. For example, a worker name or ID number may be added. Additional test requirements may be added, for example a yearly disposable respirator fit test may be required for worker 610. Checklist items may be modified, for example fall protection training may be required every 6 months instead of annually. Assets may be added, for example a full-face piece respirator may be required that worker 610 neglected to wear when the learning mode was active. Other worker lists, inspection requirements, assets, and asset inspection requirements may also be added.

FIG. 7 illustrates operation of a compliance system in an example high volume environment 700. A worker 710 is detected in environment 700 operating a grinding tool 720. The worker is wearing fire resistant gloves 718, safety goggles 712, a half-face piece respirator, which requires respirator filters 216. Not readily detectable, using only cameras, may be hearing protection devices (not visible in FIG. 7). However, worker 710 may be wearing active hearing protection, such as in-ear hearing protection or over-ear hearing protection underneath full-body covering 702. Hearing protection devices may be in communication with a compliance system either directly or through a network in environment 700.

Based on the detected PPE configuration on worker 710, a compliance system generates a worker inspection lists that includes:

1) an annual medical exam

2) a reusable respirator fit test (e.g. yearly)

3) industrial machine safety training

The system may also generate an item inspection lists based on the PPE found, e.g.

1) Grinder needs on-demand inspection for safety guards, frayed cords, working switches, and cut-off wheel attachment security. 2) Full suit requires on-demand inspection of holes, cuts, tears, and discolorations.

Based on a detection of the hearing protection device, either through a networked communication or because a safety supervisor previously indicated it was a required PPE for area 700, system may also add a hearing protection checklist that includes:

1 ) Fit testing and N R testing

2) battery life check

After checklists are generated in a learning phase, a safety officer may review the suggested lists, and make changes as desired.

FIG. 8 illustrates a block diagram of an example environment in accordance with embodiments herein. A worksite may have one or more areas 800, which may be similar or different to areas 8A or 8B discussed with respect to FIG. 1 A. Area may be any industrial, research, construction, process, medical, office or other environment in which safety protocols are present.

One or more individuals 810 may work in environment 800. Individuals may have an identifier 814, such as a visible badge, detectable tag, or identifiable through facial or other recognition. Individuals 810 may include workers, supervisors, guests, or other personnel, and may be indicated as such by identifier 814. Each individual may be wearing one or more items of PPE 812, which may be required safety items for area 800. Each item of PPE may require training for individual 810 to operate, and may require maintenance, battery charging, filter replacement, or performance of other action items on a regular or as- needed basis.

Area 800 may also have one or more items of equipment 818 that may require safety protocols in place to operate safely. Equipment 818 may dictate the PPE 812 required by individuals 810 in area 800. Equipment 818 may also require periodic maintenance, cleaning and safety checks prior to, or during, use. Other hazards 819 may also be present in a worksite area 800, including the area itself, which may be toxic or have airborne gas or particulates . Additionally, other hazards 819 may require additional safety protocols or may require other checklist items to be added to safety compliance checklists. Individuals 810, equipment 818, and other hazards 819 may be identified as hazards by checklist item identifiers 830, which may include cameras 832, security checkpoints 836, wireless readers 834, or other sensors 838. Checklist item identifiers 830, during a learning or active learning phase, may identify compliance items that correspond to safety checklist items. During a learning or active learning phase, in addition to identifying individuals 810, required PPE 812, equipment 818 and other hazards 819 by monitoring an active worksite using checklist item identifiers 830, a checklist creation system 840 may, using cameras 832, read posted signs 820 in area 800. System 840 may read signs 820, which may indicate areas 826, required PPE 824, potential danger or hazards 822, or other safety related items 828 and, using dictionary 892, translate the text on a sign into checklist items.

Checklist management system 840, in an active phase, has a hazard identifier 842 that identifies hazards in area 800. Identifying hazards may include detecting movement, or the presence of, individuals 810, equipment 818, or other hazards 819, for example using identifiers 830. Cameras 832 may identify a hazard 810, 818, 819 in a camera feed. Sensors 838 may identify a hazard 810, 818, 819 for example through motion, etc. Wireless readers 834 may be able to detect and communicate with PPE 812. Security checkpoints 836 may know when individuals 810 and / or PPE 812 enter or leave an area 800.

Based on a detected hazard, in a learning mode, a checklist item identifier 844 may identify a potential checklist item and add it to an appropriate checklist 890. In an active mode, checklist management system 840 may, based on an identified hazard, retrieve an appropriate checklist 890 using checklist retriever 846.

Compliance detector 848, in an active mode, checks the retrieved checklist 890 to determine whether each item on the checklist has been timely satisfied. For example, an individual 810 may need to have sufficient security clearance, the right PPE 812, and training to engage with a given piece of equipment 818. Compliance detector 848 may detect that identifier 814 matches the required security credentials, PPE 812 is the correct PPE, and individual 810 has the required training.

A communications component 860 may communicate that a checklist is complete. In some embodiments, communication component 860 may communicate the complete checklist to an interactable device, which may not actuate until it receives an indication that the checklist is complete. For example, equipment 818 may not turn on, or operate, if an individual 810 has not completed each checklist item. This may reduce instances of injury, or damage, to equipment 818.

If a checklist item is not completed, an alert generator 849 may generate an alert, which may be conveyed by communication component 860, for example, to a non- compliant individual 810, their supervisor, an audio / visual or haptic feedback component within area 800, or to database 870, where it may be stored in compliance record 886.

Checklist management system 840 may receive information from numerous sources for generating checklists 890 and monitoring compliance. In a learning phase, system 840 may receive environment information detected by sensors in PPE devices 812, using PPE data receiver 858. Checklist items may also be generated based on data received from signs 820, which are detected in environment 800 using sign detector 852, and read by sign reader 854 and translated using dictionary 892. Based on detected hazards, potential checklist items 893 are retrieved from a database 870 and correlated to one or more checklists 890.

System 840 may be able to provide analysis of safety compliance within environment 800, using historic compliance analyzer 857, which may store indications of completed checklists 890 and which checklist items, of which checklists 890, were not completed or not verified as complete. Results from analysis may be communicated, or interacted with by a safety officer, through learning results communicator 856, which may present compliance data through a user interface (not shown in FIG. 8).

Database 870 may store information relevant to the operation of checklist management system 840 in area 800, both for a learning mode and an active learning mode. Database 870 is illustrated as a single entity, however some information may be stored on site, other information may be stored in a remote storage, while other information may be stored and accessible through a network such as a wireless or cloud-based network. Other suitable configurations are also envisioned.

Database 870 includes a number of checklists 890, which may be retrieved by checklist retriever 846 in response to a detected hazard in area 800. For example, an area checklist 898 may be retrieved when an individual 810 is detected in area 800, to ensure that individual 810 has meet all requirements for being in area 800. A worker checklist 899 may be retrieved when an individual 810 is identified, by identifier 814, with a worker identification, for example using a worker access list 878. An equipment checklist 896 may be retrieved when a worker 810 nears or attempts to operate equipment 818. Other hazard checklists 897 may be retrieved as other hazard conditions are identified. For example, if volatile organic compounds are detected by a sensor 838, a VOC checklist may be retrieved. Other checklists 891 may be retrieved as needed. In other embodiments, checklists are retrieved for known hazards periodically, for example at the beginning of each shift, at the beginning of each week, etc.

One or more checklists 890 may be retrieved by checklist retriever 846 as different hazards are detected. Checklists 890 may be reviewed by system 840 in sequence or in parallel.

Site specific information 872 may also be stored in database 870. For example, site checklists 876 may be retrieved periodically for safety evaluation of an entire area 800 or larger site. Additionally, learning results 874, from checklist management system 840 may be stored in database 870. Other site-specific information 882 may be stored in database 870.

Database 870 may also store general information 884 useful for operation of system 840. For example, a record of checklists 890 retrieved, and checklist items completed, missed, or just unverified, may be stored as compliance record 886. Additionally, a number of potential checklist items 893 may be stored in database 870 that may be added to one or more checklists 890 as hazards are identified in a learning mode. Many safety rules, which correspond to checklist items, are based on regulatory requirements, manufacturer requirements, or device functionality. These may be stored as potential checklist items 893, which may be set as default checklist items as checklists 890 are created. For example, a default requirement may be that all workers 810 in area 800 must undergo a medical evaluation annually. A safety officer may change the default potential checklist item for worker medical evaluation to 6 months - either for some or all workers 810. Potential checklist items 893 may be populated by a manufacturer of system 840 based on input from manufacturers, for example, of PPE 812, equipment 818, known types of areas 800 (e.g. distillery requirements differ from construction requirements which differ from medical environments). Additionally, potential checklist items 893 may be populated based on known regulatory requirements. Potential checklist items 893 may be updated if regulatory changes are detected, and / or when new equipment 818 is installed in area 800.

Other information 894 may also be stored in area 800. FIG. 9 illustrates an example method for monitoring safety compliance in accordance with embodiments herein. The example method 900 may be similar to the examples discussed above, and may be implemented using compliance systems as discussed herein, or may be accomplished using another suitable compliance system.

In block 910, hazard indicia are detected. For example, a camera communicatively coupled to a compliance system may be in a fixed position monitoring access to a restricted area 918 that contains equipment 912, a number of individuals 914 wearing PPE 916 and also includes other indicia 902, such as signs or other hazards.

In block 920, a checklist is retrieved. The checklist may be retrieved based on a detected hazard. As illustrated by arrow 950, the process of steps 920, 930 and 940 may be completed for each hazard detected. All of the relevant checklists may be retrieved, and analyzed, in series as illustrated in FIG. 9, or in parallel, which may be more efficient as some hazards may require the same checklist item to be completed. For example, a worker may be in an area that requires workers to wear scrubs and hair nets. The PPE rules may be received by the compliance system accessing a stored checklist for each detected hazard.

As illustrated in block 914, a worker may be identified in an area. The worker may be identified using a camera or video camera feed and detecting movement indicative of a worker. Systems, methods and examples herein have discussed the term “worker” as indicative of an individual authorized to operate in a given area. However, it is expressly contemplated that the PPE compliance system will also receive indications of other individuals in an area, including guests or other employees. In fact, non-workers in an area may benefit most from a PPE compliance system providing prompts to comply with PPE rules that they might not be aware of.

In block 930, compliance with a retrieved checklist is analyzed, for example by attempting to verify compliance with each checklist item. Checklist compliance may be verified by retrieving information from a reference database 922, for example to check whether maintenance was completed recently enough, whether a worker has had a medical checkup as required, or whether a worker is on a worker access list. Sensor readings 924 may also be relied on to check compliance. For example, optical sensors, including cameras, may detect whether or not a worker is wearing required PPE. Device sensors within a PPE may also be useful to satisfy health requirements, for example to ensure that a worker is not overheated or overtaxed to continue. Compliance may also be verified by communication with a device, as indicated in block 926. For example, in-ear hearing protection devices may not be easily detectable by optical sensors, but may be confirmed by a communication module within the hearing protection device. Other compliance verification methods, as indicated in block 928, may also be used.

Identifying a worker may include associating a known identity with the worker, for example by recognizing a PPE article checked out to a given individual, by recognizing an ID badge, or using facial or other recognition techniques. However, compliance system, in some embodiments, operates without identifying each worker individually.

Identifying a worker may also include identifying PPE articles that the worker is wearing. For example, PPE articles may include, but are not limited to: hearing protection, hard hats or helmets, safety glasses or goggles, scrubs or drapes, respirators or masks, gloves, closed or steel toed shoes, fall protection harnesses, etc. Identifying PPE articles worn by an individual may include analyzing an incoming image or video feed for indications of PPE, such as the shape of a hardhat, the color or shape of goggles, etc.

If the worker is wearing at least all of the PPE articles needed for the worksite or area, compliance is detected and, in some embodiments, is recorded. In embodiments where the compliance system identifies workers individually, compliance may be recorded for the individual worker in a worker data file. Individual compliance or non-compliance may assist a safety officer for the worksite in determining whether additional training is needed on PPE use and other safety and compliance rules. Compliance may be recorded along with a timestamp, and may be recorded along with other detected conditions, such as temperature, lighting or noise levels, which may impact compliance or may impact a compliance analysis.

In block 940, a compliance result is reported. The compliance or non-compliance may be reported to an individual worker, as indicated in block 942, to a safety officer 944, and / or to other nearby workers 946. In some embodiments, only non-compliance is reported so that action can be taken to ensure safety in a worksite. In some embodiments, compliance results are reported to another device or database, as indicated in block 948.

Additionally, the PPE compliance system may provide an alert, for example by informing a worker of an unverified checklist item. In some instances, a checklist item may not be verifiable by a system, but may have been completed. For example, steel-toed shoes may be required, but not visible underneath other garments. A compliance system may, therefore, send an indication of an unverified checklist item to the worker in question, who may provide verbal or other feedback that the checklist item has been met.

Additionally, in embodiments where the PPE compliance system is integrated into a locking mechanism for an area, the worker may be denied entry, until compliance with all checklist items is verified.

FIGS. 10-12 illustrate example devices that can be used in the embodiments shown in previous Figures. For example, computing devices may be used by a safety officer to review automatically generated checklists by a compliance system in a learning mode, either to modify or confirm them. Computing devices may also be used to review compliance information collected by a compliance checklist system.

FIG. 10 illustrates an example mobile device that can be used in the embodiments shown in previous Figures. FIG. 10 is a simplified block diagram of one illustrative example of a handheld or mobile computing device that can be used as either a worker’s device or a supervisor / safety officer device, for example, in which the present system (or parts of it) can be deployed. For instance, a mobile device can be deployed in the operator compartment of computing device for use in generating, processing, or displaying the data.

FIG. 10 provides a general block diagram of the components of a mobile cellular device 1016 that can run some components shown and described herein. Mobile cellular device 1016 interacts with them or runs some and interacts with some. In the device 1016, a communications link 1013 is provided that allows the handheld device to communicate with other computing devices and under some embodiments provides a channel for receiving information automatically, such as by scanning. Examples of communications link 1013 include allowing communication though one or more communication protocols, such as wireless services used to provide cellular access to a network, as well as protocols that provide local wireless connections to networks.

In other examples, applications can be received on a removable Secure Digital (SD) card that is connected to an interface 1015. Interface 1015 and communication links 1013 communicate with a processor 1017 (which can also embody a processor) along a bus 1019 that is also connected to memory 1021 and input/output (I/O) components 1023, as well as clock 1025 and location system 1027.

I/O components 1023, in one embodiment, are provided to facilitate input and output operations and the device 1016 can include input components such as buttons, touch sensors, optical sensors, microphones, touch screens, proximity sensors, accelerometers, orientation sensors and output components such as a display device, a speaker, and or a printer port. Other I/O components 1023 can be used as well.

Clock 1025 illustratively comprises a real time clock component that outputs a time and date. It can also provide timing functions for processor 1017.

Illustratively, location system 1027 includes a component that outputs a current geographical location of device 1016. This can include, for instance, a global positioning system (GPS) receiver, a LORAN system, a dead reckoning system, a cellular triangulation system, or other positioning system. It can also include, for example, mapping software or navigation software that generates desired maps, navigation routes and other geographic functions.

Memory 1021 stores operating system 1029, network settings 1031, applications 1033, application configuration settings 1035, data store 1037, communication drivers 1039, and communication configuration settings 1041. Memory 1021 can include all types of tangible volatile and non-volatile computer-readable memory devices. It can also include computer storage media (described below). Memory 1021 stores computer readable instructions that, when executed by processor 1017, cause the processor to perform computer-implemented steps or functions according to the instructions. Processor 1017 can be activated by other components to facilitate their functionality as well. It is expressly contemplated that, while a physical memory store 1021 is illustrated as part of a device, that cloud computing options, where some data and / or processing is done using a remote service, are available.

FIG. 11 shows that the device can also be a smart phone 1171. Smart phone 1171 has a touch sensitive display 1173 that displays icons or tiles or other user input mechanisms 1175. Mechanisms 1175 can be used by a user to run applications, make calls, perform data transfer operations, etc. In general, smart phone 1171 is built on a mobile operating system and offers more advanced computing capability and connectivity than a feature phone. Note that other forms of the devices are possible.

FIG. 12 is one example of a computing environment in which elements of systems and methods described herein, or parts of them (for example), can be deployed. With reference to FIG. 12, an example system for implementing some embodiments includes a general-purpose computing device in the form of a computer 1210. Components of computer 1210 may include, but are not limited to, a processing unit 1220 (which can comprise a processor), a system memory 1230, and a system bus 1221 that couples various system components including the system memory to the processing unit 1220. The system bus 1221 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. Memory and programs described with respect to systems and methods described herein can be deployed in corresponding portions of FIG. 12.

Computer 1210 typically includes a variety of computer readable media. Computer readable media can be any available media that can be accessed by computer 1210 and includes both volatile/nonvolatile media and removable/non-removable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media is different from, and does not include, a modulated data signal or carrier wave. It includes hardware storage media including both volatile/nonvolatile and removable/non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computer 1210. Communication media may embody computer readable instructions, data structures, program modules or other data in a transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.

The system memory 1230 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 1231 and random -access memory (RAM) 1232. A basic input/output system 1233 (BIOS) containing the basic routines that help to transfer information between elements within computer 1210, such as during start-up, is typically stored in ROM 1231. RAM 1232 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 1220. By way of example, and not limitation, FIG. 12 illustrates operating system 1234, application programs 1235, other program modules 1236, and program data 1237.

The computer 1210 may also include other removable/non-removable and volatile/nonvolatile computer storage media. By way of example only, FIG. 12 illustrates a hard disk drive 1241 that reads from or writes to non-removable, nonvolatile magnetic media, nonvolatile magnetic disk 1252, an optical disk drive 1255, and nonvolatile optical disk 1256. The hard disk drive 1241 is typically connected to the system bus 1221 through a non-removable memory interface such as interface 1240, and optical disk drive 1255 are typically connected to the system bus 1221 by a removable memory interface, such as interface 1250.

Alternatively, or in addition, the functionality described herein can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field- programmable Gate Arrays (FPGAs), Application-specific Integrated Circuits (e.g., ASICs), Application-specific Standard Products (e.g., ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

The drives and their associated computer storage media discussed above and illustrated in FIG. 12, provide storage of computer readable instructions, data structures, program modules and other data for the computer 1210. In FIG. 12, for example, hard disk drive 1241 is illustrated as storing operating system 1244, application programs 1245, other program modules 1246, and program data 1247. Note that these components can either be the same as or different from operating system 1234, application programs 1235, other program modules 1236, and program data 1237.

A user may enter commands and information into the computer 1210 through input devices such as a keyboard 1262, a microphone 1263, and a pointing device 1261, such as a mouse, trackball or touch pad. Other input devices (not shown) may include a joystick, game pad, satellite receiver, scanner, or the like. These and other input devices are often connected to the processing unit 1220 through a user input interface 1260 that is coupled to the system bus but may be connected by other interface and bus structures. A visual display 1291 or other type of display device is also connected to the system bus 1221 via an interface, such as a video interface 1290. In addition to the monitor, computers may also include other peripheral output devices such as speakers 1297 and printer 1296, which may be connected through an output peripheral interface 1295.

The computer 1210 is operated in a networked environment using logical connections, such as a Local Area Network (LAN) or Wide Area Network (WAN) to one or more remote computers, such as a remote computer 1280.

When used in a LAN networking environment, the computer 1210 is connected to the LAN 1271 through a network interface or adapter 1270. When used in a WAN networking environment, the computer 1210 typically includes a modem 1272 or other means for establishing communications over the WAN 1273, such as the Internet. In a networked environment, program modules may be stored in a remote memory storage device. FIG. 12 illustrates, for example, that remote application programs 1285 can reside on remote computer 1280.

As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” encompass embodiments having plural referents, unless the content clearly dictates otherwise. As used in this specification and the appended claims, the term “or” is generally employed in its sense including “and/or” unless the content clearly dictates otherwise.

The techniques of this disclosure may be implemented in a wide variety of computer devices, such as servers, laptop computers, desktop computers, notebook computers, tablet computers, hand-held computers, smart phones, and the like. Any components, modules or units have been described to emphasize functional aspects and do not necessarily require realization by different hardware units. The techniques described herein may also be implemented in hardware, software, firmware, or any combination thereof. Any features described as modules, units or components may be implemented together in an integrated logic device or separately as discrete but interoperable logic devices. In some cases, various features may be implemented as an integrated circuit device, such as an integrated circuit chip or chipset. Additionally, although a number of distinct modules have been described throughout this description, many of which perform unique functions, all the functions of all of the modules may be combined into a single module, or even split into further additional modules. The modules described herein are only exemplary and have been described as such for better ease of understanding. If implemented in software, the techniques may be realized at least in part by a computer-readable medium comprising instructions that, when executed in a processor, performs one or more of the methods described above. The computer-readable medium may comprise a tangible computer-readable storage medium and may form part of a computer program product, which may include packaging materials. The computer- readable storage medium may comprise random access memory (RAM) such as synchronous dynamic random access memory (SDRAM), read-only memory (ROM), non volatile random access memory (NVRAM), electrically erasable programmable read-only memory (EEPROM), FLASH memory, magnetic or optical data storage media, and the like. The computer-readable storage medium may also comprise a non-volatile storage device, such as a hard-disk, magnetic tape, a compact disk (CD), digital versatile disk (DVD), Blu- ray disk, holographic data storage media, or other non-volatile storage device.

The term “processor,” as used herein may refer to any of the foregoing structure or any other structure suitable for implementation of the techniques described herein. In addition, in some aspects, the functionality described herein may be provided within dedicated software modules or hardware modules configured for performing the techniques of this disclosure. Even if implemented in software, the techniques may use hardware such as a processor to execute the software, and a memory to store the software. In any such cases, the computers described herein may define a specific machine that is capable of executing the specific functions described herein. Also, the techniques could be fully implemented in one or more circuits or logic elements, which could also be considered a processor.

A compliance monitoring system is presented. The system includes a sensor in an environment, the sensor generates a sensor signal. The system also includes a hazard identifier configured to identify a hazard within the environment, based on the sensor signal. The system also includes a compliance checklist identifier configured to identify a compliance checklist, based on the identified hazard. The system also includes a compliance checklist retriever configured to retrieve a checklist for the hazard in the image. The checklist has a compliance checklist item. The system also includes a compliance detector configured to analyze the environment for completion of the checklist compliance item, and, based on the comparison, provide an indication of compliance checklist completion. The compliance monitoring system operates in either a compliance detection mode or an active learning mode. The compliance checklist retrieved by the compliance checklist retrieval module was compiled by the compliance monitoring system during an active learning mode based on the sensor signal.

The system may be implemented such that the sensor is a camera and the sensor signal is an image of the environment, and the hazard identifier identifies a hazard in the image.

The system may be implemented such that the sensor is associated with a personal protective equipment item in the environment.

The system may be implemented such that the sensor signal is an indication of a worker presently in the environment.

The system may be implemented such that the sensor signal is a gas concentration in the environment.

The system may be implemented such that the sensor signal is a recorded audio signal.

The system may be implemented such that, based on the recorded audio signal, a noise hazard is identified. The compliance checklist item is a requirement that hearing protection is worn by a worker in the environment.

The system may be implemented such that the compliance detector detects the worker is wearing hearing protection by analyzing an image captured by a camera in the environment.

The system may be implemented such that, during the active learning phase, a camera in the environment captures images of the environment, the hazard identifier identifies a potential hazard in the captured images, and a compliance checklist generator generates a potential checklist based on the identified potential hazard.

The system may be implemented such that the potential checklist is modifiable.

The system may be implemented such that, if the indication of compliance checklist item completion indicates that the checklist item has not been completed, an alert generator generates an alert.

The system may be implemented such that the alert is provided to a worker associated with the identified hazard.

The system may be implemented such that the worker is a worker nearest the hazard.

The system may be implemented such that the worker is the hazard. The system may be implemented such that the sensor is a mobile sensor configured to move within the environment.

The system may be implemented such that analyzing the environment includes retrieving stored data indicative of whether the checklist item has been met.

The system may be implemented such that the checklist item is a necessary PPE, and analyzing the environment includes reviewing an image of the environment to determine whether the necessary PPE is present.

The system may be implemented such that the hazard is a worker in the environment.

The system may be implemented such that the hazard is a machine in the environment.

The system may be implemented such that the hazard is a PPE in the environment.

A method of detecting compliance with safety requirements in a worksite is presented. The method includes generating, using an active learning module of a compliance system, a safety checklist for the worksite. The safety checklist is generated by: analyzing an image feed, from a camera with a field of view, and detecting a safety requirement indication, analyzing the safety requirement indication to determine a checklist item for the worksite, and associating the checklist item with a safety checklist for the worksite. The safety checklist is associated with a hazard in the worksite. The method also includes identifying the hazard in the worksite. Identifying includes detecting the hazard in the worksite using a sensor in the worksite. The method also includes retrieving the safety checklist for the worksite from a database of checklists. The checklist includes the checklist item required for the portion of the worksite in the field of view. The method also includes checking the worksite for completion of the safety checklist. The method also includes providing an indication of checklist completion.

The method may be implemented such that the sensor is a camera, and the hazard is identified in an image feed captured by the camera.

The method may be implemented such that the sensor is associated with a personal protective equipment (PPE) item in the environment.

The method may be implemented such that the sensor sends a signal indicative of a worker in the environment.

The method may be implemented such that the sensor sends a signal indicative of a gas concentration in the environment. The method may be implemented such that the sensor sends a recorded audio stream.

The method may be implemented such that based on the recorded audio stream, a noise hazard is identified, and the checklist item is a requirement that hearing protection is worn by a worker in the environment.

The method may be implemented such that checking the worksite for completion includes analyzing an image captured by a camera in the environment and detecting the worker is wearing hearing protection.

The method may be implemented such that, if the provided indication indicates that a checklist item on the safety checklist has not been completed. The method further includes generating an alert, using an alert generator, the alert is a visual, audio, or haptic alert.

The method may be implemented such that the alert is communicated to a worker associated with the identified hazard.

The method may be implemented such that the alert is communicated to a PPE device associated with the worker.

The method may be implemented such that the worker is a worker nearest the hazard.

The method may be implemented such that the worker is the hazard.

The method may be implemented such that the sensor is a mobile sensor configured to move within the environment.

The method may be implemented such that analyzing the environment includes retrieving stored data indicative of whether the checklist item has been met.

The method may be implemented such that the checklist item is a necessary PPE, and analyzing the environment includes reviewing an image of the environment to determine whether the necessary PPE is present.

The method may be implemented such that the hazard is a worker in the environment.

The method may be implemented such that the hazard is a machine in the environment.

The method may be implemented such that the hazard is a PPE in the environment.

The method may be implemented such that the detected safety requirement is a PPE worn by a worker in the field of view.

The method may be implemented such that the safety requirement is a hazard indication, and the checklist item is retrieved based on the detected hazard indication. The method may be implemented such that the hazard indication is a machine in the field of view, and the checklist item is a maintenance requirement for the machine.

The method may be implemented such that the provided indication is stored in a database.

The method may be implemented such that the provided indication is an alert indicating that the safety checklist includes an unverified checklist item.

A method of training a compliance system in a worksite is presented. The method includes initiating the compliance system. Initiating includes communicatively coupling the system to a camera within the worksite. The camera has a field of view. The method also includes scanning an image feed from the camera for an indication of a compliance checklist item for the worksite within the field of view. The method also includes detecting, using a processor of the compliance system, an indication of a checklist item in the image. The method also includes translating the indication into a compliance checklist item. The method also includes associating the compliance checklist item with a hazard in the worksite. The method also includes storing the compliance checklist item with a compliance checklist for the hazard.

The method may be implemented such that the indication is a personal protective equipment item in the environment.

The method may be implemented such that the indication is a worker in the environment.

The method may be implemented such that the indication is a gas concentration in the environment.

The method may be implemented such that the indication is a recorded audio signal.

The method may be implemented such that, based on the recorded audio signal, a noise hazard translated into the compliance checklist item, and the compliance checklist item is a requirement that hearing protection is worn by a worker in the environment.

The method may be implemented such that the compliance checklist is modifiable.

The method may be implemented such that the camera is configured to move within the environment.

The method may be implemented such that the checklist item is a necessary PPE, and analyzing the environment includes reviewing an image of the environment to determine whether the necessary PPE is present. The method may be implemented such that the hazard is a worker in the environment.

The method may be implemented such that the hazard is a PPE in the environment.

A worksite compliance system is presented. The system includes a camera with a field of view, that captures an image feed. The system also includes a database storing a compliance checklist including a compliance requirement for a hazard in the field of view, and a datastore corresponding to a plurality of potential checklist item. The system also includes a processor configured to: receive the image feed and identify the hazard in the field of view, receive the compliance checklist, determine, based by analyzing the image feed, whether the compliance checklist is satisfied for the identified hazard, and generate a compliance result for the hazard. The system also includes a training module configured to: scan the image feed for a compliance checklist indication, determine whether the checklist indication includes a new checklist item, and add the new checklist item to the compliance checklist.

The system may be implemented such that the hazard is a personal protective equipment (PPE) item in the environment, and the compliance checklist is maintenance checklist for the PPE.

The system may be implemented such that the hazard is a worker presently in the environment and the compliance checklist includes a PPE requirement for the worker in the environment.

The system may be implemented such that the hazard is a sign in the environment indicating a gas present, and the compliance checklist includes a PPE requirement for a worker in the environment.

The system may be implemented such that the hazard is a loud noise warning, and the compliance checklist includes a hearing protection requirement for a worker in the environment. The system may be implemented such that the compliance checklist is satisfied if the worker is detected in the image feed as wearing a hearing protection device.

The system may be implemented such that the compliance checklist generated by the training module is modifiable.

The system may be implemented such that, if compliance result indicates that the compliance checklist is not completed, an alert generator generates an alert.

The system may be implemented such that the alert is provided to a worker in the environment.

The system may be implemented such that the worker is the hazard.

The system may be implemented such that the camera is configured to move within the environment.

The system may be implemented such that determining whether the checklist is satisfied includes retrieving stored data indicative of whether an item on the checklist has been met.

The system may be implemented such that the hazard is a PPE in the environment.

The system may be implemented such that the training model determines the new checklist item by referencing a database of checklist items.

A method for tracking equipment is presented. The method includes detecting, by analyzing a received signal from a sensor located in a worksite area, a hazard in the area. The method also includes retrieving from a database, based on the detection, a compliance checklist of compliance items associated with the hazard. The method also includes checking the area for compliance with a checklist item on the compliance checklist by analyzing an image feed from a camera with a field of view that includes the worksite area. The method also includes determining that the checklist item is not verified based on the image feed. The method also includes generating an alert including an indication of the unverified checklist item. The method also includes monitoring, using the camera feed, for completion of the checklist item. The method may be implemented such that it also includes recording the alert in a database.

The method may be implemented such that it also includes receiving an indication that the checklist item is verified as complete and ending the alert.

The method may be implemented such that the sensor is a camera and the sensor signal is an image of the environment, and the hazard identifier identifies a hazard in the image.

The method may be implemented such that the sensor is associated with a personal protective equipment item in the environment.

The method may be implemented such that the received signal is an indication of a worker presently in the environment.

The method may be implemented such that the received signal is a gas concentration in the environment.

The method may be implemented such that the received signal is a recorded audio signal.

The method may be implemented such that, based on the recorded audio signal, a noise hazard is identified, and the checklist item is a requirement that hearing protection is worn by a worker in the environment.

The method may be implemented such that the compliance detector detects the worker is wearing hearing protection by analyzing the image feed.

The method may be implemented such that the alert is provided to a worker associated with the identified hazard.

The method may be implemented such that the worker is the hazard.

The method may be implemented such that the sensor is a mobile sensor configured to move within the area.

The method may be implemented such that the hazard is a PPE in the environment.

Claims

What is claimed is:

1. A compliance monitoring system comprising: a sensor in an environment, wherein the sensor generates a sensor signal; a hazard identifier configured to identify a hazard within the environment, based on the sensor signal; a compliance checklist identifier configured to identify a compliance checklist, based on the identified hazard; a compliance checklist retriever configured to retrieve a checklist for the detected hazard wherein the checklist has a compliance checklist item; a compliance detector configured to analyze the environment for completion of the checklist compliance item, and, based on the comparison, provide an indication of compliance checklist completion; and wherein the compliance monitoring system operates in either a compliance detection mode or an active learning mode, and wherein the compliance checklist retrieved by the compliance checklist retrieval module was compiled by the compliance monitoring system during an active learning mode based on the sensor signal.

2. The system of claim 1, wherein the sensor is a camera and the sensor signal is an image of the environment, and wherein the hazard identifier identifies a hazard in the image.

3. The system of claim 1 or 2, wherein the sensor is associated with a personal protective equipment item in the environment.

4. The system of any of claims 1-3, wherein the sensor signal is an indication of a worker presently in the environment.

5. The system of any of claims 1-4, wherein the sensor signal is a gas concentration in the environment.

6. The system of any of claims 1-5, wherein the sensor signal is a recorded audio signal.

7. The system of claim 6, wherein, based on the recorded audio signal, a noise hazard is identified, and wherein the compliance checklist item is a requirement that hearing protection is worn by a worker in the environment.

8. The system of claim 7, wherein the compliance detector detects the worker is wearing hearing protection by analyzing an image captured by a camera in the environment.

9. The system of any of claims 1-8, wherein, during the active learning phase, a camera in the environment captures images of the environment, the hazard identifier identifies a potential hazard in the captured images, and a compliance checklist generator generates a potential checklist based on the identified potential hazard.

10. The system of claim 9, wherein the potential checklist is modifiable.

11. The system of any of claims 1-10, wherein, if the indication of compliance checklist item completion indicates that the checklist item has not been completed, an alert generator generates an alert.

12. The system of claim 11, wherein the alert is provided to a worker associated with the identified hazard.

13. The system of claim 12, wherein the worker is a worker nearest the hazard.

14. The system of any of claims 1-13, wherein analyzing the environment comprises retrieving stored data indicative of whether the checklist item has been met.

15. The system of any of claims 1-14, wherein the checklist item is a necessary PPE, and wherein analyzing the environment comprises reviewing an image of the environment to determine whether the necessary PPE is present.

16. A method of detecting compliance with safety requirements in a worksite, the method comprising: generating, using an active learning module of a compliance system, a safety checklist for the worksite, wherein the safety checklist is generated by: analyzing an image feed, from a camera with a field of view, and detecting a safety requirement indication; analyzing the safety requirement indication to determine a checklist item for the worksite; and associating the checklist item with a safety checklist for the worksite, wherein the safety checklist is associated with a hazard in the worksite; identifying the hazard in the worksite, wherein identifying comprises detecting the hazard in the worksite using a sensor in the worksite; retrieving the safety checklist for the worksite from a database of checklists, wherein the checklist comprises the checklist item required for the portion of the worksite in the field of view; checking the worksite for completion of the safety checklist; and providing an indication of checklist completion.

17. The method of claim 16, wherein the sensor is a camera, and wherein the hazard is identified in an image feed captured by the camera.

18. The method of claim 16 or 17, wherein the sensor sends a recorded audio stream.

19. The method of claim 16, wherein, based on the recorded audio stream, a noise hazard is identified, and wherein the checklist item is a requirement that hearing protection is worn by a worker in the environment and wherein checking the checklist item for completion comprises analyzing an image captured by a camera in the environment and detecting the worker is wearing hearing protection.

20. The method of any of claims 16-19, wherein, if the provided indication indicates that a checklist item on the safety checklist has not been completed, the method further comprises: generating an alert, using an alert generator, wherein the alert is a visual, audio, or haptic alert.

21. The method of claim 20, wherein the alert is communicated to a worker associated with the identified hazard.

22. The method of any of claims 16-21, wherein analyzing the environment comprises retrieving stored data indicative of whether the checklist item has been met.

23. The method of any of claims 16-22, wherein the checklist item is a necessary PPE, and wherein analyzing the environment comprises reviewing an image of the environment to determine whether the necessary PPE is present.

24. The method of any of claims 16-23, wherein the provided indication is an alert indicating that the safety checklist comprises an unverified checklist item.

25. A method of training a compliance system in a worksite, the method comprising: initiating the compliance system, wherein initiating comprises communicatively coupling the system to a camera within the worksite, wherein the camera has a field of view; scanning an image feed from the camera for an indication of a compliance checklist item for the worksite within the field of view; detecting, using a processor of the compliance system, an indication of a checklist item in the image; translating the indication into a compliance checklist item; associating the compliance checklist item with a hazard in the worksite; storing the compliance checklist item with a compliance checklist for the hazard.

26. The method of claim 25, wherein the indication is a personal protective equipment item in the environment.

27. The method of claim 25 or 26, wherein the indication comprises a worker in the environment.

28. The method of any of claims 25-27, wherein the camera is configured to move within the environment.

29. The method of any of claims 25-28, wherein the checklist item is a necessary PPE, and wherein analyzing the environment comprises reviewing an image of the environment to determine whether the necessary PPE is present.

30. A worksite compliance system comprising: a camera with a field of view, that captures an image feed; a database storing: a compliance checklist comprising a compliance requirement for a hazard in the field of view; a datastore corresponding to a plurality of potential checklist items; a processor configured to: receive the image feed and identify the hazard in the field of view; receive the compliance checklist; determine, based by analyzing the image feed, whether the compliance checklist is satisfied for the identified hazard; and generate a compliance result for the hazard; and a training module configured to: scan the image feed for a compliance checklist indication; determine whether the checklist indication comprises a new checklist item; and add the new checklist item to the compliance checklist.

31. The system of claim 30, wherein the hazard is a personal protective equipment (PPE) item in the environment, and wherein the compliance checklist is maintenance checklist for the PPE.

32. The system of claim 30 or 31, wherein the hazard is a worker presently in the environment and wherein the compliance checklist comprises a PPE requirement for the worker in the environment.

33. The system of any of claims 30-32, wherein the hazard is a sign in the environment indicating a gas present, and wherein the compliance checklist comprises a PPE requirement for a worker in the environment.

34. The system of any of claims 30-33, wherein the hazard is a loud noise warning, and wherein the compliance checklist comprises a hearing protection requirement for a worker in the environment and wherein the compliance checklist is satisfied if the worker is detected in the image feed as wearing a hearing protection device.

35. The system of any of claims 30-34, wherein, if compliance result indicates that the compliance checklist is not completed, an alert generator generates an alert.

36. The system of any of claims 30-35, wherein determining whether the checklist is satisfied comprises retrieving stored data indicative of whether an item on the checklist has been met.

37. A method for tracking equipment comprising : detecting, by analyzing a received signal from a sensor located in a worksite area, a hazard in the area, retrieving from a database, based on the detection, a compliance checklist of compliance items associated with the hazard; checking the area for compliance with a checklist item on the compliance checklist by analyzing an image feed from a camera with a field of view that includes the worksite area; determining that the checklist item is not verified based on the image feed; generating an alert comprising an indication of the unverified checklist item; and monitoring, using the camera feed, for completion of the checklist item.

38. The method of claim 37, and further comprising: recording the alert in a database.

39. The method of claim 37 or 38, and further comprising: receiving an indication that the checklist item is verified as complete and ending the alert.

40. The method of any of claims 37-39, wherein the sensor is a camera and the sensor signal is an image of the environment, and wherein the hazard identifier identifies a hazard in the image.