WO2019212795A1

WO2019212795A1 - System and method for monitoring operations and personnel on offshore unit

Info

Publication number: WO2019212795A1
Application number: PCT/US2019/028650
Authority: WO
Inventors: Agung SUNDIA; Richard Norton
Original assignee: Rowan Companies, Inc.
Priority date: 2018-05-04
Filing date: 2019-04-23
Publication date: 2019-11-07
Also published as: EP3818506A1; EP3818506A4

Abstract

A system and method is used for tracking crew members on an offshore unit during emergencies, rig operations, crane operations, and the like. A static map is created in software and interfaces with a network of receiver nodes physically installed at a predetermined set of measurements to provide coverage to designated areas to locate and identify crew members, who have or wear Bluetooth beacons. During operations, crew members are located and identified in real-time through the network of receiver nodes installed over prespecified coordinates. Cameras and visual recognition processing can operate in the designated areas. The designated areas can include muster stations for crew members to gather in an emergency or can include designated areas in which personnel are restricted while equipment is operating or moving.

Description

System and Method for Monitoring Operations and Personnel on Offshore Unit

BACKGROUND OF THE DISCLOSURE

[0001] On an offshore drilling vessel, rig, or platform, personnel or crew members may be performing different functions at various locations. When there is an emergency, each crew member needs to go to a designated muster station. At the same time, equipment may be moved, and various operations may be conducted in various areas on the vessel so it can be helpful to locate personnel on the platform.

[0002] One piece of equipment commonly used on a platform is a crane, which is used for lifting and moving equipment [e.g., pipe stands, generators, wellhead components, etc.) on the platform, unloading supply vessels, and the like. As will be appreciated, being able to identify and track personnel in real time during operations of a crane or other equipment on the vessel can be very useful.

[0003] Likewise, should an emergency occur, the crew members must move to specified muster areas, where further safety, evacuation, or other procedures can be decided and performed. As will be appreciated, being able to identify and track crew members in real time during an emergency on the platform is also extremely helpful. During an emergency or fire drill, for example, certain crew members may not be in the designated muster station due to various reasons. Crew members may not hear the alarm, may be sleeping, may have difficulty finding the muster location, etc.

[0004] Traditionally, an overseer at a muster station must perform a roll call to identify the crew members at the muster station. The overseer needs a list of personnel and must use radio communications to contact crew members and to coordinate emergency operations. The list of crew members must be up to date, as personnel on a given day or time may change. Any crew members missing in the muster station must be physically located. For example, a designated person at the muster station manually counts the personnel and verifies who is missing. This process takes a considerable amount of time before it is known who is missing. Many vessels will have several muster stations, which compounds the difficulty in accounting for missing crew members.

[0005] Systems are available for tracking personnel on a vessel. For example,

US6825763 and AU2015200877 disclose tracking systems of the prior art. A system from Aramco described in an article dated 03/14/2016 in Offshore is used to track crew members once they board a vessel. The system uses passive Radio Frequency

Identification (RFID) tags, such as ID cards, that are read at checkpoints as the crew members move about the vessel. In this way, RFID readers at various points on the vessel can detect crew members in established zones of the vessel, and a master controller can process the data and calculate location information.

[0006] Systems have also been developed to locate personnel during emergency situations. For example, US7916024, US2011/0309931, US2012/0130632,

W02013/033780, and US2014/0340220 disclose emergency tracking systems of the prior art. A system as described by Marine Rescue Technologies uses readers or data collectors at management stations for real-time situational awareness. The readers monitor attendance at each muster station to generate a tally, which is compared against a master list of personnel on board or the like. Muster roll call reports can then be generated automatically to show who is in attendance, who is missing, and who is at the wrong muster station.

[0007] Although such systems can be effective, vessel operators continually seek to improve operations on an offshore unit. The subject matter of the present disclosure is directed to overcoming, or at least reducing the effects of, one or more of the problems set forth above.

SUMMARY OF THE DISCLOSURE

[0008] Systems and methods are disclosed for monitoring operations and personnel in designated areas on an offshore unit. According to the present disclosure, a method is used to track crew members on an offshore unit. Wireless transmitters are associated in a database of a network system with the crew members. Each of the wireless transmitters is configured to transmit a wireless signal associated in the database with one of the crew members. Wireless receivers arranged in a mapped layout of at least a portion of the offshore unit are associated in the database. The mapped layout at least includes a designated area of equipment used in an operation of the offshore unit. Each of the wireless receivers is configured to receive the wireless signals, and each is connected in communication with at least one processing device of the network system.

[0009] At least one policy is associated in the database with the equipment used in the operation of the offshore unit. A state of the equipment in the designated area is monitored with the network system, and a restriction in the designated area is initiated at the at least one processing device in response to the monitored state of the equipment.

[0010] In response to the restriction, any of the wireless signals of the wireless transmitters located by the wireless receivers in the designated area are detected at the at least one processing device. In response to the detection, an action is determined at the at least one processing device based on the at least one policy associated with the equipment, and the determined action is initiated at the at least one processing device.

[0011] To associate the wireless transmitters with the crew members, tracking information of the crew members can be associated in the database with identifiers of the wireless transmitter. The tracking information can comprise one or more of personal identification, assignment, date boarded the unit, date to disembark the unit, authorization, designated work zone, communication information, radio channel, cellphone number, email address, pager number, emergency contact, and supervisor contact.

[0012] To associate the wireless receivers arranged in the at least one designated area of the offshore unit, a dimensional map of the at least one designated area of the offshore unit can be created in the database.

[0013] The wireless receivers can comprise nodes configured for a wireless protocol and hardwired to one or more power sources on the offshore unit, and the wireless

transmitters can comprise beacons configured for the wireless protocol and powered by local power storage.

[0014] To detect any of the wireless signals, indication of one or more of the wireless signals can be received from one or more of portable ones of the wireless transmitters at one or more of a plurality of stationary ones of the wireless receivers. To detect any of the wireless signals, strengths of the wireless signal of one of the wireless transmitters can be detected at at least two of the wireless receivers, and a location of the one wireless transmitter can be estimated based on the detected strengths.

[0015] The equipment can be selected from the group consisting of a crane, a boom crane, a pipe handler, drilling equipment, BOP handling equipment, swarf skip equipment, fluid handling equipment, a shaker, a pump, an electrical panel, a generator, and a manipulator.

[0016] To monitor the state of the equipment in the designated area, information of the state of the equipment can be received with the network system from a control system of the offshore unit. [0017] To initiate the restriction in the designated area in response to the monitored state of the equipment, a determination can be made that the equipment is operating, and a determination can be made that the at least one policy restricts the crew member associated with the wireless transmitter detected in the designated area when the equipment is operating.

[0018] To determine the action based on the at least one policy associated with the equipment, a determination can be made from the at least one policy to shut down the equipment, in which case the determined action to initiate can comprise shutting down the equipment. Determining the action based on the at least one policy associated with the equipment can comprise determining from the at least one policy to continue operation of the equipment, in which case the determined action to initiate can comprise continuing the operation.

[0019] To initiate the determined action, the restriction can be communicated with the network system to the crew member associated with the wireless transmitter detected in the designated area.

[0020] To initiate the restriction in the designated area in response to the monitored state of the equipment, a determination can be made that the equipment is moving in the designated area, and a determination can be made that the at least one policy restricts the crew member associated with the wireless transmitter detected in the designated area when the equipment is moving. In this case, determining the action based on the at least one policy associated with the equipment can comprise determining from the at least one policy to stop movement of the equipment, in which case the determined action to be initiated can comprise stopping movement of the equipment.

[0021] To initiate the restriction in the designated area in response to the monitored state of the equipment, a determination can be made that the at least one policy at a current time restricts the crew member associated with the wireless transmitter detected in the designated area. Based on the at least one policy, an alarm condition can be determined and initiated.

[0022] To initiate the restriction in the designated area in response to the monitored state of the equipment, a determination can be made that the at least one policy at a current time restricts the crew member associated with the wireless transmitter detected in the designated area. Based on the at least one policy, a communication of the restriction can be determined and communicated with the network system to the crew member associated with the wireless transmitter detected in the designated area.

[0023] According to a further aspect of the method, at least one optical device can be associated in the database in at least the designated area of the equipment used in the operation of the offshore unit. The at least one optical device can be connected in communication with at least one processing device of the network system. In this instance, visual monitoring can be received from the at least one visual device associated with the designated area of the offshore unit, recognition of a crew member in the designated area can be detected from the visual monitoring in response to the restriction.

[0024] To detect the recognition of the crew member, any person captured with at least one optical device in the designated area can be detected absent detection by the wireless receivers. To detect the recognition of the crew member, the detected person can be automatically identified as a particular one of the crew members based on a visual attribute using visual detection software.

[0025] In the method, an intervention by one or more other of the crew members can be determined and can be communicated to the one or more other crew members to intervene in the designated area.

[0026] According to the present disclosure, a programmable storage device has program instructions stored thereon for causing a programmable control device to perform a method of tracking crew members on an offshore unit according to any of the above aspects. The system comprises a plurality of portable wireless transmitters, a plurality of stationary wireless receivers, a database, a communication interface, and at least one programmable control device.

[0027] The portable wireless transmitters are each configured to transmit a wireless signal, and the stationary wireless receivers are arranged in a mapped layout of at least a portion of the offshore unit. The mapped layout at least includes a designated area of equipment used in an operation of the offshore unit. Each of the wireless receivers is configured to receive the wireless signals of the wireless transmitters.

[0028] The database associates the wireless receivers with the designated area and associates the crew members with the portable wireless transmitters. The database also associates at least one policy with the equipment used in the operation of the offshore unit. The communication interface is in communication with the stationary wireless receivers. [0029] The at least one programmable control device is in communication with the database and the communication interface. The at least one programmable control device is configured to monitor a state of the equipment in the designated area and to initiate a restriction in the designated area in response to the monitored state of the equipment. In response to the restriction, any of the wireless signals of the wireless transmitters located by the wireless receivers in the designated area can be detected. In response to the detection, an action can be determined based on the at least one policy associated with the equipment so the determined action can be initiated.

[0030] The system can perform any of the steps of the method disclosed above for tracking the crew members on the offshore unit.

[0031] According to the present disclosure, a computer-implemented method operates a crane on an offshore unit on which entities operate. A dimensional map [e.g., two or three- dimensional map) of the offshore unit is created in a database, and locations of the entities are tracked in the database in the dimensional map of the offshore unit by receiving at least wireless monitoring from wireless devices associated with both the entities and the offshore unit. A programmable control device obtains dynamic operating parameters of the crane operating on the offshore unit and calculates a lifting zone moving dynamically in the dimensional map in the database based on the dynamic operating parameters of the crane. The programmable control device detects a conflict of at least one of the tracked locations interfering with the dynamically moving lifting zone of the crane and outputs the detected conflict.

[0032] In receiving at least the wireless monitoring from the wireless devices associated with both the entities and the offshore unit, indication of the entities can be received from portable ones of the wireless devices associated with the entities at one or more of a plurality of stationary ones of the wireless devices associated with the offshore unit.

[0033] Tracking can involve receiving visual monitoring from visual devices associated with the offshore unit and can involve identifying given ones of the entities as authorized and unauthorized for the tracked locations in the dimensional map.

[0034] To obtaining the dynamic operating parameters, the programmable control device can select the crane for remote operation from a plurality of cranes on the offshore unit and can restrict operation of any other of the cranes for simultaneous operation. The control of the crane can be received from an operator [e.g., from a remote location), and feedback can be received from equipment of the crane. The dynamic movement of the crane relative to the dimensional map can then be determined from the received control and feedback. In general, the dynamic movement of the crane can include one or more of slew angle, boom angle, boom length, hook load, weight, block height, boom limit, slew limit, overload, hoist speed, cable length, boom angle speed, slew angle speed, and environmental data. In this situation, calculating the lifting zone can involve dimensionally translating the dynamic movement of the crane into one or more boundaries of the lifting zone within the dimensional map.

[0035] To obtain the dynamic operating parameters, visual monitoring at least in a vicinity of the crane operating on the offshore unit can also be received so the dynamic movement of the crane relative to the dimensional map can be determined from the received visual monitoring.

[0036] The programmable control device can detect the conflict of at least one of the tracked locations interfering with the dynamically moving lifting zone of the crane operating on the offshore unit by determining that the at least one tracked location is located at a point-in-time within a boundary of the dynamically moving lifting zone in the dimensional map. The programmable control device can output the conflict by generating a perceptible representation of the conflict and outputting the perceptible representation from an interface of the programmable control device to an operator of the crane. The programmable control device can also generate a control in response to the conflict and can control the operation of the crane with the generated control.

[0037] According to the present disclosure, a system for operating a crane on an offshore unit on which entities operate comprises a plurality of portable wireless devices, a plurality of stationary wireless devices, a database, a communication interface, and a programmable control device. The portable wireless devices are associated with the entities, and the stationary wireless devices are associated with the offshore unit. The database stores a dimensional map of the offshore unit, and the communication interface is in communication with the plurality of stationary wireless devices and with the crane.

[0038] The programmable control device is in communication with database and the communication interface. The programmable control device is configured to: track, in the database, locations of the entities in the dimensional map of the offshore unit by receiving at least wireless monitoring from the wireless devices associated with the entities and the offshore unit; obtain dynamic operating parameters of the crane operating on the offshore unit; calculate a lifting zone moving dynamically in the dimensional map in the database based on the dynamic operating parameters of the crane; detect a conflict of at least one of the tracked locations interfering with the dynamically moving lifting zone of the crane; and output the detected conflict.

[0039] The system can further comprise a plurality of visual devices associated with the offshore unit, the visual devices receiving visual monitoring and in communication with the interface. In this case, the programmable control device can be configured to track, in the database, the locations of the entities in the dimensional map of the offshore unit based on the received visual monitoring. The programmable control device can also determine dynamic movement of the crane relative to the dimensional map from the received visual monitoring at least in a vicinity of the crane operating on the offshore unit.

[0040] The can include an operator module in communication with the interface and receiving control of the crane from an operator. A crane module in communication with the interface can receive feedback from equipment of the crane. To calculate the dynamically moving lifting zone in the dimensional map, the programmable control device can thereby determine dynamic movement of the crane relative to the dimensional map from the received control and feedback, and can dimensionally translate the dynamic movement of the crane into one or more boundaries of the lifting zone within the dimensional map.

[0041] Systems and methods are disclosed for locating personnel at a muster station on an offshore unit. According to the present disclosure, a method is used to track crew members on an offshore unit. Wireless transmitters are associated, in a database of a network system, with the crew members. Each of the wireless transmitters is configured to transmit a wireless signal associated in the database with one of the crew members. Wireless receivers arranged in a mapped layout of at least a portion of the offshore unit are associating in the database. The mapped layout at least includes one muster area of the offshore unit. Each of the wireless receivers is configured to receive the wireless signals, and each is connected in communication with at least one processing device of the network system.

[0042] An event is initiated at the at least one processing device that requires location of the crew members in the at least one muster area of the offshore unit. Any of the wireless signals of the wireless transmitters located by the wireless receivers in the at least one muster area are detected at the at least one processing device in response to the initiated event. A failure to detect at least one of the wireless signals of at least one of the wireless transmitters in the at least one muster area is determined at the at least one processing device, and the determined failure is output in the network system.

[0043] To associate the wireless transmitters with the crew members, tracking information of the crew members can be associated in the database with identifiers of the wireless transmitter. The tracking information can comprise one or more of personal identification, assignment, date boarded the unit, date to disembark the unit, authorization, designated work zone, communication information, radio channel, cellphone number, email address, pager number, emergency contact, and supervisor contact.

[0044] To associate the wireless receivers arranged in the at least one muster area of the offshore unit, a dimensional map of the at least one muster area of the offshore unit can be created in the database.

[0045] The wireless receivers can comprise nodes configured for a wireless protocol and wired to one or more power sources on the offshore unit, and the wireless transmitters can comprise beacons configured for the wireless protocol and powered by local power storage.

[0046] To detect any of the wireless signals, indication of one or more of the wireless signals can be received from one or more of portable ones of the wireless transmitters at one or more of a plurality of stationary ones of the wireless receivers.

[0047] To detect any of the wireless signals, strengths of the wireless signal of one of the wireless transmitters can be detected at at least two of the wireless receivers, and a location of the one wireless transmitter can be estimated based on the detected strengths.

[0048] To determine the failure to detect, the failure to detect can be determined within a predetermined time limit.

[0049] The determined failure can be output in a number of ways. To output the determined failure, for example, a perceptible representation of the determined failure can be generated, and the perceptible representation can be output from an interface of the at least one processing device to an operator. In another example to output the determined failure, a communication can be generated for the crew member of the determined failure, and the communication can be transmitted from an interface of the at least one processing device to the determined crew member based on the tracking information.

[0050] In yet another example to output the determined failure, the at least one wireless transmitter associated with the determined failure can be located with one or more of the wireless receivers arranged outside of the at least one muster area. Additionally, to output the determined failure, information of the crew member associated with the at least one wireless transmitter of the determined failure in the at least one muster area can be communicated to one or more portable processing devices.

[0051] According to a further aspect of the method, optical devices arranged in the mapped layout can be associating in the database. Absent detection by the wireless receivers, any person captured with at least one of the optical devices in the mapped layout can be detected with visual detection software operating on the at least one processing device. To output the determined failure, the crew member associated with the determined failure can be located and identified as the detected person.

[0052] To locate the crew member associated with the determined failure, the crew member can be located in the at least one muster area using the at least one optical device located in the at least one muster area. Alternatively, the crew member can be located outside the at least one muster area using the at least one optical device located outside the at least one muster area. To identify the crew member associated with the determined failure, the crew member can be visually identified based on a visual attribute using the visual detection software.

[0053] According to the present disclosure, a programmable storage device has program instructions stored thereon for causing a programmable control device to perform a method of tracking crew members on an offshore unit according to any of the above aspects.

[0054] According to the present disclosure, a system is used for tracking crew members on an offshore unit. The system comprises a plurality of portable wireless transmitters, a plurality of stationary wireless receivers, a database, a communication interface, and at least one programmable control device.

[0055] The portable wireless transmitters are each configured to transmit a wireless signal, and the stationary wireless receivers are arranged in a mapped layout of at least a portion of the offshore unit. The mapped layout at least includes at least one muster area of the offshore unit. Each of the wireless receivers is configured to receive the wireless signals of the wireless transmitters. The database associates the wireless receivers with the at least one muster area and associates the crew members with the portable wireless transmitters. The communication interface is in communication with the stationary wireless receivers. [0056] The at least one programmable control device is in communication with the database and the communication interface. The at least one programmable control device is configured to initiate an event requiring the crew members to locate in the at least one muster area of the offshore unit. In response to the initiated event, any of the portable wireless transmitters located by the stationary wireless transceivers in the at least one muster area is detected. A failure to detect any of the portable wireless transmitters in the at least one muster area is determined, and the determined failure is output.

[0057] The system can further include a plurality of visual detection devices associated with the offshore unit. The visual devices receive visual monitoring and is in

communication with the communication interface.

[0058] The system can perform any of the steps of the method disclosed above for tracking the crew members on the offshore unit.

[0059] The foregoing summary is not intended to summarize each potential embodiment or every aspect of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Fig. 1 illustrates a plan view of an offshore unit having cranes for remote operation and having a personnel tracking system according to the present disclosure.

[0061] Fig. 2A diagrams a plan view of stationary and portable wireless devices according to the present disclosure arranged on the offshore unit, representing an array of radius/cell coverage for each wireless device.

[0062] Fig. 2B diagrams a plan view of optical devices according to the present disclosure arranged on the offshore unit.

[0063] Fig. 2 C diagrams a plan view of a dimensional map having designated areas according to the present disclosure.

[0064] Fig. 3 illustrates a flow chart of the disclosed personnel tracking system during a mustering operation according to the present disclosure.

[0065] Fig. 4 illustrates a flow chart of the disclosed personnel tracking system during rig operations according to the present disclosure.

[0066] Fig. 5A diagrams a user interface screen showing a map of stationary wireless devices and optical devices for the disclosed tracking system arranged on an offshore unit.

[0067] Fig. 5B diagrams a user interface screen showing a map of personnel tracked in a mapped area. [0068] Fig. 5C diagrams a user interface screen showing a map and a video feed of personnel tracked in a mapped area.

[0069] Fig. 5D diagrams a user interface screen showing a map of equipment and tracked personnel in a mapped area.

[0070] Fig. 6 A diagrams a plan view of the dimensional map of the offshore unit having a dynamic lifting zone for crane operations.

[0071] Fig. 6B diagrams a perspective view of the dimensional map having the dynamic lifting zone.

[0072] Fig. 6C schematically illustrates a crane with some crane factors for use in dynamic determining geometry and location of a dynamic lifting zone according to the present disclosure.

[0073] Fig. 7 illustrates a flow chart of operation of the disclosed system in remotely operating cranes according to the present disclosure.

[0074] Figs. 8A-8C illustrate schematic views of the personnel tracking system according to the present disclosure.

[0075] Fig. 9 illustrates a plan view of a remote crane station for the disclosed system according to the present disclosure.

DETAILED DESCRIPTION OF THE DISCLOSURE

A. Overview of Offshore Unit

[0076] Fig. 1 illustrates a plan view of an offshore unit 20 having cranes 30 for remote operation and having a personnel tracking system 100 according to the present disclosure. Although shown here as a jack-up rig, the offshore unit 20 may be configured as a floating, fixed, or semi-submersible rig, vessel, barge, platform, mobile offshore drilling unit (MODU), mobile offshore production unit (MOPU), and the like according to various embodiments.

[0077] The offshore unit 20 includes a hull or platform 22 supported by a plurality of extendable and retractable legs 24 The unit 20 may be equipped with various facilities, including a control room 26, as well as any equipment necessary to operate offshore.

[0078] For example, the unit 20 can be equipped with a plurality of cranes 30 to assist with moving and supporting equipment to conduct various rig operations. The cranes 30 can rotate, extend, retract, lift, and lower their booms for moving equipment, pipe, and the like on the unit 20 and between the unit 20 and other vessels (not shown). The cranes 30 operate within an operable range or static lifting area 38 schematically outline here for one of the cranes 30.

[0079] To control and monitor the crane operations, the unit 20 includes a central control unit 105 and has a number of elements incorporated into components and locations on the unit 20 and its equipment. Also as part of the control and monitoring of the crane operations, a remote crane station can be provided in the control room 26 of the unit 20 or elsewhere. Alternatively or in addition, each crane 30 can have a local crane cabin.

[0080] The offshore unit 20 can include a tower 60 equipped to conduct operations, such as drilling, completions, logging, decommissioning, workover, and other offshore operations. The tower 60 can be movable relative to the vessel’s hull 22 in both forward and aft directions by a cantilever assembly 50.

[0081] The tower 60 may include a drawworks, top drive, manipulator arm, and any other equipment (not necessarily shown) to conduct operations through well center of the platform 22. As shown, for example, the tower 60 may be supported by a manipulator arm 62, a pipe carousel 64, a driller’s cabin 66, a degasser system, a swarf handling system, and a shaker system, BOP handling equipment, and fluid handling equipment.

[0082] In general, the unit 20 can include other equipment, such as a knuckle boom crane 32, pipe racks 40, and the like. For example, the knuckle boom crane 32 may be provided for handling pipes from a plurality of pipe racks 40 located on the hull 22 to and from the cantilever assembly 50.

[0083] In addition to monitoring crane operations, mapping, personnel identification, and tracking of personnel as disclosed herein can also be used for other purposes. For example, "restricted areas” can be mapped, and unauthorized entrance of personnel into these areas can initiate an alarm. Infractions of the "restricted areas” by personnel can be logged and tracked in conjunction with the personnel’s identification. Additional, muster stations on the unit 20 can automatically detect personnel present and can automatically populate a logbook.

[0084] During operations on the unit 20 and/or during emergencies, personnel or crew members may be performing different functions at various locations and may be located in their rooms, on the main deck, in a control room, in an engine room, etc. To track personnel on the unit 20, the unit 20 includes a personnel tracking system 100 ( see Fig.

2B) having a central control unit 150 and having a number of elements 110, 120, and 130 incorporated into components and locations on the unit 20 and its equipment. Also as part of the personnel tracking, the unit 20 has one or more specified work zones, safety areas, muster stations, and the like for monitoring personnel during various operations, emergency situations, and the like. Details are provided with reference to Figs. 2A-2C.

B. Diagrams of Offshore Unit

[0085] Fig. 2A diagrams a plan view showing an array of radius/cell coverage for each stationary wireless devices or nodes 110 and showing portable wireless devices 120 according to the present disclosure arranged on the platform 22 of offshore unit 20. The stationary wireless devices 110 can be arranged in any suitable layout, preferably having overlapping wireless regions 112 to cover at least suitable area(s) or several zones of the platform 22 and its decks. Although shown here in a plan, two-dimensional arrangement, the stationary wireless devices 110 can be arranged in three-dimensions, such as on several decks of the unit 20. Even a separate vessel 25 or the like may be outfitted with such stationary wireless device(s) 110. The arrangement shown in Fig. 2A is only exemplary.

[0086] In conjunction with the stationary wireless devices 110, the personnel tracking system 100 further includes the plurality of portable wireless devices 120, which are associated with entities on the unit 20. The entities can be personnel [i.e., crew members), equipment, or the like located on the platform 22. Typically, the entities of interest according to the present disclosure will include personnel or crew members, who will move on the platform 22, are authorized for certain areas, are restricted in other areas at least during given operations, and need to gather in muster stations during an emergency.

[0087] For example, portable wireless devices 120 can be associated with personnel who operate on the unit 20. Portable wireless devices 120 can also be associated with equipment and other components that may be movable on the unit 20 and/or may be needed during emergency situations. For example, movable equipment, such as cranes (30), booms (32), etc., on the unit 20 may have portable wireless devices 120 for tracking movement. In other examples, fork lifts, the retractable legs (24), components on the cantilever assembly (50), other cranes, and the like may also have portable wireless devices 120 installed or attached to them. In further examples, life jackets, supplies, containers, survival equipment, and the like may also have portable wireless devices 120 installed or attached to them. (For simplicity, reference herein may be specifically made to tracking personnel, although this should be taken to mean any suitable entity for tracking on the unit 20.)

[0088] The portable wireless devices 120 can be beacons, transmitters, or other like devices that use radio-frequency identification (RFID), wireless, Bluetooth®, Wi-Fi, cellular, radio link, or other form of wireless protocol or communication. (BLUETOOTH is a registered trademark of BLUETOOTH SIG, INC.) The portable wireless devices 120 can use a battery or other local power storage. For example, the portable devices 120 can include Bluetooth® beacons or transmitters mounted on personnel hard hats, worn on outer clothing of personnel in some fashion, affixed to movable equipment on the unit 20, etc. The stationary devices 110 can at least be receivers of the same form of wireless protocol or communication. Preferably, the devices 110 and 120 use the wireless personal area network technology of Bluetooth® Low Energy (BLE). Transceivers can be used to enable read/write capabilities for the devices.

[0089] Due to the environment of the offshore unit 20, the arrangement of the wireless devices 110, 120; the signal strengths provided; the frequency ranges used; and the like should all account for walls, barriers, and other structures of the offshore unit; electrical interference of equipment; electro-magnetic iron-effects of the metal structure; and other considerations. These and other considerations will be appreciated based on the teachings of the present disclosure.

[0090] As discussed below, entities [e.g., personnel and/or equipment) are located and identified within an electronic map ofthe unit 20 using the wireless devices 110, 120. As also discussed below, the control system 100 can functionality identify the personnel (or equipment) as authorized or unauthorized for one or more particular areas of the unit 20. Other categories could also be used.

[0091] In addition to the wireless devices 110, 120, the personnel tracking system 100 can further include a plurality of optical devices 130a-c arranged on the offshore unit 20. Fig. 2B diagrams a plan view of optical devices 130a-c according to the present disclosure arranged on the offshore unit 20. The optical devices 130a-c can be arranged in any suitable layout, preferably covering suitable areas. Although shown here in a plan, two- dimensional arrangement, the optical devices 130a-c can be arranged in three-dimensions, such as on several decks of the unit 20. The arrangement in Fig. 2B is only exemplary.

[0092] The optical devices 130a-c can include cameras, motion detectors, proximity sensors, or the like. For example, at least some of the devices 130a-c can be pan-tilt-zoom (PTZ) cameras. As with the wireless devices (110, 120), some optical devices 130a may be arranged in a stationary layout on the unit 20 to monitor various zones, regions, and areas of the unit 20 and may be arranged to provide a number of camera feeds. Other the optical devices 130b may be arranged to move on or relative to the unit 20. For example, optical devices 130c can be associated with movable equipment [e.g., cranes 30 and the like) to provide a number of moving camera feeds of the vicinity around the moving equipment.

[0093] In addition to providing camera feeds, the network of optical devices 130a-c can provide visual recognition of personnel and/or equipment on the unit 20. The visual recognition of personnel in addition to the output of their location on the unit 20 can be used by the tracking system 100 to determine location of personnel in areas of the unit 20.

[0094] According to one arrangement, the tracking system 100 uses a combination of the wireless and optical devices 110, 120, and 130a-c installed across areas of the platform 22. These areas are mapped digitally in coordinates and can be modelled as a dimensional layout or map 200, such as shown in a plan view in Fig. 2 C. The dimensional map 200 includes a coordinate system 210, such as Cartesian coordinates or polar coordinates, although other systems could be used. Mapped locations 212 of the personnel (or equipment) can be determined in the coordinate system 210 of the map 200 using monitoring and tracking provided by the wireless and optical devices (110, 120, and 130a- c). Features of the platform 22 and its equipment can also be located in the coordinate system 210 of the map 200.

[0095] Overall, the locations of the stationary wireless devices (110) are predefined [i.e., mapped) and are used to produce the static dimensional layout or map 200 of the unit (20). Although the dimensional map 200 can produce a two-dimensional map, the map 200 can also produce a three-dimensional map. Survey, global positioning system, and other such information can be used in producing the location information [e.g., x, y, z coordinates) for the map 200.

[0096] The dimensional map 200 can cover the entire (or near entire) area of the unit 20. Alternatively, one or more areas 220, 222, and 224 can be digitally laid out in the map 200 with a fixed set of coordinates that represents specific locations of interest. Any area where personnel may be located will preferably have a digital area map or portion thereof created for it.

[0097] As examples, the map 200 can include the work zones 220, restricted areas 222, and muster stations 224 electronically mapped in Cartesian or other coordinates within the predefined array of stationary devices (110) and optical devices (130a-c). The muster stations 224 represent areas where personnel are instructed to gather during an emergency and can include evacuation areas, safe areas, evacuation routes, lifeboat stations, etc.

[0098] As disclosed in more detail below, one or more static areas can be digitally laid out in the map 200 with a fixed set of coordinates can represent a potential location of possible on-board lifting operations by the cranes (30). The map 200 at least includes the static lifting areas (38) of the cranes 30 electronically mapped in Cartesian or other coordinates within the predefined array of stationary devices (110). Such static areas can represent where the cranes (30) could potentially conduct lifting operations. Moreover, as disclosed in more detail below with reference to Figs. 6A-6B, dynamic zones can also be configured that move across the digital map 200 with moving equipment, such as when a crane (30) is moving a load.

[0099] Using the wireless devices 110, 120 and the optical devices 130a-c, entities [e.g., personnel and/or equipment) are located and identified within the electronic map 200 of the unit 20 {e.g., at least in work zones 220, restricted areas 222, and muster stations 224). Briefly, for example, personnel (or equipment) can be identified for specifically defined areas 220, 222, and 224 or other regions of the map 200. When personnel enter the defined areas 220, 222, and 224, the tracking system (100) can generate a record, a log, an alarm, or the like. Additionally, real-time visual indications of locations and other relevant information can be overlaid on real-time camera views of the area provided to an operator. Additionally, the tracking system 100 can functionality identify the personnel (or equipment) as authorized or unauthorized for one or more particular areas of the unit 20. Other categories could also be used.

[0100] In addition to the defined areas 220, 222, and 224, the tracking system (100) can be used to monitor and control crane operations, areas around the crane, and dynamic lifting zones of the cranes, as hinted to previously and discussed in more detail later.

Briefly, for example, real-time information of zones, personnel identification, and location is integrated into an operator’s user interface by augmenting and overlaying the real-time camera views to enhance the operator’s awareness of operations. Designated areas for the work zones 220, restricted areas 224, muster stations 224, lifting areas, dynamic lifting zones, and the like are digitally mapped, and a combination of visual and wireless monitoring provide real-time location and identification of personnel who enter digitally mapped areas. For example, the associated areas can have a semi-transparent overlay that is superimposed on the operator’s camera feed on the displays. This will provide a visual representation of the zones in real time for the operator. The mapping, personnel identification, and tracking can automatically detect personnel present in work zones 220, restricted areas 224, muster stations 224, etc. on the unit 20 and can automatically populate a logbook.

C. Personnel Tracking at Muster Stations

[0101] Having an overview of the tracking system 100 and its use provided above, discussion now turns to how the tracking system 100 can track entities (personnel and/or equipment) in defined areas 220, 222, and 224 and during particular operations of equipment on the unit 20.

[0102] In particular, Fig. 3 illustrates a flow chart of a process 300 of the disclosed system 100 in tracking personnel (and/or equipment) according to the present disclosure. (For purposes of explanation, reference to features in Figs. 1 and 2A-2C will be provided in the current discussion.)

[0103] In the present arrangement for Fig. 3, the tracking system 100 is used in muster stations 224 of the unit 20. During an event requiring personnel to muster to emergency or other locations, the system 100 recognizes who is present and who is not present in the designated muster station(s) 224 within a specified time frame. Utilizing the combination of unique personnel beacons 120 and/or visual recognition, personnel are counted, identified, and located in the muster station(s) 224 on the unit 20 with accuracy and immediacy. Personnel overseeing mustering activities can note all personnel present at the muster station(s) 224 and the location of those absent on a portable device. For those who are not present, the tracking system 100 can locate the missing personnel on the unit 20. Once located, a live camera feed and/ or a digital map position detailing where the missing personnel is located on the unit 20 can be fed to the handheld device or other location, such as an on-shore monitoring station.

[0104] To track the personnel, the portable wireless devices 120 are distributed to the personnel (Block 310). Some of the devices 120 are portable and associated [e.g., worn, carried, etc.) by personnel (or attached to their equipment). Each device 120 [i.e., its identifier or signal) for a crew member is associated with tracking information 312, such as an identification of the crew member, assignment, date boarded the unit 20, date to disembark the unit 20, authorizations for the crew member, and work zones or other areas where the crew member is restricted. The tracking information can include communication information, such as radio channel, cellphone number, email address, pager number, emergency contact, and supervisor contact. This and other information can be associated in a database with the device 120 and the crew member.

[0105] The stationary wireless devices 110 and optical devices 130 are associated [e.g., mounted, laid out, etc.) on the unit 20 (Block 320). In distributing the wireless and optical devices 110 and 130, identifying information 322 is associated with them in a database. For example, the stationary devices 110 are arranged as access points with a configured layout on the unit 20 to cover various designated areas, regions, and the like, such as work zones 220, restricted areas 222, and muster stations 224, on the unit 20. In that sense, the stationary wireless devices 110 can be access points, receivers, transceivers, and the like for compatible wireless communication with the portable devices 120.

[0106] In addition to the wireless devices 110 and 120, various optical devices 130, such as cameras, motion sensors, and the like, are distributed on the unit 20 and can be arranged to monitor areas, regions, and the like, such as work zones 220, restricted areas 222, and muster stations 224. The optical devices 130 may operate in some areas as a primary form of monitoring personnel (or movable equipment), but may operate in other areas as a secondary form of monitoring that is ancillary to the wireless monitoring.

[0107] As noted above, the devices 110, 120, and 130 are associated with database information (Block 312, 322) of the tracking system 100. The database information (312) can include tracking information of the crew members associated with the wireless transmitters 120. For example, the tracking information can include identifying information [e.g., worker ID, name, position, etc.) and particular designations or authorizations for the personnel. Thus, a given personnel member may or may not be designated/authorized to access or work in various areas or regions on the unit 20, and information on such designations/authorizations can be stored in the system 100 and associated with the personnel’s identification.

[0108] The database information (322) can include layout information of the devices 110, 130 and information about areas or other regions of the unit 20. For example, each of the devices 110, 130 is associated with identification information, assigned to the layout of the unit 20, and associated with work zones, restricted areas, and muster stations and the like.

[0109] From the layout and monitoring, the dimensional map 200 of the offshore unit 20 is created in the tracking system 100 [e.g., in a database) (Block 330). [0110] With the set up and arrangement completed, the tracking system 100 monitors rig operations; the distributed devices 110, 120, and 130; the designated areas [e.g., work zones 220, restricted areas 222, and muster stations 224); and the tracked locations 212 of the personnel’s wireless transmitters 120 (Block 340). To do this, wireless monitoring is received in the form of wireless inputs from the wireless devices 110, 120 associated with the personnel and the offshore unit 20. Visual monitoring can also be received in the form of optical input from the optical devices 130 of cameras, motion sensors, and the like.

[0111] The tracking involves the portable wireless transmitters 120 ofthe personnel wirelessly interacting with one or more stationary receivers 110 distributed on the unit 20. The wireless interaction can involve communication of identifying information, such as an ID number, signal strength, access point location, and the like, which is associated in the database with given information of the personnel, dimensional map 200, designated areas (220, 222, 224), etc. For example, the portable transmitter 120 of a crew member in a zone on the unit 20 may wirelessly interact with two or more stationary receivers 110 with known locations on the unit 20. Using triangulation, comparison of signal strengths between stationary receivers 110, and other locating techniques, the location of the portable transmitter 120 can be indicated in the dimensional map 200 of the unit 20. The personnel (or equipment) associated with the portable transmitted 120 can be identified, authorizations accessed, and other steps taken.

[0112] As a backup to the wireless monitoring or in place of the wireless monitoring in some areas, visual monitoring with the optical devices 130 of cameras, motion sensors, and the like can be used for tracking locations of personnel and equipment in the dimensional map 200 of the unit 20. Personnel and equipment, whether wirelessly monitored or not, can also be tracked in this manner. For example, personnel [e.g., P in Fig. 2C) may not currently have a portable wireless device 120, the portable device 120 may not be interacting properly, a particular zone may not have stationary wireless devices 110 that are operational, or some other reason may apply. The visual monitoring can be used in these and other situations to locate, track, and potentially identify the personnel (P).

[0113] The monitoring (Block 340) discussed above can be continuous with repeated monitoring and updating in real-time. Such tracking has benefits on its own in monitoring various operations on the unit 20.

[0114] To monitor rig operations, the system 100 may be integrated with rig controls, emergency equipment, fire detection equipment, weather detection equipment, and the like on the unit 20. When an alarm condition or emergency occurs, the tracking system 100 initiates an event requiring mustering of crew members in designated muster stations 224 (Block 350). The event can be initiated automatically from another monitoring system, such as weather or emergency monitoring system. Alternatively, the tracking system 100 may allow for an operator to initiate the event. A number of events may occur on the unit 20 that require personnel to muster at muster stations 224. For example, severe weather conditions may require crew members to leave areas of the unit 20 and congregate at the muster stations 224.

[0115] In response to the detected event, the tracking system 100 detects the personnel in mapped muster stations 224 with the distributed devices 110, 120, and 130 (Block 360). To detect the personnel, the tracking system 100 obtains dynamic tracking parameters (362) of the offshore unit 20. The dynamic tracking parameters include wireless inputs from wireless devices 110, 120 and include visual inputs from cameras 130 associated with muster stations 224 and surrounding areas, communications from personnel on the unit 20 and other control stations 60, locations 212 of personnel in the dimensional map 200, identification of the personnel, visual boundaries of zones in the dimensional map 200, and other information.

[0116] The tracking system 100 has access to a manifest and determines if any personnel have not been detected within the designated muster station 224 at least within a defined time frame (Block 370). For example, the tracking system 100 can determine a failure to detect any of the wireless signals of the wireless transmitters 120 of given crew members in the designated muster station(s) 224. The tracking is done automatically as the wireless receivers 110 at the muster station 224 detect each of the wireless transmitters 120 in the area, and the system 100 registers the associated crew member on the muster station’s manifest in the system database.

[0117] During the event, the system 100 can then output information to operators (Block 380). The output (382) can include visual display, audible alarms, control feedback, etc. Primarily, the output (382) can include lists of crew members in the muster station 224 and lists of missing crew members of the station 224. Operators at the muster station 224 can access the lists and can perform additional actions. For example, the output (328) can take the form of visual display in user interfaces of portable units. Graphical overlays can be included in the visual displays to depict the muster stations 224, information of located personnel, information of personnel missing from the muster stations 224, camera feeds, etc.

[0118] The tracking system 100 can also generate automatic or manual controls (384). In response to a missing crew member, for example, automated or manual communications may be initiated. Automated communications can include a visual display, an alarm, an instruction, or the like may be sent via the communication interface from the system 100 to the operator, the missing personnel, and others using an appropriate form of communication.

[0119] The controls (384) may allow operators to take active steps. For missing personnel from the muster stations 224, the tracking system 100 may determine the tracked location 212 where they are located. The system 100 may then allow operators to contact the crew member, to initiate an alarm on the crew member’s wireless device 120 or communication equipment, to locate the crew member in other areas of the unit 20, etc.

[0120] As a discrete example of tracking personnel at muster stations, Fig. 5 A diagrams a user interface 500A mapping stationary wireless receivers 110 and optical devices 130 for the disclosed tracking system 100 arranged in an example area 502, such as a muster station. Various wireless transmitters 120 of personnel are located in the mapped area 502 of the muster station by the tracking system 100, and a manifest of the personnel can be generated.

[0121] As a further example, Fig. 5B diagrams a user interface 500B having the mapped area 502 of personnel tracked in the muster station and showing a manifest 504 of those logged and those not logged within the muster station. An operator of the tracking system (100) can select one or more of the missing personnel and can select one or more controls 506 to generate an alert or to call the selected personnel through communication information associated in the database.

[0122] With the controls 506, the operator can also use the tracking system (100) to locate the selected, unlogged personnel. For example, Fig. 5C diagrams a user interface 500C showing another mapped area 510 and a video feed 512 of the selected, unlogged personnel tracked in another area of the unit (20). The selected, unlogged crew member [e.g., ID#003) on the missing manifest from the previous screen 500B has been located in this mapped area 510 using the wireless devices (110, 120).

[0123] Some of the personnel may not be located through the wireless transmitters (120), either due to a malfunction of the transmitters (120), poor battery level, loss of the transmitter, etc. The visual tracking can be used to locate and track the personnel in addition to or in place of the wireless tracking.

[0124] For example, the user interface 500B in Fig. 5B includes unidentified personnel [e.g., NO TX#) in the manifest 504. The unidentified include any persons detected by visual detection software in the images/video captured with at least one of the optical devices 130 in the muster station when that person has not been detected with the wireless system. The person can be assigned a tracking identifier and can be located visually, but the identity of the person may not be known. The controls 506 allow the operator to identify the detected person who has been located in the muster station visually without the wireless system. This identification can be done manually by the operator entering the identity of the crew member so that the visual tracking can continue to identify and track the crew member. Alternatively, the visual detection software can determine the identity of the detected person automatically using a visual attribute, such as facial recognition, body type, walking pattern, a symbol, a marker, an emblem, a uniform, clothing, a hardhat type, or some other form of identifying feature or physical attribute.

[0125] In another example, the video processing of the feed 512 in Fig. 5C has detected an additional person outside the muster area (224) who has not been identified with a transmitter (120). Although the person is detected and located visually in the mapped area 510 and can be assigned a tracking identifier, the identity of the person may not be known. The controls 516 can allow the operator to identify the detected person who has been located in the outside area visually without the wireless system. This identification can be done manually by the operator entering the identity of the crew member so that the visual tracking can then identify and track the crew member. Alternatively, the visual detection software can determine the identity of the detected person automatically or based on the operator’s selection using a visual attribute, such as facial recognition, body type, walking pattern, a symbol, a marker, an emblem, a uniform, clothing, a hardhat type, or some other form of identifying feature or physical attribute.

[0126] Overall, depending on the visual detection software, the visual tracking can detect persons in the captured image or video, although personal identification of the crew members may not be achieved. In other implementations, the visual detection software can be used to personally identify the crew members visually detected by the optical devices (130), using facial recognition, body type, walking pattern, a symbol, a marker, clothing, or some other form of identifying feature or physical attribute. In that sense, visual detection of any person in a mapped area by one or more optical devices (130) can be compared to wireless detection of wireless transmitters (120) in the same mapped area by one or more wireless receivers (110). A detected person who has been both visually and wirelessly located in the mapped area can then have one or more visual attributes captured by the optical device(s) (130) associated with the known identifying and tracking information of the crew member, who is known from the crew member’s associated wireless transmitter (120) detected by the wireless receivers (110). Likewise, a detected person who has been only visually located but not wirelessly located in the mapped area can have one or more visual attributes captured by the optical device (s) (130) associated with identifying and tracking information generated for the visually detected person. This generated information can then be used to automatically or manually identify the visually detected person as a particular crew member. In the meantime, the generated information can be used to track the detected person even as the person moves to other mapped areas of the offshore unit 20 monitored by other optical devices (130).

D. Personnel Tracking During Rig Operations

[0127] In addition to determining when crew members are missing from muster stations 224 during an event and locating the missing crew member on the unit 20, the disclosed tracking system 100 can monitor on-going, normal operations on the unit 20, track crew members, and perform a number of functions. To do this tracking of personnel during operations, the tracking system 100 uses the same elements discussed above for tracking at muster stations.

[0128] In this way, a combination of individual wireless transmitters 120 [e.g., wearable Bluetooth beacons) and visual detection can provide real-time personnel

detection/location and identification visible to operators. The wireless receivers 110 [e.g., Bluetooth receiver nodes) stationed to establish a grid of physical coordinates can be used to locate and track in real-time the wireless transmitters 120. The digital map 200 representing the area over which operations are to take place is created from the locations of the receiver nodes 120. Movements of the crew members are tracked and displayed in real-time across this digital map. Zones that define authorized and unauthorized areas for specific personnel are defined on the digital map and are monitored in real-time for violations. Violations may be logged and may actuate remedial actions, such as alarms, directed communications to crew members, change in operations, physical intervention, etc. [0129] To that end, Fig. 4 illustrates a flow chart of a process 400 of the disclosed system 100 in tracking personnel during operations according to the present disclosure. (For purposes of explanation, reference to features in Figs. 1 and 2A-2C will be provided in the current discussion.)

[0130] As before, the process 400 involves distributing the receivers 110 and cameras 130 on the unit 20 and distributing the beacons 120 to personnel (Block 410) and involves creating the dimensional map (Block 420). These steps for set up and arrangement are similar to those discussed previously.

[0131] The tracking system 100 monitors rig operations, personnel, and designated areas [i.e., work zones 220, restricted areas 222, muster stations 224, etc.) (Block 430). In monitoring the rig operations, the system 100 determines whether to establish a restricted area 222 or whether a restricted area 222 is already established (Decision 440). For instance, some areas 222 may be permanently restricted or may be restricted based on which particular rig operations are being conducted at the time. Generally, a certain rig operation that is being performed at the time may require an area of the unit 20 around equipment to be restricted to all or certain crew members. A number of rig operations dictate different scenarios that define when crew members can or cannot be located in relation to equipment.

[0132] For example, the system 100 can monitor states of equipment in areas of the unit 20 during current rig operations. Certain equipment may be operating, not operating, moving, not moving, etc. in certain stages of the rig operations. The state of the equipment in a designated area may then define whether the area is restricted or not.

[0133] In monitoring the personnel, the system 100 monitors the personnel [i.e., their particular ID, authorizations, etc.) and monitors their locations in relation to the established areas [e.g., work zones 220, restricted areas 222, etc.) (Block 450).

[0134] The tracking system 100 determines if a crew member has been found (located) in or has breached a restricted area 222 (Decision 460) and determines if the identified crew member is authorized for the area 222 (Decision 470). For example, a particular crew member may enter or be found in a restricted area 222 for which the crew member is not authorized during the operation performed with equipment in the area 222. Other crew members may be allowed in the area 222 at the time. Alternatively, all crew members may be restricted in the area 222 during the rig operation. [0135] In response to the detected breach, unauthorized entry, etc., the tracking system 100 initiates an alarm, logs the incident, sends out a communication to the crew member or to others, and performs other ancillary functions (Block 472). The alarms can be local alarms in the restricted area 222 or can be general alarms or alters. Communications can be directed to the identified crew member and/or to others.

[0136] In some situations, additional actions may be necessary in addition to initiating alarms, logging the event, and sending out communications. In these types of situations, the system 100 determines if intervention is required (Decision 480). For example, the crew member may be in the vicinity of moving or operating equipment during a particular rig operation, and the crew members needs to be removed from the area 222 or the equipment needs to be stopped. The crew member may have been only visually detected in the restricted area because the wireless system has not detected a wireless transmitter 120 of an associated crew member for whatever reason. Therefore, the detected person’s identity and corresponding authorizations may not be known. Any number of

interventions may be needed given the current rig operation, operating equipment, persons detected, and the like.

[0137] To determine if intervention is required, the system 100 obtains a policy defined for the area, the equipment, and the current rig operation (Block 474). Rig operations have defined policies governing protocols for controlling equipment and stopping operation given certain conditions, and the system 100 is coded with the policies and runs a decision-making process based on acquired information to determine if, when, and how to control/stop/alter the rig operation. Ultimate control may be left for user intervention and final decision. In the end, the tracking system 100 performs (or is at least used to perform) the required intervention based on the defined policy (Block 490).

[0138] In one example, a restriction in a designated area may be initiated in response to a monitored state of the equipment because the equipment is determined to be operating and because an associated policy restricts crew members in the designated area when the equipment is operating. The action defined by the policy associated with the equipment may call for the equipment to be shutdown. The shutdown can be initiated automatically or manually. Alternatively, the action defined by the policy associated with the equipment may call for the equipment to continue operation. In this case, a determined action can be initiated automatically or manually that involves initiating an alarm condition, communicating with the associated crew member having the wireless transmitter in the restricted area, calling for intervention by other crew members, and/or other actions.

[0139] In another example, a restriction in a designated area may be initiated in response to a monitored state of the equipment because the equipment is determined to be moving and because an associated policy restricts crew members in the designated area when the equipment is moving. The action defined by the policy associated with the equipment may call for the equipment to be stopped, which can be initiated automatically or manually. Alternatively, the action defined by the policy associated with the equipment may call for the equipment to continue moving. In this case, a determined action can be initiated automatically or manually that involves initiating an alarm condition, communicating with the associated crew member having the wireless transmitter in the restricted area, calling for intervention by other crew members, and/or other actions.

[0140] In some scenarios, a person may be detected visually but not wirelessly in the restricted area 222 through visual monitoring, but the person may not be identified. For example, the person may not have their wireless transmitter 120, there may be some malfunction, or the like. The person can be assigned a tracking identifier and can be located visually, but the tracking system may be unable to personally identify the visually detected person from associated information in the database. In this case, personal communication directly with the detected person cannot be achieved. The tracking system 100 can be used so one or more other crew members can intervene. The system 100 can send communications to the other crew members and instruct them to intervene with the unidentified crew member in the restricted area 222.

[0141] In other scenarios where a person may be detected visually but not wirelessly in the restricted area 222, identification of the person as a particular crew member can be done manually by the operator entering the identity of the crew member so that the visual tracking can then identify and track the crew member. Alternatively, the detected person may be visually identified as a particular crew member automatically through visual monitoring. For example, the visual detection software can determine the identity of the detected person automatically using facial recognition, symbol, marker, clothing, or other some of form of identification or physical attribute.

[0142] As a discrete example of tracking personnel during operations, Fig. 5D diagrams a user interface 500D mapping an area 520 [e.g., work zone) having stationary wireless receivers 110 and optical devices 130 for the disclosed tracking system 100. The work zone 520 may have a restricted boundary or may be restricted based on current operations. The system 100 monitors the operational state of equipment in the area 520, such as whether the equipment is active or inactive, operating or not operating, moving or not moving, etc. The current operating state of the equipment may restrict all (or certain) personnel from being located in the work zone 520 or in the vicinity of the equipment. An alarm condition may be generated automatically or manually, and the system 100 can display details 522 of the alarm condition to the operator.

[0143] For example, the area 520 has equipment [e.g., units #4 & #5), and a crew member has been located in the area 520 near the equipment. The interface 500D displays an alarm condition 522, showing the current operation, state, or status of the rig operation; describing the alarm; and giving the policy defined for handling the alarm condition. In the depicted example, equipment (unit #4) is active with an execution, and the identified crew member is unauthorized in the work zone 520 for the operation of the equipment. The coded policy defines a recommended action of immediate shutdown of the rig operation [i.e., shutdown of the active equipment). The operator can select one or more controls 522 to generate an alert, to call the selected personnel through communication information associated in the database, or to shut down the given equipment.

[0144] As noted above, certain policies govern how to handle various situations, such as when personnel are located close to operating or moving equipment. In some cases, the policy may dictate that the equipment needs to be stopped or turned off. In other cases, stopping or turning off the equipment may not be warranted due to the impact to other equipment or operations on the unit 20. Although the dictated policy may be implemented automatically, the tracking system 100 can display the policy recommendation and permit the operator to select actions, such as alerting the personnel with an alarm in the area, calling the identified personnel through associated communication information, or shutting-down/stopping the operating/moving equipment.

E. Personnel Tracking During Crane Operations

[0145] One particular example of a rig operation requiring monitoring and possible intervention when an unauthorized crew member is found in a restricted zone involves crane operations. According to this arrangement, the control system 100 uses a combination of the wireless and optical devices 110, 120, and 130 installed across potential areas exposed to lifting operations. These areas are mapped digitally in coordinates across the potential static areas 38 that could be exposed to lifting operations. For example, based on the wireless and optical monitoring of the unit 20 from the layout of the wireless and optical devices 110, 120, and 130, the unit 20 can be modelled as a dimensional map 200, such as shown in a plan view in Fig. 6A and in a perspective view in Fig. 6B.

[0146] As shown, the dimensional map 200 again includes a coordinate system 210, such as Cartesian coordinates or polar coordinates, although other systems could be used. Even a separate vessel or the like may include coordinate mapping 215. Mapped locations 220 of the personnel (or equipment) can be determined in the coordinate system 210 of the map 200 using monitoring and tracking provided by the wireless and optical devices (110, 120, and 130). Features of the crane 30 can also be located in the coordinate system 210 of the map 200 using information provided by the crane’s operation and the operator’s controls. As schematically shown here, the features of the crane 30 can include the pedestal 232, the boom 234, the boom end 236, motion range 238, and load 240, which can be mapped.

[0147] Crane instrumentation can deliver real-time location of the load 240 and the crane boom 234 as defined by coordinates in the static lifting area 238. The crane information is used to create a dynamic lifting zone 250 defined in the map 200. As shown, the dynamic lifting zone 250 can be moved dynamically in the map 200 with the operation of the crane 30. The dynamic lifting zone 250 can have any desirable boundaries and can define a region taken up by the crane’s boom 234 and load 240, a region in which the crane’s boom 234 and load 240 is moving, a buffer area about such regions, and other such boundaries.

[0148] Overall, the dynamic lifting zone 250 can be the area moving under the boom 234 and its load 240. The geometry and location of the dynamic lifting zone 250 is subject to real-time changes in boom and slew angles, as well as other factors. Briefly, Fig. 6C schematically illustrates a crane 30 with some crane parameters for use in dynamically determining the geometry and location of the dynamic lifting zone 250.

[0149] In general, various types of cranes 30 can be used. For example, the crane 30 can a pedestal crane having a revolving superstructure (with boom) bolted to a roller bearing.

In another example, the crane 30 can be a kingpost crane having a stationary or fixed kingpost about which a revolving structure (with boom, machinery housing, hoist and slewing machinery, etc.) revolves. The crane 30 can have knuckled booms, latticed booms, etc. In general, the crane 30 can have suitable lifting capacities for offshore operations ranging as high as 300 metric tons, and the crane 30 can have boom lengths of any suitable length, such as up to 200 feet. Sensors can measure rope speed, slew angle position, boom angle, load, and other parameters of the crane 30.

[0150] The crane shown in Fig. 6C includes a pedestal 232 with a boom 234 mounted thereon. The boom 234 of the upper structure supports a hoist tackle (not shown) and is raised and lowered by a boom hoist 233, which uses wire ropes, sheaves, shafts blocks and other rigging to support the boom 234. The pedestal 232 typically has a height (H) above the platform (22) of the offshore unit (20). The boom 234 can rotate about the pedestal 232 to define a slew angle (HI) relative to a reference [e.g., Y’-axis in Fig. 3C). The boom 234 can also be raised or lowered to define a boom angle (H) relative to a reference plane [e.g., horizontal X’-Y’ plane in Fig. 3C). Finally, the boom 234 can be extended or retracted to define a boom length (L).

[0151] In addition to slew angle (H), boom angle (H), and boom length (L), other crane parameters can include hook load/weight (W), block height, alarms [e.g., boom limit, slew limit, overload), hoist speed (S), cable length (R), boom angle speed, slew angle speed, environmental data [e.g., wind speed), and other data. The crane instrumentation can provide these and a number of other crane parameters related to the operation of the crane 30.

[0152] In general and already noted above, the dynamic lifting zone 250 in Figs. 6A-6C is defined within the static lifting zone 238 and includes the area under the crane boom 234 and its load 240. This zone 250 and its associated geometry moves with the crane boom 234 and its load 240 as lifting operations are undertaken. Although the dynamic lifting zone 250 can have any suitable boundaries, the geometry is preferably inclusive of the various loads 240 that could be lifted by the crane 30 in which the system is integrated.

The dynamic lifting zone 250 can be circular and defined by a center point and a radius. Alternatively, the dynamic lifting zone 250 can be rectilinear and defined by at least a width (w) and a length (1), as represented in Figs. 6A-6C. (A height could also be defined.)

[0153] For example, the width (w) of the zone’s geometry can be a predetermined value and can move as a whole in real time with the slew angle (H) provided by the crane instrumentation to the system 100. The length (1) of the zone’s geometry can have a predetermined lower limit that corresponds to the lowest possible operational boom angle (H). The length (1) of the dynamic lifting zone 250 can be increased from this lower limit in real-time with changes of the boom angle (H). As a result, the boom angle (H) combined with physical boom length (L) define a hypotenuse, and the resulting length (1) for the dynamic lifting zone 250 represents the adjacent side of the resulting triangle. These inputs and associated calculations can thereby make up the geometric boundaries of the dynamic lifting zone 250.

[0154] As the crane (30) operates on the unit (20), the crane operator uses the information of the dimensional map 200, the located personnel (or equipment) 220, camera feeds, the dynamically moving dynamic lifting zone 250, and the like to monitor and control the crane’s operation. In general, the information can indicate a conflict or interaction of located personnel (or equipment) 220 with the dynamic lifting zone 250, which may require some further action by the crane operator.

[0155] For example, personnel (or equipment) can be identified as authorized or unauthorized for specifically defined lifting zones 250 or other regions of the map 200.

For example, the operator has the ability to provide "authorized” status to personnel that will be assisting with lifting operations. During the crane operation, the locations 220 of the personnel (or equipment) are tracked in real-time, and identifications of the tracked locations 220 can be associated with authorized or unauthorized status for the defined dynamic lifting zone 250. When unauthorized personnel enter the defined dynamic lifting zone 250 (or when the dynamic lifting zone 250 moves to encompass unauthorized personnel), the control system (100) can generate automated alarms and/or machine controls. Additionally, real-time visual indications of locations and other relevant lifting information can be overlaid on real-time camera views of the lifting operation provided to the crane operator. As noted herein, the detection of personnel (and equipment) in the dynamic lifting zone 250 can be determined manually or automatically based on load 240, direction, movement, and other noted parameters discussed herein.

[0156] As shown in Figs. 6B-6C, the lifting zone under consideration may include an additional margin around the dynamic lifting zone 250 that will also move in conjunction with the dynamic lifting zone 250. As one example, the margin may encompass a dynamic warning zone 255, which can extend out approximately 20 -ft or some other distance from the dynamic lifting zone 250 in all directions. The dynamic warning zone 255 may be extended in the direction of movement to provide advance warning.

[0157] Any unauthorized personnel (or equipment) that crosses the threshold of the dynamic warning zone 255 (or has the warning zone’s threshold move to encompass it) can initiate an alarm that notifies the crane operator, the unauthorized personnel infringing the zone, and/or some other entity. In like manner, any unauthorized personnel (or equipment) that enters the dynamic lifting zone 250 (or has the lifting zone’s threshold move to encompass it) can initiate a separate specific alarm that can notify these same parties.

[0158] With an overview of the control system 100 and its use in tracking crane operation, discussion turns to Fig. 7, which illustrates a flow chart of a process 300 of the disclosed system 100 in remotely operating cranes 30 according to the present disclosure. (For purposes of explanation, reference to elements in Figs. 1, 2A-2B, and 6A-6C will be provided in the current discussion.)

[0159] To operate the cranes 30 on the offshore unit 20 on which personnel operate, the plurality of wireless devices 110, 120 are distributed (Block 710). Some of the devices 120 are portable and associated [e.g., worn, carried, etc.) by personnel (or attached to equipment). Other devices 110 are stationary and associated [e.g., mounted, etc.) on the unit 20.

[0160] In distributing the wireless devices 110, 120, the stationary devices 110 are arranged as access points with a configured layout on the unit 20 to cover various work areas, regions, and the like on the unit 20. As will be appreciated, the various work areas on the unit 20 may be used for different purposes and operations, such as pipe handling, pipe storage, fluid handling, etc. The portable wireless devices 120 can be beacons, transmitters, Bluetooth, RFID, cellular, or other like devices. In turn, the stationary wireless devices 110 can be access points, receivers, transceivers, and the like of for compatible wireless communication with the portable devices 120.

[0161] In addition to the wireless devices 110, 120, various optical devices 130, such as cameras, motion sensors, and the like, are distributed on the unit 20. The cranes 30 of the unit 20 can be outfitted with a number of cameras 130b-c for monitoring both the movement of the crane and for monitoring surroundings in the vicinity of the crane 30. Other optical devices 130a, such as cameras, motion sensor, and the like, can be arranged throughout the unit 20 to monitor work areas, regions, and the like. The optical devices 130 may operate in some areas as a primary form of monitoring personnel (or movable equipment), but may operate in other areas as a secondary form of monitoring that is ancillary to the wireless monitoring.

[0162] The devices 110, 120, and 130 are associated with database information (Block 712) of the control system 100. The database information (Block 712) can include information about the identity of the devices 110, 120, 130, personnel, locations, etc.; information about the layout of the devices 110, 120, 130; information about personnel authorizations; and information about work areas or other regions of the unit 20.

[0163] For example, the portable devices 120 for the personnel are associated with identifying information [e.g., worker ID, name, position, etc.) and with particular authorizations for the personnel. Thus, a given personnel member may or may not be authorized to access or work in various areas or regions on the unit 20, and information on such authorizations can be stored in the control system 100 and associated with the personnel’s identification.

[0164] From the layout and monitoring, the dimensional map 200 of the offshore unit 20 is created in the control system 100 [e.g., in a database) (Block 720). The dimensional map 200 can be two-dimensional, although three dimensions may be preferred because the unit 20 has three-dimensional features and the crane 30 operates in three dimensions.

[0165] With the distributed devices 110, 120, and 130 and with the created dimensional map 200, locations 220 of the personnel are tracked in the dimensional map 200 of the database (Block 730). To do this, wireless monitoring is received in the form of wireless inputs (Block 732) from the wireless devices 110, 120 associated with the personnel and the offshore unit 20. Visual monitoring can also be received in the form of optical input (Block 734) from the optical devices 130 of cameras, motion sensors, and the like.

[0166] The tracking involves the portable wireless device 120 of the personnel wirelessly interacting with one or more stationary devices 110 distributed on the unit 20. The wireless interaction can involve communication of identifying information, such as ID number, signal strength, access point location, and the like, which is associated in the database with given information of the personnel, dimensional map 200, etc. For example, the portable device 120 of a personnel member in a zone on the unit 20 may wirelessly interact with two or more stationary devices 110 with known locations on the unit 20. Using triangulation, comparison of signal strengths between stationary devices 110, and other locating techniques, the location of the portable device 120 can be indicated in the dimensional map 200 of the unit 20. The personnel (or equipment) associated with the portable device 120 can be identified and authorizations accessed.

[0167] As a backup to the wireless monitoring or in place of the wireless monitor, visual monitoring with the optical devices 130 of cameras, motion sensors, and the like can be used for tracking locations 220 of personnel and equipment in the dimensional map 200 of the unit 20. Personnel and equipment, whether wirelessly monitored or not, can also be tracked in this manner. For example, personnel may not currently have a portable wireless device 120, the portable device 120 may not be interacting properly, a particular zone may not have stationary wireless devices 110, or some other reason may apply. The visual monitoring can be used in these and other situations.

[0168] The tracking (Block 730) can be continuous with repeated monitoring and updating in real time. Such tracking has benefits on its own in monitoring various operations on the unit 20. According to the present disclosure, crane operations are one form of operation suitable for monitoring in this manner. As noted above, the unit 20 may have one or more cranes 30, and a crane operator can operate a selected one of the cranes 30 from a remote station 26 on the unit 20. Such a remote station 26 includes various controls, inputs, displays, and the like allowing the remote crane operator to operate the selected crane 30 with the monitoring disclosed herein. Alternatively, the crane operator can operate a selected crane 30 from a conventional crane cab augmented with various controls, inputs, displays, and the like for the monitoring disclosed herein. Ideally, when one of the cranes 30 is selected for operation by the operator, simultaneous operation of any of the other cranes 30 is restricted, although this may not be necessary in some implementations.

[0169] To perform a crane operation remotely, the crane operator selects a crane 30 for remote operation (Block 740). The control system 100 [e.g., a programmable control device of the system 100) then obtains dynamic operating parameters of the crane 30 operating on the offshore unit 20 (Block 750). The dynamic operating parameters can include visual inputs (Block 752) from cameras 130 associated with the crane 30 and surrounding area, communications from personnel on the unit 20 and other control stations 60, locations 220 of personnel in the dimensional map 200, identification of the personnel, visual boundaries of zones in the dimensional map 200, and other information. Wireless inputs associated with the movement and operation of the crane 30 may also be obtained if so arranged.

[0170] The dynamic operating parameters include operator inputs (Block 754) from the crane operator and include feedback (Block 756) from equipment of the crane 30. For example, the operator uses joysticks and other inputs (Block 754) to direct and control operation of the crane 30, such as to rotate the crane 30, to raise and lower the boom 234, to lift and lower a load 240, and the like. In turn, the crane 30 provides feedback (Block 756) of its operation, including information from sensors and instrumentation of the crane 30 and its component, indicating information such as the crane’s slew angle, boom angle, lift height, speed, load, position, direction, etc.

[0171] As noted herein, the crane 30 can also include a camera 130c on the end of the boom 234 for visually monitoring the unit 20 below. Other cameras 130 can externally monitor the motion and position of the crane 30 relative to the unit 20. For the dynamic operating parameters of the crane 30, visual monitoring at least in the vicinity of the crane 30 operating on the unit 20 can be received to determine the dynamic movement of the crane 30, the position of boom 234, the position of the load 240, etc. The crane 30 itself may have internal sensors and instrumentation for monitoring its position, motion, and other operational details.

[0172] From the received controls and feedback, the control system 100 determines dynamic operating parameters of the crane 30 and its components in the dimensional map 200. From these dynamic operating parameters, the control system 100 calculates the dynamic lifting zone 250 of the crane 30 moving dynamically in the dimensional map 200 in the database (Block 760). As noted above, this dynamic lifting zone 250 represents a bounded region in the crane’s range, below the boom 234, underneath the load 240, etc. subjected to monitoring as the crane 30 operates and moves during operation. In calculating the dynamic lifting zone 250, the dynamic movement of the crane’s operation is dimensionally translated into one or more boundaries of the dynamic lifting zone 250 within the dimensional map 200. The dynamic lifting zone 250 can be defined and moved in two or more dimensions of the dimensional map 200.

[0173] During the operation, the control system 100 outputs information of the lifting operation to the crane operator (Block 770). For example, the output can take the form of visual display (Block 772) of camera feeds, including multiple views and picture-in-picture. Graphical overlays (Block 774) can be included into the visual displays (Block 772) to depict the dynamic lifting zone 250, the dynamic parameters of the crane 30, information of located personnel 220, numerical values of the crane’s operation, etc. Control feedback (Block 776) may also be output.

[0174] During the course of monitoring and operating, the control system 100 may detect interaction of the tracked locations 220 of the personnel (or equipment) interfering with the dynamically moving dynamic lifting zone 250 (Block 780). For example, the control system 100 may detect a conflict in which at least one of the tracked locations 220 of the personnel (or equipment) interferes with the dynamically moving dynamic lifting zone 250 of the crane 30 operating on the unit 20. As a result, the control system 100 may output the interaction [e.g., conflict) to the operator or to the crane 30 (Block 790) in the form of an alarm, automatic control, etc.

[0175] In general, the control system 100 may determine that the at least one tracked location 220 of the personnel is located (or will be located) at a point-in-time within a boundary of the dynamically moving dynamic lifting zone 250 in the dimensional map 200. In turn, the control system 100 can generate a control (Block 792) and/or a perceptible representation (Block 794).

[0176] In response to the conflict, for example, automated or manual controls (Block 792) may be initiated in the crane operations. Automated control can include stopping, slowing, or changing the crane operations to avoid the conflict. Such automated control may not be suitable in all circumstances, especially when a load is being moved. For this reason, any number of manual controls may be available to the crane operator in response to the conflict to stop, slow, or change the crane operations.

[0177] In response to the conflict, the perceptible representations (Block 794) can be output to the crane operator, the personnel on the unit 20, and elsewhere. A visual display, an alarm, instruction, control feedback, or the like may be sent via the communication interface from the control system 100 to the crane operator, the interfering personnel, and others using an appropriate form of communication.

F. Schematic Views of T racking System Components

[0178] Various components of the tracking system 100 have been detailed above.

Discussion now turns to Figs. 8A-8C, which illustrate schematic views of components for the tracking system 100 according to the present disclosure.

[0179] Referring to structural elements as shown in Fig. 8 A, the tracking system 100 includes a control system 800 having a programmable control device 802, which can use any suitable computing hardware and software, including one or more of programmable logic controls, communication switches, servers, computers, etc. For example, the programmable control device 802 can include distributed computer resources of programmable logic controls, communication switches, servers, computers, etc. As shown in Fig. 8A, the programmable control device 802 is in operable communication with memory 804, storage device(s) 806, input interfaces 810, output interfaces 812, and network interfaces 818. These structural elements can use any suitable hardware and software for operating the cranes according to the techniques disclosed herein. Database(s) 808 store configuration details, tracking information, and dimensional map(s) ofthe offshore unit (20) in which the stationary devices (110) and the optical devices (130) are laid out and in which the portable devices (120) are tracked.

[0180] Fig. 8B schematically illustrates further details of the tracking system 100, which can include a control module 820, a system data logger 822, an operations module 824a, a crane module 824b, a monitoring module 828, and an output module 834. As will be appreciated, the modules can be implemented using combinations of structural and functional elements in hardware and software.

[0181] The modules are in communication with one another via a communication bus 836. The control module 820 operates as the main control or hub for coordinating operation and interaction of the various modules and structural elements (Fig. 8A) of the tracking system 100. The system data logger module 822 can log data of the system 100 and its operation in databases of storage devices and the like.

[0182] The other modules are responsible for interaction with operational aspects of the system 100 and communicate with external modules, components, and equipment. For example, the operations module 824a is in communication with equipment controls 826a for rig equipment, such as cranes, boom crane, pipe handler, drilling equipment, BOP handling equipment, swarf skip equipment, fluid handling equipment, a shaker, a pump, an electrical panel, a generator, manipulators, etc. The operations module 824 is thereby responsible for exchanging suitable information with rig equipment to determine status of rig operations, perform controls, etc.

[0183] For example, one particular operations module 824a is the crane module 824b disposed in communication with instrumentation, sensors, and other crane components 826b of the crane equipment on the unit (20). The crane module 824b thereby sends and receives communications associated with the control and operation of the cranes (30).

[0184] The crane module 824b is further in communication with crane controls of the equipment controls 826. These crane controls, such as the joystick and other control equipment, are used by an operator in a remote station (26 or local cab) to operate the cranes (30). The crane module 824b is thereby responsible for exchanging suitable information for the crane operator to perform crane operations.

[0185] The monitoring module 828 is in communication with the wireless monitoring equipment 830 and optical monitoring equipment 832. The monitoring module 828 is thereby responsible for exchanging suitable information for monitoring and tracking personnel/equipment and tracking crane operations. As noted herein and presented again here, the wireless monitoring equipment 830 includes an array of stationary wireless devices 110, such as wireless receivers, Bluetooth access points, RFID transceivers, or the like, which interact wirelessly with portable wireless devices 120. Likewise, the optical monitoring equipment 832 includes an array of optical devices 130, such as cameras, motion detectors, and the like, and receives optical monitoring in the form of video feeds, pictures, motion detection, and the like.

[0186] Finally, the output module 834 is in communication with outputs and displays 836 for presentation to operators, personnel, and the like. The output module 834 is thereby responsible for exchanging suitable communication information for operators, personnel, and users. For instance, the output module 480 is responsible for exchanging suitable communication information for a crane operator to perform crane operations.

[0187] The information provided to the operators and users by the tracking system 100 can augment camera views and can provide graphic rendering of mapped areas. The tracking system 100 receives various inputs (e.g., position coordinates, instrumentation feeds, alarm status, etc.), visually maps out the areas, and provide graphic overlays and other user interfaces for the operator’s user interface.

[0188] For example, the coordinates of work zones, restricted areas, or muster station are passed on in real-time to the output module 834 of the system 100. In turn, output module 834 can use these coordinates to render a transparent red boundary on the display screens displaying various feeds from multiple camera angles to the operator’s user interface.

This graphical rendering can be turned on or off by the operator.

[0189] When the tracking system 100 determines an alarm status indicating

unauthorized personnel in a restricted area (222), indicating personnel missing from the muster station (224) within a specified time frame, etc., the output module 834 can place an alarm banner on a screen for the operator, can also send out communications, and can act to automatically locate the personnel in other mapped areas of the unit 20.

[0190] For monitoring and controlling crane operations, the information provided to the crane operator by the control system 100 can augment camera views and can provide graphic rendering of the crane mapped with the static lifting areas (238), the dynamic lifting and warning zones (250) and (255), camera feeds, and crane instrumentation. The control system 100 receives various inputs [e.g., position coordinates, instrumentation feeds, alarm status, etc.), visually maps out the areas exposed to the crane operations, and provide graphic overlays and other user interfaces for the crane operator.

[0191] For example, the coordinates of the dynamic lifting zone (250) are passed on in real-time to the output module 834 of the system 100. In turn, output module 834 can use these coordinates to render a transparent red boundary on the display screens displaying various feeds from multiple camera angles to the crane operator. As noted above, the cameras (130b-c) can be located to provide a display on multiple screens that mimics the viewpoint of local operation from a local crane cab. This graphical rendering can be turned on or off by the operator.

[0192] The coordinates of the dynamic warning zone (255) can also be passed on in real time to the output module 834 of the control system 100. In turn, the output module 834 can use these coordinates to render a transparent yellow boundary outside of the dynamic lifting zone’s red boundary on to the display screens displaying the various feeds from multiple camera angles.

[0193] When the control system 100 determines an alarm status indicating an unauthorized personnel violation of the dynamic lifting or warning zone (250 or 255), the output module 834 can place an alarm banner on the screen for the operator and can also stop the crane operation. The violating unauthorized person’s identification and location information can also be provided in the alarm.

[0194] In addition to these features, the output module 834 can provide various meters, dials, and readouts indicating various items of crane status. For example, slew angle, boom angle, block height, hook load, anti-two block status, hoist speed, and associated alarm status with these indications can be provided on the graphical display by the output module 834 to the operator. These meters/dials/readouts may be semi-transparent overlays on the camera feeds used by the operator to conduct lifting operations. The output module 834 can provide picture-in-picture views on one screen from any two cameras (130).

[0195] Finally, Fig. 8C illustrates a schematic arrangement of components of the personnel tracking system 100. The components of the system 800 include a main processing unit (MPU) or computer 850 having a processing unit 852 and memory 854.

The computer 854 holds and handles software and interfaces for users, visual detection and personnel ID, wireless Bluetooth® nodes and beacons, and controls. [0196] The computer 850 connects by redundant communications to a power line networking unit (PLNU) 860. The networking unit 860 contains several pieces of hardware to operate as an instrumentation and networking hub. For example, the unit 860 includes a programmable logic controller 862, two power supplies 864, a Power over Ethernet (PoE) switch 866, a wireless router 868a for the wireless nodes, a wireless hub 868b for the camera system being used for visual detection, and instrumentation control interface 868c for rig equipment, such as cranes, pipe handling equipment, etc. The Ethernet switch 866 also connects to the local area network (LAN) for the offshore unit 20.

[0197] The wireless router 868a communicates with the wireless receivers 110 distributed in the work zones, restricted areas, muster stations and other mapped, designated areas for wirelessly tracking the wireless beacons 120 on the crew members (P). The wireless hub 868b communicates with the cameras 130 and other optical devices distributed in the work zones, restricted areas, muster stations and other mapped, designated areas for visually tracking the crew members (P) who either have or do not have wireless beacons 120.

[0198] A video processing unit 870 connects to the power line networking unit 860 and contains the processing hardware for the visual detection software. The video unit 870 contains a processing unit 872, a video card 874, and memory. The processing unit 872 is interfaced via the network switch 866 to the main processing unit 850.

[0199] Additional components of the personnel tracking system 100 can include power bank enclosure(s) 880 containing charging equipment for all of the batteries that are used on the wireless transmitters 120 [e.g., Bluetooth beacons). The stationary wireless receivers 110 may have batteries for power backup, but they are preferably hardwired to a power supply on the offshore unit 20.

[0200] One or more user devices 890 can be used for operating, monitoring, and troubleshooting the system 100. The user devices 890 can enable users to physically interact in the digital static map area away from the main programing hub, and view and operate operations of the tracking system 100. The user devices 890 can be mobile handheld devices, permanently installed workstations, and the like. During a muster event, for example, personnel responsible for the oversight of a muster station can have a handheld device 890 that will immediately download a list of all personnel present and those who are missing. [0201] A remote control station has been briefly detailed above. Discussion now turns to Fig. 9, which illustrates a plan view of a remote control station 900 for the crane operations according to the present disclosure. The control station 900 is located in a remote location to provide a single operator the ability to control any crane 30 from a single location. The station 900 preferably allows the operator to operate a single crane 30 at a time. Camera feeds, controls, and instrumentation are switched in unison from any crane 30 to the remote crane station 900.

[0202] The station 900 includes a suitable enclosure 902 for use on the offshore unit (20) with appropriate hazard detection, climate features, and the like. A control station 904 inside the enclosure 902 includes crane controls 910, such as joysticks, input panels, and the like. Displays 920 provide an immersive view for the operator at the control station 904. As shown, at least four displays can be arranged around the crane operator’s control chair to mimic the view the operator would otherwise have in the local crane cab.

[0203] Any number of hardware and software components of the control system can be housed in the control station 900. For example, the station 900 can include a cabinet 906 for programmable logical controls and a cabinet 908 for computing and networking components. In the end, the station 900 allows the operator to switch between cranes for control, monitoring, and operation.

[0204] As noted herein, for example, real-time information of lifting zones, personnel identification, and location is integrated into the operator’s interface by augmenting and overlaying the real-time camera views to enhance the operator’s awareness of lifting operations. All the potential lifting areas of the remotely operated cranes are digitally mapped, and a combination of visual and wireless monitoring provide real-time location and identification of personnel who enter digitally mapped lifting areas. For example, the dynamic lifting zone and any other associated areas can have a semi-transparent red and yellow overlay that are superimposed on the operator’s camera feed on the displays. This will provide a visual representation of the zones in real time for the operator. Meters and digital readouts of various crane functions can also have a semi-transparent overlay superimposed on the operator’s camera feed. Any of the visual overlays can be configured and turned on or off at the preference of the operator.

[0205] As will be appreciated, teachings of the present disclosure can be implemented in digital electronic circuitry, computer hardware, computer firmware, computer software, or any combination thereof. Teachings of the present disclosure can be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a programmable processor so that the programmable processor executing program instructions can perform functions of the present disclosure. The teachings of the present disclosure can be implemented advantageously in one or more computer programs that are executable on a programmable system including at least one

programmable processor coupled to receive data and instructions from, and to transmit data and instructions to, a data storage system, at least one input device, and at least one output device. Storage devices suitable for tangibly embodying computer program instructions and data include all forms of non-volatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM disks. Any of the foregoing can be supplemented by, or incorporated in, ASICs (application-specific integrated circuits).

[0206] The foregoing description of preferred and other embodiments is not intended to limit or restrict the scope or applicability of the inventive concepts conceived of by the Applicants. It will be appreciated with the benefit of the present disclosure that features described above in accordance with any embodiment or aspect of the disclosed subject matter can be utilized, either alone or in combination, with any other described feature, in any other embodiment or aspect of the disclosed subject matter.

[0207] In exchange for disclosing the inventive concepts contained herein, the Applicants desire all patent rights afforded by the appended claims. Therefore, it is intended that the appended claims include all modifications and alterations to the full extent that they come within the scope of the following claims or the equivalents thereof.

Claims

CLAIMS:

1. A method of tracking crew members on an offshore unit, the method comprising: associating, in a database of a network system, a plurality of wireless transmitters with the crew members, each of the wireless transmitters configured to transmit a wireless signal associated in the database with one of the crew members;

associating, in the database, a plurality of wireless receivers arranged in a mapped layout of at least a portion of the offshore unit, the mapped layout at least including a designated area of equipment used in an operation of the offshore unit, each of the wireless receivers configured to receive the wireless signals and each connected in communication with at least one processing device of the network system;

associating, in the database, at least one policy with the equipment used in the operation of the offshore unit;

monitoring, with the network system, a state of the equipment in the designated area;

initiating, at the at least one processing device, a restriction in the designated area in response to the monitored state of the equipment;

detecting, at the at least one processing device in response to the restriction, any of the wireless signals of the wireless transmitters located by the wireless receivers in the designated area;

determining, at the at least one processing device in response to the detection, an action based on the at least one policy associated with the equipment; and initiating, at the at least one processing device, the determined action.

2. The method of claim 1, wherein associating the wireless transmitters with the crew members comprises associating tracking information of the crew members in the database with identifiers of the wireless transmitter.

3. The method of claim 2, wherein the tracking information comprises one or more of personal identification, assignment, date boarded the unit, date to disembark the unit, authorization, designated work zone, communication information, radio channel, cellphone number, email address, pager number, emergency contact, and supervisor contact.

4. The method of claim 1, 2 or 3, wherein associating the wireless receivers arranged in the at least one designated area of the offshore unit comprises creating, in the database, a dimensional map of the at least one designated area of the offshore unit.

5. The method of any one of claims 1 to 4, wherein the wireless receivers comprise nodes configured for a wireless protocol and hardwired to one or more power sources on the offshore unit; and wherein the wireless transmitters comprise beacons configured for the wireless protocol and powered by local power storage.

6. The method of any one of claims 1 to 5, wherein detecting any of the wireless signals comprises receiving indication of one or more of the wireless signals from one or more of portable ones of the wireless transmitters at one or more of a plurality of stationary ones of the wireless receivers.

7. The method of any one of claims 1 to 6, wherein detecting any of the wireless signals comprises: detecting strengths of the wireless signal of one of the wireless transmitters at at least two of the wireless receivers; and estimating a location of the one wireless transmitter based on the detected strengths.

8. The method of any one of claims 1 to 7, wherein the equipment is selected from the group consisting of a crane, a boom crane, a pipe handler, drilling equipment, BOP handling equipment, swarf skip equipment, fluid handling equipment, a shaker, a pump, an electrical panel, a generator, and a manipulator.

9. The method of any one of claims 1 to 8, wherein monitoring the state of the equipment in the designated area comprises receiving, with the network system, information of the state of the equipment from a control system of the offshore unit.

10. The method of any one of claims 1 to 9, wherein initiating the restriction in the designated area in response to the monitored state of the equipment comprises:

determining that the equipment is operating; and determining that the at least one policy restricts the crew member associated with the wireless transmitter detected in the designated area when the equipment is operating.

11. The method of claim 10, wherein determining the action based on the at least one policy associated with the equipment comprises determining from the at least one policy to shut down the equipment; and wherein initiating the determined action comprises shutting down the equipment.

12. The method of claim 10, wherein determining the action based on the at least one policy associated with the equipment comprises determining from the at least one policy to continue operation of the equipment; and wherein initiating the determined action comprises continuing the operation.

13. The method of claim 12, wherein initiating the determined action further comprises communicating, with the network system, the restriction to the crew member associated with the wireless transmitter detected in the designated area.

14. The method of any one of claims 1 to 9, wherein initiating the restriction in the designated area in response to the monitored state of the equipment comprises:

determining that the equipment is moving in the designated area; and determining that the at least one policy restricts the crew member associated with the wireless transmitter detected in the designated area when the equipment is moving.

15. The method of claim 14, wherein determining the action based on the at least one policy associated with the equipment comprises determining from the at least one policy to stop movement of the equipment; and wherein initiating the determined action comprises stopping movement of the equipment.

16. The method of any one of claims 1 to 9, wherein initiating the restriction in the designated area in response to the monitored state of the equipment comprises

determining that the at least one policy at a current time restricts the crew member associated with the wireless transmitter detected in the designated area; wherein determining the action based on the at least one policy associated with the equipment comprises determining an alarm condition; and wherein initiating the determined action comprises initiating the alarm condition.

17. The method of any one of claims 1 to 9, wherein initiating the restriction in the designated area in response to the monitored state of the equipment comprises

determining that the at least one policy at a current time restricts the crew member associated with the wireless transmitter detected in the designated area; wherein determining the action based on the at least one policy associated with the equipment comprises determining a communication of the restriction; and wherein initiating the determined action comprises communicating, with the network system, the restriction to the crew member associated with the wireless transmitter detected in the designated area.

18. The method of any one of claims 1 to 17, further comprising: associating, in the database, at least one optical device in at least the designated area of the equipment used in the operation of the offshore unit, the at least one optical device connected in

communication with at least one processing device of the network system; receiving, at the at least one processing device, visual monitoring from the at least one visual device associated with the designated area of the offshore unit; and detecting, at the at least one processing device from the visual monitoring in response to the restriction, recognition of a crew member in the designated area.

19. The method of claim 18, wherein detecting the recognition of the crew member comprises detecting any person captured with at least one optical device in the designated area absent detection by the wireless receivers.

20. The method of claim 18 or 19, wherein detecting the recognition of the crew member comprises automatically identifying the detected person as a particular one of the crew members based on a visual attribute using visual detection software.

21. The method of claim 18, 19, or 20, wherein: determining the action comprises determining an intervention by one or more other of the crew members; and initiating the determined action comprises communicating to the one or more other crew members, with the network system, to intervene in the designated area.

22. The method of any one of claims 1 to 21, wherein the equipment includes a crane on the offshore unit; and wherein monitoring the state of the equipment in the designated area comprises: obtaining dynamic operating parameters of the crane operating on the offshore unit; and calculating a lifting zone moving dynamically in the mapped layout based on the dynamic operating parameters of the crane.

23. The method of claim 22, wherein initiating the restriction comprises applying the restriction to the calculated lifting zone.

24. The method of claim 22 or 23, wherein detecting any of the wireless signals of the wireless transmitters located by the wireless receivers in the designated area comprises detecting a conflict of at least one of the wireless transmitters interfering with the dynamically moving lifting zone of the crane.

25. The method of claim 24, wherein detecting the conflict of at least one of the wireless transmitter interfering with the dynamically moving lifting zone of the crane comprises determining that the at least one wireless transmitter is located at a point-in-time within a boundary of the dynamically moving lifting zone in the mapped layout.

26. The method of any one of claims 22 to 25, wherein obtaining the dynamic operating parameters of the crane operating on the offshore unit comprises: receiving control of the crane from an operator; receiving feedback from crane equipment of the crane; and determining dynamic movement of the crane relative to the mapped layout from the received control and feedback.

27. The method of claim 26, wherein receiving the control of the crane from the operator comprises receiving the control at a location remote from the crane.

28. The method of claim 26 or 27, wherein the dynamic movement of the crane comprises one or more of slew angle, boom angle, boom length, hook load, weight, block height, boom limit, slew limit, overload, hoist speed, cable length, boom angle speed, slew angle speed, and environmental data.

29. The method of claim 26, 27 or 28, wherein obtaining the dynamic operating parameters of the crane operating on the offshore unit further comprises receiving visual monitoring at least in a vicinity of the crane operating on the offshore unit; and

determining the dynamic movement of the crane relative to the mapped layout from the received visual monitoring.

30. The method of any one of claims 26 to 29, wherein calculating the lifting zone of the crane moving dynamically in the mapped layout based on the dynamic operating parameters of the crane comprises dimensionally translating the dynamic movement of the crane into one or more boundaries of the lifting zone within the mapped layout.

31. The method of any one of claims 24 to 30, wherein initiating the determined action comprises outputting the detected conflict with the at least one processing device.

32. The method of claim 31, wherein outputting the conflict with the programmable control device comprises generating a perceptible representation of the conflict and outputting the perceptible representation from an interface of the programmable control device to an operator of the crane.

33. The method of claim 31 or 32, wherein outputting the conflict with the

programmable control device comprises generating a control in response to the conflict; and controlling the operation of the crane with the generated control.

34. The method of any one of claims 22 to 33, wherein obtaining the dynamic operating parameters of the crane operating on the offshore unit comprises selecting the crane for remote operation from a plurality of cranes on the offshore unit.

35. The method of claim 34, wherein selecting the crane for remote operation comprises restricting operation of any other of the cranes for simultaneous operation.

36. A programmable storage device having program instructions stored thereon for causing a programmable control device to perform a method of tracking crew members on an offshore unit according to any one of claims 1 to 35.

37. A system for tracking crew members on an offshore unit, the system comprising: a plurality of portable wireless transmitters each configured to transmit a wireless signal;

a plurality of stationary wireless receivers arranged in a mapped layout of at least a portion of the offshore unit, the mapped layout at least including a designated area of equipment used in an operation of the offshore unit, each of the wireless receivers configured to receive the wireless signals of the wireless transmitters;

a database associating the stationary wireless receivers with the designated area and associating the crew members with the portable wireless transmitters, the database associating at least one policy with the equipment used in the operation of the offshore unit;

a communication interface in communication with the plurality of stationary

wireless receivers; and

at least one programmable control device in communication with database and the communication interface, the at least one programmable control device configured to:

monitor a state of the equipment in the designated area;

initiate a restriction in the designated area in response to the monitored state of the equipment;

detect, in response to the restriction, any of the wireless signals of the

wireless transmitters located by the wireless receivers in the designated area;

determine, in response to the detection, an action based on the at least one policy associated with the equipment; and

initiate the determined action.

38. The system of claim 37, wherein the communication interface is in communication with the crane.

39. The system of claim 37 or 38, wherein to monitor the state of the equipment, the programmable control device is configured to: obtain dynamic operating parameters of the crane operating on the offshore unit; and calculate a lifting zone moving dynamically in the dimensional map in the database based on the dynamic operating parameters of the crane.

40. The system of claim 39, wherein to initiate the restriction, the at least one programmable control device configured to initiate the restriction to the calculated lifting zone.

41. The system of claim 39 or 40, wherein to detect any of the wireless signals of the wireless transmitters located by the wireless receivers in the designated area, the at least one programmable control device configured to detect a conflict of at least one of the tracked locations interfering with the dynamically moving lifting zone of the crane.

42. The system of claim 39, 40 or 41, comprising: an operator module in

communication with the interface and receiving control of the crane from an operator; and a crane module in communication with the interface and receiving feedback from equipment of the crane.

43. The system of claim 42, wherein to calculate the dynamically moving lifting zone in the dimensional map, the at least one programmable control device is configured to:

determine dynamic movement of the crane relative to the dimensional map from the received control and feedback, and dimensionally translate the dynamic movement of the crane into one or more boundaries of the lifting zone within the dimensional map.

44. A method of tracking crew members on an offshore unit, the method comprising: associating, in a database of a network system, a plurality of wireless transmitters with the crew members, each of the wireless transmitters configured to transmit a wireless signal associated in the database with one of the crew members;

associating, in the database, a plurality of wireless receivers arranged in a mapped layout of at least a portion of the offshore unit, the mapped layout at least including one muster area of the offshore unit, each of the wireless receivers configured to receive the wireless signals and each connected in communication with at least one processing device of the network system; initiating, at the at least one processing device, an event requiring location of the crew members in the at least one muster area of the offshore unit;

detecting, at the at least one processing device in response to the initiated event, any of the wireless signals of the wireless transmitters located by the wireless receivers in the at least one muster area; determining, at the at least one processing device, a failure to detect at least one of the wireless signals of at least one of the wireless transmitters in the at least one muster area; and

outputting, in the network system, the determined failure.

45. The method of claim 44, wherein associating the wireless transmitters with the crew members comprises associating tracking information of the crew members in the database with identifiers of the wireless transmitter.

46. The method of claim 45, wherein the tracking information comprises one or more of personal identification, assignment, date boarded the unit, date to disembark the unit, authorization, designated work zone, communication information, radio channel, cellphone number, email address, pager number, emergency contact, and supervisor contact.

47. The method of claim 44, 45 or 46, wherein associating the wireless receivers arranged in the at least one muster area of the offshore unit comprises creating, in the database, a dimensional map of the at least one muster area of the offshore unit.

48. The method of any one of claims 44 to 47, wherein the wireless receivers comprise nodes configured for a wireless protocol and wired to one or more power sources on the offshore unit; and wherein the wireless transmitters comprise beacons configured for the wireless protocol and powered by local power storage.

49. The method of any one of claims 44 to 48, wherein detecting any of the wireless signals comprises receiving indication of one or more of the wireless signals from one or more of portable ones of the wireless transmitters at one or more of a plurality of stationary ones of the wireless receivers.

50. The method of any one of claims 44 to 49, wherein detecting any of the wireless signals comprises: detecting strengths of the wireless signal of one of the wireless transmitters at at least two of the wireless receivers; and estimating a location of the one wireless transmitter based on the detected strengths.

51. The method of any one of claims 44 to 50, wherein determining the failure to detect comprises determining the failure within a predetermined time limit.

52. The method of any one of claims 44 to 51, wherein outputting the determined failure comprises: generating a perceptible representation of the determined failure; and outputting the perceptible representation from an interface of the at least one processing device to an operator.

53. The method of any one of claims 44 to 52, wherein outputting the determined failure comprises: generating a communication for the crew member of the determined failure; and transmitting the communication from an interface of the at least one processing device to the determined crew member based on the tracking information.

54. The method of any one of claims 44 to 53, wherein outputting the determined failure comprises locating, with one or more of the wireless receivers arranged outside of the at least one muster area, the at least one wireless transmitter associated with the determined failure in the at least one muster area.

55. The method of any one of claims 44 to 54, further comprising: associating, in the database, a plurality of optical devices arranged in the mapped layout; and detecting, with visual detection software operating on the at least one processing device, any person captured with at least one of the optical devices in the mapped layout absent detection by the wireless receivers, wherein outputting the determined failure comprises locating and identifying the crew member associated with the determined failure as the detected person.

56. The method of claim 55, wherein locating the crew member associated with the determined failure comprises locating the crew member in the at least one muster area using the at least one optical device located in the at least one muster area; or locating the crew member outside the at least one muster area using the at least one optical device located outside the at least one muster area.

57. The method of claim 55 or 56, wherein identifying the crew member associated with the determined failure comprises visually identifying the crew member based on a visual attribute using the visual detection software.

58. The method of any one of claims 44 to 57, wherein outputting the determined failure comprises communicating information of the crew member associated with the at least one wireless transmitter of the determined failure in the at least one muster area to one or more portable processing devices.

59. A programmable storage device having program instructions stored thereon for causing a programmable control device to perform a method of tracking crew members on an offshore unit according to any one of claims 44 to 58.

60. A system for tracking crew members on an offshore unit, the system comprising: a plurality of portable wireless transmitters each configured to transmit a wireless signal; a plurality of stationary wireless receivers arranged in a mapped layout of at least a portion of the offshore unit, the mapped layout at least including at least one muster area of the offshore unit, each of the wireless receivers configured to receive the wireless signals of the wireless transmitters;

a database associating the wireless receivers with the at least one muster area and associating the crew members with the portable wireless transmitters; a communication interface in communication with the plurality of stationary

wireless receivers; and

at least one programmable control device in communication with the database and the communication interface, the at least one programmable control device configured to:

initiate an event requiring the crew members to locate in the at least one muster area of the offshore unit;

detect, in response to the initiated event, any of the portable wireless

transmitters located by the stationary wireless transceivers in the at least one muster area;

determine a failure to detect any of the portable wireless transmitters in the at least one muster area; and

output the determined failure.

61. The system of claim 60, further comprising a plurality of visual detection devices associated with the offshore unit, the visual devices receiving visual monitoring and in communication with the communication interface.