WO2016207370A1 - Système de surveillance de respect de l'hygiène - Google Patents

Système de surveillance de respect de l'hygiène Download PDF

Info

Publication number
WO2016207370A1
WO2016207370A1 PCT/EP2016/064703 EP2016064703W WO2016207370A1 WO 2016207370 A1 WO2016207370 A1 WO 2016207370A1 EP 2016064703 W EP2016064703 W EP 2016064703W WO 2016207370 A1 WO2016207370 A1 WO 2016207370A1
Authority
WO
WIPO (PCT)
Prior art keywords
person
controller
distance
information
transceiver
Prior art date
Application number
PCT/EP2016/064703
Other languages
English (en)
Other versions
WO2016207370A8 (fr
Inventor
Joan Ramon REGUÉ MORRERES
Simó GRAELLS I CASTELLÁ
Enric FRAILE ALGECIRAS
Laura GAVALDÀ MESTRE
María Antonia CASADO GARCÍA
Ana María SORIANO FERRÍN
Original Assignee
Fundació Institut De Recerca Biomédica De Bellvitge (Idibell)
Salutis Technological Solutions, S.L (Salutistech)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from EP15382339.8A external-priority patent/EP3109840A1/fr
Application filed by Fundació Institut De Recerca Biomédica De Bellvitge (Idibell), Salutis Technological Solutions, S.L (Salutistech) filed Critical Fundació Institut De Recerca Biomédica De Bellvitge (Idibell)
Publication of WO2016207370A1 publication Critical patent/WO2016207370A1/fr
Publication of WO2016207370A8 publication Critical patent/WO2016207370A8/fr

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • G08B21/24—Reminder alarms, e.g. anti-loss alarms
    • G08B21/245—Reminder of hygiene compliance policies, e.g. of washing hands
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/20—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B29/00—Checking or monitoring of signalling or alarm systems; Prevention or correction of operating errors, e.g. preventing unauthorised operation
    • G08B29/18—Prevention or correction of operating errors
    • G08B29/185—Signal analysis techniques for reducing or preventing false alarms or for enhancing the reliability of the system
    • G08B29/188—Data fusion; cooperative systems, e.g. voting among different detectors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/12—Acquisition of 3D measurements of objects

Definitions

  • the present invention relates in particular to monitoring of compliance with hygiene protocols e.g. for hospitals or other medical facilities and provides a system, a controller and a method in particular for monitoring hygiene compliance.
  • the invention is applicable to facilities where compliance with hygiene protocols is of importance as for example for hospital facilities and the like.
  • a further development in the present field provides a system employing an IR camera which can communicate with corresponding batches provided at HCWs.
  • This system is described in the international publication WO 2010/151802 A2 which discloses a system for determining compliance with hand hygiene requirements in hospitals.
  • the system according to this document is provided with a camera which allows for acquiring image frames (visible and IR) and performing video analysis. Using this camera it is suggested to monitor motions of a HCW within a patient room and to detect entry of the HCW into a contact zone around the patient bed.
  • the present invention has been made to further improve the prior art. It is a particular object of the present invention to provide a system preferably for hygiene compliance monitoring capable of determining and following a position of a person such as a HCW within a monitoring area such as a room in a hospital or other medical facilities with improved precision. It is a further object of the present invention to provide a system preferably for hygiene compliance monitoring capable of monitoring compliance with hygiene protocols such as the "Five moments for hand hygiene" defined by the WHO in an automatized manner.
  • a controller is provided.
  • the controller is a controller for a hygiene compliance monitoring system.
  • the controller is used specifically for monitoring hand hygiene.
  • the controller comprises first distance information receiving means configured to receive first distance information acquired by at least one first transceiver.
  • the first distance information receiving means are provided at a predefined position within a monitoring area.
  • the monitoring area may be a room such as a hospital room or may be defined by a transmission range of the used transceivers.
  • the first distance information represents a distance between the at least one first transceiver and at least one second transceiver provided at or for at least one person.
  • the at least one first transceiver is provided at a predefined position within a monitoring area, which in a preferred embodiment is a room such as a hospital or patient room.
  • the at least one first transceiver is provided at a wall of the room.
  • the first distance information is distance information acquired by at least two, preferably by at least three, most preferably by at least four first transceivers provided at respective predefined positions within the monitoring area representing relative distances between each of the first transceivers and a second transceiver provided at a person within the monitoring area.
  • the monitoring area is defined by a transmission range of the at least one first and/or the at least one second transceiver. This transmission range may be a maximum transmission range or may be limited e.g. by walls of a room such as walls of a hospital room wherein the hygiene compliance system is applied.
  • the first transceiver and the second transceiver are radio frequency transceivers (RF)
  • the first transceiver can be an RF listener, i.e. receiver
  • the second transceiver can be an RF badge or tag provided at a person.
  • the second transceiver can thus for example be an RF tag attached to the clothing of a person such as a health care worker (HCW) or a patient or can be provided in form of an RF card carried by a person.
  • the first and second transceivers can be different suitable transceivers such as for example infrared (IR) or ultrasound transceivers.
  • IR infrared
  • ultrasound transceivers The above mentioned monitoring area may be defined by a transmission range of the used transceivers.
  • first transceivers such as four RF listeners can be distributed within a room, for example be provided at walls of the room. These first transceivers can then communicate with a second transceiver such as an RF badge provided at a person which is present in the monitoring area such as the room.
  • the first distance information is calculated based on the time needed to communicate a signal between the first and the second transceiver.
  • the first transceiver may send a signal or message to the second transceiver.
  • the second transceiver may reply after a prefixed time interval to the first transceiver. The total time is twice the time of flight plus the prefixed time.
  • the first transceiver can calculate the distance between first and second transceiver as first distance information.
  • the first distance information can be similarly calculated based on the time of one directional communication.
  • the second transceiver may send a signal or a message to two or more synchronized first transceivers.
  • the controller can be configured to calculate a position of the second transceiver e.g. using a multilateration algorithm.
  • further first distance information is determined for a case of more than one person.
  • two second transceivers may communicate with the at least one first transceiver and the controller then receives two times first distance information.
  • the controller is configured to determine first position information representing a position of the at least one person based on the first distance information.
  • the controller can determine a position of a person provided with the second transceiver.
  • different algorithms can be implemented to perform the corresponding position calculation such as trilateration, multilateration or the like.
  • the controller comprises person identification information receiving means configured to receive person identification information from a person ID transceiver for identifying the at least one person.
  • the identification information is received from the second transceiver.
  • each second transceiver such as an RF badge or tag can be provided with unique person identification information to identify the person provided with the second transceiver.
  • the controller is provided with the identity of the person e.g. within the monitoring area in addition to the position of the person.
  • the controller can thus be provided with identification of the persons in addition to their location e.g. within a patient room.
  • the controller may e.g. determine position of a HCW in a patient room as well as the position of the patient.
  • the controller is provided with the corresponding ID at the determined position.
  • a particularly high spatial resolution can be achieved by using RF transceivers as first and second transceivers which may be on the order of only a few centimeters.
  • the controller further comprises two-dimensional image data receiving means configured to receive data of a two-dimensional image acquired by an imaging means.
  • Data of a two-dimensional image may be digital data of a two-dimensional image acquired by a two- dimensional digital camera or data acquired by a stereoscopic camera using more than one objective lens to acquire more than one image to be combined into a two-dimensional image including 3D information.
  • the imaging means can be adapted for imaging using visible light or infrared light.
  • the imaging means can for example be provided at a wall of a patient room capturing images of the corresponding view of the room such that objects and persons present in the room are imaged within respective portions of the two-dimensional image.
  • the controller comprises a second distance information receiving means configured to receive second distance information representing at least one distance between the at least one person and the imaging means, whereby the at least one person is imaged by the imaging means.
  • the second distance information may be received by the second distance information receiving means through calculation from data acquired by a 3D-camera, e.g. by a stereoscopic camera. The calculation may be e.g. performed at the controller or at the stereoscopic camera or by a separate calculation means.
  • the second distance information may further be provided by a second distance information acquiring means which may be a separate, dedicated system provided in addition to the imaging means. Such system may measure a distance between the imaging means for example by measuring a time of flight of an electromagnetic signal such as a light signal and determine the distance between the object or person and the imaging means based thereon.
  • the second distance information acquiring means may be provided combined with the imaging means to form a 3D-camera.
  • the second distance information is a two-dimensional array of distance information elements
  • the data of the two-dimensional image is a two-dimensional array of image information elements, whereby each of the distance information elements has a one-to-one relation with a corresponding one of the image information elements and represents a distance between an object imaged within an image information element and the imaging means.
  • the second distance information can for example be a "depth image" corresponding to the two-dimensional image with portions of said depth image corresponding to portions of the two-dimensional image.
  • the portions of the depth image then represent distances of objects imaged in the corresponding image portions with respect to the imaging means.
  • the distance information elements can be portions of the depth image being groups of pixels or individual pixels.
  • the distance information elements can be portions of the two- dimensional image represented by groups of pixels or individual pixels corresponding to the respective depth information elements.
  • the controller is further configured to determine second position information relating to the position of the at least one person imaged by the imaging means based on the second distance information.
  • the controller may be configured to transform the second distance information into coordinates of the at least one person in an appropriately defined coordinate system provided for the monitoring area as the second position information.
  • the controller can for example apply computer vision techniques to the information acquired with the two-dimensional image and the second distance information to detect a three-dimensional shape or volume occupied for example by a person present in the monitoring area and can compute the relative position of the person to the camera by combining the two-dimensional image with the second distance information .
  • the controller is further configured to compare the first and the second position information and to identify the at least one person at the position represented by the first position information with the at least one person at the position represented by the second position information when the first position information matches the second position information.
  • the controller is thus configured to acquire a first position (represented by first position information) of a person e.g. present in the monitoring area based on the system of first transceivers and second transceivers (for example the RF system including RF listeners and RF badges) and to acquire identification information of the person e.g. provided with the second transceiver.
  • the controller is further adapted to acquire a second position (represented by second position information) of a person recognized as such within a two-dimensional image. This second position is acquired based on the second distance information.
  • the controller may e.g. assign the identification information acquired to the system of first and second transceivers to the person recognized as such in the two-dimensional image.
  • the controller is further configured to determine a two-dimensional shape of the at least one person imaged by the imaging means within the two- dimensional image, and to determine a three-dimensional shape or volume of the at least one person imaged within the two- dimensional image based on the two-dimensional shape of the person.
  • the controller is configured to perform image processing of the two- dimensional image to recognize a two-dimensional shape of a person within the two-dimensional image. Based on this two- dimensional shape, the controller can then preferably be further configured to calculate a three-dimensional shape or volume, i.e. a three-dimensional model of the geometry of the person.
  • the three-dimensional model may be an actual three- dimensional surface representing a proximate outer surface of the person or an estimated skeleton of the person. Such calculation may preferably be based on predefined image processing libraries relating two-dimensional shapes of humans to typical three-dimensional human shapes or typical human skeletons .
  • the second distance information represents distances between portions of the at least one person and the imaging means, the controller being configured to determine a three-dimensional shape of the at least one person based the second distance information.
  • the controller may thus be further or alternatively be configured to determine a three- dimensional shape or volume based on distances (second distance information) between portions of the at least one person (corresponding to respective image portions of the two- dimensional image acquired by the imaging means) and the imaging means .
  • the controller is further configured to determine a three-dimensional shape of a further person and a relative distance between the at least one person and the further person based on the corresponding three- dimensional shapes, and to determine that the first person is in contact with the second person when the relative distance is smaller than a predetermined threshold.
  • the relative distance may be a minimum distance between portions of the three-dimensional shapes of the first and the second persons. Portions may be body parts or differently defined portions of each three dimensional shape.
  • the relative distance is the distance between a hand of the first person, e.g. the HCW, and the body, i.e. the three-dimensional shape, of the second person, e.g. the patient.
  • the controller may preferably be configured to recognize a hand of the first person from the two-dimensional shape or the three- dimensional shape of the first person.
  • the controller may be configured to recognize joints of the persons' bodies as respective portions.
  • such distance may be the distance between a hand joint such as a finger joint or a wrist joint of the first person and a hip joint or knee joint of the further person.
  • the relative distance is the distance between a joint of a hand or a wrist joint of the first person and a joint of the further person.
  • the threshold may be set in advance and can be adjusted in accordance with the requirements of the particular system such as in accordance with the resolution of the two- dimensional image and the like.
  • the controller is further configured to determine a two- dimensional shape of an object different from a person within the two-dimensional image, to determine a three dimensional shape of the object and to determine that the at least one person is in contact with the object when a relative distance between the at least one person and the object is below a predefined threshold.
  • objects may be objects e.g. surrounding a patient such as a nightstand, a bed or the like.
  • the controller further comprises a dispenser signal receiving means configured to receive a dispenser signal transmitted from a cleaning agent dispenser detector provided at a cleaning agent dispenser when a person uses the cleaning agent dispenser.
  • a cleaning agent may be soap or a sterilizing agent as it is typically used for example in medical facilities such as hospitals .
  • the controller is further configured to determine a relative distance between the first person based on the first position information and a predetermined position of the cleaning agent dispenser.
  • the controller is configured to determine a relative distance between the first person based on the information received from the system of first and second transceivers.
  • the controller is configured to determine a relative distance between the first person based on a communication between the second transceiver provided at the first person and a dispenser transceiver, i.e. a transceiver similar to the first or second transceiver, provided at the dispenser.
  • one of the transceivers may transmit a signal, the controller being configured to receive the signal thus determining the relative distance between the first person and the cleaning agent dispenser.
  • the controller is configured to determine that the first person has used the cleaning agent dispenser, when the dispenser signal receiving means receives the dispenser signal and the relative distance between the first person and a position of the cleaning agent dispenser is below a predetermined threshold.
  • the controller receives the dispenser signal and determines that the first person (preferably identified by identification information received from the first transceiver or the second transceiver provided at the first person) is close to the cleaning agent dispenser (the relative distance between said predetermined thresholds) , the controller determines that the first person has used the cleaning agent dispenser.
  • the controller is further configured to determine that the first person has entered a monitoring area at a first timing based on a signal received from the at least one first transceiver, and is configured to determine that the first person is in contact with the second person at a second timing, and is configured to generate an output when determining that in a time interval between the first timing and the second timing the controller has not determined that the first person has used the cleaning agent dispenser.
  • the controller is configured to determine this entering to be performed at a first timing.
  • a HCW provided with a second transceiver e.g. an RF tag
  • entering the room may be determined by the controller via communication between the at least one first transceiver and the second transceiver provided at the first person.
  • the second transceiver may e.g. send a signal to the at least one first transceiver, e.g. an RF listener, which in turn may send a signal to the controller.
  • the first transceiver may broadcast signals at given timings which are received by a second transceiver when a person enters the monitoring area.
  • the second transceiver may then send a response signal which is transferred to the controller via the first transceiver.
  • the first timing is in these cases the time point when the signal is received by the controller.
  • the controller is further configured to monitor the relative distance between the first person and the second person, and is configured to cause an alert when at a third timing the relative distance between the first person and the second person is below a predefined threshold and in a time interval between the first timing and the third timing the controller has not determined that the first person has used the cleaning agent dispenser.
  • the controller is adapted to monitor e.g. the first Moment of the "Five Moments" defined by the WHO.
  • the controller is thus adapted to monitor e.g. actions of a first person such as a HCW, within a monitoring area such as a patient room and is adapted to determine contact between said first person and a second person such as a patient.
  • the controller is adapted to monitor if in advance to such contact the first person, e.g. the HCW, has used the cleaning agent dispenser.
  • the controller may further be adapted to monitor the further Moments as defined by the WHO, i.e. further actions of the HCW cleaning his/her hands after touching the patient, after touching the patient surroundings, etc. Based on such determination, it is thus possible to monitor compliance with a hygiene protocol such as the "Five Moments" as defined by the WHO.
  • the controller is a controller for a hygiene compliance monitoring system.
  • the present invention further provides a system, preferably for a hygiene compliance monitoring, more preferably for a hand hygiene compliance monitoring system, whereby the system comprises the controller as described above, the at least one first transceiver, the second transceiver, and the imaging means.
  • the hygiene compliance monitoring system further comprises a second distance information acquiring means for acquiring the second distance information, the second distance information acquiring means and the imaging means being comprised by a 3D-camera.
  • a 3D-camera can be a combination of a two-dimensional digital camera and a means to determine the distance between objects imaged by the camera and the camera such as a two-dimensional time of flight detector, whereby a distance between an object imaged by a camera is measured by measuring the time between sending a light signal from the camera and reception of the signal reflected from the imaged object.
  • This method allows to perform measurements for individual image portions of a two- dimensional image such that a "depth image" as described above can be obtained with portions of the depth image representing distances for corresponding image portions of the two- dimensional image.
  • the monitoring area is a room, preferably a patient room in a hospital, and the at least one first transceiver is provided at a wall or door of the room.
  • the first and second transceivers are radio frequency (RF) transceivers.
  • the first and second transceivers are infrared (IR) or ultrasound transceivers.
  • a method preferably for hygiene compliance monitoring comprises the following steps: receive first distance information acquired by at least one first transceiver representing a distance between the at least one first transceiver and at least one second transceiver provided at at least one person; determine first position information representing a position of the at least one person based on the first distance information; receive person identification information from a person ID transceiver for identifying the at least one person; receive data of a two-dimensional image acquired by an imaging means, and receive second distance information representing at least one distance between the at least one person and the imaging means, whereby the at least one person is imaged by the imaging means, determine second position information relating to the position of the at least one person imaged by the imaging means based on the second distance information; compare the first and the second position information identify the at least one person at the position represented by the first position information with the at least one person at the position represented by the second position information when the first position information matches the second position information.
  • FIG. 1 shows a schematic top view of a patient room in a hospital
  • Fig. 2 shows a further top view of the patient room in the hospital ;
  • Fig. 3 illustrates the cleaning agent dispenser
  • Fig. 4 illustrates images acquired by the three- dimensional imaging means and the second distance information acquiring means
  • Fig. 5 is a schematic illustration of the components of the hygiene compliance monitoring system
  • Fig. 6 illustrates the actions to be performed by the hygiene compliance monitoring system.
  • Fig. 1 shows a schematic top view of a patient room 300 in a hospital with a patient 403 on a bed and a health care worker (HCW) 401 present in the room, i.e. the monitoring area.
  • patient surroundings 307 are schematically illustrated which may be nightstands, dining tables, wardrobes or the like.
  • a cleaning agent dispenser 151 is illustrated in proximity to the entrance door 303 such that a person entering or exiting the room 300 can use the cleaning agent to wash his or her hands.
  • Fig. 2 shows the patient room 300 of Fig. 1 further being provided with first transceivers 120i, 120 2 , I2O 3 and I2O 4 provided at predefined positions, i.e. at respective walls 305 of the patient room 300.
  • the first transceivers are RF listeners adapted to send and receive RF signals to and from a corresponding second transceiver which in the preferred embodiment is an RF tag 130 provided at the HCW 401 or the patient 403.
  • the RF listeners 120i, I2O 2 , I2O 3 , and I2O 4 are adapted to calculate a distance between the respective RF listener 120i, 120 2 , I2O 3 and I2O 4 and the RF tag 130 based on the time of flight of a signal communicated with the RF tag 130 along the dashed arrows 6OI 1 , 6OI2, 6OI 3 and 6OI 4 shown in Fig. 2.
  • a suitable algorithm such as trilateration, multi-lateration or the like.
  • the relative distance between each of the RF listeners and the RF tags 130 is provided to the controller (not shown) as first distance information and the controller is adapted to calculate a position (first position information) of the HCW based on this first distance information.
  • the RF tag has person identification information which can be acquired by the RF listener and send to the controller to determine the identity of the person present at the position represented by the first position information.
  • Fig. 3 illustrates the cleaning agent dispenser 151 in a different view (right part of Fig. 3) .
  • the cleaning agent dispenser is provided with a cleaning agent dispenser detector (not shown) which serves to send a signal to the controller when the HCW uses the dispenser.
  • the controller additionally determines that the relative distance between the HCW 401 and the dispenser 151 is below a predefined threshold. This may be determined based on the position of the HCW 401 determined using the RF listeners 120i, 120 2 , I2O 3 and I2O 4 and a known position of the dispenser 151. In the shown embodiment, the relative distance is determined based on communication between the shown dispenser transceiver 153 provided at the dispenser and the RF badge 130. The controller can thus determine that the HCW has washed his or her hands.
  • Fig. 4 illustrates the use of the imaging means and the second distance information acquiring means which in the shown embodiment are comprised by a 3D-camera 140.
  • the 3D-camera 140 is adapted to acquire a two-dimensional image as illustrated in part B of Fig. 4, whereby the corresponding field of view is indicated by dotted lines 605 in part A of the figure.
  • the image is an infrared image.
  • a visible image similarly could be employed.
  • the 3D-camera 140 is further adapted to acquire a corresponding depth image as illustrated in part C of Fig. 4 wherein for each image portion the distance between objects imaged in the two-dimensional image with respect to the camera 140 are indicated using a grey scale coding.
  • Such distances are exemplarily indicated by the dashed lines 603 in part A of the figure.
  • the distance of the object imaged in a portion of the two-dimensional image with respect to the 3D-camera 140 is encoded in a corresponding portion of the depth image.
  • parts B and C of Fig. 4 illustrate a one-to-one correspondence between the two-dimensional image of part B and the depth image of part C.
  • Fig. 5 schematically illustrates components of the hygiene compliance monitoring system 100.
  • tags 130i to 130 m can be provided at m persons present in the monitoring area, for example the patient room.
  • n listeners 120i to 120 n i.e. receivers, are provided which exchange or communicate signals, for example RF signals with the m tags. Based on this communication, each listener can determine the relative distance between said listener and each of the RF tags and these relative positions are supplied as first distance information to the controller 110.
  • each tag is provided with person identification information for identifying the person provided with the tag which is sent to the listener, this person identification information is similarly provided to the controller 110. Based on the first distance information, the controller can determine the position of each person within the monitoring area based on this first distance information and in addition knows the person identification information corresponding to each position .
  • a time of flight camera 140 is shown as an example of a 3D-camera being connected to the controller 110.
  • different 3D-cameras such as stereoscopic cameras may also be used.
  • the controller can assign person identification information received from the system of RF tags and listeners to a person recognized as such in an image received from the time of flight camera when the first position information matches the second position information determined based on second distance information received from the time of flight camera.
  • a soap dispenser 151 is illustrated as an example of a cleaning agent dispenser connected to the controller to notify the controller when the soap dispenser is used by sending a cleaning agent dispenser signal.
  • Fig. 6 is a flow chart illustrating steps performed by the hygiene compliance monitoring system. As illustrated in this flow chart, based on signals communicated with n RF listeners and corresponding RF tags, distances between the RF listeners and the RF tags can be calculated (S101) . Based on these distances (first distance information) an absolute position of the person provided with a tag can be determined in addition to its identity (S103) . When this person is near to the soap dispenser and it is determined that the soap dispenser is pressed, the controller is adapted to determine the HCW who is pressing the soap dispenser (S105) .
  • the controller determines three-dimensional shape or volume and relative position with respect to the camera for each person and object present in the monitoring area (S107) .
  • the controller compares the position acquired via the system of RF listeners and RF tags with the position acquired based on the relative position of a person or object with respect to the camera and assigns person identification information to said person (S109) .
  • the controller can select a patient, HCWs and surrounding objects present in the two-dimensional image (Sill) .
  • the controller can then determine if HCW and patient are in contact or if HCW is in contact with surrounding objects (S113) .
  • the controller automatically outputs statistical results monitoring the above steps over a predetermined time and in addition it becomes possible to output alerts, when for example it is determined that a HCW is in contact with a patient having not previously washed his or her hands.
  • Embodiment 1 Controller (110) comprising: first distance information receiving means configured to receive first distance information acquired by at least one first transceiver ( 120i...l20 n ) representing a distance
  • (110) being configured to determine first position information representing a position of the at least one person (401, 403) based on the first distance information; person identification information receiving means configured to receive person identification information from a person ID transceiver (130i...l30 m ) for identifying the at least one person (401, 403); two-dimensional image data receiving means configured to receive data of a two-dimensional image (Fig.
  • second distance information receiving means configured to receive second distance information representing at least one distance (603) between the at least one person and the imaging means (140), the at least one person imaged by the imaging means (140)
  • the controller (110) being configured to determine second position information relating to the position of the at least one person (401, 403) imaged by the imaging means based on the second distance information; the controller being configured to compare the first and the second position information and to identify the at least one person at the position represented by the first position information with the at least one person at the position represented by the second position information when the first position information matches the second position information.
  • Embodiment 2 Controller (110) according to embodiment 1, further configured to determine a two-dimensional shape of the at least one person (401, 403) imaged by the imaging means (140) within the two-dimensional image, and to determine a three-dimensional shape of the at least one person (401, 403) imaged within the two-dimensional image based on the two- dimensional shape of the person (401, 403) .
  • Embodiment 3 Controller (110) according to any one of embodiments 1 or 2, whereby the second distance information represents distances between portions of the at least one person and the imaging means (140), the controller being configured to determine a three-dimensional shape of the at least one person (401, 403) based on the second distance information .
  • Embodiment 4 Controller (110) according to any one of the preceding embodiments, further configured to determine a three-dimensional shape of a further person and a relative distance between the at least one person and the further person based on the corresponding three-dimensional shapes, and to determine that the first person (401, 403) is in contact with the second person (401, 403), when the relative distance is smaller than a predetermined threshold.
  • Embodiment 5 Controller (110) according to any one of the preceding embodiments further configured to determine a two- dimensional shape of an object different from a person within the two-dimensional image, to determine a three dimensional shape of the object and to determine that the at least one person is in contact with the object when a relative distance between the at least one person and the object is below a predefined threshold.
  • Embodiment 6 Controller (110) according to any one of the preceding embodiments, whereby the second distance information is a two-dimensional array (Fig. 4C) of distance information elements, and the data of the two-dimensional image (Fig. 4B) is a two-dimensional array of image information elements, whereby each of the distance information elements has a one- to-one relation with a corresponding one of the image information elements and represents a distance between an object imaged within an image information element and the imaging means .
  • the second distance information is a two-dimensional array (Fig. 4C) of distance information elements
  • the data of the two-dimensional image Fig. 4B
  • each of the distance information elements has a one- to-one relation with a corresponding one of the image information elements and represents a distance between an object imaged within an image information element and the imaging means .
  • Embodiment 7 Controller (110) according to any one of the preceding embodiments, further comprising a dispenser signal receiving means configured to receive a dispenser signal transmitted from a cleaning agent dispenser detector (153) provided at a cleaning agent dispenser (151) when a person (401, 403) uses the cleaning agent dispenser (151), the controller (110) further being configured to determine a relative distance between the first person (401, 403) based on the first position information and a predetermined position of the cleaning agent dispenser (151), and configured to determine that the first person (401, 403) has used the cleaning agent dispenser (151), when the dispenser signal receiving means receives the dispenser signal and the relative distance between the first person (401, 403), based on the first position information and a predetermined position of the cleaning agent dispenser is below a predetermined threshold .
  • a dispenser signal receiving means configured to receive a dispenser signal transmitted from a cleaning agent dispenser detector (153) provided at a cleaning agent dispenser (151) when a person (401, 403) uses the cleaning agent dispenser (151)
  • the controller (110) further being configured to determine a relative distance
  • Embodiment 8 Controller (110) according to any one of the preceding embodiments, further configured to determine that the first person (401, 403) has entered a monitoring area (300) at a first timing based on a signal received from the at least one first transceiver ( 120i...l20 n ) , and is configured to determine that the first person (401, 403) is in contact with the second person (401, 403) at a second timing, and is configured to generate an output when determining that in a time interval between the first timing and the second timing the controller (110) has not determined that the first person (401, 403) has used the cleaning agent dispenser.
  • Embodiment 9 Controller (110) according to embodiment 8, the controller (110) further configured to monitor the relative distance between the first person (401, 403) and the second person (401, 403), and is configured to cause an alert when at a third timing the relative distance between the first person (401, 403) and the second person (401, 403) is below a predefined threshold and in a time interval between the first timing and the third timing the controller (110) has not determined that the first person (401, 403) has used the cleaning agent dispenser.
  • Embodiment 10 Controller according to any one of the preceding embodiments, the controller being for a hygiene compliance monitoring system (100) .
  • Embodiment 11 System comprising the controller (110) according to any one of embodiments 1 to 10, the at least one first transceiver ( 120i...l20 n ) , the second transceiver (130i...l30 m ) , and the imaging means (140) .
  • Embodiment 12 System (100) according to embodiment 11, further comprising a second distance information acquiring means for acquiring the second distance information, the second distance information acquiring means and the imaging means (140) being comprised by a 3D-camera.
  • Embodiment 13 System (100) according to any one of embodiments 11 or 12, or controller (110) according to any one of embodiments 1 to 10, whereby the at least one transceiver is provided at a predefined position within a monitoring area (300) .
  • Embodiment 14 System (100) according to any one of embodiments 11 to 13, or controller (110) according to any one of embodiments 1 to 10 or 13, whereby the first distance information is calculated based on the time needed to communicate a signal between the first and the second transceiver ( 130i...l30 m ) .
  • Embodiment 15 Method comprising the following steps: receive first distance information acquired by at least one first transceiver ( 120i...l20 n ) representing a distance ( 601 1 ...6O l n ) between the at least one first transceiver ( 120i...l2 O n ) and at least one second transceiver (130i...l30 m ) provided at at least one person (401, 403); determine first position information representing a position of the at least one person (401, 403) based on the first distance information; receive person identification information from a person ID transceiver (130i...l30 m ) for identifying the at least one person (401, 403); receive data of a two-dimensional image (401) acquired by an imaging means (140), and receive second distance information representing at least one distance (603) between the at least one person and the imaging means (140), the at least one person imaged by the imaging means (140) , determine second position information relating to the position of the at least one person (401, 403) imaged

Landscapes

  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Primary Health Care (AREA)
  • Medical Informatics (AREA)
  • Human Computer Interaction (AREA)
  • Emergency Management (AREA)
  • Computer Security & Cryptography (AREA)
  • Emergency Alarm Devices (AREA)
  • Alarm Systems (AREA)

Abstract

La présente invention concerne un dispositif de commande, en particulier pour un système de surveillance de respect de l'hygiène des mains. Le dispositif de commande est, de préférence, configuré pour détecter un contact entre des déchets médicaux (HCW) et un patient. Le dispositif de commande est configuré pour recevoir des premières informations de distance pour déterminer des premières informations de position représentant une position d'au moins une personne et des informations d'identification de personne pour identification de l'au moins une personne. Le dispositif de commande est configuré pour recevoir une image et déterminer des secondes informations de position relatives à la position d'une personne dont on prend une image sur la base des secondes informations de distance. Le dispositif de commande est configuré pour comparer les premières et secondes informations de position et identifier l'au moins une personne au niveau de la position représentée par les premières informations de position avec l'au moins une personne au niveau de la position représentée par les secondes informations de position lorsque les premières informations de position correspondent aux secondes informations de position.
PCT/EP2016/064703 2015-06-26 2016-06-24 Système de surveillance de respect de l'hygiène WO2016207370A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP15174131.1 2015-06-26
EP15382339.8A EP3109840A1 (fr) 2015-06-26 2015-06-26 Systeme de surveillance du respect de l'hygiene
EP15382339.8 2015-06-26
EP15174131 2015-06-26

Publications (2)

Publication Number Publication Date
WO2016207370A1 true WO2016207370A1 (fr) 2016-12-29
WO2016207370A8 WO2016207370A8 (fr) 2017-02-23

Family

ID=56292690

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2016/064703 WO2016207370A1 (fr) 2015-06-26 2016-06-24 Système de surveillance de respect de l'hygiène

Country Status (1)

Country Link
WO (1) WO2016207370A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018196979A1 (fr) * 2017-04-27 2018-11-01 Essity Hygiene And Health Aktiebolag Surveillance améliorée du respect de l'hygiène
US10997848B2 (en) 2017-04-27 2021-05-04 Essity Hygiene And Health Aktiebolag Hygiene compliance monitoring

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010151802A2 (fr) 2009-06-26 2010-12-29 Madison Research Technologies, Inc. Système destiné à la surveillance de la sécurité des patients permettant de déterminer l'observance des directives en matière d'hygiène des mains
EP2395490A1 (fr) * 2010-05-27 2011-12-14 Infrared Integrated Systems Ltd. Surveillance de l'hygiène des mains
US20120212582A1 (en) * 2011-02-22 2012-08-23 Richard Deutsch Systems and methods for monitoring caregiver and patient protocol compliance
WO2013106440A1 (fr) 2012-01-09 2013-07-18 Judson Smith Système en réseau d'hygiène des mains
WO2015020709A2 (fr) * 2013-05-09 2015-02-12 Cryovac, Inc. Système de reconnaissance visuelle basé sur des données d'image à distorsion visuelle
US20150109442A1 (en) * 2010-09-23 2015-04-23 Stryker Corporation Video monitoring system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010151802A2 (fr) 2009-06-26 2010-12-29 Madison Research Technologies, Inc. Système destiné à la surveillance de la sécurité des patients permettant de déterminer l'observance des directives en matière d'hygiène des mains
EP2395490A1 (fr) * 2010-05-27 2011-12-14 Infrared Integrated Systems Ltd. Surveillance de l'hygiène des mains
US20150109442A1 (en) * 2010-09-23 2015-04-23 Stryker Corporation Video monitoring system
US20120212582A1 (en) * 2011-02-22 2012-08-23 Richard Deutsch Systems and methods for monitoring caregiver and patient protocol compliance
WO2013106440A1 (fr) 2012-01-09 2013-07-18 Judson Smith Système en réseau d'hygiène des mains
WO2015020709A2 (fr) * 2013-05-09 2015-02-12 Cryovac, Inc. Système de reconnaissance visuelle basé sur des données d'image à distorsion visuelle

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018196979A1 (fr) * 2017-04-27 2018-11-01 Essity Hygiene And Health Aktiebolag Surveillance améliorée du respect de l'hygiène
US10997848B2 (en) 2017-04-27 2021-05-04 Essity Hygiene And Health Aktiebolag Hygiene compliance monitoring

Also Published As

Publication number Publication date
WO2016207370A8 (fr) 2017-02-23

Similar Documents

Publication Publication Date Title
US10412541B2 (en) Real-time location system (RTLS) that uses a combination of bed-and-bay-level event sensors and RSSI measurements to determine bay-location of tags
Zago et al. 3D tracking of human motion using visual skeletonization and stereoscopic vision
JP7138931B2 (ja) 姿勢解析装置、姿勢解析方法、及びプログラム
US20190378395A1 (en) Method and system for hand washing compliance
US11776146B2 (en) Edge handling methods for associated depth sensing camera devices, systems, and methods
US8742935B2 (en) Radar based systems and methods for detecting a fallen person
US20020044682A1 (en) Method and apparatus for subject physical position and security determination
CN106580294A (zh) 基于多模态成像技术的生理信号远程监控系统及应用
Steinebach et al. Accuracy evaluation of two markerless motion capture systems for measurement of upper extremities: Kinect V2 and Captiv
CN110546694A (zh) 改进的卫生合规性监控
KR20170111221A (ko) LiDAR를 이용한 환자의 위치추적 시스템
WO2016207370A1 (fr) Système de surveillance de respect de l'hygiène
TWI541769B (zh) 跌倒偵測系統及方法
JP7086441B1 (ja) 携帯型非接触生体信号検出装置、運転者モニター装置、入場者スクリーニング・システム、及び家庭用ヘルスケアシステム
EP3109840A1 (fr) Systeme de surveillance du respect de l'hygiene
KR100696951B1 (ko) 위치 인식 기술을 이용한 모니터링 시스템 및 방법
US20230326318A1 (en) Environment sensing for care systems
EP3835812A1 (fr) Procédé pour la localisation d'individus vivants dans une zone de recherche
JP2006003157A (ja) 位置検出システム
JP7388199B2 (ja) 生体情報収集システム、生体情報収集方法及びプログラム
CN113271848B (zh) 身体健康状态影像分析装置、方法以及系统
WO2019105542A1 (fr) Conformité de l'utilisation d'un équipement d'hygiène
KR20220102774A (ko) 라이다(LiDAR)를 이용한 인체 감시장치
US20220225893A1 (en) Methods for automatic patient tidal volume determination using non-contact patient monitoring systems
JP7205540B2 (ja) コンピューターで実行されるプログラム、情報処理装置、および、コンピューターで実行される方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16733423

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16733423

Country of ref document: EP

Kind code of ref document: A1