WO2024004641A1 - 監視システム、監視装置、監視方法及び監視プログラム - Google Patents

監視システム、監視装置、監視方法及び監視プログラム Download PDF

Info

Publication number
WO2024004641A1
WO2024004641A1 PCT/JP2023/021999 JP2023021999W WO2024004641A1 WO 2024004641 A1 WO2024004641 A1 WO 2024004641A1 JP 2023021999 W JP2023021999 W JP 2023021999W WO 2024004641 A1 WO2024004641 A1 WO 2024004641A1
Authority
WO
WIPO (PCT)
Prior art keywords
person
state
predetermined
area
monitored
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2023/021999
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
河野命
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Glory Ltd
Original Assignee
Glory Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Glory Ltd filed Critical Glory Ltd
Priority to EP23831089.0A priority Critical patent/EP4550288A1/en
Publication of WO2024004641A1 publication Critical patent/WO2024004641A1/ja
Priority to US19/001,622 priority patent/US20250148892A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • G08B21/22—Status alarms responsive to presence or absence of persons
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0407—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
    • G08B21/043—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis detecting an emergency event, e.g. a fall
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B29/00—Checking or monitoring of signalling or alarm systems; Prevention or correction of operating errors, e.g. preventing unauthorised operation
    • G08B29/18—Prevention or correction of operating errors
    • G08B29/185—Signal analysis techniques for reducing or preventing false alarms or for enhancing the reliability of the system
    • G08B29/188—Data fusion; cooperative systems, e.g. voting among different detectors
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B7/00—Signalling systems according to two or more of groups G08B3/00 - G08B6/00
    • G08B7/06—Signalling systems according to two or more of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0438—Sensor means for detecting
    • G08B21/0469—Presence detectors to detect unsafe condition, e.g. infrared sensor, microphone

Definitions

  • the present disclosure relates to a monitoring system, a monitoring device, a monitoring method, and a monitoring program.
  • Patent Document 1 describes a monitoring system that monitors a person to be monitored.
  • this monitoring system (“monitored person monitoring system” in Patent Document 1)
  • an alarm device (“mobile terminal unit” in Patent Document 1) is activated.
  • the person to be monitored is a resident of a welfare facility for the elderly, and the resident takes a prescribed action (such as getting up or falling), the resident becomes in a state in which assistance is required, and the person in charge assists the resident. If the resident is not present in the area where the resident is located, the alarm should be activated. However, in this case, if another resident exists in the area where the resident is present, the activation of the alarm device will be blocked.
  • the purpose of the present disclosure is to provide a monitoring system, a monitoring device, a monitoring method, and a monitoring program that can easily issue an alarm in a situation where an alarm is necessary while avoiding an alarm in a situation where an alarm is not required.
  • the goal is to provide the following.
  • the monitoring system includes an alarm device, a state detection section that detects a state of a person to be monitored, and a state detection section that operates the alarm device in response to a predetermined state being detected by the state detection section. and a determination for determining whether a predetermined attribute person, who is a person different from the monitored person and has a predetermined attribute, exists in the area where the monitored person exists. and when the predetermined state is detected by the state detection unit and the determination unit determines that the predetermined attribute person is present in the area, the alarm control unit activates the alarm device. If the state detection unit detects the predetermined state and the determination unit determines that the person with the predetermined attribute does not exist in the area, the alarm control unit activates the alarm device. let
  • a monitoring method is a monitoring method in a monitoring system, and includes a state detection step of detecting the state of a monitored person, and a predetermined person who is a person different from the monitored person and has a predetermined attribute. a determination step of determining whether or not the attribute person exists in the area where the monitored person exists; and a predetermined state is detected by the state detection step, and the determination step determines whether the predetermined attribute person is present in the area. If it is determined that the predetermined attribute person does not exist in the area, the alarm device is not activated, and if the predetermined condition is detected by the condition detection step and the predetermined attribute person is determined not to exist in the area by the determination step. and a warning step of activating the warning device.
  • the monitoring program includes a status acquisition function that acquires information indicating the status of a monitored person, and a predetermined attribute person who is a person different from the monitored person and has a predetermined attribute.
  • a determination function that determines whether the person exists in the area where the observer exists; information indicating a predetermined state is acquired by the state acquisition function; and the determination function determines that the person with the predetermined attribute exists in the area. If the predetermined state is detected by the state acquisition function, and the determination function determines that the person with the predetermined attribute does not exist in the area, the alarm device is not activated. To enable a computer to realize an alarm function for activating an alarm device.
  • the alarm device when a person to be monitored is in a predetermined state, the alarm device does not operate if a person with the predetermined attribute exists in the area where the person to be monitored exists, and the alarm device does not activate if the person with the predetermined attribute does not exist. The alarm device will be activated.
  • the person to be monitored is a resident of a welfare facility for the elderly and the predetermined attribute is "being an attendant who provides assistance to the resident," the resident who is the person to be monitored is in a predetermined state (for example, if a resident falls down and a staff member is present in the area where the resident is present, the alarm device will not operate.
  • the alarm device is activated. That is, it is possible to avoid a situation where the alarm is blocked due to the presence of another resident.
  • the monitoring device includes a state detection unit that detects a state of a person to be monitored, and a state that is information indicating a detection result by the state detection unit in response to a predetermined state being detected by the state detection unit.
  • a transmitter capable of transmitting information to the outside; and a transmitting unit that determines whether or not a person with a predetermined attribute, who is a person different from the person to be monitored and has a predetermined attribute, exists in the area where the person to be monitored exists.
  • a determination unit that makes a determination, and when the state detection unit detects the predetermined state and the determination unit determines that the predetermined attribute person is present in the area, the transmission unit transmits the state information. If the state detection unit detects the predetermined state and the determination unit determines that the person with the predetermined attribute does not exist in the area without transmitting the state information to the outside, the transmission unit transmits the state information to the outside. Send.
  • the status information when a person to be monitored is in a predetermined state, if a person with a predetermined attribute exists in the area where the person to be monitored exists, the status information is not transmitted to the outside, and if a person with a predetermined attribute does not exist, the state information is not transmitted to the outside.
  • Status information will be sent externally. That is, for example, if status information is sent to an external alarm device, when the monitored person enters a predetermined state, the alarm device will not operate if a person with a predetermined attribute exists in the area where the monitored person exists. First, if a person with the predetermined attribute does not exist, the alarm device will be activated.
  • the person to be monitored is a resident of a welfare facility for the elderly and the predetermined attribute is "being an attendant who provides assistance to the resident," the resident who is the person to be monitored is in a predetermined state (for example, if a resident falls down and a staff member is present in the area where the resident is present, the alarm device will not operate.
  • the alarm device is activated. That is, it is possible to avoid a situation where the alarm is blocked due to the presence of another resident.
  • the predetermined state is a dangerous state of the monitored person.
  • the alarm device when the monitored person is in a dangerous state (for example, when the monitored person falls), the alarm device is activated if a person with a predetermined attribute does not exist in the area where the monitored person exists. becomes.
  • the predetermined attribute is "an employee who provides assistance to the resident”
  • the person in charge will be able to respond to an alarm and report a dangerous situation. You can go to assist the resident in the area.
  • the predetermined attribute is that the person is an attendant who provides assistance to the monitored person.
  • the alarm device when the monitored person is in a predetermined state (for example, fallen down), if an attendant is present in the area where the monitored person is present, the alarm device will not operate. Furthermore, when the monitored person is in a predetermined state (for example, fallen), if there is no staff in the area where the monitored person is, even if someone other than the monitored person is present, The alarm device is activated. That is, it is possible to avoid a situation where the alarm is blocked due to the presence of a person other than the monitored person.
  • an alarm is issued in a situation where an alarm is required, while preventing an alarm from being issued in a situation where an alarm is not required, and the staff member responds to the alarm by notifying the monitored person. can go to provide assistance to others.
  • the present disclosure includes a detection unit that detects a specific object worn by the staff member, and the determination unit determines whether the predetermined attribute person is present in the area based on the detection result by the detection unit. It is preferable to determine whether or not.
  • the determination algorithm tends to be simpler than a configuration in which the presence or absence of a person with a predetermined attribute is determined by, for example, facial recognition.
  • the present disclosure includes a biometric information acquisition unit that acquires at least one of biometric information of a person entering the area and biometric information of a person existing in the area, and the determination unit It is preferable to determine whether or not the person with the predetermined attribute exists in the area based on biometric information acquired by the information acquisition unit.
  • this configuration it is possible to determine the presence or absence of a person with a predetermined attribute without depending on what the person with the predetermined attribute wears (for example, an IC card or a staff member's uniform). That is, in order to determine the presence or absence of a person with the predetermined attribute, it is not necessary for the persons with the predetermined attribute to wear a specific item in common. Therefore, when operating the surveillance system, there is no need to require a person with a predetermined attribute to wear a specific item. This tends to facilitate the operation of the monitoring system.
  • the alarm control section operates the alarm device.
  • the person to be monitored When the person to be monitored is in a predetermined state (for example, fallen), even if a person with a predetermined attribute is present in the area where the person to be monitored exists, there may be cases where an alarm should be issued depending on the situation. For example, when a person with a predetermined attribute is present in the area where the person being monitored exists, the person being monitored may be in an abnormal state (for example, bleeding profusely) that cannot be dealt with by the person with the predetermined attribute. If this occurs, a report should be issued.
  • a predetermined state for example, fallen
  • an abnormal state for example, bleeding profusely
  • the alarm device can be activated in a situation where a person with a predetermined attribute is present in the area where the person to be monitored exists but an alarm should be issued.
  • This allows the user of the monitoring system (for example, a staff member who assists the monitored person) to take appropriate measures upon receiving the alert.
  • the first condition is that the state detection section detects an abnormal state different from the predetermined state.
  • the monitored person when the monitored person is in a predetermined state (for example, a fallen state), even if a person with a predetermined attribute is present in the area where the monitored person exists, the monitored person is in an abnormal state (for example, a large number of An alarm will be issued if the patient is in a state of bleeding.
  • a predetermined state for example, a fallen state
  • an abnormal state for example, a large number of An alarm will be issued if the patient is in a state of bleeding.
  • the apparatus further includes a person condition detection section that detects the condition of the person with the predetermined attribute, and the first condition is that an abnormal condition is detected by the person condition detection section.
  • a report will be issued.
  • a predetermined state for example, a fallen state
  • an abnormal state for example, If the monitored person is assaulted
  • the first condition is that the predetermined state continues for a predetermined period of time.
  • the monitored person when the monitored person is in a predetermined state (for example, fallen), even if a person with a predetermined attribute is present in the area where the monitored person exists, the monitored person remains in a relatively long time. If the predetermined state remains throughout, an alarm is issued.
  • a predetermined state for example, fallen
  • an alarm is issued.
  • the alarm control section does not operate the alarm device.
  • a person to be monitored When a person to be monitored is in a specified state (for example, falling), there may be cases in which an alarm should not be issued, depending on the situation, even if no person with the specified attribute exists in the area where the person to be monitored exists. . For example, if the person to be monitored or the user of the monitoring system wishes not to issue a warning during a particular time period, the notification should not be issued during that time period.
  • the second condition is that the current time is included in a preset time zone.
  • the area is a room where the person to be monitored exists.
  • the predetermined attribute person can deal with the predetermined state of the monitored person. Therefore, there is no need to issue an alert.
  • the alarm device when the person to be monitored is in a predetermined state, if a person with the predetermined attribute is present in the room where the person to be monitored exists, the alarm device will not operate, and the person with the predetermined attribute will not be present. In this case, the alarm device will be activated.
  • the alarm device is a display device that can issue an alarm by displaying an image.
  • the alarm device issues an alarm, for example, by displaying an image taken of the person to be monitored
  • the user of the monitoring system can grasp the condition of the person to be monitored in detail. can be realized. This makes it easier for users of the monitoring system to take appropriate measures.
  • the alarm device is a calling device capable of calling the person with the predetermined attribute.
  • the person to be monitored when the person to be monitored is in a predetermined state, if the person with the predetermined attribute does not exist in the area where the person to be monitored exists, the person with the predetermined attribute is called. Thereby, a person with a predetermined attribute can receive the call and take appropriate measures.
  • FIG. 7 is a diagram illustrating an example of a case where a person with a predetermined attribute does not exist in an area where a person to be monitored exists.
  • FIG. 7 is a diagram illustrating an example of a case where a person with a predetermined attribute exists in an area where a person to be monitored exists.
  • FIG. 1 is a block diagram of a monitoring system. It is a flowchart of an alert decision flow.
  • FIG. 2 is a diagram illustrating a monitoring method according to the present disclosure.
  • the monitoring system A in this embodiment includes a monitoring device 1 and an alarm device 2.
  • the monitoring device 1 and the alarm device 2 are connected to each other via a predetermined network.
  • the monitoring device 1 is installed in area B where the person to be monitored D exists.
  • the monitoring device 1 monitors the person D to be monitored.
  • the monitoring device 1 can operate the alarm device 2 according to the condition of the person D to be monitored.
  • the predetermined attribute person E who owns the alarm device 2 can grasp the condition of the monitored person D even though he/she is outside the area B by the alarm issued by the alarm device 2.
  • the person to be monitored D is in a fallen state.
  • the monitoring device 1 can activate the alarm device 2.
  • the person to be monitored D is a resident of a welfare facility for the elderly
  • area B is the room of the person to be monitored D in the welfare facility for the elderly. That is, area B in this embodiment is a room where monitored person D exists.
  • the present disclosure is not limited thereto, and area B does not need to be a room.
  • the area B may be the entire space, or the area B may be the entire space, or the area where the monitored person D is located within the space. It may be only in the vicinity.
  • Area B is preferably a range where another person (person E with predetermined attribute) can visually check the state of person D to be monitored.
  • the predetermined attribute person E is a person different from the monitored person D and has a predetermined attribute.
  • the predetermined attribute is that the person is an attendant who assists the person to be monitored. That is, the predetermined attribute person E is an attendant (employee) of a welfare facility for the elderly.
  • the "predetermined attribute” may be an attribute other than "being an attendant who assists the monitored person D".
  • the "predetermined attribute” may be "being a relative of monitored person D or a staff member who assists monitored person D", or being a specific person (for example, "being a relative of monitored person D"), or being a specific person (e.g., "specific ⁇ Mr. X or Mr. Y'').
  • the predetermined attribute person E is also a user of the monitoring system A.
  • the alarm device 2 in this embodiment is an information terminal (smartphone, tablet, etc.) carried by the staff member. Further, in the example shown in FIG. 1, the person E with the predetermined attribute who is an attendant is located in a room other than the room (for example, a waiting room).
  • the number of monitoring devices 1 included in the monitoring system A may be one or more. That is, the monitoring system A may be one that monitors one person D to be monitored, or may be one that monitors a plurality of people D to be monitored.
  • a plurality of monitoring devices 1 may be installed within a welfare facility for the elderly.
  • the monitoring device 1 may be installed in each living room of a welfare facility for the elderly, or may be installed in an area other than the living room (for example, a hallway).
  • the number of alarm devices 2 included in the monitoring system A may be one or more than one.
  • a plurality of predetermined attribute persons E may each carry one alarm device 2.
  • the alarm device 2 may be a personal computer, a display, a lamp, a speaker, etc. installed in a room (for example, a waiting room) for the person E with the predetermined attribute. Further, the alarm device 2 may be carried by a person who is not a person E with the predetermined attribute (for example, a relative of the person to be monitored D), or may be carried by a person who is not a person with the predetermined attribute E (for example, a relative of the person to be monitored D). ) may be a computer, display, lamp, speaker, etc. installed at home.
  • a first person E1 and a second person E2 are shown.
  • the first person E1 and the second person E2 are both persons E with a predetermined attribute.
  • the first person E1 is located in a room (for example, a waiting room) that is different from area B, which is the living room where the person to be monitored D exists.
  • the second person E2 is located in area B, which is the living room where the person to be monitored D exists.
  • the person to be monitored D is in a fallen state, similar to the example shown in FIG.
  • the monitoring device 1 does not operate the alarm device 2 in principle.
  • the monitoring device 1 includes an imaging section 3 and a control section 4.
  • the imaging unit 3 images the inside of area B (see FIG. 1).
  • the imaging range of the imaging unit 3 may be the entire area B or only a part of the area B. Further, the imaging range of the imaging unit 3 may include the outside of the area B.
  • the imaging unit 3 is configured with an infrared camera.
  • the imaging unit 3 may be any device other than an infrared camera as long as it can image the inside of area B.
  • the imaging unit 3 is preferably a ToF (Time of Flight) camera.
  • the captured image acquired by the imaging unit 3 is preferably a depth image that includes depth information. Note that the captured image acquired by the imaging unit 3 may be a moving image or a still image.
  • control section 4 includes a state detection section 41.
  • the imaging unit 3 sends the acquired captured image to the state detection unit 41.
  • the monitoring system A includes a sound detection device 5 that detects sound.
  • the sound detection device 5 may be installed within area B, for example.
  • the sound detection device 5 may be a known microphone.
  • the sound detection device 5 sends information indicating the detected sound to the state detection section 41.
  • the state detection unit 41 detects the state of the monitored person D based on the captured image received from the imaging unit 3 and the information indicating the sound received from the sound detection device 5. That is, the monitoring system A includes a state detection unit 41 that detects the state of the person D to be monitored.
  • the state detection unit 41 generates a skeletal model, which is information indicating the skeletal structure of the monitored person D, based on the received captured image.
  • the skeletal model is generated by analyzing the captured image, three-dimensionally recognizing the positions of the joints of the monitored person D, and connecting each joint with a straight line.
  • the state detection unit 41 detects the body position of the monitored person D (for example, standing position, lying position, sitting position) based on the captured image and the generated skeletal model, and also detects the captured image, the skeletal model, and the sound. Based on the information shown, it is configured to detect whether the person to be monitored D is in a predetermined state and whether or not the monitored person D is in an abnormal state different from the predetermined state.
  • the predetermined state may be a dangerous state of the monitored person D (for example, a fallen state).
  • the abnormal state may be a state in which the person to be monitored D is bleeding profusely or a state in which the person to be monitored D is being assaulted by a person E of a predetermined attribute. Note that the technology for detecting a dangerous state or abnormal state such as a fall based on a captured image or a skeletal model is well known and will not be described here.
  • the state detection unit 41 determines whether or not the monitored person D is screaming based on the information indicating the sound, and also determines whether the monitored person D is in a dangerous state or abnormality based on the result of the determination. It may be configured to detect the state.
  • the state detection unit 41 be able to identify the person appearing in the captured image. By identifying the person shown in the captured image, it is possible to avoid a situation in which the state detection unit 41 mistakenly detects the state of a person other than the monitored person D. As a result, for example, when a person other than person D to be monitored (for example, person E with a predetermined attribute) is in a predetermined state (for example, a fallen state), it is mistakenly detected that person D to be monitored is in a predetermined state. You can avoid situations where this happens.
  • a person other than person D to be monitored for example, person E with a predetermined attribute
  • a predetermined state for example, a fallen state
  • the method by which the state detection unit 41 identifies the person in the captured image is not particularly limited, but the person may be identified by analyzing the captured image using a machine-learned neural network.
  • the control section 4 includes a person state detection section 42.
  • the imaging unit 3 sends the acquired captured image to the person state detection unit 42 .
  • the sound detection device 5 sends information indicating the detected sound to the person state detection section 42 .
  • the person state detection unit 42 detects the state of a predetermined attribute person E (see FIG. 2) existing in the area B based on the captured image received from the imaging unit 3 and the information indicating the sound received from the sound detection device 5. Detect. That is, the monitoring system A further includes a person state detection section 42 that detects the state of the person E with a predetermined attribute.
  • the person state detection unit 42 generates a skeletal model, which is information indicating the skeletal structure of the person E with the predetermined attribute, based on the received captured image.
  • the skeletal model is generated by analyzing the captured image, three-dimensionally recognizing the positions of the joints of the person E with the predetermined attribute, and connecting each joint with a straight line.
  • the person state detection unit 42 detects the body position (e.g., standing position, lying position, sitting position) of the person E with a predetermined attribute based on the captured image and the generated skeletal model, and also It is configured to detect whether or not the predetermined attribute person E is in an abnormal state based on information indicating.
  • the body position e.g., standing position, lying position, sitting position
  • the abnormal state may be a state in which the person E of the predetermined attribute assaults the person to be monitored D. For example, if the person E with the predetermined attribute continues to move violently for a predetermined period of time, or if the person E with the predetermined attribute waves his/her hand down a predetermined number of times, the person E with the predetermined attribute is in an abnormal state (the person being monitored). It may be detected that the person is in a state of assaulting person D).
  • the person state detection unit 42 determines whether or not the person E of the predetermined attribute is yelling based on the information indicating the sound, and detects the abnormal state of the person E of the predetermined attribute based on the result of the determination. It may be configured to detect.
  • the person state detection unit 42 be able to identify the person appearing in the captured image. By identifying the person in the captured image, it is possible to avoid a situation in which the person state detection unit 42 mistakenly detects the state of a person other than the person E with the predetermined attribute. This avoids a situation where, for example, when a person other than the predetermined attribute person E (for example, monitored person D) is in an abnormal state, it is mistakenly detected that the predetermined attribute person E is in an abnormal state. can.
  • a person other than the predetermined attribute person E for example, monitored person D
  • the method by which the person state detection unit 42 identifies the person in the captured image is not particularly limited, but the person may be identified by analyzing the captured image using a machine-learned neural network.
  • the control unit 4 includes a specific object detection unit 43 (corresponding to the “detection unit” according to the present disclosure).
  • the imaging unit 3 sends the acquired captured image to the specific object detection unit 43.
  • the specific object detection unit 43 detects a specific object by performing image analysis based on the captured image received from the imaging unit 3.
  • the specific object is an object worn by a person E with a predetermined attribute who is an employee of a welfare facility for the elderly. That is, the monitoring system A includes a specific object detection unit 43 that detects a specific object worn by an attendant.
  • the specific object may be, for example, the uniform or badge of the staff member.
  • a predetermined attribute person E exists in area B, a specific object will appear in the captured image, and the specific object will be detected by the specific object detection unit 43. If the predetermined attribute person E does not exist in area B, the specific object is not captured in the captured image, and therefore the specific object detection unit 43 does not detect the specific object.
  • the monitoring system A includes a room entry detection device 6 (corresponding to the "biological information acquisition unit” according to the present disclosure) and a room exit detection device 7. Both the room entry detection device 6 and the room exit detection device 7 are installed near a door 8 provided at the entrance/exit of area B.
  • the room entry detection device 6 is configured to acquire biometric information of a person entering area B. That is, the monitoring system A includes an entry detection device 6 that acquires biological information of a person who enters the area B.
  • the door 8 may be configured to be normally closed and temporarily open in response to the entry detection device 6 acquiring biological information.
  • the biometric information acquired by the room entry detection device 6 may be, for example, facial information or fingerprint information.
  • the room exit detection device 7 is configured to acquire biological information of a person leaving area B.
  • the door 8 may be normally closed and may be temporarily opened in response to the exit detection device 7 acquiring biometric information.
  • the biometric information acquired by the room exit detection device 7 may be, for example, facial information or fingerprint information.
  • control section 4 includes a determination section 44.
  • the detection result by the specific object detection section 43 is sent to the determination section 44 .
  • the biometric information acquired by the room entry detection device 6 and the room exit detection device 7 is sent to the determination unit 44 .
  • the determination unit 44 determines whether a person E with a predetermined attribute exists in area B based on the detection result by the specific object detection unit 43 and the biological information acquired by the room entry detection device 6 and the room exit detection device 7. judge.
  • the monitoring system A determines whether a predetermined attribute person E, who is a person different from the monitored person D and has a predetermined attribute, exists in the area B where the monitored person D exists.
  • a determination section 44 is provided. Further, the determination unit 44 determines whether or not the predetermined attribute person E exists in the area B based on the detection result by the specific object detection unit 43. Further, the determination unit 44 determines whether or not a person E with a predetermined attribute exists in the area B based on the biometric information acquired by the room entry detection device 6.
  • the determination unit 44 stores biometric information (for example, facial information and fingerprint information) of all staff members of this elderly welfare facility.
  • the determining unit 44 determines whether the person who entered area B is a person E with a predetermined attribute by comparing the biometric information stored in the determining unit 44 and the biometric information acquired by the room entry detection device 6. Determine whether In addition, the determining unit 44 determines that the person who left area B is the predetermined attribute person E by comparing the biometric information stored in the determining unit 44 and the biometric information acquired by the exit detection device 7. Determine whether or not.
  • the determination unit 44 determines whether the history of the biological information acquired by the room entry detection device 6 and the room exit detection device 7 is the first pattern, the second pattern, or the third pattern.
  • the first pattern is a pattern in which after the predetermined attribute person E enters area B, the predetermined attribute person E does not exit from area B.
  • the second pattern is a pattern in which a person E with a predetermined attribute enters area B and then a person E with a predetermined attribute exits from area B.
  • the third pattern is a pattern in which area B does not include the predetermined attribute person E.
  • the determination unit 44 determines that the predetermined attribute person E exists in the area B, regardless of the biometric information acquired by the room entry detection device 6 and the room exit detection device 7. .
  • the determination unit 44 determines that a predetermined It is determined that attribute person E exists in area B.
  • the determination unit 44 determines that the specific object is not detected by the specific object detection unit 43 and the history of the biological information acquired by the room entry detection device 6 and the room exit detection device 7 is the second pattern or the third pattern described above. If so, it is determined that the predetermined attribute person E does not exist in area B.
  • the determination unit 44 determines whether a person E with a predetermined attribute has been identified only when the specific object is detected by the specific object detection unit 43 and the history of biometric information acquired by the room entry detection device 6 and the room exit detection device 7 is the first pattern. may be configured to determine that exists in area B.
  • the control unit 4 includes a signal transmission unit 45 (corresponding to the “alarm control unit” and “transmission unit” according to the present disclosure).
  • the detection results by the state detection section 41 and the person state detection section 42 are sent to the signal transmission section 45. Further, the determination result by the determining section 44 is sent to the signal transmitting section 45.
  • the signal transmitter 45 is configured to be able to transmit a predetermined alarm signal (corresponding to "status information" according to the present disclosure) to the alarm device 2 when a predetermined state is detected by the state detector 41.
  • the alarm signal is information indicating the detection result by the state detection section 41.
  • the alarm device 2 operates upon receiving the alarm signal. More specifically, the alarm device 2 issues an alarm by displaying an image and using a voice that calls the person E with the predetermined attribute. That is, the alarm device 2 is a display device capable of issuing an alarm by displaying an image, and is also a calling device capable of calling a person E with a predetermined attribute.
  • the image display may be one that displays an image captured by the imaging unit 3.
  • the contents of the image display and the calling voice may inform, for example, the name of the person to be monitored D, the location of the room (room number, etc.), the current state, etc.
  • the alarm device 2 may be capable of issuing an alarm by vibration.
  • the monitoring system A includes a signal transmitting section 45 that can activate the alarm device 2 in response to the detection of a predetermined state by the state detecting section 41.
  • the monitoring device 1 also includes a signal transmitter 45 capable of transmitting an alarm signal, which is information indicating the detection result by the condition detector 41, to the outside in response to the detection of a predetermined condition by the condition detector 41. ing.
  • the signal transmitter 45 transmits the above-mentioned alarm signal to the alarm device according to the alarm determination flow shown in FIG. 2.
  • step S01 it is determined whether the state detection unit 41 detects a predetermined state. If the predetermined state is not detected by the state detection unit 41 (“No” in step S01 of FIG. 4), this notification determination flow is temporarily terminated. When the predetermined state is detected by the state detection unit 41 ("Yes" in step S01 of FIG. 4), the process moves to step S02.
  • step S02 it is determined by the determination unit 44 whether or not it has been determined that the predetermined attribute person E exists in area B. If it is determined that the predetermined attribute person E exists in area B ("Yes” in step S02 of FIG. 4), the process moves to step S03. Further, if it is determined that the predetermined attribute person E does not exist in area B ("No" in step S02 of FIG. 4), the process moves to step S04.
  • step S03 it is determined whether a predetermined first condition is satisfied.
  • the first condition in this embodiment is that an abnormal state is detected by the person state detection unit 42.
  • the first condition may be, for example, that the state detection unit 41 has detected an abnormal state different from the predetermined state, or that the predetermined state has continued for a predetermined period of time (for example, 5 minutes). Also good.
  • step S05 If the first condition is satisfied ("Yes" in step S03 of FIG. 4), the process moves to step S05.
  • step S05 the signal transmitter 45 transmits the above-mentioned alarm signal to the alarm device 2. That is, in this case, the signal transmitter 45 activates the alarm device 2. Thereafter, this notification determination flow is temporarily terminated.
  • the state detection unit 41 detects the predetermined state and the determination unit 44 determines that the predetermined attribute person E exists in the area B, if the predetermined first condition is satisfied, the signal is transmitted.
  • the section 45 activates the alarm device 2.
  • step S03 of FIG. 4 If the first condition is not satisfied (“No” in step S03 of FIG. 4), this notification determination flow is temporarily terminated. Therefore, in this case, the signal transmitter 45 does not transmit the above-mentioned alarm signal to the alarm device 2. That is, in this case, the signal transmitter 45 does not activate the alarm device 2.
  • step S04 it is determined whether a predetermined second condition is satisfied.
  • the second condition in this embodiment is that the current time is included in a preset time zone.
  • the time period may be set, for example, by being input in advance according to the intention of the monitored person D or a contract regarding monitoring of the monitored person D (for example, an agreement regarding the monitoring time period), or may be set by a predetermined attribute. It may also be a time period during which the person E is caring for the person D, such as a time period when the person E wipes the body of the person D, or a time period when the person E is excreting the body.
  • the second condition may be, for example, that the time when the predetermined state is detected by the state detection unit 41 is included in a preset time period.
  • this notification determination flow is temporarily ended. Therefore, in this case, the signal transmitter 45 does not transmit the above-mentioned alarm signal to the alarm device 2. That is, in this case, the signal transmitter 45 does not activate the alarm device 2.
  • the signal The transmitter 45 does not activate the alarm device 2.
  • step S05 the signal transmitter 45 transmits the above-mentioned alarm signal to the alarm device 2. That is, in this case, the signal transmitter 45 activates the alarm device 2. Thereafter, this notification determination flow is temporarily terminated.
  • the state detection unit 41 detects the predetermined state (“Yes” in step S01 of FIG. 4), and the determination unit 44 determines that the predetermined attribute person E does not exist in area B. If the alarm is detected (“No” in step S02 of FIG. 4), the signal transmitter 45 transmits the alarm signal, except when the second condition is satisfied. That is, when the predetermined state is detected by the state detection section 41 and the determination section 44 determines that the predetermined attribute person E does not exist in the area B, the signal transmission section 45 activates the alarm device 2 . Further, when the state detection section 41 detects the predetermined state and the determination section 44 determines that the predetermined attribute person E does not exist in the area B, the signal transmission section 45 transmits an alarm signal to the outside.
  • the signal transmitter 45 does not transmit the alarm signal unless the first condition is satisfied. That is, when the predetermined state is detected by the state detection section 41 and the determination section 44 determines that the predetermined attribute person E is present in the area B, the signal transmission section 45 does not activate the alarm device 2. Furthermore, when the state detection section 41 detects the predetermined state and the determination section 44 determines that the predetermined attribute person E exists in the area B, the signal transmission section 45 does not transmit the alarm signal to the outside.
  • the monitoring device 1 when the person to be monitored D is in a predetermined state (for example, a fallen state), if the person E with the predetermined attribute is present in the area B where the person to be monitored D is present, The alarm signal is not transmitted from the monitoring device 1 to the alarm device 2. That is, the monitoring device 1 does not activate the alarm device 2.
  • a predetermined state for example, a fallen state
  • control unit 4 and each functional unit included in the control unit 4, such as the state detection unit 41 may be a physical device such as a microcomputer, or may be a functional unit in software. For example, by storing programs corresponding to each functional unit included in the control unit 4 in a ROM or non-volatile memory (not shown), and loading and executing these programs into the CPU, processes corresponding to each functional unit can be executed. It may also be a configuration that is executed.
  • the alarm device 2 when the monitored person D is in a predetermined state, if the predetermined attribute person E exists in the area B where the monitored person D exists, the alarm device 2 does not operate, and If the attribute person E does not exist, the alarm device 2 will be activated.
  • the person to be monitored D is a resident of a welfare facility for the elderly and the predetermined attribute is "being an attendant who provides assistance to the resident," the resident who is the person to be monitored D is When the resident falls down, for example, if an attendant is present in area B where the resident is present, the alarm device 2 will not operate.
  • a resident who is monitored person D is in a predetermined state (for example, a fallen state)
  • the alarm device 2 is activated. That is, it is possible to avoid a situation where the alarm is blocked due to the presence of another resident.
  • the monitoring method may be configured as a monitoring method in which the steps performed by each member in the above embodiments are performed in one or more steps.
  • a monitoring method includes a state detection step S11 corresponding to the state detection section 41, a determination step S12 corresponding to the determination section 44, and an alarming step S13 corresponding to the signal transmission section 45. It may be configured as
  • the alarm step S13 does not activate the alarm device 2 when the predetermined state is detected by the state detection step S11 and it is determined that the predetermined attribute person E exists in the area B by the determination step S12.
  • It may be configured as a monitoring program that causes a computer to realize the functions of each member in the above embodiment.
  • it may be configured as a monitoring program that causes a computer to implement a state acquisition function corresponding to the state detection section 41, a judgment function corresponding to the judgment section 44, and an alarm function corresponding to the signal transmission section 45. .
  • the status acquisition function is a function that acquires information indicating the status of the monitored person D.
  • the "information indicating the state of the monitored person D" may be a captured image acquired by the imaging unit 3, or may be a captured image that indicates the state of the monitored person D detected based on the captured image. It may also be information that indicates.
  • the alarm function activates the alarm device 2 when the state acquisition function acquires information indicating a predetermined state and the determination function determines that the person E with the predetermined attribute exists in area B.
  • This function activates the alarm device 2 when a predetermined state is detected by the state acquisition function and the determination function determines that the person E with the predetermined attribute does not exist in area B.
  • the monitoring program may be configured to be stored in, for example, a mobile terminal such as a smartphone, and executed on the mobile terminal.
  • the mobile terminal may be configured to function as an "alarming device" according to the present disclosure.
  • Some or all of the state detection unit 41, person state detection unit 42, specific object detection unit 43, determination unit 44, and signal transmission unit 45 are external to the monitoring device 1 (for example, used by a person E with a predetermined attribute). (such as a personal computer).
  • step S03 may not exist, and step S04 may not exist.
  • the sound detection device 5 may be included in the monitoring device 1.
  • the room entry detection device 6 and the room exit detection device 7 may be configured as devices that read IC cards worn by staff members.
  • the IC card corresponds to the "specific object" according to the present disclosure
  • both the room entry detection device 6 and the room exit detection device 7 correspond to the "detection unit" according to the present disclosure.
  • the monitoring device 1 or the monitoring system A may include a face information acquisition unit that acquires face information of a person.
  • the facial information corresponds to "biometric information” according to the present disclosure
  • the facial information acquisition section corresponds to the "biometric information acquisition section” according to the present disclosure.
  • the face information acquisition unit may be configured to acquire only one of the face information of a person entering area B and the face information of a person existing in area B, or may acquire both. It may be configured as follows. That is, the face information acquisition unit acquires at least one of the face information of a person entering area B and the face information of a person existing in area B.
  • the face information acquisition unit may acquire face information of a person present in area B, for example, based on the captured image acquired by the imaging unit 3.
  • the determination unit 44 may be configured to determine whether or not the predetermined attribute person E exists in the area B based on the face information acquired by the face information acquisition unit.
  • the imaging unit 3 may not be provided.
  • the state detection unit 41 may detect the state of the monitored person D, for example, based only on the information indicating the sound received from the sound detection device 5.
  • the specific object detection unit 43 may not be provided.
  • the determination unit 44 may determine whether or not the predetermined attribute person E exists in the area B, for example, based only on the biometric information acquired by the room entry detection device 6 and the room exit detection device 7.
  • the room entry detection device 6 and the room exit detection device 7 may not be provided.
  • the determination unit 44 may determine whether or not the predetermined attribute person E exists in the area B, for example, based only on the detection result by the specific object detection unit 43.
  • An input section may be provided through which the user can input information indicating whether or not an alarm is actually not required when the alarm device 2 is activated. Furthermore, if information indicating that the situation does not actually require alarming is input into the input section, various information (for example, the body position and position of person D to be monitored) when the alarm device 2 is activated
  • An information storage unit may be provided to store information indicating the time, time, etc.). Furthermore, the signal transmitting unit 45 determines that the current situation is the same at that time (when the alarm device 2 is activated even though the alarm is not required) based on the information stored in the information storage unit. ), and if it is determined that the situation is similar, the above-mentioned alarm signal may not be transmitted to the alarm device 2.
  • the present disclosure can be used not only in welfare facilities for the elderly but also in various facilities such as medical facilities and public facilities, and can also be used outdoors.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Engineering & Computer Science (AREA)
  • Gerontology & Geriatric Medicine (AREA)
  • Psychiatry (AREA)
  • Computer Security & Cryptography (AREA)
  • Alarm Systems (AREA)
  • Emergency Alarm Devices (AREA)
  • Debugging And Monitoring (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Closed-Circuit Television Systems (AREA)
PCT/JP2023/021999 2022-06-29 2023-06-14 監視システム、監視装置、監視方法及び監視プログラム Ceased WO2024004641A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP23831089.0A EP4550288A1 (en) 2022-06-29 2023-06-14 Monitoring system, monitoring device, monitoring method, and monitoring program
US19/001,622 US20250148892A1 (en) 2022-06-29 2024-12-26 Monitoring system, monitoring device, monitoring method, and monitoring program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-104858 2022-06-29
JP2022104858A JP7771002B2 (ja) 2022-06-29 2022-06-29 監視システム、監視装置、監視方法及び監視プログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US19/001,622 Continuation US20250148892A1 (en) 2022-06-29 2024-12-26 Monitoring system, monitoring device, monitoring method, and monitoring program

Publications (1)

Publication Number Publication Date
WO2024004641A1 true WO2024004641A1 (ja) 2024-01-04

Family

ID=89382066

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/021999 Ceased WO2024004641A1 (ja) 2022-06-29 2023-06-14 監視システム、監視装置、監視方法及び監視プログラム

Country Status (4)

Country Link
US (1) US20250148892A1 (https=)
EP (1) EP4550288A1 (https=)
JP (2) JP7771002B2 (https=)
WO (1) WO2024004641A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025253130A1 (en) * 2024-06-06 2025-12-11 Safehinge Primera Limited Identifying further information about a detected person in an indoor environment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009053797A (ja) * 2007-08-24 2009-03-12 Oki Electric Ind Co Ltd 近接状態推定装置、プログラム、近接状態推定方法、および近接状態推定システム
WO2017026218A1 (ja) * 2015-08-07 2017-02-16 コニカミノルタ株式会社 被監視者監視システム、被監視者監視装置および被監視者監視方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009053797A (ja) * 2007-08-24 2009-03-12 Oki Electric Ind Co Ltd 近接状態推定装置、プログラム、近接状態推定方法、および近接状態推定システム
WO2017026218A1 (ja) * 2015-08-07 2017-02-16 コニカミノルタ株式会社 被監視者監視システム、被監視者監視装置および被監視者監視方法
JP6123971B1 (ja) 2015-08-07 2017-05-10 コニカミノルタ株式会社 被監視者監視システム、被監視者監視装置および被監視者監視方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025253130A1 (en) * 2024-06-06 2025-12-11 Safehinge Primera Limited Identifying further information about a detected person in an indoor environment

Also Published As

Publication number Publication date
US20250148892A1 (en) 2025-05-08
EP4550288A1 (en) 2025-05-07
JP2026021481A (ja) 2026-02-10
JP2024004944A (ja) 2024-01-17
JP7771002B2 (ja) 2025-11-17

Similar Documents

Publication Publication Date Title
US10964199B2 (en) AI-based monitoring system for reducing a false alarm notification to a call center
US20150194034A1 (en) Systems and methods for detecting and/or responding to incapacitated person using video motion analytics
KR101492799B1 (ko) 감시영역 입퇴실자 추적을 통한 출입 통제 기능을 가지는 출입 통제 통합 영상 저장 시스템 및 그 방법
WO2020194370A1 (ja) 安否確認システム
CN109635631A (zh) 一种基于人工智能的消防值班室人员在岗识别方法
JP2026021481A (ja) 監視システム、監視装置、監視方法及び監視プログラム
JP2026021481A5 (https=)
EP3142089A2 (en) System arm notification based on ble position
JP2023128776A (ja) 監視システム、監視装置、監視方法及び監視プログラム
WO2021002293A1 (ja) 緊急対処方法、安否確認システム、管理装置、空間部、及び管理装置の制御方法
JP5363215B2 (ja) 警備システム
EP4005466A1 (en) Safety system and method for monitoring not self-sufficient persons
JP2013210927A (ja) 警備装置、及び警備方法
EP4334922B1 (en) Monitoring system and method for recognizing the activity of determined persons
EP3109837A1 (en) System and method of smart incident analysis in control system using floor maps
JP7025609B2 (ja) モニタリングシステム及びモニタリングシステムに用いられる制御装置
CN114863637B (zh) 一种酒店安全管理系统及方法
WO2020170643A1 (ja) 情報処理装置、情報処理システム、および情報処理方法、並びにプログラム
JP2016113238A (ja) エレベータ制御装置及びその制御方法
JP2022018571A (ja) 入場監視装置、及び入場監視方法
US20260065766A1 (en) A method of and a device for operating a fall detection system and a fall detection system
JP7807958B2 (ja) 警備システム、警備方法およびプログラム
JP2011034136A (ja) 警備システム
JP5487076B2 (ja) 院内管理システム
EP3048513A1 (en) A method to invoke backup input operation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23831089

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023831089

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2023831089

Country of ref document: EP

Effective date: 20250129

WWP Wipo information: published in national office

Ref document number: 2023831089

Country of ref document: EP