JP2020013185A - Watching device and watching device control program - Google Patents

Abstract

To provide a watching device for suppressing a violent behavior or the like in a facility.SOLUTION: A watching device includes an information acquisition section 111, an event determination section 113, and an event notification section 114. The information acquisition section 111 acquires information related to an object person. The event determination section 113 determines whether or not a predetermined event related to multiple persons including an object person has occurred on the basis of information acquired by the information acquisition section 111. When the event determination section 113 determines that a predetermined event related to multiple persons has occurred, the event notification section 114 notifies of occurrence of the predetermined event related to the multiple persons.SELECTED DRAWING: Figure 10

Description

  The present invention relates to a watching device and a control program for the watching device.

  In Japan, the prolongation of life has become remarkable due to the improvement of living standards, the improvement of sanitary conditions, and the improvement of medical standards accompanying the high economic growth after the war. For this reason, coupled with a decrease in the birth rate, the aging society has a high aging rate. In such an aging society, an increase in the number of care recipients who need nursing care is expected due to illness, injury, and aging.

  There is a risk that a target person, such as a care recipient, may fall during walking or fall from a bed and be injured in a facility such as a hospital or a welfare facility for the elderly. For this reason, a system for detecting the state of the subject has been developed so that a caregiver, a nurse, or the like can immediately rush when the subject is in such a state.

  As such a system, in the nurse call system disclosed in Patent Literature 1, it is determined whether or not the patient has woken or woken up from a captured image of a camera installed on the patient's bed. Then, when the user wakes up or gets out of the bed, an image captured by the camera is displayed on the nurse call master provided at the nurse station.

JP 2014-90913 A

  However, the system disclosed in Patent Literature 1 cannot monitor actions other than the actions of the patient. In recent years, inappropriate acts such as violence and abuse (hereinafter collectively referred to as “violent acts”) have become a problem in facilities such as welfare facilities for the elderly. However, the system disclosed in Patent Document 1 However, there is a problem that such violent acts cannot be deterred.

  The present invention has been made in view of the above-mentioned problems. Therefore, an object of the present invention is to provide a watching device that suppresses violence in a facility and a control program for the watching device.

  The above object of the present invention is achieved by the following means.

  (1) A monitoring device that notifies the occurrence of a predetermined event regarding a target person to be monitored, based on an information acquisition unit that acquires information about the target person, based on the information acquired by the information acquisition unit. An event determination unit that determines whether a predetermined event related to a plurality of persons including the target person has occurred; and if the event determination unit determines that the predetermined event related to the plurality of people has occurred, the plurality of persons A monitoring device having an event notification unit configured to notify occurrence of a predetermined event related to the monitoring.

  (2) The information acquisition unit acquires an image related to the target person, and the event determination unit determines whether a predetermined event related to the plurality of persons has occurred based on the image acquired by the information acquisition unit. The watching device according to the above (1), which determines whether or not the watching is performed.

  (3) the event determination unit confirms a moving speed of an edge of an area of at least one of the plurality of persons including the target person, which is extracted in the image acquired by the information acquisition unit; When the moving speed of at least a part of the edge is equal to or higher than a predetermined speed, it is determined that a predetermined event regarding the plurality of persons has occurred, and when the moving speed of at least a part of the edge is lower than the predetermined speed. The watching device according to (2), wherein it is determined that the predetermined event relating to the plurality of persons has not occurred.

  (4) The event determination unit checks a trajectory of an edge of an area of at least one of the plurality of persons including the target person, which is extracted from the image acquired by the information acquisition unit. When at least a part of the edge repeatedly moves in a predetermined area, it is determined that a predetermined event relating to the plurality of people has occurred. When at least a part of the edge does not repeatedly move in the predetermined area, the plurality of edges are determined. The watching device according to (2) or (3), wherein it is determined that a predetermined event relating to a person has not occurred.

  (5) The information acquisition unit acquires sound information about the target person, and the event determination unit generates a predetermined event related to the plurality of persons based on the sound information acquired by the information acquisition unit. The watching device according to any one of the above (1) to (4), which determines whether or not the monitoring has occurred.

  (6) The event determining unit confirms a level of a sound generated from at least one of the plurality of persons including the subject based on the information on the sound acquired by the information acquiring unit, and If the level of the sound is equal to or higher than a predetermined level, it is determined that a predetermined event relating to the plurality of persons has occurred.If the level of the sound is lower than the predetermined level, a predetermined event relating to the plurality of persons has occurred. The watching device according to the above (5), wherein the watching device is determined not to exist.

  (7) The event determination unit confirms, based on the information of the sound acquired by the information acquisition unit, the content of a sound emitted by at least one of the plurality of persons including the target person, and If the content is a predetermined content, it is determined that a predetermined event related to the plurality of people has occurred.If the content of the voice is not the predetermined content, it is determined that a predetermined event related to the plurality of people has not occurred. The watching device according to the above (5) or (6).

  (8) further comprising: a plurality of persons judging section for judging whether or not the plurality of persons are present in the image concerning the target person acquired by the information acquiring section, wherein the event judging section comprises: If it is determined that the plurality of persons are not shown in the image, the type of the predetermined event to be determined is set to the predetermined event related to the target person, and whether the predetermined event related to the target person has occurred And if it is determined that the plurality of people are reflected in the image by the plurality of people determination unit, the type of the predetermined event to be determined is set to a predetermined event related to the plurality of people, The watching device according to any one of the above (1) to (7), which determines whether a predetermined event relating to a plurality of people has occurred.

  (9) The event determination unit executes both a predetermined event determination process for the subject and a predetermined event determination process for the plurality of people, and performs a predetermined event for the subject and a predetermined event for the plurality of people. The watching device according to any one of the above (1) to (7), which determines whether or not the event (1) has occurred.

  (10) When the event determining unit determines that the predetermined event has occurred, the moving image for a predetermined time including the occurrence time of the predetermined event acquired by the information acquiring unit is stored in the storage unit. The watching device according to any one of (1) to (9), further including a moving image processing unit for storing the moving image processing unit.

  (11) The event notification unit, when the event determination unit determines that the predetermined event related to the plurality of people has occurred, sets the occurrence of the predetermined event related to the plurality of people as the occurrence of the predetermined event related to the target person. The watching device according to any one of the above (1) to (10) for notifying.

  (12) When the event notification unit notifies the occurrence of the predetermined event related to the plurality of persons as the occurrence of the predetermined event related to the target person, the occurrence of the predetermined event regarding the plurality of persons is the predetermined event related to the target person. The monitoring device according to the above (11), wherein the notification is performed by adding information indicating that the notification is made as the occurrence of the notification.

  (13) The event notification unit, when the event determination unit determines that the predetermined event related to the plurality of people has occurred, causes the sound output unit capable of outputting a sound to output a sound calling attention, The watching device according to any one of (1) to (12), which notifies occurrence of a predetermined event relating to a plurality of persons.

  (14) A control program for a watching device that notifies the occurrence of a predetermined event relating to a target person to be monitored, based on an obtaining step of obtaining information on the target person, and based on the information obtained in the obtaining step. A determining step of determining whether a predetermined event relating to a plurality of persons including the target person has occurred; and determining that the predetermined event relating to the plurality of persons has occurred in the determining step. A control program for causing a computer to execute a process including a notifying step of notifying occurrence of a predetermined event.

  According to the watching device of the present invention, it is determined whether or not a predetermined event relating to a plurality of persons including the target person has occurred based on the acquired information regarding the target person. When it is determined that a predetermined event relating to a plurality of persons has occurred, the occurrence of the event is notified. As a result, violence as a predetermined event relating to a plurality of persons is monitored without using a separate monitoring camera or the like, and violence or the like in the facility is suppressed.

It is a figure showing the whole composition of the watching system concerning one embodiment of the present invention. FIG. 3 is a block diagram illustrating a hardware configuration of a detection unit. It is a figure which shows an example of the detection part installed in the living room of the target person. FIG. 3 is a block diagram illustrating a functional configuration of a control unit of the detection unit. FIG. 2 is a block diagram illustrating a hardware configuration of a server. FIG. 3 is a block diagram illustrating a functional configuration of a control unit of the server. FIG. 2 is a block diagram illustrating a hardware configuration of the mobile terminal. FIG. 3 is a block diagram illustrating a functional configuration of a control unit of the mobile terminal. It is a figure for explaining an example of judgment processing of violent acts etc. It is a flowchart which shows the procedure of the process which concerns on 1st Embodiment. It is a flow chart which shows the procedure of processing concerning a 2nd embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the description of the drawings, the same elements will be denoted by the same reference symbols, without redundant description. In addition, the dimensional ratios in the drawings are exaggerated for convenience of description, and may be different from the actual ratios.

(overall structure)
FIG. 1 is a diagram showing an entire configuration of a watching system according to an embodiment of the present invention.

  As shown in FIG. 1, the watching system 1 is a system for watching (monitoring) a target person 60 to be monitored (monitored). The watching system 1 includes, for example, one or more detection units 10, a server 20, a fixed terminal 30, and one or more mobile terminals 40, as shown in FIG. The watching device according to an embodiment of the present invention may be configured by one device, or may be configured by two or more devices. For example, the monitoring device may be configured by at least one of the detection unit 10 and the server 20. Is also good.

  The components of the watching system 1 are communicably connected to each other via a network 50 such as a LAN (Local Area Network), a telephone network, or a data communication network by wire and / or wirelessly. The network 50 may include a repeater that relays communication signals, a bridge, and a repeater such as a router or a cross-connect. In the example illustrated in FIG. 1, the plurality of detection units 10, the server 20, the fixed terminal 30, and the mobile terminal 40 are connected to a wired or wireless LAN (for example, a LAN according to the IEEE 802.11 standard) including an access point 51. By 50, they are communicably connected to each other. The network 50 configures a so-called intranet by using an Internet protocol group such as a Transmission Control Protocol (TCP) and an Internet Protocol (IP).

  The watching system 1 is provided at an appropriate place according to the target person 60. The target person 60 is, for example, a person who needs nursing due to illness or injury, a person who needs nursing care due to a decrease in physical ability due to the elderly, a single person living alone, and the like. In particular, from the viewpoint of enabling early detection and early coping, the target person 60 may be a person who needs to be found when a predetermined inconvenient event such as an abnormal state occurs in the person. For this reason, the watching system 1 is suitably installed in a building such as a hospital, a welfare facility for the aged, and dwelling units according to the type of the target person 60. In the example illustrated in FIG. 1, the watching system 1 is arranged in a plurality of rooms (rooms) in which a plurality of subjects 60 enter, or in a building of a facility including a plurality of rooms such as a nurse station. In addition, the detection unit 10 is arranged in each of a plurality of rooms in which a plurality of subjects 60 enter, and in the example shown in FIG. 1, rooms A, B, C, and D of the subjects 60 (unsuitable rooms). (Shown).

  However, the position, the number, and the like of each component included in the watching system 1 are not limited to the example illustrated in FIG. For example, a plurality of target persons 60 may enter one room, and a plurality of detection units 10 may be arranged for each bed of target person 60.

  In the example illustrated in FIG. 1, the server 20 is located at a nurse station in the same building as the room of the subject 60, but may be located at a remote location as an external server connected to the network 50. Good. Further, the server 20 may be a cloud server virtually constructed by a plurality of servers connected to a network such as the Internet.

  In addition, in the example illustrated in FIG. 1, the watching system 1 includes two types of devices, the fixed terminal 30 and the mobile terminal 40, as terminal devices, but may include only one type of device. The fixed terminal 30 and the portable terminal 40 are different from the fixed terminal 30 in that the portable terminal 40 is carried by a user such as a caregiver or a nurse (hereinafter referred to as “staff 70”) while the fixed terminal 30 is fixedly operated. Different. However, since the fixed terminal 30 and the mobile terminal 40 have the same configuration, in the following description of each component, the mobile terminal 40 will be mainly described.

(Detection unit 10)
FIG. 2 is a block diagram illustrating a hardware configuration of the detection unit. FIG. 3 is a diagram illustrating an example of the detection unit installed in the room of the subject.

  The detection unit 10 is a device that notifies occurrence of a predetermined event (event) relating to the target person 60. The predetermined event is an event that needs to be dealt with, and includes, for example, a predetermined predetermined action in the target person 60, a nurse call (care call) by the target person 60, and the like. As shown in FIG. 2, the detection unit 10 includes a control unit 11, a storage unit 12, a communication unit 13, a photographing unit 14, a sound input / output unit (sound input unit and sound output unit) 15, and a nurse call input unit 16. . The components are interconnected via a bus for exchanging signals. As shown in FIG. 3, the detection unit 10 including the imaging unit 14, the sound input / output unit 15, and the nurse call input unit 16 is arranged around the bed of the subject 60 in the room of the subject 60.

  The control unit 11 includes a CPU (Central Processing Unit), and controls the above-described components and executes various arithmetic processes according to a program. The functional configuration of the control unit 11 will be described later with reference to FIG.

  The storage unit 12 includes a ROM (Read Only Memory) for storing various programs and various data in advance, a RAM (Random Access Memory) for temporarily storing programs and data as a work area, and a hard disk for storing various programs and various data. Is provided. The various programs include, for example, programs such as a control program that controls each unit of the detection unit 10 according to the function of each unit and a monitoring processing program that executes a predetermined monitoring process on the target person 60. The various data includes, for example, data necessary for executing each program, such as a sensor ID which is an identifier for identifying and identifying the detection unit 10 of the own device, a communication address of the server 20, and the like.

  The communication unit 13 includes a communication interface circuit for communicating with other devices such as the server 20, the fixed terminal 30, and the mobile terminal 40 via the network 50. The communication unit 13 may include a wired communication interface based on a standard such as Ethernet (registered trademark), a wireless communication interface based on a standard such as IEEE 802.11 (registered trademark) or Bluetooth (registered trademark), or the like.

  The photographing unit 14 includes a device that outputs a photographed image (image data). The image includes at least one of a still image and a moving image. The imaging unit 14 is disposed, for example, on a ceiling or an upper part of a wall of the living room of the subject 60 to monitor the space where the subject 60 is located, and captures an image of the space where the subject 60 is overhead viewed from above. . The photographing unit 14 photographs the space where the subject 60 is located from above a position (for example, a pillow position) where the head of the subject 60 is expected to be located on the bed on which the subject 60 lies. May be arranged.

  The image capturing unit 14 may be a device that generates a visible light image, or may be a device that generates an infrared image so that the target person 60 can be monitored even in a relatively dark place. That is, the photographing unit 14 may include a visible light camera, an infrared camera, or a camera using them in combination. The imaging optical system of the imaging unit 14 may include a wide-angle optical system (a so-called wide-angle lens including a fish-eye lens) having an angle of view capable of imaging the entire living room in which the imaging unit 14 is arranged.

  The sound input / output unit 15 includes a circuit for outputting a sound corresponding to the electric signal generated by the control unit 11 and receiving an input of an external sound. The sound input / output unit 15 includes, for example, a speaker and a microphone. The sound input / output unit 15 is disposed, for example, together with the imaging unit 14 on a ceiling or an upper portion of a wall of the room of the subject 60 to monitor the space where the subject 60 is located, and outputs the sound in the space where the subject 60 is located. Accept input.

  The nurse call input unit 16 includes a switch circuit such as a push button switch for receiving a nurse call input. The nurse call input unit 16 may be connected to the control unit 11 by a wire, or may be connected to the control unit 11 by wireless communication based on a standard such as Bluetooth (registered trademark). The nurse call input unit 16 may receive an input of a nurse call based on the voice input to the sound input / output unit 15.

  Note that the detection unit 10 detects the Doppler shift of the microwave caused by the body motion (for example, the respiratory motion) of the subject 60 by transmitting and receiving the microwave toward the direction of the bed of the subject 60. A body movement sensor of a type may be further provided. The body movement sensor detects body movement (up and down movement) of the chest accompanying the breathing movement of the subject 60, and when there is a disturbance in the cycle of the body movement or when the amplitude in the body movement is equal to or less than a preset threshold. And the like, to detect an abnormal micro-body movement.

  FIG. 4 is a block diagram illustrating a functional configuration of a control unit of the detection unit.

  The control unit 11 reads the program and executes the processing, whereby the information acquisition unit 111, the multiple-person determination unit 112, the event determination unit 113, the event notification unit 114, the video processing unit 115, the call processing unit 116, and the streaming distribution unit It functions as 117. Note that at least a part of the function of the control unit 11 may be realized by a built-in processing circuit.

  The information acquisition unit 111 acquires information about the target person 60. The information acquiring unit 111 acquires, for example, an image of the subject 60 photographed by the photographing unit 14, that is, an image of the space where the subject 60 is located. In addition, the information acquisition unit 111 acquires, for example, sound information regarding the subject 60 input to the sound input / output unit 15, that is, information about a sound generated in the space where the subject 60 is located. In addition, the information acquisition unit 111 acquires the information of the nurse call by the subject 60 input to the nurse call input unit 16 or is detected by the body motion sensor when the detection unit 10 includes the body motion sensor. You may acquire the information of the abnormal body motion in the subject 60.

  The multiple-person determination unit 112 determines whether a plurality of persons are included in the image acquired by the information acquisition unit 111. More specifically, the multiple-person determination unit 112 extracts a person area (hereinafter, referred to as a “person area”) in the image, and, when the number of extracted human areas is plural (two or more), It is determined that a plurality of people are shown in the image. On the other hand, when the number of extracted human regions is one or less, the multiple-person determination unit 112 determines that the image does not include a plurality of people.

  The human region is, for example, a region within the outline of the person (hereinafter, referred to as a “person silhouette”) or a rectangular region circumscribing the outline of the person (hereinafter, referred to as a “person rectangle”). The human region may be extracted by a time difference method that extracts a difference between images whose shooting times are before and after, or may be extracted by a background difference method that extracts a difference between a shot image and a background image. Since the size of the human region is considered to be equal to or larger than the predetermined first size and equal to or smaller than the predetermined second size, the multiple person determination unit 112 sets the first size set based on a plurality of samples in advance. The human area may be extracted based on the second size. That is, the multiple-person determination unit 112 extracts, as the human area, an area having a size equal to or larger than the first size and equal to or smaller than the second size from among the candidate areas of the human area, and sets an area smaller than the first size or larger than the second size. It does not have to be extracted as a human area.

  The event determination unit 113 determines whether a predetermined event related to the target person 60 (hereinafter, referred to as “target person event”) has occurred. The event determination unit 113 determines whether or not a target person event has occurred based on, for example, the image regarding the target person 60 acquired by the information acquisition unit 111. The target person event includes, for example, a predetermined behavior of the target person 60 set in advance. The predetermined action in the target person 60 includes, for example, the action of the target person 60 getting up from the bed, getting out of the bed, getting off the bed, falling down from the bed, and falling down on the floor or the like. Including.

  The event determination unit 113 determines a predetermined event in the target person 60 as a target event based on a temporal change of the human area of the target person 60 extracted in the image related to the target person 60 acquired by the information acquisition unit 111, for example. It is determined whether an action has occurred. Further, the event determination unit 113 extracts a region of the head of the subject 60 (hereinafter, referred to as “head region”) in the image, and generates a subject event based on a temporal change of the extracted head region. It may be determined whether or not it has been performed. The head region is, for example, a region within the outline of the head or a rectangular region circumscribing the outline of the head. The head region may be extracted by a circular or elliptical Hough transform, pattern matching using a prepared head model, a neural network learned for detecting the head region, or the like. The head region may be extracted as a substantially circular region having a relatively high reflectance to near infrared rays.

  More specifically, a first threshold value Th1 for identifying (1) the bed location area, and (2) the size of the head area in the lying posture and the size of the head area in the sitting posture in the bed location area. (3) a second threshold value Th2 for identifying the size of the head region in the standing position in the living room excluding the bed region, and (4) a head in the reclining position in the living room excluding the bed region. It is assumed that information regarding the third threshold value Th3 and the like for identifying the size of the area is stored in the storage unit 12 in advance. For example, the event determination unit 113 determines that the position of the head region is within the region where the bed is located, and the size of the head region changes from the lying posture size to the sitting posture size based on the first threshold Th1. In this case, it is determined that the wake-up event has occurred. In addition, the event determination unit 113 determines that the size of the head region is based on the second threshold Th2, for example, when the position of the head region has changed from within the bed location region to outside the bed location region. It is determined that an event of leaving the bed has occurred when the size has changed from the size of the standing posture to the size of the standing posture. Further, the event determination unit 113 may determine that the size of the head region is based on the third threshold value Th3, for example, when the position of the head region has changed from within the bed location region to outside the bed location region. In the case where the size has changed from the size to the recumbent posture, it is determined that a falling event has occurred. In addition, the event determination unit 113 determines that the position of the head region is in a living room excluding the region where the bed is located, and the size of the head region is changed from a certain size to the recumbent posture based on the third threshold Th3. If the size has changed, it is determined that a fall event has occurred.

  In addition, the target person event may further include a nurse call by the target person 60, an abnormal body movement in the target person 60, and the like. In this case, the event determination unit 113 may further determine whether or not an event such as a nurse call or a slight body movement abnormality has occurred as the subject event based on the information acquired by the information acquisition unit 111. .

  Further, the event determination unit 113 further determines whether or not a predetermined event relating to a plurality of persons including the target person 60 (hereinafter, referred to as “multiple persons event”) has occurred. The event determination unit 113 determines, for example, whether or not a multi-person event has occurred based on the information on the target person 60 acquired by the information acquisition unit 111, that is, information on the image or sound about the target person 60. The multi-person event includes a predetermined behavior of a plurality of persons including the target person 60, and includes, for example, inappropriate acts such as violence and abuse (violent acts and the like). Examples of violent acts by a plurality of persons include, for example, violent acts by the staff 70 against the target person 60, violent acts by the target person 60 on the staff 70, and violent acts between the target persons 60. Further, the violent acts include not only physical violent acts, but also mental violent acts such as abusive or ranting. Details of the determination process of violent acts will be described later with reference to FIG.

  The event notification unit 114 notifies the server 20 or the like when the event determination unit 113 determines that the subject event or the multi-person event has occurred. For example, when the event determining unit 113 determines that the subject event has occurred, the event notifying unit 114 notifies the server 20 of the occurrence of the subject event. Alternatively, the event notification unit 114 notifies the server 20 of the occurrence of the multi-person event when the event determination unit 113 determines that the multi-person event has occurred.

  More specifically, the event notification unit 114 transmits a first event notification including the sensor ID of the own device (the detection unit 10) and event information indicating an event that has occurred to the server 20 via the communication unit 13. I do. The event information is, for example, information on a target person event or a multi-person event. The event notification unit 114 sends the image (at least one of a still image and a moving image) used for the determination to the server when the event determination unit 113 determines that the predetermined action has occurred in the target person 60 or a plurality of persons. 20 may be further transmitted.

  The moving image processing unit 115 transmits the moving image captured by the image capturing unit 14 and acquired by the information acquiring unit 111 to the server 20. More specifically, the moving image processing unit 115 sequentially generates a moving image signal including the moving image by a predetermined number of frames, and sequentially transmits the generated moving image signal to the server 20 together with its own sensor ID. When the event determination unit 113 determines that the target person event or the multi-person event has occurred, the moving image processing unit 115 performs a predetermined first time (for example, several seconds to several minutes) including the event occurrence time. The moving image may be transmitted to the server 20. In other words, the moving image processing unit 115 converts the moving image before the event occurrence time and the moving image after the event occurrence time temporarily stored in the storage unit 12 into the server 20 as a predetermined first time moving image. May be sent. Alternatively, the moving image processing unit 115 may constantly transmit the moving image to the server 20. The moving image processing unit 115 may instruct the server 20 to store the transmitted moving image in the storage unit 22 of the server 20.

  The call processing unit 116 enables a voice call between the detection unit 10 and the fixed terminal 30 or the mobile terminal 40 by controlling the sound input / output unit 15. The call processing unit 116 enables a voice call with the fixed terminal 30 or the mobile terminal 40 via the communication unit 13 by VoIP (Voice over Internet Protocol) or the like.

  The streaming distribution unit 117 distributes a moving image (for example, a live video) captured by the image capturing unit 14 and acquired by the information acquiring unit 111 to the fixed terminal 30 or the mobile terminal 40 by streaming. For example, when there is a request for distribution of a moving image from the fixed terminal 30 or the mobile terminal 40, the streaming distribution unit 117 distributes the moving image to the fixed terminal 30 or the mobile terminal 40 via the communication unit 13.

(Server 20)
FIG. 5 is a block diagram illustrating a hardware configuration of the server.

  The server 20 is a device that manages the entire monitoring system 1. The server 20 is configured by, for example, a computer having a communication function. As shown in FIG. 5, the server 20 includes a control unit 21, a storage unit (database) 22, and a communication unit 23. The components are interconnected via a bus for exchanging signals. Each component of the server 20 has the same configuration as each component of the detection unit 10, and a description thereof will be omitted. The functional configuration of the control unit 21 will be described with reference to FIG.

  FIG. 6 is a block diagram illustrating a functional configuration of a control unit of the server.

  The control unit 21 functions as the monitoring processing unit 211, the event notification unit 212, and the moving image processing unit 213 by reading the program and executing the processing.

  When receiving the first event notification from the detection unit 10, the monitoring processing unit 211 uses the information included in the first event notification as information related to monitoring the target person 60 (hereinafter, referred to as “monitoring information”), and stores the information in the storage unit 22. To memorize. The monitoring processing unit 211 associates, for example, identification information of the target person 60, event information, an image used for determination of a predetermined action, a reception time of the first event notification, and the like with each other as monitoring information. 22. When the first event notification includes information on the event occurrence time, the monitoring processing unit 211 may cause the storage unit 22 to store the event occurrence time instead of the reception time of the first event notification.

  The correspondence between the sensor ID of the detection unit 10, the location of the detection unit 10 (such as the number of the living room where the detection unit 10 is disposed), and the name of the subject 60 monitored by the detection unit 10 is stored in advance in the storage unit. 22 may be stored. In this case, the monitoring processing unit 211 uses at least one of the sensor ID of the detection unit 10, the location of the detection unit 10, and the name of the target person 60 monitored by the detection unit 10 as the identification information of the target person 60. , May be stored in the storage unit 22. In addition, the subject 60 may carry an IC tag, and the monitoring processing unit 211 uses the information of the IC tag read by an RFID reader or the like installed in the room of the subject 60 as identification information of the subject 60. May be stored in the storage unit 22.

  When receiving the first event notification from the detection unit 10, the event notification unit 212 notifies at least one of the fixed terminal 30 and the mobile terminal 40. More specifically, the event notification unit 212 transmits the second event notification including the identification information of the target person 60, the event information, and the image used for the determination of the predetermined action as described above to the communication unit 23. To at least one of the fixed terminal 30 and the portable terminal 40. The event notification unit 212 may notify all of the fixed terminal 30 and the portable terminal 40 connected to the network 50, or may notify only some of them. The correspondence between the sensor ID of the detection unit 10 that is the transmission source of the first event notification and the terminal IDs that are the IDs of the fixed terminal 30 and the mobile terminal 40 that are the transmission destinations of the second event notification is stored in the storage unit 22 in advance. It may be stored. In this case, the event notification unit 212 may select at least one of the fixed terminal 30 and the mobile terminal 40 corresponding to the detection unit 10 that has transmitted the first event notification as the notification destination.

  Note that the second event notification may further include a communication address or the like as a download destination of the moving image acquired by the detection unit 10 that has transmitted the first event notification. The event notification unit 212 may select a communication address corresponding to the detection unit 10 that has transmitted the first event notification as the communication address.

  The moving image processing unit 213 causes the storage unit 22 to store the moving image received from the detecting unit 10. More specifically, the moving image processing unit 213 collects the moving images included in the series of moving image signals received from the moving image processing unit 115 of the detection unit 10 into a single first time (for example, several seconds to several seconds). For example, a moving image file for minutes) is generated and stored in the storage unit 22.

  When the moving image is constantly transmitted from the detecting unit 10, the moving image processing unit 213 determines whether the moving image is transmitted for a predetermined second time (for example, several seconds, several minutes, several hours, several days, several weeks, several months, or the like). ) May be temporarily stored in the storage unit 22. Then, when receiving the first event notification from the detection unit 10, the moving image processing unit 213 determines the predetermined event including the event occurrence time from the moving image for the predetermined second time temporarily stored in the storage unit 22. The moving image for the first hour may be cut out and stored in the storage unit 22. When the temporary storage time of the moving image exceeds the predetermined second time, the moving image processing unit 213 causes the moving image with the oldest time stamp to be overwritten in order, but not to overwrite the moving image for the predetermined first time. The unit 22 may be controlled.

(Fixed terminal 30, portable terminal 40)
The fixed terminal 30 and the mobile terminal 40 are devices that function as a user interface of the watching system 1. The fixed terminal 30 is configured by, for example, a computer with a communication function. The fixed terminal 30 may be a terminal used by an administrator of the watching system 1 or a person in charge of the staff 70. In addition, the fixed terminal 30 may receive an input such as the sensor ID of the detection unit 10, the location of the detection unit 10, and the correspondence between the name of the subject 60 and the like, and transmits information about the received input to the server 20. , May be stored in the server 20. Note that the fixed terminal 30 as an example of the terminal device has a configuration similar to that of a mobile terminal 40 described later, and a description of the components of the fixed terminal 30 will be omitted.

  FIG. 7 is a block diagram illustrating a hardware configuration of the mobile terminal.

  The mobile terminal 40 is configured by a portable communication terminal device such as a tablet computer, a smartphone, or a mobile phone. As shown in FIG. 7, the mobile terminal 40 includes a control unit 41, a storage unit 42, a communication unit (wireless communication unit) 43, a display unit 44, an operation input unit 45, a sound input / output unit 46, and an interface unit 47. The components are interconnected via a bus for exchanging signals. The control unit 41, the storage unit 42, the communication unit 43, and the sound input / output unit 46 have the same configuration as each component of the detection unit 10, and thus the description is omitted. The functional configuration of the control unit 41 will be described later with reference to FIG.

  The display unit 44 includes a display device such as an LCD (liquid crystal display) or an organic EL display. The display unit 44 displays the monitoring information of the subject 60 included in the second event notification received from the server 20, an operation screen for the monitoring information, the content of the operation input in the operation input unit 45, and the like.

  The operation input unit 45 includes a device that receives an input of a predetermined operation. The predetermined operation is, for example, an operation of inputting a login ID and a password, an operation of requesting and ending a voice call with the target person 60, an operation of requesting and ending a live video distribution of the target person 60, and receiving a notification. The operation includes various operations such as an operation of confirming the event and an input operation of responding to the target person 60 that has caused the event. The response to the target person 60 includes, for example, various responses such as lifesaving, nursing, care, and assistance.

  The display unit 44 and the operation input unit 45 may constitute a touch panel by superimposing a touch detection unit as the operation input unit 45 on a display surface of an LCD as the display unit 44.

  The interface unit 47 includes a circuit that inputs and outputs data to and from an external device. The interface unit 47 includes an interface circuit using infrared communication such as the Bluetooth (registered trademark) standard or the IrDA standard, or the USB standard. Note that the interface unit 47 may be included in the communication unit 43.

  FIG. 8 is a block diagram illustrating a functional configuration of a control unit of the mobile terminal.

  The control unit 41 functions as a monitoring processing unit 411, a call processing unit 412, and a streaming reproduction unit 413 by reading the program and executing the processing.

  When receiving the second event notification from the server 20, the monitoring processing unit 411 causes the storage unit 42 to store the information included in the second event notification, or causes the display unit 44 to display the information. More specifically, the monitoring processing unit 411 stores, for example, the identification information of the target person 60, the event information, the image used for the determination of the predetermined action, the reception time of the second event notification, and the like in the storage unit 42. It is stored or displayed on the display unit 44. When the second event notification includes information on the event occurrence time, the monitoring processing unit 411 stores the event occurrence time in the storage unit 42 instead of the reception time of the second event notification, or displays the display unit 44 May be displayed.

  When the operation input unit 45 receives an input of a predetermined operation with respect to the information included in the second event notification displayed on the display unit 44, the monitoring processing unit 411 performs a predetermined operation corresponding to the operation. Execute the process. The monitoring processing unit 411 notifies the server 20 when, for example, an input operation for responding to the target person 60 that has caused the event is received in the operation input unit 45. In this case, the server 20 associates the information indicating that the input to perform the response to the target person 60 has been received with the event information of the target person 60 stored in the storage unit 22 and associates the information with the storage unit 22. May be stored.

  When a request operation for a voice call is received by the operation input unit 45, the call processing unit 412 controls the sound input / output unit 46 to enable a voice call with the detection unit 10. The call processing unit 412 enables a voice call with the detection unit 10 that has transmitted the first event notification to the server 20 via the communication unit 43 by VoIP or the like, for example.

  The streaming reproduction unit 413 performs streaming reproduction of the moving image distributed from the detection unit 10 and causes the display unit 44 to display the moving image. More specifically, the streaming reproduction unit 413 performs streaming reproduction of the moving image distributed from the streaming distribution unit 117 of the detection unit 10 in response to a live video distribution request operation received at the operation input unit 45, and displays the moving image. It is displayed on the unit 44.

  Note that the detection unit 10, the server 20, the fixed terminal 30, and the mobile terminal 40 may include components other than the above-described components, or may not include some of the above-described components. For example, the server 20 may further include an input unit that receives inputs of various commands and various data as needed.

(Judgment processing of violent acts, etc.)
Hereinafter, determination processing of violent acts as a multiple-person event will be described in detail. The event determination unit 113 determines whether or not violence has occurred by performing at least one of the following determination processes based on the image or sound information about the subject 60 acquired by the information acquisition unit 111. I do.

(1) Image Determination Process The event determination unit 113 determines, for example, whether or not violence has occurred based on an image of the subject 60 captured by the imaging unit 14 and acquired by the information acquisition unit 111. More specifically, for example, the event determination unit 113 extracts at least one person region (a person silhouette or a person rectangle) among a plurality of persons including the target person 60 extracted from the image acquired by the information acquisition unit 111. The presence or absence of violence or the like is determined based on the time change of.

  FIG. 9 is a diagram for explaining an example of a determination process of a violent act or the like.

  (A) and (b) of FIG. 9 show the temporal change of the person rectangle of the staff member 70 in the standing posture in the living room excluding the bed area, which is extracted from the image acquired by the information acquiring unit 111. I have. (B) is a human rectangle extracted immediately after (a) or after several samples, for example. Note that the image acquired by the information acquisition unit 111 includes a person other than the staff 70 (for example, the subject 60). However, in FIG. Shall be shown.

(A) Judgment Process Based on Moving Speed of Edge in Human Area A person who performs violence or the like is likely to vigorously swing up or down his arms or legs when hitting or kicking. That is, at least a part of the edge of the person rectangle corresponding to the tip of the hand or foot of the person who performs violence or the like is likely to move at high speed. For example, as shown in FIG. 9, when the staff 70 hits the target person 60, the dashed line portion E, which is the edge of the person rectangle corresponding to the hand of the staff 70, is swung down from the (a) to (b). ) Is likely to move quickly (in the direction of the arrow).

  For this reason, the event determination unit 113 determines, as the time change of the human region, for example, the edge of the edge of at least one of a plurality of persons including the target person 60 extracted in the image acquired by the information acquisition unit 111. Check the moving speed. The event determination unit 113 calculates the moving speed of the edge based on the moving amount of the edge and the moving time of the edge, for example. Then, for example, when the moving speed of at least a part of the edge is equal to or higher than a predetermined speed, the event determining unit 113 determines that a violent act as a multi-person event has occurred. On the other hand, when the moving speed of at least a part of the edge is lower than the predetermined speed, the event determining unit 113 determines that a violent act or the like has not occurred. For example, in the example illustrated in FIG. 9, the event determination unit 113 determines whether or not the moving speed of the broken line portion E, which is a part of the edge indicated by the four sides of the human rectangle, is equal to or higher than a predetermined speed. The predetermined speed may be set according to characteristics of a camera used in the photographing unit 14 (for example, characteristics of a wide-angle lens). Note that when the moving speeds of all the edges of the human rectangle are equal to or higher than the predetermined speed, the event determining unit 113 simply causes the target person 60 to fall or the staff 70 to move quickly. Alternatively, it may be determined that violence has not occurred.

(B) Judgment processing based on the trajectory where the edge of the human area moves A person who commits violence is likely to repeatedly hit or kick, and corresponds to the tip of the hand or foot of the person who commits violence. At least a part of the edge of the human rectangle has a high possibility of repeatedly moving in the same predetermined area. For example, in the example shown in FIG. 9, the broken line portion E which is the edge of the person rectangle corresponding to the hand of the staff 70 has a high possibility of repeatedly moving between the positions (a) and (b).

  For this reason, the event determination unit 113 determines that the edge of the rectangle of at least one of a plurality of persons including the target person 60 extracted in the image acquired by the information acquisition unit 111 as the time change of the human area. Check the moving path. Then, for example, when at least a part of the edge repeatedly moves in a predetermined area, the event determination unit 113 determines that a violent act as a multi-person event has occurred. On the other hand, if at least a part of the edge does not repeatedly move in the predetermined area, the event determination unit 113 determines that violence has not occurred. The predetermined area may be set according to the characteristics of the camera used in the photographing unit 14 (for example, the characteristics of a wide-angle lens).

  In the above-described two determination processes, the event determination unit 113 performs the violent action based on the time change of the aspect ratio (the ratio of the long side to the short side) of the person rectangle instead of the time change of the edge of the person rectangle. May be determined. Further, the event determination unit 113 may determine whether a violent act or the like has occurred based on the time change of the edge of the person silhouette instead of the time change of the edge of the person rectangle.

  Further, the event determination unit 113 may determine whether violence or the like has occurred based on the joint points of the person estimated from the region of the person (person region). That is, the event determination unit 113 may estimate a joint point on an arm or a leg of a person who performs a violent act or the like, and may determine whether or not the violent act or the like has occurred based on a temporal change of the estimated joint point.

(2) Judgment Process Based on Sound Information The event judgment unit 113 generates, for example, a violent act based on the sound information about the target person 60 input to the sound input / output unit 15 and acquired by the information acquisition unit 111. Is determined.

  The sound input / output unit 15 receives an input of a sound generated from at least one of a plurality of persons including the target person 60 when a violent act or the like is performed. Examples of the sound input to the sound input / output unit 15 include, for example, a beating sound, a kicking sound, a sound of a person who has been subjected to violent acts, a sound of colliding with furniture when the person falls, a violence, and the like. Screaming, moaning, voice including words such as "pain", "stop" or "help" by a person who receives the act, etc., swearing by a person who commits violent acts, "this yarou" or "idiot" And the like, but are not limited thereto.

(A) Judgment Processing Based on Sound Level When violent acts or the like are performed, there is a high probability that at least one of the sounds described above occurs at a large level. For this reason, the event determination unit 113 confirms, for example, the level of a sound generated from at least one of a plurality of persons including the target person 60 based on the sound information acquired by the information acquisition unit 111. Then, for example, when the level of the sound is equal to or higher than a predetermined level, the event determination unit 113 determines that a violent act as a multi-person event has occurred, and when the level of the sound is lower than the predetermined level. It is determined that violence has not occurred. For example, the event determination unit 113 determines that a violent act or the like has occurred if the level of the sound colliding with furniture or the like when the person who has been subjected to the violent act or the like falls down is equal to or higher than a predetermined level.

(B) Judgment Process Based on Voice Content At least one of a person who receives a violent act or a person who performs a violent act or the like has a high probability of emitting the above-mentioned sound. For this reason, the event determination unit 113 confirms, for example, the content of the voice uttered by at least one of a plurality of persons including the target person 60 based on the sound information acquired by the information acquisition unit 111. The event determination unit 113 may confirm the content of the voice by a well-known voice recognition process.

  Then, for example, when the content of the voice is a predetermined content, the event determination unit 113 determines that a violent act or the like as a multi-person event has occurred, and when the content of the voice is not the predetermined content, It is determined that no occurrence has occurred. The predetermined content may be, for example, a scream, a moan, a voice including words such as "pain", "stop" or "help" by a person who is subjected to violence, an abuse by a person who performs violence, " Or a voice including words such as "" or "Fool", but is not limited thereto. In addition, the predetermined content may be a voice content that is input in advance by the manager of the watching system 1 or a person who supervises the staff 70 via the fixed terminal 30 or the like and stored in the server 20. Good.

  As described above, in the determination process based on the image, the presence or absence of the occurrence of the multi-person event is determined based on the acquired image regarding the target person 60. Accordingly, the presence or absence of the occurrence of the multi-person event is determined based on the image of the target person 60 that is also used in the determination processing of the target person event without requiring additional information.

  In addition, the moving speed of the edge of at least one person region among the plurality of persons including the target person 60 is confirmed, and based on whether the moving speed of at least a part of the edge is equal to or higher than a predetermined speed, It is determined whether a human event has occurred. Thereby, physical violence or the like is accurately detected, and the violence or the like is suppressed.

  Further, a trajectory in which the edge of at least one of the plurality of persons including the target person 60 moves is confirmed, and based on whether at least a part of the edge repeatedly moves in the predetermined area, the plurality of persons are determined. It is determined whether an event has occurred. Thereby, based on an index different from the moving speed of the edge of the human region as described above, a physical violence or the like is accurately detected, and the violence or the like is suppressed.

  In the determination process based on the sound information, the presence or absence of the occurrence of the multi-person event is determined based on the acquired sound information on the target person 60. As a result, the presence / absence of a multi-person event is determined based on information different from the image regarding the target person 60 as described above. More specifically, not only physical violence and the like, but also mental violence and the like caused by abusive or abusive words of a person performing the violence or the like can be determined as to whether or not an event has occurred as a multiple-person event.

  In addition, the level of a sound generated from at least one of a plurality of persons including the target person 60 is confirmed, and based on whether or not the level of the sound is equal to or higher than a predetermined level, it is determined whether or not a multi-person event has occurred. Is determined. As a result, physical or mental violence or the like is accurately detected, and the violence or the like is suppressed.

  Further, the content of the voice uttered by at least one of the plurality of persons including the target person 60 is confirmed, and the presence or absence of the occurrence of the multi-person event is determined based on whether or not the content of the voice is a predetermined content. You. Thereby, based on an index different from the sound level as described above, a physical or mental violence or the like is accurately detected, and the violence or the like is suppressed.

  The event determination unit 113 may determine whether a violent act or the like has occurred as a multi-person event by executing a plurality of determination processes out of the four determination processes described above. That is, for example, the event determination unit 113 may execute a plurality of determination processes and make a final determination that a violent act or the like has occurred only when it is determined that a violent act or the like has occurred in all of the executed determination processes. . Alternatively, the event determination unit 113 may execute a plurality of determination processes, and when it is determined in at least one determination process that a violent act or the like has occurred, the event determination unit 113 may make a final determination that a violent act or the like has occurred. Further, the event determination unit 113 may execute a determination process other than the four determination processes described above.

(1st Embodiment)
Hereinafter, the processing procedure according to the first embodiment of the present invention will be described with reference to FIG.

  FIG. 10 is a flowchart illustrating a procedure of a process according to the first embodiment. The algorithm shown in the flowchart of FIG. 10 is stored as a program in the storage unit 12 of the detection unit 10, and is executed by the control unit 11.

  As illustrated in FIG. 10, the control unit 11 first obtains information on the target person 60 as the information obtaining unit 111 (Step S101). More specifically, the control unit 11 acquires an image of the subject 60, which is captured by the imaging unit 14. In addition, in the later-described step S105, when performing the determination process of the multi-person event based on the information on the sound about the target person 60 in step S105 described later, the control unit 11 outputs the sound information on the target person 60 in addition to the image on the target person 60 May be acquired.

  Subsequently, the control unit 11 determines whether or not a plurality of persons are included in the image acquired in step S101 as the multiple person determination unit 112 (step S102).

  When it is not determined that a plurality of persons are included in the image (step S102: NO), the control unit 11 proceeds to the process of step S103. Then, the control unit 11 sets the type of the predetermined event to be determined as the subject event as the event determination unit 113, and executes the subject event determination process based on the image acquired in step S101. (Step S103). Then, the control unit 11 determines whether or not the target person event has occurred (Step S104). That is, the control unit 11 determines whether or not a predetermined action including wake-up, leaving the bed, falling, or falling of the subject 60, a nurse call, abnormal body movement, or the like has occurred as the subject person event.

  When it is determined that the target person event has not occurred (step S104: NO), the control unit 11 ends the process.

  When determining that the target person event has occurred (step S104: YES), the control unit 11 proceeds to the process of step S107 described later.

  On the other hand, when it is determined that a plurality of persons are included in the image (step S102: YES), the control unit 11 proceeds to the process of step S105. Then, the control unit 11 sets the type of the predetermined event to be determined to be a multi-person event as the event determination unit 113, and performs a multi-person event determination process based on the information acquired in step S101. (Step S105). More specifically, the control unit 11 executes a determination process of a violent act as a multi-person event, based on at least one of the image and sound information acquired in step S101. Then, the control unit 11 determines whether a multiple-person event has occurred (Step S106).

  When it is determined that the multiple-person event has not occurred (step S106: NO), the control unit 11 ends the process.

  When it is determined that the multiple-person event has occurred (step S106: YES), the control unit 11 proceeds to the process of step S107.

  If step S104 or S106 is YES, the control unit 11 notifies the server 20 or the like of the occurrence of the target person event or the multi-person event as the event notification unit 114 (step S107). More specifically, when determining that the subject event has occurred, the control unit 11 notifies the server 20 or the like of the occurrence of the subject event. When determining that a multi-person event has occurred, the control unit 11 notifies the server 20 or the like of the occurrence of the multi-person event.

  Subsequently, the control unit 11 transmits the moving image for a predetermined first time including the event occurrence time acquired by the information acquiring unit 111 to the server 20 as the moving image processing unit 115, and stores the moving image in the storage unit 22 of the server 20. (Step S108). Note that the control unit 11 may execute the process of step S108 only when it is determined in step S106 that a multiple-person event has occurred. Further, as described above, when the moving image is constantly transmitted to the server 20, the control unit 11 instructs the server 20 to cut out and store the moving image for a predetermined first time including the event occurrence time. May be.

  As described above, in the first embodiment, it is determined whether or not a predetermined event relating to a plurality of persons including the target person 60 has occurred based on the acquired information regarding the target person 60. When it is determined that a predetermined event relating to a plurality of persons has occurred, the occurrence of the event is notified. As a result, violence as a predetermined event relating to a plurality of persons is monitored without using a separate monitoring camera or the like, and violence or the like in the facility is suppressed.

  Further, it is determined whether or not a plurality of persons are included in the acquired image of the subject 60. If it is determined that a plurality of persons are not shown in the image, the type of the predetermined event to be determined is set as the target person event, and it is determined whether or not the target person event has occurred. On the other hand, if it is determined that a plurality of persons are present in the image, the type of the predetermined event to be determined is set to the multi-person event, and it is determined whether or not the multi-person event has occurred. That is, one of the subject person event determination process and the multi-person event determination process is selectively executed. This eliminates the need to simultaneously execute each of the heavy load determination processes, and can reduce the processing load.

  Further, the control unit 11 causes the storage unit 22 of the server 20 to store a moving image for a predetermined time including the time of occurrence of the event. Thereby, for example, a moving image serving as evidence of violence as a multi-person event can be stored in the storage unit 22.

(2nd Embodiment)
Hereinafter, the procedure of the process according to the second embodiment of the present invention will be described with reference to FIG. In the first embodiment, it is described that one of the subject event determination process and the multi-person event determination process is selectively executed based on whether or not a plurality of persons appear in the acquired image. did. In the second embodiment, a process different from that of the first embodiment is executed as the event determination process.

  FIG. 11 is a flowchart illustrating a procedure of a process according to the second embodiment. The algorithm shown in the flowchart of FIG. 11 is stored as a program in the storage unit 12 of the detection unit 10, and is executed by the control unit 11. The processing in each step other than step S204 in FIG. 11 is the same as the processing in each step in FIG. However, in step S201, the control unit 11 may acquire, as the information regarding the target person 60, either an image regarding the target person 60 or sound information regarding the target person 60.

  As shown in FIG. 11, the control unit 11 performs both the subject person event determination process and the multi-person event determination process as the event determination unit 113 regardless of whether or not the acquired image includes a plurality of people. Execute That is, the control unit 11 does not limit the type of the predetermined event to be determined to either the target person event or the multi-person event, and performs both the target person event determination processing and the multi-person event determination processing. Execute Then, in step S204, the control unit 11 causes the event determination unit 113 to determine whether or not a target person event or a multi-person event has occurred.

  As described above, in the second embodiment, both the target person event determination processing and the multi-person event determination processing are executed regardless of whether or not a plurality of persons are included in the acquired image. As a result, it is not clear whether or not a plurality of people are included in the image, and it is not correctly determined whether or not a plurality of people are captured, or the determination process itself of whether or not a plurality of people are captured is not performed. However, the determination process of the multi-person event is executed reliably. Therefore, the detection accuracy of a violent act as a multi-person event can be improved.

  Note that the present invention is not limited to the above-described embodiment, and various changes and improvements can be made within the scope of the claims.

  For example, in the above-described embodiment, the case where the occurrence of the multi-person event is notified when it is determined that the multi-person event has occurred has been described as an example, but the present invention is not limited to this.

  For example, when the detection unit 10 determines that a multi-person event has occurred, the detection unit 10 may notify the occurrence of the multi-person event as the occurrence of the target person event. More specifically, in step S107 in FIG. 10 or step S205 in FIG. 11, the detection unit 10 determines that the occurrence of a violent act or the like as a multiple-person event has occurred, May be notified. The detection unit 10 may notify the occurrence of the multi-person event as the occurrence of an event other than the fall of the target person 60. However, the notification of the target person event to be notified is invalidated by the user such as the staff 70. Preferably, the event is not performed. Then, the server 20 may notify at least one of the fixed terminal 30 and the portable terminal 40 of the occurrence of the event of the fall of the subject 60, for example. As a result, the fact that a violent act or the like is detected as a multiple-person event does not have to be known to the staff 70 or the like. Therefore, it is possible to avoid a situation in which the staff member 70 acts too cautiously, taking into account that his / her own behavior is also a determination target, or hesitates to deal with the target person 60. On the other hand, the server 20 stores, for example, a moving image such as a violent act as a moving image of a fall, and at least one of the fixed terminal 30 and the portable terminal 40 displays, for example, an image of a violent act or the like as a fall image. Thus, it is not necessary for the staff 70 or the like to know that a violent act or the like can be detected. , Violence, etc. are deterred.

  In addition, when the detection unit 10 determines that a multi-person event has occurred, when notifying that a target person event has occurred, the detection unit 10 is confirmed only by the manager of the watching system 1 or the person in charge of the staff 70. The information may be added to notify the server 20. Alternatively, the detection unit 10 notifies the server 20 of the occurrence of the multi-person event as usual, while the server 20 determines that the occurrence of the multi-person event is the occurrence of the subject event and adds the information to the fixed terminal 30. And at least one of the portable terminals 40 may be notified. The information may be a flag or the like indicating that the occurrence of the multi-person event is notified as the occurrence of the target person event. Therefore, it is not necessary for the staff 70 or the like to know that a violent act or the like can be detected as a multi-person event. On the other hand, the administrator or the responsible person confirms the information via the fixed terminal 30 or the like. Violence can be suppressed.

  Further, even when it is determined that the multi-person event has occurred, the detection unit 10 does not have to execute the process of notifying the occurrence of the multi-person event. The detection unit 10 may enable or disable the notification of the multi-person event in response to an instruction of a user such as the staff 70 or automatically. For example, the detection unit 10 normally activates the notification, while it is highly likely that the occurrence of a multi-person event, such as a time period during which the family of the target person 60 is visiting the target person 60, is erroneously determined. In such a case, the notification may be invalidated. Alternatively, the detection unit 10 normally invalidates the notification, and when there is a high possibility that a multi-person event will occur, such as during a nighttime when the number of staff members 70 at work is small, the detection unit 10 will disable the notification. May be activated. Thereby, the processing load can be reduced. Note that, even when the detection of the occurrence of the multi-person event is not notified, the detection unit 10 may execute the process of transmitting the moving image for a predetermined first time including the occurrence time of the multi-person event. As a result, even when the notification of the multi-person event is invalidated, for example, when there is a large number of erroneous determinations about the occurrence of the multi-person event, the stored moving image can be checked later, and the violence as the multi-person event can be confirmed. Acts are deterred.

  Further, in the above-described embodiment, the case where the detection unit 10 notifies the server 20 of the occurrence of the multi-person event has been described as an example, but the present invention is not limited to this. For example, when it is determined that a multi-person event has occurred, the detection unit 10 may output a sound to notify a surrounding person of the occurrence of the multi-person event. More specifically, in step S107 of FIG. 10 or step S205 of FIG. 11, the detection unit 10 outputs a sound that calls attention to the sound input / output unit 15 to notify the surrounding people of the occurrence of the multi-person event. You may be notified. In this case, the control unit 11 of the detection unit 10 controls the sound input / output unit 15 as the event notification unit 114. Examples of sounds that call attention include, but are not limited to, chimes, music, and predetermined sounds. Accordingly, the detection unit 10 can notify the occurrence of the violence or the like as a multi-person event to a person who is performing the violence or the like, a staff member 70 or the like who can stop the violence, or the like. Etc. are effectively suppressed.

  Further, at least a part of the processing in the detection unit 10, the server 20, the fixed terminal 30, and the mobile terminal 40 may be respectively executed in other devices. For example, in the above-described embodiment, the case where the processing in FIGS. 10 and 11 is executed in the detection unit 10 has been described as an example, but the processing is executed in the server 20, the fixed terminal 30, or the mobile terminal 40. May be done. In this case, the server 20, the fixed terminal 30, or the mobile terminal 40 may acquire information about the target person 60 from the detection unit 10 and execute the process. Thereby, even when the processing according to the above-described embodiment cannot be executed in the detection unit 10 due to resources or the like, violence or the like as a multi-person event is suppressed.

  Further, in the above-described embodiment, the detection unit 10, the server 20, the fixed terminal 30, and the mobile terminal 40 are described as one device, respectively, but the present invention is not limited to this. For example, for each component, an information processing device that executes various determination processes and a device that executes other processes may be separately configured. In this case, the information processing device and the device that executes other processing may be connected by wire or wirelessly.

  Further, the processing according to the above-described embodiment may include steps other than the steps in the above-described flowchart, or may not include some of the above-described steps. Further, the order of the steps is not limited to the above embodiment. Further, each step may be executed as one step in combination with another step, may be executed by being included in another step, or may be executed by being divided into a plurality of steps.

  The means and method for performing various processes in the watching system 1 according to the above-described embodiment can be realized by any of a dedicated hardware circuit and a programmed computer. The above-described program may be provided by a computer-readable recording medium such as a USB memory or a DVD (Digital Versatile Disc) -ROM, or may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred to and stored in a storage unit such as a hard disk. Further, the above-described program may be provided as independent application software, or may be incorporated as one function into the software of each device.

1 Watching system,
10 detector,
11 control unit,
111 information acquisition unit,
112 multi-person determination unit,
113 event determination unit,
114 event notification unit,
115 video processing unit,
116 call processing unit,
117 streaming distribution unit,
12 storage unit,
13 communication unit,
14 shooting section,
15 sound input / output unit,
16 Nurse call input section,
20 servers,
21 control part,
211 monitoring processing unit,
212 event notification unit,
213 video processing unit,
22 storage unit,
23 communication section,
30 fixed terminals,
40 mobile terminals,
41 control unit,
411 monitoring processing unit,
412 call processing unit,
413 streaming playback unit,
42 storage unit,
43 communication unit,
44 display,
45 operation input unit,
46 sound input / output unit,
47 interface section,
50 networks,
51 access points,
60 subjects,
70 staff.

Claims (14)

A watching device that notifies the occurrence of a predetermined event related to a target person who is a watching target,
An information acquisition unit that acquires information about the target person,
Based on the information acquired by the information acquisition unit, an event determination unit that determines whether a predetermined event related to a plurality of persons including the target person has occurred,
When it is determined that the predetermined event related to the plurality of people has occurred by the event determination unit, an event notification unit that notifies the occurrence of the predetermined event related to the plurality of people,
Watching device with. The information acquisition unit acquires an image of the subject,
The watching device according to claim 1, wherein the event determination unit determines whether a predetermined event related to the plurality of people has occurred based on the image acquired by the information acquisition unit.   The event determination unit is extracted in the image acquired by the information acquisition unit, confirms the moving speed of the edge of the area of at least one person of the plurality of people including the target person, When at least a part of the moving speed is equal to or higher than a predetermined speed, it is determined that a predetermined event relating to the plurality of people has occurred. The watching device according to claim 2, wherein it is determined that a predetermined event relating to a person has not occurred.   The event determination unit is extracted in the image acquired by the information acquisition unit, confirms a trajectory in which an edge of an area of at least one of the plurality of persons including the subject moves, and If at least a part of the edge repeatedly moves in a predetermined area, it is determined that a predetermined event related to the plurality of people has occurred. If at least a part of the edge does not repeatedly move in the predetermined area, a predetermined event related to the plurality of people is determined. The watching device according to claim 2, wherein it is determined that no event has occurred. The information acquisition unit acquires sound information about the subject,
The event determination unit according to any one of claims 1 to 4, wherein the event determination unit determines whether a predetermined event related to the plurality of people has occurred based on the sound information acquired by the information acquisition unit. Watching device.   The event determination unit confirms a level of a sound generated from at least one of the plurality of persons including the target person based on the information on the sound acquired by the information acquisition unit, and the level of the sound is If the level is equal to or higher than a predetermined level, it is determined that a predetermined event relating to the plurality of persons has occurred. If the level of the sound is lower than the predetermined level, it is determined that the predetermined event relating to the plurality of persons has not occurred. The watching device according to claim 5, wherein   The event determination unit confirms the content of a voice uttered by at least one of the plurality of persons including the target person based on the information of the sound obtained by the information obtaining unit, and the content of the voice is If the content is a predetermined content, it is determined that a predetermined event related to the plurality of people has occurred, and if the content of the voice is not the predetermined content, it is determined that a predetermined event related to the plurality of people has not occurred. The watching device according to 5 or 6. The image about the subject acquired by the information acquisition unit, further comprising a plurality of people determination unit to determine whether or not the plurality of people are shown,
The event determination unit includes:
When it is determined that the plurality of persons are not shown in the image by the plurality of persons determination unit, a type of a predetermined event to be determined is set to a predetermined event regarding the target person, and a predetermined event regarding the target person is set. Judge whether or not has occurred,
When the plurality of persons is determined to be present in the image by the plurality of persons determination unit, the type of the predetermined event to be determined is set to a predetermined event regarding the plurality of persons, and a predetermined event regarding the plurality of persons is set. The watching device according to any one of claims 1 to 7, wherein it is determined whether an event has occurred.   The event determination unit performs both a predetermined event determination process for the target person and a predetermined event determination process for the plurality of people, and the predetermined event for the target person and the predetermined event for the plurality of people are determined. The watching device according to any one of claims 1 to 7, wherein it is determined whether or not the monitoring has occurred.   When the event determining unit determines that the predetermined event has occurred, a moving image for a predetermined time including the time of occurrence of the predetermined event, obtained by the information obtaining unit, is stored in the storage unit. The watching device according to claim 1, further comprising a processing unit.   The event notification unit, when the event determination unit determines that the predetermined event related to the plurality of people has occurred, notifies the occurrence of the predetermined event related to the plurality of people as the occurrence of the predetermined event related to the target person. The watching device according to any one of Items 1 to 10.   The event notification unit, when notifying the occurrence of the predetermined event related to the plurality of persons as the occurrence of the predetermined event related to the subject, sets the occurrence of the predetermined event related to the plurality of persons as the occurrence of the predetermined event related to the subject. The monitoring device according to claim 11, wherein the notification is performed by adding information indicating that the notification is performed.   The event notification unit, when it is determined by the event determination unit that a predetermined event related to the plurality of people has occurred, by outputting a sound calling attention to a sound output unit capable of outputting a sound, The watching device according to any one of claims 1 to 12, which notifies occurrence of a predetermined event. A control program for a watching device that notifies occurrence of a predetermined event related to a target person who is a watching target,
An acquisition step of acquiring information on the target person,
Based on the information obtained in the obtaining step, a determining step of determining whether a predetermined event related to a plurality of persons including the target person has occurred,
A notification step of notifying the occurrence of the predetermined event related to the plurality of persons when it is determined that the predetermined event related to the plurality of persons has occurred in the determination step;
A control program that causes a computer to execute processing that includes