JP2015149039A - State notification method, device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To detect the concrete behavior change of a person to be monitored while protecting the privacy of the person to be monitored concerning a state notification method, device and program for reporting the situation of the person to be monitored.SOLUTION: An alarm output section 104 determines the type of an alarm for reporting the state of a person 108 to be monitored in accordance with the descendent or ascendent movement of the position of the head detected on the basis of pickup image data from an imaging device 105 by a head movement state detection section 102 and the state of a sound detected by a sound state detection section 103 on the basis of voice data from a sound collection device 106. Then, an alarm output section 104 outputs the determined alarm to, for example, a management terminal 107 connected via the Internet and a radio LAN.

Description

  The present invention relates to a state notification method, apparatus, and program for notifying the status of a monitoring target person.

  With the arrival of an aging society, the number of elderly living alone has increased. There is an unfortunate case where, even if some kind of abnormality occurs in an elderly person living alone, no one notices it, and it is discovered many days after death.

  Attempts have been made to realize a so-called emergency call system or the like that uses ICT to watch over the elderly living alone and discovers abnormalities at an early stage using a sensor such as a camera.

  The following technique is known as a first conventional technique that allows a user to easily recognize an abnormality with an existing television receiver or the like (for example, Patent Document 1). Image data as a television broadcast program is displayed on each of the television receivers as the parent device and each child device. Each television receiver receives image data from the camera wirelessly, detects the feature amount of the image data for each frame, and further analyzes temporal variations of the feature amount of the image data. ing. When the temporal variation of the feature amount satisfies a predetermined condition, the display of each television receiver is switched. Image data from a camera whose temporal variation of the feature quantity satisfies a predetermined condition is displayed on the entire screen over the display screens of all television receivers.

  In addition, the following technique is known as a second conventional technique that enables a detailed situation during movement of a person or an article moving on a specific premises (for example, Patent Document 2). The wireless area generated by the private wireless base station is used as an area to be tracked and monitored by a specific person who moves with a specific PHS terminal for private use. The private PHS exchange connected to the private radio base station uses the location information of the private PHS terminal stored in the subscriber database by the location registration performed by the private PHS terminal moving in the wireless area. Select / switch the private wireless base station that generates the wireless area corresponding to the current position of the PHS terminal, and start and control the direction of the monitoring video camera and sound collection microphone provided in the switched private wireless base station Thus, the trend of the PHS terminal for the premises is tracked and monitored.

JP 2003-199092 A JP 2004-88485 A

  There is a problem of privacy protection in monitoring elderly people. More specifically, by monitoring a daily life by a third party, there is a possibility that a psychological burden, such as whether a face is photographed and used somewhere, may occur on the monitoring subject. However, in the first prior art described above, if there is a large variation in the image or sound of the surveillance camera, it can only be detected as an abnormality, and it is not possible to detect a specific behavior change such as a fall of an elderly person, for example. . In addition, the face or the like of the monitoring subject is exposed to the administrator as an image of the monitoring camera.

  In the second prior art described above, the situation where the tracking target is placed from the video information output from the video analysis means and the sound information output from the sound analysis means is comprehensively considered from two viewpoints of video and sound. There is a description that may be specified. However, this alone cannot detect specific behavioral changes such as the fall of an elderly person, for example, as in the first prior art. Similarly to the first prior art, the face of the monitoring subject is exposed to the administrator as an image of the monitoring camera.

  In view of this, an object of one aspect of the present invention is to enable detection of a behavior change of a monitoring target person in consideration of the privacy of the monitoring target person.

  In an example, the state of the sound detected from the vicinity of the monitoring subject in the vicinity of the timing at which the state of the head of the monitoring subject is lowered or raised and the state of the movement of the descending or rising is detected. In response to this, the computer is caused to execute a process for controlling the type of alarm for notifying the status of the monitoring subject.

  In consideration of the privacy of the monitoring subject, it becomes possible to detect a change in the behavior of the monitoring subject.

It is a block diagram of the status notification apparatus concerning this embodiment. It is a figure which shows the example of the time change / sound generation pattern 1 of the head height, and the alarm message 1. FIG. It is a figure which shows the example of the time change / sound generation pattern 2 of the head height, and the alarm message 2. FIG. It is. It is a figure which shows the example of the time change / sound generation pattern 3 of the head height, and the alarm message 3. FIG. It is. It is a figure which shows the example of the time change / sound generation pattern 4 of the head height, and the alarm message 4. FIG. It is. It is a figure which shows the example of the time change / sound generation pattern 5 of the head height, and the alarm message 5. FIG. It is. FIG. 6 is a diagram showing the relationship between temporal changes in head height and sound generation and patterns. 1 is a system configuration diagram of a status notification device according to the present embodiment. It is a figure which shows the data structural example of the head height sound pressure recording log 802. FIG. It is a figure which shows the data structural example of message DB803. FIG. 6 is a diagram showing an example data structure of a camera setting table 804. It is a figure which shows the example of a data structure of user management DB805. It is a figure which shows the example of a data structure of the monitoring work table 806. 10 is a flowchart (part 1) illustrating a processing example of an abnormality notification program 801. 12 is a flowchart (part 2) illustrating a processing example of an abnormality notification program 801. 12 is a flowchart (part 3) illustrating a processing example of the abnormality notification program 801. It is a flowchart which shows the process example of a flag rearrangement subroutine. It is a figure which shows the structural example of the hardware of the server computer which is a state notification apparatus which can run the drip needle removal prevention processing program which concerns on this embodiment.

Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram of a status notification device according to the present embodiment.

  The state notification device 100 includes a head detection unit 101, a head movement state detection unit 102, a sound state detection unit 103, and an alarm output unit 104.

  The head detection unit 101 detects the head of the monitoring target person 108 based on, for example, a captured image captured by the imaging device 105 installed in the room where the monitoring target person 108 is located. Alternatively, the head detection unit 101 detects the head of the monitoring target person 108 based on a signal acquired by means other than an imaging device such as a radar device installed in the room where the monitoring target person 108 is located. . For example, the imaging device 105 and the status notification device 100 are connected via a network such as a wireless LAN (local area network) and the Internet. For example, the imaging device 105 transmits captured image data obtained by imaging the room where the monitoring target person 108 is located to the head detection unit 101 in the state notification device 100 configured by, for example, a server computer via the network. To do. The head detection unit 101, for example, matches the position and size of the head of the monitoring subject 108 on the above-described captured image data by matching with a template image of the head stored in a storage device (not shown). Furthermore, the angle of view of the imaging device 105 registered in advance in the imaging device 105, the height from the floor in the room where the imaging device 105 is installed, and the above-described detected person 108 to be monitored are detected. For example, the height of the head is detected using information such as the size of the head.

  The head movement state detection unit 102 detects the movement state of the head position of the monitoring subject 108 detected by the head detection unit 101 in the descending or rising direction. Specifically, the head movement state detection unit 102 tracks the temporal change in the height of the head (unit: [cm] centimeter) detected by the head detection unit 101, for example. Detects the descending or rising state and speed of the position. As the state of movement, in addition to speed, a movement change pattern (for example, rising and falling) may be detected.

  The sound state detection unit 103 detects the position of the head detected by the head movement state detection unit 102 based on an audio signal collected by, for example, the sound collection device 106 installed in the room where the monitoring target person 108 is located. Detect a sound condition associated with a descending or ascending motion condition. As the sound state, the sound pressure level (unit: [dB] (decibel)) and / or frequency characteristics (unit: [Hz] (hertz)) are detected. For example, the frequency characteristic is obtained based on a frequency signal obtained by frequency analysis processing using an audio signal obtained from the sound collector 106 as an input. As the frequency analysis processing, for example, fast Fourier transform or frequency analysis using a filter bank may be used. Alternatively, frequency envelope extraction by linear prediction analysis (for example, LPC (Linear Prediction Coding) analysis, LSP (Linear Spectral Pairs) analysis, or cepstrum analysis)) may be used. The characteristic frequency peak and power of the sound generated by hitting the body somewhere or falling to the floor are stored in advance, and the actual frequency peak and power obtained by the above frequency analysis are stored. May be detected.

  The alarm output unit 104 performs monitoring according to the state of the sound detected by the sound state detection unit 103 from the vicinity of the person to be monitored in the vicinity of the timing when the head movement state detection unit 102 detects the state of the downward or upward movement. The type of alarm for notifying the state of the target person 108 is controlled. Then, the alarm output unit 104 outputs the controlled alarm to the management terminal 107 connected via, for example, the Internet and a wireless LAN.

  The management terminal 107 notifies (displays and / or emits) an alarm to the manager who possesses it.

  The operation of the state notification device 100 having the above configuration will be described below. In this embodiment, for example, the alarm output unit 104 detects that the sound state detection unit 103 detects a significant sound pressure level at a timing before or after the head movement state detection unit 102 detects a decrease in the position of the head. The type of alarm for notifying the status of the person being monitored may be determined depending on whether or not it is present.

  FIG. 2 is a diagram illustrating an example of the temporal change of the head height and the sound generation pattern 1 and the alarm message 1 detected by the head movement state detection unit 102 and the sound state detection unit 103. FIG. 2A shows the temporal change (solid line) of the head height ([cm]) detected by the head movement state detection unit 102 and the sound pressure level ([dB]) detected by the sound state detection unit 103. The sound generation pattern 1 by time change (broken line) is shown. The head movement state detection unit 102 detects that the head height has rapidly decreased in the period 201. At this time, the sound state detection unit 103 does not detect a particularly significant sound pressure level (for example, the first sound pressure level) before the period 201, and the end of the period 201 in which the head height is near the lowest. At a nearby timing 202, a significant sound pressure level (for example, a second sound pressure level) is detected.

  In this case, as illustrated in FIG. 2B, the alarm output unit 104 displays an alarm message 1 (first alarm) indicating that the person to be monitored 108 may have suddenly fallen and hit the head. ).

  FIG. 3 is a diagram illustrating an example of the temporal change in the head height and the sound generation pattern 2 and the alarm message 2 detected by the head movement state detection unit 102 and the sound state detection unit 103. FIG. 3A shows the temporal change (solid line) of the head height ([cm]) detected by the head movement state detection unit 102 and the sound pressure level ([dB]) detected by the sound state detection unit 103. The sound generation pattern 2 by time change (broken line) is shown. In a state where the head height detected by the head detection unit 101 is still high, the sound state detection unit 103 performs a significant sound pressure level (for example, the first sound pressure level) at the timing 301 before the period 302. Is detected. In the subsequent period 302 starting from within the first predetermined time, the head movement state detection unit 102 detects that the head height has suddenly decreased. Further, at the timing 303 near the end of the period 302 in which the head height in the second predetermined time that follows is the lowest, the sound state detection unit 103 sets a significant sound pressure level (for example, the second sound pressure level). To detect.

  In this case, as illustrated in FIG. 3B, the alarm output unit 104 displays an alarm message 2 (second alarm) indicating that the monitoring target person 108 may have fallen into something. decide.

  FIG. 4 is a diagram illustrating an example of the temporal change of the head height and the sound generation pattern 3 and the alarm message 3 detected by the head movement state detection unit 102 and the sound state detection unit 103. FIG. 4A shows the temporal change (solid line) of the head height ([cm]) detected by the head movement state detection unit 102 and the sound pressure level ([dB]) detected by the sound state detection unit 103. The sound generation pattern 3 by time change (broken line) is shown. In a state where the head height detected by the head detection unit 101 is still high, the sound state detection unit 103 performs a significant sound pressure level (for example, the first sound pressure level) at the timing 401 before the period 402. Is detected. Within the first predetermined time that follows, the head movement state detection unit 102 detects that the head height has started to gradually decrease. Thereafter, within the period 402 that is the second predetermined period, the period 402 elapses and the timing 403 is reached without the sound state detection unit 103 detecting a significant sound pressure level (for example, the second sound pressure level).

  In this case, as illustrated in FIG. 4B, the alarm output unit 104 displays an alarm message 3 (third alarm) that displays that the monitoring target person 108 may have crouched and bumped into something. decide.

  FIG. 5 is a diagram illustrating examples of temporal changes in head height, sound generation patterns 4 and alarm messages 4 detected by the head movement state detection unit 102 and the sound state detection unit 103. FIG. 5A shows a temporal change in head height and a sound generation pattern 4 detected by the head movement state detection unit 102 and the sound state detection unit 103. First, the temporal change of the head height and the sound generation pattern 1, which are detected by the head movement state detection unit 102 and the sound state detection unit 103 in FIG. 2 (a), FIG. 3 (a), or FIG. It will be in either of the two states. Thereafter, in a period 501 within the third predetermined period, the head movement state detection unit 102 detects an increase in the head height. At timing 502, the change in head height becomes substantially constant.

  In this case, as illustrated in FIG. 5B, the alarm output unit 104 determines the alarm message 4 (fourth alarm) that displays that the monitoring target person 108 may have stood up by himself / herself. .

  FIG. 6 is a diagram illustrating examples of temporal changes in head height, sound generation patterns 5 and alarm messages 5 detected by the head movement state detection unit 102 and the sound state detection unit 103. FIG. 6A shows a temporal change in head height and a sound generation pattern 5 detected by the head movement state detection unit 102 and the sound state detection unit 103. First, the temporal change of the head height and the sound generation pattern 1, which are detected by the head movement state detection unit 102 and the sound state detection unit 103 in FIG. 2 (a), FIG. 3 (a), or FIG. It will be in either of the two states. Thereafter, within the third predetermined period, the sound state detection unit 103 does not detect a significant sound pressure level (for example, the second sound pressure level), and timing 601 is reached.

  In this case, the alarm output unit 104 determines the alarm message 5 (fifth alarm) that displays that there is a possibility that the monitoring target 108 may remain squatting or falling down.

  FIG. 7 is a diagram summarizing the relationship between the temporal change in head height and sound generation and patterns shown in FIGS.

  In the pattern 1 in which the alarm message 1 described with reference to FIG. 2 is output, the head height sharply decreases without generating the sound pressure (first sound pressure level), and the sound pressure (second sound pressure) is further reduced. Level) occurs.

  In the pattern 2 in which the alarm message 2 described with reference to FIG. 3 is output, after the sound pressure (first sound pressure level) is generated, the head height rapidly decreases, and the sound pressure (second sound pressure) is further reduced. Level) occurs.

  In the pattern 3 in which the alarm message 3 described with reference to FIG. 4 is output, the head height gradually decreases after the sound pressure (first sound pressure level) is generated, and then the sound pressure (second sound). Pressure level) does not occur.

  The pattern 4 in which the alarm message 4 described with reference to FIG. 5 is output is a case where the head height has risen after the notification of the patterns 1 to 3 and the head has risen.

  The pattern 5 in which the alarm message 5 described with reference to FIG. 6 is output is a case where the head height remains low after the notification of the patterns 1 to 3.

  As described above, according to the present embodiment, while monitoring the captured image of the monitoring target person without showing it to the administrator who operates the management terminal 107, while protecting the privacy, the specific behavior change patterns 1 to 1 of the monitoring target person. 5 can be detected.

FIG. 8 is a system configuration diagram of the status notification device according to the present embodiment.
The state notification device 100 realized by the server computer executes functions of each part of 101 to 104 of the state notification device 100 in FIG. 1 by executing an abnormality notification program 801 stored in a memory by a CPU (central processing processor). Perform the action. In the memory in the state notification device 100, a head height sound pressure recording log 802, a message DB (database) 803, a camera setting table 804, a user management DB 805, and other databases, and a monitoring work table 806 are stored. . Details of these data will be described later in the description of FIG. 9, FIG. 10, FIG. 11, FIG. 12, and FIG.

  The state notification device 100 corresponds to the imaging device 105 and the sound collection device 106 in FIG. 1 and is connected from a plurality of cameras / microphone units 807 installed in the room of the monitoring target person 108 (FIG. 1) via a hospital LAN 810. The captured image data and audio data in the living room are received at regular intervals.

  In the status notification device 100, when the abnormality notification program 801 receives captured image data and audio data from the camera / microphone unit 807, the abnormality notification program 801 executes the function of the head detection unit 101 in FIG. The head height and sound pressure are detected and recorded in the head height sound pressure recording log 802 for each camera / microphone unit 807.

  FIG. 9 is a diagram showing a data configuration example of the head height sound pressure recording log 802 in FIG. For example, every 0.1 second, the head height and sound pressure are detected based on the captured image data and audio data from the camera / microphone unit 807 installed in the living room, kitchen, bedroom, bathroom, etc. Recording is performed corresponding to the camera / microphone unit 807. When data for a certain time is recorded, the old data is overwritten in order. The head height sound pressure recording log 802 is generated for each monitoring target person 108 (monitoring target person ID). Incidentally, FIG. 9 will be described. Since the monitoring subject 108 is present in the living room, a numerical value is recorded in the head height of the living room, and no numerical value is recorded in the fields of other rooms.

  FIG. 10 is a diagram illustrating a data configuration example of the message DB 803 in FIG. Each template (FIG. 2B), FIG. 3B, FIG. 4B, FIG. 5B, and FIG. Template) is stored. Corresponding to each of the alarm messages 1 to 5, message IDs 1 to 5 are given.

  FIG. 11 is a diagram illustrating a data configuration example of the camera setting table 804 in FIG. For each monitoring subject ID corresponding to the monitoring subject 108 (FIG. 1), the number of cameras installed and each camera / microphone unit 807 for each of the first, second, third, fourth,... The ID (identifier) and installation location of (FIG. 8) are registered.

  FIG. 12 is a diagram showing a data configuration example of the user management DB 805 of FIG. For each monitoring target person ID corresponding to the monitoring target person 108 (FIG. 1), the monitoring target person name, the height of the monitoring target person, the name of the manager who monitors the monitoring target person, and the administrator contact An e-mail address that can be received by the management terminal 107 (FIG. 1) owned by the previous manager is registered.

  FIG. 13 is a diagram showing a data configuration example of the monitoring work table 806 of FIG. 8 used by the abnormality notification program 801. For each monitoring subject ID corresponding to the monitoring subject 108 (FIG. 1), a sound generation flag 1, a head height change flag 1, a head height change flag 2, a sound generation flag 2, an abnormality notification flag, a rising edge A notified flag and a re-notified flag are recorded.

  The sound generation flag 1 is set to ON by the abnormality notification program 801 when the above-described first sound pressure level is generated for the monitoring target person 108 corresponding to the monitoring target person ID.

  The head height change flag 1 is set to ON by the abnormality notification program 801 when the above-described rapid drop in head height occurs for the monitoring target person 108 corresponding to the monitoring target person ID.

  The head height change flag 2 is set to ON by the abnormality notification program 801 when the above-described gradual lowering of the head height occurs for the monitoring target person 108 corresponding to the monitoring target person ID.

  The sound generation flag 2 is set to ON by the abnormality notification program 801 when the above-described second sound pressure level is generated for the monitoring target person 108 corresponding to the monitoring target person ID.

  The abnormality notification completed flag is a numerical value 1 to 5 corresponding to the alarm messages 1 to 5 determined by the abnormality notification program 801 or an undefined value (when there is no notification) for the monitoring target person 108 corresponding to the monitoring target person ID. Is set.

  The rise notification completion flag is set to ON by the abnormality notification program 801 when the above-described increase in head height occurs for the monitoring target person 108 corresponding to the monitoring target person ID.

  The re-notification flag is abnormal when the alarm message 1 to 3 or 5 has already been notified and the alarm message 1 to 3 or 5 is further notified regarding the monitoring target person 108 corresponding to the monitoring target person ID. Set to ON by the notification program 801.

  14, 15, and 16 are flowcharts illustrating an example of processing of the abnormality notification program 801 in FIG. 8.

  First, a flag organizing subroutine is executed (step S1401). This process will be described later.

  Next, it is determined whether or not the monitoring subject ID, camera ID, head height, and sound pressure have been received (step S1402). The head height may be detected by executing the function of the head detection unit 101 in FIG. 1 as a part of the abnormality notification program 801 in FIG. 8, or a dedicated device on the camera / microphone unit 807 side. It may be detected as a process. In the description in step S1402, the head height is an example received from the camera / microphone unit 807.

  If the determination in step S1402 is NO, the process returns to step S1401, and the flag rearranging subroutine and the subsequent step S1402 are executed again to enter a standby state.

  If the determination in step S1402 is YES, the received monitoring subject ID, camera ID, head height, and sound pressure information correspond to the monitoring subject ID having the data configuration example of FIG. It is recorded in the unit height sound pressure recording log 802 for each reception time in increments of 0.1 seconds (step S1403).

  Next, a predetermined number of the latest data with respect to the current time is acquired from the head height sound pressure recording log 802 corresponding to the received monitoring subject person ID (step S1404).

  It is determined whether or not the sound pressure level received this time is a predetermined amount or more greater than the most recent sound pressure level acquired in step S1404 (step S1405).

  If a sound pressure level greater than the most recent sound pressure level is generated and the determination in step S1405 is YES, the next control process is executed. It is determined whether or not the head height change flag 1 of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the received monitoring target person ID is ON (step S1406). That is, immediately before, it is determined whether or not the head height is rapidly lowered.

  If the head height has not fallen sharply immediately before and the determination in step S1406 is NO, the sound generation flag of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the received monitoring target person ID is stored. 1 is set to ON (step S1407). That is, it is recorded that the first sound pressure level before the head height is lowered is generated for the monitoring target person 108 corresponding to the monitoring target person ID. Thereafter, the process returns to the standby process in steps S1401 and S1402.

  Immediately before, if the head height has fallen sharply and the determination in step S1406 is YES, the sound generation flag 2 of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the received monitoring target person ID. Is set to ON (step S1408). That is, it is recorded that the second sound pressure level after the head height is lowered is generated for the monitoring target person 108 corresponding to the monitoring target person ID. Thereafter, the process proceeds to a control process related to determination of alarm messages 1 and 2 in FIG.

  If a sound pressure level greater than the most recent sound pressure is not generated and the determination in step S1405 is NO, the process proceeds to the control process relating to the determination of the head height lowering or rising state described below with reference to FIG. .

  In FIG. 15, first, it is determined whether or not the head height has been lowered compared to the latest data acquired in step S1404 of FIG. 14 (step S1409).

  If the head height is not lowered and the determination in step S1409 is NO, the process moves to step S1413.

  If the head height is decreasing and the determination in step S1409 is YES, it is determined whether or not the descending degree is so sharp that it exceeds a predetermined change in a predetermined time (step S1410).

  If the change is abrupt and the determination in step S1410 is YES, the head height change flag 1 of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the received monitoring subject ID is set to ON ( Step S1411). Thereafter, the process returns to the standby processing in steps S1401 and S1402 of FIG.

  If the change is gradual and the determination in step S1410 is NO, the head height change flag 2 of the monitoring work table 806 having the data configuration example in FIG. 13 corresponding to the received monitoring subject ID is set to ON ( Step S1412). Thereafter, the process returns to the standby processing in steps S1401 and S1402 of FIG.

  If the head height has not decreased and the determination in step S1409 is NO, it is determined whether or not the head height has increased compared to the latest data acquired in step S1404 in FIG. (Step S1413).

  If the determination in step S1413 is NO, the process returns to the standby processing in steps S1401 and S1402 in FIG.

  If the head height is increased and the determination in step S1413 is YES, the value of the abnormality notified flag in the monitoring work table 806 having the data configuration example in FIG. 13 corresponding to the received monitoring target person ID is 1 to 3. It is determined whether or not it is any (step S1414). That is, the head height of the monitoring target person 108 corresponding to the received monitoring target person ID is currently lowered (it is assumed that the person has fallen), and any one of the alarm messages 1 to 3 described above is notified. It is determined whether it is in a state.

  If the determination in step S1414 is NO, the process returns to the standby processing in steps S1401 and S1402 in FIG.

  If the determination in step S1414 is YES, message 4 with message ID = 4 is acquired from message DB 803 illustrated in FIG. 10 and notified to management terminal 107 (step S1415). At this time, the values of the “monitoring person name” item and the “manager contact” item of the record corresponding to the received monitoring person ID in the user management DB 805 illustrated in FIG. 12 are acquired. Then, the e-mail address of the “manager contact” item is used as the transmission destination, and the “monitoring person name” in the message 4 illustrated in FIG. 10 is replaced with the value of the “monitoring person name” item, A mail having the content of the message 4 is transmitted (see FIG. 5B).

  Next, the rising notice flag of the monitoring target person 108 corresponding to the received monitoring target person ID is turned ON (step S1416). Thereafter, the process returns to the standby processing in steps S1401 and S1402 of FIG.

  FIG. 16 is a flowchart showing an example of a control process related to determination of alarm messages 1 and 2 executed when the sound generation flag 2 is turned on after step S1408 of FIG.

  In FIG. 16, first, it is determined whether or not the sound generation flag 1 of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the received monitoring target person ID is ON (step S1417).

  If the sound generation flag 1 is not ON and the determination in step S1417 is NO, message 1 with message ID = 1 is acquired from the message DB 803 illustrated in FIG. 10 and notified to the management terminal 107 (step). S1418). At this time, the values of the “monitoring person name” item and the “manager contact” item of the record corresponding to the received monitoring person ID in the user management DB 805 illustrated in FIG. 12 are acquired. Then, the email address of the “administrator contact” item is used as the transmission destination, and the “monitoring subject name” in the message 1 illustrated in FIG. 10 is replaced with the value of the “monitoring subject name” item, A mail having the content of message 1 is transmitted (see FIG. 2B).

  After that, the value 1 corresponding to the alarm message 1 is set in the abnormality notified flag of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the received monitoring target person ID (step S1419).

Then, the process returns to the standby process in steps S1401 and S1402 of FIG.
If the sound generation flag 1 is ON and the determination in step S1417 is YES, message 2 with message ID = 2 is acquired from the message DB 803 illustrated in FIG. 10 and notified to the management terminal 107 (step S1420). ). At this time, the values of the “monitoring person name” item and the “manager contact” item of the record corresponding to the received monitoring person ID in the user management DB 805 illustrated in FIG. 12 are acquired. Then, the e-mail address of the “manager contact” item is used as the transmission destination, and the “monitoring person name” in the message 2 illustrated in FIG. 10 is replaced with the value of the “monitoring person name” item, A mail having the content of message 2 is transmitted (see FIG. 3B).

  After that, the value 2 corresponding to the alarm message 2 is set in the abnormality notified flag of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the received monitoring target person ID (step S1421).

Then, the process returns to the standby process in steps S1401 and S1402 of FIG.
Next, a description of FIG. FIG. 17 is a flowchart illustrating a processing example of a flag organizing subroutine executed in step S1401 during the standby processing in steps S1401 and S1402 in FIG.

  In FIG. 17, first, the latest flag setting time is acquired for the monitoring target person ID corresponding to the monitoring target person 108 for which the abnormality notification program 801 including the flag organizing subroutine is executed (step S1701). Here, in the monitoring work table 806 illustrated in FIG. 13, when any flag is updated for each monitoring target person ID, the flag provided in the memory corresponding to the monitoring target person ID The time of update is recorded in the variable area of the set time. In step S1701, the latest flag setting time is acquired by referring to this variable area.

  Next, it is determined whether or not a predetermined time, for example, 5 seconds or more has elapsed since the flag setting time acquired in step S1701 (step S1702).

  If the determination in step S1702 is NO, the flag organizing subroutine in step S1401 in FIG. 14 shown in the flowchart in FIG. 17 ends, and the process moves to step S1402.

  If the determination in step S1702 is YES, the following determination is made regarding the monitoring target person ID corresponding to the monitoring target person 108 for which the abnormality notification program 801 including the flag organization subroutine is executed. It is determined whether or not the value of the abnormality notified flag in the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the monitoring target person ID is 1 to 3 (step S1703). That is, the head height of the monitoring target person 108 corresponding to the received monitoring target person ID is currently lowered (it is assumed that the person has fallen), and any one of the alarm messages 1 to 3 described above is notified. It is determined whether it is in a state.

  If the determination in step S1703 is YES, the message 5 with message ID = 5 is acquired from the message DB 803 illustrated in FIG. 10 and notified to the management terminal 107 (step S1704). At this time, each value of the “monitoring person name” item and “manager contact” item of the record corresponding to the monitoring person ID in the user management DB 805 illustrated in FIG. 12 is acquired. Then, the email address of the “administrator contact” item is used as the transmission destination, and the “monitoring subject name” in the message 1 illustrated in FIG. 10 is replaced with the value of the “monitoring subject name” item, A mail having the content of the message 5 is transmitted (see FIG. 6B).

  Thereafter, the re-notification flag of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the monitoring target person ID is set to ON (step S1705).

  Then, the flag organizing subroutine of step S1401 of FIG. 14 shown in the flowchart of FIG. 17 is terminated, and the process proceeds to step S1402.

  If the determination in step S1703 is NO, whether or not both the sound generation flag 1 and the head height change flag 2 of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the monitoring subject ID are ON. Is determined (step S1706). That is, it is determined whether or not the head height is gradually falling after the first sound pressure level.

  If the determination in step S1706 is YES, message 3 with message ID = 3 is acquired from the message DB 803 illustrated in FIG. 10 and notified to the management terminal 107 (step S1707). At this time, each value of the “monitoring person name” item and “manager contact” item of the record corresponding to the monitoring person ID in the user management DB 805 illustrated in FIG. 12 is acquired. Then, the e-mail address of the “manager contact” item is used as the transmission destination, and the “monitoring person name” in the message 3 illustrated in FIG. 10 is replaced with the value of the “monitoring person name” item, A mail having the contents of message 3 is transmitted (see FIG. 4B).

  After that, the value 3 corresponding to the message 3 is set in the abnormality notified flag of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the monitoring subject ID (step S1708).

  Then, the flag organizing subroutine of step S1401 of FIG. 14 shown in the flowchart of FIG. 17 is terminated, and the process proceeds to step S1402.

  If the determination in step S1706 is NO, it is determined that the monitoring target person 108 is not in a dangerous state, and all the flags of the monitoring work table 806 having the data configuration example of FIG. 13 corresponding to the monitoring target person ID are set. It is set to OFF (step S1709). In FIG. 13, those set to OFF are indicated by “---”.

  Then, the flag organizing subroutine of step S1401 of FIG. 14 shown in the flowchart of FIG. 17 is terminated, and the process proceeds to step S1402.

  The function of the alarm output unit 104 of the state notification device 100 of FIG. 1 is realized by the processing of the abnormality notification program 801 of FIG. 8 shown in the flowcharts of FIGS. 14 to 17 described above. Thereby, it is possible to detect a specific behavior change of the monitoring target person while protecting the privacy of the monitoring target person.

  18 is a diagram illustrating a hardware configuration example of a server computer that is the state notification device 100 capable of executing the abnormality notification program 801 in FIG. 8 that realizes the function of the state notification device 100 in FIG.

  The computer shown in FIG. 18 includes a CPU 1801, a memory 1802, an input device 1803, an output device 1804, an external storage device 1805, a portable recording medium driving device 1806 into which a portable recording medium 1809 is inserted, and a communication interface 1807. These are connected to each other by a bus 1808. The configuration shown in the figure is an example of a server computer that can implement the state notification device 100, and such a server computer is not limited to this configuration.

  A CPU 1801 controls the entire computer. The memory 1802 stores an abnormality notification program 801, a head height sound pressure recording log 802, a message DB 803, a camera setting table 804, a user management DB 805, and a monitoring work table 806 during program execution and data update. Is stored. The CPU 1801 performs overall control by reading the abnormality notification program 801 into the memory 1802 and executing it.

  The input device 1803 detects an input operation by the administrator of the state notification device 100 using a keyboard, a mouse, or the like, and notifies the CPU 1801 of the detection result.

  The output device 1804 outputs data sent under the control of the CPU 1801 to a display device or a printing device.

  The external storage device 1805 is, for example, a hard disk storage device. Mainly used for storing various data and abnormality notification program 801.

  The portable recording medium driving device 1806 accommodates a portable recording medium 1809 such as an optical disc, SDRAM, or Compact Flash (registered trademark), and has an auxiliary role for the external storage device 1805.

  The communication interface 1807 is a device for connecting the communication line of the in-hospital LAN 810 of FIG.

  The system according to the present embodiment is realized by the CPU 1801 executing the abnormality notification program 801 equipped with the function of the state notification device 100 of FIG. 1 realized by the flowcharts of FIGS. The program may be distributed by being recorded in, for example, the external storage device 1805 or the portable recording medium 1809, or may be acquired from the network by the network connection device 1807.

Regarding the above embodiment, the following additional notes are disclosed.
(Appendix 1)
Detects the state of the head's head's head position being lowered or raised,
Control the type of alarm for notifying the state of the monitoring subject according to the state of the sound detected from the vicinity of the monitoring subject in the vicinity of the timing at which the state of the downward or rising movement is detected.
A state notification method characterized by causing a computer to execute processing.
(Appendix 2)
The sound state includes a sound pressure level or frequency characteristic of the sound,
The state notification method according to claim 1, wherein the control processing is controlled according to a sound pressure level or a frequency characteristic of the sound.
(Appendix 3)
The state of the head position lowering or raising movement includes the speed of the lowering or raising movement, and the controlling process is controlled according to the speed of the head position lowering or raising movement,
The state notification method according to any one of appendix 1 or 2, characterized by:
(Appendix 4)
The controlling process controls the type of alarm for notifying the state of the person to be monitored depending on whether or not a sound pressure level is detected at a timing before or after a drop in the position of the head is detected. ,
The state notification method according to any one of appendices 1 to 3, wherein:
(Appendix 5)
The process to be controlled is the monitoring target when a drop of the head position at a predetermined speed or more is detected in a state where the first sound pressure level is not detected, and then a second sound pressure level is detected. The first alarm indicating that the person may have suddenly fallen and hit his head
The status notification method according to supplementary note 4, wherein:
(Appendix 6)
In the controlling process, the first sound pressure level is detected, and then the descent of the head position at a predetermined speed or more is detected within a first predetermined time, and then the second sound is detected within a second predetermined time. When the sound pressure level is detected, a second alarm indicating that there is a possibility that the person to be monitored has collided with something is output.
The state notification method according to any one of appendix 4 or 5, characterized by:
(Appendix 7)
In the controlling process, a first sound pressure level is detected, and then a lowering of the head position slower than a predetermined speed is detected within a first predetermined time, and then the second sound is detected within a second predetermined time. When a sound pressure level is not detected, a third alarm indicating that there is a possibility that the person to be monitored has crouched and bumped into something is output.
The state notification method according to any one of appendices 4 to 6, characterized in that:
(Appendix 8)
The process to be controlled may be that the person to be monitored has risen by himself / herself when an increase in the position of the head is detected within a third predetermined time after any of the states of appendix 5 to 7 The fourth alarm indicating that there is a target is output,
The state notification method according to any one of appendices 5 to 7, characterized in that:
(Appendix 9)
The process to be controlled is that the person to be monitored is crouched down or falls down when the elevation of the position of the head is not detected within the third predetermined time after any of the states of appendix 5 to 7 The fifth alarm indicating that there is a possibility that
The state notification method according to any one of appendices 5 to 7, characterized in that:
(Appendix 10)
The position of the head of the person to be monitored is detected based on a captured image captured by an imaging device;
The status notification method according to any one of appendices 1 to 9, characterized in that:
(Appendix 11)
The position of the head of the person to be monitored is detected based on a signal acquired by means other than the imaging device.
The status notification method according to any one of appendices 1 to 9, characterized in that:
(Appendix 12)
A head movement state detection unit that detects a state of movement of the head of the monitoring subject that is descending or rising;
An alarm output unit for controlling the type of alarm for notifying the state of the monitored person according to the state of the sound detected from the vicinity of the monitored person in the vicinity of the timing at which the state of the descending or rising movement is detected; ,
A state notification device comprising:
(Appendix 13)
On the computer,
Detects the state of the head's head's head position being lowered or raised,
Control the type of alarm for notifying the state of the monitoring subject according to the state of the sound detected from the vicinity of the monitoring subject in the vicinity of the timing at which the state of the downward or rising movement is detected.
A status notification program to execute processing.

DESCRIPTION OF SYMBOLS 100 State notification apparatus 101 Head detection part 102 Head movement state detection part 103 Sound state detection part 104 Alarm output part 105 Imaging device 106 Sound collector 107 Management terminal 108 Monitoring subject 801 Abnormality notification program 802 Head height sound pressure Record log 803 Message DB (database)
804 Camera setting table 805 User management DB
806 Monitoring work table 807 Camera / microphone unit 1801 CPU
1802 Memory 1803 Input device 1804 Output device 1805 External storage device 1806 Portable recording medium driving device 1807 Communication interface 1808 Bus 1809 Portable recording medium

Claims (13)

Detects the state of the head's head's head position being lowered or raised,
Control the type of alarm for notifying the state of the monitoring subject according to the state of the sound detected from the vicinity of the monitoring subject in the vicinity of the timing at which the state of the downward or rising movement is detected.
A state notification method characterized by causing a computer to execute processing. The sound state includes a sound pressure level or frequency characteristic of the sound,
The state notification method according to claim 1, wherein the control processing is controlled according to a sound pressure level or a frequency characteristic of the sound. The state of the head position lowering or raising movement includes the speed of the lowering or raising movement, and the controlling process is controlled according to the speed of the head position lowering or raising movement,
The status notification method according to claim 1, wherein the status notification method is performed. The controlling process controls the type of alarm for notifying the state of the person to be monitored depending on whether or not a sound pressure level is detected at a timing before or after a drop in the position of the head is detected. ,
The status notification method according to claim 1, wherein: The process to be controlled is the monitoring target when a drop of the head position at a predetermined speed or more is detected in a state where the first sound pressure level is not detected, and then a second sound pressure level is detected. The first alarm indicating that the person may have suddenly fallen and hit his head
The state notification method according to claim 4. In the controlling process, the first sound pressure level is detected, and then the descent of the head position at a predetermined speed or more is detected within a first predetermined time, and then the second sound is detected within a second predetermined time. When the sound pressure level is detected, a second alarm indicating that there is a possibility that the person to be monitored has collided with something is output.
The state notification method according to claim 4, wherein: In the controlling process, a first sound pressure level is detected, and then a lowering of the head position slower than a predetermined speed is detected within a first predetermined time, and then the second sound is detected within a second predetermined time. When a sound pressure level is not detected, a third alarm indicating that there is a possibility that the person to be monitored has crouched and bumped into something is output.
The state notification method according to any one of claims 4 to 6. The control process may be performed when the person to be monitored has stood up by himself / herself when an increase in the position of the head is detected within a third predetermined time after the state according to any one of claims 5 to 7. The fourth alarm indicating that there is
The state notification method according to any one of claims 5 to 7. The control process is performed when the person to be monitored is crouched down or falls down when an increase in the position of the head is not detected within a third predetermined time after the state according to any one of claims 5 to 7. The fifth alarm indicating that there is a possibility of being left
The state notification method according to any one of claims 5 to 7. The position of the head of the person to be monitored is detected based on a captured image captured by an imaging device;
The state notification method according to claim 1, wherein: The position of the head of the person to be monitored is detected based on a signal acquired by means other than the imaging device.
The state notification method according to claim 1, wherein: A head movement state detection unit that detects a state of movement of the head of the monitoring subject that is descending or rising;
An alarm output unit for controlling the type of alarm for notifying the state of the monitoring target person according to the state of the sound detected from the vicinity of the monitoring target person in the vicinity of the timing at which the state of the descending or rising movement is detected;
A state notification device comprising: On the computer,
Detects the state of the head's head's head position being lowered or raised,
Control the type of alarm for notifying the state of the monitoring subject according to the state of the sound detected from the vicinity of the monitoring subject in the vicinity of the timing at which the state of the downward or rising movement is detected.
A status notification program to execute processing.

Images