WO2020100461A1

WO2020100461A1 - Sensor device for to-be-monitored person monitoring assistance system, monitoring image storage method, and to-be-monitored person monitoring assistance system

Info

Publication number: WO2020100461A1
Application number: PCT/JP2019/039341
Authority: WO
Inventors: 和浩小島; 雅史西角
Original assignee: コニカミノルタ株式会社
Priority date: 2018-11-15
Filing date: 2019-10-04
Publication date: 2020-05-22
Also published as: JP7491219B2; JPWO2020100461A1

Abstract

In a to-be-monitored person monitoring assistance system, a device therefor, and a monitoring image storage method according to the present invention, a prescribed event related to a to-be-monitored person is detected by a sensor device provided corresponding to the to-be-monitored person, and the detection result is notified to a central management apparatus that manages the event. In the to-be-monitored person monitoring assistance system which notifies, via the central management apparatus, a terminal device of the event detected by the sensor device, a moving picture is generated, and upon detecting the event, the generated moving picture lasting for a prescribed first time period including a time point at which the event was detected is transmitted, as an event moving picture, to the central management apparatus, and then the generated moving picture is stored, as a to-be-stored moving picture, in a moving picture storage unit having a storage capacity to store a moving picture lasting for a prescribed second time period that is longer than the first time period.

Description

Sensor device of monitored person support system, monitoring image storage method, and monitored person support system

The present invention relates to a sensor device of a monitored person monitoring support system for supporting monitoring of a monitored person, a monitoring image storage method for storing the monitoring image, and the monitored person monitoring support system.

In recent years, with the entry of a super-aged society, a technology that complements the work of the nursing industry, the nursing care industry, and the like has been researched and developed, and is disclosed in Patent Document 1, for example.

The nurse call system disclosed in Patent Document 1 is installed in a bed to allow a patient to call a nurse, and a nurse call device installed in a nurse station to answer a call by the nurse call device. A nurse call system having a nurse call base unit, which is a camera for imaging a patient on a bed from above the bed, and a state in which the patient is upright and the patient is separated from the bed from the image captured by the camera. The nurse call master unit has a notification unit for receiving the caution state generation signal and performing a notification operation. The nurse call base unit has a monitor for displaying an image, an image control unit for displaying the imaged image of the camera on the monitor when receiving the attention state generation signal, and an image storage unit for storing the image. The image control unit stores the imaged image of the camera in the image storage unit in accordance with the display of the imaged image of the camera on the monitor.

Since the nurse call system disclosed in Patent Document 1 stores the image of the patient who performed the call operation, the state of the patient at the time of calling can be grasped later, which is useful for nursing work (see [0030] of Patent Document 1 above. See paragraph). However, the nurse call system disclosed in Patent Document 1 stores captured images only when it is determined that at least one of a state in which the patient is in an upper body position and a state in which the patient is separated from the bed is generated. Therefore, in the nurse call system disclosed in the Patent Document 1, when the determination of the occurrence is missed, that is, when the determination cannot be made when the occurrence should be determined (in the case of a false alarm). However, there is an inconvenience that a captured image that should be originally saved is not saved. In addition, in the work of the nursing industry, the nursing care industry, etc., the situation of the patient etc. may be confirmed at a later date although it is not a failure to report.

JP, 2014-90913, A

The present invention is an invention made in view of the above circumstances, and an object thereof is to save a picture at the time of occurrence and also a picture at the time of a false alarm. A storage method and the monitored person monitoring support system are provided.

In order to achieve the above-mentioned object, a monitored person monitoring support system, a sensor device thereof, and a monitoring image storage method, which reflect one aspect of the present invention, provide a predetermined event relating to the monitored person to the monitored person. Monitored person who detects by the sensor device provided correspondingly, notifies the central management device that manages the event, and notifies the terminal device of the event detected by the sensor device through the central management device. In the support system, when a moving image is generated and the event is detected, the generated moving image of a predetermined first time including the time when the event is detected is transmitted to the central management device as an event moving image, The generated moving image is stored as a stored moving image in a moving image storage unit having a storage capacity for storing a moving image for a predetermined second time longer than one hour.

The advantages and features afforded by one or more embodiments of the invention are fully understood from the detailed description given below and the accompanying drawings. The detailed description and accompanying drawings are provided by way of example only and are not intended as a definition of the limitations of the invention.

It is a figure which shows the structure of the to-be-monitored person monitoring support system in embodiment. It is a figure which shows the structure of the sensor apparatus in the said to-be-monitored person monitoring assistance system. It is a figure which shows the structure of the management server apparatus in the said to-be-monitored person monitoring support system. It is a figure which shows the structure of the event moving image information table memorize | stored in the said management server apparatus. It is a figure which shows the structure of the preservation | save animation information table memorize | stored in the said management server apparatus. 6 is a flowchart showing an operation related to storage of a saved moving image in the sensor device. 6 is a flowchart showing an operation related to transmission of a stored moving image in the sensor device. It is a sequence diagram which shows the operation | movement regarding the notification of the event in the said to-be-monitored person monitoring assistance system. 6 is a flowchart showing an operation regarding transmission of an event moving image in the sensor device.

Hereinafter, one or more embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the disclosed embodiments. In addition, in each of the drawings, the components denoted by the same reference numerals indicate the same components, and the description thereof will be appropriately omitted. In the present specification, reference numerals without suffixes are used for generic names, and reference numerals with suffixes are used when referring to individual configurations.

The monitored person monitoring support system according to the embodiment supports the above-described monitoring of a monitored person (user) who monitors a monitored person (watched person, target person) who is a monitoring target (watching target) to be monitored (watched). To do. In the present embodiment, the monitored person monitoring support system is provided corresponding to the monitored person, is connected to the sensor device that detects a predetermined event related to the monitored person, and is communicably connected to the sensor device. A central management device that receives notification of an event detected by a sensor device and manages the event, and a notification of an event detected by the sensor device via the central management device that is communicably connected to the central management device And a terminal device for receiving. Then, in the present embodiment, the monitored person monitoring support system includes an image capturing unit that generates a moving image, and a predetermined first period including the time when the event is detected, which is generated by the image capturing unit when the event is detected. A moving image transmission processing unit that transmits a one-hour moving image to the central management device as an event moving image, and a moving image generated by the imaging unit that has a storage capacity for storing a predetermined second time moving image that is longer than the first time period. And a moving image storage unit that stores the stored image as a saved moving image. The terminal device may be one type of device, but in the present embodiment, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between the fixed terminal device and the mobile terminal device is that the fixed terminal device is fixedly operated, while the mobile terminal device is operated while being carried by a supervisor (user) such as a nurse or a caregiver. The fixed terminal device and the mobile terminal device are substantially the same. As an example, a case where the image pickup unit, the moving image transmission processing unit, and the moving image storage unit are included in the sensor device will be described more specifically below.

FIG. 1 is a diagram showing a configuration of a monitored person monitoring support system in the embodiment. FIG. 2 is a diagram showing a configuration of a sensor device in the monitored person monitoring support system. FIG. 3 is a diagram showing a configuration of a management server device in the monitored person monitoring support system. FIG. 4 is a diagram showing a configuration of an event moving image information table stored in the management server device. FIG. 5 is a diagram showing a configuration of a saved moving image information table stored in the management server device.

The monitored person monitoring support system MS in the embodiment is a system that supports monitoring of the monitored person Ob, and for example, as shown in FIG. 1, one or a plurality of sensor devices SU (SU-1 to SU-4). A management server device SV, a fixed terminal device SP, one or more mobile terminal devices TA (TA-1, TA-2), and a private branch exchange (PBX, Private branch exchange) CX. It is connected by wire or wirelessly via a network (network, communication line) NW such as LAN (Local Area Network). The network NW may be equipped with a repeater such as a repeater, a bridge, and a router that relays communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of mobile terminal devices TA-1 and TA-2, and the private branch exchange CX are L2 switches. Line concentrators (hubs, HUBs) LS and access points APs are communicatively connected to each other via a mixed wired / wireless LAN (for example, a LAN conforming to the IEEE 802.11 standard) NW. More specifically, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP and the private branch exchange CX are connected to the concentrator LS, and the plurality of mobile terminal devices TA-1 and TA-2 are connected. Is connected to the line concentrator LS via the access point AP. The network NW forms a so-called intranet by using Internet protocol groups such as TCP (Transmission control protocol) and IP (Internet protocol).

The private branch exchange (line switching equipment) CX is connected to the network NW, controls extension telephones such as call origination, termination, and call between the mobile terminal apparatuses TA to perform extension telephone calls between the mobile terminal apparatuses TA, and For example, calling, receiving and calling between the outside line telephone TL and the mobile terminal device TA by being connected to the outside line telephone TL such as the fixed telephone or the mobile telephone via the public telephone network PN such as the fixed telephone network or the mobile telephone network. And the like to control an outside line telephone and to make an outside line telephone between the outside line telephone TL and the mobile terminal device TA. The private branch exchange CX is, for example, a digital exchange or an IP-PBX (Internet Protocol Private Branch eXchange).

The person-to-be-monitored monitoring support system MS is arranged at an appropriate place according to the person-to-be-observed Ob. The person to be monitored (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs nursing care due to deterioration of physical ability, or a single person living alone. In particular, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs to be detected when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. Therefore, the monitored person monitoring support system MS is preferably installed in a building such as a hospital, an aged welfare facility, and a dwelling unit according to the type of the monitored person Ob. In the example shown in FIG. 1, the monitored person monitoring support system MS is arranged in a building of a nursing care facility having a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station. ..

The sensor device SU has a communication function and the like for communicating with other devices SV, SP, TA via the network NW, notifies the management server device SV of a predetermined event related to the monitored person Ob, and will be described later. Is a device for transmitting the event moving image of (1) to the management server device SV and storing a stored moving image to be described later. The predetermined event (event) is preferably a predetermined event that needs to be dealt with, and in the present embodiment, for example, a predetermined action and a nurse call in the monitored person Ob. Therefore, in the present embodiment, the sensor device SU detects a predetermined action in the monitored person Ob, notifies (transmits) the detection result to the management server device SV as an example of the predetermined event, and accepts a nurse call. As another example of the predetermined event, the nurse call is notified (transmitted) to the management server device SV, a voice call is performed between the terminal devices SP and TA, and an image including a moving image is generated to generate the terminal. This is a device for delivering a moving image to the devices SP and TA. Such a sensor device SU includes, for example, as shown in FIG. 2, an imaging unit 11, a sound input / output unit 12, a nurse call acceptance operation unit 13, a sensor side control processing unit (SU control processing unit) 14, and The sensor-side communication interface unit (SU communication IF unit) 15 and the sensor-side storage unit (SU storage unit) 16 are provided.

The image pickup unit 11 is a device that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14. The image includes a still image (still image data) and a moving image (moving image data). The imaging unit 11 is arranged so as to be able to monitor a space (location space, in the example shown in FIG. 1, a living room (room) RM) where the monitored person Ob, which is a monitoring target, is scheduled to be located. An image (image data) of a bird's eye view of the imaging target is generated from the upper side of the location space as an imaging target, and the image of the imaging target (target image) is output to the SU control processing unit 14. Preferably, since there is a high probability that the entire monitored person Ob to be monitored can be imaged, the image capturing unit 11 detects, for example, the head of the monitored person Ob in the bedding (such as a bed) on which the monitored person Ob lies down. It is arranged so that the object to be imaged can be imaged from directly above a preset head position (usually the pillow disposition position) which is scheduled to be located. Alternatively, for example, since there is a high probability that the entire location space can be imaged, the imaging unit 11 is arranged at a substantially central position on the ceiling surface. The sensor device SU uses the image capturing unit 11 to image the monitored person Ob from above the monitored person Ob, preferably an image captured directly above the planned head position or from a substantially central position on the ceiling surface, Preferably, a moving image is acquired.

The imaging unit 11 as described above may be a device that generates an image of visible light, but in the present embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. . In the present embodiment, for example, such an image pickup unit 11 has an imaging optical system that forms an infrared optical image of an image pickup object on a predetermined image forming surface, and a light receiving surface is made to coincide with the image forming surface. And an area image sensor arranged to convert an infrared optical image of the imaging target into an electrical signal, and data representing an infrared image of the imaging target by image-processing the output of the area image sensor. The digital infrared camera includes an image processing unit that generates image data, preferably moving image data. In the present embodiment, the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (a so-called wide-angle lens (including a fisheye lens)) having an angle of view capable of imaging the entire living room RM in which the imaging unit 11 is arranged. .

The sound input / output unit 12 is a circuit that inputs and outputs sounds. That is, the sound input / output unit 12 is a circuit that is connected to the SU control processing unit 14 and that generates and outputs a sound according to an electric signal representing the sound under the control of the SU control processing unit 14 and is an external circuit. It is a circuit for acquiring sound and inputting it to the sensor device SU. The sound input / output unit 12 is, for example, a speaker or the like that converts an electric signal of sound (sound data) into a mechanical vibration signal of sound (acoustic signal), a microphone that converts the mechanical vibration signal of sound in the audible region into an electric signal, or the like. And is configured. The sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, and also converts the electric signal input from the SU control processing unit 14 into a mechanical vibration signal of sound and outputs the mechanical vibration signal.

The nurse call acceptance operation unit 13 is a switch circuit such as a push button switch that is connected to the SU control processing unit 14 and inputs a nurse call to the sensor device SU. The nurse call acceptance operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as Bluetooth (registered trademark) standard.

The SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication under the control of the SU control processing unit 14. The SU communication IF unit 15 generates a communication signal containing the data to be transferred, which is input from the SU control processing unit 14, according to the communication protocol used in the network NW of the monitored person monitoring support system MS, and the generated communication signal. The communication signal is transmitted to the other devices SV, SP, TA via the network NW. The SU communication IF unit 15 receives communication signals from other devices SV, SP, TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data. The data is converted into data of various formats and output to the SU control processing unit 14. The SU communication IF unit 15 includes, for example, a communication interface circuit conforming to the IEEE 802.11 standard or the like.

The SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14. The various predetermined programs include, for example, a SU control program for controlling the respective units 11 to 13, 15, 16 of the sensor device SU in accordance with the functions of the respective units, and predetermined information processing relating to monitoring of the monitored person Ob. A control processing program such as a SU monitoring processing program for executing the above is included. The SU monitoring processing program detects a predetermined action in the monitored person Ob and notifies the predetermined result to the predetermined terminal devices SP and TA via the management server SV as an example of the predetermined event. When a nurse call is accepted by the action detection processing program or the nurse call accepting and operating section 13, the fact is notified to the management server SV as another example of the predetermined event, and the SU sound input / output section 12 or the like is used. A nurse call processing program for performing a voice call with the terminal devices SP and TA, a streaming processing program for streaming the moving image generated by the imaging unit 11 to the terminal devices SP and TA that requested the moving image, and imaging When a SU moving image storage processing program that stores the moving image generated by the unit 11 in the SU storage unit 16 or the event, in the present embodiment, a preset specific type event of the plurality of types is detected. , A moving image transmission processing program for transmitting a moving image of a predetermined first time including a time point at which the event of the specific type is detected, which is generated by the image capturing unit 11, to the management server SV as an event moving image, and of the plurality of types. Of these, when a residual type event other than the specific type is detected, predetermined tag information relating to the detected event is associated with a later-described stored moving image stored in the SU storage unit In addition, a SU clock program that counts the year, month, day, hour, minute, and second is included. The various types of predetermined data include a sensor device identifier (sensor ID), which is an identifier for identifying and identifying the sensor device SU of the own device, a communication address of the management server device SV, and a moving image generated by the imaging unit 11. Etc. include data necessary for executing each program. The SU storage unit 16 includes, for example, a ROM (Read Only Memory) that is a non-volatile storage element, an EEPROM (Electrically Erasable Programmable Memory) that is a rewritable non-volatile storage element, and the like. The SU storage unit 16 includes a RAM (Random Access Memory) that serves as a working memory of the so-called SU control processing unit 14 that stores data and the like generated during execution of the predetermined program. Then, in the present embodiment, the SU storage unit 16 functionally includes the first and second ring

buffer storage units

161 and 162 of the ring buffer.

The first ring buffer storage unit 161 has a storage capacity (first storage capacity) for storing a predetermined first time moving image (first time length moving image), and stores the moving image generated by the imaging unit 11. This is a so-called ring buffer. Therefore, each frame (each frame data) in the moving image generated by the imaging unit 11 is sequentially arranged in the order of generation from the start address (first start address) to the end address (first end address) of the first ring buffer storage unit 161. ) Is stored, and when the first final address is reached, the data is stored back to the first start address. Therefore, after the first time has elapsed from the first ring buffer storage unit 161, the oldest (oldest) stored moving image frame is overwritten with the moving image frame generated by the imaging unit 11 at this point. Will be erased automatically. The first time is appropriately set in advance, for example, 30 seconds, 60 seconds (1 minute), 2 minutes, 3 minutes, or the like.

The second ring buffer storage unit 162 has a storage capacity (second storage capacity) for storing a moving image of a predetermined second time (a moving image of a second time length) longer than the first time, and is generated by the imaging unit 11. This is a so-called ring buffer that stores stored moving images as saved moving images. Therefore, each frame (each frame data) in the moving image generated by the image capturing unit 11 is sequentially generated in the order of generation from the start address (second start address) of the second ring buffer storage unit 162 to the end address (second end address). ) Is stored, and when the second final address is reached, the second top address is stored again. Therefore, after the lapse of the second time from being stored in the second ring buffer storage unit 162, the oldest (oldest) stored moving image frame is overwritten with the moving image frame stored at this point, and Erased to. The second time is appropriately set in advance, for example, 1 day, 3 days, 6 days, or the like, so that the state of the patient or the like can be confirmed with a moving image later. Then, the moving image generated by the image capturing unit 11 may be directly stored in the second ring buffer storage unit 162 from the image capturing unit 11 by the control processing unit 14, but in the present embodiment, the first processing is performed by the control processing unit 14. The moving image stored in the ring buffer storage unit 161 is stored in the second ring buffer storage unit 162.

The first and second ring

buffer storage units

161 and 162 may each be configured by physically arranging storage elements in a ring shape, but this is not realistic, so the first ring buffer storage unit 161 A storage area (first storage area) is secured in the RAM with the first storage capacity for the first ring buffer storage unit 161, and the first start address and the first end address of the first storage area are connected to create a logical Similarly, the second ring buffer storage unit 162 secures a storage area (second storage area) for the second ring buffer storage unit 162 in the RAM with the second storage capacity, and It is logically constructed by connecting the second start address and the final address.

The SU control processing unit 14 controls each of the units 11 to 13, 15, and 16 of the sensor device SU in accordance with the function of each unit, and sends a predetermined event (event) related to the monitored person Ob to the management server SV. It is a circuit for notifying, transmitting the event moving image to the management server SV, and storing the stored moving image. More specifically, in the present embodiment, the SU control processing unit 14 detects a predetermined action of the monitored person Ob and notifies the management server SV of the detection result as an example of the predetermined event (notification, (Transmitting), accepting the nurse call, notifying (notifying, transmitting) the nurse call to the management server SV as another example of the predetermined event, and making a voice call between the terminal devices SP and TA, and moving images. Generates an image and distributes the moving image to the terminal devices SP and TA. When an event of a specific type is detected, the event moving image is transmitted to the management server device SV, and the stored moving image is stored. The SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. The SU control processing unit 14 executes the control processing program, whereby the sensor side control unit (SU control unit) 141, the action detection processing unit 142, the nurse call processing unit 143, the streaming processing unit 144, and the sensor side moving image storage. A processing unit (SU moving image storage processing unit) 145, a moving image transmission processing unit 146, a tag information addition processing unit 147, and a sensor side clock unit (SU clock unit) 148 are functionally provided.

The SU control unit 141 controls the respective units 11 to 13, 15 and 16 of the sensor device SU in accordance with the functions of the respective units, and controls the overall control of the sensor device SU.

The action detection processing unit 142 detects a preset predetermined action in the monitored person Ob and notifies the management server SV of the detection result as an example of the predetermined event. More specifically, in the present embodiment, the predetermined action is, for example, wake-up of the monitored person Ob, leaving the monitored person Ob from the bedding, falling of the monitored person Ob falling from the bedding, And the four behaviors of the fall of the monitored person Ob. Then, the behavior detection processing unit 142 detects, for example, the head of the monitored person Ob based on the target image captured by the image capturing unit 11, and detects the temporal change in the size of the detected head of the monitored person Ob. Based on this, the waking up, leaving the bed, falling, and falling of the monitored person Ob are detected. More specifically, first, the location area of the bedding BD, the first threshold Th1, the second threshold Th2, and the third threshold Th3 are stored in advance in the SU storage unit 16 as one of the various kinds of predetermined data. The first threshold Th1 is a threshold for distinguishing between the size of the head in the recumbent posture and the size of the head in the sitting posture within the location area of the bedding BD. The second threshold Th2 is a threshold for identifying whether or not it is the size of the head in the standing posture in the living room RM excluding the location area of the bedding BD. The third threshold Th3 is a threshold for identifying whether or not the size of the head in the recumbent posture in the living room RM excluding the area where the bedding BD is located. Then, the behavior detection processing unit 142 extracts a moving body region from the target image as a region of the person of the monitored person Ob by, for example, the background difference method or the frame difference method. Next, the behavior detection processing unit 142 uses, for example, a circular or elliptical Hough transform from the extracted moving body region, pattern matching using a head model prepared in advance, or head detection, for example. The head area of the monitored person Ob is extracted by the neural network learned in the above. Next, the behavior detection processing unit 142 detects getting up, leaving the bed, falling, and falling from the extracted position and size of the head. For example, the action detection processing unit 142 determines that the position of the extracted head is within the location area of the bedding BD and the size of the extracted head is the size of the recumbent posture by using the first threshold Th1. If the time elapses from the sitting posture to the size of the sitting posture, it is determined that the user is getting up and the rising is detected. For example, the behavior detection processing unit 142 is a case where the position of the extracted head changes with time from within the area where the bedding BD is located to outside the area where the bedding is located, and the extracted size of the head is the second area. When the threshold value Th2 is used to change with time from a certain size to the size of the standing posture, it is determined that the user is out of bed and the above-mentioned leaving is detected. For example, when the action detection processing unit 142 changes the position of the extracted head with time from inside the area where the bedclothes BD is located to outside the area where the bedclothes BD is located, the size of the extracted head is the first size. When the size changes from a certain size to the size of the recumbent posture with time by using the three threshold value Th3, it is determined to fall and the fall is detected. For example, the behavior detection processing unit 142 uses the extracted head position in the living room RM excluding the area where the bedding BD is located, and the extracted head size uses the third threshold Th3. If the size changes from the size of the recumbent posture to the size of the recumbent posture, the fall is determined and the fall is detected.

When the predetermined action is detected in this way, the action detection processing unit 142 notifies the event that the event information (event information) indicating the content of the predetermined event (event) related to the monitored person Ob is stored. The communication signal (first event notification communication signal) is notified to the management server SV by the SU communication IF unit 15. More specifically, the action detection processing unit 142 includes the sensor ID of its own device, event information indicating the content of the event, the time when the predetermined action is detected (detection time), and the target used for detecting the predetermined action. The first event notification communication signal containing the image is transmitted to the management server device SV via the SU communication IF unit 15. In the present embodiment, the event information is one or more of wake-up, wake-up, fall, fall, and nurse call (NC). Here, the action detection processing unit 142 detects the wake-up, wake-up, fall, and fall. One or more of the falls are accommodated in the first event notification communication signal as the event information. The image may be at least one of a still image and a moving image. In the present embodiment, first, the still image is notified, and the moving image is delivered in response to the user's request. First, the moving image may be distributed, or the still image and the moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by screen division.

When the nurse call reception operation unit 13 receives a nurse call, the nurse call processing unit 143 notifies the management server device SV of a first event notification communication signal accommodating to that effect as another example of the predetermined event, By using the sound input / output unit 12 and the like, a voice call is made between the terminal devices SP and TA. More specifically, the nurse call processing unit 143, when the nurse call reception operation unit 13 is input, operates as a sensor ID of the device itself, a time when the nurse call is detected (detection time), and the event information. The first event notification communication signal accommodating the nurse call is transmitted to the management server device SV via the SU communication IF unit 15. Then, the nurse call processing unit 143 uses the sound input / output unit 12 and the like to make a voice call with the terminal devices SP and TA by, for example, VoIP (Voice over Internet Protocol).

When there is a request for distribution of a moving image from the fixed terminal device SP or the mobile terminal device TA via the SU communication IF unit 15, the streaming processing unit 144 sends the request to the fixed terminal device SP or the mobile terminal device TA. A moving image (for example, a live moving image) generated by the image pickup unit 11 is distributed by streaming reproduction via the SU communication IF unit 15.

The SU moving image storage processing unit 145 stores the moving image generated by the imaging unit 11 in the SU storage unit 16. More specifically, the SU moving image storage processing unit 145 stores the moving image generated by the image capturing unit 11 in the first ring buffer storage unit 161 of the SU storage unit 16, and stores the moving image generated by the image capturing unit 11 as a stored moving image. Is stored in the second ring buffer storage unit 162 of the SU storage unit 16. More specifically, first, the SU moving image storage processing unit 145 sequentially outputs each frame (each frame data) in the moving image generated by the imaging unit 11 in the order of generation from the first start address of the first ring buffer storage unit 161. The data is stored up to the first end address, and when the first end address is reached, the data is returned to the first start address and stored. Then, the SU moving image storage processing unit 145 reads out the moving image of the first time stored in the first ring buffer storage unit 161 every time the first time passes, and the read moving image of the first time is the stored moving image. Is stored in the second ring buffer storage unit 162 as. That is, the SU moving image storage processing unit 145 stores each frame of the moving image generated by the imaging unit 11 sequentially from the first start address to the first end address of the first ring buffer storage unit 161, in the order of generation, When the first final address is reached, the moving image of the first time stored in the first ring buffer storage unit 161 is stored in the second ring buffer storage unit 162 as the stored moving image. Therefore, in the second ring buffer storage unit 162, the moving images of the first time stored in the first ring buffer storage unit 161 every time the first time elapses are sequentially stored in the second ring buffer storage unit 162. From the second head address to the second end address are stored, and when the second end address is reached, the second head address is stored again.

The moving image transmission processing unit 146 generates the event of the specific type generated by the imaging unit 11 when detecting the event, which is a preset specific event of the plurality of types in the present embodiment. The moving image of a predetermined first time including the time point when the event is detected is transmitted to the management server SV as an event moving image. As described above, in the present embodiment, the plurality of types of events are getting up, leaving the bed, falling, falling, and a nurse call. The specific type is appropriately preset from among these. In the present embodiment, the importance of the event is taken into consideration, and falls and falls are set as the specific types. The event moving image may be a moving image that is traced back (past) by a first time from the time (detection time) when the event of the specific type is detected, but in the present embodiment, before the time when the event is detected. In addition, a moving image generated by the imaging unit 11 (a moving image before detection) and a moving image generated by the imaging unit 11 after the event is detected (a moving image after detection) are included. The time lengths of the moving image before detection and the moving image after detection may be the same or different. In one example, when the first time is 60 seconds, each time length is 30 seconds, or from the viewpoint of emphasizing the process leading to the event, the time length of the pre-detection video is 45 seconds and after detection. The time length of the moving image is 15 seconds, or the time length of the moving image before detection is 15 seconds and the time length of the moving image after detection is 15 seconds from the viewpoint of emphasizing confirmation of the state of the monitored person Ob and the person after the event. 45 seconds. Therefore, in the present embodiment, when the motion detection processing unit 142 detects the fall, the moving image transmission processing unit 146 starts a predetermined seventh time period shorter than the first time period (30 seconds in the above example) from the time of detection. Or 45 seconds or 15 seconds), the first-time moving image stored in the first ring buffer storage unit 161 is read, and the read first-time moving image is transmitted to the management server SV as the event moving image. To do. Then, when a fall is detected by the action detection processing unit 142, the moving image transmission processing unit 146 detects the fall of the first time period stored in the first ring buffer storage unit 161 after the lapse of the seventh time period from the time of detection. A moving image is read and the read moving image of the first time is transmitted to the management server device SV as the event moving image. In the transmission of this event video, the sensor ID of the device itself, the event information of the event caused by the transmission of the event video, the detection time of the event, and the communication signal containing the event video (event video notification communication signal) are managed. It is transmitted to the server device SV.

Further, in the present embodiment, the moving image transmission processing unit 146 transmits the stored moving image stored in the second ring buffer storage unit 162 to the management server device SV. More specifically, the moving image transmission processing unit 146 reads out the stored moving image of the second time stored in the second ring buffer storage unit 162 every time the second time elapses, and stores the read second time. The moving image is transmitted to the management server device SV. That is, the moving images of the first time stored in the first ring buffer storage unit 161 every time the first time elapses are sequentially stored from the second start address to the second end address of the second ring buffer storage unit 162. When the second final address is reached, the moving image transmission processing unit 146 reads the stored moving image for the second time stored in the second ring buffer storage unit 162, and manages the read stored moving image for the second time. It is transmitted to the server device SV. In the transmission of the stored moving image, a communication signal (stored moving image notification communication signal) containing the sensor ID of the own device and the stored moving image of the second time is transmitted to the management server device SV.

The tag information addition processing unit 147 stores predetermined tag information regarding the detected event in the SU storage unit 16 when detecting an event of a remaining type of the plurality of types other than the specific type. It is associated with a stored video that is stored. As described above, in the present embodiment, the specific types are falls and falls, so the remaining types are wake-up, leaving the bed, and nurse call. The tag information is appropriately set in advance, and in the present embodiment, for example, is the event information and the detection time of the detected event. Therefore, when the action detection processing unit 142 detects the wake-up, the tag information addition processing unit 147 associates the wake-up and its detection time with the stored video as the tag information, and the action detection processing unit 142 detects that the user gets out of the bed. When the nurse call is detected by the nurse call processing unit 143, the leaving call and the detection time thereof are associated with the stored video as the tag information, and the nurse call and the detection time thereof are associated with the stored video as the tag information. In the association of the tag information, for example, the electronic file storing the tag information is stored in the SU storage unit 16, and the saved moving image for the second time stored in the second ring buffer storage unit 162 is the management server device as described above. When transmitted to the SV, the electronic file of tag information is further accommodated in the stored video notification communication signal, and the electronic file of tag information is erased from the SU storage unit 16 after transmission of the stored video notification communication signal. It Alternatively, for example, the tag information is incorporated in the data of the stored moving image and stored. The moving image data that can accommodate such metadata (tag information in this embodiment) is in the mp4 format, for example.

The SU clock unit 148 keeps time in year / month / day / hour / minute / second.

FIG. 1 shows, as an example, first to fourth sensor devices SU-1 to SU-4. The first sensor device SU-1 is Mr. A Ob-1 who is one of the monitored persons Ob. In the room RM-1 (not shown) of the second sensor device SU-2 is installed in the room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob. The third sensor device SU-3 is disposed in the room RM-3 (not shown) of Mr. C. Ob-3, who is one of the monitored persons Ob, and the fourth sensor device SU-4 is the monitored person. It is located in the room RM-4 (not shown) of Mr. D Ob-4, who is one of Ob.

In the present embodiment, the first time, the predetermined third time that is equal to or more than the first time and less than the second time, and the predetermined fourth time that is equal to or less than the third time are the same. In the embodiment in the case of the first time, the first ring buffer storage unit 161 has a storage capacity for storing a moving image of a predetermined third time that is equal to or more than the first time and less than the second time. It corresponds to an example of a storage unit of a ring buffer that holds a moving image generated by the image capturing unit. The second ring buffer storage unit 162 has a storage capacity for storing a moving image of a predetermined second time longer than the first time, and is an example of a moving image storage unit that stores the moving image generated by the imaging unit as a stored moving image. Equivalent to. The SU moving image storage processing unit 145 reads out the moving image of the fourth time stored in the storage unit of the ring buffer at every elapse of a predetermined fourth time of the third time or less, and reads out the moving image of the fourth time. Corresponds to an example of a moving image storage processing unit that stores the stored moving image in the moving image storage unit.

The management server device SV has a communication function of communicating with other devices SU, TA, and SP via the network NW, and when receiving the notification of the predetermined event from the sensor device SU, information regarding monitoring of the monitored person Ob ( Monitoring information (in the present embodiment, for example, the predetermined event (a predetermined action type detected by the sensor device SU or a nurse call accepted by the sensor device SU), an image (still image and moving image) of the monitored person Ob, and The detection time and the like)), notify (re-notify, re-notify, transmit) the predetermined event to a predetermined terminal device SP, TA, and request a client (terminal device SP, TA, etc. in the present embodiment). Is a device that provides the client with data according to the above and manages the entire monitored person monitoring support system MS. Then, in the present embodiment, the management server device SV also manages the event moving image and the stored moving image received from the sensor device SU. Such a management server device SV includes, for example, as shown in FIG. 3, a server-side communication interface unit (SV communication IF unit) 21, a server-side control processing unit (SV control processing unit) 22, and a server-side storage unit. (SV storage unit) 23.

Like the SU communication IF unit 15, the SV communication IF unit 21 is a communication circuit that is connected to the SV control processing unit 22 and performs communication under the control of the SV control processing unit 22. The SV communication IF unit 21 includes, for example, a communication interface circuit conforming to the IEEE 802.11 standard or the like.

The SV storage unit 23 is a circuit that is connected to the SV control processing unit 22 and stores various predetermined programs and various predetermined data under the control of the SV control processing unit 22. The various predetermined programs execute, for example, an SV control program that controls the

respective units

21 and 23 of the management server device SV according to the functions of the respective units, and predetermined information processing relating to monitoring of the monitored person Ob. A monitoring processing program, an SV moving image storage processing program that executes a predetermined storage processing for storing (recording) an event moving image or a stored moving image received from the sensor device SU, and an SV clock program that measures time in year / month / day / hour / minute / second. A control processing program is included. The various predetermined data include a server identifier (server ID) for identifying the management server device SV and identifying the management server device SV of the device itself, the monitoring information of the monitored person Ob, and the predetermined data. Inter-device information indicating information between devices SU, SP, TA such as event notification destinations, sensor information about sensor devices SU, terminal information about terminal devices SP, TA, the event moving images, the saved moving images, etc. Data and the like necessary for executing each program are included. The SV storage unit 23 stores the monitoring information, the inter-device information, the sensor information, the terminal information, the event moving image, and the stored moving image, respectively, in the monitoring information storage unit 231, the inter-device information storage unit 232, and the sensor information storage unit 233. A terminal information storage unit 234, an event moving image storage unit 235, and a saved moving image storage unit 236 are functionally provided.

The SV monitoring information storage unit 231 stores the monitoring information of the monitored person Ob transmitted / received to / from each of the devices SU, SP, TA. More specifically, in the present embodiment, the SV monitoring information storage unit 231 stores the sensor ID and the event information as the monitoring information based on the information contained in the communication signal such as the first event notification communication signal. (Event information, waking up, leaving the bed, falling, falling, and nurse call in the present embodiment), detection time, target image, communication address of the sensor device SU as the acquisition source of the live video, and presence / absence of correspondence (presence / absence of correspondence) It is stored in association with each other. The presence / absence of the coping means that the monitor person who handles the terminal devices SP and TA has an intention to coping (correspondence, treatment, measure) with respect to the event information contained in the communication signal received by the terminal devices SP and TA, This is information indicating whether or not it has been accepted by the terminal devices SP and TA.

In the present embodiment, the inter-device information storage unit 232 indicates a notification destination (re-notification destination, re-notification destination, transmission destination) of the first event notification communication signal or the like transmitted from the sensor device SU in the present embodiment. , The correspondence between the sensor ID that is the transmission source and the terminal ID that is the notification destination (re-notification destination) (correspondence of the notification destination), and the ID (sensor ID, terminal ID) of each device SU, SP, TA and its The correspondence relationship with the communication address (communication address correspondence relationship) and the like are stored. The terminal ID is a terminal identifier for identifying the terminal devices SP and TA and identifying the terminal devices SP and TA.

Note that each of the sensor ID, server ID, and terminal ID may be, for example, a serial number or the like formed of a predetermined symbol string, or may be, for example, a communication address (in this case, the communication address correspondence can be omitted).

The sensor information storage unit 233 stores the sensor information. In the present embodiment, the sensor information is information related to the sensor device SU, and is information in which the sensor ID of the sensor device SU and the monitored person name of the monitored person Ob are associated with each other.

In the present embodiment, the terminal information storage unit 234, as the terminal information, is a login monitor who indicates a monitor (user) who logs in to the terminal devices SP and TA (monitorer who handles the terminal devices SP and TA). Information and supervisor work information indicating the supervisor's work status (shift work hours) are stored.

The event moving image storage unit 235 stores the event moving image. In the present embodiment, the event moving image storage unit 235 stores an electronic file of the event moving image and predetermined attribute information (event moving image attribute information) in the event moving image. In the present embodiment, the event moving image attribute information is stored in the event moving image storage unit 235 in a table format as shown in FIG. 4, for example. The event moving image attribute information table IT shown in FIG. 4 includes the sensor ID contained in the event moving image notification communication signal, the event information and the detection time, and the file name of the event moving image contained in the event moving image notification communication signal (event moving image file Each of the event moving images (event moving image file name) has a record, which includes a sensor ID field 2351 for registering each of them), an event field 2352, a detection time field 2353, and an event moving image file name field 2354. By referring to the event video attribute information, the monitored person (sensor ID) related to the event video, the type of event detected (event information), and the detection time can be recognized (who recognizes what event caused which event). it can). In the detection time field 2353, the reception time of the received event moving image notification communication signal may be registered instead of the detection time.

The saved moving image storage unit 236 stores the saved moving image. In this embodiment, the saved moving image storage unit 236 stores an electronic file of the saved moving image and predetermined attribute information (saved moving image attribute information) in the saved moving image. In the present embodiment, the saved moving image attribute information is stored in the saved moving image storage unit 236 in a table format as shown in FIG. 5, for example. The saved moving image attribute information table LT shown in FIG. 5 registers the sensor ID accommodated in the saved moving image notification communication signal and the file name (saved moving image file name) of the saved moving image housed in the saved moving image notification communication signal. A sensor ID field 2361 and a saved moving image file name field 2364 are provided, and each saved moving image (saved moving image file name) has a record. In the present embodiment, the case where tag information is stored in the stored moving image notification communication signal is considered, and the stored moving image attribute information table LT further includes event information in the tag information stored in the stored moving image notification communication signal. An event field 2362 and a detection time field 2363 for registering each detection time are provided. In the present embodiment, in order to delete the stored moving image after a lapse of a predetermined time, if the stored moving image notification communication signal does not contain tag information, the detection time field 2363 indicates the stored moving image notification communication signal. The reception time is registered. Further, even when the stored moving image notification communication signal contains tag information, the detection time field 2363 may register the reception time of the stored moving image notification communication signal instead of the detection time. By referring to the saved moving image attribute information, the monitored person (sensor ID) and the reception time relating to the saved moving image can be recognized, and when the saved moving image notification communication signal includes the tag information, the saved moving image is further stored. It is possible to recognize the type of detected event (event information) and the detection time related to.

The SV control processing unit 22 controls the

respective units

21 and 23 of the management server device SV in accordance with the functions of the respective units, and when receiving the notification of the predetermined event from the sensor device SU, monitors the monitored person Ob. Information management is performed, the predetermined event is notified to predetermined terminal devices SP and TA (re-notification, re-notification, transmission), data is provided to the client according to the request of the client, and a monitored person monitoring support system is provided. This is a circuit for managing the entire MS. Then, in the present embodiment, the SV control processing unit 22 also manages the event moving image and the stored moving image received from the sensor device SU. The SV control processing unit 22 includes, for example, a CPU and its peripheral circuits. The SV control processing unit 22 executes the control processing program, whereby the server-side control unit (SV control unit) 221, the monitoring processing unit 222, the server-side moving image storage processing unit (SV moving image storage processing unit) 223, and the server. A side clock unit (SV clock unit) 224 is functionally provided.

The SV control unit 221 controls the

respective units

21 and 23 of the management server device SV according to the functions of the respective units, and controls the entire management server device SV.

Upon receiving the notification of the predetermined event from the sensor device SU, the monitoring processing unit 222 manages the monitoring information regarding the monitoring of the person Ob to be monitored and notifies the predetermined terminal device SP, TA of the predetermined event. . More specifically, when the monitoring processing unit 222 receives the first event notification communication signal from the sensor device SU, the monitoring information regarding the monitoring of the person Ob to be monitored contained in the received first event notification communication signal. Is stored (recorded) in the SV monitoring information storage unit 231. The monitoring processing unit 222 stores the notification destination (re-notification destination, transfer destination, transmission destination) corresponding to the sensor device SU that has transmitted the received first event notification communication signal in the inter-device information storage unit 232. The second event notification communication signal is selected based on the selection result (search) based on the notification destination correspondence relationship, and the generated second event notification communication signal is transmitted by the SV communication IF unit 21. The selection (search processing) of the notification destination terminal devices SP and TA is performed based on the sensor ID corresponding to the sensor device SU that has transmitted the received first event notification communication signal. If the event information contained in the first event notification communication signal is the predetermined action (one or more of getting up, leaving the bed, falling, and falling), the second event notification communication signal includes The communication address corresponding to the sensor device SU having the sensor ID stored in the first event notification communication signal is stored as the download destination of the sensor ID stored in the one event notification communication signal, the event information and the target image, and the moving image. To be done. When the event information contained in the first event notification communication signal is the nurse call, the sensor ID and event information contained in the first event notification communication signal are contained in the second event notification communication signal. To be done.

The SV moving image storage processing unit 223 executes a predetermined storage process for storing (recording) an event moving image or a stored moving image received from the sensor device SU.

More specifically, first, when the event moving image notification communication signal is received, the SV moving image storage processing unit 223 stores the event moving image stored in the received event moving image notification communication signal in the SV storage unit 23. It is stored in the unit 235. If the electronic file of the event moving image does not have a file name (event moving image file name), the SV moving image storage processing unit 223 first receives a predetermined file name (for example, a code string indicating that the event moving image is received). The event moving image is stored in the event moving image storage unit 235 with a file name including a serial number assigned sequentially from the event moving image. Then, the SV moving image storage processing unit 223 newly adds a record to the event moving image attribute information table IT stored in the event moving image storage unit 235, and the sensor ID field 2351, the event field 2352, and the detection time in the added record. In each of the fields 2353, the sensor ID, the event information, and the detection time contained in the received event moving image notification communication signal are registered, and in the event moving image file name field 2354 in this added record, the received event moving image notification communication is registered. Register the event video file name of the event video stored in the signal.

On the other hand, when the saved moving image notification communication signal is received, the SV moving image storage processing unit 223 stores the saved moving image accommodated in the received saved moving image notification communication signal in the saved moving image storage unit 236 of the SV storage unit 23. When the electronic file of the saved moving image does not have a file name (saved moving image file name), the SV moving image storage processing unit 223 first receives a predetermined file name (for example, a code string representing the saved moving image and the received file). The saved moving image is stored in the saved moving image storage unit 236 with a file name including a serial number assigned in order from the event moving image. Then, the SV moving image storage processing unit 223 newly adds a record to the saved moving image attribute information table LT stored in the saved moving image storage unit 236, and adds the received event moving image to the sensor ID field 2351 in the added record. The sensor ID accommodated in the notification communication signal is registered, and the saved moving image file name of the saved moving image accommodated in the received saved moving image notification communication signal is registered in the saved moving image file name field 2364 in this added record. Then, when the received event moving image notification communication signal contains the tag information, the SV moving image storage processing unit 223 causes the event field 2362 and the detection time field 2363 in the newly added record to receive the received information. When the event information and the detection time in the tag information accommodated in the stored video notification communication signal are registered, and the tag information is not accommodated in the received event video notification communication signal, the SV video storage processing unit 223 The reception time of the received stored video notification communication signal is registered in the detection time field 2363 of the newly added record.

Further, in the present embodiment, the SV moving image storage processing unit 223 determines that a predetermined fifth time period longer than the second time period has elapsed from the reception time at which the event moving image was received from the sensor device SU or the detection time of the event related to the event moving image. After the elapse, the event moving image is deleted from the event moving image storage unit 235. More specifically, the SV moving image storage processing unit 223 registers in the detection time field 2353 in the event moving image attribute information table IT at a preset time of the day such as midnight when the date is switched. If the fifth time has elapsed from the detection time or the reception time registered in the detection time field 2353 as a result of the reference, the event moving image file in this record is referred to. The electronic file of the event moving image having the event moving image file name registered in the name field 2354 is deleted from the event moving image storage unit 235, and this record is deleted (deleted) from the event moving image attribute information table IT. The fifth time is appropriately set in advance, for example, 1 month, 3 months, 6 months, or the like, by considering the storage period of the event moving image and the like. Then, the SV moving image storage processing unit 223 stores the stored moving image after a predetermined sixth time longer than the second time from the reception time when the stored moving image is received from the sensor device SU or the detection time of the event related to the stored moving image. The saved moving image stored in the storage unit 236 is deleted from the saved moving image storage unit 236. More specifically, the SV moving image storage processing unit 223 registers in the detection time field 2363 in the saved moving image attribute information table LT at a preset time of the day, such as midnight when the date is switched. If the sixth time has passed from the detection time or the reception time registered in the detection time field 2363 as a result of the reference, the saved moving image file in this record is referred to. The electronic file of the saved moving image having the saved moving image file name registered in the name field 2364 is deleted from the saved moving image storage unit 236, and this record is deleted (deleted) from the saved moving image attribute information table LT. The sixth time is appropriately set in advance, for example, 1 month, 3 months, 6 months, or the like, by considering the storage period of the stored moving images and the like. The fifth time and the sixth time may be the same as each other or may be different from each other.

The SV clock unit 224 keeps time by year / month / day / hour / minute / second.

Note that the management server device SV is further connected to the SV control processing unit 22 as necessary, for example, as shown by a broken line in FIG. ) 24, various commands and various data input by the SV input unit 24, a server-side output unit (SV output unit) 25 that outputs monitoring information regarding monitoring of the monitored person Ob, and data with external devices. A server-side interface unit (SVIF unit) 26 for inputting and outputting the data may be provided.

Such a management server device SV can be configured by, for example, a computer with a communication function.

The management server device SV corresponds to an example of a central processing unit. The SV moving image storage processing unit 223 detects the event moving image after a predetermined fifth time longer than the second time from the reception time when the event moving image is received from the sensor device or the detection time of the event related to the event moving image. Corresponds to an example of the event moving image deletion processing unit that deletes the event moving image storage unit. Then, the SV moving image storage processing unit 223, after a lapse of a predetermined sixth time longer than the second time, from the reception time when the stored moving image is received from the sensor device or the detection time of an event related to the stored moving image, It also corresponds to an example of the saved moving image deletion processing unit that deletes the saved moving image stored in the saved moving image storage unit from the saved moving image storage unit.

The fixed terminal device SP has a communication function of communicating with other devices SU, SV, TA via the network NW, a display function of displaying predetermined information, an input function of inputting predetermined instructions and data, and the like. By inputting a predetermined instruction or data to be given to the management server device SV or the portable terminal device TA, or by displaying the monitoring information obtained by the sensor device SU by the notification from the management server device SV, the person to be monitored It is a device that functions as a user interface (UI) of the monitoring support system MS. In the present embodiment, the fixed terminal device SP also displays the event moving image and the stored moving image designated by the user. Such a fixed terminal device SP can be configured by, for example, a computer with a communication function.

The mobile terminal device TA performs a communication function of communicating with other devices SV, SP, and SU via the network NW, a display function of displaying predetermined information, an input function of inputting predetermined instructions and data, and a voice call. It has a call function to perform, inputs predetermined instructions and data to be given to the management server device SV and the sensor device SU, displays the monitoring information obtained by the sensor device SU by a notification from the management server device SV, It is a device for responding to a nurse call or making a voice call by a voice call with the sensor device SU. In the present embodiment, the mobile terminal device TA also displays the event moving image and the stored moving image designated by the user. Such a mobile terminal device TA can be configured by, for example, a tablet computer with a communication function or a so-called smartphone.

Next, the operation of the monitored person monitoring support system MS in the present embodiment will be described. FIG. 6 is a flowchart showing an operation regarding storage of a stored moving image in the sensor device. FIG. 7 is a flowchart showing an operation regarding transmission of a stored moving image in the sensor device. FIG. 8 is a sequence diagram showing an operation regarding notification of an event in the monitored person monitoring support system. FIG. 9 is a flowchart showing an operation regarding transmission of an event moving image in the sensor device.

In such a monitored person monitoring support system MS, each device SU, SV, SP, TA, when the power is turned on, executes necessary initialization of each unit and starts its operation. In the sensor device SU, by executing the control processing program, the SU control processing unit 14 causes the SU control unit 141, the behavior detection processing unit 142, the nurse call processing unit 143, the SU streaming processing unit 144, and the SU moving image storage processing unit 145. The video transmission processing unit 146, the tag information addition processing unit 147, and the SU clock unit 148 are functionally configured. In the management server device SV, the SV control processing unit 22 functionally includes the SV control unit 221, the monitoring processing unit 222, the SV moving image storage processing unit 223, and the SV clock unit 224 by executing the control processing program. ..

First, the processing of the moving image generated by the image pickup unit 11 in the sensor device SU will be described. When the sensor device SU starts its operation, the sensor device SU causes the SU moving image storage processing unit 145 of the SU control processing unit 14 to generate each frame (each frame data) in the moving image generated by the imaging unit 11 in the order of generation. The first leading address to the first final address of the first ring buffer storage unit 161 are sequentially stored, and when the first final address is reached, the first leading address is stored again and the storage is repeated thereafter.

While storing each frame of the moving image generated by the imaging unit 11 in the first ring buffer storage unit 161, the SU moving image storage processing unit 145 corresponds to the first ring buffer storage unit 161 in FIG. It is determined whether the storage process has completed one cycle (S11). That is, it is determined whether the frame storage process has reached the first final address. If the result of this determination is that one cycle has not been completed (No if the first final address has not been reached), the SU moving image storage processing unit 145 returns the processing to step S11. That is, the process S11 is repeated until one cycle is completed. On the other hand, as a result of the determination, when the circuit has completed one cycle (when the first final address has been reached, Yes), the SU moving image storage processing unit 145 stores the first moving image stored in the first ring buffer storage unit 161. The one-hour moving image is stored in the second ring buffer storage unit 162 as a stored moving image (S12), and then the process S13 is executed.

In this processing S13, the sensor device SU determines by the SU control processing unit 14 whether or not its operation is completed (stopped). If the result of this determination is that the operation has ended (stopped) (Yes), the sensor device SU ends this processing, while if it has not ended (stopped) the operation (No), the sensor device SU has ended. The SU returns the process to the process S11.

Then, when the moving image of the first time stored in the first ring buffer storage unit 161 is stored as the stored moving image in the second ring buffer storage unit 162, the SU moving image storage processing unit 145, in FIG. It is determined whether the storage process for the second ring buffer storage unit 162 has completed one cycle (S21). That is, it is determined whether the storage process for the moving image for the first time has reached the second final address. If the result of this determination is that one cycle has not been completed (No if the second final address has not been reached), the SU moving image storage processing unit 145 returns the processing to step S21. That is, the process S21 is repeated until one cycle is completed. On the other hand, as a result of the determination, when the circuit has completed one cycle (when the second final address has been reached, Yes), the moving image transmission processing unit 146 of the SU control processing unit 14 causes the second ring buffer storage unit 162 to store the second ring buffer storage unit 162. The stored stored video for the second time is transmitted to the management server SV by the stored video notification communication signal (S22), and then the processing S23 is executed.

In this process S23, the sensor device SU determines by the SU control processing unit 14 whether or not its operation is completed (stopped). If the result of this determination is that operation has ended (stopped) (Yes), the sensor device SU ends this processing, while if it has not ended (stopped) operation (No), the sensor device SU has ended. The SU returns the process to the process S21.

Each frame of the moving image generated by the image capturing unit 11 in this manner is stored in the first ring buffer storage unit 161, and the storage process for the first ring buffer storage unit 161 reaches from the first start address to the first end address. After one cycle, the first time moving image (first time length moving image) stored in the first ring buffer storage unit 161 is stored in the second ring buffer storage unit 162 as a saved moving image. When the storage process for the second ring buffer storage unit 162 reaches the second end address from the second start address and completes one cycle, the second time saved moving image stored in the second ring buffer storage unit 162 (second The stored video of the length of time) is transmitted to the management server device SV by a stored video notification communication signal.

Next, the operation regarding notification of an event in the monitored person monitoring support system MS will be described. In FIG. 8, when the sensor device SU detects an event (C1), in order to notify the detected event, the sensor device SU transmits a first event notification communication signal to the management server device SV (C2). More specifically, when the sensor device SU starts its operation, the sensor device SU detects the predetermined event by operating in each frame or every several frames as follows, and detects the predetermined event. When detecting the, the first event notification communication signal is transmitted to the management server device SV. The sensor device SU acquires an image (image data) for one frame from the imaging unit 11 as a target image, detects a predetermined action of the monitored person Ob based on the acquired target image, and performs the predetermined action. Upon detection, in order to notify the predetermined terminal device SP, TA of the detection result, the SU communication IF unit 15 sends the first event notification communication signal of the action detection accommodating the predetermined action detected as the event information. To send to the management server SV. While operating in this way, the sensor device SU determines whether or not the nurse call is accepted, and when the nurse call is accepted, the sensor device SU notifies the predetermined terminal devices SP and TA of the acceptance of the nurse call. In addition, the sensor device SU transmits the first event notification communication signal of the nurse call detection accommodating the received nurse call as the event information to the management server device SV by the SU communication IF unit 15.

Subsequently, when the first event notification communication signal is received from the sensor device SU (C3), the management server device SV records (stores) the monitoring information by the received first event notification communication signal by the monitoring processing unit 222. (C4), a second event notification communication signal corresponding to the received first event notification communication signal is transmitted to a predetermined terminal device SP, TA (C5). More specifically, when the monitoring processing unit 222 receives the first event notification communication signal from the sensor device SU via the network NW, the sensor ID and event information contained in the received first event notification communication signal, etc. The above information is stored (recorded) in the SV storage unit 23 as the monitoring information of the monitored person Ob monitored by the sensor device SU having this sensor ID. Then, the monitoring processing unit 222 generates the second event notification communication signal addressed to the terminal devices SP and TA having the terminal ID corresponding to the sensor ID accommodated in the received first event notification communication signal, and generates this. The second event notification communication signal is transmitted by the SV communication IF unit 21.

Then, when the second event notification communication signal is received from the management server device SV (C6), the terminal devices SP and TA which have received the second event notification communication signal detect the sensors accommodated in the second event notification communication signal. Each information such as ID and event information is stored as the monitoring information of the monitored person Ob who is monitored by the sensor device SU having this sensor ID, and the monitoring information is displayed (C7). As a result, the event detected by the sensor device SU is displayed on the predetermined terminal devices SP and TA via the management server device SV.

The supervisor NS, such as a nurse or a caregiver who referred to the monitoring information, inputs a call request to the terminal devices SP and TA, for example, to make a call. Upon receiving this input, the terminal devices SP and TA transmit a communication signal (call request communication signal) for requesting a call to the sensor device SU having the sensor ID associated with the displayed monitoring information. In response to the call request, the terminal devices SP and TA and the sensor device SU are connected so that they can talk by VoIP, and the supervisor NS talks with the monitored person Ob.

Also, for example, in order to refer to a moving image live, the monitor NS inputs a moving image request to the terminal devices SP and TA. Upon receiving this input, the terminal devices SP and TA transmit a communication signal (moving image request communication signal) for requesting a moving image to the sensor device SU having the sensor ID related to the monitoring information being displayed. In response to the request for the moving image, the terminal devices SP and TA and the sensor device SU are connected so that the moving image can be played back by streaming, and the monitor NS refers to the moving image displayed on the terminal devices SP and TA.

Next, the process related to the transmission of the event moving image in the sensor device SU will be described. While the event is notified by detecting the event as described above, the sensor device SU transmits the event moving image by operating as follows.

In FIG. 9, when an event is detected as described with reference to FIG. 8 (S31, process C1 shown in FIG. 8), the sensor device SU causes the moving image transmission process 146 of the SU control processing unit 14 to detect the detected event. It is determined whether the type is a specific type (S32). As a result of this determination, when the type is the specific type (Yes), the sensor device SU sequentially executes each process of process S34, process S35, and process S36 by the moving image transmission process 146 of the SU control processing unit 14. After this, this processing is terminated. On the other hand, as a result of the determination, when it is not the specific type (No, when it is the residual type), the sensor device SU causes the tag information addition processing unit 147 of the SU control processing unit 14 to perform the processing S33. After the execution, this process ends.

In process S34, in order to generate an event moving image including the pre-detection moving image and the post-detection moving image, the moving image transmission process 146 functionally generates the timer set in the seventh time in the SU control processing unit 14, Run this generated timer.

In process S35 subsequent to process S34, the moving image transmission process 146 determines whether or not the timer has timed out. If the result of this determination is that the time has not expired (No), the moving image transmission processing 146 returns the processing to processing S35. That is, the process S35 is repeated until the time is up. On the other hand, as a result of the determination, when the time is up (Yes), the moving image transmission processing 146 executes processing S36.

In this process S36, the moving image transmission process 146 transmits the event moving image to the management server device SV. More specifically, the moving image transmission process 146 reads out the moving image for the first time stored in the first ring buffer storage unit 161, and uses the read moving image for the first time as an event moving image as an event moving image notification communication signal. It is transmitted to the management server device SV. Therefore, the moving image stored in the first ring buffer storage unit 161 is read out to be stored as a stored moving image in the second ring buffer storage unit 162 as described above, while a specific type of event is detected. In this case, it is read for transmission as an event moving image to the management server device SV. It should be noted that although there is a possibility that they match, the moving image that is read in order to store it as a saved moving image in the second ring buffer storage unit 162 and the moving image that is read out to be transmitted as an event moving image to the management server SV are normally used. ,It does not match.

On the other hand, in the process S33, the tag information addition processing unit 147 associates the predetermined tag information regarding the detected event with the saved moving image stored in the SU storage unit 16. For example, the tag information (event information and detection time in this embodiment) is incorporated and stored in the data of the saved moving image.

When an event is detected in this way, if the detected event type is the specific type (falling and falling in this embodiment), the event moving image is an event moving image notification communication signal and the management server device SV. When the detected event type is the remaining type (wake-up, wake-up and nurse call in this embodiment), the tag information is associated with the stored moving image.

Next, the processing relating to the event moving image and the stored moving image in the management server device SV will be described.

When the stored video notification communication signal transmitted from the sensor device SU is received as described above, the management server device SV is accommodated in the received stored video notification communication signal by the SV video storage processing unit 223 of the SV control processing unit 22. The stored video thus stored is stored in the storage video storage unit 236 of the SV storage unit 23. Then, the management server device SV newly adds a record to the saved moving image attribute information table LT stored in the saved moving image storage unit 236 by the SV moving image storage processing unit 223 of the SV control processing unit 22, and the added record In the sensor ID field 2351 of the above, the sensor ID accommodated in the received event moving image notification communication signal is registered, and in the saved moving image file name field 2364 of this added record, the received stored moving image notification communication signal is accommodated. Register the saved movie file name of the saved movie. Then, when the received event moving image notification communication signal contains the tag information, the SV moving image storage processing unit 223 causes the event field 2362 and the detection time field 2363 in the newly added record to receive the received information. When the event information and the detection time in the tag information accommodated in the stored video notification communication signal are registered, and the tag information is not accommodated in the received event video notification communication signal, the SV video storage processing unit 223 The reception time of the received stored video notification communication signal is registered in the detection time field 2363 of the newly added record.

On the other hand, the SV moving image storage processing unit 223 stores the saved moving image stored in the saved moving image storage unit 236 after the sixth time has elapsed from the reception time of the saved moving image or the detection time of the event related to the saved moving image. Erase from the section 236. More specifically, the SV moving image storage processing unit 223 sets the detection time or the reception time registered in the detection time field 2363 in the saved moving image attribute information table LT at a preset time in one day, for example. As a result of the reference, if the sixth time has elapsed from the detection time or the reception time registered in the detection time field 2363, the save registered in the save moving image file name field 2364 in this record The electronic file of the saved moving image having the moving image file name is deleted from the saved moving image storage unit 236, and this record is deleted from the saved moving image attribute information table LT.

Further, as described above, upon receiving the event moving image notification communication signal transmitted from the sensor device SU, the management server device SV causes the SV moving image storage processing unit 223 of the SV control processing unit 22 to receive the received event moving image notification communication. The event moving image stored in the signal is stored in the event moving image storage unit 235 of the SV storage unit 23. Then, in the management server device SV, the SV moving image storage processing unit 223 of the SV control processing unit 22 newly adds a record to the event moving image attribute information table IT stored in the event moving image storage unit 235, and the added record In the sensor ID field 2351, the event field 2352, and the detection time field 2353 in each, the sensor ID, event information, and detection time contained in the received event video notification communication signal are registered, and the event video file in this added record is registered. In the name field 2354, the event video file name of the event video stored in the received event video notification communication signal is registered.

On the other hand, the SV moving image storage processing unit 223 deletes the event moving image from the event moving image storage unit 235 after the lapse of the fifth time from the reception time of the event moving image or the detection time of the event related to the event moving image. More specifically, the SV moving image storage processing unit 223 sets the detection time or the reception time registered in the detection time field 2353 in the event moving image attribute information table IT at a preset time in one day, for example. If the reference result indicates that the fifth time has elapsed from the detection time or the reception time registered in the detection time field 2353, the event registered in the event moving image file name field 2354 in this record. The electronic file of the event moving image having the moving image file name is deleted from the event moving image storage unit 235, and this record is deleted from the event moving image attribute information table IT.

In this way, the event moving image is stored in the management server device SV and deleted after the lapse of the fifth time, and the saved moving image is stored in the management server device SV and deleted after the lapse of the sixth time.

As described above, the monitored person monitoring support system MS, the sensor device SU, and the monitoring image storage method implemented therein according to the present embodiment include the event generated by the imaging unit 11 when the event is detected. While transmitting the moving image of the predetermined first time including the time point when the event is detected to the management server SV as the event moving image, the moving image generated by the image pickup unit 11 is stored in the second ring buffer storage unit 162 as the stored moving image. . Therefore, the management server device SV can save the event moving image, and the monitored person monitoring support system MS, the sensor device SU, and the monitoring image saving method, while saving the image at the time of occurrence, are lost as the saved moving image. You can also save the time image. Therefore, it is possible to verify the event using the event moving image immediately after the occurrence of the event, and it is also possible to verify the event found later using the saved moving image, and the verification of both of them can be efficiently performed.

In the monitored person monitoring support system MS, the sensor device SU, and the monitoring image storage method, the moving image generated by the imaging unit 11 is stored in the first ring buffer storage unit 161, and is stored in the first ring buffer storage unit 161. The event moving image is transmitted to the management server SV from the moving image while the stored moving image is stored in the second ring buffer storage unit 162. Therefore, the monitored person monitoring support system MS, the sensor device SU, and the monitored image saving method have a simplified configuration, and when the situation of a patient or the like is confirmed later, the contents of the event moving image and the saved You can treat the contents of the video with the same value. For example, the content of the event moving image and the content of the stored moving image can be treated equally as evidence. In addition, since the first ring buffer storage unit 161 is a ring buffer, the monitored person monitoring support system MS, the sensor device SU, and the monitoring image storage method can be realized with a memory device having a minimum storage capacity for storing the moving image of the first time. The oldest (oldest) stored moving image frame is overwritten by the moving image frame generated by the image capturing unit at this point in time after the first time has passed since the first moving image was stored in the first ring buffer storage unit 161. It can be erased automatically.

In the above-mentioned monitored person monitoring support system MS, sensor device SU, and monitoring image storage method, since the second ring buffer storage unit 162 is a ring buffer, a memory device having a minimum storage capacity for storing a second time moving image is used. The monitored person monitoring support system MS, the sensor device SU, and the monitoring image saving method can be configured, and after the second time has elapsed since the moving image was stored in the second ring buffer storage unit 162, the oldest (oldest) stored moving image is stored. The frame is overwritten with the frame of the movie stored at this point and can be automatically erased.

In the monitored person monitoring support system MS, the sensor device SU, and the monitoring image storage method, the management server device SV can refer to the management server device SV by storing the event moving image related to a specific type of event in the management server device SV. The videos related to the type of event can be referenced in the saved videos based on the tag information.

In the above-described embodiment, when the moving image of the first time is stored from the first ring buffer storage unit 161 to the second ring buffer storage unit 162 as the stored moving image, the moving image of the first time is stored with the same image quality. However, the image quality may be changed and then stored. For example, the stored moving image is stored in the second ring buffer storage unit 162 from the first ring buffer storage unit 161 with the second image quality lower than the first image quality of the first time moving image (for example, the event moving image). More specifically, for example, the SU moving image storage processing unit 145 images the moving image of the first time stored in the first ring buffer storage unit 161 so that the moving image of the first time becomes a second resolution lower than the first resolution. A saved moving image is generated by processing, and the saved moving image of the second resolution is stored in the second ring buffer storage unit 162. In one example, the resolution is changed from 1920x1080 to 1280x720. Alternatively, for example, the SU moving image storage processing unit 145 performs image processing on the moving image for the first time period stored in the first ring buffer storage unit 161 so that the second frame rate becomes lower than the first frame rate. Thus, the stored moving image is generated, and the stored moving image having the second frame rate is stored in the second ring buffer storage unit 162. In one example, the frame rate is changed from 30 fps to 15 fps. According to this, since the stored moving image has the second image quality lower than the first image quality of the first time moving image (for example, the event moving image), the second ring buffer storage unit 162 can be configured with a memory device having a smaller storage capacity. .

Further, in the above-described embodiment, the predetermined action of the monitored person Ob is detected as one of the events from the image generated by the image pickup unit 11, but the present invention is not limited to this, and the image pickup unit 11 is used instead. Alternatively, in addition to the imaging unit 11, a predetermined action in the monitored person Ob may be detected by another sensor. For example, a radar (or active sonar) may be used instead of the image pickup unit 11 or in addition to the image pickup unit 11. A method of detecting a predetermined action using radar (or active sonar) is disclosed in, for example, WO2018 / 186042 (PCT / JP2018 / 006492). When the imaging unit 11 and the radar (or active sonar) are used, for example, a final detection result is obtained by ORing the first detection result of the imaging unit 11 and the second detection result of the radar (or active sonar). Is determined. When the first detection result of the image pickup unit 11 and the second detection result of the radar (or active sonar) are the same and within a predetermined time, they may be integrated into one.

Further, in the above-described embodiment, the time length of the event moving image and the time length of the stored moving image stored in the first ring buffer storage unit 161 to the second ring buffer storage unit 162 are the same first time, but different. May be. That is, the first ring buffer storage unit 161 has a storage capacity capable of storing a moving image of the same first time as the time length of the event moving image in the above-described embodiment, but a storage capacity capable of storing a moving image of the first time or longer. May be Further, in the above-described embodiment, when the storage process for the first ring buffer storage unit 161 has completed one cycle, the moving image of the first time from the first start address to the first end address is stored as a moving image in the first ring buffer storage unit. Although stored from 161 in the second ring buffer storage unit 162, the moving images stored in a partial storage area of the first ring buffer storage unit 161 may be sequentially stored in the second ring buffer storage unit 162. . That is, the first ring buffer storage unit 161 has a storage capacity for storing a moving image for a predetermined third time period that is equal to or longer than the first time period and shorter than the second time period, and the moving image generated by the imaging unit 11 is stored. The SU moving image storage processing unit 145 stores the first ring buffer storage unit 161 (an example of the storage unit of the ring buffer) every time a predetermined fourth time period equal to or less than the third time period elapses. ), The moving image for the fourth time stored in the second ring buffer storage unit 162 (an example of the moving image storage unit) is stored as the stored moving image, and the moving image is transmitted. When the processing unit 146 detects the event, the processing unit 146 reads the moving image of the first time stored in the first ring buffer storage unit 161, and the management server device uses the read moving image of the first time as the event moving image. Send to SV. Preferably, the third time period is a multiple of the fourth time period. In one example, the third time period is 10 minutes and the fourth time period is 2 minutes. In this example, the first ring buffer storage unit 161 makes a cycle every 10 minutes, and during this cycle of 10 minutes, a moving image of 2 minutes every 2 minutes is stored as a moving image in the first ring buffer storage unit 161. From the first ring buffer storage unit 162 and are sequentially stored in the second ring buffer storage unit 162. Further, in this case, the two stored moving images that are adjacent in time series may have an overlap for a predetermined time (several frames), or may not have the overlap.

Further, in the above-described embodiment, when the storage process for the second ring buffer storage unit 162 has completed one cycle, the stored video for the second time stored in the second ring buffer storage unit 162 is the stored video notification communication signal. Although transmitted to the management server device SV, the stored moving image of the second time is not transmitted to the management server device SV and is erased by being sequentially overwritten from the second top address of the second ring buffer storage unit 162. May be done. By ensuring that the second ring buffer storage unit 162 has a storage capacity for the number of days required for confirmation at a later date, it is possible to sufficiently deal with the confirmation at a later date, and the management server device can store the stored moving image for the second time. It is not necessary to secure the storage capacity of SV.

Further, in the above-described embodiment, the management server device SV deletes the saved moving image after the sixth time has elapsed, but the saved moving image storage unit 236 is configured by the ring buffer from the third start address to the third final address, The management server device SV sequentially stores the stored moving image received from the sensor device SU from the third start address to the third end address for each reception, and when the third end address is reached, the third start address is stored. The stored moving images may be sequentially erased by returning to and storing by overwriting.

Further, in the above-described embodiment, tag information is added when the detected event type is not a specific type, but tag information is added to all types regardless of the detected event type. May be done.

The present specification discloses various aspects of the technology as described above, and the main technologies are summarized below.

A sensor device according to one aspect is provided corresponding to a monitored person who is a monitoring target, is connected to a sensor device that detects a predetermined event related to the monitored person, and is communicably connected to the sensor device. A central management device that manages the event by receiving notification of the event detected by, and receives notification of the event detected by the sensor device via the central management device that is communicably connected to the central management device. The sensor device of the monitored person monitoring support system for supporting the monitoring of the monitored person, comprising: a terminal device; and an imaging unit that generates a moving image, and an imaging unit that detects the event. A moving image transmission processing unit that transmits the generated moving image of a predetermined first time including the time when the event is detected to the central management device as an event moving image, and a moving image of a predetermined second time longer than the first time. A moving image storage unit having a storage capacity for storing and storing a moving image generated by the imaging unit as a stored moving image. Preferably, in the above-mentioned sensor device, the event moving image is a moving image generated by the image capturing unit before the time when the event is detected (a pre-detection moving image), and an image generated by the image capturing unit after the time when the event is detected. The generated moving image (moving image after detection) is included. Preferably, in the above-described sensor device, the event includes a plurality of types, and the moving image transmission processing unit, in the case of detecting an event of a specific preset type of the plurality of types, A moving image of a predetermined first time period including the time when the event is detected, which is generated by the imaging unit, is transmitted to the central management device as an event moving image. Preferably, the types of the events are wake-up, leaving the bed, falls, falls and nurse calls, and the specific types are the falls and the falls. Preferably, in the above-described sensor device, the moving image transmission unit further transmits the stored moving image stored in the moving image storage unit to the central management device.

When such a sensor device detects the event, the sensor device transmits, to the central management device, a moving image of a predetermined first time including the time when the event is detected, which is generated by the imaging unit, as an event moving image. Then, the moving image generated by the image capturing unit is stored in the moving image storage unit as a stored moving image. Therefore, it becomes possible to save the event moving image in the central management device, and the sensor device can save the image at the time of a failure as the saved moving image while saving the image at the time of occurrence.

In another aspect, in the above-described sensor device, the moving image generated by the imaging unit has a storage capacity for storing a moving image for a predetermined third time that is the first time or more and is less than the second time. And a storage unit of a ring buffer for storing the moving image, and a fourth time moving image stored in the storage unit of the ring buffer for each elapse of a predetermined fourth time period equal to or less than the third time period, and the read fourth time period. A moving image storage processing unit that stores the moving image as the stored moving image in the moving image storage unit, and the moving image transmission unit stores the first moving image stored in the storage unit of the ring buffer when the event is detected. A moving image of time is read, and the read moving image of the first time is transmitted to the central management device as the event moving image. Preferably, in the above-described sensor device, when the moving image transmission unit detects the event, the moving image transmission unit stores it in the ring buffer after a predetermined seventh time shorter than the first time from the time of detecting the event. The read first-time moving image is read, and the read first-time moving image is transmitted to the central management device as the event moving image.

Such a sensor device stores the moving image generated by the image capturing unit in the storage unit of the ring buffer, transmits the event moving image from the moving image stored in the storage unit of the ring buffer to the central management unit, and The saved moving image is stored in the moving image storage unit. Therefore, in the sensor device, the configuration is simplified, and the contents of the event moving image and the contents of the stored moving image can be treated with the same value when confirming the condition of a patient or the like at a later date. Since the storage unit is a ring buffer, the oldest (oldest) stored moving image frame is stored by the imaging unit at this point of time after the third time has elapsed since the storage unit of the ring buffer stored the storage unit. It will be overwritten with the frames of the generated video and can be erased automatically.

In another aspect, in the above-described sensor device, the moving image storage unit is a ring buffer.

In such a sensor device, since the moving image storage unit is a ring buffer, the sensor device can be configured with a memory element having a minimum storage capacity for storing the moving image of the second time, and after being stored in the moving image storage unit. After the elapse of the second time, the oldest (oldest) stored moving image frame is overwritten with the moving image frame stored at this point and can be automatically deleted.

In another aspect, in the above-described sensor device, the saved moving image has a second image quality lower than the first image quality of the event moving image. Preferably, in the sensor device described above, the saved moving image has a second resolution lower than the first resolution of the event moving image. Preferably, in the sensor device described above, the saved moving image is the first frame of the event moving image. The second frame rate is lower than the rate.

In such a sensor device, since the stored moving image has the second image quality lower than the first image quality of the event moving image, the moving image storage unit can be configured with a memory element having a smaller storage capacity.

In another aspect, in the above-described sensor device, the event includes a plurality of types, and the moving image transmission processing unit detects an event of a specific preset type of the plurality of types. In addition, a video of a predetermined first time including the time when the event is detected, which is generated by the imaging unit, is transmitted to the central management device as the event video, and the specific type of the plurality of types is transmitted. And a tag information addition processing unit that associates predetermined tag information related to the detected event with the stored moving image stored in the moving image storage unit when an event of the remaining type other than is detected. Preferably, in the above-mentioned sensor device, the type of the event is wake-up, leaving the bed, fall, fall and nurse call, the specific type is the fall and the fall, the residual type is awake, Get out and nurse call.

In such a sensor device, an event moving image related to a specific type of event can be referred to by the central managing device by storing it in the central managing device, and moving images related to the remaining types of events are based on tag information. You can refer to the saved video.

A monitoring image storage method according to another aspect is provided corresponding to a monitored person who is a monitoring target, is connected to a sensor device that detects a predetermined event related to the monitored person, and is communicably connected to the sensor device. A central management device that manages the event by receiving notification of an event detected by the sensor device; and an event detected by the sensor device via the central management device so as to be communicatively connected to the central management device A monitoring image storage method of a monitored person monitoring support system for supporting monitoring of a monitored person, comprising: a terminal device that receives a notification of A moving image transmission processing step of transmitting, as an event moving image, a moving image of a predetermined first time including the time point at which the event is detected, generated in the imaging step, and a predetermined first time longer than the first time. And a moving image storage step of storing, as a stored moving image, the moving image generated in the imaging step in a moving image storage section having a storage capacity for storing a two-hour moving image.

In such a monitoring image storage method, when the event is detected, a moving image of a predetermined first time period, which is generated by the imaging unit and includes the time when the event is detected, is transmitted to the central management device as an event moving image. On the other hand, the moving image generated by the image capturing unit is stored in the moving image storage unit as a saved moving image. Therefore, the event moving image can be saved in the central management device, and the monitoring image saving method can save the image at the time of occurrence of an alarm as well as the image at the time of occurrence.

A monitored person monitoring support system according to another aspect is provided corresponding to a monitored person who is a monitoring target, and is capable of communicating with a sensor device that detects a predetermined event related to the monitored person, and the sensor device. A central management device that is connected and manages the event by receiving a notification of an event detected by the sensor device, and a communicable connection with the central management device that is detected by the sensor device through the central management device. A monitored person monitoring support system for supporting monitoring of the monitored person, comprising: a terminal device that receives notification of an event, the imaging unit generating a moving image, and the imaging device when the event is detected. A moving image transmission processing unit that transmits a moving image of a predetermined first time including a time point at which the event is detected, which is generated by a unit, to the central management device as an event moving image; A moving image storage unit having a storage capacity for storing a moving image and storing the moving image generated by the imaging unit as a stored moving image. A monitored person monitoring support system according to another aspect is provided corresponding to a monitored person who is a monitoring target, and is capable of communicating with a sensor device that detects a predetermined event related to the monitored person, and the sensor device. A central management device that is connected and manages the event by receiving a notification of an event detected by the sensor device, and a communicable connection with the central management device that is detected by the sensor device through the central management device. A monitored person monitoring support system for supporting monitoring of the monitored person, comprising a terminal device for receiving notification of an event, wherein the sensor device is any one of the above sensor devices.

In such a monitored person monitoring support system, when the event is detected, the central management device uses, as an event moving image, a predetermined first time moving image generated by the imaging unit and including the time when the event is detected. On the other hand, the moving image generated by the image pickup unit is stored in the moving image storage unit as a saved moving image while being transmitted to. Therefore, it becomes possible to save the event moving image in the central management device, and the monitored person monitoring support system can save the image at the time of failure as the saved moving image while saving the image at the time of occurrence.

In another aspect, in the above-mentioned monitored person monitoring support system, the central management device receives an event moving image storage unit that stores the event moving image received from the sensor device, and the event moving image from the sensor device. An event moving image deletion processing unit that deletes the event moving image from the event moving image storage unit after a predetermined fifth time longer than the second time has elapsed from the reception time or the detection time of the event related to the event moving image.

Since such a monitored person monitoring support system automatically deletes the event moving picture after the fifth time from the reception time or the detection time of the event, the event moving picture can be stored only for a necessary time, and the event moving picture storage The storage capacity of the unit can be minimized.

In another aspect, in the above-mentioned monitored person monitoring support system, the moving image transmission unit further transmits the stored moving image stored in the moving image storage unit to the central management device, and the central management device Longer than the second time, from a saved moving image storage unit that stores the saved moving image received from the sensor device, and a reception time when the saved moving image is received from the sensor device or a detection time of an event related to the saved moving image. And a saved moving image deletion processing unit that deletes the saved moving image stored in the saved moving image storage unit from the saved moving image storage unit after a predetermined sixth time period has elapsed.

Since such a monitored person monitoring support system can save the saved moving image in the central management unit, and automatically deletes the saved moving image after the lapse of the sixth time from the reception time or the detection time of the event, The stored moving image can be stored for a required time, and the storage capacity of the stored moving image storage unit can be minimized.

This application is based on Japanese Patent Application No. 2018-214508, which was filed on November 15, 2018, and the content thereof is included in the present application.

Although embodiments of the present invention have been illustrated and described in detail, it is merely illustrative and illustrative and not restrictive. The scope of the invention should be construed by the language of the appended claims.

In order to represent the present invention, the present invention has been described above appropriately and sufficiently through the embodiments with reference to the drawings, but those skilled in the art can easily modify and / or improve the above embodiments. It should be recognized that this is possible. Therefore, unless a modification or improvement carried out by a person skilled in the art is at a level that deviates from the scope of rights of the claims recited in the claims, the modification or the improvement is covered by the scope of rights of the claims. Is understood to be included in.

According to the present invention, it is possible to provide a sensor device of a monitored person monitoring support system for supporting monitoring of a monitored person, a monitoring image storage method for storing the monitoring image, and the monitored person monitoring support system.

Claims

A sensor device that is provided corresponding to a monitored person who is a monitoring target, detects a predetermined event related to the monitored person, is communicably connected to the sensor device, and notifies the event detected by the sensor device. A central management device that receives and manages the event, and a terminal device that is communicably connected to the central management device and that receives notification of an event detected by the sensor device via the central management device, The sensor device of a monitored person monitoring support system for supporting monitoring of a person,
An imaging unit that generates a moving image,
A moving image transmission processing unit that, when detecting the event, transmits a moving image generated by the imaging unit for a predetermined first time period including the time when the event is detected to the central management device as an event moving image;
A moving picture storage unit having a storage capacity for storing a moving picture for a predetermined second time longer than the first time, and storing the moving picture generated by the imaging unit as a stored moving picture;
Sensor device.
A storage unit of a ring buffer that has a storage capacity for storing a moving image of a predetermined third time that is equal to or more than the first time and less than the second time, and that stores a moving image generated by the imaging unit;
The moving image of the fourth time stored in the storage unit of the ring buffer is read every time a predetermined fourth time of the third time or less elapses, and the read moving image of the fourth time is stored as the saved moving image. Further comprises a moving image storage processing unit to be stored in the unit,
When detecting the event, the moving image transmission unit reads the moving image of the first time stored in the storage unit of the ring buffer, and centralizes the read moving image of the first time as the event moving image. Send to device,
The sensor device according to claim 1.
The moving image storage unit is a ring buffer,
The sensor device according to claim 1 or 2.
The stored video has a second image quality lower than the first image quality of the event video.
The sensor device according to any one of claims 1 to 3.
The event includes multiple types,
When the moving image transmission processing unit detects an event of a specific preset type of the plurality of types, the moving image transmission processing unit generates a predetermined first time including the time when the event is detected, which is generated by the imaging unit. Send a video of the time as the event video to the central management unit,
Of the plurality of types, when a residual type event other than the specific type is detected, predetermined tag information regarding the detected event is associated with the saved moving image stored in the moving image storage unit. Further comprising a tag information addition processing unit,
The sensor device according to any one of claims 1 to 4.
A sensor device that is provided corresponding to a monitored person who is a monitoring target, detects a predetermined event related to the monitored person, is communicably connected to the sensor device, and notifies the event detected by the sensor device. A central management device that receives and manages the event, and a terminal device that is communicably connected to the central management device and that receives notification of an event detected by the sensor device via the central management device, A monitoring image saving method of a monitored person monitoring support system for supporting monitoring of a person,
An imaging process for generating a moving image,
A moving image transmission processing step of transmitting, when the event is detected, a moving image of a predetermined first time generated in the imaging step and including the time when the event is detected to the central management device as an event moving image,
A moving image storage step of storing, as a saved moving image, the moving image generated in the imaging step in a moving image storage section having a storage capacity for storing a moving image of a predetermined second time longer than the first time.
How to save surveillance images.
A sensor device that is provided corresponding to a monitored person who is a monitoring target, detects a predetermined event related to the monitored person, is communicably connected to the sensor device, and notifies the event detected by the sensor device. A central management device that receives and manages the event, and a terminal device that is communicably connected to the central management device and that receives notification of an event detected by the sensor device via the central management device, A monitored person monitoring support system for supporting monitoring of a person,
An imaging unit that generates a moving image,
A moving image transmission processing unit that, when detecting the event, transmits a moving image generated by the imaging unit for a predetermined first time period including the time when the event is detected to the central management device as an event moving image;
A moving picture storage unit having a storage capacity for storing a moving picture for a predetermined second time longer than the first time, and storing the moving picture generated by the imaging unit as a stored moving picture;
Monitored person monitoring support system.
A sensor device that is provided corresponding to a monitored person who is a monitoring target, detects a predetermined event related to the monitored person, is communicably connected to the sensor device, and notifies the event detected by the sensor device. A central management device that receives and manages the event, and a terminal device that is communicably connected to the central management device and that receives notification of an event detected by the sensor device via the central management device, A monitored person monitoring support system for supporting monitoring of a person,
The sensor device is the sensor device according to any one of claims 1 to 5.
Monitored person monitoring support system.
The central management device is
An event moving image storage unit that stores the event moving image received from the sensor device,
The event moving image is deleted from the event moving image storage unit after a predetermined fifth time longer than the second time has elapsed from the reception time when the event moving image is received from the sensor device or the detection time of the event related to the event moving image. An event moving image deletion processing unit is provided,
The monitored person monitoring support system according to claim 7 or 8.
The moving image transmission unit further transmits the stored moving image stored in the moving image storage unit to the central management device,
The central management device is
A stored video storage unit that stores the stored video received from the sensor device;
The storage stored in the storage video storage unit after a predetermined sixth time longer than the second time from the reception time when the storage video is received from the sensor device or the detection time of the event related to the storage video. A stored moving image deletion processing unit that deletes a moving image from the stored moving image storage unit;
The monitored person monitoring support system according to any one of claims 7 to 9.