WO2018096806A1

WO2018096806A1 - Setting device for monitored subject monitoring device, setting method for same, and monitored subject monitoring system

Info

Publication number: WO2018096806A1
Application number: PCT/JP2017/036408
Authority: WO
Inventors: 和浩小島; 敏行山下
Original assignee: コニカミノルタ株式会社
Priority date: 2016-11-24
Filing date: 2017-10-06
Publication date: 2018-05-31
Also published as: JPWO2018096806A1

Abstract

A setting device for a monitored subject monitoring device and a setting method for the same according to the present invention, with which a prescribed parameter of the monitored subject monitoring device is set, wherein a target image is acquired, the imaging target thereof being a place where the monitored subject is present, and when an operating mode is a setting mode in which the prescribed parameter is set, a processed image is generated by performing prescribed image processing on the target image so as to protect privacy, and this generated processed image is displayed as the target image on a display unit. A monitored subject monitoring system according to the present invention uses this sort of setting device for a monitored subject monitoring device.

Description

Monitored person monitoring device setting device and method, and monitored person monitoring system

The present invention relates to a setting apparatus for a monitored person monitoring apparatus and a setting method for a monitored person monitoring apparatus that set predetermined parameters in the monitored person monitoring apparatus that monitors the monitored person to be monitored. The present invention also relates to a monitored person monitoring system that monitors the monitored person using a plurality of devices using the monitored person monitoring apparatus setting device.

In an aging society like Japan (Japan) in recent years, an increase in the number of nurses requiring nursing care or those requiring care (care recipients) due to illness, injury, or aging is expected. The caregiver needs to enter a hospital or a facility such as a welfare facility for the elderly and receive nursing care. In such facilities, nurses and caregivers (nursing caregivers) regularly check their safety and condition by patrol.

However, the increase in the number of nursing caregivers cannot keep up with the increase in the number of nursing caregivers, and the nursing and nursing care industries are chronically short of manpower. Furthermore, compared to the day shift hours, the number of nursing caregivers is reduced and the work load per person is increased in the semi-night shift and night shift hours. In order to reduce such a labor shortage and the burden of nursing caregivers, there is a need for technology that complements nursing work and care work. For this reason, in recent years, a monitored person monitoring technique for monitoring a monitored person who is a monitoring target of a care recipient is being researched and developed.

For example, Patent Document 1 discloses a monitored person monitoring system as one of such monitored person monitoring techniques. The monitored person monitoring system disclosed in Patent Document 1 determines whether or not a predetermined event (event), such as a wake-up and a fall, has occurred in the monitored person based on the image, When it is determined that the predetermined event has occurred in the monitored person, the determination result is notified to the receiving device (terminal device). In such a monitored person monitoring system, in order to appropriately determine the predetermined event, for example, an imaging condition for extracting a monitored person from an image, what becomes noise in the determination, and the determination It is necessary to set a predetermined parameter such as a threshold value (determination threshold value) for. What becomes noise in the determination includes, for example, an image area of a curtain that is easily misidentified as a moving object that is the monitored person. Since setting such parameters requires knowledge thereof, it is difficult for the monitored person to set the parameters, and a setting person different from the monitored person sets the parameters. Become. The setter preferably sets the parameter while referring to an image of a target area in order to appropriately determine the predetermined event according to the monitored person. However, the target area is usually a living space (or a residence space) of the monitored person, such as a living room of an elderly welfare facility or a hospital room. For this reason, protection of the privacy of the monitored person is required.

Regarding the protection of the privacy of this image, for example, Patent Document 2 discloses an imaging device. The imaging apparatus disclosed in Patent Document 2 acquires an original image by photographing a subject, and performs a reversible processing on an image in a specific region in the original image, whereby the original image is obtained. A processed image is generated, and an image file in which the processed image and restoration information for specifying the content of the restoration process necessary to restore the original image from the processed image are stored in association with each other is recorded. And the said imaging device disclosed by the said patent document 2 is for switching control of permission / prohibition with respect to restoring the said original image from the said processed image according to the said information for restoration | restoration, and making it visible. Authority management information is further stored in the image file in association with the processed image and the restoration information.

On the other hand, in terms of safety confirmation, a single person living alone is similar to the above-mentioned nurses and the like, and is a monitored person to be monitored.

By the way, in the imaging device disclosed in Patent Document 2, authority management information is defined according to the viewer. For this reason, when the imaging device disclosed in Patent Document 2 is applied to a monitored person monitoring system, when setting the predetermined parameter, the permission management information of the permission is defined for the setter. The setter can view the original image (in this case, the original image is the image of the target area), and there is a possibility that the privacy of the monitored person cannot be protected from the setter. On the other hand, if appropriate authority management information is not defined for the setter, there is a possibility that the setting cannot be completed and the system cannot be operated.

International Publication No. WO2016 / 093274 Pamphlet JP 2009-33738 A

The present invention has been made in view of the above circumstances, and its object is to set a monitoring device for a monitored person monitoring device, a setting method for a monitored person monitoring device, and a monitoring device that can protect the privacy of the monitored person more appropriately. It is to provide a monitored person monitoring system using this.

In order to achieve the above-described object, a monitoring apparatus setting device for monitoring person monitoring apparatus and a method for setting a predetermined parameter in the monitoring apparatus for the monitored person, which reflects one aspect of the present invention, are provided with a location where the monitored person is located. When a target image as an imaging target is acquired and the operation mode is a setting mode for setting the predetermined parameter, a processed image is obtained by executing predetermined image processing so as to protect privacy for the target image. The generated processed image is displayed on the display unit as the target image. The monitored person monitoring system according to the present invention uses such a setting apparatus for a monitored person monitoring apparatus.

The advantages and features afforded by one or more embodiments of the invention will be more fully understood from the detailed description and accompanying drawings provided below. The detailed description and the accompanying drawings are given by way of example only and are not intended as a definition of the limitations of the invention.

It is a figure which shows the structure of the monitoring person monitoring system in embodiment. It is a figure which shows the structure of the fixed terminal device in which the setting apparatus for monitoring person monitoring apparatuses of embodiment in the said monitoring person monitoring system was integrated. It is a flowchart which shows the operation | movement regarding the setting mode in the said fixed terminal device. It is a flowchart which shows the operation | movement regarding the setting mode in the said fixed terminal device. It is a figure which shows an example of the main screen displayed on the said fixed terminal device. It is a figure which shows an example of the 1st setting screen displayed on the said fixed terminal device. It is a figure which shows an example of the 2nd setting screen displayed on the said fixed terminal device. It is a figure which shows an example of the monitoring information screen displayed on the said fixed terminal device.

Hereinafter, one or more embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the disclosed embodiments. In addition, the structure which attached | subjected the same code | symbol in each figure shows that it is the same structure, The description is abbreviate | omitted suitably. In this specification, when referring generically, it shows with the reference symbol which abbreviate | omitted the suffix, and when referring to an individual structure, it shows with the reference symbol which attached | subjected the suffix.

The setting device for a monitored person monitoring apparatus in the present embodiment is defined in advance in a monitored person monitoring apparatus that monitors a monitored person (watched person) Ob that is a monitored object (watched object) to be monitored (watched). This is a device for setting (set) predetermined parameters. The monitored person monitoring device setting device includes: an image acquisition unit that acquires a target image in which a place where the monitored person Ob is present is captured; a display unit that performs display; and a target image acquired by the image acquisition unit. An image display processing unit for displaying on the display unit. The image display processing unit generates a processed image by executing predetermined image processing so as to protect privacy for the target image when the operation mode is a setting mode for setting the predetermined parameter. The generated processed image is set as the target image. Such a monitored person monitoring device setting device executes predetermined image processing so as to protect privacy for the target image when the operation mode is the setting mode regardless of the authority management information. Then, a processed image is generated, and the generated processed image is set as the target image and displayed on the display unit. For this reason, when the operation mode is the setting mode, the setting device for the monitored person monitoring device can more appropriately protect the privacy of the monitored person.

In this embodiment, such a setting device for a monitored person monitoring apparatus will be described using a monitored person monitoring system that monitors the monitored person Ob using a plurality of devices. More specifically, the monitored person monitoring system is connected to the monitored person monitoring apparatus that monitors the monitored person Ob, and the monitored person monitoring apparatus so as to be communicable, and the monitoring result of the monitored person monitoring apparatus In this embodiment, a monitoring device setting device is further provided. The monitored person monitoring device may be a single integrated device, but in the present embodiment, the monitored person monitoring device includes a plurality of separate devices. More specifically, the monitored person monitoring device includes a sensor device and a management server device. The sensor device is a device that detects a predetermined event (event) defined (set) in advance related to the monitored person Ob. The management server device is communicably connected to each of the sensor device and the terminal device. When the notification of the detected predetermined event is received from the sensor device, the management server device manages the predetermined event and transmits the predetermined event. It is a device that notifies a predetermined terminal device associated with the sensor device. Although the terminal device may be one type of device, in the present embodiment, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between these fixed terminal devices and portable terminal devices is that the fixed terminal device is fixedly operated, while the portable terminal device is operated by being carried by a supervisor (user) such as a nurse or a caregiver. The fixed terminal device and the mobile terminal device are substantially the same.

In such a monitored person monitoring system, the monitored person monitoring device setting device includes a monitored person monitoring device (a sensor device and a management server device in this embodiment) and a terminal device (a fixed terminal device in this embodiment). It may be a separate device from the portable terminal device, or may be incorporated in the monitored person monitoring apparatus (the monitored person monitoring apparatus and the setting apparatus for the monitored person monitoring apparatus are integrated) The terminal device and the monitored person monitoring device setting device may be integrated with each other. For example, the setting device for the monitored person monitoring device is incorporated in the management server device. Further, for example, the setting device for the monitored person monitoring device is incorporated in the portable terminal device. Below, the case where the said monitoring person monitoring apparatus setting apparatus is integrated in the said fixed terminal device is demonstrated more concretely.

FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment. FIG. 2 is a diagram illustrating a configuration of a fixed terminal device in which the setting device for a monitored person monitoring apparatus according to the embodiment is incorporated in the monitored person monitoring system.

More specifically, the monitored person monitoring system MS includes, for example, as shown in FIG. 1, one or a plurality of sensor devices SU (SU-1 to SU-4), a management server device SV, and a fixed terminal device. SP, one or more portable terminal devices TA (TA-1, TA-2), and private branch exchange (PBX) CX, which are wired or wireless, LAN (Local Area Network) Or the like via a network (network, communication line) NW. The network NW may be provided with repeaters such as repeaters, bridges, and routers that relay communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of portable terminal devices TA-1, TA-2, and the private branch exchange CX include an L2 switch. Are connected to each other by a wired / wireless LAN (for example, a LAN in accordance with the IEEE 802.11 standard) NW including the LS and the access point AP. More specifically, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the private branch exchange CX are connected to the line concentrator LS, and the plurality of portable terminal devices TA-1, TA-2. Is connected to the line concentrator LS via the access point AP. The network NW constitutes a so-called intranet by using Internet protocol groups such as TCP (Transmission control protocol) and IP (Internet protocol).

A private branch exchange (line switching unit) CX is connected to the network NW, controls extension calls such as outgoing calls, incoming calls, and calls between the portable terminal devices TA, and performs extension calls between the portable terminal devices TA, and For example, outgoing calls, incoming calls, and calls between the external telephone TL and the mobile terminal device TA are connected to an external telephone TL such as a fixed telephone or a mobile telephone via a public telephone network PN such as a fixed telephone network or a mobile telephone network. This is a device that performs an outside line telephone call between the outside line telephone TL and the portable terminal device TA by controlling the outside line telephone. The private branch exchange CX is, for example, a digital exchange or an IP-PBX (Internet Protocol Private Branch eXchange).

The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, a single person living alone, or the like. In particular, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. For this reason, the monitored person monitoring system MS is suitably arranged in a building such as a hospital, an elderly welfare facility, or a dwelling unit according to the type of the monitored person Ob. In the example illustrated in FIG. 1, the monitored person monitoring system MS is disposed in a building of a care facility that includes a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station.

The sensor device SU has a communication function for communicating with other devices SV, SP, and TA via the network NW, and detects a predetermined event (event) related to the monitored person Ob and manages the server. It is a device that notifies (transmits) to the device SV. The predetermined event is preferably a predetermined event that needs to be dealt with. For example, in the present embodiment, the predetermined event is a predetermined action and a nurse call (NC) defined in advance in the monitored person Ob. More specifically, the sensor device SU moves upward (preferably a communication interface circuit (for example, a LAN card) for communicating with other devices SV, SP, and TA via the network NW, for example, the monitored person Ob. An image sensor (for example, a visible camera, a near-infrared camera, etc.) that captures an image from directly above (for example, the ceiling) and a predetermined predetermined in the monitored person Ob based on the output (image) of the image sensor A behavior detection processing circuit for detecting behavior as an example of the predetermined event and notifying the management server device SV; a nurse call processing circuit for receiving a nurse call as another example of the predetermined event and notifying the management server device SV; Call processing circuit for making voice calls with terminal devices SP, TA, etc., output of the image sensor (images (including still images and moving images)) Image transmission processing circuit for transmitting certain other apparatus SV, SP, to TA, the control circuit for controlling these, and, for example, such as a storage element configured to include a peripheral circuit.

The predetermined actions include, for example, entering the monitored person Ob into the bedding, getting up the monitored person Ob, leaving the monitored person Ob away from the bedding, and falling over when the monitored person Ob falls. These are the four actions. In addition, the fall may include a fall in which the monitored person Ob falls from the bedding, or the predetermined action may include the fall separately from the fall. The behavior detection processing circuit detects, for example, the head of the monitored person Ob based on an image (target image) captured by the image sensor, and the time change in the size of the detected head of the monitored person Ob The monitored person Ob is caused to wake up and fall, and the monitored person Ob is detected based on the target image captured by the image sensor, and the detected degree of overlap between the monitored person Ob and the bedding (overlapping region). Based on the size of the person to be monitored and the entry of the monitored person Ob. More specifically, the location area of the bedding BD on which the bedding BD such as a bed and a futon is placed on the image, the size of the head in the lying position and the size of the head in the sitting position in the location area of the bedding BD are shown. A first threshold value Th1 for identification and a second threshold value Th2 for identifying whether or not the size is the size of the head in the lying posture in the living room RM excluding the location area of the bedding BD are stored. The behavior detection processing circuit extracts a moving object region from the target image as a person region of the monitored person Ob, for example, by a background difference method or a frame difference method. Subsequently, the behavior detection processing circuit uses, for example, a circular or elliptical Hough transform from the extracted moving object region, for example, by pattern matching using a head model prepared in advance, or for example, for head detection. The head region of the monitored person Ob is extracted by the neural network learned in step (b). Then, the behavior detection processing circuit detects wakeup and falls from the extracted position and size of the head. For example, in the behavior detection processing circuit, the position of the extracted head is in the region where the bedding BD is located, and the size of the extracted head uses the first threshold Th1 to determine the size of the lying posture. When the time changes from the sitting posture to the size of the sitting posture, it is determined that the user gets up and the rising is detected. For example, in the behavior detection processing circuit, the position of the extracted head is in the living room RM excluding the area where the bedding BD is located, and the size of the extracted head uses the second threshold Th2. When the time changes from the size to the size of the recumbent posture, it is determined that the vehicle has fallen, and the fall is detected. Then, the behavior detection processing circuit detects an overlapping area where the moving object area extracted from the target image overlaps with the location area of the bedding BD, and detects bed leaving and entering from the temporal change of the overlapping area. . For example, the behavior detection processing circuit determines that the person has left the bed when the time changes from the state in which the detected overlapping area exists to the state in which the overlapping area does not exist, and detects the bed leaving. For example, in the behavior detection processing circuit, the state where the detected overlapping area does not exist, and the entire overlapping area overlaps within the location area of the bedding BD through the detection of the presence of the overlapping area (that is, the If the moving body area changes over time to a state where the moving body area is completely contained within the area where the bedding BD is located), it is determined that the user has entered the floor, and the floor is detected.

In this embodiment, in order to more appropriately detect the predetermined behavior according to the monitored person Ob by the behavior detection processing circuit, in this embodiment, the monitored person incorporated in the fixed terminal device SP as will be described later. The frame rate, brightness level, ceiling height, and bedding BD location area of the image sensor are set as predetermined parameters by the monitoring device setting device.

The predetermined event is notified from the sensor device SU to the management server device SV by a first event notification communication signal. This first event notification communication signal contains the sensor ID of the own device and event information indicating the contents of the event. The sensor ID (sensor identifier) is an identifier for identifying and identifying the sensor device SU. In the present embodiment, the event information is one or more of entering, getting up, leaving, falling, and nurse call. The first event notification communication signal may contain an image captured by the image sensor. In particular, when the event information is any one of entering, getting up, leaving the floor, and falling, an image used for detecting the predetermined action (when the detection is performed by a plurality of images). For example, the last image) is preferably accommodated. The image may be at least one of a still image and a moving image. For example, the still image is notified and the still image is displayed on the terminal devices SP and TA.

FIG. 1 shows four first to fourth sensor devices SU-1 to SU-4 as an example, and the first sensor device SU-1 is one of the monitored persons Ob. The second sensor device SU-2 is arranged in a room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob. The third sensor device SU-3 is disposed in the room RM-3 (not shown) of Mr. C Ob-3, one of the monitored subjects Ob, and the fourth sensor device SU-4 It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.

The management server device SV has a communication function for communicating with other devices SU, TA, and SP via the network NW, and receives a notification of the predetermined event from the sensor device SU with the first event notification communication signal. Information relating to monitoring (monitoring information) for the monitor Ob is managed, and the predetermined event is notified (re-notification, notification, transmission) to the predetermined terminal device SP and TA by the second event notification communication signal, and the client (this embodiment) In this embodiment, the client device provides data corresponding to the request of the terminal device SP, TA, etc.) to manage the entire monitored person monitoring system MS. In the present embodiment, the monitoring information includes, for example, the sensor ID of the sensor device SU that is the transmission source of the first event notification communication signal, the predetermined event (the type of the predetermined action detected by the sensor device SU, and the sensor device). Nurse call received by SU), image of monitored person Ob, time of receiving the notification (notification time), and the like, which are stored (recorded and managed) in association with each other. The monitoring information is accommodated in the second event notification communication signal. The second event notification communication signal may be transmitted by, for example, broadcast communication (broadcast or multicast), and, for example, one or more associated with the sensor device SU that is the transmission source of the first event notification communication signal. May be transmitted to the terminal devices SP and TA.

Such a management server device SV can be configured by a computer with a communication function, for example.

The fixed terminal device SP includes a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like. By inputting a predetermined instruction or data to be given to the management server device SV or the portable terminal device TA, displaying the monitoring information obtained by the sensor device SU by a notification from the management server device SV, etc. Is a device that functions as a user interface (UI) of the person monitoring system MS. Such a fixed terminal device SP can be configured by, for example, a computer with a communication function. The fixed terminal device SP will be described more specifically below.

The mobile terminal device TA has a communication function for communicating with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. Including a call function to perform, inputting a predetermined instruction or data to be given to the management server device SV or the sensor device SU, displaying the monitoring information obtained by the sensor device SU by a notification from the management server device SV, This is a device for making a nurse call response or calling a voice call with the sensor device SU. Such a portable terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.

Next, the fixed terminal device SP will be described more specifically. For example, as shown in FIG. 2, the fixed terminal device SP includes a fixed terminal side control processing unit (SP control processing unit) 1, a fixed terminal side communication interface unit (SP communication IF unit) 2, and a fixed terminal side input unit. (SP input unit) 3, fixed terminal side display unit (SP display unit) 4, fixed terminal side interface unit (SPIF unit) 5, and fixed terminal side storage unit (SP storage unit) 6.

The SP communication IF unit 2 is a communication circuit that is connected to the SP control processing unit 1 and performs communication in accordance with the control of the SP control processing unit 1. The SP communication IF unit 2 generates a communication signal containing the data to be transmitted input from the SP control processing unit 1 according to the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SU, SV, TA via the network NW. The SP communication IF unit 2 receives a communication signal from another device SU, SV, TA via the network NW, extracts data from the received communication signal, and the SP control processing unit 1 can process the extracted data. The data is converted into data in a proper format and output to the SP control processing unit 1. The SP communication IF unit 2 includes, for example, a communication interface circuit that conforms to the IEEE 802.11 standard or the like. In the present embodiment, when the operation mode is a setting mode to be described later, the SP communication IF unit 2 sends a communication signal containing a target image for imaging a place where the monitored person Ob is present from the sensor device SU to the network NW. Receive via. The SP communication IF unit 2 corresponds to an example of an image acquisition unit that acquires a target image whose imaging target is a place where the monitored person Ob is present. The place where the monitored person Ob is located is a room of a building corresponding to the type of the monitored person Ob, such as a hospital room, a living room of a welfare facility for the elderly, and a room of a dwelling unit. In the present embodiment, the place where the monitored person Ob is the living room RM of the care facility.

The SP input unit 3 is connected to the SP control processing unit 1 and is, for example, a circuit that accepts a predetermined operation and inputs it to the fixed terminal device SP. For example, a plurality of input switches assigned a predetermined function, a keyboard, Or a mouse. The predetermined operation includes, for example, monitoring of an ID (user name) input operation for login, an operation mode input operation, an operator information input operation, a predetermined parameter input operation, and the like. Various operations necessary for the above are included. The operation mode includes a plurality of modes that define the operation content of the own device SP. In this embodiment, a service mode (monitoring mode) for monitoring the monitored person Ob and a setting mode for setting the predetermined parameter Etc. The worker information is information for identifying and identifying a worker in the setting mode, and is, for example, an ID or a monitor name. As the worker information, for example, the ID at the time of login may be used as the worker information. For example, when the setting mode is activated, the worker information may be input from the SP input unit 3.

The SP display unit 4 is connected to the SP control processing unit 1, and according to the control of the SP control processing unit 1, a predetermined operation content input from the SP input unit 3 and a monitored target monitored by the monitored person monitoring system MS. This is a circuit for displaying the monitoring information related to the monitoring of the observer Ob, and is a display device such as an LCD (Liquid Crystal Display) and an organic EL display.

The SPIF unit 5 is a circuit that is connected to the SP control processing unit 1 and inputs / outputs data to / from an external device according to the control of the SP control processing unit 1, and uses, for example, the Bluetooth (registered trademark) standard. An interface circuit, an interface circuit that performs infrared communication such as the IrDA standard, and an interface circuit that uses the USB standard.

The SP storage unit 6 is a circuit that is connected to the SP control processing unit 1 and stores various predetermined programs and various predetermined data under the control of the SP control processing unit 1. Examples of the various predetermined programs include a control program for controlling each unit of the fixed terminal device SP according to the function of each unit, a monitoring processing program for executing predetermined information processing related to monitoring of the monitored person Ob, A parameter setting processing program that receives a predetermined parameter set (set) in advance from the SP input unit 3 and sets it in the sensor device SU, or the sensor device SU when receiving the predetermined parameter in the parameter setting processing program A control processing program such as an image display processing program for displaying the target image acquired by the SP communication IF unit 2 via the network NW on the SP display unit 4 is included. In the present embodiment, the image display processing program is processed by executing predetermined image processing defined (set) in advance so as to protect the privacy of the target image when the operation mode is the setting mode. An image is generated, and the generated processed image is set as the target image. The various types of predetermined data include data necessary for executing each program such as the terminal ID of the own device, the monitoring information of the monitored person Ob, the authorized person information, the area information, the person identification information, and the substitute image. included. The SP storage unit 6 includes, for example, a ROM (Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), and the like. The SP storage unit 6 includes a RAM (Random Access Memory) that is a working memory of the so-called SP control processing unit 1 that stores data generated during execution of the predetermined program. The terminal ID is an identifier for identifying and identifying the terminal devices SP and TA.

In order to store each of the monitoring information, permitter information, area information, person identification information, and substitute image, the SP storage unit 6 includes a monitoring information storage unit 61, an authorizer information storage unit 62, an area information storage unit 63, a person An identification information storage unit 64 and a substitute image storage unit 65 are functionally provided.

The monitoring information storage unit 61 stores the monitoring information. In the present embodiment, the monitoring information includes, for example, the sensor ID of the sensor device SU that has detected the predetermined event, the image of the predetermined event Ob, The notification time and the like are associated with each other and stored for each reception of the second event notification communication signal (that is, for each event detected by the sensor device SU).

The permitter information storage unit 62 stores the permitter information in advance. The permitter information is information representing a permitter who can refer to the target image without modifying the target image by predetermined image processing so as to protect the privacy. The permitter information storage unit 62 stores the permitter information in association with the monitored person Ob for each monitored person Ob. That is, the permitter information is stored in the permitter information storage unit 62 in association with the sensor device SU (sensor ID) for each sensor device SU (sensor ID). For example, since a caregiver or nurse in charge of the monitored person Ob is in contact with the monitored person Ob on a daily basis, the caregiver or nurse in charge of the monitored person Ob is monitored. The request to protect the privacy of the Ober is considered low. For this reason, in one example, the permitter is a caregiver or a nurse in charge of the monitored person Ob. In such a case, the caregiver ID (user name, caregiver name) and nurse ID (user name, nurse name) are associated with the monitored person Ob (sensor ID) as the permitter information. It is stored in the permitter information storage unit 62.

The area information storage unit 63 stores area information. The area information is information representing a predetermined specific area in the target image. The specific area is appropriately defined (set) by one or more in advance, and is, for example, an area set by a user (monitoring person). Further, for example, the specific area is an area that is displayed by the image display processing program. For example, the specific area is an area generated based on information held by the management server device SV. Further, for example, the specific area is a bedding location area in the target image. Such a specific area is used by a second sub-execution determination unit 1512 described later. In particular, the location area of the bedding is used in a fifth sub execution determination unit 1515 described later. The area information storage unit 63 stores the area information in association with the monitored person Ob for each monitored person Ob. That is, the region information is stored in the region information storage unit 63 in association with the sensor device SU (sensor ID) for each sensor device SU (sensor ID).

The person identification information storage unit 64 stores the person identification information in advance. The person information is information for identifying the monitored person Ob from the target image (monitored person identification information) and information for identifying the family of the monitored person Ob from the target image (family identification information). . The person information is data corresponding to a known person recognition method used for identifying the monitored person Ob and his family, for example, each face data of the monitored person Ob and his family.

The substitute image storage unit 65 stores the substitute image. In the setting mode, the substitute image is used instead of the target image acquired by the SP communication IF unit 2 when it is finally determined that the target image acquired by the SP communication IF unit 2 is an image infringing on privacy. These are images displayed on the SP display unit 4. The substitute image storage unit 65 stores the substitute image in association with the monitored person Ob for each monitored person Ob. That is, the substitute image is stored in the substitute image storage unit 65 in association with the sensor device SU (sensor ID) for each sensor device SU (sensor ID). For example, when the predetermined parameter is set in the setting mode, the target image displayed and referenced on the SP display unit 4 at that time is stored in the substitute image storage unit 65 as a substitute image. In such a case, it is preferable that the target image referenced in the most recent setting mode is stored in the substitute image storage unit 65 as a substitute image.

The authorized person information, the area information, and the person identification information stored in each of the authorized person information storage unit 62, the area information storage unit 63, and the person identification information storage unit 64 are managed (stored) by the management server device SP. When the fixed terminal device SP logs into the monitored person monitoring system SM, it is transmitted (downloaded) from the management server device SP to the fixed terminal device SP, and the permitter information storage unit 62, the area information storage unit 63, and the person identification information storage are stored. Each of the units 64 may be stored.

The SP control processing unit 1 controls each part of the fixed terminal device SP according to the function of each part, and receives and displays the monitoring information of the monitored person Ob when the operation mode is the service mode. Is a circuit for accepting and setting the predetermined parameter when is in the setting mode. The SP control processing unit 1 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. The SP control processing unit 1 functionally includes a control unit 11, a monitoring processing unit 12, a parameter setting processing unit 13, an image display processing unit 15, and an image display adjustment unit 16 by executing a control processing program.

The control unit 11 controls each unit of the fixed terminal device SP according to the function of each unit, and controls the entire fixed terminal device SP.

The monitoring processing unit 12 executes predetermined information processing related to monitoring of the monitored person Ob. More specifically, when the monitoring processing unit 12 receives the second event notification communication signal transmitted by the management server device SV due to the first event notification communication signal transmitted by the sensor device SU, Based on each information (each data) accommodated in the received second event notification communication signal, the monitoring information of the monitored person Ob is stored (recorded) in the monitoring information storage unit 61. The monitoring processing unit 12 displays a screen corresponding to each piece of information contained in the received second event notification communication signal on the SP display unit 4. When the monitoring processing unit 12 receives a predetermined input operation from the SP input unit 3, the monitoring processing unit 12 executes a predetermined process corresponding to the input operation.

The parameter setting processing unit 13 receives a predetermined parameter defined in advance from the SP input unit 3 and sets it in the sensor device SU.

The image display processing unit 15 displays the target image acquired by the SP communication IF unit 2 from the sensor device SU via the network NW on the SP display unit 4 when the parameter setting processing unit 13 receives the predetermined parameter. It is. Here, when the operation mode is the setting mode, the image display processing unit 15 generates a processed image by executing predetermined image processing so as to protect the privacy of the target image, and the generated processing Let the image be the target image. The predetermined image processing for protecting the privacy includes, for example, mosaic processing for mosaicing an image, gradation adjustment processing for adjusting the gradation of an image (including filling), blur processing for blurring an image, etc. It is. More specifically, the image display processing unit 15 functionally includes an execution determination unit 151, a processed image generation unit 152, and a high resolution processing unit 153.

The execution determination unit 151 determines whether or not to execute predetermined image processing so as to protect privacy for the target image when the operation mode is the setting mode.

The processed image generation unit 152 generates a processed image by executing the predetermined image processing on the target image based on the determination result of the execution determination unit, and uses the generated processed image as the target image. . More specifically, when the execution determination unit 151 determines that the predetermined image processing is to be executed based on the determination result of the execution determination unit, the processed image generation unit 152 applies the predetermined image to the target image. A processed image is generated by executing image processing, and the generated processed image is set as the target image.

The high resolution processing unit 153 generates an image (high resolution image) in which the resolution of the target image is increased by, for example, a known super-resolution process, and the generated high resolution image is used as the target image. An image. The super-resolution processing is disclosed in, for example, International Publication No. WO2013 / 0889260 pamphlet.

In the present embodiment, the execution determination unit 151 functionally includes first to sixth sub-execution determination units 1511 to 1516, and the processed image generation unit 152 includes first to fourth processed image generation units 1521 to 1524. Functionally prepared.

The first sub-execution determination unit 1511 determines whether the worker information input from the SP input unit 3 matches the permitter information stored in the permitter information storage unit 62. As a result of this determination, When it is determined that they do not match, it is determined that the predetermined image processing is to be executed. More specifically, in the present embodiment, the first sub-execution determination unit 1511 determines that the predetermined image processing is to be executed at the first processing level when it is determined that they do not match as a result of the determination, As a result of the determination, when it is determined that they match, it is further determined whether or not a toilet is reflected in the target image, and when it is determined that the toilet is reflected as a result of the determination, the predetermined image processing is performed. When it is determined that the second processing level is lower than the first processing level, and it is determined that the toilet is not captured as a result of the determination, it is determined that the predetermined image processing is not performed. For the toilet determination, for example, a known scene analysis method described later is used. Further, for example, a known pattern matching method using a toilet template is used. For example, when the predetermined image processing is mosaic processing, the mosaic size (mosaic size) at the first processing level is smaller (narrower) than the mosaic size at the second processing level. Further, for example, when the predetermined image processing is gradation adjustment processing, the number of gradations at the first processing level is smaller than the number of gradations at the second processing level. In one example, when the number of gradations of the target image before the predetermined image processing is 256 gradations, the number of gradations at the first processing level is 8 gradations, 4 gradations, 2 gradations, etc. On the other hand, the number of gradations at the second processing level is 32 gradations, 24 gradations, 16 gradations, or the like. Further, for example, when the predetermined image processing is blurring processing, the degree of blurring of the first processing level is larger (strong) than the degree of blurring of the second processing level.

In response to this, when the first sub execution determination unit 1511 of the execution determination unit 151 determines to execute the predetermined image processing at the first processing level, the fourth sub processed image generation unit 1524 adds the target image to the target image. On the other hand, a first processed image is generated by executing the predetermined image processing at the first processing level, the generated first processed image is set as the target image, and a first sub execution determination unit 1511 of the execution determination unit 151 is performed. Generates a second processed image by executing the predetermined image processing on the target image at the second processing level when it is determined that the predetermined image processing is executed at the second processing level. The processed second image is set as the target image.

The second sub-execution determining unit 1512 determines whether or not there is a person image in an image outside the predetermined specific region stored in the region information storage unit 63 in the target image. As a result, when it is determined that there is an image of the person, the predetermined image processing is performed on an image in a region outside the predetermined specific region stored in the region information storage unit 63 in the target image. Judge that. On the other hand, as a result of the determination, the second sub-execution determination unit 1512 determines not to execute the predetermined image processing when determining that there is no image of the person. More specifically, the second sub-execution determination unit 1512 determines whether or not there is a moving object region as a human region from the target image, for example, by a frame difference method or a background difference method. Further, it is determined whether or not the moving object region is outside the predetermined specific region. If it is determined by this determination that the moving object region is outside the predetermined specific region, the second sub execution determination unit 1512 performs the predetermined image processing on the target image in the region information storage unit 63. It is determined that the image is to be executed with respect to an image outside the predetermined specific area stored in (1).

In response to this, in the first sub-processed image generation unit 1521, the second sub-execution determination unit 1512 of the execution determination unit 151 stores the predetermined image processing in the region information storage unit 63 in the target image. When it is determined that the image of the area outside the predetermined specific area is to be executed, the predetermined image processing is performed outside the predetermined specific area stored in the area information storage unit 63 in the target image. Execute on the image of the area.

The third sub-execution determining unit 1513 determines whether or not a person image in the target image infringes privacy, and if it is determined that the result is not a privacy infringement, the predetermined image It is determined that the process is not executed. On the other hand, if it is determined as a violation of privacy as a result of the determination, the third sub-execution determination unit 1513 may determine to execute the predetermined image processing, or prohibit display of the target image. Good.

More specifically, for example, the third sub-execution determination unit 1513 infringes privacy by determining whether or not there is an image of the person in order to more easily determine whether or not there is an infringement of privacy. It is determined whether or not. For example, the third sub execution determination unit 1513 determines whether or not there is an image of the person based on the monitoring information corresponding to the monitored person Ob. More specifically, when the latest monitoring information corresponding to the monitored person Ob is entering or getting up, the third sub-execution determining unit 1513 determines that there is an image of the person and determines that it is a violation of privacy. To do. On the other hand, if the latest monitoring information corresponding to the monitored person Ob is an event other than entering or getting up, the third sub-execution determining unit 1513 determines that there is no image of the person. Judge that there is no. Further, for example, the third sub execution determination unit 1513 determines whether or not there is an image of the person by determining whether or not there is a moving object region in the target image. If the third sub-execution determination unit 1513 determines that there is a moving object area in the target image, the third sub-execution determination unit 1513 determines that there is an image of the person, and determines that it is a privacy violation. If it is determined that there is no moving object area in the target image, the third sub-execution determination unit 1513 determines that there is no image of the person and determines that there is no privacy infringement. In addition, for example, the schedule of the monitored person Ob such as a care plan and a nursing plan is stored in the SP storage unit 6 in advance, and the third sub-execution determining unit 1513 generates an image of the person based on the schedule of the monitored person Ob. It is determined whether or not there is. More specifically, when the schedule of the monitored person Ob is a matter (first matter) to be performed outside the living room RM such as bathing or taking a walk, the third sub-execution determination unit 1513 has no image of the person It is determined that it is not a violation of privacy. On the other hand, when the schedule of the monitored person Ob is other matters (second matter) other than the first matter, the third sub-execution judging unit 1513 judges that there is an image of the person, and infringes privacy. Judge that there is.

Further, for example, since the third sub execution determination unit 1513 can easily identify a person from the face, in order to protect privacy more appropriately, a face image (for example, a face image viewed from the front, a diagonal view) is added to the person image. It is determined whether or not privacy is infringed by determining whether or not it includes a face image viewed from the side and a face image viewed from the side. More specifically, the third sub-execution determination unit 1513 extracts the head in the same manner as described above, and extracts the head by a known face orientation determination method for determining the face orientation with respect to the extracted head. Determine the orientation of the part. When it is determined that the extracted head includes a face (when it is determined that the extracted head is not a back of the head), the third sub execution determination unit 1513 determines that the person image includes a face image. If it is determined that it is a violation of privacy and the extracted head does not include a face (when it is determined that the extracted head is the back of the head), a face image is added to the person image. It is determined that it is not included, and it is determined that it is not a violation of privacy. The face orientation determination method is disclosed in, for example, Japanese Patent Application Laid-Open No. 2006-72770.

Also, for example, the third sub execution determination unit 1513 analyzes the scene by a known scene analysis method for the target image in order to protect the scene (scene) that the other person does not want to see and protect the privacy more appropriately. Then, it is determined whether privacy is infringed by determining whether the analyzed scene is any of changing clothes, excretion, and hobbies. If the third sub-execution determination unit 1513 determines that the analyzed scene is being changed, being excreted, or being a hobby, the third sub-execution determination unit 1513 determines that it is a privacy violation and the analyzed scene is being changed. If it is determined that it is neither excretion nor a hobby, it is determined that it is not a violation of privacy. Note that a known clothes recognition method for recognizing clothes can also be used to determine whether or not the user is changing clothes. The clothes recognition method is disclosed in, for example, Japanese Patent Application Laid-Open No. 2007-128307.

Further, for example, the third sub-execution determination unit 1513 is based on the monitored person identification information of the monitored person Ob stored in the person identification information storage unit 64 in order to more appropriately protect the privacy of the monitored person Ob. Then, it is determined whether or not the target image violates privacy by determining whether or not the image of the person is an image of the monitored person Ob by a known person identification method. If the third sub-execution determination unit 1513 determines that the person image is an image of the monitored person Ob, the third sub-execution determination unit 1513 determines that it is a violation of privacy, and the person image is not the image of the monitored person Ob. If it is determined, it is determined that it is not a violation of privacy.

Further, for example, the third sub-execution determination unit 1513 uses the monitored person identification information of the family of the monitored person Ob stored in the person identification information storage unit 64 in order to more appropriately protect the privacy of the monitored person Ob. Based on this, it is determined whether or not the target image infringes privacy by determining whether or not the image of the person is an image of the family of the monitored person Ob by the known person identification method. If the third sub-execution determination unit 1513 determines that the image of the person is an image of the family of the monitored person Ob, the third sub-execution determination unit 1513 determines that the person's image is an infringement of privacy. If it is determined that it is not an image, it is determined that it is not a violation of privacy.

The fourth sub execution determination unit 1514 determines whether an image resolution of the target image when the target image is displayed on the SP display unit 4 is equal to or lower than a predetermined threshold value. When it is determined that the resolution is equal to or less than the resolution threshold, it is determined that the predetermined image processing is not executed. On the other hand, as a result of the determination, if it is determined that it is not less than or equal to the predetermined threshold, the fourth sub-execution determination unit 1514 may determine that the predetermined image processing is to be executed, and display the target image. You can ban it. In the present embodiment, since the target image is displayed for setting the parameters, the image resolution of the target image is evaluated in two stages. More specifically, the fourth sub execution determination unit 1514 determines whether or not the image resolution of the target image when the target image is displayed on the SP display unit 4 is equal to or lower than a predetermined first resolution threshold. As a result of the determination, whether or not the image resolution of the target image when the target image is displayed on the SP display unit 4 is equal to or higher than a predetermined second resolution threshold when determined to be equal to or lower than the first resolution threshold. If it is further determined whether or not the predetermined parameter can be set, and if it is determined that the result is greater than or equal to the second resolution threshold, the fourth sub-execution determination unit 1514 It is determined that predetermined image processing is not executed. On the other hand, as a result of the determination, if it is determined that it is not equal to or higher than the second resolution threshold, the high-resolution processing unit 153 generates a high-resolution image by increasing the resolution of the target image to a predetermined resolution. Let it be the target image. Further, as a result of the determination at the first resolution threshold, when it is determined that it is not less than the first resolution threshold, the fourth sub execution determination unit 1514 determines to execute the predetermined image processing as described above. The display of the target image may be prohibited. The first resolution threshold is set to an appropriate value in advance from the viewpoint of whether or not privacy can be protected, such as whether or not a person can be recognized from an image. The second resolution threshold is set to an appropriate value in advance from the viewpoint of whether or not the predetermined parameter can be set from an image. For example, the second resolution threshold is determined based on the resolution of an image necessary for the sensor device SU to detect the predetermined action. The high-resolution processing unit 153 generates the high-resolution image by increasing the resolution of the target image so that the target image is at least higher than a second resolution threshold, and the generated high-resolution image is used as the target image. To do.

The fifth sub-execution determination unit 1515 determines whether or not a background image excluding a person's image of the target image infringes on privacy. It is determined that the predetermined image processing is performed on a partial image in a predetermined range including an image determined to be an infringement of privacy among the background images. On the other hand, if it is determined as a result of the determination that there is no privacy infringement, the fifth sub execution determination unit 1515 determines not to execute the predetermined image processing.

More specifically, for example, the fifth sub-execution determination unit 1515 extracts a region (photo image region) in which a photograph is captured from the target image by a known general object recognition method, and the extracted photographic image region Based on the person identification information stored in the person identification information storage unit 64, it is determined whether or not the monitored person Ob or his / her family is reflected by the known person identification method. Whether to infringe. If it is determined that at least one of the monitored person Ob and his / her family is reflected in the background image, the fifth sub-execution determining unit 1515 determines that it is a privacy infringement, and the background image is monitored. When it is determined that the person Ob and his family are not reflected together, it is determined that the privacy is not infringed. In this case, the fifth sub-execution determination unit 1515 extracts the person image by extracting the moving object region, generates a background image excluding the person image from the target images, and A photographic image region may be extracted from the target image by the general object recognition method. General object recognition is disclosed in, for example, Japanese Unexamined Patent Application Publication No. 2009-258953.

Further, for example, the fifth sub-execution determination unit 1515 extracts characters from the target image by a known optical character recognition (OCR (Optical character recognition)) method, and adds the name of the monitored person Ob or his family to the extracted characters. It is determined whether or not the background image violates privacy by determining whether or not the name of the image is reflected. In this case, the person identification information storage unit 64 further stores the name of the monitored person Ob and the name of the family as person identification information. If the fifth sub-execution determination unit 1515 determines that at least one of the name of the monitored person Ob and the name of the family member is reflected in the background image, the fifth sub-execution determination unit 1515 determines that it is a privacy infringement, and When it is determined that neither the name of the monitored person Ob and the name of the family are included in the image, it is determined that the privacy is not infringed.

Further, for example, the fifth sub execution determination unit 1515 extracts a region (television image region) in which the television receiver is reflected from the target image by the known general object recognition method, and publicly identifies the extracted television image region. Analyzing the scene using a scene analysis method and determining whether the analyzed scene infringes privacy, so that the background image excluding the person's image in the target image is an image that infringes privacy Determine whether or not. If the fifth sub-execution determination unit 1515 determines that the analyzed scene is in a state of looking at the SNS, the fifth sub-execution determination unit 1515 determines that the analyzed scene is a violation of privacy, and determines that the analyzed scene is a scene other than the above. If not, it is determined that it is not a privacy violation.

In response to this, the second sub-processed image generation unit 1522 indicates that the fifth sub-execution determination unit 1515 of the execution determination unit 151 performs the predetermined image processing as an infringement of the privacy among the background images. When it is determined to execute a partial image in a predetermined range including the determined image, the predetermined image processing includes the predetermined image including the image determined to be an infringement of the privacy among the background images. This is executed for the partial image (image of the infringing substance region) in the range of.

The sixth sub-execution determining unit 1516 determines whether or not there is an image of a person on the bed in the region where the bedding is set in advance in the target image, and as a result of this determination, there is an image of the person on the bed. If it is determined, the predetermined image processing is determined to be performed on the image in the area where the bedding is located. On the other hand, if it is determined that there is no person image as a result of the determination, the sixth sub-execution determination unit 1516 determines that the predetermined image processing is not executed. More specifically, the sixth sub-execution determination unit 1516 determines whether or not there is a moving object region as a human region from the target image by, for example, a frame difference method or a background difference method. Further, it is determined whether or not the moving object region is present in the bedding location region stored in the region information storage unit 63. For this determination, a method similar to the determination of entering in the sensor device SU is used. If it is determined by this determination that the moving object region is present in the location area of the bedding, the sixth sub-execution determination unit 1516 determines that the predetermined image processing is to be executed on the image of the location area of the bedding. To do. Alternatively, the sixth sub execution determination unit 1516 determines that there is an image of a person in the bedding location area set in advance in the target image when the latest monitoring information corresponding to the monitored person Ob is an entry. May be.

In response to this, the third sub-processed image generation unit 1523 determines that the sixth sub-execution determination unit 1516 of the execution determination unit 151 executes the predetermined image processing on the image in the location area of the bedding. In this case, the predetermined image processing is executed on the image in the area where the bedding is located.

The predetermined image processing based on the determination result of the first sub-execution determination unit 1511, the predetermined image processing based on the determination result of the second sub-execution determination unit 1512, and the determination result of the third sub-execution determination unit 1513. The predetermined image processing based on the predetermined image processing and the determination result of the fourth sub execution determination unit 1514 and the predetermined image processing based on the determination result of the fifth sub execution determination unit 1515 and the sixth sub execution determination unit 1516 The predetermined image processing based on the determination result may be different from each other. Alternatively, based on the predetermined image processing based on the determination result of the first sub execution determination unit 1511, the predetermined image processing based on the determination result of the second sub execution determination unit 1512, and the determination result of the third sub execution determination unit 1513. The predetermined image processing based on the predetermined image processing and the determination result of the fourth sub execution determination unit 1514 and the predetermined image processing based on the determination result of the fifth sub execution determination unit 1515 and the sixth sub execution determination unit 1516 The predetermined image processing based on the determination result may be the same as each other. Alternatively, based on the predetermined image processing based on the determination result of the first sub execution determination unit 1511, the predetermined image processing based on the determination result of the second sub execution determination unit 1512, and the determination result of the third sub execution determination unit 1513. The predetermined image processing based on the predetermined image processing and the determination result of the fourth sub execution determination unit 1514 and the predetermined image processing based on the determination result of the fifth sub execution determination unit 1515 and the sixth sub execution determination unit 1516 A part of the predetermined image processing based on the determination result may be different from each other, and the remaining part may be the same.

The image display adjustment unit 16 determines whether or not the target image of the processed image generated by the processed image generation unit 152 infringes privacy by the third and fifth sub

execution determination units

1513 and 1515, respectively. As a result, when it is determined that it is a violation of privacy, the target image of the processed image is not displayed on the SP display unit 4 by the image display processing unit 15.

In order to enable setting of a predetermined parameter in the setting mode while protecting privacy, the image display processing unit 15 performs SP communication IF when the determination result of the image display adjustment unit 16 is a violation of privacy. The target image is re-acquired by the unit 2, and each process of the execution determination unit 151, the processed image generation unit 152, and the high-resolution processing unit 153 is executed again on the re-acquired target image.

In such a fixed terminal device SP, the control unit 11 in the SP control processing unit 1, the parameter setting processing unit 13, the image display processing unit 15, the image display adjustment unit 16, the SP communication IF unit 2, the SP input unit 3, The SP display unit 4 and the SP storage unit 6 constitute an example of a setting device for a monitored person monitoring device.

Next, the operation of this embodiment will be described. 3 and 4 are flowcharts showing operations related to the setting mode in the fixed terminal device. FIG. 5 is a diagram illustrating an example of a main screen displayed on the fixed terminal device. FIG. 6 is a diagram illustrating an example of a first setting screen displayed on the fixed terminal device. FIG. 7 is a diagram illustrating an example of a second setting screen displayed on the fixed terminal device. FIG. 8 is a diagram illustrating an example of a monitoring information screen displayed on the fixed terminal device. FIG. 8A shows a monitoring information screen when the sensor device SU repeatedly performs a predetermined event detection operation but does not detect the predetermined event, and FIG. 8B shows a sensor event when the sensor device SU detects the predetermined event. Shows the monitoring information screen when it is detected.

In the monitored person monitoring system MS having the above-described configuration, each device SU, SV, SP, TA performs initialization of each necessary part and starts its operation when the power is turned on. In the fixed terminal device SP, by executing the control processing program, the control unit 11, the monitoring processing unit 12, the parameter setting processing unit 13, the image display processing unit 15, and the image display adjustment unit 16 function in the SP control processing unit 1. Configured. The image display processing unit 15 is functionally configured with an execution determination unit 151, a processed image generation unit 152, and a resolution enhancement processing unit 153. The execution determination unit 151 includes first to sixth sub-execution determination units 1511 to 1511. 1516 is functionally configured, and the processed image generation unit 152 is functionally configured with first to fourth processed image generation units 1521 to 1524.

When the power is turned on and the operation starts, the fixed terminal device SP accepts a login operation by a supervisor (user) such as a nurse or a caregiver. In the login operation, an ID such as a user name of the monitor is input and stored in the SP storage unit 6. When the fixed terminal device SP logs into the monitored person monitoring system MS by the login operation, the fixed terminal device SP displays the main screen on the SP display unit 4 by the control unit 11 of the SP control processing unit 1.

The main screen is a screen for receiving the operation mode of the fixed terminal device SP. For example, as shown in FIG. 5, the main screen 21 includes a “service mode” button 211 and a “setting mode” button 212. The “service mode” button 211 is a button for requesting the service mode for monitoring the monitored person Ob as the operation mode of the fixed terminal device SP, and an instruction (command, command) for operating the fixed terminal device SP in the service mode. ) Is a button for inputting. The “setting mode” button 212 is a button for requesting a setting mode for setting the predetermined parameter as an operation mode of the fixed terminal device SP, and is used to input an instruction to operate the fixed terminal device SP in the setting mode. It is a button.

When an input operation is received from the SP input unit 3 while the main screen 21 is displayed on the SP display unit 4, the fixed terminal device SP is received by the control unit 11 of the SP control processing unit 1. It is determined whether the input operation is an input operation of the “service mode” button 211 or an input operation of the “setting mode” button 212.

As a result of this determination, if the accepted input operation is an input operation of the “service mode” button 211, the fixed terminal device SP stores in the SP storage unit 6 that the operation mode is the service mode, and the SP The operation is started in the service mode so that the monitored person Ob is monitored by the monitoring processor 12 of the control processor 1. The operation of the fixed terminal device SP in this service mode will be described later including the operation of the entire monitored person monitoring system MS. The input operation is, for example, an operation in which the cursor is moved onto the “service mode” button 211 by moving the mouse and the mouse is left-clicked. Each button displayed on the SP display unit 4 is similarly input.

On the other hand, as a result of the determination, if the accepted input operation is an input operation of the “setting mode” button 212, the fixed terminal device SP stores in the SP storage unit 6 that the operation mode is the setting mode. Then, the operation starts in the setting mode so that the parameter setting processing unit 13 of the SP control processing unit 1 sets the predetermined parameter.

In the setting mode, as described above, when the input operation of the “setting mode” button 212 is received from the SP input unit 3, the fixed terminal device SP is set to the SP display unit 4 by the parameter setting processing unit 13 of the SP control processing unit 1. Display the setting screen. In the present embodiment, authentication is performed using an ID such as a user name, and only the authorized user (setting person) can enter the setting mode.

The setting screen is a screen for inputting and setting the predetermined parameter. In the present embodiment, the predetermined parameter is a setting value used to appropriately determine the predetermined event. For example, an imaging condition for extracting a monitored person from an image, noise in the determination, And a threshold value (determination threshold value) for the determination. More specifically, in the present embodiment, as will be described later, the frame rate, the brightness level, the ceiling height, and the location area of the bedding BD. In this embodiment, the setting screen includes two first and second setting screens. The first setting screen inputs (determines) the monitored person Ob (sensor device SU) that is a parameter setting target, and among the predetermined parameters, is mainly a numerical parameter (in this embodiment, a frame rate). , Brightness level and ceiling height) are input and set. The second setting screen is a screen for inputting and setting other parameters (in this embodiment, the region where the bedding BD is located) other than the numerical parameters among the predetermined parameters. Other specific areas may also be input using the second setting screen.

More specifically, when an input operation of the “setting mode” button 212 is received from the SP input unit 3, the parameter setting processing unit 13 displays the first setting screen on the SP display unit 4.

For example, as shown in FIG. 6, the first setting screen 22 is configured to input and set a monitored person name input setting area 221 for inputting and setting the name of the monitored person Ob, and a frame rate. Frame rate input setting area 222, brightness level input setting area 223 for inputting and setting the brightness level, ceiling height input setting area 224 for inputting and setting the ceiling height, An “area setting” button 225 and a “return to main screen” button 226 are provided. Each of the input setting areas 221 to 224 includes a parameter value input field and an “update” button for storing and setting a parameter with the parameter value input in the input field. The “area setting” button 225 is a button for requesting the second setting screen, and is a button for inputting an instruction to display the second setting screen on the fixed terminal device SP. The “return to main screen” button 226 is a button for requesting the main screen 21 and a button for inputting an instruction to display the main screen 21 on the fixed terminal device SP. The “return to main screen” button 226 is also a button for setting each parameter value stored as a parameter in the SP storage unit 6 to the sensor device SU via the management server device SV.

In the example shown in FIG. 6, “Mr. A”, “15 fps”, “5”, and “2.4 m” are entered in the input fields in the input setting areas 221 to 224, respectively. When the “update” button in the monitored person name input setting area 221 is input, the parameter setting processing unit 13 sets the parameter setting target to “Mr. A” and stores it in the SP storage unit 6. The sensor device SU that monitors “Mr. A” or its sensor ID may be input and set as a parameter setting target. When the “update” button in the frame rate input setting area 222 is input, the parameter setting processing unit 13 sets the frame rate to “15 fps” and stores the frame rate in the SP storage unit 6. Since the sensor device SU executes the above-described event detection operation for each frame or every several frames, the execution interval of the event detection operation is defined by setting the frame rate. When the “update” button in the brightness level input setting area 223 is input, the parameter setting processing unit 13 sets the brightness level to “5” and stores it in the SP storage unit 6. If the target image captured by the sensor device SU is too dark or too bright, it is difficult to extract a moving body region as a person region of the monitored person Ob from the target image, and it is difficult to identify a person. By setting the brightness level, the target image can be generated with appropriate exposure, the moving object region can be extracted more appropriately, and the person can be identified more appropriately. The frame rate is an example of the imaging condition, and the brightness level is another example of the imaging condition. When the “update” button in the ceiling height input setting area 224 is input, the parameter setting processing unit 13 sets the ceiling height to “2.4 m” and stores it in the SP storage unit 6. The first and second threshold values Th <b> 1 and Th <b> 2 when the sensor device SU is disposed on a ceiling with a reference ceiling height (e.g., 2.4 m) are stored in advance in the sensor device SU as default values. By setting the ceiling height, the first and second threshold values Th1 and Th2 of the default values are corrected, and the corrected first and second threshold values Th1 and Th2 are used for the detection of the predetermined action described above. . By setting the ceiling height, the first and second threshold values Th1 and Th2 can be adjusted according to the situation of the sensor device SU that is actually installed. The ceiling height is an example of the determination threshold.

When accepting an input operation of the “area setting” button 225 from the SP input unit 3, the SP control processing unit 1 displays the second setting screen on the SP display unit 4.

The second setting screen 23 includes a target image display area 231 for displaying a target image, an “update” button 232, and a “return” button 233, for example, as shown in FIG. In the target image display area 231, the target image processed so as to protect the privacy by the image display processing unit 15 is displayed. The operation of the target image display area 231 will be described later. The “update” button 232 is a button for requesting parameter setting in the area input from the SP input unit 3 while referring to the target image displayed in the target image display area 231. In the present embodiment, the location area of the bedding BD is set. The “return” button 233 is a button for requesting the first setting screen 22, and is a button for inputting an instruction to display the first setting screen 22 on the fixed terminal device SP.

In such a second setting screen 23, when the second setting screen 23 is displayed on the SP display unit 3, the parameter setting processing unit 13 waits for an area where the bedding BD is located. When the user inputs four vertices of the location area of the bedding BD from the SP input unit 3 and performs an input operation on the “update” button 232, the pixel positions of the four vertices of the location area of the bedding BD are displayed by the parameter setting processing unit 13. Is stored in the area information storage unit 63, and the location area of the bedding BD is set. FIG. 7 shows a state in which the user has input four vertices (●) of the location area of the bedding BD from the SP input unit 3. When the “return” button 233 is input, the first setting screen 22 is displayed on the SP display unit 4.

The location area of the bedding BD is another example of the determination threshold. In addition, as an example of what becomes noise in the determination, an image area of a curtain that is easily misidentified as a moving object that is the monitored person Ob may be set. In this case, when detecting the predetermined action, the moving object region extracted in the image region of the curtain is excluded.

Then, when the “return to main screen” button 226 is input, the main screen 21 is displayed on the SP display unit 4. Then, the parameter setting processing unit 13 transmits each parameter value stored as a parameter in the SP storage unit 6 to the sensor device SU via the management server device SV, and the sensor device SU automatically receives the received parameter value. Set to machine SU. Thereby, each value of the predetermined parameter is set in the sensor device SU.

Next, the operation of the image display processing unit 15 will be described. As described above, when an input operation of the “area setting” button 225 is received from the SP input unit 3, first, in FIG. 3 and FIG. 4, the parameter setting processing unit 13 inputs the monitored person name on the first setting screen 22. The target image of the monitored person Ob input in the setting area 221 is acquired (S11). More specifically, the parameter setting processing unit 13 requests a target image to be sent to the sensor device SU that monitors the monitored person Ob input in the monitored person name input setting area 221 of the first setting screen 22. A communication signal (target image request communication signal) containing information indicating (command) is transmitted from the SP communication IF unit 2. The SP storage unit 6 stores a correspondence relationship between the monitored person Ob and the sensor device SU that monitors the person Ob. Note that the parameter setting processing unit 13 sends the sensor ID of the sensor device SU that monitors the monitored person Ob input to the monitored person name input setting area 221 of the first setting screen 22 and a command requesting the target image ( A communication signal containing information representing a command) may be transmitted to the monitoring server device SV, and the target image request communication signal may be transmitted to the sensor device SU via the management server device SV. Upon receiving the target image request communication signal, the sensor device SU generates a target image by imaging the target area, and then transmits a communication signal (target image notification) containing the sensor ID of the own device and the generated target image. (Communication signal) is transmitted (returned) to the fixed terminal device SP (or transmitted to the fixed terminal device SP via the management server device SV). As a result, the fixed terminal device SP acquires the target image by the SP communication IF unit 2. The following processes are executed for the monitored person Ob input in the monitored person name input setting area 221 of the first setting screen 22.

Next, the image display processing unit 15 uses the first sub-execution determining unit 1511 of the execution determining unit 151 to input the worker information input from the SP input unit 3 (in this embodiment, the SP storage unit 6 is input at the time of login). It is determined whether the permitter information stored in the permitter information storage unit 62 and the ID stored in the permitter information storage unit 62 match (S12).

Note that the worker information may be input from the SP input unit 3 when the setting mode is activated as described above. For example, when the “setting mode” button 212 is input on the main screen 21 or when the “area setting” button 225 is input on the first setting screen 22, a screen for entering worker information ( An operator information input screen (not shown) is displayed on the SP display unit 4 and the operator information (user, operator) is input from the SP input unit 3 by the supervisor (user, operator).

As a result of the determination, if it is determined that the worker information matches the permitter information (Yes), the process S13 is executed. On the other hand, if it is determined as a result of the determination that the worker information and the permitter information do not match (No), the first sub-execution determination unit 1511 executes the predetermined image processing at the first processing level. Then, the process S14 is executed.

In process S13, the first sub-execution determination unit 1511 further determines whether or not a toilet is reflected in the target image. As a result of this determination, if it is determined that the toilet is not reflected in the target image (No), the first sub-execution determination unit 1511 determines that the predetermined image processing is not performed, and then processing S32 Is executed. On the other hand, as a result of the determination, when it is determined that a toilet is reflected in the target image (Yes), the first sub-execution determination unit 1511 determines that the predetermined image processing is to be executed at the second processing level. Next, process S15 is executed. This is because it is thought that it is better not to look at the toilet even if it is a caregiver or the like who is usually in contact.

In process S14, the image display processing unit 15 generates a first processed image by executing the predetermined image processing on the target image at the first processing level by the fourth sub-processed image generation unit 1524. The generated first processed image is set as the target image. That is, the target image before the predetermined image processing is replaced with a first processed image ((the first processed image) → (the target image)). Then, step S16 is executed.

In process S15, the image display processing unit 15 generates a second processed image by executing the predetermined image processing on the target image at the second processing level by the fourth sub-processed image generation unit 1524. The generated second processed image is set as the target image. That is, the target image before the predetermined image processing is replaced with a second processed image ((second processed image) → (target image)). Then, step S16 is executed.

In process S16, the image display processing unit 15 uses the second sub-execution determination unit 1512 of the execution determination unit 151 to display an image of a region outside the predetermined specific region stored in the region information storage unit 63 in the target image. It is determined whether or not there is a person image. As a result of this determination, if it is determined that there is an image of the person (Yes), the second sub-execution determination unit 1512 stores the predetermined image processing in the region information storage unit 63 in the target image. In addition, it is determined that the image is to be executed on an image outside the predetermined specific area, and then processing S17 is executed. On the other hand, when it is determined that there is no image of the person as a result of the determination (No), the second sub-execution determination unit 1512 determines that the predetermined image processing is not performed, and then processing S18 is performed. Executed.

In step S17, the image display processing unit 15 causes the first sub-processed image generation unit 1521 to perform the predetermined image processing outside the predetermined specific area stored in the area information storage unit 63 in the target image. Execute on the image of the area. Then, step S18 is executed.

In process S18, the image display processing unit 15 determines whether the third sub-execution determination unit 1513 infringes privacy on the image of the person in the target image. As a result of this determination, if it is determined that the privacy is infringed (Yes), then processing S19 is executed. On the other hand, if it is determined as a result of the determination that privacy is not infringed (No), the third sub-execution determination unit 1513 determines that the predetermined image processing is not performed, and then processing S32 is performed. Is done.

In process S19, the image display processing unit 15 determines whether or not the image resolution of the target image when the fourth sub execution determination unit 1514 displays the target image on the SP display unit 4 is equal to or lower than the first resolution threshold value. Determine. As a result of this determination, if it is determined that it is not less than or equal to the first resolution threshold value (No), next, step S22 is executed. On the other hand, if it is determined as a result of the determination that it is equal to or less than the first resolution threshold value (Yes), then step S20 is executed.

In process S20, the fourth sub execution determination unit 1514 further determines whether or not the image resolution of the target image when the target image is displayed on the SP display unit 4 is equal to or higher than a second resolution threshold. As a result of this determination, if it is determined that the value is not equal to or greater than the second resolution threshold value (No), then step S21 is executed. On the other hand, as a result of the determination, if it is determined that the value is equal to or greater than the second resolution threshold (Yes), the fourth sub-execution determination unit 1514 determines that the predetermined image processing is not performed, and then performs processing S32 is executed.

In process S21, the image display processing unit 15 generates a high-resolution image by increasing the resolution of the target image to a predetermined resolution by the high-resolution processing unit 153, and the generated high-resolution image is converted into the target image. And That is, the target image before the resolution enhancement process is replaced with the resolution enhancement image ((the resolution enhancement image) → (the target image)). Then, step S22 is executed.

In process S22, the image display processing unit 15 uses the fifth sub-execution determination unit 1515 to determine whether or not a background image excluding a person image in the target image infringes on privacy. As a result of this determination, if it is determined that privacy is infringed (Yes), the fifth sub-execution determining unit 1515 determines that the predetermined image processing is the privacy infringement of the background images. It determines with performing with respect to the partial image of the predetermined range containing the determined image, and next, process S23 is performed. On the other hand, as a result of the determination, if it is determined that it is not an infringement of privacy (No), the fifth sub-execution determination unit 1515 determines that the predetermined image processing is not performed, and then processing S24 performs Executed.

In the process S23, the image display processing unit 15 performs the predetermined image processing by the second sub-processed image generation unit 1522, including a predetermined image including an image determined to be an infringement of privacy among the background images. Execute for partial images in the range (images of infringing material areas). Then, step S24 is executed.

In process S24, the image display processing unit 15 determines whether the target image includes a person image by the sixth sub-execution determination unit 1516. More specifically, the sixth sub-execution determination unit 1516 determines whether or not there is a moving object region as a person region from the target image, for example, by a frame difference method or a background difference method. As a result of this determination, when it is determined that there is no person, more specifically, when it is determined that there is no moving object region, the sixth sub-execution determination unit 1516 determines that the predetermined image processing is not performed. Then, step S32 is executed. On the other hand, as a result of the determination, if it is determined that there is a person, more specifically, if it is determined that there is a moving object region, then process S25 is executed.

In process S25, the sixth sub execution determination unit 1516 determines whether or not the person is in bed. More specifically, in the present embodiment, the sixth sub-execution determination unit 1516 determines whether or not the moving object region is within the bedding location region stored in the region information storage unit 63. As a result of this determination, if it is determined that the person is lying on the floor (the moving object region is present in the bedding location region) (Yes), the sixth sub-execution determining unit 1516 determines that the predetermined image It is determined that the process is to be performed on the image in the area where the bedding is located, and then process S26 is performed. On the other hand, if it is determined as a result of the determination that the person is not lying on the bed (the moving body area does not exist within the area where the bedding is located) (No), then step S27 is executed.

In process S26, the image display processing unit 15 causes the third sub-processed image generation unit 1523 to execute the predetermined image processing on the image in the area where the bedding is located. Then, step S27 is executed.

In process S27, the image display processing unit 15 determines whether the target image infringes privacy by the image display adjustment unit 16 by the third and fifth

sub-execution determination units

1513 and 1515, respectively. As a result, the target image of the processed image generated by the processed image generation unit 152 is re-determined from the viewpoint of privacy infringement. As a result of this determination, if it is determined that the privacy is infringed (Yes), the process S28 is executed next. On the other hand, if it is determined that the privacy is not infringed (No), the process is then performed. S32 is executed.

In process S28, the image display processing unit 15 determines whether or not a substitute image corresponding to the monitored person Ob is stored in the substitute image storage unit 65. As a result of this determination, if the substitute image corresponding to the monitored person Ob is not stored in the substitute image storage unit 65 (No), next, the process S29 is executed, while the corresponding person corresponds to the monitored person Ob. If the substitute image is stored in the substitute image storage unit 65 (Yes), the process S31 is executed next.

In the process S29, the image display adjustment unit 16 prohibits the display of the target image on the SP display unit 4 (without displaying the target image on the SP display unit 4), and then the process S30 is executed. .

In this process S30, the parameter setting processing unit 13 re-acquires the target image in the SP communication IF unit 2 and returns the process to the process S16 in order to perform the re-acquired process, as in the above-described process S11. As a result, the re-acquired target image is reprocessed by the image display processing unit 15.

On the other hand, in the process S31, the image display processing unit 15 sets the substitute image corresponding to the monitored person Ob stored in the substitute image storage unit 65 as the target image. That is, the target image is replaced with a substitute image ((substitute image) → (target image)). Then, step S32 is executed.

In processing S32, the parameter setting processing unit 13 causes the image display processing unit 15 to display the target image on the SP display unit 4.

Next, when the second setting screen 23 is displayed, the parameter setting processing unit 13 receives an input of the location area of the bedding BD from the SP input unit 3, and receives an input operation of the “update” button 232. The location area is set as one of the predetermined parameters (S33).

Then, the parameter setting processing unit 13 substitutes the target image being displayed on the second setting screen 23 as the next substitute image when the location area of the bedding BD is set as one of the predetermined parameters in this process S33. It memorize | stores in the image memory | storage part 65 (S34), and complete | finishes this process.

On the other hand, when the input operation of the “service mode” button 211 is received from the SP input unit 3 on the main screen 21 described above, the fixed terminal device SP operates in the service mode, and the monitored person monitoring system MS The person to be monitored Ob is monitored by operating in this manner.

In monitoring of the monitored person Ob, the sensor device SU detects a predetermined operation in the monitored person Ob by performing the following operation for each frame or every several frames, and also for the nurse call. The presence or absence of reception is determined. First, the sensor device SU acquires an image (image data) for one frame from the image sensor as a target image, detects a predetermined action in the monitored person Ob based on the acquired target image, and performs the predetermined operation. When an action is detected, in order to notify the detection result to a predetermined terminal device SP or TA, a first event notification communication signal for detecting the predetermined action that contains the predetermined action detected as the event information is stored. Is transmitted to the management server device SV. While operating in this manner, the sensor device SU determines whether or not a nurse call is accepted, and when accepting the nurse call, notifies the predetermined terminal devices SP and TA of the acceptance of the nurse call. In addition, the sensor device SU transmits a first event notification communication signal for receiving the nurse call, which accommodates the received nurse call as the event information, to the management server device SV.

When the management server device SV receives the first event notification communication signal from the sensor device SU via the network NW, each information such as the sensor ID and the event information accommodated in the first event notification communication signal is stored in the sensor ID. Is stored (recorded) as monitoring information of the monitored person Ob monitored by the sensor device SU having That is, the management server device SV stores each information such as the sensor ID and event information stored in the first event notification communication signal in association with each other. Then, the management server device SV transmits a second event notification communication signal to the notification destination terminal devices SP and TA corresponding to the transmission source (notification source) sensor device SU in the received first event notification communication signal.

When the fixed terminal device SP and the mobile terminal device TA receive the second event notification communication signal from the management server device SV via the network NW, the sensor accommodated in the second event notification communication signal by the monitoring processing unit 12 Each information such as ID and event information is stored (recorded) in the monitoring information storage unit 61 as monitoring information of the monitored person Ob monitored by the sensor device SU having this sensor ID, and the monitoring information is displayed. For example, when the sensor device SU repeatedly executes a predetermined event detection operation but does not detect the predetermined event, the SP display unit 4 of the fixed terminal device SP displays the monitoring information screen shown in FIG. 8A. 31a is displayed, and when the sensor device SU detects a predetermined event and the detected predetermined event is notified by the second event notification communication signal, the SP display unit 4 of the fixed terminal device SP is displayed in FIG. A monitoring information screen 31b is displayed. The monitoring information screen 31a illustrated in FIG. 8A includes a monitoring image display area 311 that displays an image captured by the sensor device SU. The monitoring information screen 31b shown in FIG. 8B further includes an event display area 312 for displaying the type of event detected by the sensor device SU. In the example shown in FIG. 8B, an event display area 312 is displayed in which a message “Getting out of bed” is displayed superimposed on the monitoring image display area 311.

As described above, the monitored person monitoring system MS, the monitored person monitoring apparatus setting apparatus, and the fixed terminal apparatus SP incorporating the method according to the present embodiment have an operation mode of the setting mode regardless of the authority management information. In this case, a processed image is generated by executing predetermined image processing so as to protect the privacy of the target image, and the generated processed image is set as the target image and displayed on the SP display unit 4. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can more appropriately protect the privacy of the monitored person Ob when the operation mode is the setting mode.

Since the monitored person monitoring system MS and the fixed terminal device SP include the execution determination unit 151, unnecessary image processing can be stopped when the target image does not infringe privacy.

For example, since a caregiver or nurse in charge of the monitored person Ob is in contact with the monitored person on a daily basis, the caregiver or nurse in charge of the monitored person is informed of the monitored person. Requests to protect privacy are considered low. The monitored person monitoring system MS and the fixed terminal device SP execute the predetermined image processing when it is determined that the worker information does not match the authorized person information. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can execute the predetermined image processing when necessary, and can more appropriately protect the privacy of the monitored person Ob.

When the monitored person monitoring system MS and the fixed terminal device SP determine that there is a person image in an image outside the predetermined specific area, the predetermined image processing is performed on the target image. The process is executed on an image outside a predetermined specific area. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person Ob.

The monitored person monitoring system MS and the fixed terminal device SP determine whether or not the image of the person in the target image infringes privacy, and when it is determined that it is not infringement of privacy, the predetermined image It is determined that the process is not executed. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can more appropriately protect the privacy of the person reflected in the target image.

If the image resolution of the display is low, the subject appearing in the target image cannot be identified, so the target image with a low display image resolution is considered to be an image that does not infringe privacy. The monitored person monitoring system MS and the fixed terminal device SP do not execute the predetermined image processing when the display image resolution is equal to or lower than a predetermined threshold. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can execute the predetermined image processing when necessary, and can more appropriately protect the privacy of the monitored person Ob.

In some cases, a background image of a person image in the target image includes, for example, a photograph of the monitored person Ob or a photograph of the family member. If the monitored person monitoring system MS and the fixed terminal device SP determine that the background image is a violation of privacy, the predetermined image processing is determined to be a violation of privacy among the background images. The process is executed on a partial image in a predetermined range including the determined image. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person.

When the monitored person monitoring system MS and the fixed terminal device SP determine that there is an image of a person lying on the bed in a predetermined area of the bedding set in the target image, the predetermined image processing is performed as described above. Execute on the image in the area where the bedding is located. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person Ob.

Since the monitored person monitoring system MS and the fixed terminal device SP determine whether or not the processed image is infringed on the privacy, the monitored person's privacy can be protected more reliably.

In the above-described embodiment, the image acquisition unit is the SP communication IF unit 2, but may be an image sensor (for example, a visible camera or an infrared camera) that generates a target image. In such a case, the setting device for the monitored person monitoring device may be incorporated in the sensor device SU.

In the above-described embodiment, the setting device for the monitored person monitoring device is incorporated in the fixed terminal device SP. However, as described above, it may be a separate unit, and as shown by a broken line in FIG. The monitoring system SM may be configured to include a separate monitoring target person monitoring device setting device ST. Such a monitoring device setting device ST for the monitored person includes the above-described control unit 11, parameter setting processing unit 13, image display processing unit 15 and image display adjustment unit 16 in the SP control processing unit 1, and SP communication IF. Each unit includes the same units as the unit 2, the SP input unit 3, the SP display unit 4, and the SP storage unit 6.

This specification discloses various modes of technology as described above, and the main technologies are summarized below.

A setting apparatus for a monitored person monitoring apparatus according to one aspect is a setting apparatus for a monitored person monitoring apparatus that sets a predetermined parameter in a monitored person monitoring apparatus that monitors the monitored person, An image acquisition unit that acquires a target image whose target is an image of a place where the monitored person is present, a display unit that performs display, and an image display processing unit that displays the target image acquired by the image acquisition unit on the display unit. And the image display processing unit executes a predetermined image processing so as to protect privacy for the target image when the operation mode is a setting mode for setting the predetermined parameter. And generating the processed image as the target image.

Such a monitored person monitoring device setting device executes predetermined image processing so as to protect privacy for the target image when the operation mode is the setting mode regardless of the authority management information. Then, a processed image is generated, and the generated processed image is set as the target image and displayed on the display unit. For this reason, when the operation mode is the setting mode, the setting device for the monitored person monitoring device can more appropriately protect the privacy of the monitored person.

In another aspect, in the above-described monitored person monitoring device setting device, the image display processing unit provides privacy to the target image when the operation mode is a setting mode for setting the predetermined parameter. An execution determination unit that determines whether or not to execute predetermined image processing to protect, and a processed image by executing the predetermined image processing on the target image based on a determination result of the execution determination unit And a processed image generation unit that uses the generated processed image as the target image.

Such a setting apparatus for a monitored person monitoring apparatus includes an execution determination unit, so that it is possible to stop execution of unnecessary image processing when the target image does not infringe privacy.

In another aspect, in the above-described monitoring target person monitoring device setting device, an input unit for inputting worker information for identifying and identifying a worker in the setting mode, and an authorized person who can refer to the target image are represented. A permitter information storage unit for storing permitter information, wherein the execution determination unit matches the worker information input from the input unit with the permitter information stored in the permitter information storage unit. A first sub-execution determination unit that determines that the predetermined image processing is to be executed when it is determined that they do not match as a result of the determination. Preferably, in the above-described monitoring target person monitoring device setting device, when the first sub-execution determination unit determines that they do not match as a result of the determination, the predetermined image processing is executed at the first processing level. If the result of the determination is that they match, it is further determined whether or not a toilet is shown in the target image. If the result of the determination is that the toilet is shown, It is determined that the image processing is to be executed at a second processing level lower than the first processing level, and the processed image generation unit executes the predetermined image processing at the first processing level by the first sub execution determination unit of the execution determination unit. Then, when it is determined, a first processed image is generated by executing the predetermined image processing on the target image at the first processing level, and the generated first processed image is set as the target image. When the first sub execution determination unit of the execution determination unit determines that the predetermined image processing is to be executed at the second processing level, the predetermined image processing is executed on the target image at the second processing level. Then, a second processed image is generated, and the generated second processed image is set as the target image.

For example, since a caregiver or nurse who is in charge of the monitored person is in contact with the monitored person on a daily basis, the privacy of the monitored person is not given to the caregiver or nurse who is in charge of the monitored person. The demand to protect the country is considered low. The monitored person monitoring device setting device executes the predetermined image processing when it is determined that the worker information does not match the permitter information. For this reason, the setting apparatus for the monitored person monitoring apparatus can execute the predetermined image processing when necessary, and can more appropriately protect the privacy of the monitored person.

In another aspect, in the above-described monitored person monitoring apparatus setting device, the information processing apparatus further includes a region information storage unit that stores a predetermined specific region in the target image, and the execution determination unit includes the region in the target image. It is determined whether or not there is a person image in an image outside the predetermined specific area stored in the information storage unit, and when it is determined that the person image exists as a result of the determination, the predetermined image A second sub-execution determining unit that determines to execute the image processing on an image in the target image outside the predetermined specific region stored in the region information storage unit. The second sub-execution determination unit of the execution determination unit performs the predetermined image processing on an image of a region outside the predetermined specific region stored in the region information storage unit in the target image. Run A first sub-processed image generation unit that executes the predetermined image processing on an image in a region outside the predetermined specific region stored in the region information storage unit in the target image. Is provided.

When such a monitoring target person monitoring device setting device determines that there is a person image in an image outside the predetermined specific region, the predetermined image processing is performed on the target image in the region. The process is executed on an image in an area outside the predetermined specific area stored in the information storage unit. Therefore, the setting device for the monitored person monitoring apparatus can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person.

In another aspect, in the above-described monitored person monitoring device setting device, the execution determination unit determines whether or not an image of a person in the target image infringes privacy, and as a result of the determination, A third sub-execution determination unit that determines that the predetermined image processing is not executed when it is determined that the privacy is not infringed is provided.

Such a setting device for a monitored person monitoring device can more appropriately protect the privacy of a person reflected in the target image.

In another aspect, in the above-described monitored person monitoring apparatus setting device, the execution determination unit determines whether an image resolution of the target image when the target image is displayed on the display unit is a predetermined threshold value or less. A fourth sub-execution determining unit that determines that the predetermined image processing is not to be executed when it is determined that the predetermined image processing is less than or equal to the predetermined threshold.

If the image resolution of the display is low, the subject appearing in the target image cannot be identified, so the target image with a low display image resolution is considered to be an image that does not infringe privacy. The monitored person monitoring device setting device does not execute the predetermined image processing when the display image resolution is equal to or lower than a predetermined threshold value. For this reason, the setting apparatus for the monitored person monitoring apparatus can execute the predetermined image processing when necessary, and can more appropriately protect the privacy of the monitored person.

In another aspect, in the above-described monitored person monitoring device setting device, the execution determination unit determines whether a background image excluding a person image of the target image infringes privacy, and As a result of the determination, when it is determined that privacy is infringed, the predetermined image processing is performed on a partial image in a predetermined range including the image determined to be infringement of privacy among the background images. A fifth sub-execution determination unit that determines to execute, and the processed image generation unit includes the fifth sub-execution determination unit of the execution determination unit that performs the predetermined image processing in the privacy of the background image. If it is determined to execute a partial image in a predetermined range including an image determined to be an infringement, the predetermined image processing is an infringement of the privacy among the background images. Partial image of a predetermined range including the determined image contrast, a second sub-processing image generating unit to perform.

In some cases, a background image of a person image in the target image includes, for example, a photograph of the person being monitored or a photograph of the family member. When the background image is determined to be an infringement of privacy, the setting device for the monitored person monitoring device determines that the predetermined image processing is an infringement of privacy among the background images. The process is executed on a partial image in a predetermined range including the image. Therefore, the setting device for the monitored person monitoring apparatus can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person.

In another aspect, in the above-described monitored person monitoring device setting device, the execution determination unit determines whether or not there is an image of a person lying on the bed in a region where the bedding is preset in the target image. A sixth sub-execution determining unit that determines that the predetermined image processing is to be executed on the image in the area where the bedding is located when it is determined that there is an image of the person on the bed as a result of the determination; The processed image generation unit is configured to execute the predetermined image processing when the sixth sub-execution determination unit of the execution determination unit determines that the predetermined image processing is to be executed on an image in the location area of the bedding. A third sub-processed image generation unit is provided that performs image processing on an image in an area where the bedding is located. Preferably, in the above-described monitored person monitoring device setting device, the predetermined image processing based on the determination result of the first sub-execution determination unit, the predetermined image processing based on the determination result of the second sub-execution determination unit, and the first The predetermined image processing based on the determination result of the third sub execution determination unit, the predetermined image processing based on the determination result of the fourth sub execution determination unit, and the predetermined image processing based on the determination result of the fifth sub execution determination unit; The predetermined image processing based on the determination result of the sixth sub execution determination unit is different from each other. Preferably, in the above-described monitored person monitoring device setting device, the predetermined image processing based on the determination result of the first sub-execution determination unit, the predetermined image processing based on the determination result of the second sub-execution determination unit, and the first The predetermined image processing based on the determination result of the third sub execution determination unit, the predetermined image processing based on the determination result of the fourth sub execution determination unit, and the predetermined image processing based on the determination result of the fifth sub execution determination unit; The predetermined image processing based on the determination result of the sixth sub execution determination unit is the same as each other. Preferably, in the above-described monitored person monitoring device setting device, the predetermined image processing based on the determination result of the first sub-execution determination unit, the predetermined image processing based on the determination result of the second sub-execution determination unit, and the first The predetermined image processing based on the determination result of the third sub execution determination unit, the predetermined image processing based on the determination result of the fourth sub execution determination unit, and the predetermined image processing based on the determination result of the fifth sub execution determination unit; The predetermined image processing based on the determination result of the sixth sub-execution determination unit is partly different from each other and the remaining part is the same.

Such a monitored person monitoring apparatus setting device performs the predetermined image processing when it is determined that an image of a person lying on the bed is present in an area where the bedding is preset in the target image. This is performed on the image in the region where Therefore, the setting device for the monitored person monitoring apparatus can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person.

In another aspect, in the above-described monitored person monitoring device setting device, it is determined whether or not the target image of the processed image generated by the processed image generation unit infringes privacy. And an image display adjustment unit that does not display the target image of the processed image on the display unit by the image display processing unit. Preferably, in the above-described monitored person monitoring device setting device, the image display adjustment unit is configured so that a target image of the processed image generated by the processed image generation unit by each of the third and fifth sub-execution determination units. Determine whether to violate privacy.

Since such a setting device for a monitored person monitoring device determines whether or not the processed image infringes on privacy, the monitored person's privacy can be protected more reliably.

A setting method for a monitored person monitoring apparatus according to another aspect is a setting method for a monitored person monitoring apparatus that sets a predetermined parameter in a monitored person monitoring apparatus that monitors the monitored person. An image acquisition process for acquiring a target image for imaging a place where the monitored person is present, and an image display process for displaying the target image acquired in the image acquisition process on a display unit. When the operation mode is a setting mode for setting the predetermined parameter, a process image is generated by executing predetermined image processing so as to protect privacy for the target image, and the generated The processed image is set as the target image.

Such a setting method for a monitored person monitoring device executes predetermined image processing so as to protect privacy for the target image when the operation mode is the setting mode regardless of the authority management information. Then, a processed image is generated, and the generated processed image is set as the target image and displayed on the display unit. Therefore, the setting method for the monitored person monitoring apparatus can more appropriately protect the privacy of the monitored person when the operation mode is the setting mode.

A monitored person monitoring system according to another aspect includes a monitored person monitoring apparatus that monitors a monitored person, and a communication result connected to the monitored person monitoring apparatus, and notification of a monitoring result of the monitored person monitoring apparatus A monitoring device including a terminal device for receiving the image, wherein the image acquisition unit acquires a target image for imaging a place where the monitored person is present, a display unit that performs display, and the image acquisition unit. An image display processing unit that displays the acquired target image on the display unit, and the image display processing unit is configured to display the target image when the operation mode is a setting mode for setting the predetermined parameter. A processed image is generated by executing predetermined image processing so as to protect privacy, and the generated processed image is set as the target image. Preferably, a monitored person monitoring device that monitors a monitored person that is a monitoring target, and a terminal device that is communicably connected to the monitored person monitoring device and receives a notification of a monitoring result of the monitored person monitoring device. The system provided further includes any one of the above-described monitored person monitoring apparatus setting devices.

Since such a monitored person monitoring system further includes any one of the above-described setting apparatuses for the monitored person monitoring device, the privacy of the monitored person can be more appropriately protected.

This application is based on Japanese Patent Application No. 2016-228281 filed on November 24, 2016, including the specification, claims, drawings and abstract, and the entire disclosure thereof is Incorporated herein by reference.

Although embodiments of the present invention have been illustrated and described in detail, it is merely exemplary and illustrative and not limiting. The scope of the invention should be construed by the language of the appended claims.

In order to express the present invention, the present invention has been properly and fully described through the embodiments with reference to the drawings. However, those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that this is possible. Therefore, unless the modifications or improvements implemented by those skilled in the art are at a level that departs from the scope of the claims recited in the claims, the modifications or improvements are not covered by the claims. To be construed as inclusive.

ADVANTAGE OF THE INVENTION According to this invention, the setting apparatus for monitored person monitoring apparatuses, this method, and a monitored person monitoring system can be provided.

Claims

In the monitored person monitoring apparatus for monitoring the monitored person, a setting apparatus for the monitored person monitoring apparatus that sets a predetermined parameter defined in advance,
An image acquisition unit for acquiring a target image whose imaging target is a place where the monitored person is present;
A display unit for displaying, and
An image display processing unit that displays the target image acquired by the image acquisition unit on the display unit;
The image display processing unit generates a processed image by executing predetermined image processing so as to protect privacy for the target image when the operation mode is a setting mode for setting the predetermined parameter. , The generated processed image as the target image,
Setting device for monitored person monitoring device.
The image display processing unit
An execution determination unit that determines whether or not to execute predetermined image processing so as to protect privacy for the target image when the operation mode is a setting mode for setting the predetermined parameter;
A modified image generating unit configured to generate a processed image by executing the predetermined image processing on the target image based on a determination result of the execution determining unit, and to use the generated processed image as the target image; ,
The setting apparatus for a monitored person monitoring apparatus according to claim 1.
An input unit for inputting worker information for identifying and identifying a worker in the setting mode;
A permitter information storage unit that stores permitter information representing a permitter who can refer to the target image;
The execution determination unit determines whether the worker information input from the input unit matches the permitter information stored in the permitter information storage unit, and determines that they do not match as a result of the determination. A first sub-execution determination unit that determines to execute the predetermined image processing when
The setting device for a monitored person monitoring device according to claim 2.
An area information storage unit for storing a predetermined specific area in the target image;
The execution determination unit determines whether or not there is a person image in an image outside the predetermined specific region stored in the region information storage unit in the target image, and as a result of the determination, When it is determined that there is an image of a person, it is determined that the predetermined image processing is performed on an image in a region outside the predetermined specific region stored in the region information storage unit in the target image. A second sub execution determination unit;
In the processed image generation unit, the second sub-execution determination unit of the execution determination unit performs the predetermined image processing in an area outside the predetermined specific area stored in the area information storage unit in the target image. When it is determined that the image is to be executed, the predetermined image processing is executed on an image in an area outside the predetermined specific area stored in the area information storage unit in the target image. 1 sub-processed image generator
The setting device for a monitored person according to claim 2 or 3.
The execution determination unit determines whether or not an image of a person in the target image infringes on privacy, and executes the predetermined image processing when it is determined that privacy is not infringed as a result of the determination. Including a third sub-execution determination unit that determines that no
The setting device for a monitored person monitoring device according to any one of claims 2 to 4.
The execution determination unit determines whether an image resolution of the target image when the target image is displayed on the display unit is equal to or lower than a predetermined threshold, and as a result of the determination, is lower than the predetermined threshold. A fourth sub-execution determination unit that determines that the predetermined image processing is not to be executed.
The setting apparatus for a monitored person monitoring apparatus according to any one of claims 2 to 5.
The execution determination unit determines whether or not a background image excluding a person's image in the target image infringes privacy, and determines that the predetermined image is a privacy infringement as a result of the determination. A fifth sub-execution determining unit that determines to perform image processing on a partial image in a predetermined range including an image determined to be an infringement of privacy among the background images;
The processed image generation unit includes a predetermined range including an image determined by the fifth sub execution determination unit of the execution determination unit as the infringement of privacy among the background images. When it is determined that the partial image is to be executed, the predetermined image processing is executed on a partial image in a predetermined range including the image determined to be infringement of the privacy among the background images. A second sub-processed image generating unit
The setting device for a monitored person monitoring device according to any one of claims 2 to 6.
The execution determination unit determines whether or not there is an image of a person lying on the bed within a predetermined area of the bedding set in the target image, and determines that there is an image of the person on the bed as a result of the determination. A sixth sub-execution determination unit that determines that the predetermined image processing is to be executed on the image in the location area of the bedding,
When the sixth sub-execution determination unit of the execution determination unit determines that the predetermined image processing is to be performed on an image in the area where the bedding is located, the processed image generation unit performs the predetermined image processing. Including a third sub-processed image generation unit that executes the image on the image in the area where the bedding is located,
The setting device for a monitored person monitoring device according to any one of claims 2 to 7.
It is determined whether or not the target image of the processed image generated by the processed image generation unit violates privacy, and when the determination result indicates that the target image of the processed image is a violation of privacy, the target image of the processed image is An image display adjustment unit that is not displayed on the display unit by the image display processing unit;
The setting device for a monitored person monitoring device according to any one of claims 2 to 8.
In the monitored person monitoring apparatus for monitoring the monitored person, a setting method for the monitored person monitoring apparatus for setting a predetermined parameter defined in advance,
An image acquisition step of acquiring a target image for imaging a place where the monitored person is present;
An image display processing step of displaying the target image acquired in the image acquisition step on a display unit,
The image display processing step generates a processed image by executing predetermined image processing so as to protect privacy for the target image when the operation mode is a setting mode for setting the predetermined parameter. , The generated processed image as the target image,
Setting method for monitored person monitoring device.
A monitored person monitoring system comprising: a monitored person monitoring device that monitors the monitored person; and a terminal device that is communicably connected to the monitored person monitoring apparatus and receives a notification of a monitoring result of the monitored person monitoring apparatus. There,
An image acquisition unit for acquiring a target image whose imaging target is a place where the monitored person is present;
A display unit for displaying, and
An image display processing unit that displays the target image acquired by the image acquisition unit on the display unit;
The image display processing unit generates a processed image by executing predetermined image processing so as to protect privacy for the target image when the operation mode is a setting mode for setting the predetermined parameter. , The generated processed image as the target image,
Monitored person monitoring system.