WO2018096806A1 - Dispositif de réglage de dispositif de surveillance de sujet surveillé, son procédé de réglage et système de surveillance de sujet surveillé - Google Patents

Dispositif de réglage de dispositif de surveillance de sujet surveillé, son procédé de réglage et système de surveillance de sujet surveillé Download PDF

Info

Publication number
WO2018096806A1
WO2018096806A1 PCT/JP2017/036408 JP2017036408W WO2018096806A1 WO 2018096806 A1 WO2018096806 A1 WO 2018096806A1 JP 2017036408 W JP2017036408 W JP 2017036408W WO 2018096806 A1 WO2018096806 A1 WO 2018096806A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
unit
predetermined
monitored person
setting
Prior art date
Application number
PCT/JP2017/036408
Other languages
English (en)
Japanese (ja)
Inventor
和浩 小島
敏行 山下
Original Assignee
コニカミノルタ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コニカミノルタ株式会社 filed Critical コニカミノルタ株式会社
Priority to JP2018552445A priority Critical patent/JPWO2018096806A1/ja
Publication of WO2018096806A1 publication Critical patent/WO2018096806A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/04—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using a single signalling line, e.g. in a closed loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to a setting apparatus for a monitored person monitoring apparatus and a setting method for a monitored person monitoring apparatus that set predetermined parameters in the monitored person monitoring apparatus that monitors the monitored person to be monitored.
  • the present invention also relates to a monitored person monitoring system that monitors the monitored person using a plurality of devices using the monitored person monitoring apparatus setting device.
  • Patent Document 1 discloses a monitored person monitoring system as one of such monitored person monitoring techniques.
  • the monitored person monitoring system disclosed in Patent Document 1 determines whether or not a predetermined event (event), such as a wake-up and a fall, has occurred in the monitored person based on the image, When it is determined that the predetermined event has occurred in the monitored person, the determination result is notified to the receiving device (terminal device).
  • a predetermined event such as a wake-up and a fall
  • the determination result is notified to the receiving device (terminal device).
  • the predetermined event for example, an imaging condition for extracting a monitored person from an image, what becomes noise in the determination, and the determination It is necessary to set a predetermined parameter such as a threshold value (determination threshold value) for.
  • a threshold value determination threshold value
  • What becomes noise in the determination includes, for example, an image area of a curtain that is easily misidentified as a moving object that is the monitored person. Since setting such parameters requires knowledge thereof, it is difficult for the monitored person to set the parameters, and a setting person different from the monitored person sets the parameters. Become.
  • the setter preferably sets the parameter while referring to an image of a target area in order to appropriately determine the predetermined event according to the monitored person.
  • the target area is usually a living space (or a residence space) of the monitored person, such as a living room of an elderly welfare facility or a hospital room. For this reason, protection of the privacy of the monitored person is required.
  • Patent Document 2 discloses an imaging device.
  • the imaging apparatus disclosed in Patent Document 2 acquires an original image by photographing a subject, and performs a reversible processing on an image in a specific region in the original image, whereby the original image is obtained.
  • a processed image is generated, and an image file in which the processed image and restoration information for specifying the content of the restoration process necessary to restore the original image from the processed image are stored in association with each other is recorded.
  • the said imaging device disclosed by the said patent document 2 is for switching control of permission / prohibition with respect to restoring the said original image from the said processed image according to the said information for restoration
  • Authority management information is further stored in the image file in association with the processed image and the restoration information.
  • authority management information is defined according to the viewer. For this reason, when the imaging device disclosed in Patent Document 2 is applied to a monitored person monitoring system, when setting the predetermined parameter, the permission management information of the permission is defined for the setter.
  • the setter can view the original image (in this case, the original image is the image of the target area), and there is a possibility that the privacy of the monitored person cannot be protected from the setter.
  • appropriate authority management information is not defined for the setter, there is a possibility that the setting cannot be completed and the system cannot be operated.
  • the present invention has been made in view of the above circumstances, and its object is to set a monitoring device for a monitored person monitoring device, a setting method for a monitored person monitoring device, and a monitoring device that can protect the privacy of the monitored person more appropriately. It is to provide a monitored person monitoring system using this.
  • a monitoring apparatus setting device for monitoring person monitoring apparatus and a method for setting a predetermined parameter in the monitoring apparatus for the monitored person which reflects one aspect of the present invention, are provided with a location where the monitored person is located.
  • the operation mode is a setting mode for setting the predetermined parameter
  • a processed image is obtained by executing predetermined image processing so as to protect privacy for the target image.
  • the generated processed image is displayed on the display unit as the target image.
  • the monitored person monitoring system uses such a setting apparatus for a monitored person monitoring apparatus.
  • the setting device for a monitored person monitoring apparatus in the present embodiment is defined in advance in a monitored person monitoring apparatus that monitors a monitored person (watched person) Ob that is a monitored object (watched object) to be monitored (watched).
  • This is a device for setting (set) predetermined parameters.
  • the monitored person monitoring device setting device includes: an image acquisition unit that acquires a target image in which a place where the monitored person Ob is present is captured; a display unit that performs display; and a target image acquired by the image acquisition unit.
  • An image display processing unit for displaying on the display unit.
  • the image display processing unit generates a processed image by executing predetermined image processing so as to protect privacy for the target image when the operation mode is a setting mode for setting the predetermined parameter.
  • the generated processed image is set as the target image.
  • a monitored person monitoring device setting device executes predetermined image processing so as to protect privacy for the target image when the operation mode is the setting mode regardless of the authority management information. Then, a processed image is generated, and the generated processed image is set as the target image and displayed on the display unit. For this reason, when the operation mode is the setting mode, the setting device for the monitored person monitoring device can more appropriately protect the privacy of the monitored person.
  • such a setting device for a monitored person monitoring apparatus will be described using a monitored person monitoring system that monitors the monitored person Ob using a plurality of devices. More specifically, the monitored person monitoring system is connected to the monitored person monitoring apparatus that monitors the monitored person Ob, and the monitored person monitoring apparatus so as to be communicable, and the monitoring result of the monitored person monitoring apparatus
  • a monitoring device setting device is further provided.
  • the monitored person monitoring device may be a single integrated device, but in the present embodiment, the monitored person monitoring device includes a plurality of separate devices. More specifically, the monitored person monitoring device includes a sensor device and a management server device.
  • the sensor device is a device that detects a predetermined event (event) defined (set) in advance related to the monitored person Ob.
  • the management server device is communicably connected to each of the sensor device and the terminal device.
  • the management server device manages the predetermined event and transmits the predetermined event. It is a device that notifies a predetermined terminal device associated with the sensor device.
  • the terminal device may be one type of device, in the present embodiment, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between these fixed terminal devices and portable terminal devices is that the fixed terminal device is fixedly operated, while the portable terminal device is operated by being carried by a supervisor (user) such as a nurse or a caregiver.
  • the fixed terminal device and the mobile terminal device are substantially the same.
  • the monitored person monitoring device setting device includes a monitored person monitoring device (a sensor device and a management server device in this embodiment) and a terminal device (a fixed terminal device in this embodiment). It may be a separate device from the portable terminal device, or may be incorporated in the monitored person monitoring apparatus (the monitored person monitoring apparatus and the setting apparatus for the monitored person monitoring apparatus are integrated)
  • the terminal device and the monitored person monitoring device setting device may be integrated with each other.
  • the setting device for the monitored person monitoring device is incorporated in the management server device.
  • the setting device for the monitored person monitoring device is incorporated in the portable terminal device.
  • FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment.
  • FIG. 2 is a diagram illustrating a configuration of a fixed terminal device in which the setting device for a monitored person monitoring apparatus according to the embodiment is incorporated in the monitored person monitoring system.
  • the monitored person monitoring system MS includes, for example, as shown in FIG. 1, one or a plurality of sensor devices SU (SU-1 to SU-4), a management server device SV, and a fixed terminal device.
  • SP one or more portable terminal devices TA (TA-1, TA-2), and private branch exchange (PBX) CX, which are wired or wireless, LAN (Local Area Network) Or the like via a network (network, communication line) NW.
  • the network NW may be provided with repeaters such as repeaters, bridges, and routers that relay communication signals.
  • the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of portable terminal devices TA-1, TA-2, and the private branch exchange CX include an L2 switch.
  • a wired / wireless LAN for example, a LAN in accordance with the IEEE 802.11 standard
  • NW including the LS and the access point AP.
  • the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the private branch exchange CX are connected to the line concentrator LS, and the plurality of portable terminal devices TA-1, TA-2. Is connected to the line concentrator LS via the access point AP.
  • the network NW constitutes a so-called intranet by using Internet protocol groups such as TCP (Transmission control protocol) and IP (Internet protocol).
  • a private branch exchange (line switching unit) CX is connected to the network NW, controls extension calls such as outgoing calls, incoming calls, and calls between the portable terminal devices TA, and performs extension calls between the portable terminal devices TA, and For example, outgoing calls, incoming calls, and calls between the external telephone TL and the mobile terminal device TA are connected to an external telephone TL such as a fixed telephone or a mobile telephone via a public telephone network PN such as a fixed telephone network or a mobile telephone network.
  • This is a device that performs an outside line telephone call between the outside line telephone TL and the portable terminal device TA by controlling the outside line telephone.
  • the private branch exchange CX is, for example, a digital exchange or an IP-PBX (Internet Protocol Private Branch eXchange).
  • the monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob.
  • the monitored person (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, a single person living alone, or the like.
  • the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable.
  • the monitored person monitoring system MS is suitably arranged in a building such as a hospital, an elderly welfare facility, or a dwelling unit according to the type of the monitored person Ob.
  • the monitored person monitoring system MS is disposed in a building of a care facility that includes a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station.
  • the sensor device SU has a communication function for communicating with other devices SV, SP, and TA via the network NW, and detects a predetermined event (event) related to the monitored person Ob and manages the server. It is a device that notifies (transmits) to the device SV.
  • the predetermined event is preferably a predetermined event that needs to be dealt with.
  • the predetermined event is a predetermined action and a nurse call (NC) defined in advance in the monitored person Ob.
  • the sensor device SU moves upward (preferably a communication interface circuit (for example, a LAN card) for communicating with other devices SV, SP, and TA via the network NW, for example, the monitored person Ob.
  • An image sensor for example, a visible camera, a near-infrared camera, etc. that captures an image from directly above (for example, the ceiling) and a predetermined predetermined in the monitored person Ob based on the output (image) of the image sensor
  • a behavior detection processing circuit for detecting behavior as an example of the predetermined event and notifying the management server device SV; a nurse call processing circuit for receiving a nurse call as another example of the predetermined event and notifying the management server device SV; Call processing circuit for making voice calls with terminal devices SP, TA, etc., output of the image sensor (images (including still images and moving images)) Image transmission processing circuit for transmitting certain other apparatus SV, SP, to TA, the control circuit for controlling these, and, for example, such as a storage element configured to include a peripheral circuit.
  • the predetermined actions include, for example, entering the monitored person Ob into the bedding, getting up the monitored person Ob, leaving the monitored person Ob away from the bedding, and falling over when the monitored person Ob falls. These are the four actions.
  • the fall may include a fall in which the monitored person Ob falls from the bedding, or the predetermined action may include the fall separately from the fall.
  • the behavior detection processing circuit detects, for example, the head of the monitored person Ob based on an image (target image) captured by the image sensor, and the time change in the size of the detected head of the monitored person Ob The monitored person Ob is caused to wake up and fall, and the monitored person Ob is detected based on the target image captured by the image sensor, and the detected degree of overlap between the monitored person Ob and the bedding (overlapping region).
  • the behavior detection processing circuit extracts a moving object region from the target image as a person region of the monitored person Ob, for example, by a background difference method or a frame difference method.
  • the behavior detection processing circuit uses, for example, a circular or elliptical Hough transform from the extracted moving object region, for example, by pattern matching using a head model prepared in advance, or for example, for head detection.
  • the head region of the monitored person Ob is extracted by the neural network learned in step (b).
  • the behavior detection processing circuit detects wakeup and falls from the extracted position and size of the head.
  • the position of the extracted head is in the region where the bedding BD is located, and the size of the extracted head uses the first threshold Th1 to determine the size of the lying posture.
  • the position of the extracted head is in the living room RM excluding the area where the bedding BD is located, and the size of the extracted head uses the second threshold Th2.
  • the behavior detection processing circuit detects an overlapping area where the moving object area extracted from the target image overlaps with the location area of the bedding BD, and detects bed leaving and entering from the temporal change of the overlapping area.
  • the behavior detection processing circuit determines that the person has left the bed when the time changes from the state in which the detected overlapping area exists to the state in which the overlapping area does not exist, and detects the bed leaving.
  • the behavior detection processing circuit determines that the user has entered the floor, and the floor is detected.
  • the monitored person in this embodiment, in order to more appropriately detect the predetermined behavior according to the monitored person Ob by the behavior detection processing circuit, in this embodiment, the monitored person incorporated in the fixed terminal device SP as will be described later.
  • the frame rate, brightness level, ceiling height, and bedding BD location area of the image sensor are set as predetermined parameters by the monitoring device setting device.
  • the predetermined event is notified from the sensor device SU to the management server device SV by a first event notification communication signal.
  • This first event notification communication signal contains the sensor ID of the own device and event information indicating the contents of the event.
  • the sensor ID sensor identifier
  • the event information is one or more of entering, getting up, leaving, falling, and nurse call.
  • the first event notification communication signal may contain an image captured by the image sensor.
  • the event information is any one of entering, getting up, leaving the floor, and falling, an image used for detecting the predetermined action (when the detection is performed by a plurality of images).
  • the last image is preferably accommodated.
  • the image may be at least one of a still image and a moving image.
  • the still image is notified and the still image is displayed on the terminal devices SP and TA.
  • FIG. 1 shows four first to fourth sensor devices SU-1 to SU-4 as an example, and the first sensor device SU-1 is one of the monitored persons Ob.
  • the second sensor device SU-2 is arranged in a room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob.
  • the third sensor device SU-3 is disposed in the room RM-3 (not shown) of Mr. C Ob-3, one of the monitored subjects Ob, and the fourth sensor device SU-4 It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.
  • the management server device SV has a communication function for communicating with other devices SU, TA, and SP via the network NW, and receives a notification of the predetermined event from the sensor device SU with the first event notification communication signal.
  • Information relating to monitoring (monitoring information) for the monitor Ob is managed, and the predetermined event is notified (re-notification, notification, transmission) to the predetermined terminal device SP and TA by the second event notification communication signal, and the client (this embodiment)
  • the client device provides data corresponding to the request of the terminal device SP, TA, etc.) to manage the entire monitored person monitoring system MS.
  • the monitoring information includes, for example, the sensor ID of the sensor device SU that is the transmission source of the first event notification communication signal, the predetermined event (the type of the predetermined action detected by the sensor device SU, and the sensor device). Nurse call received by SU), image of monitored person Ob, time of receiving the notification (notification time), and the like, which are stored (recorded and managed) in association with each other.
  • the monitoring information is accommodated in the second event notification communication signal.
  • the second event notification communication signal may be transmitted by, for example, broadcast communication (broadcast or multicast), and, for example, one or more associated with the sensor device SU that is the transmission source of the first event notification communication signal. May be transmitted to the terminal devices SP and TA.
  • Such a management server device SV can be configured by a computer with a communication function, for example.
  • the fixed terminal device SP includes a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like.
  • a predetermined instruction or data to be given to the management server device SV or the portable terminal device TA By inputting a predetermined instruction or data to be given to the management server device SV or the portable terminal device TA, displaying the monitoring information obtained by the sensor device SU by a notification from the management server device SV, etc.
  • a device that functions as a user interface (UI) of the person monitoring system MS can be configured by, for example, a computer with a communication function. The fixed terminal device SP will be described more specifically below.
  • the mobile terminal device TA has a communication function for communicating with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. Including a call function to perform, inputting a predetermined instruction or data to be given to the management server device SV or the sensor device SU, displaying the monitoring information obtained by the sensor device SU by a notification from the management server device SV, This is a device for making a nurse call response or calling a voice call with the sensor device SU.
  • a portable terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.
  • the fixed terminal device SP includes a fixed terminal side control processing unit (SP control processing unit) 1, a fixed terminal side communication interface unit (SP communication IF unit) 2, and a fixed terminal side input unit.
  • SP control processing unit SP control processing unit
  • SP communication IF unit fixed terminal side communication interface unit
  • SP input unit 3
  • SP display unit 4
  • SPIF unit fixed terminal side interface unit
  • SP storage unit fixed terminal side storage unit 6.
  • the SP communication IF unit 2 is a communication circuit that is connected to the SP control processing unit 1 and performs communication in accordance with the control of the SP control processing unit 1.
  • the SP communication IF unit 2 generates a communication signal containing the data to be transmitted input from the SP control processing unit 1 according to the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SU, SV, TA via the network NW.
  • the SP communication IF unit 2 receives a communication signal from another device SU, SV, TA via the network NW, extracts data from the received communication signal, and the SP control processing unit 1 can process the extracted data.
  • the data is converted into data in a proper format and output to the SP control processing unit 1.
  • the SP communication IF unit 2 includes, for example, a communication interface circuit that conforms to the IEEE 802.11 standard or the like.
  • the SP communication IF unit 2 when the operation mode is a setting mode to be described later, the SP communication IF unit 2 sends a communication signal containing a target image for imaging a place where the monitored person Ob is present from the sensor device SU to the network NW. Receive via.
  • the SP communication IF unit 2 corresponds to an example of an image acquisition unit that acquires a target image whose imaging target is a place where the monitored person Ob is present.
  • the place where the monitored person Ob is located is a room of a building corresponding to the type of the monitored person Ob, such as a hospital room, a living room of a welfare facility for the elderly, and a room of a dwelling unit.
  • the place where the monitored person Ob is the living room RM of the care facility.
  • the SP input unit 3 is connected to the SP control processing unit 1 and is, for example, a circuit that accepts a predetermined operation and inputs it to the fixed terminal device SP.
  • a predetermined operation includes, for example, monitoring of an ID (user name) input operation for login, an operation mode input operation, an operator information input operation, a predetermined parameter input operation, and the like.
  • the operation mode includes a plurality of modes that define the operation content of the own device SP. In this embodiment, a service mode (monitoring mode) for monitoring the monitored person Ob and a setting mode for setting the predetermined parameter Etc.
  • the worker information is information for identifying and identifying a worker in the setting mode, and is, for example, an ID or a monitor name.
  • the worker information for example, the ID at the time of login may be used as the worker information.
  • the worker information may be input from the SP input unit 3.
  • the SP display unit 4 is connected to the SP control processing unit 1, and according to the control of the SP control processing unit 1, a predetermined operation content input from the SP input unit 3 and a monitored target monitored by the monitored person monitoring system MS.
  • This is a circuit for displaying the monitoring information related to the monitoring of the observer Ob, and is a display device such as an LCD (Liquid Crystal Display) and an organic EL display.
  • the SPIF unit 5 is a circuit that is connected to the SP control processing unit 1 and inputs / outputs data to / from an external device according to the control of the SP control processing unit 1, and uses, for example, the Bluetooth (registered trademark) standard.
  • An interface circuit an interface circuit that performs infrared communication such as the IrDA standard, and an interface circuit that uses the USB standard.
  • the SP storage unit 6 is a circuit that is connected to the SP control processing unit 1 and stores various predetermined programs and various predetermined data under the control of the SP control processing unit 1.
  • Examples of the various predetermined programs include a control program for controlling each unit of the fixed terminal device SP according to the function of each unit, a monitoring processing program for executing predetermined information processing related to monitoring of the monitored person Ob, A parameter setting processing program that receives a predetermined parameter set (set) in advance from the SP input unit 3 and sets it in the sensor device SU, or the sensor device SU when receiving the predetermined parameter in the parameter setting processing program
  • a control processing program such as an image display processing program for displaying the target image acquired by the SP communication IF unit 2 via the network NW on the SP display unit 4 is included.
  • the image display processing program is processed by executing predetermined image processing defined (set) in advance so as to protect the privacy of the target image when the operation mode is the setting mode.
  • An image is generated, and the generated processed image is set as the target image.
  • the various types of predetermined data include data necessary for executing each program such as the terminal ID of the own device, the monitoring information of the monitored person Ob, the authorized person information, the area information, the person identification information, and the substitute image. included.
  • the SP storage unit 6 includes, for example, a ROM (Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), and the like.
  • the SP storage unit 6 includes a RAM (Random Access Memory) that is a working memory of the so-called SP control processing unit 1 that stores data generated during execution of the predetermined program.
  • the terminal ID is an identifier for identifying and identifying the terminal devices SP and TA.
  • the SP storage unit 6 includes a monitoring information storage unit 61, an authorizer information storage unit 62, an area information storage unit 63, a person An identification information storage unit 64 and a substitute image storage unit 65 are functionally provided.
  • the monitoring information storage unit 61 stores the monitoring information.
  • the monitoring information includes, for example, the sensor ID of the sensor device SU that has detected the predetermined event, the image of the predetermined event Ob,
  • the notification time and the like are associated with each other and stored for each reception of the second event notification communication signal (that is, for each event detected by the sensor device SU).
  • the permitter information storage unit 62 stores the permitter information in advance.
  • the permitter information is information representing a permitter who can refer to the target image without modifying the target image by predetermined image processing so as to protect the privacy.
  • the permitter information storage unit 62 stores the permitter information in association with the monitored person Ob for each monitored person Ob. That is, the permitter information is stored in the permitter information storage unit 62 in association with the sensor device SU (sensor ID) for each sensor device SU (sensor ID). For example, since a caregiver or nurse in charge of the monitored person Ob is in contact with the monitored person Ob on a daily basis, the caregiver or nurse in charge of the monitored person Ob is monitored. The request to protect the privacy of the Ober is considered low.
  • the permitter is a caregiver or a nurse in charge of the monitored person Ob.
  • the caregiver ID user name, caregiver name
  • nurse ID user name, nurse name
  • the permitter information storage unit 62 It is stored in the permitter information storage unit 62.
  • the area information storage unit 63 stores area information.
  • the area information is information representing a predetermined specific area in the target image.
  • the specific area is appropriately defined (set) by one or more in advance, and is, for example, an area set by a user (monitoring person).
  • the specific area is an area that is displayed by the image display processing program.
  • the specific area is an area generated based on information held by the management server device SV.
  • the specific area is a bedding location area in the target image. Such a specific area is used by a second sub-execution determination unit 1512 described later. In particular, the location area of the bedding is used in a fifth sub execution determination unit 1515 described later.
  • the area information storage unit 63 stores the area information in association with the monitored person Ob for each monitored person Ob. That is, the region information is stored in the region information storage unit 63 in association with the sensor device SU (sensor ID) for each sensor device SU (sensor ID).
  • the person identification information storage unit 64 stores the person identification information in advance.
  • the person information is information for identifying the monitored person Ob from the target image (monitored person identification information) and information for identifying the family of the monitored person Ob from the target image (family identification information).
  • the person information is data corresponding to a known person recognition method used for identifying the monitored person Ob and his family, for example, each face data of the monitored person Ob and his family.
  • the substitute image storage unit 65 stores the substitute image.
  • the substitute image is used instead of the target image acquired by the SP communication IF unit 2 when it is finally determined that the target image acquired by the SP communication IF unit 2 is an image infringing on privacy. These are images displayed on the SP display unit 4.
  • the substitute image storage unit 65 stores the substitute image in association with the monitored person Ob for each monitored person Ob. That is, the substitute image is stored in the substitute image storage unit 65 in association with the sensor device SU (sensor ID) for each sensor device SU (sensor ID). For example, when the predetermined parameter is set in the setting mode, the target image displayed and referenced on the SP display unit 4 at that time is stored in the substitute image storage unit 65 as a substitute image. In such a case, it is preferable that the target image referenced in the most recent setting mode is stored in the substitute image storage unit 65 as a substitute image.
  • the authorized person information, the area information, and the person identification information stored in each of the authorized person information storage unit 62, the area information storage unit 63, and the person identification information storage unit 64 are managed (stored) by the management server device SP.
  • the fixed terminal device SP logs into the monitored person monitoring system SM, it is transmitted (downloaded) from the management server device SP to the fixed terminal device SP, and the permitter information storage unit 62, the area information storage unit 63, and the person identification information storage are stored.
  • Each of the units 64 may be stored.
  • the SP control processing unit 1 controls each part of the fixed terminal device SP according to the function of each part, and receives and displays the monitoring information of the monitored person Ob when the operation mode is the service mode. Is a circuit for accepting and setting the predetermined parameter when is in the setting mode.
  • the SP control processing unit 1 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits.
  • the SP control processing unit 1 functionally includes a control unit 11, a monitoring processing unit 12, a parameter setting processing unit 13, an image display processing unit 15, and an image display adjustment unit 16 by executing a control processing program.
  • the control unit 11 controls each unit of the fixed terminal device SP according to the function of each unit, and controls the entire fixed terminal device SP.
  • the monitoring processing unit 12 executes predetermined information processing related to monitoring of the monitored person Ob. More specifically, when the monitoring processing unit 12 receives the second event notification communication signal transmitted by the management server device SV due to the first event notification communication signal transmitted by the sensor device SU, Based on each information (each data) accommodated in the received second event notification communication signal, the monitoring information of the monitored person Ob is stored (recorded) in the monitoring information storage unit 61. The monitoring processing unit 12 displays a screen corresponding to each piece of information contained in the received second event notification communication signal on the SP display unit 4. When the monitoring processing unit 12 receives a predetermined input operation from the SP input unit 3, the monitoring processing unit 12 executes a predetermined process corresponding to the input operation.
  • the parameter setting processing unit 13 receives a predetermined parameter defined in advance from the SP input unit 3 and sets it in the sensor device SU.
  • the image display processing unit 15 displays the target image acquired by the SP communication IF unit 2 from the sensor device SU via the network NW on the SP display unit 4 when the parameter setting processing unit 13 receives the predetermined parameter. It is.
  • the image display processing unit 15 when the operation mode is the setting mode, the image display processing unit 15 generates a processed image by executing predetermined image processing so as to protect the privacy of the target image, and the generated processing Let the image be the target image.
  • the predetermined image processing for protecting the privacy includes, for example, mosaic processing for mosaicing an image, gradation adjustment processing for adjusting the gradation of an image (including filling), blur processing for blurring an image, etc. It is. More specifically, the image display processing unit 15 functionally includes an execution determination unit 151, a processed image generation unit 152, and a high resolution processing unit 153.
  • the execution determination unit 151 determines whether or not to execute predetermined image processing so as to protect privacy for the target image when the operation mode is the setting mode.
  • the processed image generation unit 152 generates a processed image by executing the predetermined image processing on the target image based on the determination result of the execution determination unit, and uses the generated processed image as the target image. . More specifically, when the execution determination unit 151 determines that the predetermined image processing is to be executed based on the determination result of the execution determination unit, the processed image generation unit 152 applies the predetermined image to the target image. A processed image is generated by executing image processing, and the generated processed image is set as the target image.
  • the high resolution processing unit 153 generates an image (high resolution image) in which the resolution of the target image is increased by, for example, a known super-resolution process, and the generated high resolution image is used as the target image.
  • the super-resolution processing is disclosed in, for example, International Publication No. WO2013 / 0889260 pamphlet.
  • the execution determination unit 151 functionally includes first to sixth sub-execution determination units 1511 to 1516
  • the processed image generation unit 152 includes first to fourth processed image generation units 1521 to 1524. Functionally prepared.
  • the first sub-execution determination unit 1511 determines whether the worker information input from the SP input unit 3 matches the permitter information stored in the permitter information storage unit 62. As a result of this determination, When it is determined that they do not match, it is determined that the predetermined image processing is to be executed. More specifically, in the present embodiment, the first sub-execution determination unit 1511 determines that the predetermined image processing is to be executed at the first processing level when it is determined that they do not match as a result of the determination, As a result of the determination, when it is determined that they match, it is further determined whether or not a toilet is reflected in the target image, and when it is determined that the toilet is reflected as a result of the determination, the predetermined image processing is performed.
  • the predetermined image processing is not performed.
  • a known scene analysis method described later is used.
  • a known pattern matching method using a toilet template is used.
  • the predetermined image processing is mosaic processing
  • the mosaic size (mosaic size) at the first processing level is smaller (narrower) than the mosaic size at the second processing level.
  • the predetermined image processing is gradation adjustment processing
  • the number of gradations at the first processing level is smaller than the number of gradations at the second processing level.
  • the number of gradations of the target image before the predetermined image processing is 256 gradations
  • the number of gradations at the first processing level is 8 gradations, 4 gradations, 2 gradations, etc.
  • the number of gradations at the second processing level is 32 gradations, 24 gradations, 16 gradations, or the like.
  • the predetermined image processing is blurring processing
  • the degree of blurring of the first processing level is larger (strong) than the degree of blurring of the second processing level.
  • the fourth sub processed image generation unit 1524 adds the target image to the target image.
  • a first processed image is generated by executing the predetermined image processing at the first processing level
  • the generated first processed image is set as the target image
  • a first sub execution determination unit 1511 of the execution determination unit 151 is performed.
  • Generates a second processed image by executing the predetermined image processing on the target image at the second processing level when it is determined that the predetermined image processing is executed at the second processing level.
  • the processed second image is set as the target image.
  • the second sub-execution determining unit 1512 determines whether or not there is a person image in an image outside the predetermined specific region stored in the region information storage unit 63 in the target image. As a result, when it is determined that there is an image of the person, the predetermined image processing is performed on an image in a region outside the predetermined specific region stored in the region information storage unit 63 in the target image. Judge that. On the other hand, as a result of the determination, the second sub-execution determination unit 1512 determines not to execute the predetermined image processing when determining that there is no image of the person.
  • the second sub-execution determination unit 1512 determines whether or not there is a moving object region as a human region from the target image, for example, by a frame difference method or a background difference method. Further, it is determined whether or not the moving object region is outside the predetermined specific region. If it is determined by this determination that the moving object region is outside the predetermined specific region, the second sub execution determination unit 1512 performs the predetermined image processing on the target image in the region information storage unit 63. It is determined that the image is to be executed with respect to an image outside the predetermined specific area stored in (1).
  • the second sub-execution determination unit 1512 of the execution determination unit 151 stores the predetermined image processing in the region information storage unit 63 in the target image.
  • the predetermined image processing is performed outside the predetermined specific area stored in the area information storage unit 63 in the target image. Execute on the image of the area.
  • the third sub-execution determining unit 1513 determines whether or not a person image in the target image infringes privacy, and if it is determined that the result is not a privacy infringement, the predetermined image It is determined that the process is not executed. On the other hand, if it is determined as a violation of privacy as a result of the determination, the third sub-execution determination unit 1513 may determine to execute the predetermined image processing, or prohibit display of the target image. Good.
  • the third sub-execution determination unit 1513 infringes privacy by determining whether or not there is an image of the person in order to more easily determine whether or not there is an infringement of privacy. It is determined whether or not.
  • the third sub execution determination unit 1513 determines whether or not there is an image of the person based on the monitoring information corresponding to the monitored person Ob. More specifically, when the latest monitoring information corresponding to the monitored person Ob is entering or getting up, the third sub-execution determining unit 1513 determines that there is an image of the person and determines that it is a violation of privacy. To do.
  • the third sub-execution determining unit 1513 determines that there is no image of the person. Judge that there is no. Further, for example, the third sub execution determination unit 1513 determines whether or not there is an image of the person by determining whether or not there is a moving object region in the target image. If the third sub-execution determination unit 1513 determines that there is a moving object area in the target image, the third sub-execution determination unit 1513 determines that there is an image of the person, and determines that it is a privacy violation.
  • the third sub-execution determination unit 1513 determines that there is no image of the person and determines that there is no privacy infringement.
  • the schedule of the monitored person Ob such as a care plan and a nursing plan is stored in the SP storage unit 6 in advance, and the third sub-execution determining unit 1513 generates an image of the person based on the schedule of the monitored person Ob. It is determined whether or not there is. More specifically, when the schedule of the monitored person Ob is a matter (first matter) to be performed outside the living room RM such as bathing or taking a walk, the third sub-execution determination unit 1513 has no image of the person It is determined that it is not a violation of privacy. On the other hand, when the schedule of the monitored person Ob is other matters (second matter) other than the first matter, the third sub-execution judging unit 1513 judges that there is an image of the person, and infringes privacy. Judge that there is.
  • the third sub execution determination unit 1513 can easily identify a person from the face, in order to protect privacy more appropriately, a face image (for example, a face image viewed from the front, a diagonal view) is added to the person image. It is determined whether or not privacy is infringed by determining whether or not it includes a face image viewed from the side and a face image viewed from the side. More specifically, the third sub-execution determination unit 1513 extracts the head in the same manner as described above, and extracts the head by a known face orientation determination method for determining the face orientation with respect to the extracted head. Determine the orientation of the part.
  • a face image for example, a face image viewed from the front, a diagonal view
  • the third sub-execution determination unit 1513 extracts the head in the same manner as described above, and extracts the head by a known face orientation determination method for determining the face orientation with respect to the extracted head. Determine the orientation of the part.
  • the third sub execution determination unit 1513 determines that the person image includes a face image. If it is determined that it is a violation of privacy and the extracted head does not include a face (when it is determined that the extracted head is the back of the head), a face image is added to the person image. It is determined that it is not included, and it is determined that it is not a violation of privacy.
  • the face orientation determination method is disclosed in, for example, Japanese Patent Application Laid-Open No. 2006-72770.
  • the third sub execution determination unit 1513 analyzes the scene by a known scene analysis method for the target image in order to protect the scene (scene) that the other person does not want to see and protect the privacy more appropriately. Then, it is determined whether privacy is infringed by determining whether the analyzed scene is any of changing clothes, excretion, and hobbies. If the third sub-execution determination unit 1513 determines that the analyzed scene is being changed, being excreted, or being a hobby, the third sub-execution determination unit 1513 determines that it is a privacy violation and the analyzed scene is being changed. If it is determined that it is neither excretion nor a hobby, it is determined that it is not a violation of privacy.
  • a known clothes recognition method for recognizing clothes can also be used to determine whether or not the user is changing clothes. The clothes recognition method is disclosed in, for example, Japanese Patent Application Laid-Open No. 2007-128307.
  • the third sub-execution determination unit 1513 is based on the monitored person identification information of the monitored person Ob stored in the person identification information storage unit 64 in order to more appropriately protect the privacy of the monitored person Ob. Then, it is determined whether or not the target image violates privacy by determining whether or not the image of the person is an image of the monitored person Ob by a known person identification method. If the third sub-execution determination unit 1513 determines that the person image is an image of the monitored person Ob, the third sub-execution determination unit 1513 determines that it is a violation of privacy, and the person image is not the image of the monitored person Ob. If it is determined, it is determined that it is not a violation of privacy.
  • the third sub-execution determination unit 1513 uses the monitored person identification information of the family of the monitored person Ob stored in the person identification information storage unit 64 in order to more appropriately protect the privacy of the monitored person Ob. Based on this, it is determined whether or not the target image infringes privacy by determining whether or not the image of the person is an image of the family of the monitored person Ob by the known person identification method. If the third sub-execution determination unit 1513 determines that the image of the person is an image of the family of the monitored person Ob, the third sub-execution determination unit 1513 determines that the person's image is an infringement of privacy. If it is determined that it is not an image, it is determined that it is not a violation of privacy.
  • the fourth sub execution determination unit 1514 determines whether an image resolution of the target image when the target image is displayed on the SP display unit 4 is equal to or lower than a predetermined threshold value. When it is determined that the resolution is equal to or less than the resolution threshold, it is determined that the predetermined image processing is not executed. On the other hand, as a result of the determination, if it is determined that it is not less than or equal to the predetermined threshold, the fourth sub-execution determination unit 1514 may determine that the predetermined image processing is to be executed, and display the target image. You can ban it. In the present embodiment, since the target image is displayed for setting the parameters, the image resolution of the target image is evaluated in two stages.
  • the fourth sub execution determination unit 1514 determines whether or not the image resolution of the target image when the target image is displayed on the SP display unit 4 is equal to or lower than a predetermined first resolution threshold. As a result of the determination, whether or not the image resolution of the target image when the target image is displayed on the SP display unit 4 is equal to or higher than a predetermined second resolution threshold when determined to be equal to or lower than the first resolution threshold. If it is further determined whether or not the predetermined parameter can be set, and if it is determined that the result is greater than or equal to the second resolution threshold, the fourth sub-execution determination unit 1514 It is determined that predetermined image processing is not executed.
  • the high-resolution processing unit 153 generates a high-resolution image by increasing the resolution of the target image to a predetermined resolution. Let it be the target image. Further, as a result of the determination at the first resolution threshold, when it is determined that it is not less than the first resolution threshold, the fourth sub execution determination unit 1514 determines to execute the predetermined image processing as described above. The display of the target image may be prohibited.
  • the first resolution threshold is set to an appropriate value in advance from the viewpoint of whether or not privacy can be protected, such as whether or not a person can be recognized from an image.
  • the second resolution threshold is set to an appropriate value in advance from the viewpoint of whether or not the predetermined parameter can be set from an image.
  • the second resolution threshold is determined based on the resolution of an image necessary for the sensor device SU to detect the predetermined action.
  • the high-resolution processing unit 153 generates the high-resolution image by increasing the resolution of the target image so that the target image is at least higher than a second resolution threshold, and the generated high-resolution image is used as the target image. To do.
  • the fifth sub-execution determination unit 1515 determines whether or not a background image excluding a person's image of the target image infringes on privacy. It is determined that the predetermined image processing is performed on a partial image in a predetermined range including an image determined to be an infringement of privacy among the background images. On the other hand, if it is determined as a result of the determination that there is no privacy infringement, the fifth sub execution determination unit 1515 determines not to execute the predetermined image processing.
  • the fifth sub-execution determination unit 1515 extracts a region (photo image region) in which a photograph is captured from the target image by a known general object recognition method, and the extracted photographic image region Based on the person identification information stored in the person identification information storage unit 64, it is determined whether or not the monitored person Ob or his / her family is reflected by the known person identification method. Whether to infringe. If it is determined that at least one of the monitored person Ob and his / her family is reflected in the background image, the fifth sub-execution determining unit 1515 determines that it is a privacy infringement, and the background image is monitored. When it is determined that the person Ob and his family are not reflected together, it is determined that the privacy is not infringed.
  • the fifth sub-execution determination unit 1515 extracts the person image by extracting the moving object region, generates a background image excluding the person image from the target images, and A photographic image region may be extracted from the target image by the general object recognition method.
  • General object recognition is disclosed in, for example, Japanese Unexamined Patent Application Publication No. 2009-258953.
  • the fifth sub-execution determination unit 1515 extracts characters from the target image by a known optical character recognition (OCR (Optical character recognition)) method, and adds the name of the monitored person Ob or his family to the extracted characters. It is determined whether or not the background image violates privacy by determining whether or not the name of the image is reflected.
  • OCR optical character recognition
  • the person identification information storage unit 64 further stores the name of the monitored person Ob and the name of the family as person identification information.
  • the fifth sub-execution determination unit 1515 determines that at least one of the name of the monitored person Ob and the name of the family member is reflected in the background image, the fifth sub-execution determination unit 1515 determines that it is a privacy infringement, and When it is determined that neither the name of the monitored person Ob and the name of the family are included in the image, it is determined that the privacy is not infringed.
  • the fifth sub execution determination unit 1515 extracts a region (television image region) in which the television receiver is reflected from the target image by the known general object recognition method, and publicly identifies the extracted television image region. Analyzing the scene using a scene analysis method and determining whether the analyzed scene infringes privacy, so that the background image excluding the person's image in the target image is an image that infringes privacy Determine whether or not. If the fifth sub-execution determination unit 1515 determines that the analyzed scene is in a state of looking at the SNS, the fifth sub-execution determination unit 1515 determines that the analyzed scene is a violation of privacy, and determines that the analyzed scene is a scene other than the above. If not, it is determined that it is not a privacy violation.
  • the second sub-processed image generation unit 1522 indicates that the fifth sub-execution determination unit 1515 of the execution determination unit 151 performs the predetermined image processing as an infringement of the privacy among the background images.
  • the predetermined image processing includes the predetermined image including the image determined to be an infringement of the privacy among the background images. This is executed for the partial image (image of the infringing substance region) in the range of.
  • the sixth sub-execution determining unit 1516 determines whether or not there is an image of a person on the bed in the region where the bedding is set in advance in the target image, and as a result of this determination, there is an image of the person on the bed. If it is determined, the predetermined image processing is determined to be performed on the image in the area where the bedding is located. On the other hand, if it is determined that there is no person image as a result of the determination, the sixth sub-execution determination unit 1516 determines that the predetermined image processing is not executed. More specifically, the sixth sub-execution determination unit 1516 determines whether or not there is a moving object region as a human region from the target image by, for example, a frame difference method or a background difference method.
  • the sixth sub-execution determination unit 1516 determines that the predetermined image processing is to be executed on the image of the location area of the bedding. To do.
  • the sixth sub execution determination unit 1516 determines that there is an image of a person in the bedding location area set in advance in the target image when the latest monitoring information corresponding to the monitored person Ob is an entry. May be.
  • the third sub-processed image generation unit 1523 determines that the sixth sub-execution determination unit 1516 of the execution determination unit 151 executes the predetermined image processing on the image in the location area of the bedding. In this case, the predetermined image processing is executed on the image in the area where the bedding is located.
  • the predetermined image processing based on the predetermined image processing and the determination result of the fourth sub execution determination unit 1514 and the predetermined image processing based on the determination result of the fifth sub execution determination unit 1515 and the sixth sub execution determination unit 1516 The predetermined image processing based on the determination result may be different from each other.
  • the predetermined image processing based on the determination result of the first sub execution determination unit 1511 based on the predetermined image processing based on the determination result of the first sub execution determination unit 1511, the predetermined image processing based on the determination result of the second sub execution determination unit 1512, and the determination result of the third sub execution determination unit 1513.
  • the predetermined image processing based on the predetermined image processing and the determination result of the fourth sub execution determination unit 1514 and the predetermined image processing based on the determination result of the fifth sub execution determination unit 1515 and the sixth sub execution determination unit 1516 The predetermined image processing based on the determination result may be the same as each other.
  • the predetermined image processing based on the determination result of the first sub execution determination unit 1511 based on the predetermined image processing based on the determination result of the first sub execution determination unit 1511, the predetermined image processing based on the determination result of the second sub execution determination unit 1512, and the determination result of the third sub execution determination unit 1513.
  • the predetermined image processing based on the predetermined image processing and the determination result of the fourth sub execution determination unit 1514 and the predetermined image processing based on the determination result of the fifth sub execution determination unit 1515 and the sixth sub execution determination unit 1516 A part of the predetermined image processing based on the determination result may be different from each other, and the remaining part may be the same.
  • the image display adjustment unit 16 determines whether or not the target image of the processed image generated by the processed image generation unit 152 infringes privacy by the third and fifth sub execution determination units 1513 and 1515, respectively. As a result, when it is determined that it is a violation of privacy, the target image of the processed image is not displayed on the SP display unit 4 by the image display processing unit 15.
  • the image display processing unit 15 performs SP communication IF when the determination result of the image display adjustment unit 16 is a violation of privacy.
  • the target image is re-acquired by the unit 2, and each process of the execution determination unit 151, the processed image generation unit 152, and the high-resolution processing unit 153 is executed again on the re-acquired target image.
  • the SP display unit 4 and the SP storage unit 6 constitute an example of a setting device for a monitored person monitoring device.
  • FIG. 5 is a diagram illustrating an example of a main screen displayed on the fixed terminal device.
  • FIG. 6 is a diagram illustrating an example of a first setting screen displayed on the fixed terminal device.
  • FIG. 7 is a diagram illustrating an example of a second setting screen displayed on the fixed terminal device.
  • FIG. 8 is a diagram illustrating an example of a monitoring information screen displayed on the fixed terminal device.
  • FIG. 8A shows a monitoring information screen when the sensor device SU repeatedly performs a predetermined event detection operation but does not detect the predetermined event
  • FIG. 8B shows a sensor event when the sensor device SU detects the predetermined event. Shows the monitoring information screen when it is detected.
  • each device SU, SV, SP, TA performs initialization of each necessary part and starts its operation when the power is turned on.
  • the control unit 11, the monitoring processing unit 12, the parameter setting processing unit 13, the image display processing unit 15, and the image display adjustment unit 16 function in the SP control processing unit 1.
  • the image display processing unit 15 is functionally configured with an execution determination unit 151, a processed image generation unit 152, and a resolution enhancement processing unit 153.
  • the execution determination unit 151 includes first to sixth sub-execution determination units 1511 to 1511.
  • 1516 is functionally configured
  • the processed image generation unit 152 is functionally configured with first to fourth processed image generation units 1521 to 1524.
  • the fixed terminal device SP When the power is turned on and the operation starts, the fixed terminal device SP accepts a login operation by a supervisor (user) such as a nurse or a caregiver. In the login operation, an ID such as a user name of the monitor is input and stored in the SP storage unit 6. When the fixed terminal device SP logs into the monitored person monitoring system MS by the login operation, the fixed terminal device SP displays the main screen on the SP display unit 4 by the control unit 11 of the SP control processing unit 1.
  • the main screen is a screen for receiving the operation mode of the fixed terminal device SP.
  • the main screen 21 includes a “service mode” button 211 and a “setting mode” button 212.
  • the “service mode” button 211 is a button for requesting the service mode for monitoring the monitored person Ob as the operation mode of the fixed terminal device SP, and an instruction (command, command) for operating the fixed terminal device SP in the service mode. ) Is a button for inputting.
  • the “setting mode” button 212 is a button for requesting a setting mode for setting the predetermined parameter as an operation mode of the fixed terminal device SP, and is used to input an instruction to operate the fixed terminal device SP in the setting mode. It is a button.
  • the fixed terminal device SP is received by the control unit 11 of the SP control processing unit 1. It is determined whether the input operation is an input operation of the “service mode” button 211 or an input operation of the “setting mode” button 212.
  • the fixed terminal device SP stores in the SP storage unit 6 that the operation mode is the service mode, and the SP The operation is started in the service mode so that the monitored person Ob is monitored by the monitoring processor 12 of the control processor 1.
  • the operation of the fixed terminal device SP in this service mode will be described later including the operation of the entire monitored person monitoring system MS.
  • the input operation is, for example, an operation in which the cursor is moved onto the “service mode” button 211 by moving the mouse and the mouse is left-clicked. Each button displayed on the SP display unit 4 is similarly input.
  • the fixed terminal device SP stores in the SP storage unit 6 that the operation mode is the setting mode. Then, the operation starts in the setting mode so that the parameter setting processing unit 13 of the SP control processing unit 1 sets the predetermined parameter.
  • the fixed terminal device SP is set to the SP display unit 4 by the parameter setting processing unit 13 of the SP control processing unit 1. Display the setting screen.
  • authentication is performed using an ID such as a user name, and only the authorized user (setting person) can enter the setting mode.
  • the setting screen is a screen for inputting and setting the predetermined parameter.
  • the predetermined parameter is a setting value used to appropriately determine the predetermined event. For example, an imaging condition for extracting a monitored person from an image, noise in the determination, And a threshold value (determination threshold value) for the determination. More specifically, in the present embodiment, as will be described later, the frame rate, the brightness level, the ceiling height, and the location area of the bedding BD.
  • the setting screen includes two first and second setting screens.
  • the first setting screen inputs (determines) the monitored person Ob (sensor device SU) that is a parameter setting target, and among the predetermined parameters, is mainly a numerical parameter (in this embodiment, a frame rate).
  • the second setting screen is a screen for inputting and setting other parameters (in this embodiment, the region where the bedding BD is located) other than the numerical parameters among the predetermined parameters. Other specific areas may also be input using the second setting screen.
  • the parameter setting processing unit 13 displays the first setting screen on the SP display unit 4.
  • the first setting screen 22 is configured to input and set a monitored person name input setting area 221 for inputting and setting the name of the monitored person Ob, and a frame rate.
  • An “area setting” button 225 and a “return to main screen” button 226 are provided.
  • Each of the input setting areas 221 to 224 includes a parameter value input field and an “update” button for storing and setting a parameter with the parameter value input in the input field.
  • the “area setting” button 225 is a button for requesting the second setting screen, and is a button for inputting an instruction to display the second setting screen on the fixed terminal device SP.
  • the “return to main screen” button 226 is a button for requesting the main screen 21 and a button for inputting an instruction to display the main screen 21 on the fixed terminal device SP.
  • the “return to main screen” button 226 is also a button for setting each parameter value stored as a parameter in the SP storage unit 6 to the sensor device SU via the management server device SV.
  • “Mr. A”, “15 fps”, “5”, and “2.4 m” are entered in the input fields in the input setting areas 221 to 224, respectively.
  • the parameter setting processing unit 13 sets the parameter setting target to “Mr. A” and stores it in the SP storage unit 6.
  • the sensor device SU that monitors “Mr. A” or its sensor ID may be input and set as a parameter setting target.
  • the parameter setting processing unit 13 sets the frame rate to “15 fps” and stores the frame rate in the SP storage unit 6.
  • the execution interval of the event detection operation is defined by setting the frame rate.
  • the parameter setting processing unit 13 sets the brightness level to “5” and stores it in the SP storage unit 6. If the target image captured by the sensor device SU is too dark or too bright, it is difficult to extract a moving body region as a person region of the monitored person Ob from the target image, and it is difficult to identify a person. By setting the brightness level, the target image can be generated with appropriate exposure, the moving object region can be extracted more appropriately, and the person can be identified more appropriately.
  • the frame rate is an example of the imaging condition
  • the brightness level is another example of the imaging condition.
  • the parameter setting processing unit 13 sets the ceiling height to “2.4 m” and stores it in the SP storage unit 6.
  • the first and second threshold values Th ⁇ b> 1 and Th ⁇ b> 2 when the sensor device SU is disposed on a ceiling with a reference ceiling height (e.g., 2.4 m) are stored in advance in the sensor device SU as default values.
  • the first and second threshold values Th1 and Th2 of the default values are corrected, and the corrected first and second threshold values Th1 and Th2 are used for the detection of the predetermined action described above. .
  • the first and second threshold values Th1 and Th2 can be adjusted according to the situation of the sensor device SU that is actually installed.
  • the ceiling height is an example of the determination threshold.
  • the SP control processing unit 1 When accepting an input operation of the “area setting” button 225 from the SP input unit 3, the SP control processing unit 1 displays the second setting screen on the SP display unit 4.
  • the second setting screen 23 includes a target image display area 231 for displaying a target image, an “update” button 232, and a “return” button 233, for example, as shown in FIG.
  • the target image display area 231 the target image processed so as to protect the privacy by the image display processing unit 15 is displayed.
  • the operation of the target image display area 231 will be described later.
  • the “update” button 232 is a button for requesting parameter setting in the area input from the SP input unit 3 while referring to the target image displayed in the target image display area 231.
  • the location area of the bedding BD is set.
  • the “return” button 233 is a button for requesting the first setting screen 22, and is a button for inputting an instruction to display the first setting screen 22 on the fixed terminal device SP.
  • the parameter setting processing unit 13 waits for an area where the bedding BD is located.
  • the pixel positions of the four vertices of the location area of the bedding BD are displayed by the parameter setting processing unit 13. Is stored in the area information storage unit 63, and the location area of the bedding BD is set.
  • FIG. 7 shows a state in which the user has input four vertices ( ⁇ ) of the location area of the bedding BD from the SP input unit 3.
  • the “return” button 233 is input, the first setting screen 22 is displayed on the SP display unit 4.
  • the location area of the bedding BD is another example of the determination threshold.
  • an image area of a curtain that is easily misidentified as a moving object that is the monitored person Ob may be set. In this case, when detecting the predetermined action, the moving object region extracted in the image region of the curtain is excluded.
  • the parameter setting processing unit 13 transmits each parameter value stored as a parameter in the SP storage unit 6 to the sensor device SU via the management server device SV, and the sensor device SU automatically receives the received parameter value. Set to machine SU. Thereby, each value of the predetermined parameter is set in the sensor device SU.
  • the parameter setting processing unit 13 inputs the monitored person name on the first setting screen 22.
  • the target image of the monitored person Ob input in the setting area 221 is acquired (S11). More specifically, the parameter setting processing unit 13 requests a target image to be sent to the sensor device SU that monitors the monitored person Ob input in the monitored person name input setting area 221 of the first setting screen 22.
  • a communication signal (target image request communication signal) containing information indicating (command) is transmitted from the SP communication IF unit 2.
  • the SP storage unit 6 stores a correspondence relationship between the monitored person Ob and the sensor device SU that monitors the person Ob.
  • the parameter setting processing unit 13 sends the sensor ID of the sensor device SU that monitors the monitored person Ob input to the monitored person name input setting area 221 of the first setting screen 22 and a command requesting the target image ( A communication signal containing information representing a command) may be transmitted to the monitoring server device SV, and the target image request communication signal may be transmitted to the sensor device SU via the management server device SV.
  • the sensor device SU Upon receiving the target image request communication signal, the sensor device SU generates a target image by imaging the target area, and then transmits a communication signal (target image notification) containing the sensor ID of the own device and the generated target image.
  • Communication signal is transmitted (returned) to the fixed terminal device SP (or transmitted to the fixed terminal device SP via the management server device SV).
  • the fixed terminal device SP acquires the target image by the SP communication IF unit 2.
  • the following processes are executed for the monitored person Ob input in the monitored person name input setting area 221 of the first setting screen 22.
  • the image display processing unit 15 uses the first sub-execution determining unit 1511 of the execution determining unit 151 to input the worker information input from the SP input unit 3 (in this embodiment, the SP storage unit 6 is input at the time of login). It is determined whether the permitter information stored in the permitter information storage unit 62 and the ID stored in the permitter information storage unit 62 match (S12).
  • the worker information may be input from the SP input unit 3 when the setting mode is activated as described above.
  • the “setting mode” button 212 is input on the main screen 21 or when the “area setting” button 225 is input on the first setting screen 22, a screen for entering worker information ( An operator information input screen (not shown) is displayed on the SP display unit 4 and the operator information (user, operator) is input from the SP input unit 3 by the supervisor (user, operator).
  • the process S13 is executed.
  • the first sub-execution determination unit 1511 executes the predetermined image processing at the first processing level. Then, the process S14 is executed.
  • the first sub-execution determination unit 1511 further determines whether or not a toilet is reflected in the target image. As a result of this determination, if it is determined that the toilet is not reflected in the target image (No), the first sub-execution determination unit 1511 determines that the predetermined image processing is not performed, and then processing S32 Is executed. On the other hand, as a result of the determination, when it is determined that a toilet is reflected in the target image (Yes), the first sub-execution determination unit 1511 determines that the predetermined image processing is to be executed at the second processing level. Next, process S15 is executed. This is because it is thought that it is better not to look at the toilet even if it is a caregiver or the like who is usually in contact.
  • the image display processing unit 15 generates a first processed image by executing the predetermined image processing on the target image at the first processing level by the fourth sub-processed image generation unit 1524.
  • the generated first processed image is set as the target image. That is, the target image before the predetermined image processing is replaced with a first processed image ((the first processed image) ⁇ (the target image)). Then, step S16 is executed.
  • the image display processing unit 15 generates a second processed image by executing the predetermined image processing on the target image at the second processing level by the fourth sub-processed image generation unit 1524.
  • the generated second processed image is set as the target image. That is, the target image before the predetermined image processing is replaced with a second processed image ((second processed image) ⁇ (target image)). Then, step S16 is executed.
  • the image display processing unit 15 uses the second sub-execution determination unit 1512 of the execution determination unit 151 to display an image of a region outside the predetermined specific region stored in the region information storage unit 63 in the target image. It is determined whether or not there is a person image. As a result of this determination, if it is determined that there is an image of the person (Yes), the second sub-execution determination unit 1512 stores the predetermined image processing in the region information storage unit 63 in the target image. In addition, it is determined that the image is to be executed on an image outside the predetermined specific area, and then processing S17 is executed. On the other hand, when it is determined that there is no image of the person as a result of the determination (No), the second sub-execution determination unit 1512 determines that the predetermined image processing is not performed, and then processing S18 is performed. Executed.
  • step S17 the image display processing unit 15 causes the first sub-processed image generation unit 1521 to perform the predetermined image processing outside the predetermined specific area stored in the area information storage unit 63 in the target image. Execute on the image of the area. Then, step S18 is executed.
  • the image display processing unit 15 determines whether the third sub-execution determination unit 1513 infringes privacy on the image of the person in the target image. As a result of this determination, if it is determined that the privacy is infringed (Yes), then processing S19 is executed. On the other hand, if it is determined as a result of the determination that privacy is not infringed (No), the third sub-execution determination unit 1513 determines that the predetermined image processing is not performed, and then processing S32 is performed. Is done.
  • the image display processing unit 15 determines whether or not the image resolution of the target image when the fourth sub execution determination unit 1514 displays the target image on the SP display unit 4 is equal to or lower than the first resolution threshold value. Determine. As a result of this determination, if it is determined that it is not less than or equal to the first resolution threshold value (No), next, step S22 is executed. On the other hand, if it is determined as a result of the determination that it is equal to or less than the first resolution threshold value (Yes), then step S20 is executed.
  • the fourth sub execution determination unit 1514 further determines whether or not the image resolution of the target image when the target image is displayed on the SP display unit 4 is equal to or higher than a second resolution threshold. As a result of this determination, if it is determined that the value is not equal to or greater than the second resolution threshold value (No), then step S21 is executed. On the other hand, as a result of the determination, if it is determined that the value is equal to or greater than the second resolution threshold (Yes), the fourth sub-execution determination unit 1514 determines that the predetermined image processing is not performed, and then performs processing S32 is executed.
  • the image display processing unit 15 generates a high-resolution image by increasing the resolution of the target image to a predetermined resolution by the high-resolution processing unit 153, and the generated high-resolution image is converted into the target image. And That is, the target image before the resolution enhancement process is replaced with the resolution enhancement image ((the resolution enhancement image) ⁇ (the target image)). Then, step S22 is executed.
  • the image display processing unit 15 uses the fifth sub-execution determination unit 1515 to determine whether or not a background image excluding a person image in the target image infringes on privacy. As a result of this determination, if it is determined that privacy is infringed (Yes), the fifth sub-execution determining unit 1515 determines that the predetermined image processing is the privacy infringement of the background images. It determines with performing with respect to the partial image of the predetermined range containing the determined image, and next, process S23 is performed.
  • the fifth sub-execution determination unit 1515 determines that the predetermined image processing is not performed, and then processing S24 performs Executed.
  • the image display processing unit 15 performs the predetermined image processing by the second sub-processed image generation unit 1522, including a predetermined image including an image determined to be an infringement of privacy among the background images. Execute for partial images in the range (images of infringing material areas). Then, step S24 is executed.
  • the image display processing unit 15 determines whether the target image includes a person image by the sixth sub-execution determination unit 1516. More specifically, the sixth sub-execution determination unit 1516 determines whether or not there is a moving object region as a person region from the target image, for example, by a frame difference method or a background difference method. As a result of this determination, when it is determined that there is no person, more specifically, when it is determined that there is no moving object region, the sixth sub-execution determination unit 1516 determines that the predetermined image processing is not performed. Then, step S32 is executed. On the other hand, as a result of the determination, if it is determined that there is a person, more specifically, if it is determined that there is a moving object region, then process S25 is executed.
  • the sixth sub execution determination unit 1516 determines whether or not the person is in bed. More specifically, in the present embodiment, the sixth sub-execution determination unit 1516 determines whether or not the moving object region is within the bedding location region stored in the region information storage unit 63. As a result of this determination, if it is determined that the person is lying on the floor (the moving object region is present in the bedding location region) (Yes), the sixth sub-execution determining unit 1516 determines that the predetermined image It is determined that the process is to be performed on the image in the area where the bedding is located, and then process S26 is performed. On the other hand, if it is determined as a result of the determination that the person is not lying on the bed (the moving body area does not exist within the area where the bedding is located) (No), then step S27 is executed.
  • the image display processing unit 15 causes the third sub-processed image generation unit 1523 to execute the predetermined image processing on the image in the area where the bedding is located. Then, step S27 is executed.
  • the image display processing unit 15 determines whether the target image infringes privacy by the image display adjustment unit 16 by the third and fifth sub-execution determination units 1513 and 1515, respectively. As a result, the target image of the processed image generated by the processed image generation unit 152 is re-determined from the viewpoint of privacy infringement. As a result of this determination, if it is determined that the privacy is infringed (Yes), the process S28 is executed next. On the other hand, if it is determined that the privacy is not infringed (No), the process is then performed. S32 is executed.
  • the image display processing unit 15 determines whether or not a substitute image corresponding to the monitored person Ob is stored in the substitute image storage unit 65. As a result of this determination, if the substitute image corresponding to the monitored person Ob is not stored in the substitute image storage unit 65 (No), next, the process S29 is executed, while the corresponding person corresponds to the monitored person Ob. If the substitute image is stored in the substitute image storage unit 65 (Yes), the process S31 is executed next.
  • the image display adjustment unit 16 prohibits the display of the target image on the SP display unit 4 (without displaying the target image on the SP display unit 4), and then the process S30 is executed. .
  • the parameter setting processing unit 13 re-acquires the target image in the SP communication IF unit 2 and returns the process to the process S16 in order to perform the re-acquired process, as in the above-described process S11.
  • the re-acquired target image is reprocessed by the image display processing unit 15.
  • the image display processing unit 15 sets the substitute image corresponding to the monitored person Ob stored in the substitute image storage unit 65 as the target image. That is, the target image is replaced with a substitute image ((substitute image) ⁇ (target image)). Then, step S32 is executed.
  • the parameter setting processing unit 13 causes the image display processing unit 15 to display the target image on the SP display unit 4.
  • the parameter setting processing unit 13 receives an input of the location area of the bedding BD from the SP input unit 3, and receives an input operation of the “update” button 232.
  • the location area is set as one of the predetermined parameters (S33).
  • the parameter setting processing unit 13 substitutes the target image being displayed on the second setting screen 23 as the next substitute image when the location area of the bedding BD is set as one of the predetermined parameters in this process S33. It memorize
  • the fixed terminal device SP when the input operation of the “service mode” button 211 is received from the SP input unit 3 on the main screen 21 described above, the fixed terminal device SP operates in the service mode, and the monitored person monitoring system MS The person to be monitored Ob is monitored by operating in this manner.
  • the sensor device SU In monitoring of the monitored person Ob, the sensor device SU detects a predetermined operation in the monitored person Ob by performing the following operation for each frame or every several frames, and also for the nurse call. The presence or absence of reception is determined. First, the sensor device SU acquires an image (image data) for one frame from the image sensor as a target image, detects a predetermined action in the monitored person Ob based on the acquired target image, and performs the predetermined operation. When an action is detected, in order to notify the detection result to a predetermined terminal device SP or TA, a first event notification communication signal for detecting the predetermined action that contains the predetermined action detected as the event information is stored. Is transmitted to the management server device SV.
  • the sensor device SU determines whether or not a nurse call is accepted, and when accepting the nurse call, notifies the predetermined terminal devices SP and TA of the acceptance of the nurse call. In addition, the sensor device SU transmits a first event notification communication signal for receiving the nurse call, which accommodates the received nurse call as the event information, to the management server device SV.
  • each information such as the sensor ID and the event information accommodated in the first event notification communication signal is stored in the sensor ID. Is stored (recorded) as monitoring information of the monitored person Ob monitored by the sensor device SU having That is, the management server device SV stores each information such as the sensor ID and event information stored in the first event notification communication signal in association with each other. Then, the management server device SV transmits a second event notification communication signal to the notification destination terminal devices SP and TA corresponding to the transmission source (notification source) sensor device SU in the received first event notification communication signal.
  • the sensor accommodated in the second event notification communication signal by the monitoring processing unit 12 Each information such as ID and event information is stored (recorded) in the monitoring information storage unit 61 as monitoring information of the monitored person Ob monitored by the sensor device SU having this sensor ID, and the monitoring information is displayed. For example, when the sensor device SU repeatedly executes a predetermined event detection operation but does not detect the predetermined event, the SP display unit 4 of the fixed terminal device SP displays the monitoring information screen shown in FIG. 8A.
  • the monitoring information screen 31a illustrated in FIG. 8A includes a monitoring image display area 311 that displays an image captured by the sensor device SU.
  • the monitoring information screen 31b shown in FIG. 8B further includes an event display area 312 for displaying the type of event detected by the sensor device SU.
  • an event display area 312 is displayed in which a message “Getting out of bed” is displayed superimposed on the monitoring image display area 311.
  • the monitored person monitoring system MS, the monitored person monitoring apparatus setting apparatus, and the fixed terminal apparatus SP incorporating the method according to the present embodiment have an operation mode of the setting mode regardless of the authority management information.
  • a processed image is generated by executing predetermined image processing so as to protect the privacy of the target image, and the generated processed image is set as the target image and displayed on the SP display unit 4. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can more appropriately protect the privacy of the monitored person Ob when the operation mode is the setting mode.
  • the monitored person monitoring system MS and the fixed terminal device SP include the execution determination unit 151, unnecessary image processing can be stopped when the target image does not infringe privacy.
  • the monitored person monitoring system MS and the fixed terminal device SP execute the predetermined image processing when it is determined that the worker information does not match the authorized person information. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can execute the predetermined image processing when necessary, and can more appropriately protect the privacy of the monitored person Ob.
  • the predetermined image processing is performed on the target image.
  • the process is executed on an image outside a predetermined specific area. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person Ob.
  • the monitored person monitoring system MS and the fixed terminal device SP determine whether or not the image of the person in the target image infringes privacy, and when it is determined that it is not infringement of privacy, the predetermined image It is determined that the process is not executed. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can more appropriately protect the privacy of the person reflected in the target image.
  • the target image with a low display image resolution is considered to be an image that does not infringe privacy.
  • the monitored person monitoring system MS and the fixed terminal device SP do not execute the predetermined image processing when the display image resolution is equal to or lower than a predetermined threshold. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can execute the predetermined image processing when necessary, and can more appropriately protect the privacy of the monitored person Ob.
  • a background image of a person image in the target image includes, for example, a photograph of the monitored person Ob or a photograph of the family member. If the monitored person monitoring system MS and the fixed terminal device SP determine that the background image is a violation of privacy, the predetermined image processing is determined to be a violation of privacy among the background images. The process is executed on a partial image in a predetermined range including the determined image. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person.
  • the predetermined image processing is performed as described above. Execute on the image in the area where the bedding is located. Therefore, the monitored person monitoring system MS and the fixed terminal device SP can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person Ob.
  • the monitored person monitoring system MS and the fixed terminal device SP determine whether or not the processed image is infringed on the privacy, the monitored person's privacy can be protected more reliably.
  • the image acquisition unit is the SP communication IF unit 2, but may be an image sensor (for example, a visible camera or an infrared camera) that generates a target image.
  • the setting device for the monitored person monitoring device may be incorporated in the sensor device SU.
  • the setting device for the monitored person monitoring device is incorporated in the fixed terminal device SP. However, as described above, it may be a separate unit, and as shown by a broken line in FIG.
  • the monitoring system SM may be configured to include a separate monitoring target person monitoring device setting device ST.
  • Such a monitoring device setting device ST for the monitored person includes the above-described control unit 11, parameter setting processing unit 13, image display processing unit 15 and image display adjustment unit 16 in the SP control processing unit 1, and SP communication IF.
  • Each unit includes the same units as the unit 2, the SP input unit 3, the SP display unit 4, and the SP storage unit 6.
  • a setting apparatus for a monitored person monitoring apparatus is a setting apparatus for a monitored person monitoring apparatus that sets a predetermined parameter in a monitored person monitoring apparatus that monitors the monitored person, An image acquisition unit that acquires a target image whose target is an image of a place where the monitored person is present, a display unit that performs display, and an image display processing unit that displays the target image acquired by the image acquisition unit on the display unit. And the image display processing unit executes a predetermined image processing so as to protect privacy for the target image when the operation mode is a setting mode for setting the predetermined parameter. And generating the processed image as the target image.
  • Such a monitored person monitoring device setting device executes predetermined image processing so as to protect privacy for the target image when the operation mode is the setting mode regardless of the authority management information. Then, a processed image is generated, and the generated processed image is set as the target image and displayed on the display unit. For this reason, when the operation mode is the setting mode, the setting device for the monitored person monitoring device can more appropriately protect the privacy of the monitored person.
  • the image display processing unit provides privacy to the target image when the operation mode is a setting mode for setting the predetermined parameter.
  • An execution determination unit that determines whether or not to execute predetermined image processing to protect, and a processed image by executing the predetermined image processing on the target image based on a determination result of the execution determination unit
  • a processed image generation unit that uses the generated processed image as the target image.
  • Such a setting apparatus for a monitored person monitoring apparatus includes an execution determination unit, so that it is possible to stop execution of unnecessary image processing when the target image does not infringe privacy.
  • an input unit for inputting worker information for identifying and identifying a worker in the setting mode, and an authorized person who can refer to the target image are represented.
  • a first sub-execution determination unit that determines that the predetermined image processing is to be executed when it is determined that they do not match as a result of the determination.
  • the predetermined image processing is executed at the first processing level.
  • the processed image generation unit executes the predetermined image processing at the first processing level by the first sub execution determination unit of the execution determination unit. Then, when it is determined, a first processed image is generated by executing the predetermined image processing on the target image at the first processing level, and the generated first processed image is set as the target image.
  • the predetermined image processing is executed on the target image at the second processing level. Then, a second processed image is generated, and the generated second processed image is set as the target image.
  • the monitored person monitoring device setting device executes the predetermined image processing when it is determined that the worker information does not match the permitter information. For this reason, the setting apparatus for the monitored person monitoring apparatus can execute the predetermined image processing when necessary, and can more appropriately protect the privacy of the monitored person.
  • the information processing apparatus further includes a region information storage unit that stores a predetermined specific region in the target image, and the execution determination unit includes the region in the target image. It is determined whether or not there is a person image in an image outside the predetermined specific area stored in the information storage unit, and when it is determined that the person image exists as a result of the determination, the predetermined image
  • a second sub-execution determining unit that determines to execute the image processing on an image in the target image outside the predetermined specific region stored in the region information storage unit.
  • the second sub-execution determination unit of the execution determination unit performs the predetermined image processing on an image of a region outside the predetermined specific region stored in the region information storage unit in the target image.
  • Run A first sub-processed image generation unit that executes the predetermined image processing on an image in a region outside the predetermined specific region stored in the region information storage unit in the target image. Is provided.
  • the predetermined image processing is performed on the target image in the region.
  • the process is executed on an image in an area outside the predetermined specific area stored in the information storage unit. Therefore, the setting device for the monitored person monitoring apparatus can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person.
  • the execution determination unit determines whether or not an image of a person in the target image infringes privacy, and as a result of the determination, A third sub-execution determination unit that determines that the predetermined image processing is not executed when it is determined that the privacy is not infringed is provided.
  • Such a setting device for a monitored person monitoring device can more appropriately protect the privacy of a person reflected in the target image.
  • the execution determination unit determines whether an image resolution of the target image when the target image is displayed on the display unit is a predetermined threshold value or less.
  • a fourth sub-execution determining unit that determines that the predetermined image processing is not to be executed when it is determined that the predetermined image processing is less than or equal to the predetermined threshold.
  • the target image with a low display image resolution is considered to be an image that does not infringe privacy.
  • the monitored person monitoring device setting device does not execute the predetermined image processing when the display image resolution is equal to or lower than a predetermined threshold value. For this reason, the setting apparatus for the monitored person monitoring apparatus can execute the predetermined image processing when necessary, and can more appropriately protect the privacy of the monitored person.
  • the execution determination unit determines whether a background image excluding a person image of the target image infringes privacy, and As a result of the determination, when it is determined that privacy is infringed, the predetermined image processing is performed on a partial image in a predetermined range including the image determined to be infringement of privacy among the background images.
  • a fifth sub-execution determination unit that determines to execute, and the processed image generation unit includes the fifth sub-execution determination unit of the execution determination unit that performs the predetermined image processing in the privacy of the background image.
  • the predetermined image processing is an infringement of the privacy among the background images. Partial image of a predetermined range including the determined image contrast, a second sub-processing image generating unit to perform.
  • a background image of a person image in the target image includes, for example, a photograph of the person being monitored or a photograph of the family member.
  • the setting device for the monitored person monitoring device determines that the predetermined image processing is an infringement of privacy among the background images. The process is executed on a partial image in a predetermined range including the image. Therefore, the setting device for the monitored person monitoring apparatus can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person.
  • the execution determination unit determines whether or not there is an image of a person lying on the bed in a region where the bedding is preset in the target image.
  • a sixth sub-execution determining unit that determines that the predetermined image processing is to be executed on the image in the area where the bedding is located when it is determined that there is an image of the person on the bed as a result of the determination;
  • the processed image generation unit is configured to execute the predetermined image processing when the sixth sub-execution determination unit of the execution determination unit determines that the predetermined image processing is to be executed on an image in the location area of the bedding.
  • a third sub-processed image generation unit is provided that performs image processing on an image in an area where the bedding is located.
  • the predetermined image processing based on the determination result of the first sub-execution determination unit, the predetermined image processing based on the determination result of the second sub-execution determination unit, and the first The predetermined image processing based on the determination result of the third sub execution determination unit, the predetermined image processing based on the determination result of the fourth sub execution determination unit, and the predetermined image processing based on the determination result of the fifth sub execution determination unit;
  • the predetermined image processing based on the determination result of the sixth sub execution determination unit is different from each other.
  • the predetermined image processing based on the determination result of the first sub-execution determination unit, the predetermined image processing based on the determination result of the second sub-execution determination unit, and the first The predetermined image processing based on the determination result of the third sub execution determination unit, the predetermined image processing based on the determination result of the fourth sub execution determination unit, and the predetermined image processing based on the determination result of the fifth sub execution determination unit;
  • the predetermined image processing based on the determination result of the sixth sub execution determination unit is the same as each other.
  • the predetermined image processing based on the determination result of the sixth sub-execution determination unit is partly different from each other and the remaining part is the same.
  • Such a monitored person monitoring apparatus setting device performs the predetermined image processing when it is determined that an image of a person lying on the bed is present in an area where the bedding is preset in the target image. This is performed on the image in the region where Therefore, the setting device for the monitored person monitoring apparatus can execute the predetermined image processing in a necessary area, and can more appropriately protect the privacy of the monitored person.
  • the image display adjustment unit is configured so that a target image of the processed image generated by the processed image generation unit by each of the third and fifth sub-execution determination units. Determine whether to violate privacy.
  • a setting method for a monitored person monitoring apparatus is a setting method for a monitored person monitoring apparatus that sets a predetermined parameter in a monitored person monitoring apparatus that monitors the monitored person.
  • An image acquisition process for acquiring a target image for imaging a place where the monitored person is present, and an image display process for displaying the target image acquired in the image acquisition process on a display unit.
  • the operation mode is a setting mode for setting the predetermined parameter
  • a process image is generated by executing predetermined image processing so as to protect privacy for the target image, and the generated The processed image is set as the target image.
  • Such a setting method for a monitored person monitoring device executes predetermined image processing so as to protect privacy for the target image when the operation mode is the setting mode regardless of the authority management information. Then, a processed image is generated, and the generated processed image is set as the target image and displayed on the display unit. Therefore, the setting method for the monitored person monitoring apparatus can more appropriately protect the privacy of the monitored person when the operation mode is the setting mode.
  • a monitored person monitoring system includes a monitored person monitoring apparatus that monitors a monitored person, and a communication result connected to the monitored person monitoring apparatus, and notification of a monitoring result of the monitored person monitoring apparatus
  • a monitoring device including a terminal device for receiving the image, wherein the image acquisition unit acquires a target image for imaging a place where the monitored person is present, a display unit that performs display, and the image acquisition unit.
  • An image display processing unit that displays the acquired target image on the display unit, and the image display processing unit is configured to display the target image when the operation mode is a setting mode for setting the predetermined parameter.
  • a processed image is generated by executing predetermined image processing so as to protect privacy, and the generated processed image is set as the target image.
  • a monitored person monitoring device that monitors a monitored person that is a monitoring target, and a terminal device that is communicably connected to the monitored person monitoring device and receives a notification of a monitoring result of the monitored person monitoring device.
  • the system provided further includes any one of the above-described monitored person monitoring apparatus setting devices.
  • Such a monitored person monitoring system further includes any one of the above-described setting apparatuses for the monitored person monitoring device, the privacy of the monitored person can be more appropriately protected.
  • the setting apparatus for monitored person monitoring apparatuses, this method, and a monitored person monitoring system can be provided.

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Alarm Systems (AREA)
  • Emergency Alarm Devices (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

L'invention concerne un dispositif de réglage de dispositif de surveillance de sujet surveillé et son procédé de réglage, ledit procédé permettant de régler un paramètre prescrit du dispositif de surveillance de sujet surveillé. Selon l'invention, le procédé consiste à acquérir une image cible, la cible d'imagerie de cette dernière étant un endroit où est présent le sujet surveillé, et lorsqu'un mode de fonctionnement correspond à un mode de réglage dans lequel est réglé le paramètre prescrit, à générer une image traitée par application d'un traitement d'image prescrit à l'image cible de façon à protéger la confidentialité, et à afficher ladite image traitée générée en tant qu'image cible sur une unité d'affichage. Un système de surveillance de sujet surveillé selon la présente invention fait appel à ce type de dispositif de réglage de dispositif de surveillance de sujet surveillé.
PCT/JP2017/036408 2016-11-24 2017-10-06 Dispositif de réglage de dispositif de surveillance de sujet surveillé, son procédé de réglage et système de surveillance de sujet surveillé WO2018096806A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018552445A JPWO2018096806A1 (ja) 2016-11-24 2017-10-06 被監視者監視装置用設定装置および該方法ならびに被監視者監視システム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-228281 2016-11-24
JP2016228281 2016-11-24

Publications (1)

Publication Number Publication Date
WO2018096806A1 true WO2018096806A1 (fr) 2018-05-31

Family

ID=62196227

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/036408 WO2018096806A1 (fr) 2016-11-24 2017-10-06 Dispositif de réglage de dispositif de surveillance de sujet surveillé, son procédé de réglage et système de surveillance de sujet surveillé

Country Status (2)

Country Link
JP (1) JPWO2018096806A1 (fr)
WO (1) WO2018096806A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114333238A (zh) * 2021-12-30 2022-04-12 广东省第二人民医院（广东省卫生应急医院） 一种基于5g的紧急救援通信系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002142214A (ja) * 2000-11-02 2002-05-17 Matsushita Electric Ind Co Ltd 映像監視システム
JP2004128801A (ja) * 2002-10-01 2004-04-22 Matsushita Electric Ind Co Ltd 宅内モニタリング装置
JP2010114785A (ja) * 2008-11-07 2010-05-20 Canon Inc 映像送信装置、映像送信方法、およびコンピュータプログラム
JP2011091705A (ja) * 2009-10-23 2011-05-06 Canon Inc 画像処理装置、および画像処理方法
JP2012090176A (ja) * 2010-10-21 2012-05-10 Canon Inc 映像配信装置、撮像装置、映像配信システム、映像配信方法、映像配信プログラム
JP2016012752A (ja) * 2014-06-27 2016-01-21 株式会社 日立産業制御ソリューションズ 映像監視装置、映像監視システムおよび映像監視方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002142214A (ja) * 2000-11-02 2002-05-17 Matsushita Electric Ind Co Ltd 映像監視システム
JP2004128801A (ja) * 2002-10-01 2004-04-22 Matsushita Electric Ind Co Ltd 宅内モニタリング装置
JP2010114785A (ja) * 2008-11-07 2010-05-20 Canon Inc 映像送信装置、映像送信方法、およびコンピュータプログラム
JP2011091705A (ja) * 2009-10-23 2011-05-06 Canon Inc 画像処理装置、および画像処理方法
JP2012090176A (ja) * 2010-10-21 2012-05-10 Canon Inc 映像配信装置、撮像装置、映像配信システム、映像配信方法、映像配信プログラム
JP2016012752A (ja) * 2014-06-27 2016-01-21 株式会社 日立産業制御ソリューションズ 映像監視装置、映像監視システムおよび映像監視方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114333238A (zh) * 2021-12-30 2022-04-12 广东省第二人民医院（广东省卫生应急医院） 一种基于5g的紧急救援通信系统

Also Published As

Publication number Publication date
JPWO2018096806A1 (ja) 2019-10-17

Similar Documents

Publication Publication Date Title
JP6819738B2 (ja) 端末装置、プログラムおよびシステム
WO2017146012A1 (fr) Dispositif, procédé et système de surveillance d'une personne sous surveillance
WO2016199495A1 (fr) Dispositif de détection de comportement, procédé et programme de détection de comportement et dispositif de surveillance de sujet
WO2018096805A1 (fr) Dispositif de réglage de dispositif de surveillance de sujet surveillé, procédé de réglage associé et système de surveillance de sujet surveillé
EP3486868A1 (fr) Dispositif de détermination de comportement et procédé de détermination de comportement
JP6589736B2 (ja) 監視システム
WO2018096806A1 (fr) Dispositif de réglage de dispositif de surveillance de sujet surveillé, son procédé de réglage et système de surveillance de sujet surveillé
WO2018230104A1 (fr) Dispositif et procédé de traitement central pour système d'aide à la surveillance d'une personne surveillée, et système d'aide à la surveillance d'une personne surveillée
JP6895090B2 (ja) 検知システムおよび検知システムの表示処理方法
JP6292363B2 (ja) 端末装置および端末装置の表示方法ならびに被監視者監視システム
JP7264065B2 (ja) 被監視者監視支援システムおよび被監視者監視支援方法
JP7047762B2 (ja) 被監視者監視システムの中央処理装置および中央処理方法ならびに被監視者監視システム
WO2020100461A1 (fr) Dispositif de capteur pour un système d'aide à la surveillance de personne à surveiller, procédé de stockage d'image de surveillance, et système d'aide à la surveillance de personne à surveiller
JP6187732B1 (ja) 端末装置、端末装置の動作制御方法および被監視者監視システム
WO2019073735A1 (fr) Système et procédé d'aide à la surveillance de personne surveillée
JP7264066B2 (ja) 被監視者監視支援システム
US10970988B2 (en) Information processing apparatus, information processing system, method, and program
JP7327396B2 (ja) 制御プログラム、レポート出力方法、およびレポート出力装置
WO2018230103A1 (fr) Dispositif de surveillance de personne surveillée et procédé associé, et système d'aide à la surveillance de personne surveillée
JP6156674B1 (ja) 通信システム
CN115943626A (zh) 看护监视装置以及看护监视方法
JPWO2018034206A1 (ja) 被監視者監視システムの設定変更判定装置、及び、被監視者監視システムの設定変更判定方法
JP2022069026A (ja) 見守り支援装置および見守り支援システム
JPWO2019235068A1 (ja) 被監視者監視支援装置、被監視者監視支援方法、被監視者監視支援システムおよび被監視者監視支援サーバ装置
JP2019139340A (ja) 徘徊検出システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17873186

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018552445

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17873186

Country of ref document: EP

Kind code of ref document: A1