JP6777470B2 - Action recording system, terminal device and action recording method - Google Patents

Description

The present invention relates to an action recording system, a terminal device, and an action recording method.

As a technique for monitoring the state of a person in a predetermined room, the nursing care system described in Patent Document 1 and the monitoring device described in Patent Document 2 are known. These Patent Documents 1 and 2 propose a monitoring technique that considers the privacy of the person to be monitored.
The nursing care system described in Patent Document 1 includes a camera device installed in the nursing care room and a monitor capable of displaying the state of the care recipient. The feature part of the body of the care recipient is analyzed from the image taken by the camera device, and the comparison result between the analyzed feature part and the pre-registered feature part is displayed on the monitor instead of the captured image.
The monitoring device described in Patent Document 2 includes a person image obtained by extracting a portion above a predetermined temperature from an image taken by a thermography camera installed in a hospital room, and a background image obtained by taking an unmanned hospital room with a normal camera. And are combined to generate a surveillance image.

Japanese Unexamined Patent Publication No. 2014-007685 JP-A-2007-089727

In recent years, assaults by staff on care recipients have become a social problem in nursing care facilities and the like. Such violent acts may be confirmed from the images of surveillance cameras installed in the facility.
However, for example, if privacy-conscious monitoring is performed as described above, or if the assault is performed in the blind spot of the surveillance camera, the assault may not be confirmed.
An object of the present invention is to prevent assault of facility staff against facility users and to enable proof of staff innocence in the event of an accident.

According to one embodiment of the present invention, an action recording system including a communication device installed in a predetermined area and a terminal device that can be worn by a person is provided. The terminal device includes a photographing unit that photographs the surroundings of the terminal device, a communication unit that communicates with the communication device, and a photographing control unit that prohibits the photographing unit from stopping photography based on communication between the communication unit and the communication device. , Equipped with.

The shooting control unit may start shooting by the shooting unit when the communication unit can communicate with the communication device, and may stop shooting by the shooting unit when the communication unit cannot communicate with the communication device.
The action recording system may include an alarm control unit that generates an alarm when shooting by the photographing unit continues even after a predetermined time has elapsed since the communication unit cannot communicate with the communication device.

The action recording system may include a storage device that stores a scheduled work period in a predetermined area. The shooting control unit prohibits the shooting unit from stopping shooting when the current time is the scheduled work period in the predetermined area, and permits the shooting unit to stop shooting when the current time is outside the work period in the predetermined area. You may.

According to another embodiment of the present invention, a human wearable terminal device is provided. The terminal device has a photographing unit that photographs the surroundings of the terminal device, a communication unit that communicates with a communication device installed in a predetermined area, and a stop of photography by the photographing unit based on communication between the communication unit and the communication device. It is provided with a shooting control unit forbidden.

According to another embodiment of the present invention, a method of recording worker behavior is provided. In the action recording method, communication is performed between the terminal device worn by the worker and the communication device installed in a predetermined area, the surroundings of the worker are photographed by the photographing unit of the terminal device, and the terminal device and the communication device are used. It is prohibited to stop shooting by the shooting unit based on the communication with.

According to the present invention, it is possible to prevent the assault of the facility staff against the user of the facility and prove the innocence of the staff in the event of an accident.

It is a schematic block diagram which shows the whole of the action recording system of an embodiment. (A) to (c) are explanatory views of an example of how to attach a mobile terminal device, respectively. It is a figure which shows the configuration example of the mobile terminal apparatus of embodiment. (A) is a diagram showing an example of a photographed image taken by a camera of a mobile terminal device, and (b) is a diagram showing an example of mosaic processing applied to the photographed image. It is a figure which shows the configuration example of the server apparatus of embodiment. It is a flowchart which shows an example of the action recording method of embodiment. It is a flowchart which shows an example of the wearing state determination processing. It is a flowchart which shows an example of the acoustic detection state determination processing.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiments of the present invention shown below exemplify devices and methods for embodying the technical idea of the present invention, and the technical idea of the present invention describes the materials, shapes, and shapes of the components. The structure, arrangement, etc. are not specified as follows. The technical idea of the present invention may be modified in various ways within the technical scope specified by the claims stated in the claims.

(Overall configuration of action recording system)
See FIG. In this specification, the case of recording the behavior of the staff engaged in the nursing care service at the nursing care facility as the behavior record will be described. However, the behavior recording system of the present invention is not limited to the system for recording the behavior of the staff of the nursing facility, and can be widely applied to the system for recording the behavior of the workers engaged in the work in the predetermined area.

The action recording system is attached to the communication device 2 installed in the living room 1 of the long-term care facility, which is a predetermined area, and the staff 4 of the long-term care facility who cares for the resident 3 who is the care recipient who receives the long-term care service in the living room 1. The mobile terminal device 5 is provided. Further, the action recording system includes a server device 7 installed in the monitoring center and connected to the mobile terminal device 5 through the communication line 6.
The mobile terminal device 5 includes a camera that photographs the surroundings of the mobile terminal device 5 (for example, in front of the staff 4) and an acoustic detection unit that detects an acoustic signal. The action recording system records the actions of the staff 4 by recording the video and conversation of the resident 3 while the staff 4 is in the room 1.

In this way, the privacy of the resident 3 is protected by monitoring only the period during which the staff 4 is in the room 1, and the assault of the staff 4 against the resident 3 by recording the actions of the staff 4. The act can be prevented. Furthermore, in the unlikely event of an accident, the innocence of the staff 4 can be proved.
Further, since the image of the resident 3 is taken by the mobile terminal device 5 attached to the staff 4, the resident 3 supported by the staff 4 enters the blind spot of the camera unlike the fixed surveillance camera. Hateful. Therefore, it is possible to prevent violent acts in the blind spot of the camera.

Next, each of the components of the action recording system will be described.
(Communication device)
The communication device 2 is installed on a wall surface, a ceiling, or the like in each predetermined area such as the living room 1 of the resident 3 or other common rooms. The communication device 2 transmits an identification signal (ID signal) peculiar to the communication device 2, for example, a beacon signal to the surroundings of the communication device 2 in a predetermined cycle according to a short-range wireless communication standard such as BLE (Bluetooth Low Energy). The communication device 2 may be an active RFID (Radio Frequency IDentification) tag that has a power source and periodically transmits a beacon signal. Such active RFID tags include, but are not limited to, iBeacon ™ compliant with Bluetooth® LE. Further, it is desirable that the living room or the like is electromagnetically isolated so that the beacon signal cannot be received outside the area where the communication device 2 is installed. Hereinafter, a case where the communication device 2 transmits a beacon signal will be described.

(Mobile terminal device)
The mobile terminal device 5 is attached to the body of the employee 4 at the time of use, and the camera of the mobile terminal device 5 photographs the surroundings of the mobile terminal device 5 to photograph the resident 3 as seen from the position of the employee 4. Used for. For example, the mobile terminal device 5 is attached to the employee 4 so that the camera captures the front of the employee 4 (that is, the field of view of the camera includes the front of the employee 4). As a result, the resident 3 supported by the staff 4 can be photographed with the camera.
As shown in FIG. 2A, the employee 4 may attach the mobile terminal device 5 to the string hung from the neck. The mobile terminal device 5 may be provided with a mounting device to be mounted on the employee 4, or may be accommodated in a dedicated case having such a mounting device.

Alternatively, the employee 4 may attach the mobile terminal device 5 to another portion and attach the camera unit for transmitting an image to the mobile terminal device 5 to a string hung from the neck. As shown in FIG. 2B, an external camera 12 such as a headset camera may be attached to the head.
Alternatively, as shown in FIG. 2C, a mounting space for accommodating the mobile terminal device 5 or an external camera may be provided in the uniform or the like of the staff 4.

See FIG. The mobile terminal device 5 includes an operation unit 10, a display unit 11, a camera 12, a first communication unit 13, a second communication unit 14, an alarm output unit 15, an acoustic detection unit 16, and a control unit 17. , The storage device 18.
The operation unit 10 functions as an information input means, and may include an input button, a touch panel provided on the display screen of the display unit 11, and the like. The operation unit 10 is used to receive information input and operation input to the mobile terminal device 5 by the staff 4. For example, the operation unit 10 receives an input of an operation of the staff 4 who stops the shooting by the camera 12.

The display unit 11 functions as a display means, and displays various operation screens and information under the control of the control unit 17. For example, the operation screen of the camera 12 is displayed on the display unit 11. On the operation screen of the camera 12, for example, a shooting start button for starting shooting by the camera 12, a shooting stop button for stopping shooting by the camera 12, and the like may be displayed.
The camera 12 may be a known built-in camera or an external camera formed by including an image sensor such as a CCD element or a C-MOS element, an optical system component, an A / D converter, an encoder, and the like. The camera 12 outputs the captured image to the control unit 17.

The first communication unit 13 includes an interface circuit for performing wireless communication in accordance with a short-range wireless communication standard such as BLE (Bluetooth Low Energy). The communication range of short-range radio may be about several meters to several tens of meters. As a result, the first communication unit 13 receives the beacon signal transmitted from the communication device 2.
The second communication unit 14 is provided with a wired or wireless communication interface, and is a circuit for performing wired communication or wireless communication with the server device 7 via the communication line 6.

The alarm output unit 15 outputs an alarm by a visual signal or an acoustic signal according to the control of the control unit 17. The alarm output unit 15 may be, for example, a buzzer or a speaker that outputs an acoustic signal, or a display device or a lamp that outputs a visual signal.
The acoustic detection unit 16 detects an acoustic signal around the mobile terminal device 5. The sound detection unit 16 may be a built-in microphone, an external microphone, or the like. The acoustic detection unit 16 outputs the detected acoustic signal to the control unit 17.

The control unit 17 may include a processor such as a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit) for controlling the operation of the mobile terminal device 5. The control unit 17 may be realized by a functional logic circuit set in a general-purpose semiconductor integrated circuit. For example, the control unit 17 may have a programmable logic device (PLD: Programmable Logic Device) such as a field-programmable gate array (FPGA).

The control unit 17 includes a communication processing unit 20, an entry determination unit 21, a photographing control unit 22, an alarm control unit 23, a human body detection unit 24, and an abnormality determination unit 25. By executing the computer program stored in the storage device 18, the control unit 17 executes the communication processing unit 20, the room entry determination unit 21, the photographing control unit 22, the alarm control unit 23, the human body detection unit 24, and the abnormality described below. The process of the determination unit 25 is performed. That is, the computer program includes an instruction to cause the control unit 17 to perform processing of the communication processing unit 20, the room entry determination unit 21, the photographing control unit 22, the alarm control unit 23, the human body detection unit 24, and the abnormality determination unit 25.

The control unit 17 does not need to have all the functions of the communication processing unit 20, the room entry determination unit 21, the imaging control unit 22, the alarm control unit 23, the human body detection unit 24, and the abnormality determination unit 25, and the server device 7 May include some of these features.
The storage device 18 may include any of a semiconductor storage device, a magnetic storage device, and an optical storage device. The storage device 18 may include a memory such as a register, a cache memory, a ROM (Read Only Memory) and a RAM (Random Access Memory) used as the main storage device.

The communication processing unit 20 performs communication processing with the server device 7 via the second communication unit 14. When the captured image by the camera 12 and the acoustic signal detected by the acoustic detection unit 16 are input to the control unit 17, the captured image and the acoustic signal are not stored in the portable terminal device 5 and are not stored in the mobile terminal device 5 by the communication processing unit 20. It is transmitted to the server device 7.
As shown in FIG. 4A, the image 30 captured by the camera 12 may include the image 31 of the resident 3. Similarly, the acoustic signal detected by the acoustic detection unit 16 may include the remarks of the resident 3.

By not storing the captured image and the acoustic signal in the mobile terminal device 5, it is possible to prevent such information from being illegally taken out from the mobile terminal device 5 and leaked. As a result, the privacy of the resident 3 is protected.
As shown in FIG. 4B, the communication processing unit 20 may perform mosaic processing on the portion of the image 31 of the resident 3 of the captured image 30 and then transmit the image to the server device 7 for privacy protection. The acoustic signal detected by the acoustic detection unit 16 may also be subjected to processing so that the speaker cannot be identified.

See FIG. When the first communication unit 13 receives the beacon signal periodically transmitted from the communication device 2, the communication processing unit 20 transfers the identification information (ID information) unique to the communication device 2 included in the beacon signal to the server device 7. Send. At this time, in the room entry determination unit 21, the staff 4 wearing the mobile terminal device 5 is placed in the room 1 depending on whether or not the first communication unit 13 has received the beacon signal periodically transmitted from the communication device 2. You may decide whether or not you have entered the room. That is, the room entry determination unit 21 may determine that the staff 4 has entered the living room 1 when the first communication unit 13 can communicate with the communication device 2. When the entry determination unit 21 determines that the staff 4 has entered the living room 1, the communication processing unit 20 transmits the ID information of the communication device 2 to the server device 7.
The communication processing unit 20 receives the shooting permission signal and the shooting stop prohibition signal transmitted from the server device 7 in response to the ID information.

The shooting control unit 22 controls the start and stop of shooting by the camera 12. When it is determined that the staff member 4 has entered the living room 1 based on the reception of the beacon signal and the communication processing unit 20 receives the photographing permission signal from the server device 7, the photographing control unit 22 uses the camera 12 for photographing and the sound detecting unit 16. Start acoustic detection. That is, when the first communication unit 13 can communicate with the communication device 2, the photographing control unit 22 starts photographing by the camera 12 and sound detection by the sound detecting unit 16. In other words, the photographing control unit 22 controls the photographing by the camera 12 and the detection of the acoustic signal by the acoustic detection unit 16 based on the communication between the first communication unit 13 and the communication device 2.

Further, when it is determined that the employee 4 has entered the living room 1 based on the reception of the beacon signal and the communication processing unit 20 receives the shooting stop prohibition signal from the server device 7, the shooting control unit 22 prohibits the shooting from being stopped by the camera 12. To do. That is, the photographing control unit 22 prohibits the camera 12 from stopping the photographing when the first communication unit 13 can communicate with the communication device 2. In other words, the photographing control unit 22 prohibits the camera 12 from stopping the photographing based on the communication between the first communication unit 13 and the communication device 2.

For example, the shooting control unit 22 may invalidate the operation of the shooting stop button on the operation screen of the camera 12 displayed on the display unit 11. Further, for example, the shooting control unit 22 may prohibit the display of the shooting stop button itself.
By prohibiting the staff 4 from stopping the shooting in the living room 1, it is possible to prevent the staff 4 from unfairly interrupting the action record of the staff 4 and assaulting the resident 3 during that time. ..

When the employee 4 leaves the room 1 and the first communication unit 13 stops receiving the beacon signal of the communication device 2, the room entry determination unit 21 determines that the employee 4 has left the room 1. That is, the room entry determination unit 21 determines that the staff 4 has left the living room 1 when the first communication unit 13 cannot communicate with the communication device 2.
When it is determined that the staff 4 has left the living room 1 based on the reception of the beacon signal, the shooting control unit 22 stops shooting by the camera 12. That is, the shooting control unit 22 stops shooting by the camera 12 when the first communication unit 13 cannot communicate with the communication device 2. The photographing control unit 22 may stop photographing by the camera 12 when the first communication unit 13 cannot communicate with the communication device 2. For example, the photographing control unit 22 may stop photographing by the camera 12 when a predetermined time has elapsed after the first communication unit 13 cannot communicate with the communication device 2.

Further, when it is determined that the employee 4 has left the living room 1 based on the reception of the beacon signal, the photographing control unit 22 releases the prohibition of stopping the photographing by the camera 12.
Further, while the staff 4 is outside the living room 1 and is not receiving the beacon signal from the communication device 2, the photographing control unit 22 follows the operation performed on the operation screen of the camera 12 displayed on the display unit 11 to the camera 12. Starts and stops shooting by. As a result, the staff 4 can manually operate the camera 12 while the staff 4 is outside the living room 1.

Due to a failure of the shooting control unit 22 or the camera 12, there is a risk that the shooting by the camera 12 will not be automatically stopped even if the staff 4 leaves the living room 1 after the work period of the staff 4 is completed. If the shooting by the camera 12 is not stopped even after the work period of the staff 4, the privacy of the staff 4 may be infringed.
Therefore, the alarm control unit 23 generates a predetermined alarm when the camera 12 continues to take a picture even after a predetermined time has elapsed since the first communication unit 13 cannot communicate with the communication device 2. For example, the alarm control unit 23 may output an alarm sound or an alarm message from the alarm output unit 15 which is a buzzer or a speaker. The alarm control unit 23 may output a visual alarm display by the alarm output unit 15 which is a display device or a lamp.

If the mobile terminal device 5 is not normally attached, the employee 4 cannot take a picture of the corresponding resident 3, and thus the action of the employee 4 cannot be recorded. Therefore, the abnormality determination unit 25 determines the abnormality of the wearing state of the mobile terminal device 5. The abnormality of the mounting state of the mobile terminal device 5 includes the abnormality of the mounting state of the mobile terminal device 5 itself and the abnormality of the mounting state of the camera 12 when the external camera is used as the camera 12.

Therefore, the human body detection unit 24 detects the human body captured in the image captured by the camera 12. The abnormality determination unit 25 is a mobile terminal depending on whether or not the human body detection unit 24 has detected a human body while the entry determination unit 21 determines that the employee 4 has entered the living room 1 and the camera 12 is taking a picture. Determine the abnormality of the mounting state of the device 5.
This is because even though the staff 4 is in the room 1, the staff 4 does not see the resident 3 at all (that is, the staff 4 does not face the resident 3 at all). Based on the finding that it is natural.

The abnormality determination unit 25 responds to the length of the period during which the human body detection unit 24 does not continuously detect the human body in a state where the entry determination unit 21 determines that the employee 4 has entered the living room 1 and the camera 12 is taking a picture. The abnormality in the mounting state of the mobile terminal device 5 may be determined. For example, in the case where the abnormality determination unit 25 determines that the employee 4 has entered the living room 1 and the camera 12 is taking a picture, the human body detection unit 24 does not detect the human body continuously for a predetermined period or longer. In addition, it may be determined that the mounting state is abnormal.
The abnormality determination unit 25 notifies the server device 7 of an abnormality in the mounting state of the mobile terminal device 5 via the communication processing unit 20.

Further, the abnormality determination unit 25 is a mobile terminal device according to the frequency with which the human body detection unit 24 detects the human body in a state where the entry determination unit 21 determines that the employee 4 has entered the living room 1 and the camera 12 is taking a picture. The abnormality of the mounting state of 5 may be determined. For example, in the abnormality determination unit 25, the number of times the human body is detected within a predetermined period by the human body detection unit 24 is equal to or less than the threshold value in a state where the entry determination unit 21 determines that the employee 4 has entered the living room 1 and the camera 12 is taking a picture. In this case, it may be determined that the mounting state is abnormal.

The human body detection unit 24 may detect the human body based on the detection result of the human face captured in the image captured by the camera 12.
For example, the human body detection unit 24 may detect the human head as a face by scanning the edge image of the captured image using an elliptical reference pattern similar to the human head shape. Further, the human body detection unit 24 inputs an image into a discriminator trained in advance using an image in which the human face exists and an image in which the human face does not exist, and the discriminator captures the photographed image of the person. The face may be detected.

In addition, the human body detection unit 24 may detect a human face by detecting a skin color region of a captured image. As shown in FIG. 4B, when the photographed image is subjected to the mosaic process, the face of the person in the photographed image is detected based on the skin color information by performing the mosaic process so that the color information remains. can do.
Further, a marker having a predetermined shape or a reflective material may be attached to the clothes of the resident 3, and the human body detection unit 24 detects the human body based on the detection result of the predetermined marker captured in the image captured by the camera 12. May be good.

The employee 4 who knows the attachment determination logic of the mobile terminal device 5 by detecting the human body places the mobile terminal device 5 at a position where the face of the resident 3 can be seen, and the employee 4 is not equipped with the mobile terminal device 5. However, it is conceivable to take measures so that the abnormality cannot be detected.
Therefore, even if the human body detection unit 24 detects the human body, the abnormality determination unit 25 attaches the mobile terminal device 5 when the state in which there is no change between images that are continuous in time continues for a predetermined period or longer. Judge that the state is abnormal.

For example, the abnormality determination unit 25 determines that the wearing state of the mobile terminal device 5 is abnormal when the change between the captured images (that is, “frames”) taken by the camera 12 at different times is equal to or less than a predetermined amount.
In this case, even if the person who is the subject of the camera 12 moves a little, the change occurs between the frames, but when the mobile terminal device 5 is normally attached, the entire image changes in the process of the staff 4 performing the work. Since it occurs, the amount of change is large. Therefore, it is possible to identify whether or not the wearing state of the mobile terminal device 5 is abnormal based on the amount of change between the frames.

Further, the abnormality determination unit 25 determines an abnormality such as a failure of the sound detection unit 16 or a planning action of the staff 4 with respect to the sound detection unit 16.
The abnormality determination unit 25 detects an abnormality in the acoustic detection unit 16, that is, acoustic detection when the acoustic detection unit 16 does not detect an acoustic signal even though the human body detection unit 24 detects the human body during shooting by the camera 12. It is determined that the unit 16 has failed or that some kind of fraudulent activity has been performed on the acoustic detection unit 16. For example, the abnormality determination unit 25 is a sound detection unit when the sound detection unit 16 does not detect an acoustic signal of a predetermined level Th1 or higher even though the human body detection unit 24 detects the human body during shooting by the camera 12. It may be determined that the abnormality is 16.
The abnormality determination unit 25 notifies the server device 7 of the abnormality of the sound detection unit 16 via the communication processing unit 20.

Here, in the "fraudulent act", for example, a normal care act is recorded in the image taken by the camera 12, but the staff member 4 makes a statement that abuses the resident 3 and records the acoustic signal at that time. Including acts that 4 interferes.
For example, assuming that the acoustic detection unit 16 does not detect an acoustic signal, it is assumed that the staff 4 covers the acoustic detection unit 16 with some material and no sound is input to the acoustic detection unit 16. In this case, the abnormality determination unit 25 may determine that the sound detection unit 16 is abnormal when the sound detection unit 16 does not detect an acoustic signal of a predetermined level Th1 or higher before and after the human body detection unit 24 detects the human body.

The timing of the human body detection by the human body detection unit 24 and the timing of the acoustic signal detection may not be the same. That is, if an acoustic signal of a predetermined level Th1 or higher is not detected within a predetermined period before and after including the human body detection time by the human body detection unit 24, it may be determined that the acoustic detection unit 16 is abnormal.

Further, the fraudulent act may include an act of making the voice of the staff 4 indistinguishable by inputting noise to the sound detection unit 16. For example, it is conceivable to continuously hit the sound detection unit 16 to input noise.
In this case, the abnormality determination unit 25 transmits an acoustic signal of a second predetermined level Th2 or higher, which is larger than a predetermined level, while the human body detection unit 24 is detecting the human body during shooting by the camera 12. When it is detected, it is determined that the sound detection unit 16 is abnormal.
The timing of detecting the human body by the human body detecting unit 24 and the timing of detecting the acoustic signal may not be the same. That is, when an acoustic signal of a second predetermined level Th2 or higher is detected within a predetermined period before and after the human body detection time by the human body detection unit 24, it may be determined that the acoustic detection unit 16 is abnormal.

Further, in the abnormality determination unit 25, even if the acoustic detection unit 16 detects an acoustic signal of a predetermined level Th1 or higher during the period when the human body detection unit 24 detects the human body during shooting by the camera 12, the detected acoustic signal is a vowel. If the component is not included, it may be determined that the acoustic detection unit 16 is abnormal. That is, it may be determined whether or not the human voice can be detected by determining whether or not the detected acoustic signal includes a vowel.
For example, by calculating the frequency features of the acoustic signal detected at each predetermined cycle and comparing the vowel features learned based on the voice data collected from a large number of speakers in advance with the calculated frequency features. It may be determined whether or not the acoustic signal contains vowels.
The timing of the human body detection by the human body detection unit 24 and the timing of the detection of the acoustic signal including the vowel component may not be the same. That is, even if the acoustic detection unit 16 detects an acoustic signal of a predetermined level Th1 or higher within a predetermined period before and after including the human body detection time by the human body detection unit 24, if the acoustic signal does not contain a vowel component, the sound is acoustic. It may be determined that the detection unit 16 is abnormal.

(Server device)
See FIG. When the server device 7 receives the ID information of the communication device 2 from the mobile terminal device 5, it determines whether or not the mobile terminal device 5 can take a picture in the living room 1 in which the communication device 2 is installed.
When permitting photography by the mobile terminal device 5 in the living room 1, the server device 7 transmits a photographing permission signal to the mobile terminal device 5.
The server device 7 securely stores the captured image of the camera 12 received from the mobile terminal device 5 and the acoustic signal by the acoustic detection unit 16 in the predetermined storage device 42 as the action record information of the staff 4.

Further, the server device 7 determines whether or not the current time is within the scheduled work period (for example, the long-term care schedule period) of the staff 4 in the living room 1. When the current time is within the scheduled work period of the staff 4 in the living room 1, the server device 7 transmits a shooting stop prohibition signal to the mobile terminal device 5. When the current time is outside the scheduled work period of the staff 4 in the living room 1, the shooting stop prohibition signal is not transmitted to the mobile terminal device 5. As a result, the shooting control unit 22 of the mobile terminal device 5 prohibits the camera 12 from stopping the shooting when the current time is the scheduled work period, and the shooting by the camera 12 when the current time is outside the scheduled work period. Allow suspension.

In this way, in the work outside the scheduled work period such as emergency response, the staff 4 may be able to stop the shooting by himself / herself even if the shooting is started. That is, in such an emergency situation, the employee 4 can determine whether or not to record his / her actions. This makes it possible to prevent people from hesitating to take drastic actions due to being photographed in an emergency, and conversely, if they want to record their own actions, they can decide not to stop shooting. Become.

The server device 7 includes a communication unit 40, a control unit 41, and a storage device 42.
The communication unit 40 is provided with a wired or wireless communication interface, and is a circuit for performing wired communication or wireless communication with the mobile terminal device 5 via the communication line 6.
The control unit 41 may include a processor such as a CPU or MPU for controlling the operation of the server device 7.

The control unit 41 includes a communication processing unit 50, a shooting possibility determination unit 51, a work period collation unit 52, a control signal generation unit 53, and an action recording unit 54. By executing the computer program stored in the storage device 42, the control unit 41 executes the communication processing unit 50, the shooting possibility determination unit 51, the work period collation unit 52, the control signal generation unit 53, and the action recording unit described below. The processing of the part 54 is carried out. That is, the computer program includes an instruction to cause the control unit 41 to perform the processing of the communication processing unit 50, the shooting possibility determination unit 51, the work period collation unit 52, the control signal generation unit 53, and the action recording unit 54.

The storage device 42 may include any of a semiconductor storage device, a magnetic storage device, and an optical storage device. The storage device 42 may include a memory such as a register, a cache memory, a ROM and a RAM used as a main storage device. Resident information 60, schedule information 61, recordability information 62, and action record information 63 are stored in the storage device 42.
The resident information 60 is information about the resident 3 of the living room 1, and is stored in association with the ID information of the communication device 2 installed in the living room 1.
The schedule information 61 is information regarding the scheduled work period of the staff 4 in the living room 1, that is, the nursing care schedule period, and is stored in association with the ID information of the communication device 2 installed in the living room 1.

The recordability information 62 is information regarding whether or not the mobile terminal device 5 can shoot and record in the living room 1, and is stored in association with the ID information of the communication device 2 installed in the living room 1. When the resident 3 of the living room 1 consents to the shooting and recording, the information to the effect that the shooting and recording are permitted is stored as the recordability information 62. If the resident 3 of the living room 1 does not agree to the shooting and recording, the information to the effect that the shooting and recording are prohibited is stored as the recordability information 62.
The action record information 63 is a photographed image of the camera 12 received from the mobile terminal device 5 and an acoustic signal by the acoustic detection unit 16, and is ID information of the communication device 2 installed in the living room 1 and resident information of the resident 3. It is securely stored in association with 60.

The communication processing unit 50 performs communication processing with the mobile terminal device 5 via the communication unit 40. The communication processing unit 50 receives the ID information of the communication device 2 transmitted from the mobile terminal device 5.
When the ID information of the communication device 2 is received, the shooting possibility determination unit 51 determines whether or not to permit shooting and recording by the mobile terminal device 5 in the living room 1 in which the communication device 2 is installed. The shooting possibility determination unit 51 determines whether or not to permit shooting and recording based on the ID information of the communication device 2 and the recording possibility information 62 associated with the ID information.
When permitting photography and recording in the living room 1, the control signal generation unit 53 generates a photography permission signal. The communication processing unit 50 transmits a shooting permission signal to the mobile terminal device 5 via the communication unit 40.

When the ID information of the communication device 2 is received, the work period collation unit 52 determines whether or not the current time is within the scheduled work period of the staff 4 in the living room 1.
When the current time is within the scheduled work period of the staff 4 in the living room 1, the control signal generation unit 53 generates a shooting stop prohibition signal. The communication processing unit 50 transmits a shooting stop prohibition signal to the mobile terminal device 5 via the communication unit 40.
When the current time is outside the scheduled work period of the staff 4 in the living room 1, the control signal generation unit 53 does not generate the shooting stop prohibition signal.
The action recording unit 54 stores the captured image of the camera 12 received from the mobile terminal device 5 and the acoustic signal by the sound detection unit 16 in the storage device 42 as the action recording information 63 of the staff 4.

(motion)
Next, the operation of the action recording system will be described. See FIG. The operation shown in FIG. 6 is repeatedly executed at a predetermined cycle (for example, 0.1 second).
In step S1, the room entry determination unit 21 of the mobile terminal device 5 determines whether or not a beacon signal has been received from the communication device 2. When the beacon signal is received (step S1: Y), the communication processing unit 20 transmits the ID information of the communication device 2 included in the beacon signal to the server device 7. After that, the process proceeds to step S2. When the beacon signal is not received (step S1: N), the process proceeds to step S11.

Upon receiving the shooting permission signal transmitted from the server device 7 in response to the ID information, the shooting control unit 22 determines in step S2 whether or not shooting is being performed by the camera 12. When shooting is in progress (step S2: Y), the process proceeds to step S6. If shooting is not in progress (step S2: N), the process proceeds to step S3.
In step S3, the shooting control unit 22 starts shooting with the camera 12. After that, the process proceeds to step S4.

In step S4, the work period collation unit 52 of the server device 7 determines whether or not the current time is within the care schedule period of the staff 4 in the living room 1. When the current time is within the care schedule period (step S4: Y), the control signal generation unit 53 generates a shooting stop prohibition signal. The mobile terminal device 5 receives the shooting stop prohibition signal. After that, the process proceeds to step S5. If the current time is outside the care schedule period (step S4: N), the process proceeds to step S6.
Upon receiving the shooting stop prohibition signal, the shooting control unit 22 sets the shooting stop prohibition by the camera 12 in step S5. After that, the process proceeds to step S6.

In step S6, the abnormality determination unit 25 executes the mounting state determination process. In the mounting state determination process, the abnormality determination unit 25 determines the mounting state of the mobile terminal device 5 on the staff 4.
When the mounting state is normal (step S7: Y), the process proceeds to step S8. If the mounting state is not abnormal (step S7: N), the process proceeds to step S10.

In step S8, the abnormality determination unit 25 executes the sound detection state determination process. In the sound detection state determination process, the abnormality determination unit 25 determines whether or not the sound detection unit 16 is abnormal.
When the sound detection unit 16 is abnormal (step S9: Y), the process proceeds to step S10. The process ends when the sound detection unit 16 is not abnormal (step S9: N).
In step S10, the abnormality determination unit 25 transmits the wearing state of the mobile terminal device 5 or the abnormality of the sound detection unit 16 to the server device 7. After that, the process ends.

In step S11, the shooting control unit 22 determines whether or not shooting is being performed by the camera 12. When shooting is in progress (step S11: Y), the process proceeds to step S12. The process ends when shooting is not in progress (step S11: N).
In step S12, the photographing control unit 22 stops photographing by the camera 12.
In step S13, the shooting control unit 22 releases the prohibition of stopping shooting by the camera 12. After that, the process ends.

The mounting state determination process will be described with reference to FIG. 7.
In step S20, the abnormality determination unit 25 determines whether or not the human body detection unit 24 has detected the human body captured in the captured image. When the human body is detected (step S20: Y), the process proceeds to step S23. If the human body is not detected (step S20: N), the process proceeds to step S21.

In step S21, the abnormality determination unit 25 determines whether or not the value of the counter that measures the period during which the human body is not detected exceeds a predetermined value, that is, whether or not the predetermined period has elapsed without detecting the human body. When the predetermined period has elapsed (step S21: Y), the process proceeds to step S22. If the predetermined period does not elapse (step S21: N), the process proceeds to step S24.

In step S22, the abnormality determination unit 25 determines that the wearing state of the mobile terminal device 5 is abnormal. After that, the mounting state determination process ends.
In step S23, the abnormality determination unit 25 resets the counter that measures the period during which the human body is not detected. After that, the process proceeds to step S24.
In step S24, the abnormality determination unit 25 determines that the wearing state of the mobile terminal device 5 is normal. After that, the mounting state determination process ends.

The sound detection state determination process will be described with reference to FIG.
In step S30, the abnormality determination unit 25 determines whether or not the human body detection unit 24 has detected the human body captured in the captured image within a predetermined period including before and after the current time. When the human body is detected (step S30: Y), the process proceeds to step S31. When the human body is not detected (step S30: N), the acoustic detection state determination process ends.

In step S31, the abnormality determination unit 25 determines whether or not the acoustic level of the acoustic signal detected during the period including before and after the human body detection time by the human body detection unit 24 is less than the predetermined level Th1. That is, it is determined whether or not an acoustic signal of a predetermined level Th1 or higher is detected. When the sound level is less than Th1 (step S31: Y), the process proceeds to step S35. If the acoustic level is not less than Th1 (step S31: N), the process proceeds to step S32.

In step S32, the abnormality determination unit 25 determines whether or not the acoustic level of the acoustic signal detected during the period including before and after the human body detection time by the human body detection unit 24 is the second predetermined level Th2 or higher. When the sound level is equal to or higher than the second predetermined level Th2 (step S32: Y), the process proceeds to step S35. When the sound level is not equal to or higher than the second predetermined level Th2 (step S32: N), the process proceeds to step S33.

In step S33, the abnormality determination unit 25 determines whether or not the detected acoustic signal contains a vowel component. When the acoustic signal contains a vowel component (step S33: Y), the process proceeds to step S34. When the acoustic signal does not contain a vowel component (step S33: N), the process proceeds to step S35.
In step S34, the abnormality determination unit 25 determines that the sound detection unit 16 is not abnormal. After that, the sound detection state determination process ends.
In step S35, the abnormality determination unit 25 determines that the sound detection unit 16 is abnormal. After that, the sound detection state determination process ends.

(Effect of embodiment)
(1) The action recording system includes a communication device 2 installed in a living room 1 which is a predetermined area, and a mobile terminal device 5 which can be attached to a staff member 4.
The mobile terminal device 5 is based on communication between a camera 12 that photographs the surroundings of the mobile terminal device 5, a first communication unit 13 that communicates with the communication device 2, and communication between the first communication unit 13 and the communication device 2. A shooting control unit 22 for prohibiting stopping of shooting by the camera 12 is provided.

As a result, the privacy of the resident 3 is protected by monitoring only the period during which the staff 4 is in the room 1, and the assault of the staff 4 against the resident 3 by recording the actions of the staff 4. Can be prevented. Furthermore, in the unlikely event of an accident, the innocence of the staff 4 can be proved.
Further, since the image of the resident 3 is taken by the mobile terminal device 5 attached to the staff 4, the resident 3 supported by the staff 4 enters the blind spot of the camera unlike the fixed surveillance camera. Hateful. Therefore, it is possible to prevent violent acts in the blind spot of the camera.
Furthermore, by prohibiting the staff 4 from stopping the shooting in the living room 1, the action record of the staff 4 is illegally interrupted, and the staff 4 is prevented from assaulting the resident 3 during that time. Can be done.

(2) The shooting control unit 22 starts shooting with the camera 12 when the first communication unit 13 can communicate with the communication device 2, and shoots with the camera 12 when the first communication unit 13 cannot communicate with the communication device 2. You may stop.
As a result, since the shooting can be automatically started when the staff 4 enters the living room 1, it is possible to prevent the behavior record of the staff 4 from being leaked due to forgetting to shoot. Further, since the shooting is automatically stopped when the staff 4 leaves the room 1, it is possible to avoid the privacy invasion of the staff 4 due to the recording of the behavior of the staff 4 outside the working hours.

(3) The action recording system is an alarm control unit that generates an alarm when shooting by the camera 12 continues even after a predetermined time has elapsed since the first communication unit 13 cannot communicate with the communication device 2. 23 may be provided.
As a result, it is possible to avoid invasion of the privacy of the staff 4 due to the behavior of the staff 4 outside the work period being recorded due to a failure of the photographing control unit 22 or the camera 12.

(4) The action recording system may include a storage device 42 that stores a scheduled work period in the living room 1. The shooting control unit 22 prohibits the stop of shooting by the camera 12 when the current time is the scheduled work period in the living room 1, and stops the shooting by the camera 12 when the current time is outside the scheduled work period in the living room 1. You may allow it.
As a result, in the work outside the scheduled work period such as emergency response, the staff 4 can stop the shooting by himself / herself even if the shooting is started. For this reason, for example, it is possible to prevent hesitation in taking drastic actions due to being photographed in an emergency situation, and conversely, if you want to record your own actions, you can decide not to stop shooting. Become.

(5) The action recording system includes a communication device 2 installed in a living room 1 which is a predetermined area, and a mobile terminal device 5 which can be attached to a staff member 4.
The mobile terminal device 5 is based on communication between a camera 12 that photographs the surroundings of the mobile terminal device 5, a first communication unit 13 that communicates with the communication device 2, and communication between the first communication unit 13 and the communication device 2. A mobile terminal device based on a shooting control unit 22 that controls shooting by the camera 12, a human body detection unit 24 that detects a human body captured in an image shot by the camera 12, and a detection result by the human body detection unit 24 during shooting by the camera 12. An abnormality determination unit 25 for determining an abnormality in the wearing state of 5 is provided.

As a result, even though the staff 4 is in the room 1, the staff 4 does not see the resident 3 at all (that is, the staff 4 does not face the resident 3 at all). The natural state can be detected to determine the wearing state of the mobile terminal device 5. Therefore, it is possible to prevent the staff 4 from not wearing the mobile terminal device 5 normally and interfering with the action record of the staff 4.

(6) The abnormality determination unit 25 may determine an abnormality in the wearing state of the mobile terminal device 5 according to the length of the period during which the human body detection unit 24 does not continuously detect the human body during shooting by the camera 12. By making a determination according to the detection period in this way, it is possible to prevent erroneous detection of an abnormality in the wearing state due to the temporary absence of the human body in the captured image.
(7) The abnormality determination unit 25 may determine an abnormality in the wearing state of the portable terminal device 5 according to the frequency of detection of the human body by the human body detection unit 24 during shooting by the camera 12. By making a determination according to the detection frequency in this way, it is possible to prevent erroneous detection of an abnormality in the wearing state due to the temporary absence of the human body in the captured image.

(8) The human body detection unit 24 may detect the human body based on the detection result of the human face captured in the image captured by the camera 12. By detecting the face, which is a characteristic part of the human body, the human body can be detected with high accuracy.
(9) The human body detection unit 24 may detect the human body based on the detection result of a predetermined marker captured in the image captured by the camera 12. By detecting an object other than the human face, for example, even if the image of the human face portion is subjected to mosaic processing for privacy protection, the human body can be detected with high accuracy.

(10) Even if the human body detection unit 24 detects the human body, the abnormality determination unit 25 abnormally attaches the mobile terminal device 5 when the change between the captured images taken by the camera 12 at different times is less than or equal to a predetermined amount. It may be determined that.
As a result, the employee 4 who knows the attachment determination logic of the mobile terminal device 5 by detecting the human body places the mobile terminal device 5 at a position where the face of the resident 3 can be seen, and the mobile terminal device 5 is attached to the employee 4. It is possible to prevent a plan so that an abnormality cannot be detected without it.

(11) The action recording system includes a communication device 2 installed in a living room 1 which is a predetermined area, and a mobile terminal device 5 which can be attached to a staff member 4.
The mobile terminal device 5 communicates with a camera 12 that photographs the surroundings of the mobile terminal device 5, an acoustic detection unit 16 that detects an acoustic signal, a first communication unit 13 that communicates with the communication device 2, and a first communication unit 13. A shooting control unit 22 that controls shooting by the camera 12 and sound detection by the sound detection unit 16 based on communication with the device 2, and a human body detection unit 24 that detects the human body captured in the image shot by the camera 12. If the sound detection unit 16 does not detect an acoustic signal of a predetermined level Th1 or higher during a predetermined period including before and after the human body detection unit 24 detects the human body during shooting by the camera 12, it is determined that the sound detection unit 16 is abnormal. The abnormality determination unit 25 is provided.

As a result, while leaving a record of normal nursing care in the image taken by the camera 12, the staff 4 makes a statement that abuses the resident 3 and prevents the staff 4 from interfering with the recording of the acoustic signal at that time. be able to.

(12) The abnormality determination unit 25 detects an acoustic signal of a second predetermined level Th2 or higher, which is larger than the predetermined level Th1, during a predetermined period including before and after the human body detection unit 24 detects the human body during shooting by the camera 12. When 16 is detected, it may be determined that the acoustic detection unit 16 is abnormal.
As a result, it is possible to prevent the act of making the voice of the staff 4 indistinguishable by inputting noise into the sound detection unit 16.

(13) Even if the acoustic detection unit 16 detects an acoustic signal of a predetermined level Th1 or higher during a predetermined period including before and after the human body detection unit 24 detects the human body during shooting by the camera 12, the abnormality determination unit 25 still produces sound. When the signal does not contain a vowel component, it may be determined that the sound detection unit 16 is abnormal.
As a result, the abnormality of the acoustic detection unit 16 can be detected with high accuracy.

(Modification example)
(1) The communication device 2 may be an IC tag. The IC tag may be provided in the mobile terminal device 5. For example, the action recording system may be linked with an entry / exit management system that performs authentication at the time of entry and exit management by holding the mobile terminal device 5 over an IC tag or reader installed on a wall surface inside or outside the living room 1. For example, if the authentication is successful, entry may be permitted, shooting by the camera 12 may be permitted, and suspension of shooting may be prohibited. Alternatively, the camera 12 may stop shooting by holding the mobile terminal device 5 over the IC tag or reader when leaving the room.

(2) The ID information of the communication device 2, the resident information 60, the schedule information 61, and the recordability information 62 are downloaded to the storage device 18 of the mobile terminal device 5, and the photographing control unit 22 of the mobile terminal device 5 is a server device. Regardless of the permission or prohibition signal from 7, the entry determination unit 21 permits or prohibits photography of the camera 12 in the living room 1 with reference to the recordability information 62 stored in the storage device 18, and stops photography when leaving the room. You may cancel it.
Further, the photographing control unit 22 may determine whether or not the current time is within the scheduled work period of the staff 4 in the living room 1 by referring to the schedule information 61 stored in the storage device 18. The shooting control unit 22 prohibits the stop of shooting by the camera 12 when the current time is the scheduled work period in the living room 1, and stops the shooting by the camera 12 when the current time is outside the scheduled work period in the living room 1. You may allow it.

1 ... living room, 2 ... communication device, 3 ... resident, 4 ... staff, 5 ... mobile terminal device, 6 ... communication line, 7 ... server device, 10 ... operation unit, 11 ... display unit, 12 ... camera, 13 ... 1st communication unit, 14 ... 2nd communication unit, 15 ... alarm output unit, 16 ... sound detection unit, 17 ... control unit, 18 ... storage device, 20 ... communication processing unit, 21 ... room entry determination unit, 22 ... shooting control Unit, 23 ... Alarm control unit, 24 ... Human body detection unit, 25 ... Abnormality determination unit, 40 ... Communication unit, 41 ... Control unit, 42 ... Storage device, 50 ... Communication processing unit, 51 ... Shooting availability determination unit, 52 ... Work period collation unit, 53 ... control signal generation unit, 54 ... action recording unit, 60 ... resident information, 61 ... schedule information, 62 ... recordability information, 63 ... action record information

Claims (6)

An action recording system including a communication device installed in a predetermined area and a terminal device that can be worn by a person.
The terminal device is
An imaging unit that photographs the surroundings of the terminal device,
A communication unit that communicates with the communication device,
A shooting control unit that prohibits the shooting from being stopped by the shooting unit based on the communication between the communication unit and the communication device.
An action recording system characterized by being equipped with. The shooting control unit starts shooting by the shooting unit when the communication unit can communicate with the communication device, and stops shooting by the shooting unit when the communication unit cannot communicate with the communication device. The action recording system according to claim 1. The even communication unit has passed the said communication device whether it can no longer communicate et plants constant time, when the imaging by the imaging section is continued, characterized in that it comprises an alarm control unit for generating an alarm The action recording system according to claim 2. A storage device for storing the scheduled work period in the predetermined area is provided.
The shooting control unit prohibits the shooting from being stopped by the shooting unit when the current time is the scheduled work period in the predetermined area, and is performed by the shooting unit when the current time is outside the scheduled work period in the predetermined area. The action recording system according to any one of claims 1 to 3, wherein the stop of shooting is permitted. A terminal device that can be worn by people
An imaging unit that photographs the surroundings of the terminal device,
A communication unit that communicates with a communication device installed in a predetermined area,
A shooting control unit that prohibits the stop of shooting by the shooting unit based on communication between the communication unit and the communication device.
A terminal device characterized by comprising. Communicate between the terminal device worn by the worker and the communication device installed in the predetermined area,
The surroundings of the worker are photographed by the photographing unit included in the terminal device.
An action recording method characterized in that the stop of shooting by the shooting unit is prohibited based on the communication between the terminal device and the communication device.

Images