JP2021179723A - Monitoring system, monitoring device, monitoring method, and program - Google Patents

Abstract

To provide a monitoring system, a monitoring device, a monitoring method, and a program that can contribute to the safety of an object to be monitored.SOLUTION: A monitoring system 1 comprises: an imaging unit 20 that picks up an image of an object to be monitored T; an extraction unit 11 that extracts the movement of feature points of the object to be monitored from the image picked up by the imaging unit; a controller 15 that outputs a predetermined warning signal when, in the movement of the feature points of the object to be monitored extracted by the extraction unit, a motion consisting of a first motion in which the object to be monitored pulls the legs backward, a second motion in which the object to be monitored takes a forward-tilted posture, and a third motion in which the object to be monitored extends the hands forward is not completed after the lapse of one second from the start of the first motion; and a warning unit 17 that issues a predetermined warning based on the predetermined warning signal output from the controller.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to monitoring systems, monitoring devices, monitoring methods, and programs.

For example, in a field such as a long-term care facility, a device for monitoring the behavior of a monitored person such as a nurse or a care recipient has been proposed. For example, Patent Document 1 discloses a monitored person monitoring system that detects a predetermined behavior in a monitored person based on an image obtained by an image pickup device. Patent Document 2 discloses a fall prevention system that prevents a subject from falling while walking by attaching a detection device to the foot of the subject. Further, Patent Document 3 discloses a monitoring support device for determining the body position of a human body by detecting a temperature distribution. Cited Document 4 also discloses a medical system for monitoring elderly psychiatric patients at home or in elderly housing with care or long-term care facilities.

Japanese Unexamined Patent Publication No. 2017-91552 Japanese Unexamined Patent Publication No. 2017-221502 Japanese Unexamined Patent Publication No. 2014-106636 Japanese Patent Application Laid-Open No. 2003-91790

It would be beneficial if the monitored object could be safely monitored by monitoring it.

An object of the present disclosure is to provide a monitoring system, a monitoring device, a monitoring method, and a program that can be safely provided to a monitored object.

The monitoring system according to one embodiment is
An imaging unit that captures the monitored object and
An extraction unit that extracts the movement of the feature point of the monitored object from the image captured by the imaging unit, and an extraction unit.
In the movement of the feature points of the monitored object extracted by the extraction unit,
The first movement in which the monitored object pulls its foot backward,
The second movement in which the monitored object takes a forward leaning posture,
The third action in which the monitored object puts his hand forward,
When the operation consisting of the above is not completed within 1 second from the start of the first operation, a controller that outputs a predetermined warning signal and a controller.
A warning unit that issues a predetermined warning based on the predetermined warning signal output from the controller.
To prepare for.

In addition, the monitoring system according to one embodiment is
An imaging unit that captures the monitored object and
An extraction unit that extracts the movement of the feature point of the monitored object from the image captured by the imaging unit, and an extraction unit.
In the movement of the feature points of the monitored object extracted by the extraction unit,
The first movement in which the monitored object pulls its foot backward,
The second movement in which the monitored object takes a forward leaning posture,
The third action in which the monitored object puts his hand forward,
A controller that outputs a predetermined warning signal when at least one of the first operation to the third operation is not completed at least one second after the start of any of the above.
A warning unit that issues a predetermined warning based on the predetermined warning signal output from the controller.
To prepare for.

The monitoring device according to one embodiment is
An extraction unit that extracts the movement of the feature points of the monitored object from the image of the monitored object, and
In the movement of the feature points of the monitored object extracted by the extraction unit,
The first movement in which the monitored object pulls its foot backward,
The second movement in which the monitored object takes a forward leaning posture,
The third action in which the monitored object puts his hand forward,
When the operation consisting of the above is not completed within 1 second from the start of the first operation, a controller that outputs a predetermined warning signal and a controller.
To prepare for.

The monitoring method according to one embodiment is
A step of extracting the movement of the feature point of the monitored object from the image of the monitored object, and
In the movement of the feature points of the monitored object extracted by the extraction unit,
The first movement in which the monitored object pulls its foot backward,
The second movement in which the monitored object takes a forward leaning posture,
The third action in which the monitored object puts his hand forward,
A step of determining whether or not the operation consisting of the above is completed at the time when one second has elapsed from the start of the first operation, and
In the determination step, if the operation consisting of the first operation to the third operation is not completed within 1 second from the start of the first operation, a step of outputting a predetermined warning signal and a step of outputting a predetermined warning signal.
including.

The program according to one embodiment is
On the computer
A step of extracting the movement of the feature point of the monitored object from the image of the monitored object, and
In the movement of the feature points of the monitored object extracted by the extraction unit,
The first movement in which the monitored object pulls its foot backward,
The second movement in which the monitored object takes a forward leaning posture,
The third action in which the monitored object puts his hand forward,
A step of determining whether or not the operation consisting of the above is completed at the time when one second has elapsed from the start of the first operation, and
In the determination step, if the operation consisting of the first operation to the third operation is not completed within 1 second from the start of the first operation, a step of outputting a predetermined warning signal and a step of outputting a predetermined warning signal.
To execute.

According to one embodiment, it is possible to provide a monitoring system, a monitoring device, a monitoring method, and a program that can be safely provided to the monitored object.

It is a functional block diagram which shows the schematic structure of the monitoring system which concerns on one Embodiment. It is a flowchart which shows an example of the operation of the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment. It is a figure explaining the example of the feature point extracted in the monitoring system which concerns on one Embodiment.

In the present disclosure, the "monitoring device" may be a device driven by electric power. Further, the "monitoring system" may include a device driven by electric power. Further, the "user" may be a person (typically a human being) who uses the monitoring system and / or the monitoring device according to the embodiment. The user may include a person who monitors the monitored object by using the monitoring system and / or the monitoring device according to the embodiment. Further, the “monitored target” may be a person (for example, a human or an animal) to be monitored by the monitoring system and / or the monitoring device according to the embodiment.

The scene in which the monitoring system according to one embodiment is used is assumed to be specified by a person engaged in social activities such as a company, a hospital, an elderly home, a school, a sports gym, and a long-term care facility. It may be a facility of. For example, in the case of a company, it is extremely important to understand and / or manage the health status of employees. Similarly, it is extremely important to understand and / or manage the health status of patients and medical staff in hospitals, and residents and staff in nursing homes. The scene in which the monitoring system according to the embodiment is used is not limited to the above-mentioned facilities such as companies, hospitals, and elderly housings, and any of the above-mentioned facilities for which it is desired to grasp and / or manage the health condition of the monitored object. Good as a facility. Any facility may also include non-commercial facilities, such as the user's home. Further, the scene in which the monitoring system according to the embodiment is used may be, for example, a moving body such as a train, a bus, or an airplane, a station, a platform, or the like.

The monitoring system according to one embodiment may be used for monitoring the behavior of a monitored object such as a nurse requiring nursing care or a person requiring nursing care in a nursing care facility or the like. The monitoring system according to one embodiment can monitor the rising motion of a monitored object such as a nurse or a care recipient. Here, the rising motion of the monitored object may be, for example, an motion of standing up from a state in which the monitored person is sitting or lying down.

In particular, the monitoring system according to one embodiment may issue a predetermined warning before a monitored person such as a nurse or a care recipient performs a stand-up operation, for example, before completing the stand-up operation. can. Therefore, according to the monitoring system according to one embodiment, the staff of a nursing care facility, for example, will perform the standing-up operation before the monitored person such as a nurse or a person requiring nursing care completes the standing-up operation. You can understand what you are doing.

In addition, the monitoring system according to the embodiment issues a predetermined warning before a monitored person such as a nurse or a care recipient performs a dangerous standing-up operation, for example, before completing a dangerous standing-up operation. You can also do it. Further, the monitoring system according to the embodiment can also issue a predetermined warning before the specific monitored person performs the stand-up operation, for example, before the stand-up operation is completed.

Hereinafter, the monitoring system according to the embodiment will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing a schematic configuration of a monitoring system according to an embodiment. As shown in FIG. 1, the monitoring system 1 according to the embodiment may be configured to include a monitoring device 10 and an imaging unit 20. The monitoring device 10 and the imaging unit 20 may be connected by wire or wireless, or a combination of wired and wireless. The monitoring system 1 according to the embodiment may not include a part of the functional unit shown in FIG. 1, or may include a functional unit other than that shown in FIG. For example, the monitoring system 1 according to the embodiment may not include at least one of the warning unit 17 and the communication unit 19.

The image pickup unit 20 shown in FIG. 1 may include an image sensor that electronically captures an image, such as a digital camera. The image pickup unit 20 may be configured to include an image pickup element that performs photoelectric conversion, such as a CCD (Charge Coupled Device Image Sensor) or a CMOS (Complementary Metal Oxide Semiconductor) sensor. The image pickup unit 20 may take an image of the monitored target T, for example, as shown in FIG. Here, the monitored target T may be, for example, a human being. The image pickup unit 20 may convert the captured image into a signal and transmit it to the monitoring device 10. For example, the image pickup unit 20 may transmit a signal based on the captured image to the extraction unit 11, the storage unit 13, and / or the controller 15 of the monitoring device 10. The image pickup unit 20 is not limited to an image pickup device such as a digital camera as long as it captures the monitored target T, and may be any device.

In one embodiment, the image pickup unit 20 may take an image of the monitored target T, for example, as a still image at predetermined time intervals (for example, every 0.5 seconds). Further, in one embodiment, the imaging unit 20 may image, for example, the monitored target T as a continuous moving image.

As shown in FIG. 1, the monitoring device 10 according to the embodiment may include an extraction unit 11, a storage unit 13, a controller 15, a warning unit 17, and a communication unit 19. The monitoring device 10 according to the embodiment may not include a part of the functional unit shown in FIG. 1, or may include a functional unit other than that shown in FIG.

The extraction unit 11 may have a function of extracting a predetermined feature point from the image captured by the image pickup unit 20. For example, the extraction unit 11 may extract the movement of the feature point of the monitored target T from the image of the monitored target T captured by the imaging unit 20. Here, the feature points will be further described later. In one embodiment, the extraction unit 11 obtains the movement of each part such as the head, trunk, limbs, and / or joints of the monitored object T from the image of the monitored object T captured by the imaging unit 20. It may be extracted. The extraction unit 11 may be configured as dedicated hardware, may be configured to include software at least in part, or may be configured entirely by software. In this way, the extraction unit 11 may extract the movement of the feature point of the monitored target T from the image captured by the image pickup unit 20.

The storage unit 13 may have a function as a memory for storing various types of information. The storage unit 13 may store, for example, a program executed by the controller 15, the result of processing executed by the controller 15, and the like. Further, the storage unit 13 may function as a work memory of the controller 15. The storage unit 13 can be configured by, for example, a semiconductor memory or the like, but is not limited to this, and can be any storage device. For example, the storage unit 13 may be a storage medium such as a memory card inserted in the monitoring device 10 according to the embodiment. Further, the storage unit 13 may be the internal memory of the CPU used as the controller 15 described later, or may be connected to the controller 15 as a separate body.

In particular, in one embodiment, the storage unit 13 may store various algorithms and the like for the controller 15 to perform a determination process on the movement of the feature points when the monitored target T starts up and operates. Various algorithms for the controller 15 to perform the determination process will be further described later.

The controller 15 controls and / or manages the entire monitoring device 10 including each functional unit constituting the monitoring device 10. The controller 15 may include at least one processor, such as a CPU (Central Processing Unit), to provide control and processing power to perform various functions. The controller 15 may be realized collectively by one processor, by several processors, or by individual processors. The processor may be realized as a single integrated circuit. The integrated circuit is also referred to as an IC (Integrated Circuit). The processor may be realized as a plurality of communicably connected integrated circuits and discrete circuits. The processor may be implemented on the basis of various other known techniques.

In one embodiment, the controller 15 may be configured as, for example, a CPU and a program executed by the CPU. The program executed by the controller 15, the result of the process executed by the controller 15, and the like may be stored in, for example, the storage unit 13. The controller 15 may appropriately include a memory necessary for the operation of the controller 15. The operation of the controller 15 of the monitoring device 10 according to the embodiment will be further described later.

The warning unit 17 may issue a predetermined warning to call attention to the user of the monitoring system 1 or the monitoring device 10 based on the predetermined warning signal output from the controller 15. As a predetermined warning, the warning unit 17 may be any functional unit that stimulates at least one of the user's auditory sense, visual sense, and tactile sense, such as sound, voice, light, characters, video, and vibration. Specifically, the warning unit 17 may be at least one of, for example, an audio output unit such as a buzzer or a speaker, a light emitting unit such as an LED, a display unit such as an LCD, and a tactile presentation unit such as a vibrator. .. In this way, the warning unit 17 may issue a predetermined warning based on the predetermined warning signal output from the controller 15. In one embodiment, the warning unit 17 may issue a predetermined alarm as information acting on at least one of auditory, visual, and tactile sensations.

In one embodiment, the warning unit 17 may issue a warning that the monitored target T starts up, for example, before the monitored target T starts up. Further, in one embodiment, the warning unit 17 may issue a warning that the monitored target T performs a dangerous rising operation, for example, before the monitored target T performs a dangerous rising operation. Further, in one embodiment, the warning unit 17 may issue a warning that, for example, a specific person stands up. For example, in one embodiment, the warning unit 17 that outputs visual information may warn the user by emitting light or a predetermined display when it is detected that the monitored target T starts up. Further, in one embodiment, the warning unit 17 that outputs auditory information may warn the user by a predetermined sound or voice when it is detected that the monitored target T starts up and operates. In the present embodiment, the warning may be a combination of light emission or a predetermined display, and a predetermined sound or voice.

The monitoring device 10 shown in FIG. 1 has a built-in warning unit 17. However, in one embodiment, in the monitoring system 1, the warning unit 17 may be provided outside the monitoring device 10. In this case, the warning unit 17 and the monitoring device 10 may be connected by wire or wireless, or a combination of wired and wireless.

The communication unit 19 has an interface function for communicating by wire or wirelessly. The communication method performed by the communication unit 19 of one embodiment may be a wireless communication standard. For example, wireless communication standards include communication standards for cellular phones such as 2G, 3G, 4G, and 5G. For example, the communication standards for cellular phones are LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), CDMA2000, PDC (Personal Digital Cellular), GSM (Registered Trademark) (Global System for Mobile communications), and PHS. (Personal Handy-phone System) etc. are included. For example, wireless communication standards include WiMAX (Worldwide Interoperability for Microwave Access), 802.11, WiFi, Bluetooth®, Infrared Data Association (IrDA), NFC (Near Field Communication) and the like. The communication unit 19 can support one or more of the above communication standards. The communication unit 19 may be configured to include, for example, an antenna for transmitting and receiving radio waves, an appropriate RF unit, and the like. Further, the communication unit 19 may be configured as an interface such as a connector for making a wired connection to the outside. Since the communication unit 19 can be configured by a known technique for performing wireless communication, a more detailed description of the hardware will be omitted.

Various types of information received by the communication unit 19 may be supplied to, for example, the storage unit 13 and / or the controller 15. Various information received by the communication unit 19 may be stored in, for example, a memory built in the storage unit 13 and / or the controller 15. Further, the communication unit 19 may transmit, for example, the processing result by the controller 15, the extraction result by the extraction unit 11, and / or the information stored in the storage unit 13 to the outside.

As shown in FIG. 1, at least a part of each functional unit constituting the monitoring device 10 according to the embodiment may be configured by a specific means in which software and hardware resources cooperate.

Next, the operation of the monitoring system 1 according to the embodiment will be described.

FIG. 2 is a flowchart showing an example of the operation of the monitoring system 1 according to the embodiment. The operation shown in FIG. 2 may be started when monitoring the rising operation of the monitored target T, for example, in a hospital or a nursing care facility. For example, in a long-term care facility or a hospital, there may be a person such as an elderly person or an injured person who has a weak leg and has a high risk of falling if he / she tries to stand up by himself / herself. In addition, for example, a patient who develops dementia may wander or go missing if he / she stands up by himself / herself. By monitoring such a monitored target T by the monitoring system 1, for example, a staff member of a nursing care facility or a hospital actually starts up the monitored target T to indicate that the monitored target T is about to stand up by itself. Can be recognized before doing.

When the operation shown in FIG. 2 starts, the image pickup unit 20 takes an image of the monitored target T in the monitoring system 1 according to the embodiment (step S1). In step S1, the image pickup unit 20 may capture an image of the monitored target T. In step S1, the imaging unit 20 may start imaging of the monitored target T at this point, or may continue imaging of the monitored target T that has already started. Further, in step S1, the imaging unit 20 may capture the monitored target T as a still image, for example, at predetermined time intervals (for example, every 0.5 seconds). Further, in step S1, the imaging unit 20 may image, for example, the monitored target T as a continuous moving image. The image of the monitored object T captured by the imaging unit 20 in step S1 is supplied to the extraction unit 11 of the monitoring device 10. Further, the image pickup unit 20 may take an image of the monitored object T, for example, in combination with a still image and a continuous moving image at predetermined time intervals (for example, every 0.5 seconds). In this embodiment, the amount of image data may be reduced by shifting from the moving image imaging mode to the still image mode. In the present embodiment, when the operation of the monitored target T is small, for example, at night, the image data capacity may be reduced by shifting from the moving image imaging mode to the still image mode.

When the monitored target T is imaged in step S1, the extraction unit 11 of the monitoring device 10 extracts the movement of the feature point of the monitored target T from the image captured by the imaging unit 20 (step S2).

3A and 3B are diagrams schematically showing an example of the feature points of the monitored object T extracted by the extraction unit 11 based on the image of the monitored object T captured by the imaging unit 20. FIG. 3 schematically shows an example of feature points extracted from an image of the monitored target T sitting on the chair C1 from the left side.

In one embodiment, the feature points of the monitored target T extracted by the extraction unit 11 may be the following feature points, for example, as shown in FIGS. 3 and later.
The feature point P1 may be, for example, the head of the monitored target T.
The feature point P2 may be a connection portion between the head and the neck of the monitored target T, for example.
The feature point P3 may be a connection portion between the neck and the trunk of the monitored target T, for example.
The feature point P4 may be a connection portion between the trunk and the leg of the monitored target T, for example.
The feature point P5 may be, for example, a shoulder of the monitored target T.
The feature point P6 may be, for example, an elbow of the monitored target T.
The feature point P7 may be, for example, a hand of the monitored target T.
The feature point P8 may be, for example, the knee of the monitored target T.
The feature point P9 may be, for example, a foot of the monitored target T.

Returning to the description of FIG. 2, in step S2, the extraction unit 11 may extract feature points by using an existing technique such as image recognition. Further, in step S2, the extraction unit 11 may extract feature points by using a technique based on, for example, AI.

In step S2, the extraction unit 11 may extract the movement of the feature point from a plurality of continuous still images of the monitored target T imaged by the image pickup unit 20. Further, in step S2, the extraction unit 11 may extract the movement of the feature point from the moving image of the monitored target T imaged by the image pickup unit 20.

When the movement of the feature point is extracted in step S2, the controller 15 of the monitoring device 10 determines whether or not the movement of the extracted feature point satisfies a predetermined condition (step S3 and step S4). At the time of this determination, the controller 15 may read out an algorithm for performing determination processing on the movement of the feature point. In step S3 and step S4, the controller 15 may read the algorithm from the storage unit 13. Further, when the necessary algorithm is not stored in the storage unit 13, the controller 15 may acquire the necessary algorithm from, for example, an external server. In this case, the controller 15 may receive the required algorithm via the communication unit 19. The algorithm received in this way may be stored in, for example, the internal memory of the storage unit 13 or the controller 15. Hereinafter, the algorithm for the controller 15 to perform the determination process will be further described.

As described above, the monitoring device 10 according to the embodiment determines that the monitored target T makes a rising operation before the monitored target T makes a rising operation based on the movement of the feature points of the monitored target T. You can do it. In the present embodiment, the time before the monitored target T starts up may be, for example, before the start-up operation is completed. Therefore, in the monitoring device 10 according to the embodiment, the controller 15 may monitor the movement of the feature points extracted from the captured image of the monitored object T. Specifically, the controller 15 may monitor the positions of the plurality of feature points extracted from the image of the monitored target T at predetermined timings. Further, the controller 15 may monitor the timing at which the plurality of feature points extracted from the image of the monitored target T arrive at a predetermined position.

In one embodiment, an algorithm that performs a predetermined determination process by comparing with the movement of feature points extracted from the image of the monitored target T may be used. Here, in one embodiment, an algorithm based on the result of sampling in advance the movement of the feature points when the monitored target T starts up may be used. For example, the algorithm may be data based on the movement of feature points extracted from the rising motion actually performed by the monitored target T so far. In particular, the algorithm may be, for example, data based on the movement of feature points extracted from successful examples of the rising operation actually performed by the monitored target T so far. Such an algorithm may be, for example, data based on the movement of feature points when the monitored target T makes a plurality of rising operations. By comparing such an algorithm with the movement of the feature points extracted by the extraction unit 11, the controller 15 can determine whether or not the monitored target T performs a rising operation.

As will be described later, the rising motion performed by the monitored target T includes at least one partial motion in a series of motions from the sitting state to the completion of the standing motion. Therefore, if it can be determined that at least a part of at least one or more partial movements included in the series of movements from the sitting state to standing up has been performed, the monitored target T makes a standing up movement or is a monitored target. It can be estimated that T is about to start up. Such an estimation can be performed before the monitored target T starts up and completes the operation. Therefore, according to the monitoring device 10 according to the embodiment, it is possible to detect that the monitored target T performs the rising operation and issue a predetermined warning before the monitored target T completes the rising operation. .. That is, the monitoring device 10 can issue a predetermined warning before the monitored target T starts up and operates by the determination process using the algorithm.

Further, for example, the above-mentioned algorithm is not limited to the data based on the movement of the feature points extracted from the successful examples of the rising operation actually performed by the monitored target T so far. That is, the algorithm may be data based on the movement of the feature points extracted from the failure examples of the rising operation actually performed by the monitored target T so far. For example, the algorithm may be data based on the movement of feature points extracted from the movement when the monitored target T tries to start up but fails (for example, falls) or is about to fail. Using such an algorithm, the monitoring device 10 may not issue a predetermined warning when the probability that the rising operation of the monitored target T succeeds (that is, does not fail) is equal to or higher than a predetermined value. On the other hand, using such an algorithm, the monitoring device 10 may issue a predetermined warning when the probability that the rising operation of the monitored target T does not succeed (that is, fails) is equal to or higher than a predetermined value.

Further, the above-mentioned algorithm may be data based on the movement of feature points when a specific person (for example, the monitored target T1 or the like) stands up as a monitored target T. Using such an algorithm, the monitoring device 10 can issue a predetermined warning before a specific person such as the monitored target T1 stands up.

Further, for example, the above-mentioned algorithm is not limited to data based on the movement of feature points extracted from a successful example of a rising motion actually performed by a specific person such as the monitored target T1. That is, the algorithm may be data based on the movement of the feature points extracted from the failure example of the rising operation actually performed by a specific person such as the monitored target T1. Using such an algorithm, the monitoring device 10 does not issue a predetermined warning when the probability that the rising operation of a specific person such as the monitored target T1 succeeds (that is, does not fail) is more than a predetermined value. You may do it. On the other hand, using such an algorithm, the monitoring device 10 issues a predetermined warning when the probability that the rising operation of a specific person such as the monitored target T1 does not succeed (that is, fails) is more than a predetermined value. You may do so.

As an operation of step S3 (and step S4), the controller 15 performs an operation of raising the monitored target T depending on whether or not a predetermined condition is satisfied in the movement of the feature point of the monitored target T. It may be a process of determining whether or not. Here, the case where a predetermined condition is satisfied may be, for example, a case where a predetermined operation is performed at a predetermined timing. For example, in step S3 and step S4, the controller 15 may be completed at a predetermined number of operations and a predetermined timing.

For example, the controller 15 may determine whether or not at least one of a predetermined first operation, a predetermined second operation, and a predetermined third operation has started (step S3). The predetermined first operation, the predetermined second operation, and the predetermined third operation will be further described later. If it is determined in step S3 that neither the first operation to the third operation has started, the controller 15 may end the operation shown in FIG. The start operation determined by the controller 15 is not limited to three, and may be any number of at least one or more.

On the other hand, when it is determined in step S3 that any of the first operation to the third operation has started, the controller 15 combines all of the predetermined first operation, the predetermined second operation, and the predetermined third operation. It may be determined whether or not the operation is completed within 1 second (step S4).

When it is determined in step S4 that the combined operation of all of the predetermined first operation, the predetermined second operation, and the predetermined third operation is completed within 1 second, the controller 15 performs the operation shown in FIG. finish. After completing the operation shown in FIG. 2, the controller 15 may restart the operation shown in FIG. 2 continuously or at predetermined time intervals. Further, the controller 15 may restart the operation shown in FIG. 2 at arbitrary time intervals such as irregular time intervals.

On the other hand, if it is determined in step S4 that the combined operation of all of the predetermined first operation, the predetermined second operation, and the predetermined third operation is not completed within 1 second, the controller 15 gives a predetermined warning. A signal may be output (step S5). In step S5, the controller 15 may output a predetermined warning signal to the warning unit 17. Based on the predetermined warning signal output from the controller 15 in step S5, the warning unit 17 may issue a predetermined warning to the user.

As described above, the controller 15 may output a predetermined warning signal when a predetermined condition is satisfied in the movement of the feature point of the monitored target T extracted by the extraction unit 11. In one embodiment, the predetermined condition is that at least one of the first operation to the third operation is completed at the time when one second has elapsed from the start of at least one of the first operation, the second operation, and the third operation. It may not be done.

Further, in one embodiment, the predetermined condition is that any of the first operation to the third operation is performed at the time when one second has elapsed from the start of at least one of the first operation, the second operation, and the third operation. It may not be completed. Further, in one embodiment, the predetermined condition is that the operation including the first operation, the second operation, and the third operation is not completed at the time when one second has elapsed from the start of the first operation. May be good.

In step S3 and step S4 shown in FIG. 2, the controller 15 determines whether or not the monitored target T makes the initial movement of the rising operation. As a result, the monitoring device 10 can issue a predetermined warning before the monitored target T starts the rising operation, for example, before the rising operation is completed.

On the other hand, as described above, in the controller 15, the monitored target T has a relatively high possibility of success (that is, a safe) start-up operation, or has a relatively high possibility of failure (that is, a failure). It may be determined whether or not the initial movement of the (dangerous) rising motion is performed. In this case, the algorithm used for the determination process performed by the controller 15 may be based on the movement of the feature points extracted from the successful example of the rising operation actually performed by a specific person such as the monitored target T1. Further, in this case, the algorithm may be based on the movement of the feature points extracted from the failure example of the rising operation actually performed by a specific person such as the monitored target T1.

Hereinafter, the algorithm used for the determination process performed by the controller 15 will be further described. Here, an algorithm for performing a determination process in the movement of the feature point of the monitored target T extracted by the extraction unit 11 will be described based on some of the findings obtained from the demonstration experiment.

(When standing up from a chair without armrests)
3 to 6 are diagrams illustrating an example of extracting the feature points of the operation in which the monitored object T stands up from a chair without an armrest. 3 to 6 show the movement of the feature points when the monitored object T sitting on the chair C1 without armrests gradually stands up. 3 to 6 schematically show an example of feature points extracted from an image in which the monitored object T is captured from the left side. Here, as shown in FIGS. 3 to 6, the chair C1 may be a chair having a structure without armrests or armrests.

As shown in FIGS. 3 to 6, the series of movements in which the monitored object T stands up from the state of sitting on the chair C1 includes some partial movements. For example, as described above, FIG. 3 schematically shows an example of feature points extracted from an image of the monitored target T sitting on the chair C1 from the left side.

From the state shown in FIG. 3 to the state shown in FIG. 4, the partial operation included in the rising operation of the example performed by the monitored target T may be, for example, the following operation.
(1) The action of pulling the foot backward (movement of the feature point P9 (distance d1 and angle a1 shown in FIG. 4))
In this way, the motion of the monitored target T pulling the foot backward may be the first motion described above.
(2) Action to take a forward leaning posture (movement of feature points P1, P2, or P3 (angle a2 shown in FIG. 4))
As described above, the operation in which the monitored target T takes a forward leaning posture may be the above-mentioned second operation.
(3) Action to move the hand forward (movement of feature points P7 and / or P6 (distance d2 shown in FIG. 4))
As described above, the operation of the monitored target T to move forward may be the above-mentioned third operation.
Further, as shown in FIGS. 3 to 6, at least one of the first operation to the third operation may be an operation started from a posture in which the monitored target T is sitting in a chair or the like, for example. Further, in the present embodiment, the first operation, the second operation, and the third operation are not limited to the case where they are performed in this order, and the order of the first operation, the second operation, and the third operation is arbitrary. It may be there. In the present embodiment, any one of the first operation, the second operation, and the third operation may be the first operation of these three operations.

Here, in the normal (safe) rising operation of the monitored object T, the distance d1 in (1) above tends to be about 10 cm, and the angle a1 tends to be about 70 °. On the other hand, in the dangerous rising motion of the monitored target T, the distance d1 in (1) above tends to be about 20 cm, and the angle a1 tends to be about 50 °. Therefore, the first motion may be an motion in which the monitored object T moves the foot on the floor surface to a length of 10 cm or 20 cm behind the monitored object T. Further, the first motion may be an motion in which the monitored object T bends the knee to an angle of 70 ° or 50 °. Hereinafter, the normal (safe) rising operation may be, for example, an operation in which the probability that the rising operation succeeds (that is, does not fail) becomes a predetermined value or more. Further, the dangerous rising motion may be an motion in which the probability that the rising motion does not succeed (that is, fails) becomes a predetermined value or more, for example, a fall.

Further, in the normal rising operation of the monitored object T, the angle a2 in (2) above tends to be about 40 °. On the other hand, in the dangerous rising operation of the monitored target T, the angle a2 in (2) above tends to be about 70 °. Therefore, the second operation may be an operation in which the monitored object T is in a posture of tilting at least a part of the upper body forward until the angle is 40 ° or 70 ° from the direction perpendicular to the floor surface.

Further, the distance d2 in (3) above tends to be about 10 cm in both the normal rising operation and the dangerous rising operation of the monitored object T. Therefore, the third operation may be an operation in which the monitored object T moves his / her hand forward to a length of 10 cm.

Next, from the state shown in FIG. 4 through the state shown in FIG. 5 to the state shown in FIG. 6, the partial operation included in the rising operation of one example performed by the monitored target T is, for example, the following operation. May be. 4 and 5 schematically show an example of feature points extracted from an image of a state in the middle of an example rising operation performed by the monitored target T. Further, FIG. 6 schematically shows an example of feature points extracted from an image in which the monitored target T has completed an example of a rising operation.
(4) Operation of lifting the buttocks (movement of feature point P4 (distance d3 shown in FIG. 5))
(5) Knee extension motion (movement of feature points P4 and / or P9 (angle a3 shown in FIG. 5))
(6) Head lifting operation (movement of feature point P1 (distance d4 shown in FIG. 5))
(7) Arm extension motion (movement of feature point P7 (angle a4 shown in FIG. 5))
(8) Motion to stretch the back muscle (movement of feature points P1, P2, or P3 (angle a5 shown in FIG. 5))

Here, in the normal rising operation of the monitored target T, the angle a3 in (5) above tends to change from about 70 ° to about 180 °. On the other hand, in the dangerous rising motion of the monitored target T, the angle a3 in (5) above tends to change from about 50 ° to about 150 °.

Further, in the normal rising operation of the monitored target T, the distance d4 in (6) above tends to change from the position of P1 shown in FIG. 5 to the position of P1 shown in FIG. On the other hand, in the dangerous rising motion of the monitored target T, the distance d4 in (6) above tends to change to a position less than about 20 cm from the position of P1 shown in FIG. 5 to the position of P1 shown in FIG. It is in.

Further, in the normal rising operation of the monitored target T, the angle a4 in (7) above tends to change from about 90 ° to about 170 °. On the other hand, in the dangerous rising motion of the monitored target T, the angle a4 in (5) above tends to change from about 90 ° to about 160 °.

Further, in the normal rising operation of the monitored target T, the angle a5 in (8) above tends to be about 0 °. On the other hand, in the dangerous rising motion of the monitored target T, the angle a5 in (8) above tends to be about 20 °.

Up to this point, the movement of the feature points in the rising motion of the monitored target T has been described. Hereinafter, the timing of movement of the feature points in the rising operation of the monitored target T will be further described.

As a result of the demonstration experiment, in the normal rising operation of the monitored object T, the operations (1) to (3) tend to be performed within about 0.6 seconds. Further, in the normal rising operation of the monitored target T, the operations (4) to (8) tend to be performed within about 1.2 seconds. That is, the normal rising operation of the monitored target T tends to be performed in about 2 seconds as a whole.

On the other hand, in the dangerous rising operation of the monitored target T, the operations (1) to (3) tend to be performed within about 3 seconds. Further, in the dangerous rising operation of the monitored target T, the operations (4) to (8) above tend to be performed within about 3 seconds. That is, the dangerous rising operation of the monitored target T tends to be performed in about 6 seconds as a whole. In other words, the dangerous rising motion of the monitored target T tends not to be performed in about 2 seconds as the normal rising motion of the monitored target T as a whole.

From the above, for example, the controller 15 of the monitoring device 10 has a warning signal indicating that the rising operation is dangerous if the rising operation is not completed within 3 seconds after the monitored target T starts the rising operation. May be output. In this way, the monitoring device 10 can issue a warning to the user that the monitored target T is performing a dangerous rising operation before the monitored target T completes a dangerous rising operation.

Further, the operations (1) to (8) are included in a series of rising operations performed by the monitored target T. Therefore, for example, if the above operations (1) to (3) are performed, it can be assumed that the above operations (4) to (8) are subsequently performed. Therefore, for example, the controller 15 outputs a warning signal indicating a dangerous rise when it takes 3 seconds or more for the monitored target T to perform the operations (1) to (3) above. May be good. In this way, the monitoring device 10 warns that the monitored target T is performing a dangerous rising operation a predetermined time (for example, 3 seconds before) when the monitored target T completes the dangerous rising operation. Can be sent to the user. In this way, the controller 15 may output a predetermined warning signal before the predetermined time when the monitored target T rises up and completes the operation.

Further, in the present embodiment, in the operation of the monitored target T, the controller 15 completes the operations (1) to (3) above within 1 second after the monitored target T starts the rising operation. If not, a warning signal indicating that the rising operation is being performed may be output. Further, in the operation of the monitored target T, the controller 15 starts up when the operations (1) to (3) are completed within 1 second after the monitored target T starts the rising operation. It is not necessary to output a warning signal indicating that the operation is being performed. In this way, the monitoring device 10 warns that the monitored target T is performing a dangerous rising operation before a predetermined time (for example, 1 second before) when the monitored target T completes a dangerous rising operation. Can be issued to the user. Further, in this case, in the present embodiment, whether or not to give a warning is determined by whether or not the operation from (1) to (3) is completed in 1 second. It is possible to warn the rise of a person who makes a dangerous rise without warning. Therefore, in the present embodiment, the reliability and usefulness of the warning can be improved. Further, in the present embodiment, the elapsed time for determining whether or not to output a predetermined warning signal is not limited to 1 second as described above. That is, when the operating time of the normal rising operation is T1 and the operating time of the dangerous rising operation is T2, the elapsed time Tth for determining whether or not to output a predetermined warning signal is T2 ≧ Tth ≧ T1. May be. When the elapsed time Tth is T1, the present embodiment can quickly output a warning. When the elapsed time Tth is T2, the present embodiment can reduce the probability of erroneously recognizing a normal rising motion as a dangerous rising motion. When the elapsed time Tth is T2> Tth> T1, the present embodiment can set the speed of the warning output and the reduction of erroneous recognition in a well-balanced manner. Further, in the present embodiment, an example is taken in which the operating time T1 of the normal rising operation is 0.6 seconds and the operating time T2 of the dangerous rising operation is 3 seconds. However, in the present embodiment, T1 and T2 are used. Instead of such a value, another value may be appropriately set based on the age, physique, health condition, mental and physical disorder condition, time, for example, a situation such as after exercising, etc. of the monitored target T.

The above operation may be performed in the normal rising operation of the monitored target T. For example, in the normal rising operation of the monitored target T, if the above operations (1) to (3) are performed within 0.6 seconds, then the above operations (4) to (8) are continuously performed. It can be assumed that it takes place in 1.2 seconds.

Therefore, the controller 15 is a warning signal indicating that the rising operation is performed when the operation from (1) to (3) is completed within 1 second after the monitored target T starts the rising operation. May be output. In this way, the monitoring device 10 warns that the monitored target T has started the rising operation before a predetermined time (for example, about 1 second before) when the monitored target T completes the normal rising. Can be sent to the user. In this way, the controller 15 may output a predetermined warning signal before the predetermined time when the monitored target T starts up and operates.

Therefore, in one embodiment, the controller 15 completes at least one of the first operation to the third operation at one second from the start of at least one of the first operation, the second operation, and the third operation. If not, a predetermined warning signal may be output. Further, in one embodiment, the controller 15 completes all of the first operation to the third operation when one second has elapsed from the start of at least one of the first operation, the second operation, and the third operation. If not, a predetermined warning signal may be output. Further, in one embodiment, the controller 15 is determined when the operation including the first operation, the second operation, and the third operation is not completed at the time when one second has elapsed from the start of the first operation. A warning signal may be output. That is, in the present embodiment, the controller 15 completes at least one of the first operation to the third operation when one second has elapsed from the start of at least one of the first operation, the second operation, and the third operation. If not, a predetermined warning signal is output. Therefore, a warning is issued when the monitored target T, which may be a dangerous start-up operation, is about to start up, and the monitored target T, which may be a normal non-dangerous start-up operation, is issued. When is about to stand up, it does not issue a warning, so it is possible to issue a stand-up warning appropriately. Here, in the present embodiment, the elapsed time for determining whether or not to output a predetermined warning signal is not limited to one second as described above. That is, when the operating time of the normal rising operation is T1 and the operating time of the dangerous rising operation is T2, the elapsed time Tth for determining whether or not to output a predetermined warning signal is T2 ≧ Tth ≧ T1. May be. When the elapsed time Tth is T1, the present embodiment can quickly output a warning. When the elapsed time Tth is T2, the present embodiment can reduce the probability of erroneously recognizing a normal rising motion as a dangerous rising motion. When the elapsed time Tth is T2> Tth> T1, the present embodiment can set the speed of the warning output and the reduction of erroneous recognition in a well-balanced manner. Further, in the present embodiment, an example is taken in which the operating time T1 of the normal rising operation is 0.6 seconds and the operating time T2 of the dangerous rising operation is 3 seconds. However, in the present embodiment, T1 and T2 are used. Instead of such a value, another value may be appropriately set based on the age, physique, health condition, mental and physical disorder condition, time, for example, a situation such as after exercising, etc. of the monitored target T.

In either case, the monitoring device 10 may issue a warning to the user that the monitored target T has started the rising operation before the monitored target T has started the rising operation. In this way, the controller 15 may output a predetermined warning signal before the monitored target T rises up and completes the operation.

According to the monitoring system 1 according to the embodiment, when the monitored target T is about to perform a dangerous start-up operation, for example, a warning can be issued to the user before the dangerous start-up operation is performed. Therefore, according to the monitoring system 1 according to the embodiment, the monitored object can be safely provided.

(When standing up from a chair with armrests)
7 to 9 are diagrams illustrating an example of extracting the feature points of the operation in which the monitored object T stands up from the chair with the armrest. 7 to 9 show the movement of the feature points when the monitored object T sitting on the chair C2 with the armrest stands up. 7 to 9 schematically show an example of feature points extracted from an image in which the monitored object T is captured from the left side. Here, as shown in FIGS. 7 to 9, the chair C2 may be a chair having a structure such as an armrest or an armrest. Hereinafter, the points different from the above-mentioned "when standing up from a chair without armrests" will be mainly described.

FIG. 7 schematically shows an example of feature points extracted from an image in which the monitored object T sitting on the chair C2 is captured from the left side, as in FIG. 3.

From the state shown in FIG. 7 to the state shown in FIG. 8, the partial operation included in the normal rising operation of an example performed by the monitored target T may be, for example, the following operation as described above.
(1) Pulling the foot backward (movement of feature point P9)
This operation may be the first operation described above.
(2) Action to take a forward leaning posture (movement of feature points P1, P2, or P3)
This operation may be referred to as the above-mentioned second operation.
(3) Action to move the hand forward (movement of feature points P7 and / or P6 (distance d5 shown in FIG. 8))
This operation may be referred to as the above-mentioned third operation.

Here, in the normal rising operation of the monitored target T, the distance d5 in (3) above tends to be about 10 cm, as in the case shown in FIG.

On the other hand, in the dangerous rising motion of the monitored target T, the above-mentioned "(3) motion of pushing the hand forward" is "(3') motion of pulling the arm backward (feature point P7), as shown in FIG. And the movement of P6) ”. As shown in FIG. 9, the "(3') arm pulling motion" includes the movement of the feature point P7 (distance d6 shown in FIG. 9) and the movement of the feature point P6 (distance d7 shown in FIG. 9). It's fine. Here, in the dangerous rising operation of the monitored target T, the distance d6 tends to be about 10 cm and the distance d7 tends to be about 10 cm.

That is, when the movement of the feature point of the monitored target T is extracted, if the monitored target T has the feature point as shown in FIG. 8 when the above operations (1) to (3) are completed. , There is a tendency for the monitored target T to be in the normal rising operation. On the other hand, when the movement of the feature point of the monitored target T is extracted, if the monitored target T has the feature point as shown in FIG. 9 when the above operations (1) to (3) are completed. , There is a tendency for the monitored target T to be in a dangerous rising motion.

(When standing up from the chair used with the desk)
10 and 11 are diagrams illustrating an example of extracting the feature points of the movement of the monitored object T to stand up from the chair used together with the desk. 10 and 11 show the movement of the feature points when the monitored object T sitting on the chair C1 used together with the desk D1 stands up. 10 and 11 schematically show an example of feature points extracted from an image in which the monitored object T is captured from the left side. Here, the chair C1 may be a chair having a structure without armrests or armrests, as shown in FIGS. 3 to 6. Hereinafter, points different from the above description will be mainly described.

FIG. 10 schematically shows an example of a feature point extracted from an image of a monitored object T trying to stand up from a state of sitting on a chair C1 from the left side, in substantially the same manner as in FIG. ..

As described above, the partial operation included in the normal rising operation of one example performed by the monitored target T up to the state shown in FIG. 4 may be, for example, the following operation.
(1) Pulling the foot backward (movement of feature point P9)
This operation may be the first operation described above.
(2) Action to take a forward leaning posture (movement of feature points P1, P2, or P3)
This operation may be referred to as the above-mentioned second operation.
(3) Action to move the hand forward (movement of feature points P7 and / or P6)
This operation may be referred to as the above-mentioned third operation.

On the other hand, among the partial operations included in the normal rising operation of the example performed by the monitored target T up to the state shown in FIG. 10, the above (1) and (2) are the states shown in FIG. It may be included in the same manner as. On the other hand, the above-mentioned "(3) operation of pushing the hand forward" is "(3") operation of pushing the desk with the hand and / or operation of pulling the chair (feature points P7 and P6) in the state shown in FIG. (Movement) ”has a tendency to replace. "(3") Pushing the desk by hand and / or pulling the chair "moves the feature points P7 and / or the feature points P6 (angle a6 shown in FIG. 11) as shown in FIG. May include. The angle a6 in the above operation (3 ″) tends to change from about 70 ° to about 170 ° in both the normal rising operation and the dangerous rising operation of the monitored object T.

As described above, in the rising motion of the monitored target T, the movement of the extracted feature points may differ depending on the type of chair and / or the presence or absence of a desk. Therefore, by using an algorithm based on the feature points extracted in each situation, the monitoring system 1 can issue a predetermined warning before the monitored target T starts up and operates according to each situation.

Further, in the rising motion of the monitored target T, the movements of the feature points extracted may differ depending on the type of chair and / or the presence or absence of a desk, but the movements of the feature points extracted in common may also exist. .. Therefore, by using an algorithm based on feature points that are commonly extracted in different situations, the monitoring system 1 does not depend on each different situation, and a predetermined value is set before the monitored target T starts up. You can issue a warning.

(When a monitored subject with hemiplegia stands up)
12 and 13 are diagrams illustrating an example of extracting the characteristic points of the motion of the monitored target T having hemiplegia, for example, to stand up from the chair. 12 and 13 show the movement of the feature points when the monitored object T sitting on the chair C1 stands up. 12 and 13 schematically show an example of feature points extracted from an image in which the monitored object T is captured from the front. Here, the chair C1 may be a chair having a structure without armrests or armrests, as shown in FIGS. 3 to 6. Hereinafter, points different from the above description will be mainly described. Here, FIGS. 12 and 13 are diagrams of the monitored target T for paralysis of the left half of the body. FIG. 13 shows an example in which the monitored target T has paralysis on the side where the shoulder is lowered. For example, as a sequela of stroke, there is a symptom of paralysis of the half body (hemiplegia). Hemiplegia includes cases of paralysis of the upper and lower body of the left half of the body and cases of paralysis of the upper body of the left half of the body. The monitored target T having hemiplegia in FIG. 13 may be a case of paralysis of the upper body of the left half of the body. The left upper body on the paralyzed side tends to fall downward because no force is applied to the left half of the body. Also, in this case, since the feet are in contact with the ground, the lower half of the body on the left side does not go down. Therefore, in this case, the posture is the same as when the lower body on the left side is not paralyzed.

FIG. 12 schematically shows an example of feature points extracted from an image in which the monitored object T sitting on the chair C1 is captured, substantially similar to FIG. FIG. 3 schematically shows an example of feature points extracted from an image of the monitored target T sitting on the chair C1 from the left side. On the other hand, FIG. 12 schematically shows an example of feature points extracted from an image of the monitored target T sitting on the chair C1 from the front front.

As described above, the partial operation included in the normal rising operation of one example performed by the monitored target T up to the state shown in FIG. 4 may be, for example, the following operation.
(1) Pulling the foot backward (movement of feature point P9)
This operation may be the first operation described above.
(2) Action to take a forward leaning posture (movement of feature points P1, P2, or P3)
This operation may be referred to as the above-mentioned second operation.
(3) Action to move the hand forward (movement of feature points P7 and / or P6)
This operation may be referred to as the above-mentioned third operation.

Here, as shown in FIG. 13, among the partial movements included in the standing-up movement of the monitored target T having hemiplegia, the above-mentioned “(2) movement of taking a forward leaning posture” is shown in FIG. It tends to replace the operation different from the state shown in. Therefore, in this case, the above-mentioned "(2) operation of taking a forward leaning posture" may be replaced with "(2') an operation of taking a forward leaning posture" including a left-right asymmetrical movement. In this case, regarding the movement of the feature points P1, P2, or P3 described above in the "(2') forward leaning posture", the case of the "(2) forward leaning posture" described in FIG. May be the same as. On the other hand, the "(2') forward leaning posture" may include, for example, the movement of the feature points P5L and / or P5R (angle a7 shown in FIG. 13) as a left-right asymmetrical movement.

As described above, in the rising motion of the monitored target T, the movement of the extracted feature points may differ depending on the physical characteristics and / or disability of the monitored target T. Therefore, by using an algorithm based on the feature points extracted in each monitored target T, the monitoring system 1 can issue a predetermined warning before each monitored target T starts up.

Further, in the rising motion of the monitored target T, the movement of the extracted feature points may differ depending on the physical characteristics and / or disability of the monitored target T, but the movements of the feature points extracted in common. Can also exist. Therefore, by using an algorithm based on the feature points commonly extracted in each different monitored target T, the monitoring system 1 starts up the monitored target T without depending on each different monitored target T. You can issue a given warning before you do.

Although the embodiments according to the present disclosure have been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications or modifications based on the present disclosure. It should be noted, therefore, that these modifications or modifications are within the scope of this disclosure. For example, the functions included in each component or each step can be rearranged so as not to be logically inconsistent, and a plurality of components or steps can be combined or divided into one. Is. Although the embodiment according to the present disclosure has been mainly described with respect to the apparatus, the embodiment according to the present disclosure can also be realized as a method including steps executed by each component of the apparatus. The embodiments according to the present disclosure can also be realized as a method, a program, or a storage medium on which a program is recorded, which is executed by a processor included in the apparatus. It should be understood that these are also included in the scope of this disclosure.

The above-described embodiment is not limited to the implementation as the monitoring system 1. For example, the above-described embodiment may be implemented as a monitoring device 10 included in the monitoring system 1. Further, the above-described embodiment may be implemented as a monitoring method using a device such as the monitoring device 10. Further, the above-described embodiment may be implemented as a program executed by, for example, a device such as a monitoring device 10 or an information processing device (for example, a computer).

1 Monitoring system 10 Monitoring device 11 Extraction unit 13 Storage unit 15 Controller 17 Warning unit 19 Communication unit 20 Imaging unit

Claims (11)

An imaging unit that captures the monitored object and
An extraction unit that extracts the movement of the feature point of the monitored object from the image captured by the imaging unit, and an extraction unit.
In the movement of the feature points of the monitored object extracted by the extraction unit,
The first movement in which the monitored object pulls its foot backward,
The second movement in which the monitored object takes a forward leaning posture,
The third action in which the monitored object puts his hand forward,
When the operation consisting of the above is not completed within 1 second from the start of the first operation, a controller that outputs a predetermined warning signal and a controller.
A warning unit that issues a predetermined warning based on the predetermined warning signal output from the controller.
A monitoring system equipped with. An imaging unit that captures the monitored object and
An extraction unit that extracts the movement of the feature point of the monitored object from the image captured by the imaging unit, and an extraction unit.
In the movement of the feature points of the monitored object extracted by the extraction unit,
The first movement in which the monitored object pulls its foot backward,
The second movement in which the monitored object takes a forward leaning posture,
The third action in which the monitored object puts his hand forward,
A controller that outputs a predetermined warning signal when at least one of the first operation to the third operation is not completed at least one second after the start of any of the above.
A warning unit that issues a predetermined warning based on the predetermined warning signal output from the controller.
A monitoring system equipped with. The monitoring system according to claim 1 or 2, wherein at least one of the first operation to the third operation is an operation started from a posture in which the monitored object is sitting. The monitoring system according to any one of claims 1 to 3, wherein the first operation is an operation in which the monitored object moves a foot on the floor surface to a length of 10 cm or 20 cm behind the monitored object. The monitoring system according to any one of claims 1 to 4, wherein the first operation is an operation in which the monitored object bends the knee to an angle of 70 ° or 50 °. 2. The monitoring system described in either. The monitoring system according to any one of claims 1 to 6, wherein the third operation is an operation in which the monitored object moves a hand forward to a length of 10 cm. The monitoring system according to any one of claims 1 to 7, wherein the warning unit issues the predetermined alarm as information acting on at least one of the auditory sense, the visual sense, and the tactile sense of the human body. An extraction unit that extracts the movement of the feature points of the monitored object from the image of the monitored object, and
In the movement of the feature points of the monitored object extracted by the extraction unit,
The first movement in which the monitored object pulls its foot backward,
The second movement in which the monitored object takes a forward leaning posture,
The third action in which the monitored object puts his hand forward,
When the operation consisting of the above is not completed within 1 second from the start of the first operation, a controller that outputs a predetermined warning signal and a controller.
A monitoring device. A step of extracting the movement of the feature point of the monitored object from the image of the monitored object, and
In the movement of the feature points of the monitored object extracted in the extraction step,
The first movement in which the monitored object pulls its foot backward,
The second movement in which the monitored object takes a forward leaning posture,
The third action in which the monitored object puts his hand forward,
A step of determining whether or not the operation consisting of the above is completed at the time when one second has elapsed from the start of the first operation, and
In the determination step, if the operation consisting of the first operation to the third operation is not completed within 1 second from the start of the first operation, a step of outputting a predetermined warning signal and a step of outputting a predetermined warning signal.
Monitoring methods, including. On the computer
A step of extracting the movement of the feature point of the monitored object from the image of the monitored object, and
In the movement of the feature points of the monitored object extracted in the extraction step,
The first movement in which the monitored object pulls its foot backward,
The second movement in which the monitored object takes a forward leaning posture,
The third action in which the monitored object puts his hand forward,
A step of determining whether or not the operation consisting of the above is completed at the time when one second has elapsed from the start of the first operation, and
In the determination step, if the operation consisting of the first operation to the third operation is not completed within 1 second from the start of the first operation, a step of outputting a predetermined warning signal and a step of outputting a predetermined warning signal.
A program that runs.

Images