TWI646507B - Behavior recognition system - Google Patents

Abstract

The present invention relates to a behavior recognition system, which is a behavior recognition system that recognizes the difference between the emission and reception of a light spot to recognize the behavior state of a monitored person. The present invention includes a light emitting unit, a receiving unit, and a recognition unit, and A warning unit; thereby, the behavior recognition system of the present invention is designed by hardware that detects the optical path difference between the transmission and reception of the light spot emitted by the light-emitting unit, and effectively judges and interprets at least one of the monitored areas A variety of actions of the monitored person and the instructions they want to deliver really achieve the main advantages of fully monitoring the movement and living state of the monitored person in the space and reducing the installation cost of the hardware.

Description

Behavior recognition system

The present invention relates to a behavior recognition system, in particular to a behavior recognition system that recognizes the difference between the transmission and reception of a light spot to recognize the behavior state of a monitored person.

According to the aging of the society and the advancement of medical technology and equipment, many medical care behaviors that needed to be carried out in medical institutions in the past can now be combined with the hospital's own environment in the home environment of the elderly, young children or patients This is one of the main reasons why home care-related fields and industries have flourished in recent years. Although many home care or security centers currently employ relevant care workers to take care of the care recipients, There are still many elderly people who are not sick in all corners of the society. They often need to be alone at home, or only one person in the entire home environment, and these elderly people who are not sick or living alone do not need to be hired. Caregivers assist in care; however, these unsick old people or solitary old people often suffer from impaired mobility due to their age and poor health, and they often suffer from falls without knowing it. Home events, or more serious events such as fainting or myocardial infarction.

There have been related studies to solve the above problems. For example, some elderly care systems wear a tilt sensor on the elderly to sense the tilt signal when the elderly falls, and send related warning messages to the loved ones' mobile communications. The device is to remind relatives to perform first aid; however, if the elderly forget to wear the tilt sensor or the tilt sensor falls from the elderly, Therefore, it is impossible to effectively monitor the falling events of the elderly; the "detector and elderly care system including the detector" of the Republic of China Patent No. M549405 was developed to solve the above problems. This patent includes a sensor module, Processing module and wireless transmission module, the sensing module senses whether there is an object in front; the processing module is connected to the sensing module; the wireless transmission module is connected to the processing module, wherein when the sensing module is at a predetermined time When there is no object passing in front of the interval, the processing module can generate a warning signal, and can send the warning signal through the wireless transmission module; this patent mainly uses infrared sensing to detect whether there is an object passing in front. Drive the processing module to turn on the lighting module and provide a night light-like function to effectively prevent the elderly from falling down due to insufficient night light. If the infrared sensor module cannot detect the passing of objects in the predetermined time interval At this time, the drive processing module generates a warning signal and sends it to the mobile communication device held by the loved one through the cloud server to warn the relatives to rescue in real time; however, the sensing device presented in infrared form can only target certain fixed The motion is detected at a fixed position. Because the infrared sensor module does not have image-assisted observation, the elderly do not pass through the infrared detection area does not indicate a problem. At this time, the warning signal becomes a malfunction; therefore, how Effectively through innovative hardware design, effectively judge the caregiver's movements such as getting up, turning over or waving on the bed except lying down, and can also detect related activities such as caregivers or idlers equal to the bed, and still be healthy Related industry developers and related researchers in the care monitoring system need to continue to work hard to overcome and solve the problems.

Now, in view of the fact that the traditional monitoring and identification system still has many deficiencies in the actual implementation, the inventor is a tireless spirit, and it is improved by its rich professional knowledge and many years of practical experience. Based on this, the invention was developed.

The main purpose of the present invention is to provide a behavior recognition system, especially a recognition The behavior recognition system that recognizes the difference between the transmission and reception of the light spot to identify the behavior state of the monitored person is mainly designed by hardware that detects the optical path difference between the transmission and reception of the light spot emitted by the light emitting unit, Effective judgment and interpretation of the various actions and the desired commands of at least one monitored person in the monitored area to solve the traditional care monitoring using infrared transceivers or gravity sensors but only for certain fixed actions Measurements, and the use of wearable sensors can only analyze the physiological signals of the care receivers, etc., and indeed achieve the main advantages of fully monitoring the movements and living conditions of the monitored persons in the space, and reducing the installation cost of hardware.

In order to achieve the above-mentioned implementation objective, the present inventor proposes a behavior recognition system, which is set in a monitored area to monitor the status of at least one monitored person. The behavior recognition system of the present invention at least includes a light-emitting unit and a receiver Unit, an identification unit, and a warning unit; the light emitting unit emits a plurality of light spots toward the monitored area, wherein the light spot is irradiated on the monitored person and reflected into a plurality of reflected light spots; the receiving unit is provided on one of the light emitting units On the side, the receiving unit is used to receive the reflected light spot; the identification unit is electrically connected to the light-emitting unit and the receiving unit, the identification unit includes a conversion module, and a calculation module electrically connected to the conversion module, the conversion module The system receives the reflected light spot transmitted by the receiving unit to convert the reflected light spot into a plurality of electrical signals and transmit it to the calculation module. The calculation module calculates a difference value of the light spot reflected from the light emitting unit and reflected to the receiving unit to obtain a Depth value and send a signal; the warning unit is electrically connected to the calculation module. The warning unit sends a warning signal after receiving the signal from the calculation module.

In the behavior recognition system as described above, the light-emitting unit is one of a light-emitting diode, a laser diode, or a light-emitting element for outputting a light beam.

The behavior recognition system as described above, in which the light spots are regularly arranged or irregular Arrangement and so on.

The behavior recognition system as described above, wherein the wavelength of the light spot emitted by the light emitting unit is between 650 nm and 950 nm.

In the behavior recognition system as described above, the difference value is one of time difference or energy difference.

In the behavior recognition system as described above, the warning unit is one of a device such as an alarm, a display, or a mobile communication device.

In the behavior recognition system as described above, the warning signal is presented in one type or a combination of two or more such as sound, light, image or vibration.

The behavior recognition system as described above, wherein the behavior recognition system may be further provided with an image capturing unit.

In the behavior recognition system as described above, the image capturing unit includes an optical lens and a photosensitive element connected to the optical lens, wherein the optical lens captures the image of the monitored person and forms an image on the photosensitive element.

In the behavior recognition system as described above, the optical lens is a device such as a fisheye lens, a wide-angle lens, or a standard lens.

In the behavior recognition system as described above, the photosensitive element is one of a photo-coupled device (Charge Coupled Device, CCD) or a complementary metal oxide semiconductor (Complementary Metal-Oxide-Semiconductor, CMOS) and the like.

The behavior recognition system as described above, wherein the behavior recognition system may be further provided with a storage unit, which is electrically connected to the image capture unit to store the image captured by the image capture unit.

The behavior recognition system as described above, wherein the behavior recognition system may be further provided with a face recognition unit, which is electrically connected to the image capturing unit to recognize the face in the image captured by the image capturing unit Appearance.

The behavior recognition system as described above, wherein the behavior recognition system may be further provided with an image processing unit, the image processing unit is electrically connected to the image capture unit to divide the image captured by the image capture unit into at least one region of interest (Region Of Interest, ROI), and identify the image changes in the region of interest.

In this way, the behavior recognition system of the present invention is mainly designed by the hardware design that detects the optical path difference between the emission and reception of the light spot emitted by the light emitting unit, and at least one of the monitored areas in the effective judgment and interpretation is monitored The various actions of the author and the instructions they want to pass, to solve the traditional care monitoring using infrared transceivers or gravity sensors can only detect certain fixed movements, and wearable sensors can only analyze the received The shortcomings of the guardian ’s physiological signals, etc., do achieve the main advantages of fully monitoring the monitored person ’s actions and living conditions, as well as reducing the hardware installation cost. In addition, the behavior recognition system of the present invention is mainly emitted by the light emitting unit The difference value of the optical path difference of the light flight to know the height of at least one monitored person in the monitored area. When the monitored person's behavior changes, the change in the movement can be detected from the difference in height The main advantage of actively alerting the monitored person's behavior status; furthermore, the behavior recognition system of the present invention is mainly based on the difference value of the optical path difference of the light emitted by the light emitting unit, combined with the technical features of face recognition, in order to detect When the behavior status of at least one monitored person in the space, the face of the monitored person can be detected at the same time to effectively prevent the possibility of sleep apnea in the young monitored person, as well as to conduct behavior safety and wake-up warning notifications. Advantages; Finally, the behavior recognition system of the present invention is mainly designed by dividing the monitored area into a plurality of regions of interest (ROI), In order to know the status of at least one monitored person engaging in different behaviors in different areas of interest, it can effectively assist the daily behavior records and storage of the monitored person and the monitored person, and indeed achieve the main advantage of the record and effectiveness of medical care.

(1) ‧‧‧ Behavior recognition system

(11) ‧‧‧Lighting unit

(111) ‧‧‧ light spot

(12) ‧‧‧Receiving unit

(13) ‧‧‧Identification unit

(131) ‧‧‧Conversion module

(132) ‧‧‧Calculation module

(14) ‧‧‧Warning unit

(15) ‧‧‧Image capture unit

(151) ‧‧‧Optical lens

(152) ‧‧‧Photosensitive element

(16) ‧‧‧Storage unit

(17) ‧‧‧Face recognition unit

(18) ‧‧‧Image processing unit

(2) ‧‧‧Monitored area

(3) ‧‧‧Monitored

Figure 1: Block diagram of the system structure of a preferred embodiment of the behavior recognition system of the present invention

Figure 2: Schematic diagram of the system setting of a preferred embodiment of the behavior recognition system of the present invention

Figure 3: Block diagram of the system structure of the second preferred embodiment of the behavior recognition system of the present invention

In order to facilitate your examination committee to understand the technical features, content, advantages and achievable effects of the present invention, the present invention is described in detail in conjunction with the drawings and in the form of expressions of the embodiments, and the drawings used therein, Its purpose is only for illustration and supplementary description, and may not be the true scale and precise configuration after the implementation of the present invention, so it should not be interpreted and limited to the relationship between the scale and the configuration of the attached drawings, and the scope of the present invention in the actual implementation is limited , He Xianming.

First, please refer to FIG. 1 and FIG. 2, which is a block diagram of the system structure of a preferred embodiment of the behavior recognition system of the present invention, and a schematic diagram of the system setting, wherein the behavior recognition system (1) of the present invention is provided in In a monitored area (2), to monitor the state of at least one monitored person (3), in a preferred embodiment of the present invention, the monitored area (2) may be, for example but not limited to, a hospital bed, while receiving The monitor (3) is a patient lying on the bed in the monitored area (2); the behavior recognition system (1) of the present invention includes at least: a light emitting unit (11), which faces the monitored area (2) A plurality of light spots (111) are emitted, wherein the light spot (111) is irradiated on the monitored person (3) and reflected into a plurality of reflected light spots (pattern) (Not shown); In addition, the light-emitting unit (11) is a light-emitting diode, a laser diode or a light-emitting element used to output a light beam, etc .; furthermore, the light spots (111) are regularly arranged or Irregular arrangement, etc. In addition, the wavelength of the light spot (111) emitted by the light emitting unit (11) is between 650nm and 950nm; in a preferred embodiment of the present invention, the light emitting unit (11) ) Is arranged above the monitored area (2) of the hospital bed, and emits a plurality of light spots (111) toward the hospital bed at a distance from the hospital bed, and the light spot (111) is irradiated to the patient's monitored person (3) The top is reflected into a plurality of reflective light spots, of which the wavelength of the light spot (111) is between 650nm and 950nm, the best is 850nm or 940nm; a receiving unit (12) is provided on one of the light emitting units (11) On the side, the receiving unit (12) is used to receive the reflected light spot; in a preferred embodiment of the present invention, the receiving unit (12) is disposed on one side of the light emitting unit (11), and the receiving unit (12) receives The reflected light spot reflected from the monitored area (2) of the hospital bed or the monitored person (3) of the patient; an identification unit (13) is electrically connected to the light emitting unit (11) and the receiving unit (12), The identification unit (13) includes a conversion module (131) and a calculation module (132) electrically connected to the conversion module (131). The conversion module (131) receives the reflection transmitted by the receiving unit (12) Light spot, to convert the reflected light spot into a plurality of electrical signals and transmit it to the calculation module (132), the calculation module (132) is the calculation light spot (111) emitted from the light emitting unit (11) and reflected to the receiving unit (12) A difference value to obtain a depth value and send out a signal; in addition, the difference value is one of time difference or energy difference; in a preferred embodiment of the present invention, the identification unit (13) is composed of The conversion module (131) is composed of a calculation module (132). The conversion module (131) receives the reflected light spot transmitted by the receiving unit (12), and correspondingly converts the reflected light spot into an electrical signal and transmits it to the calculation module (132), the calculation module (132) calculates the light spot (111) contained in the electrical signal after being emitted from the light emitting unit (11) The time difference value (ie, optical path difference) hitting the receiving unit (12), this optical path difference represents the travel distance of different light spots (111), then the calculation module (132) can obtain a depth by the optical path difference Value and transmit a signal that when the patient ’s monitored person (3) lies in the monitored area (2) of the hospital bed, the light spot (111) emitted by the light emitting unit (11) located above the hospital bed is The time reflected by the patient to the receiving unit (12) is not the same, and the calculation module (132) can determine the presence or absence of the patient according to this time difference, and when the patient waves the set hand action, the light spot is caused When the optical path difference of (111) changes continuously, the calculation module (132) can also detect this hand movement and determine the command it represents, and send a signal to the warning unit (14); and a warning unit (14 ), Which is electrically connected to the calculation module (132), and the warning unit (14) sends a warning signal after receiving the signal from the calculation module (132); in addition, the warning unit (14) is an alarm and a display Or a mobile communication device, etc. Furthermore, the warning signal is presented as one type of sound, light, image or vibration, or a combination of two or more; in a preferred embodiment of the present invention, the warning The unit (14) is electrically connected to the calculation module (132) to receive the signal transmitted by the calculation module (132), that is, when the calculation module (132) detects that the optical path difference of the light spot (111) continuously changes, a warning is given The unit (14) will issue a warning signal presented in an audible manner to notify the relevant persons and others about the change of the action state of the monitored person (3).

In addition, the behavior recognition system (1) may be further provided with an image capturing unit (15), wherein the image capturing unit (15) includes an optical lens (151), and a photosensitive element connected to the optical lens (151) (152), wherein the optical lens (151) captures the image of the monitored person (3) and forms an image on the photosensitive element (152); furthermore, the optical lens (151) is a fisheye lens, a wide-angle lens or a standard lens, etc. A kind of device; in addition, the photosensitive element (152) is one kind of device such as a photoelectric coupling element (CCD) or a complementary metal oxide semiconductor (CMOS); in addition, a behavior recognition system (1) A storage unit (16) may be further provided. The storage unit (16) is electrically connected to the image capture unit (15) to store the image captured by the image capture unit (15); please refer to FIG. 3 Shown is a block diagram of the system structure of the second preferred embodiment of the behavior recognition system of the present invention, wherein the behavior recognition system (1) is provided with an image capture unit (15), and the image capture unit (15) is provided in One side of the light emitting unit (11), an optical lens (151) built inside the image capturing unit (15) and presented in the form of a fisheye lens captures the monitored person (2) in the monitored area (2) 3) The image is imaged on the photosensitive element (152), and related persons can also observe the operation state of the monitored person (3) from this image, and the image capture unit (15) is also electrically connected to the storage unit (16), The captured image is stored in the storage unit (16).

Furthermore, please refer again to FIG. 3, the behavior recognition system (1) may be further provided with a face recognition unit (17), which is electrically connected to the image capture unit (15) To identify the facial appearance in the image captured by the image capturing unit (15); in another preferred embodiment of the present invention, when the image capturing unit (15) captures the monitored area (2) When monitoring the image of the monitored person (3), the face recognition unit (17) electrically connected to the image capturing unit (15) can detect the face of the monitored person (3) and recognize its appearance. That is, when the monitored person (3) of an infant and child sleeps in the monitored area (2) of a crib, the face recognition unit (17) can detect the face shape of the infant and the child ’s eyes When opened, the face recognition unit (17) recognizes that the infant has been awake and notifies the relevant person to wait for care.

In addition, the behavior recognition system (1) may be further provided with an image processing unit (18), which is electrically connected to the image capturing unit (15) to capture the image capturing unit (15) The image is divided into at least one area of interest (not shown in the figure), and the image changes in the area of interest are identified; in the second preferred embodiment of the present invention, the monitored area (2) may be, for example but not limited to It is a room. When the image capturing unit (15) captures the image of the room, it is attached to the room. Divide a number of areas of interest like the above, for example, provide a bed area for the monitored person (3) to sleep, a table area for the monitored person (3) to take medicine, or a toilet area for the monitored person (3) to use the toilet, etc. When the computing module (132) and the image capturing unit (15) detect that the monitored person (3) is present in the table area and has the action of taking medicine, it means that the monitored person (3) is taking medicine on time, and the image processing The unit (18) can assist the monitored person (3) to record daily life; in addition, the area of interest can also be a sign of the dangerous area. When the monitored person (3) enters the dangerous area, the calculation module (132) The warning unit (14) will also be driven to issue a warning signal to remind relevant persons and others to prevent and rescue the monitored person (3) from entering a dangerous area.

As can be seen from the above implementation description, compared with the prior art, the behavior recognition system of the present invention has the following advantages:

1. The behavior recognition system of the present invention is mainly designed by the hardware design that detects the optical path difference between the emission and reception of the light spot emitted by the light emitting unit, and effectively judges and interprets at least one person in the monitored area in the monitored area The various actions and commands to be transmitted are used to solve the traditional care monitoring using infrared transceivers or gravity sensors but can only detect certain fixed actions, and the wearable sensor can only analyze the care. The shortcomings of the physiological signal of the person, indeed achieve the main advantages of fully monitoring the behavior and living state of the monitored person in the space, and reducing the installation cost of the hardware.

2. The behavior recognition system of the present invention mainly uses the difference value of the optical path difference of the light emitted by the light emitting unit to obtain the height of at least one monitored person in the monitored area when the monitored person's behavior changes At the same time, you can detect the change of its movement from the difference in height, and indeed achieve the main advantage of actively alerting the behavior status of the monitored person.

3. The behavior recognition system of the present invention is mainly based on the difference value of the optical path difference of the light flying by the light emitting unit, combined with the technical features of face recognition, in order to at least detect the space When the behavior of the monitored person is detected, the face of the monitored person can be detected at the same time, to effectively prevent the possibility of sleep apnea in the young monitored person, and the main advantages of behavior safety and wake-up warning notification.

4. The behavior recognition system of the present invention is mainly designed by dividing the monitored area into a plurality of areas of interest, so as to know the status of at least one monitored person engaging in different behaviors in different areas of interest, and effectively assist in monitoring The daily behavior records and storage of the person and the monitored person really achieve the main advantage of the record and effectiveness of medical care.

In summary, the behavior recognition system of the present invention can indeed achieve the expected use effect through the embodiments disclosed above, and the present invention has not been disclosed before the application, and has fully met the requirements and requirements of the Patent Law . I filed an application for a patent for invention in accordance with the law, pleaded for the review, and granted the patent.

However, the illustrations and descriptions disclosed above are only preferred embodiments of the present invention, and are not intended to limit the scope of protection of the present invention; those who are familiar with the art, according to the characteristic scope of the present invention, do other things Equivalent changes or modifications should be regarded as not departing from the design scope of the present invention.

Claims (14)

A behavior recognition system is set in a monitored area to monitor the status of at least one monitored person. The behavior recognition system includes at least: a light emitting unit that emits a plurality of light spots toward the monitored area, wherein The light spots are irradiated on the monitored person and reflected into a plurality of reflected light spots; a receiving unit is provided on a side of the light emitting unit, the receiving unit is used to receive the reflected light spots; an identification unit, The light-emitting unit and the receiving unit are electrically connected to each other. The identification unit includes a conversion module and a calculation module electrically connected to the conversion module. The conversion module receives the reflection transmitted by the receiving unit Light spot, to convert the corresponding reflected light spots into a plurality of electrical signals and transmit them to the calculation module, the calculation module calculates a difference value of the light spot reflected from the light emitting unit to the receiving unit to obtain a depth Value and issue a signal; and a warning unit, which is electrically connected to the computing module, and the warning unit sends a warning signal after receiving the signal from the computing module. The behavior recognition system as described in item 1 of the patent application scope, wherein the light-emitting unit is one of a light-emitting diode, a laser diode, or a light-emitting element for outputting a light beam. The behavior recognition system as described in item 1 of the patent application scope, wherein the light spots are one of regularly arranged or irregularly arranged. The behavior recognition system as described in item 1 or 2 or 3 of the patent application, wherein the wavelength of the light spot emitted by the light emitting unit is between 650 nm and 950 nm. The behavior recognition system as described in item 1 of the patent application scope, wherein the difference value is one of time difference or energy difference. The behavior recognition system as described in item 1 of the patent application scope, wherein the warning unit is one of an alarm, a display or a mobile communication device. The behavior recognition system as described in item 1 of the scope of patent application, wherein the warning signal is presented in one of sound, light, image or vibration or a combination of two or more. The behavior recognition system as described in item 1 of the patent application scope, wherein the behavior recognition system is further provided with an image capturing unit. The behavior recognition system as described in item 8 of the patent application scope, wherein the image capturing unit includes an optical lens and a photosensitive element connected to the optical lens, wherein the optical lens captures the image of the monitored person Image on the photosensitive element. The behavior recognition system as described in Item 9 of the patent application scope, wherein the optical lens is one of a fisheye lens, a wide-angle lens, or a standard lens. The behavior recognition system as described in item 9 of the patent application scope, wherein the photosensitive element is one of a photoelectric coupling element (CCD) or a complementary metal oxide semiconductor (CMOS). The behavior recognition system as described in item 8 of the patent application scope, wherein the behavior recognition system is further provided with a storage unit, the storage unit is electrically connected to the image capture unit to store the image captured by the image capture unit . The behavior recognition system as described in item 8 of the patent application scope, wherein the behavior recognition system is further provided with a face recognition unit, and the face recognition unit is electrically connected to the image capture unit to recognize the image capture unit The appearance of the face in the captured image. The behavior recognition system as described in item 8 of the patent application scope, wherein the behavior recognition system is further provided with an image processing unit, the image processing unit is electrically connected to the image capture unit to capture the image capture unit The taken image is divided into at least one region of interest (ROI), and the state of the image change in the region of interest is recognized.