CN113296163A

CN113296163A - Human body detection method, device and system, composite sensor and storage medium

Info

Publication number: CN113296163A
Application number: CN202110566276.6A
Authority: CN
Inventors: 邱明
Original assignee: Shenzhen Lutuo Technology Co Ltd
Current assignee: Shenzhen Lutuo Technology Co Ltd; Shenzhen Lumi United Technology Co Ltd
Priority date: 2021-05-24
Filing date: 2021-05-24
Publication date: 2021-08-24

Abstract

The embodiment of the application provides a human body detection method, a human body detection device, a human body detection system, a composite sensor and a storage medium, wherein the method comprises the following steps: acquiring a first detection result obtained by detecting a target area by a pyroelectric infrared sensor; when the target area is judged to move by a human body according to the first detection result, waking up the main controller, starting a working power supply of the radar sensor through the main controller, and acquiring a second detection result obtained by detecting the target area by the radar sensor; and determining the human body detection result and the corresponding credibility of the target area based on the second detection result. Therefore, the human body detection is carried out by utilizing the detection principle and the detection range of different sensors in the same composite sensor, the reliability of the human body detection is improved, and the user experience is improved. Meanwhile, the working states of the main controller and the radar sensor are controlled, so that the electric energy consumption is saved, and the service life is prolonged.

Description

Human body detection method, device and system, composite sensor and storage medium

Technical Field

The present application relates to the field of smart home technologies, and in particular, to a method, an apparatus, and a system for detecting a human body, a composite sensor, and a computer-readable storage medium.

Background

With the continuous iterative development of the internet and the internet of things technology, the smart home concept starts to be deeply conscious, and new smart home products are continuously released and released to the market. In an intelligent home, the application scenes of information input realized through detection of a sensor are very many, however, human body movement detection is performed based on a pyroelectric infrared sensor, an ultrasonic technology or a microwave technology, so that the intelligent home has respective advantages and respective limitations.

Disclosure of Invention

In order to solve the existing technical problems, the application provides a human body detection method, a human body detection device, a human body detection system, a composite sensor and a computer readable storage medium with high human body detection reliability.

In order to achieve the above purpose, the technical solution of the embodiment of the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a human body detection method, which is applied to a composite sensor, where the composite sensor includes a main controller, a pyroelectric infrared sensor, and a radar sensor, and the method includes:

acquiring a first detection result obtained by detecting a target area by a pyroelectric infrared sensor;

when the target area is judged to have human body movement according to the first detection result, waking up a main controller, starting a working power supply of a radar sensor through the main controller, and acquiring a second detection result obtained by the radar sensor detecting the target area;

and determining the human body detection result and the corresponding credibility of the target area based on the second detection result.

In a second aspect, an embodiment of the present application provides a human body detection device, which is applied to a composite sensor, the composite sensor includes a main controller, a pyroelectric infrared sensor and a radar sensor, and the device includes:

the first acquisition module is used for acquiring a first detection result obtained by detecting a target area by the pyroelectric infrared sensor;

the second acquisition module is used for acquiring a second detection result obtained by detecting the target area by the radar sensor under the condition that the human body movement in the target area is judged according to the first detection result;

and the processing module is used for determining the human body detection result and the corresponding credibility of the target area based on the second detection result.

In a third aspect, an embodiment of the present application provides a composite sensor, including a main controller, a pyroelectric infrared sensor, a radar sensor, a processor, a memory, and a computer program stored on the memory and executable by the processor, where the computer program, when executed by the processor, implements the human body detection method according to any embodiment of the present application applied to the composite sensor.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the human body detection method according to any embodiment of the present application.

In a fifth aspect, an embodiment of the present application provides a human body detection system, which includes a composite sensor, a terminal device in communication connection with the composite sensor, and a controlled device in communication connection with the terminal device, where the composite sensor may be the composite sensor of the third aspect, where the composite sensor sends a human body detection result and corresponding confidence level to the terminal device; and the terminal equipment sends a pre-configured control instruction to the controlled equipment according to the human body detection result and the corresponding credibility so as to control the controlled equipment to execute specified operation.

The method, the device and the system for detecting the human body, the composite sensor and the storage medium are provided by the embodiments of the application, the method is applied to the composite sensor comprising a main controller, a pyroelectric infrared sensor and a radar sensor, and the composite sensor obtains a first detection result obtained by detecting a target area by the pyroelectric infrared sensor; when the target area is judged to move by a human body according to the first detection result, waking up the main controller, starting a working power supply of the radar sensor through the main controller, and acquiring a second detection result obtained by detecting the target area by the radar sensor; and determining the human body detection result and the corresponding reliability of the target area based on the second detection result, thus obtaining the second detection result obtained by detecting the target area by the radar sensor under the condition that the pyroelectric infrared sensor judges that the human body moves in the target area, and determining the human body detection result and the corresponding reliability of the target area based on the second detection result, namely, jointly detecting the human body by using the detection principle and the detection range of different sensors in the same composite sensor, thereby improving the reliability of human body detection and improving the user experience. Meanwhile, the working states of the main controller and the radar sensor are controlled, so that the electric energy consumption is saved, and the service life is prolonged.

The computer-readable storage medium provided in the foregoing embodiment is used to implement the human body detection method provided in the embodiment of the present application, and has the same technical effect as the human body detection method, and for avoiding repetition, details are not described here again.

Drawings

Fig. 1 is a framework diagram of an internet of things system in an optional application scenario of the human body detection method provided in the embodiment of the present application;

FIG. 2 is a flowchart illustrating a human body detection method according to an embodiment of the present application;

FIG. 3 is a schematic view of a human body detecting device according to an embodiment of the present application;

FIG. 4 is a diagram illustrating a hardware configuration of a composite sensor according to an embodiment of the present disclosure;

FIG. 5 is a schematic representation of PIR detection range and PCR radar detection range in an alternative example of the present application;

FIG. 6 is a first flowchart illustrating a human body detection method according to an embodiment of the present disclosure;

FIG. 7 is a flowchart illustrating a human body detection method according to an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a composite sensor according to an embodiment of the present application;

fig. 9 is a schematic diagram of a hardware structure of a composite sensor according to another embodiment of the present application.

Detailed Description

The technical solution of the present application is further described in detail with reference to the drawings and specific embodiments of the specification.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of implementations of the present application. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

In the description of the present application, it is to be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing the present application and simplifying the description, but do not indicate or imply that the referred device or element must have a particular orientation, be constructed in a particular orientation, and be operated, and thus should not be construed as limiting the present application. In the description of the present application, "a plurality" means two or more unless otherwise specified.

In the description of the present application, it is to be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art.

In recent years, with the continuous iterative development of the internet and internet of things technology, smart home concepts begin to be deeply enjoyed, and the smart home is laid out and explored no matter in internet enterprises, traditional household appliance enterprises and communication operation enterprises. New intelligent household products are continuously released and released to the market; many of them products are smart home systems's basic product, for example wisdom gateway, temperature and humidity sensor, infrared human body sensor, door and window sensor etc..

Although these products are of different types, the infrared body sensors of various manufacturers are designed almost identically: the pyroelectric infrared sensor (PIR) is manufactured according to a pyroelectric principle, and a pyroelectric material is a crystal material capable of sensing heat flow and generating electric charges; PIR sensors are devices that convert thermal energy into an electrical signal. The PIR sensor-based main application is to detect human body movement in scenes such as smart homes, security, markets and the like.

The working principle of detecting the movement of the human body by the unique pyroelectric infrared technology is as follows: the infrared pyroelectric sensor for detecting the human body consists of a lens, a photosensitive element, a photosensitive circuit, a battery power supply circuit, a main controller and an RF part; the infrared ray sent by the human body focuses the signal on the photosensitive element through the lens, the signal is sent to the main controller through filtering, amplification and processing of the photosensitive circuit, and finally the signal is sent out through the RF module, or local alarm is realized. However, there are the following disadvantages: the device is easily interfered by various heat sources and light sources, and is triggered by mistake when the temperature and the light change; when the ambient temperature is close to the human body temperature, the detection sensitivity is obviously reduced, and short-time failure is easily caused; the detection sensitivity is low during radial movement; only that there is a movement of the human body is recognized and that it is not recognized when the human body is stationary.

A scheme of a pyroelectric infrared technology (PIR) and an Ultrasonic technology (Ultrasonic) or a scheme of a pyroelectric infrared technology (PIR) and a microwave technology; at the moment, the ultrasonic technology and the microwave technology detect the movement of the human body through the Doppler detection principle 1; the principle of the two hardware schemes for detecting the human body movement is the same, namely that the two technologies are triggered at least once within a certain time, and the existence/nonexistence of the human body movement is judged. However, there are the following disadvantages: the human body movement recognition accuracy is high (false alarm is less), but the sensor cannot judge whether the human body exists at the moment when the human body movement stops.

Therefore, the inventor provides the human body detection method, the human body detection device, the human body detection system, the composite sensor and the storage medium, which are provided by the embodiment of the application, and the human body detection is performed by using the detection principle and the detection range of different sensors in the same composite sensor, so that the reliability of human body detection is improved, and the user experience is improved. Meanwhile, the working states of the main controller and the radar sensor are controlled, so that the electric energy consumption is saved, and the service life is prolonged.

Please refer to fig. 1, which is a block diagram of an internet of things system in an optional application scenario of the human body detection method according to the embodiment of the present application. The internet of things system comprises a composite sensor 50, a terminal device 51, a cloud 52, a gateway device 53, a router 54, an intelligent household device 55 and the like. The terminal device 51 may be any intelligent device with communication and storage functions, such as: the smart phone, the desktop computer, the notebook computer, the tablet computer or other smart communication devices with network connection functions. The cloud 52 may be a network access server, a database server, a cloud server, or the like. Optionally, the gateway device 53 may be built based on a ZigBee protocol, the smart home device 55 may be controlled by the composite sensor 50 or the terminal device 51, and may be pre-added to the gateway device 53, for example, the smart home device 55 may be a device in a suite to which the gateway device belongs when the gateway device 53 leaves a factory; or may be a device that is subsequently connected to the gateway device 53 by a user operation.

Optionally, a client capable of managing the smart home device 55 is installed in the terminal device 51, where the client may be an application client (such as a mobile phone APP) or a web page client, and is not limited herein.

Alternatively, the composite sensor 10 may establish a network connection with the gateway device 53 based on the ZigBee protocol, thereby joining the ZigBee network.

The composite sensor 10, the terminal device 51 and the smart home device 55 can all be accessed to the ethernet through the gateway device 53, and the gateway device 53 can be accessed to the cloud 52 through a wired or wireless communication connection mode. For example, the gateway device 53 and the terminal device 51 may store the acquired information in the cloud 52. Optionally, the terminal device 51 may also establish a network connection with the cloud 52 through 2G/3G/4G/5G, WiFi, so as to obtain data sent by the cloud 52.

Optionally, the terminal device 51, the gateway device 53 and the composite sensor 50 may be in the same local area network, or may be in the same wide area network as the cloud 52. When the terminal device 51 and the gateway device 53 are in the same local area network, the terminal device 51 may interact with the gateway device 53 and the composite sensor 50 connected to the gateway device 53 through a local area network path; the gateway device 53 and the composite sensor 50 connected to the gateway device 53 may also interact over a wide area network path. When the terminal device 51 is not in the same local area network as the gateway device 53, the terminal device 51 may interact with the gateway device 53 and the composite sensor 50 connected to the gateway device 53 through a wide area network path. The internet of things system can further realize the control of turning on or off the smart home devices 55 within the range of the local area network or correspondingly connected with the local area network through the composite sensor 50. The smart home devices 55 may include, but are not limited to, smart home products such as smart lamps, automatic curtains, and air conditioners.

Automation refers to a linkage application built between gateway devices or sub-devices connected to the gateway devices; the automation comprises a trigger condition and an execution action, the equipment for realizing the control of the automation scene comprises trigger equipment and controlled equipment (or execution equipment), the trigger equipment and the controlled equipment are in communication connection through a gateway, and when the trigger equipment meets the trigger condition, the gateway controls the controlled equipment to execute the corresponding execution action. The triggering device may be various sensors such as a pressure sensor, a temperature sensor, a humidity sensor, a door and window sensor, a smoke sensor, or the like. The controlled device can be various switches, sockets, electric lamps, infrared emitting devices or camera devices and the like. The triggering device and the controlled device may be the same device.

Suppose that the user sets an automatic scene control to be an automatic linkage of automatically turning on the light according to the automatic opening of the door and the window, the condition of the scene is that the door and the window are opened, and the execution action is that the intelligent switch controls the bulb to turn on the light. Based on the application scene, the door and window sensor can be set as a trigger device, and the intelligent switch connected with the lamp is set as a controlled device. The specific execution principle is as follows: if the automatic execution is performed locally at the gateway through the local area network path, the door and window sensor senses that the door and window is opened, the door and window sensor reports the event to the gateway, and after the gateway receives the event that the door and window is opened, the corresponding equipment for executing the action is found according to the stored automatic configuration information, namely the intelligent switch in the embodiment, and the intelligent switch is informed to turn on the light, so that the automatic linkage of the automatic light turning on when the door and window is opened is realized. If through the wide area network route, carry out the automation at the high in the clouds, then door and window sensor senses door and window and opens, reports this incident to the gateway, and the gateway receives the incident that door and window were opened after, reports this incident to the high in the clouds, and the high in the clouds is according to the scene configuration information of storage, finds the equipment that corresponds of execution action, is intelligent switch in this embodiment to inform intelligent switch through the gateway and turn on the light. When the lamp is turned on, the information of successful lamp turning-on is fed back to the gateway, after the gateway knows the successful lamp turning-on, the current time, the success or failure information are reported to the cloud end, and the cloud end is responsible for storing the information.

Referring to fig. 2, a human body detection method provided for an embodiment of the present application may be applied to the composite sensor shown in fig. 1, where the composite sensor includes a main controller, a pyroelectric infrared sensor and a radar sensor, and the human body detection method includes, but is not limited to, S101, S103 and S105, and is specifically described as follows:

s101, obtaining a first detection result obtained by detecting a target area by a pyroelectric infrared sensor.

When the composite sensor is powered on, the working power supply of the pyroelectric infrared sensor can be switched on, so that the pyroelectric infrared sensor can detect a target area. As can be appreciated, since any object with a temperature radiates infrared rays outwards, and objects with different temperatures radiate infrared rays outwards differently, the pyroelectric infrared sensor can detect infrared rays to determine whether human body movement is detected.

S103, under the condition that the target area is judged to have human body movement according to the first detection result, waking up a main controller, starting a working power supply of a radar sensor through the main controller, and obtaining a second detection result obtained by detecting the target area by the radar sensor.

Specifically, when it is determined that a human body moves in a target area according to a first detection result obtained by detecting the target area by the pyroelectric infrared sensor, the main controller is awakened, and then a working power supply of the radar sensor is turned on by the main controller, so that the radar sensor detects the target area, and a second detection result obtained by detecting the target area by the radar sensor is obtained.

It should be noted that, because the human body movement detected by the pyroelectric infrared sensor may actually be the movement of an object such as an animal, and based on this, the pyroelectric infrared sensor detects the movement of a living being, and the living being may include a human body and an animal, it is not accurate to determine that there is a possibility of human body movement in the target area only according to the first detection result, and because the radar sensor can detect a human figure, the radar sensor can be further combined to detect the target area. The power consumption of the radar sensor is large, so that after the composite sensor is electrified, the working power supply of the radar sensor can be kept in a closed state, and the working power supply of the radar sensor is turned on when the radar sensor is required to detect the target area.

And S105, determining the human body detection result and the corresponding credibility of the target area based on the second detection result.

And determining whether the target area is occupied or not according to the second detection result, and obtaining the human body detection result and the corresponding credibility of the target area by combining the situation that the human body moves in the target area determined according to the first detection result. It can be understood that only biological movement can be detected by the pyroelectric infrared sensor, human shape can be detected by the radar sensor, and human body detection by combining the two sensors can be more accurate. In an embodiment, the determining the human body detection result and the corresponding confidence level of the target area based on the second detection result includes: determining that the human body detection result of the target area is human body movement and the corresponding credibility is a preset first credibility value under the condition that the target area is judged to be unmanned based on the second detection result; determining that the human body detection result of the target area is human body movement and the corresponding credibility is a preset second credibility value under the condition that the second detection result is used for judging that the target area is human; wherein the second confidence value is greater than the first confidence value. It can be understood that, in the case that it is determined that there is a human body movement in the target area according to the first detection result, if it is determined that there is no human body in the target area based on the second detection result, which indicates that a human body may have left the target area at this time or that the human body movement detected by the pyroelectric infrared sensor may not be a movement of a human body but a movement of an object such as an animal, it is determined that the human body detection result in the target area is a human body movement, and the corresponding confidence level is a preset first confidence level value; and if the person in the target area is judged based on the second detection result, and the person is in the target area at the moment, determining that the human body detection result of the target area is that the human body moves, and the corresponding credibility is a preset second credibility value. The reason that the credibility is different lies in that the detection principle of pyroelectric infrared sensor and radar sensor is different, the detection principle of pyroelectric infrared sensor is to detect temperature and move, and the detected moving object can include the pet that moves, the people that moves etc., and radar sensor can obtain the wave form of people through filtering with the wave form filtering of non-human body, and its credibility is higher. In addition, the reliability can be used for representing the speed of human body detection frequency, and when the reliability is lower, the detection can be continued for a longer time, or the interval time of the next detection period is shortened; when the reliability is relatively high, the interval time of the next detection period may be extended, or the like. Therefore, the power consumption can be saved, and the detection can be more accurate. The first reliability value and the second reliability value may be set according to actual needs, for example, the first reliability value may be set to 50%, the second reliability value may be set to 100%, and the like.

In the above embodiment of the application, the composite sensor obtains the radar sensor right when it is judged that the target area has the human body to move through the pyroelectric infrared sensor, and based on the second detection result, the human body detection result and the corresponding credibility of the target area are determined, namely, the detection principle and the detection range of different sensors in the same composite sensor are utilized to carry out human body detection together, so that the reliability of human body detection is improved, and the user experience is improved. Meanwhile, the working states of the main controller and the radar sensor are controlled, so that the electric energy consumption is saved, and the service life is prolonged.

In some embodiments, after determining the human detection result and the corresponding confidence of the target area based on the second detection result, the method further includes:

when the first preset time is reached, acquiring a third detection result obtained by detecting the target area by the pyroelectric infrared sensor;

when it is determined that no human body moves in the target area according to the third detection result, waking up the main controller, turning on a working power supply of the radar sensor through the main controller, and acquiring a fourth detection result obtained by detecting the target area by the radar sensor;

and determining that the human body detection result of the target area is the existence of the human body under the condition that the human body in the target area is judged to exist according to the fourth detection result.

It is understood that a person moving in the target area may stay in the target area after a certain time, and it is necessary to continue to detect whether the person exists in the target area. That is to say, after the human body detection result and the corresponding confidence level of the target area are determined based on the second detection result, timing is started, when a first preset time length is reached, the triggering interruption of the pyroelectric infrared sensor is turned on through the main controller, so that the pyroelectric infrared sensor detects the target area, and a third detection result obtained by detecting the target area by the pyroelectric infrared sensor is obtained, and when it is determined that the target area has no human body moving according to the third detection result, it is indicated that the human body is possibly in a stationary state at that time, the main controller is awakened, and when it is determined that the working power supply of the radar sensor is turned on to obtain a fourth detection result obtained by detecting the target area by the radar sensor, and when it is determined that the target area has a human body according to the fourth detection result, and determining that the human body detection result of the target area is that a human exists. The first preset time period may be set according to actual needs, for example, may be set to 30 seconds, 60 seconds, and the like. If it is determined that the target area is not occupied according to the fourth detection result, the step of acquiring the first detection result obtained by detecting the target area by the pyroelectric infrared sensor is returned to be executed. So, after it is long when reaching first predetermineeing, detecting the regional unmanned removal of target and detecting through radar sensor through pyroelectric infrared sensor the target area has the people, explains the regional existence of target, simple operation and degree of accuracy are high, have further improved human detection reliability and have promoted user experience.

In some embodiments, after determining that the human body detection result of the target area is the presence of a human body in the case that it is determined that the target area is the presence of a human body according to the fourth detection result, the method further includes:

acquiring a fifth detection result obtained by detecting the target area by the radar sensor by using a second preset time length as a detection period;

adding 1 to a counter under the condition that the target area is judged to be occupied according to the fifth detection result;

and when the value of the counter is equal to or greater than a preset threshold value, determining that the human body detection result of the target area is the existence of a human body.

It can be understood that, after detecting that a person exists in the target area, the human body may further continue to stay in the target area for a period of time, or may leave the target area after a period of time, at this time, a second preset time period may be used as a detection period, a fifth detection result obtained by detecting the target area by the radar sensor is obtained, and in a case that it is determined that the target area exists according to the fifth detection result, a counter is incremented by 1, and if it is detected that a value of the counter is equal to or greater than a preset threshold value, it is determined that the human body detection result of the target area exists. The second preset time period may be set according to actual needs, for example, may be set to 30 seconds, 60 seconds, and the like. The preset threshold may be set according to actual requirements, for example, may be set to 3, 5, and the like. Preferably, the size of the preset threshold may be set in combination with a second preset duration, and when the second preset duration is set to a smaller value, the preset threshold may be set to a larger value; when the second preset duration is set to a large value, the preset threshold may be set to a small value. Therefore, under the condition that the existence of people in the target area is detected, whether the existence of people still exists in the target area is periodically detected, and the reliability of human body detection is further improved.

In some embodiments, the method further comprises:

when the value of the counter is greater than 1 and smaller than a preset threshold value, if the target area is judged to be unmanned according to the fifth detection result, acquiring a sixth detection result obtained by detecting the target area by the radar sensor after a third preset time;

and returning to the step of executing the fifth detection result obtained by detecting the target area by the radar sensor with the second preset time as a detection period under the condition that the person in the target area is judged according to the sixth detection result.

It is understood that, after detecting that a person is in the target area, in the process of continuously detecting whether the person is still in the target area, due to the influence of environmental factors or other human factors, such as the radar sensor is temporarily blocked, the radar sensor may not successfully detect the person in the target area, and at this time, whether the person is in the target area may be determined again by the radar sensor. That is to say, if it is determined that the target area is not occupied according to the fifth detection result, a sixth detection result obtained by detecting the target area by the radar sensor is obtained after a third preset time period, and if it is determined that the target area is occupied according to the sixth detection result, the step of obtaining the fifth detection result obtained by detecting the target area by the radar sensor by taking the second preset time period as a detection period is continuously executed in a returning manner. If it is determined that the target area is not occupied according to the sixth detection result, the step of acquiring the first detection result obtained by detecting the target area by the pyroelectric infrared sensor is returned to. The third preset time period may be set according to actual needs, for example, 10 seconds, 30 seconds, and the like. Therefore, the reliability of human body detection is further improved, and the user experience is further improved.

In some embodiments, the waking up the main controller when it is determined that there is no human body moving in the target area according to the third detection result, turning on a working power supply of the radar sensor through the main controller, and obtaining a fourth detection result obtained by detecting the target area by the radar sensor includes: and under the condition that no human body moves in the target area is judged according to the third detection result, when a fourth preset time is reached, waking up the main controller, starting a working power supply of the radar sensor through the main controller, and acquiring a fourth detection result obtained by detecting the target area by the radar sensor.

It can be understood that, in the case that it is determined that there is no human body moving in the target area according to the third detection result, at this time, there may be a stationary human body in the target area, and the human body may only temporarily stay in the target area, but does not stay in the target area for more than a certain time, in order to detect whether the human body stays in the target area for more than a certain time, that is, stays in the target area for a long time, timing may be started after it is determined that there is no human body moving in the target area according to the third detection result, and when a fourth preset time is reached, the main controller is awakened, and the main controller turns on the operating power supply of the radar sensor to obtain a fourth detection result obtained by the radar sensor detecting the target area. Therefore, whether a human body exists in the target area can be accurately acquired, and the reliability of human body detection is further improved.

In some embodiments, the method may further comprise: and sending a message carrying the human body detection result to corresponding terminal equipment, and controlling the main controller to enter a sleep state. Specifically, when the human body detection result indicates that a human body moves, the human body detection result and the corresponding reliability are generated into a message, the message is sent to the corresponding terminal device, and the main controller is controlled to enter a sleep state, so that power consumption is reduced. Therefore, the human body detection result is timely sent to the corresponding terminal equipment in a message mode, so that the corresponding controlled equipment can be timely and automatically controlled, and the user experience is further improved. Meanwhile, the main controller is controlled to enter the sleep state in time, so that the main controller is prevented from generating large power consumption due to being in the working state for a long time, the power consumption is effectively reduced, and the service life of the main controller can be effectively prolonged.

In some embodiments, before controlling the master controller to enter the sleep state, the method further includes: and the triggering interruption of the pyroelectric infrared sensor is closed through the main controller. It can be understood that after the pyroelectric infrared sensor completes the detection of the target area, the triggering of the pyroelectric infrared sensor may be temporarily interrupted and turned off, so that the pyroelectric infrared sensor stops detecting the target area, thereby avoiding the greater power consumption of the pyroelectric infrared sensor due to long-time working state, effectively reducing the power consumption, and effectively prolonging the working life of the pyroelectric infrared sensor.

In some embodiments, before the obtaining of the third detection result obtained by the pyroelectric infrared sensor detecting the target area, the method may further include: and triggering interruption and starting of the pyroelectric infrared sensor through the main controller. It can be understood that, after the pyroelectric infrared sensor completes the detection of the target area, the triggering interruption of the pyroelectric infrared sensor is turned off, and if the pyroelectric infrared sensor needs to detect the target area again, the triggering interruption of the pyroelectric infrared sensor needs to be turned on by the main controller, that is, the pyroelectric infrared sensor is triggered to detect the target area. Therefore, the triggering interruption of the pyroelectric infrared sensor is started when the target area needs to be detected, the power consumption can be effectively reduced, and the service life of the pyroelectric infrared sensor can be effectively prolonged.

In some embodiments, after obtaining a detection result obtained by the radar sensor detecting the target area, the method may further include: and the working power supply of the radar sensor is turned off through the main controller. Specifically, after the second detection result, the fourth detection result, the fifth detection result and the sixth detection result obtained by detecting the target area by the radar sensor are obtained respectively, the working power supply of the radar sensor is turned off by the main controller, so that the radar sensor stops detecting the target area, the radar sensor is prevented from generating large power consumption due to long-time working state, the purpose of reducing the power consumption is achieved, and meanwhile the service life of the radar sensor can be effectively prolonged.

In another aspect of the embodiments of the present application, please refer to fig. 3, which further provides a human body detection apparatus applied to a composite sensor, where the composite sensor includes a main controller, a pyroelectric infrared sensor and a radar sensor, and the apparatus includes: the first acquisition module 11 is configured to acquire a first detection result obtained by detecting a target area by a pyroelectric infrared sensor; a second obtaining module 12, configured to wake up a main controller when it is determined that the target area has human body movement according to the first detection result, turn on a working power supply of a radar sensor through the main controller, and obtain a second detection result obtained by the radar sensor detecting the target area; and the processing module 13 is configured to determine a human body detection result and a corresponding confidence level of the target area based on the second detection result.

In some embodiments, the processing module 13 is specifically configured to:

determining that the human body detection result of the target area is human body movement and the corresponding credibility is a preset first credibility value under the condition that the target area is judged to be unmanned based on the second detection result;

determining that the human body detection result of the target area is human body movement and the corresponding credibility is a preset second credibility value under the condition that the second detection result is used for judging that the target area is human; wherein the second confidence value is greater than the first confidence value.

In some embodiments, the first obtaining module 11 is further configured to obtain a third detection result obtained by detecting the target area by the pyroelectric infrared sensor after a first preset time period is reached;

the second obtaining module 11 is further configured to wake up the main controller when it is determined that there is no human body moving in the target area according to the third detection result, turn on a working power supply of the radar sensor through the main controller, and obtain a fourth detection result obtained by detecting the target area by the radar sensor;

the processing module 13 is further configured to determine that the human body detection result of the target area is that a human body exists, under the condition that it is determined that the human body exists in the target area according to the fourth detection result.

In some embodiments, the second obtaining module 11 is further configured to obtain a fifth detection result obtained by detecting the target area by the radar sensor with a second preset time length as a detection period;

the processing module 13 is further configured to add 1 to a counter when it is determined that the target area is occupied according to the fifth detection result; and when the value of the counter is equal to or larger than a preset threshold value, determining that the human body detection result of the target area is that a human body exists.

In some embodiments, the second obtaining module 11 is further configured to, when the value of the counter is greater than 1 and smaller than a preset threshold, obtain, after a third preset time, a sixth detection result obtained by detecting the target area by the radar sensor if it is determined that the target area is unmanned according to the fifth detection result;

the processing module 13 is further configured to control the first obtaining module 11 to perform the step of obtaining a fifth detection result obtained by detecting the target area by the radar sensor with the second preset duration as a detection period when it is determined that the target area is occupied according to the sixth detection result.

In some embodiments, the processing module 13 is further configured to control the first acquiring module 11 to perform the step of acquiring a first detection result obtained by detecting the target area by the pyroelectric infrared sensor, if it is determined that the target area is not occupied according to the sixth detection result or the fourth detection result.

In some embodiments, the second obtaining module 11 is specifically configured to, when it is determined that there is no human body moving in the target area according to the third detection result, wake up the main controller when a fourth preset time period is reached, turn on a working power supply of the radar sensor through the main controller, and obtain a fourth detection result obtained by detecting the target area by the radar sensor.

In some embodiments, referring to fig. 3, the human body detection apparatus further includes a sending module 14, configured to send a packet carrying the human body detection result to a corresponding terminal device;

the processing module 13 is further configured to control the main controller to enter a sleep state.

In some embodiments, the processing module 13 is further configured to turn off a triggering interrupt of the pyroelectric infrared sensor through the main controller.

In some embodiments, the processing module 13 is further configured to turn on a triggering interrupt of the pyroelectric infrared sensor through the main controller.

In some embodiments, the processing module 13 is further configured to turn off an operating power supply of the radar sensor through the main controller.

It should be noted that: in the human body detection device provided in the above embodiment, only the division of the program modules is exemplified in the process of implementing human body detection, and in practical applications, the processing distribution may be completed by different program modules according to needs, that is, the internal structure of the device may be divided into different program modules to complete all or part of the method steps described above. In addition, the human body detection device provided by the above embodiment and the human body detection method embodiment belong to the same concept, and the specific implementation process thereof is detailed in the method embodiment and is not described herein again.

In order to enable a more systematic understanding of the human body detection method provided by the embodiment of the present application, different application scenarios are respectively combined and described below by specific examples.

Referring to fig. 4, a composite sensor is provided for an example of the present application, the composite sensor including: the Infrared Radar comprises a main controller, a pyroelectric Infrared Sensor (PIR), a Signal processing circuit (Signal Process), a Radar Sensor (Radar Sensor), a level conversion circuit and a battery, wherein the main controller can be a Zigbee chip or a BLE chip, the Radar Sensor can be a 60GHz PCR or FMCW Radar (pulse coherent Radar or frequency modulation continuous wave Radar) or a 24GHz FMCW Radar, and the battery can be a CR123A battery. In this embodiment, the master controller is a Zigbee chip, the Radar sensor is a 60GHz PCR Radar, and the battery is 2 × CR 123A.

According to the difference between the existing PIR detection range and the PCR radar detection range, the detection range diagram finally realized is shown in fig. 5, in an embodiment, a sector area a is a detection area of the PIR, the detection angle of the sector detection area is related to a lens used by the PIR, and the detection radius is related to environmental factors such as temperature and humidity or the amplification factor of an internal circuit of the PIR; the sector B and the sector C together constitute a detection region for PCR.

Next, two states of the compound sensor are determined according to the following steps: the human body movement state and the human body existing state are as follows:

firstly, after the system is powered on, the power supply of a PIR circuit is switched on, so that the PIR starts to work;

then, the PIR always detects whether a person moves in the detection area A; at the moment, the PCR Radar power supply is in a closed state, and the master control enters a sleep state to reduce power consumption;

and then, when the PIR detects that a person moves, the master control is awakened, the PCR Radar power supply is turned on by the master control, the PCRRadar detects whether the person moves in the detection area (twice detection), and the power supply of the PCRRadar is immediately turned off after the detection is finished so as to reduce the power consumption. Wherein, the detection of the presence/absence is actually realized by detecting high and low levels, the high level trigger represents the presence of a person, and the low level trigger represents the absence of a person.

Secondly, detecting that the PIR is unmanned, determining that the detection result is unmanned in the unmanned area detected by the PCR, generating a message by the detection result, and sending out the message, and then, entering a sleep state by the master control;

the method comprises the following steps of (1) determining that a detection result is human body movement and has a reliability of 50% in an area where the PIR is detected to be unmanned and the PCR is detected once or twice to be occupied, and after the detection result is generated into a message and sent out, the master control enters a sleep state;

the method comprises the following steps of determining that a detection result is human body movement in an area where PIRs are detected to be human bodies and PCR is detected to be unmanned once or twice, wherein the reliability is 50%, and after the detection result is generated into a message and sent out, the master control enters a sleep state;

the method comprises the steps of detecting the presence of the PIR, detecting the presence of the PIR twice by the PCR, determining that a detection result is the movement of a human body in an area with the PCR detection twice, wherein the reliability is 100%, and after the detection result is generated into a message and sent out, the master control enters a sleep state.

And then, after the PIR detects that the person exists, the PCR detects twice that the person exists, the detection result is determined to be that the person moves, the reliability is 100%, after the master control is in sleep, the master control starts PIR detection after preset time such as 60s, if the PIR detects that the person does not exist, the PCR detects that the person moves twice, the area determines that the detection result is that the person exists, the master control enters a sleep state after the detection result is generated into a message and sent out.

Wherein, the credibility of 50% represents that: there are moving objects, which may be pets or clothes, etc., or may be people; confidence 100% indicates: there is a moving object, which is determined to be a person.

The reason for the difference in reliability is that PIR and radar are different in detection principle, that is, PIR detects temperature + movement, and thus moving objects including moving pets, moving clothes, or people can be detected.

The radar can filter the waveform of other objects such as pets or clothes and the like to obtain the waveform of a person, so the reliability of the radar is 100%.

Referring to fig. 5 again, the finally determined regions in this embodiment are: the area A is an area with the detection result of human body movement and the reliability of 50 percent; the area B is an area with the detection result of human body movement and the reliability of 100 percent; the region C is a region where the detection result is that a human body exists; the remaining regions are regions in which the detection result is no person.

When a human body enters a detection area of the composite sensor, determining an automation scene corresponding to the detection result according to the detection result, referring to fig. 6 and 7, the specific process of the human body detection method includes the following steps:

step S201, controlling PIR to be electrified;

here, after the system is powered on, the power supply of the PIR circuit is turned on, and the PIR starts to operate.

Step S202, whether PIR triggering interruption exists or not is detected, if yes, step S203 is executed, and if not, the step S202 is executed;

step S203, controlling PIR to carry out human body detection;

here, the PIR detects whether a person moves in a detection area, at this time, the PCR radar power supply is in an off state, and the main control enters a sleep state to reduce power consumption.

Step S204, judging whether the PIR detects human body movement, if so, executing step S205, otherwise, returning to execute step S202;

s205, controlling the PCR Radar to carry out human body detection;

and when the PIR detects that a person moves, the PIR wakes up the main controller, the main controller turns on a PCR Radar power supply and detects whether the person moves in a detection area (immediately detects twice) of the PCR Radar, and the power supply of the PCR Radar is turned off immediately after the detection is finished so as to reduce the power consumption. The detection of presence/absence is actually by detecting high and low levels, with a high level trigger representing presence and a low level trigger representing absence.

Step S206, judging whether the PCR Radar detects human body movement, if so, executing step S210, otherwise, executing step S207;

step S207, generating a message with human body movement and with the reliability of 50%;

here, if the PCR Radar detects that no one moves, the master controller turns off the PIR trigger interrupt and simultaneously sends the someone moving telegram with a reliability of 50%, and the master controller enters a sleep state.

Step S208, delaying for 30 seconds;

step S209, opening PIR triggering interruption;

here, after delaying for 30S (the duration can be adjusted), the master controller opens the PIR to trigger the interrupt and returns to step S202 again;

step S210, generating a message which is moved by a human body and has 100% of credibility;

here, if the PCR Radar detects that someone moves, the master controller turns off the PIR trigger interrupt and simultaneously sends the someone moving telegram with the reliability of 100%, and the master controller enters a sleep state.

Step S211, delaying for 60 seconds;

step S212, opening PIR triggering interruption;

step S213, controlling PIR to detect human body;

step S214, judging whether the PIR detects human body movement, if not, executing step S215, otherwise, returning to execute step S202;

here, after a delay of 60S (the duration can be adjusted), the master controller turns on the PIR to trigger the interrupt, and the PIR detects whether a person moves, and if so, returns to step S202 again.

Step S215, delaying for 10 seconds;

s216, controlling the PCR Radar to carry out human body detection;

step S217, judging whether the PCR Radar detects human body movement, if so, executing step S219, otherwise, executing step S218;

here, if no person moves during PIR detection, after delaying for 10s (the duration can be adjusted), the main controller turns on the PCR Radar power supply and detects again (detects twice immediately) whether a person moves, and immediately turns off the PCR Radar power supply after detection is completed to reduce power consumption.

Step S218, generating an unmanned message;

step S219, a message that someone exists is generated.

Here, if the PCR Radar detects that a person moves, a presence telegram is transmitted.

Step S220, clearing the counter;

step S221, delaying for 60 seconds;

step S222, controlling the PCR Radar to carry out human body detection;

step S223, judging whether the PCR Radar detects human body movement, if so, executing step S224, otherwise, executing step S226;

here, after step S219, the time may be delayed by 60S (the duration may be adjusted), the main controller turns on the PCR Radar power again and detects again (detects twice immediately) whether a person moves, and turns off the PCR Radar power immediately after the detection is completed to reduce power consumption.

Step S224, adding 1 to the counter;

step S225, determining whether the counter is greater than 5, if so, returning to step S219, otherwise, returning to step S221;

step S226, delaying for 30 seconds;

step S227, controlling the PCR Radar to carry out human body detection;

and step S228, judging whether the PCR Radar detects human body movement, if so, returning to execute the step S221, otherwise, returning to execute the step S202.

Here, if there is one time in which no movement of a person is detected, the time is delayed for 30S (the time length can be adjusted) and then the detection is performed again, and if the movement of a person is detected, the operation returns to the step S221; if no person is detected to move, go back to step S202. In addition, in the process of executing step S221 to step S228, whenever PIR trigger interrupt is detected, the process returns to step S202.

In summary, in the human body detection method provided by the embodiment of the application, the human body detection result and the corresponding reliability level of the human body detection result are obtained according to different detection ranges of the sensors in the composite sensor, so that corresponding automatic control is set for the human body detection results with different reliability levels in an intelligent home scene; the PCR low-power radar can greatly reduce power consumption by matching with PIR detection to ensure that the PCR low-power radar can be powered by a battery and has a service life of more than 2 years; PIR detection is matched with PCR radar detection for double detection, so that the detection accuracy is ensured, and the false alarm times are reduced; the PIR detection is matched with the PCR radar detection, and the detection area and the detection result reliability can be distinguished according to the difference between the detection range and the sensitivity of the PIR detection and the PCR radar detection.

In another aspect of the embodiment of the present application, please refer to fig. 8, which further provides a composite sensor, including a main controller 210, a pyroelectric infrared sensor 211, a radar sensor 212, a processor 213, a memory 214, and a computer program stored in the memory 214 and executable by the processor 213, wherein when the computer program is executed by the processor 213, the method for detecting a human body applied to the composite sensor according to any embodiment of the present application is implemented, and the same technical effects can be achieved, and are not repeated herein.

In some embodiments, referring again to fig. 8, the composite sensor further includes a battery 215 for powering the main controller 210, the pyroelectric infrared sensor 211, the radar sensor 212, the processor 213 and the memory 214.

Fig. 9 is a block diagram of an alternative hardware structure of the composite sensor according to the embodiment of the present disclosure. As shown in fig. 9, the composite sensor may have relatively large differences due to different configurations or performances, and may include one or more processors (CPUs) 1110 (the processors 1110 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 1130 for storing data, one or more storage media 1120 (e.g., one or more mass storage devices) storing applications 1123 or data 1122. The memory 1130 and the storage medium 1120 may be, among other things, transient storage or persistent storage. The program stored in the storage medium 1120 may include one or more modules, each of which may include a series of instruction operations in human body detection. Still further, processor 1110 may be configured to communicate with storage medium 1120 to execute a series of instruction operations in storage medium 1120 on the composite sensor. The composite sensor may also include one or more power supplies 1160, one or more wired or wireless network interfaces 1150, one or more input-output interfaces 1140, and/or one or more operating systems 1121, such as Windows Server, MacOSXTM, UnixTM, LinuxTM, FreeBSDTM, and the like.

The input output interface 1140 may be used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the composite sensor. In one example, i/o interface 1140 includes a network adapter (NIC) that may be coupled to other network devices via a base station to communicate with the internet. In one example, the input/output interface 1140 can be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.

It will be understood by those skilled in the art that the structure shown in fig. 9 is only an illustration, and does not limit the structure of the terminal device. For example, the composite sensor may also include more or fewer components than shown in FIG. 9, or have a different configuration than shown in FIG. 9.

The embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the processes of the human body detection method embodiments, and can achieve the same technical effects, and in order to avoid repetition, the detailed description is omitted here. The computer-readable storage medium may be a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

The embodiment of the present application further provides a human body detection system, which is characterized by comprising a composite sensor, a terminal device in communication connection with the composite sensor, and a controlled device in communication connection with the terminal device, where the composite sensor may be the composite sensor according to any of the above embodiments, and the composite sensor sends a human body detection result and a corresponding reliability to the terminal device; and the terminal equipment sends a pre-configured control instruction to the controlled equipment according to the human body detection result and the corresponding credibility so as to control the controlled equipment to execute specified operation.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A human body detection method is applied to a composite sensor, and is characterized in that the composite sensor comprises a main controller, a pyroelectric infrared sensor and a radar sensor, and the method comprises the following steps:

2. The method of claim 1, wherein the determining the human detection result and the corresponding confidence level for the target area based on the second detection result comprises:

3. The method of claim 1, wherein after determining the human detection result and the corresponding confidence level of the target area based on the second detection result, further comprising:

4. The method according to claim 3, wherein after determining that the human body detection result of the target area is the presence of the human body in the case that it is determined that the human body is present in the target area according to the fourth detection result, the method further comprises:

5. The method of claim 4, wherein the method further comprises:

6. The method of claim 5, wherein the method further comprises:

and returning to the step of acquiring the first detection result obtained by detecting the target area by the pyroelectric infrared sensor under the condition that the target area is determined to be unmanned according to the sixth detection result or the fourth detection result.

7. The method according to claim 3, wherein the waking up the main controller in case that it is determined that there is no human body moving in the target area according to the third detection result, turning on an operating power supply of the radar sensor through the main controller, and obtaining a fourth detection result obtained by the radar sensor detecting the target area comprises:

and under the condition that no human body moves in the target area is judged according to the third detection result, when a fourth preset time is reached, waking up the main controller, starting a working power supply of the radar sensor through the main controller, and acquiring a fourth detection result obtained by detecting the target area by the radar sensor.

8. The method of any of claims 1 to 4, further comprising:

and sending a message carrying the human body detection result to corresponding terminal equipment, and controlling the main controller to enter a sleep state.

9. The method of claim 8, wherein prior to controlling the master controller to enter a sleep state, further comprising:

and the triggering interruption of the pyroelectric infrared sensor is closed through the main controller.

10. The method of claim 9, wherein before obtaining a third detection result obtained by the pyroelectric infrared sensor detecting the target area, the method further comprises:

and triggering interruption and starting of the pyroelectric infrared sensor through the main controller.

11. The method according to any one of claims 1 to 7, wherein after the obtaining of the detection result obtained by the radar sensor detecting the target area, further comprises:

and the working power supply of the radar sensor is turned off through the main controller.

12. The utility model provides a human detection device, is applied to composite sensor, composite sensor includes main control unit, pyroelectric infrared sensor and radar sensor, its characterized in that includes:

the second acquisition module is used for awakening the main controller under the condition that the target area is judged to have human body movement according to the first detection result, starting a working power supply of the radar sensor through the main controller and acquiring a second detection result obtained by detecting the target area by the radar sensor;

13. A composite sensor comprising a master controller, a pyroelectric infrared sensor, a radar sensor, a processor, a memory and a computer program stored on and executable by the processor, the computer program when executed by the processor implementing the human detection method of any one of claims 1 to 11.

14. The composite sensor of claim 13, further comprising a battery for powering the master controller, the pyroelectric infrared sensor, the radar sensor, the processor and the memory.

15. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the human detection method according to any one of claims 1 to 11.

16. A human body detection system, comprising a composite sensor, a terminal device in communication connection with the composite sensor, and a controlled device in communication connection with the terminal device, wherein the composite sensor may be the composite sensor of claim 13 or 14, and wherein the composite sensor sends a human body detection result and a corresponding confidence level to the terminal device; and the terminal equipment sends a pre-configured control instruction to the controlled equipment according to the human body detection result and the corresponding credibility so as to control the controlled equipment to execute specified operation.