WO2017132930A1

WO2017132930A1 - Internet of things smart caregiving method

Info

Publication number: WO2017132930A1
Application number: PCT/CN2016/073464
Authority: WO
Inventors: 武克易
Original assignee: 武克易
Priority date: 2016-02-04
Filing date: 2016-02-04
Publication date: 2017-08-10

Abstract

An Internet of Things smart caregiving method, comprising the following steps: acquiring a scene image in a safe condition and a scene image in a dangerous condition containing a caregiving target in a continuously changing scene inputted by a user and, at the same time, acquiring information inputted by the user for setting a highest preset value and a lowest preset value for an external audio signal; acquiring in real-time video information of a pending caregiving scene, external temperature change information, and an external audio signal; determining whether a caregiving target is in an abnormal condition; determining whether caregiving ambient sound is abnormal; determining whether caregiving ambient temperature is abnormal; when the caregiving target is in the abnormal condition, the caregiving ambient temperature is abnormal, or the caregiving ambient sound is abnormal, generating an abnormal condition alarm instruction; and, when the caregiving target is in the abnormal condition, generating an abnormal condition alarm instruction, thus achieving the goal of protecting the caregiving target.

Description

IoT device intelligent care method

Technical field

The present invention relates to the field of intelligent hardware technologies, and more particularly to an intelligent care method for an Internet of Things device.

Background technique

With the development of science and technology and the improvement of people's living standards, people's requirements for convenient and fast living environment are getting higher and higher, and smart home systems have emerged. The smart home system is a combination of modern electronic technology, communication technology and automation technology. It can realize automatic control and management of household electrical appliances and monitor and alarm the safety of the home, so as to provide users with safe, comfortable, efficient and convenient life. surroundings. In the current smart home system, the IoT device used for surveillance video can realize 24-hour real-time surveillance video, but it is not smart enough to carry out targeted home care.

For example, when baby monitoring or patient monitoring is required, ordinary surveillance video can only record the real-time recording of the screen, and can not make timely feedback according to the changes of the screen condition, and the objects that need to be monitored are generally prone to dangerous situations. Objects, such as failing to provide timely feedback when they are in danger, are likely to have irreversible consequences.

Summary of the invention

The technical problem to be solved by the present invention is to provide an intelligent care method for an Internet of Things device in view of the above-mentioned drawbacks of the prior art.

The technical solution adopted by the present invention to solve the technical problem thereof is:

Constructing an intelligent care method for the Internet of Things device, which includes the following steps:

Obtaining a scene image in a safe situation including a care target and a scene image in a dangerous situation in a continuous change scenario input by the user;

Obtaining the highest preset value and the lowest preset value information of the external audio signal set by the user;

Real-time access to the video information of the scene to be watched, external temperature change information and external audio signals;

Obtain real-time video information of the care environment through the camera, and compare and analyze the scene image under the preset security situation and the scene image in the dangerous situation to determine whether the care target has an abnormal condition;

The external audio signal acquired in real time through the microphone, the highest frequency in the external audio signal is higher than the highest preset value, or the care environment sound is abnormal when the lowest frequency in the external audio signal is lower than the lowest preset value ;

The external temperature information detected by the infrared sensor is obtained in real time, and when the external temperature information exceeds the preset temperature value, the temperature of the care environment is considered to be abnormal;

An abnormal condition alarm command is generated when there is an abnormal condition in the care target, an abnormal temperature in the care environment, or an abnormal temperature in the care environment.

The intelligent monitoring method for the Internet of Things device according to the present invention, wherein the real-time video information of the nursing environment is acquired by the camera, and compared with the scene image under the preset security situation and the scene image under the dangerous situation, the nursing target is determined. The steps for whether there is an abnormal situation include:

Using the scene image in the security situation as the first state image, and using the scene image in the dangerous situation as the second state image;

Using an image analysis algorithm, analyzing a first position coordinate of the care target in the first state image, and analyzing a second position coordinate of the care target in the second state image;

Obtaining, according to the motion trajectory algorithm, part or all of the sample trajectories of the care target moving from the first position coordinate to the second position coordinate, and storing;

The actual motion trajectory of the care target in the care screen is drawn by using a motion trajectory algorithm, and the actual motion trajectory is compared with the stored sample trajectory. If the actual motion trajectory is included in the sample trajectory, the There is an abnormal situation in the care target, otherwise the care target is considered to be in a safe state.

The method for intelligently monitoring an Internet of Things device according to the present invention, wherein the Internet of Things device comprises a main body portion, wherein the main body portion is provided with a host device connectable to the Internet and having a data calculation function, and the IoT device intelligently guards The method is fixed in the host device;

The main body portion includes a base and a body mounted on the base;

The camera surface peripheral or embedded with a camera for acquiring a care screen, the camera being electrically connected to the host device through a line;

The body is further provided with one or more microphones for acquiring an external audio signal, and the microphone is connected to the host device through a line;

An infrared sensor for sensing an external infrared signal is further disposed on the body, and the infrared sensor is connected to the host device through a line.

The method for intelligently monitoring an IoT device according to the present invention, wherein acquiring a plurality of the first state images and a plurality of the second state images input by a user are respectively stored as scene images under a safe condition of a care target and in a dangerous situation Scene image.

The method for intelligently monitoring an IoT device according to the present invention, wherein the step of acquiring a scene image in a safe situation of a care target and a scene image in a dangerous situation in a continuous change scenario input by a user includes:

A scene image under the security condition and a scene image in a dangerous situation are read from a storage device connected to the host device.

The intelligent care method for the Internet of Things device of the present invention, wherein the obtaining continuous input of the user The steps of the first state image and the second state image including the care target under the change scenario include:

The first state image and the second state image are read from an external storage device.

The intelligent monitoring method for the Internet of things device of the present invention, wherein the host device is further connected with an abnormality alarm command for generating an abnormal condition in the care module, or an abnormal sound alarm signal generated by the sound assisting module, or The alarm device generates an alarm prompt message when the infrared auxiliary module generates a temperature abnormality alarm signal.

The intelligent monitoring method for the Internet of Things device of the present invention, wherein the alarm prompt information comprises: an audible prompt information, a telephone prompt information, a short message prompt information or an image prompt information.

The method for intelligently monitoring an Internet of Things device according to the present invention, wherein the implementation method further comprises the steps of:

The voice prompt information, the telephone prompt information, the short message prompt information or the image prompt information are transmitted to another smart terminal via the Internet.

The intelligent monitoring method of the Internet of Things device of the present invention, wherein the intelligent terminal is a mobile terminal.

The invention has the beneficial effects of determining whether the care target is in an abnormal or dangerous state by detecting the environmental sound, the image and the temperature information, and causing the intelligent care method of the Internet of Things device to have a professional care function by generating an abnormal condition alarm prompt.

DRAWINGS

The present invention will be further described below in conjunction with the accompanying drawings and embodiments, in which:

1 is a general flow chart of an intelligent care method for an Internet of Things device according to a preferred embodiment of the present invention;

2a is a schematic block diagram 1 of an Internet of Things device according to a preferred embodiment of the present invention;

2b is a schematic block diagram 2 of an Internet of Things device according to a preferred embodiment of the present invention;

3a is a schematic diagram of a first starting position of a care target of an intelligent care method for an Internet of Things device according to a preferred embodiment of the present invention;

FIG. 3b is a schematic diagram showing a first target position of a care target of an intelligent care method for an Internet of Things device according to a preferred embodiment of the present invention; FIG.

3c is a schematic diagram showing a second target position of a care target of the intelligent care method for the Internet of Things device according to the preferred embodiment of the present invention;

3d is a schematic diagram of a virtual trajectory of a care target moving from a first starting position to a first target position in an intelligent care method for an Internet of Things device according to a preferred embodiment of the present invention;

3e is a schematic diagram of a virtual trajectory of a care target moving from a first starting position to a second target position in an intelligent care method for an Internet of Things device according to a preferred embodiment of the present invention;

4a is a schematic diagram of a second starting position of a care target of an intelligent care method for an Internet of Things device according to a preferred embodiment of the present invention;

4b is a schematic diagram showing a third target position of a care target of the intelligent care method for the Internet of Things device according to the preferred embodiment of the present invention;

4c is a schematic diagram showing a fourth target position of a care target of the intelligent care method for the Internet of Things device according to the preferred embodiment of the present invention;

4d is a schematic diagram of a virtual trajectory of a care target moving from a second starting position to a third target position in the intelligent care method of the Internet of Things device according to the preferred embodiment of the present invention;

4e is a schematic diagram of a virtual trajectory of a care target moving from a second starting position to a fourth target position in the intelligent care method of the Internet of Things device according to the preferred embodiment of the present invention.

detailed description

The present invention will be described in detail with reference to the embodiments of the present invention. Not all embodiments. General techniques in the art based on embodiments of the invention All other embodiments obtained by personnel without creative efforts are within the scope of the present invention.

The intelligent care method of the Internet of Things device in the preferred embodiment of the present invention is as shown in FIG. 1 and includes the following steps:

Step S1: acquiring a scene image in a safe situation of the care target and a scene image in a dangerous situation under a continuous change scenario input by the user; specifically, acquiring a plurality of first state images and a plurality of second state images input by the user The scene image in the safe state of the care target and the scene image in the dangerous state are respectively stored; the scene image in the safe state and the scene image in the dangerous state are read from the storage device connected to the host device, or read from the external storage device Taking the first state image and the second state image;

Step S2: acquiring the highest preset value and the lowest preset value information of the set external audio signal input by the user;

Step S3: acquiring video information of the scene to be watched, external temperature change information, and an external audio signal in real time;

Step S4: obtaining real-time video information of the care environment through the camera, and comparing and analyzing the scene image under the preset safety condition and the scene image in the dangerous situation to determine whether the care target has an abnormal condition;

Step S5: The external audio signal obtained by the microphone in real time is considered to be abnormal in the environment of the care environment when the highest frequency in the external audio signal is higher than the highest preset value, or when the lowest frequency in the external audio signal is lower than the lowest preset value;

Step S6: acquiring external temperature information detected by the infrared sensor in real time, and determining that the temperature of the care environment is abnormal when the external temperature information exceeds the preset temperature value;

Step S7, there is an abnormal condition in the care target, the temperature of the care environment is abnormal, or the temperature of the care environment When an abnormality occurs, an abnormal condition alarm command is generated.

The above step S4 specifically includes:

Using the scene image in a safe state as a first state image, and using the scene image in a dangerous state as a second state image;

According to the motion trajectory algorithm, part or all of the sample trajectories of the care target moving from the first position coordinate to the second position coordinate are obtained and stored;

The trajectory algorithm is used to draw the actual motion trajectory of the care target in the care image, and the actual motion trajectory is compared with the stored sample trajectory. If the actual motion trajectory is included in the sample trajectory, the care target is considered to have an abnormal condition, otherwise it is considered as care. The target is in a safe state.

As shown in FIG. 2a and FIG. 2b, the IoT device in the above-mentioned IoT device intelligent care method includes a main body portion, wherein the main body portion is provided with a host device 10 connectable to the Internet and having a data calculation function; the main body portion includes The base and the body mounted on the base; the camera surface peripheral or embedded with the camera 20 for acquiring the care screen. The host device 10 is composed of hardware and/or software, and a plurality of modules may be integrated or discretely arranged, which are connected to the camera 20 through a communication line, and the image data is collected by the camera 20 in real time.

The host device 10 is provided with a care module 11 , and the care module 11 includes: a state setting unit 111, configured to acquire a scene image in a safe situation including a care target and a scene image in a dangerous situation in a continuously changing scene input by the user. And obtaining the highest preset value and the lowest preset value information of the set external audio signal input by the user; wherein the first state image and the second state image may be one image respectively, or may be multiple images in two states respectively .

3a, 3b, 3c respectively show the first starting position in the normal situation where the care target is located A1 and the first target position B1 and the second target position B2 in the abnormal case; FIGS. 3d, 3e respectively show the virtual motion trajectory S1 of the care target from the first starting position A1 to the first target position B1, and from the first The virtual motion trajectory S2 from the start position A1 to the second target position B2.

4a, 4b, 4c respectively show the second starting position A2 in the normal case where the care target is located and the third target position B3 and the fourth target position B4 in the abnormal situation; FIGS. 4d, 4e respectively show The virtual motion trajectory S3 of the care target from the second home position A2 to the third target position B3, and the virtual motion trajectory S4 from the second home position A2 to the fourth target position B4.

According to the above description, FIG. 3a and FIG. 4a are scene images in a normal state, which can be stored as a first state image; FIGS. 3b, 3c, 4b, and 4c are scene images in an abnormal situation, and can be stored as a second state image. .

The above virtual motion trajectory may be a straight line as shown in the figure, or may be a curved line.

It should be understood that each state diagram described is illustrated, and there may be more cases in the actual scenario, which are not enumerated here.

Further, as shown in FIG. 2a and 2b, the above-mentioned care module 11 further includes: an image analyzing unit 112, configured to analyze the first position coordinate of the care target in the first state image by using a known image analysis algorithm, and analyze The second position coordinate of the care target in the second state image. The method further includes: a trajectory analysis unit 113, configured to generate, according to the motion trajectory algorithm, part or all of the sample trajectories of the care target from the first position coordinate to the second position coordinate, and store the image, and use the motion trajectory algorithm to draw the care picture The actual motion trajectory of the target is observed, and the actual motion trajectory is compared with the stored sample trajectory. If the motion trajectory is included in the sample trajectory, it is judged that the care target has an abnormal condition, otherwise the care target is considered to be in a safe state; the instruction generating unit 114, configured to generate an abnormal condition alarm instruction when there is an abnormal condition in the care target.

Thus, by setting the care module 11 in the host device 10, and passing through the state setting unit therein, The image analysis unit and the trajectory analysis unit conclude that the care target is in an abnormal state according to the motion trajectory algorithm, and generate an abnormal condition alarm instruction by the instruction generation unit, so that the intelligent care method of the Internet of Things device has the function of professional care.

In the above method for intelligently monitoring the Internet of Things device, the base or the body is further provided with one or more microphones 30 for acquiring an external audio signal, and the microphone 30 is connected to the host device 10 through a line.

The host device 10 further includes: a sound assisting module 12, configured to analyze an external audio signal acquired by the microphone 30, wherein a highest frequency in the external audio signal is higher than a highest preset value, or a lowest frequency in the external audio signal is lower than At the lowest preset value, an audible abnormality alarm signal is generated.

In the above-mentioned intelligent care method of the Internet of Things device, an infrared sensor for sensing an external infrared signal is further disposed on the base or the body, and the infrared sensor is connected to the host device 10 through a line.

The host device 10 further includes an infrared auxiliary module 13 configured to generate a temperature abnormality alarm signal when the infrared sensor detects an external temperature change.

In the above method for intelligently monitoring the Internet of things device, the host device 10 is further connected with an abnormality alarm command for generating the abnormality alarm signal in the care module 11, or an abnormal sound alarm signal generated by the sound assisting module 12, or when the infrared auxiliary module 13 generates a temperature abnormality alarm signal. An alarm 60 that generates an alarm prompt message.

In the above-mentioned intelligent monitoring method of the Internet of Things device, the alarm prompt information includes: an audible prompt information, a telephone prompt information, a short message prompt information or an image prompt information; the alarm 60 may be an information editor for sending a short message, a buzzer or the like.

In the above method for intelligently monitoring the Internet of Things device, the host device 10 is further connected with the wireless signal transceiving module 50, and communicates through wireless communication technologies such as Bluetooth, so as to transmit the voice prompt information, the telephone prompt information, the short message prompt information or the image prompt information through the Internet. To another smart terminal, such as a smart phone, a smart computer, an intelligent robot, and the like.

In the above-mentioned intelligent care method of the Internet of Things device, preferably, the body is set to be able to rotate 360 degrees. The structure of the gimbal can be set to a stationary state during the nursing process, or the pan/tilt structure can be rotated as needed, and the position of the camera 20 can be changed to adjust the angle of the shooting.

It is to be understood that those skilled in the art will be able to make modifications and changes in accordance with the above description, and all such modifications and variations are intended to be included within the scope of the appended claims.

Claims

An intelligent care method for an Internet of Things device, characterized in that the method comprises the following steps:

Obtaining a scene image in a safe situation including a care target and a scene image in a dangerous situation in a continuous change scenario input by the user;

Obtaining the highest preset value and the lowest preset value information of the external audio signal set by the user;

Real-time access to the video information of the scene to be watched, external temperature change information and external audio signals;

Obtain real-time video information of the care environment through the camera, and compare and analyze the scene image under the preset security situation and the scene image in the dangerous situation to determine whether the care target has an abnormal condition;

The external audio signal acquired in real time through the microphone, the highest frequency in the external audio signal is higher than the highest preset value, or the care environment sound is abnormal when the lowest frequency in the external audio signal is lower than the lowest preset value ;

The external temperature information detected by the infrared sensor is obtained in real time, and when the external temperature information exceeds the preset temperature value, the temperature of the care environment is considered to be abnormal;

An abnormal condition alarm command is generated when there is an abnormal condition in the care target, an abnormal temperature in the care environment, or an abnormal temperature in the care environment.
The method for intelligently monitoring an Internet of Things device according to claim 1, wherein the real-time video information of the care environment is acquired by the camera, and compared with the scene image in a preset security situation and the scene image in a dangerous situation. The steps for judging whether the care target has an abnormal condition include:

Using the scene image in the security situation as the first state image, and using the scene image in the dangerous situation as the second state image;

Using an image analysis algorithm to analyze the first position of the care target in the first state image And simultaneously analyzing the second position coordinate of the care target in the second state image;

Obtaining, according to the motion trajectory algorithm, part or all of the sample trajectories of the care target moving from the first position coordinate to the second position coordinate, and storing;

The actual motion trajectory of the care target in the care screen is drawn by using a motion trajectory algorithm, and the actual motion trajectory is compared with the stored sample trajectory. If the actual motion trajectory is included in the sample trajectory, the There is an abnormal situation in the care target, otherwise the care target is considered to be in a safe state.
The method for intelligently monitoring an Internet of Things device according to claim 1, wherein the object-to-network device comprises a main body portion, and the main body portion is provided with a host device connectable to the Internet and having a data calculation function. a networked device intelligent care method is fixed in the host device;

The main body portion includes a base and a body mounted on the base;

The camera surface peripheral or embedded with a camera for acquiring a care screen, the camera being electrically connected to the host device through a line;

The body is further provided with one or more microphones for acquiring an external audio signal, and the microphone is connected to the host device through a line;

An infrared sensor for sensing an external infrared signal is further disposed on the body, and the infrared sensor is connected to the host device through a line.
The method for intelligently monitoring an Internet of Things device according to claim 1, wherein the plurality of the first state images and the plurality of second state images input by the user are respectively stored as scene images in a safe state of the care target. And scene images in dangerous situations.
The method for intelligently monitoring an Internet of Things device according to claim 3, wherein the step of acquiring a scene image in a safe situation of the care target and a scene image in a dangerous situation in a continuous change scenario input by the user comprises:

A scene image under the security condition and a scene image in a dangerous situation are read from a storage device connected to the host device.
The method for intelligently monitoring an IoT device according to claim 2, wherein the step of acquiring the first state image and the second state image including the care target in the continuously changing scene input by the user comprises:

The first state image and the second state image are read from an external storage device.
The method for intelligently monitoring an IoT device according to claim 3, wherein the host device is further connected with an abnormality alarm command for generating an abnormal condition in the care module, or generating an abnormal sound alarm signal at the sound assisting module, Or an alarm that generates an alarm prompt message when the infrared auxiliary module generates a temperature abnormality alarm signal.
The method for intelligently monitoring an Internet of Things device according to claim 7, wherein the alarm prompt information comprises: voice prompt information, telephone prompt information, short message prompt information or image prompt information.
The method for intelligently monitoring an IoT device according to claim 8, wherein the implementation method further comprises the steps of:

The voice prompt information, the telephone prompt information, the short message prompt information or the image prompt information are transmitted to another smart terminal via the Internet.
The intelligent care method for an Internet of Things device according to claim 9, wherein the smart terminal is a mobile terminal.