WO2018196779A1

WO2018196779A1 - Smart home system and control method thereof

Info

Publication number: WO2018196779A1
Application number: PCT/CN2018/084401
Authority: WO
Inventors: 党广明; 吕剑; 王卫庆; 赵庆海; 王庆福
Original assignee: 青岛海尔股份有限公司
Priority date: 2017-04-28
Filing date: 2018-04-25
Publication date: 2018-11-01
Also published as: CN107102560B; CN107102560A

Abstract

A smart home system and a control method thereof, the method comprising: providing a smart home system, and establishing a back-end database (S1); receiving in real time identity information of a user currently outside the house, and a gesture command issued by same (S2); querying the backend database, determining whether same are consistent with gesture commands and identity information of users inside the house stored in the backend database and, if so, then opening the house door.

Description

Smart home system and control method thereof

The present application claims the priority of the Chinese Patent Application Serial No. JP-A-----------

Technical field

The invention relates to the field of household appliances, in particular to a smart home system with a refrigerator as a main carrier and a control method thereof.

Background technique

The Internet of Things is another wave of global informationization after computer, Internet and mobile communication. It is a new stage of global information development. With the advancement of society and the development of physical network technology, people's pursuit of their own quality of life is also constantly Progress; intelligent home gradually enters people's lives; smart home system is a set of management system related to people's life based on residential buildings as a suitable object, using integrated wiring technology, network communication technology and other hardware platforms; Safety, convenience, comfort, artistry, and environmentally friendly and energy-saving living environment.

Summary of the invention

The object of the present invention is to provide a smart home system and a control method thereof;

In order to achieve the above object, an embodiment of the present invention provides a smart home system, including: a first smart module disposed on a refrigerator, and a second smart module disposed on an outer door of the house, disposed in the Said refrigerator and/or a third intelligent module on the outer door of the house;

The first smart module includes: a first user identification unit, a first gesture recognition unit, a first communication unit, and a first power supply unit;

The second smart module includes: a second user identification unit, a second gesture recognition unit, a second communication unit, and a second power supply unit disposed outside the outer door of the house;

The third intelligent module includes: a control output unit, a background database, a third communication unit, and a third power supply unit;

The first user identification unit is configured to receive identity information of a user in the house;

The first gesture recognition unit is configured to receive a gesture instruction that matches a user in the house;

The second user identification unit is configured to receive identity information of a user outside the house;

The second gesture recognition unit is configured to receive a gesture instruction that matches a user outside the house;

The first intelligent module, the second smart module, and the third smart module are connected by using the first communication unit, the second communication unit, and the third communication unit;

The background database is configured to store identity information of the user respectively received by the first user identification unit and the first gesture recognition unit, and a gesture instruction matching the user in the house;

The control output unit is configured to collect and identify the identification information received by the first smart module and the second smart module, and automatically control the opening of the outer door of the house.

As a further improvement of an embodiment of the present invention, the first smart module further includes: a first sensor for controlling the opening of the first user identification unit and the first gesture recognition unit.

As a further improvement of an embodiment of the present invention, the second smart module further includes: a second sensor for controlling the opening of the second user identification unit and the second gesture recognition unit.

As a further improvement of an embodiment of the present invention, the third smart module further includes: a smart switch for controlling the closing of the first smart module or the second smart module;

The smart switch includes a third sensor disposed inside the outer door of the house and a fourth sensor disposed outside the outer door of the house.

To achieve one of the above objects, an embodiment of the present invention provides a method for controlling a smart home system, the method comprising: establishing a background database;

Real-time receiving the identity information of the user outside the current home, and the gesture command issued by the user;

Querying the background database, determining the identity information of the user outside the current home, and the gesture instruction issued by the user, and the identity information of the user in the house stored in the background database and the gesture instruction matched thereto are the same.

If they are the same, open the outer door of the house.

As a further improvement of an embodiment of the present invention, the establishing the background database specifically includes: receiving identity information of a user in the real-time room in real time, and recording identity information of the same user received multiple times within a predetermined time interval as a valid number of times;

If the effective number of the identity information corresponding to the same user is equal to the system preset number threshold, the command prompts to input the gesture command corresponding to the current user;

The identity information corresponding to the current user and the gesture instruction are recorded to form the background database.

As a further improvement of an embodiment of the present invention, the first smart module further includes: a first sensor disposed on the refrigerator;

The method further includes:

Real-time determining whether the first sensor receives an input signal,

If yes, the first user identification unit and the first gesture recognition unit are activated.

As a further improvement of an embodiment of the present invention, the second smart module further includes: a second sensor disposed outside the outer door of the house;

The method further includes:

Real-time determining whether the second sensor receives an input signal,

If yes, the second user identification unit and the second gesture recognition unit are activated.

As a further improvement of an embodiment of the present invention, the third smart module further includes: a smart switch disposed on the outer door of the house;

The smart switch includes: a third sensor disposed inside the outer door of the house; and a fourth sensor disposed outside the outer door of the house;

The method further includes:

If the identity information of the user outside the current home is the same as the identity information of the user in the back-end database in the second preset time threshold range, after receiving the input signal through the third sensor and the fourth sensor in sequence , issuing a first pre-close command, and recording the number of times the first pre-close command is received;

If the identity information of the user outside the current home is the same as the identity information of the user in the back-end database in the second preset time threshold range, after receiving the input signal through the fourth sensor and the third sensor in sequence , issuing a second pre-close command, and recording the number of times the second pre-close command is received;

The first smart module or the second smart module is turned on or off according to the number of times of receiving the first pre-close command and the second pre-close command.

As a further improvement of an embodiment of the present invention, the method specifically includes:

Each time the first pre-close command is received, the number of times of the first pre-close command is counted by +1, and the number of times of the second pre-close command is counted by -1 until it is zero;

Each time the second pre-close command is received, the number of times of the second pre-close command is counted by +1, and the number of times of the first pre-close command is counted by -1 until it is zero;

Determining whether the number of times of receiving the first pre-close command is equal to a threshold value of the first preset shutdown command of the system, and if so, turning off the first smart module and simultaneously opening the second smart module;

The method determines whether the number of times of receiving the second pre-close command is equal to a threshold of the second preset off command of the system, and if yes, turning off the second smart module, and simultaneously turning on the first smart module.

Compared with the prior art, the technical effect of the present invention is that the smart home system and the control method thereof of the present invention self-learn to identify the identity information of family members in the house through the first intelligent module provided on the refrigerator, and open the door Gesture instruction; further, by combining the second intelligent module on the outer door of the house and the third module disposed on the refrigerator, the user outside the house can be actively identified, thereby automatically opening the outer door of the house, thus avoiding the owner of the house Forget the key to the key, at the same time, the recognition result is more accurate, to avoid the loss caused by the wrong opening of the door. Further, the hardware and software execution procedures involved mostly use the refrigerator necessary in the existing family life as a carrier to save hardware. Overhead, and save space.

DRAWINGS

1 is a schematic block diagram of a smart home system according to an embodiment of the present invention;

2 is a schematic flow chart of a control method of a smart home system according to an embodiment of the present invention.

detailed description

The invention will be described in detail below in conjunction with the specific embodiments shown in the drawings. However, the embodiments are not intended to limit the invention, and the structural, method, or functional changes made by those skilled in the art in accordance with the embodiments are included in the scope of the present invention.

As shown in FIG. 1 , an embodiment of the present invention provides a smart home system, including: a first smart module 10 disposed on a refrigerator, and a second smart module 20 disposed on an outer door of the house. And a third smart module 30 disposed on the refrigerator and/or the outer door of the house; the first smart module 10 includes: a first user identification unit 11, a first gesture recognition unit 13, and a first The communication unit 15 and the first power supply unit 17; the second smart module 20 includes: a second user identification unit 21 disposed outside the outer door of the house, a second gesture recognition unit 23, a second communication unit 25, and The second power supply unit 27 includes: a control output unit 31, a background database 33, a third communication unit 35, and a third power supply unit 37.

The first user identification unit 11 is configured to receive identity information of a user in the house; the first gesture recognition unit 13 is configured to receive a gesture instruction that matches a user in the house; and the second user identification unit 21 is configured to receive Identity information of the user outside the house; the second gesture recognition unit 23 is configured to receive a gesture instruction that matches the user outside the house; the first smart module 10, the second smart module 20, and the third smart module The communication connection is performed by the first communication unit 15, the second communication unit 25, and the third communication unit 35; the background database 33 is configured to store the first user identification unit 11 and the first gesture respectively. The identity information of the user that is received by the unit 13 and the gesture command that matches the user in the house; the control output unit 31 is configured to collect the identification information received by the first smart module 10 and the second smart module 20, and For comparison, the door opening of the house is automatically controlled.

In the specific embodiment of the present invention, the first user identification unit 11 may be a camera disposed outside the refrigerator, specifically, a camera disposed outside the door of the refrigerator, and the position of the camera may be adjusted according to needs, during use, The illumination angle of the camera can also be adjusted as needed, and will not be described in detail here. The first gesture recognition unit 13 may be a camera that adopts a two-dimensional recognition technology or a three-dimensional recognition technology, or may be a radar that can recognize gesture commands, etc., of course, in an embodiment of the present invention, the first user identification unit 11 The first gesture recognition unit 13 can also be integrated on the same camera, and details are not described herein.

Correspondingly, the first user identification unit 11 is configured to identify an image corresponding to a user in a house and within a certain distance of the refrigerator, and then convert the image into a corresponding user identity information, and store it according to a preset identification rule. In the background database 33, the following will be described in detail.

The first gesture recognition unit 13 cooperates with the first user identification unit 11 to identify the gesture action sent by the current user, and then converts it into a specific gesture instruction corresponding to the user who sends the gesture action, and It is stored in the backend database 33 for use in refining the data in the backend database.

The second user identification unit 21 can be a camera disposed outside the outer door of the house. Correspondingly, the position of the camera can be adjusted according to needs. During use, the illumination angle of the camera can also be adjusted according to needs. Detailed description. The second gesture recognition unit 23 may be a camera that adopts a two-dimensional recognition technology or a three-dimensional recognition technology, or may be a radar that can recognize gesture commands, etc., of course, in an embodiment of the present invention, the second user identification unit 21 and the second gesture recognition unit 23 can also be integrated on the same camera, and will not be described in detail herein.

Correspondingly, the second user identification unit 21 is configured to identify an image corresponding to the user who is outside the house and within a certain distance from the second user identification unit 21, and then convert the image into the corresponding user identity information and send it. To the background database 33 for comparison with the data stored in the background database 33; further, the second gesture recognition unit 23 cooperates with the second user identification unit 21 to identify the current user Gesture action, which in turn is converted into a specific gesture instruction corresponding to the user who issued the gesture action, and is also sent to the background database 33 for comparison with the data stored in the background database 33; when the second user When the information received by the recognition unit 21 and the second gesture recognition unit 23 completely matches the information of the background database 33, the external door of the house is automatically opened, so that the owner of the house is forgotten to forget the key with the key, and the recognition result is more accurate and avoids. The loss caused by the wrong opening of the door, further, the hardware and software execution procedures involved It is divided into the necessary refrigerators in the existing family life to save hardware overhead and save space.

Preferably, the first smart module 10 further includes: a first sensor 19 for controlling the opening of the first user identification unit 11 and the first gesture recognition unit 13; the first sensor 19 may be an infrared sensor, The distance sensor and the like can receive the input signal in real time when the user approaches a certain distance, and further control the first user identification unit 11 and the first gesture recognition unit 13 to be turned on. In this way, the energy consumption of the refrigerator can be saved.

Preferably, the second smart module 20 further includes: a second sensor 27 for controlling the opening of the second user identification unit 21 and the second gesture recognition unit 23. The second sensor 29 can also be a component such as an infrared sensor and a distance sensor. When a user approaches a certain distance, the user can respond to the received input signal in real time, and further control the second user identification unit 21 and The second gesture recognition unit 23 is turned on. In this way, the energy consumption of the refrigerator can be saved.

Preferably, the third smart module 30 further includes: a smart switch (not shown) for controlling the closing of the first smart module 10 or the second smart module 20;

The smart switch includes a third sensor 391 disposed inside the outer door of the house and a fourth sensor 393 disposed outside the outer door of the house.

The third sensor 391 and the fourth sensor 393 can also be components such as an infrared sensor and a distance sensor. When a user approaches a certain distance, the user can respond to the input signal in real time and further control through the mutual cooperation. The opening or closing of the first smart module 10 and the second smart module 20 can save energy consumption of the refrigerator.

Of course, in a specific embodiment of the present invention, the smart home system may further include: a display module (not shown) for displaying information of the stored items in the refrigerator, and the first smart module 10, the second The information received by the smart module 20 and the third smart module 30; the display module can also be used to input a gesture command; correspondingly, the display module can be disposed on the refrigerator or at the same time on the outer door of the house. The smart home system may further include: a reminding module (not shown), the reminding module is configured to issue a voice reminder, for example, prompting the user to input a gesture instruction; or setting the outside of the outer door of the house, when determining an illegal user When the outer door is opened, an alarm is issued and will not be described in detail here.

Further, as described in conjunction with FIG. 2, an embodiment of the present invention provides a control method for a smart home system as described above, the method comprising:

S1, establishing a background database;

In a preferred embodiment of the present invention, the step S1 specifically includes:

Receiving the identity information of the user in the house in real time, and recording the identity information of the same user received multiple times in the predetermined time interval as a valid number of times;

In this embodiment, the first user identification unit receives the identity information of the user in the real-time in real time, and through the mutual communication between the first communication unit and the second communication unit, sends the received information to the control output unit for processing to form a background. database.

The predetermined time interval, the preset time threshold, and the system preset number threshold may be set as needed; for example, the preset time threshold is set to one week, and the predetermined time interval is set to 12 hours, The system preset number threshold is 10 times;

Within one week, the number of valid times that the user in the house is recognized every 12 hours is 1 time. When the number of valid times is equal to 10 times, an instruction is given to input a gesture instruction corresponding to the current user; and the identity information corresponding to the current user is recorded and Gesture instructions to form the backend database. In this way, it is possible to avoid misidentification of the visitor, thereby creating a security risk.

Of course, the back-end database can also be customized by the user in the house, and the database is encrypted and protected to prevent other users from misoperation, and will not be described in detail herein.

Preferably, the step S1 further includes: determining, in real time, whether the first sensor receives an input signal, and if so, initiating the first user identification unit and the first gesture recognition unit. In this way, the energy consumption of the refrigerator can be saved.

Further, the control method further includes:

S2, receiving the identity information of the user outside the current home in real time, and the gesture instruction issued by the user;

Query the background database, determine the identity information of the user outside the current home, and the gesture command issued by the user and the identity information of the user in the back-end database and the gesture command matched with the same, if the same, open the door of the house .

Correspondingly, the second user identification unit is configured to identify an image corresponding to the user who is outside the house and within a certain distance from the second user identification unit, and then convert the image into the corresponding user identity information, and send it to the background. The database is compared with the data stored in the background database; further, the second gesture recognition unit and the second user identification unit cooperate to identify the gesture action sent by the current user, and then Converting to a specific gesture instruction corresponding to the user who sends the gesture action, and also sending it to the background database for comparison with the data stored in the background database; when the second user identification unit and the second gesture recognition When the information received by the unit and the information of the back-end database completely match, the external door of the house is automatically opened. Thus, the owner of the house is forgotten to forget the key with the key, and at the same time, the recognition result is more accurate, and the loss caused by the wrong opening of the door is avoided. Further, The hardware and software execution programs involved are mostly based on existing families. Essential in the refrigerator as the carrier, save hardware costs, as well as save space.

Further, the step S2 further includes: determining, in real time, whether the second sensor receives an input signal, and if so, initiating the second user identification unit and the second gesture recognition unit. In this way, the energy consumption of the refrigerator can be saved.

In a preferred embodiment of the present invention, the method further includes:

In a specific implementation manner of the present invention, each time the first pre-close command is received, the number of times of the first pre-close command is counted by +1, and the number of times of the second pre-close command is counted by -1 until zero. ;

The first preset close command threshold and the second preset close command threshold may be set according to user requirements, and may also be adjusted according to the number of users storing the user in the current background database, and do not do this. Detailed description.

As described above, when all the users in the house are inside the house, the second intelligent module is completely closed, that is, the input signal is no longer received, and the non-homeowner outside the house is prevented from maliciously operating the second intelligent module, thereby saving energy. Improve the safety of the house.

When all the users in the house leave the house, the first smart module is completely closed, so that the refrigerator is in an optimal energy-saving state, and the malicious home system is prevented from being maliciously operated when the inside of the house enters other people.

In other embodiments of the present invention, the lighting and other electrical appliances in the house may be added to the smart home system. When it is determined that all the users in the house leave the house, the lights and other electrical appliances in the house are turned off to the optimal energy-saving state. In this way, the cost of household expenses is further reduced, and no detailed description is made here.

In summary, the smart home system and the control method thereof of the present invention self-learn by the first intelligent module provided on the refrigerator to identify the identity information of the family members in the house, and the door opening gesture instruction; further The second intelligent module on the outer door and the third module disposed on the refrigerator can automatically open the outer door of the house by actively identifying the user outside the house, so as to avoid the owner forgetting to carry the key, and at the same time, The recognition result is more precise, avoiding the loss caused by the wrong opening of the door. Further, the hardware and software execution programs involved mostly use the refrigerator necessary in the existing family life as a carrier, saving hardware overhead and saving space.

For the convenience of description, the above devices are described as being separately divided into various modules by function. Of course, the functions of each module can be implemented in the same software or software and/or hardware when implementing the present application.

It should be understood that, although the description is described in terms of embodiments, the embodiments are not intended to be construed as a single. The technical solutions in the embodiments may also be combined as appropriate to form other embodiments that can be understood by those skilled in the art.

The series of detailed descriptions set forth above are merely illustrative of the possible embodiments of the present invention, and are not intended to limit the scope of the present invention. Changes are intended to be included within the scope of the invention.

Claims

A smart home system, comprising: a first smart module disposed on a refrigerator; a second smart module disposed on an outer door of the house, disposed on the refrigerator and/or the outer door of the house The third intelligent module;

The first smart module includes: a first user identification unit, a first gesture recognition unit, a first communication unit, and a first power supply unit;

The second smart module includes: a second user identification unit, a second gesture recognition unit, a second communication unit, and a second power supply unit disposed outside the outer door of the house;

The third intelligent module includes: a control output unit, a background database, a third communication unit, and a third power supply unit;

The first user identification unit is configured to receive identity information of a user in the house;

The first gesture recognition unit is configured to receive a gesture instruction that matches a user in the house;

The second user identification unit is configured to receive identity information of a user outside the house;

The second gesture recognition unit is configured to receive a gesture instruction that matches a user outside the house;

The first intelligent module, the second smart module, and the third smart module are connected by using the first communication unit, the second communication unit, and the third communication unit;

The background database is configured to store identity information of the user respectively received by the first user identification unit and the first gesture recognition unit, and a gesture instruction matching the user in the house;

The control output unit is configured to collect and identify the identification information received by the first smart module and the second smart module, and automatically control the opening of the outer door of the house.
The smart home system according to claim 1, wherein the first smart module further comprises: a first sensor for controlling the opening of the first user identification unit and the first gesture recognition unit.
The smart home system according to claim 1, wherein the second smart module further comprises: a second sensor for controlling the opening of the second user identification unit and the second gesture recognition unit.
The smart home system according to claim 1, wherein the third smart module further comprises:

a smart switch for controlling the closing of the first smart module or the second smart module;

The smart switch includes a third sensor disposed inside the outer door of the house and a fourth sensor disposed outside the outer door of the house.
A method for controlling a smart home system according to claim 1, wherein the method comprises:

Establish a back-end database;

Real-time receiving the identity information of the user outside the current home, and the gesture command issued by the user;

Querying the background database, determining the identity information of the user outside the current home, and the gesture instruction issued by the user, and the identity information of the user in the house stored in the background database and the gesture instruction matched thereto are the same.

If they are the same, open the outer door of the house.
The method for controlling a smart home system according to claim 5, wherein the establishing the background database specifically comprises:

Receiving the identity information of the user in the house in real time, and recording the identity information of the same user received multiple times in the predetermined time interval as a valid number of times;

If the effective number of the identity information corresponding to the same user is equal to the system preset number threshold, the command prompts to input the gesture command corresponding to the current user;

The identity information corresponding to the current user and the gesture instruction are recorded to form the background database.
A method of controlling a smart home system according to claim 5, characterized in that

The first smart module further includes: a first sensor disposed on the refrigerator;

The method further includes:

Real-time determining whether the first sensor receives an input signal,

If yes, the first user identification unit and the first gesture recognition unit are activated.
A method of controlling a smart home system according to claim 5, characterized in that

The second smart module further includes: a second sensor disposed outside the outer door of the house;

The method further includes:

Real-time determining whether the second sensor receives an input signal,

If yes, the second user identification unit and the second gesture recognition unit are activated.
A method of controlling a smart home system according to claim 5, characterized in that

The third intelligent module further includes: a smart switch disposed on the outer door of the house;

The smart switch includes: a third sensor disposed inside the outer door of the house; and a fourth sensor disposed outside the outer door of the house;

The method further includes:

If the identity information of the user outside the current home is the same as the identity information of the user in the back-end database in the second preset time threshold range, after receiving the input signal through the third sensor and the fourth sensor in sequence , issuing a first pre-close command, and recording the number of times the first pre-close command is received;

If the identity information of the user outside the current home is the same as the identity information of the user in the back-end database in the second preset time threshold range, after receiving the input signal through the fourth sensor and the third sensor in sequence , issuing a second pre-close command, and recording the number of times the second pre-close command is received;

The first smart module or the second smart module is turned on or off according to the number of times of receiving the first pre-close command and the second pre-close command.
The method for controlling a smart home system according to claim 9, wherein the method specifically comprises:

Each time the first pre-close command is received, the number of times of the first pre-close command is counted by +1, and the number of times of the second pre-close command is counted by -1 until it is zero;

Each time the second pre-close command is received, the number of times of the second pre-close command is counted by +1, and the number of times of the first pre-close command is counted by -1 until it is zero;

Determining whether the number of times of receiving the first pre-close command is equal to a threshold value of the first preset shutdown command of the system, and if so, turning off the first smart module and simultaneously opening the second smart module;

The method determines whether the number of times of receiving the second pre-close command is equal to a threshold of the second preset off command of the system, and if yes, turning off the second smart module, and simultaneously turning on the first smart module.