WO2018232945A1

WO2018232945A1 - Motion sensing interaction-based smart home service terminal, control system and control method

Info

Publication number: WO2018232945A1
Application number: PCT/CN2017/098022
Authority: WO
Inventors: 杜光东
Original assignee: 深圳市盛路物联通讯技术有限公司
Priority date: 2017-06-23
Filing date: 2017-08-18
Publication date: 2018-12-27
Also published as: CN107272902A; CN107272902B

Abstract

The present invention comprises a motion sensing interaction-based smart home service terminal, control system and control method, the service terminal comprising: a first receiving module, used to receive coding of a device to be controlled sent by a control apparatus; a second receiving module, used to receive operator motion sensing data collected by a motion capture device; an instruction generating module, used to match the motion sensing data with pre-stored motion sensing data, and search for a corresponding control instruction according to the matched motion sensing data; an instruction sending module, used to send said control instruction to be executed in a device to be controlled corresponding to the coding of the device to be controlled. The present invention can help people, especially the visually impaired, to conveniently control any electronic device, capturing movements of an operator, obtaining motion sensing data, and obtaining a matching control instruction, thereby controlling a corresponding electronic device and realizing good human-machine interaction.

Description

Smart home server, control system and control method based on somatosensory interaction

Technical field

The invention relates to the technical field of smart home control, in particular to a smart home server, a control system and a control method based on somatosensory interaction.

Background technique

People with visual impairments have great obstacles in their daily lives because they cannot see or see things in their eyes. For example, they cannot open or close various electrical equipment, and they need to rely on other people everywhere, causing them to bear a lot of pressure. And an electrical device is equipped with a remote control. It is too difficult for visually impaired people to distinguish between different remote controls. With the maturity of smart home IoT technology and somatosensory technology, how to control people's electrical equipment through human-computer interaction technology, especially visually impaired people, is the direction that needs to be studied.

Summary of the invention

In order to solve the above technical problem, the present invention provides a smart home server, a control system and a control method based on somatosensory interaction.

In a first aspect, the present invention provides a smart home server based on somatosensory interaction, including:

a first receiving module, configured to receive a device code to be controlled sent by the control device;

a second receiving module, configured to receive the operator's somatosensory data collected by the motion capture device;

An instruction generating module, configured to match the somatosensory data with pre-stored somatosensory data, and find a corresponding control instruction according to the matched somatosensory data;

And an instruction sending module, configured to send the control instruction to be executed in a device to be controlled corresponding to the device code to be controlled.

The beneficial technical effect of the above solution is that when controlling an electrical device, the problem of finding a corresponding remote controller in a plurality of remote controllers can be avoided, and the problem of misoperation when adjusting the volume or temperature is avoided, thereby helping people, especially vision. The obstacle group conveniently controls each electrical device, can capture the action of the operator, obtain the somatosensory data, and then obtain corresponding control commands to control the corresponding electrical equipment, thereby achieving good human-computer interaction.

Further, in the instruction generating module, the pre-stored somatosensory data includes gesture-up somatosensory data, gesture-down body-sensing data, upward-looking somatosensory data, and downward-looking somatosensory data, the gesture-up sense of body Both the data and the upward sensing data correspond to a control command for increasing the volume of the television and a control command for raising the temperature of the air conditioner, the downward somatosensory data and the downward looking somatosensory data corresponding to the television volume reduction. Control commands for control commands and air conditioning temperature reduction.

The beneficial technical effect of the above solution is that the most commonly used TV volume and air conditioning temperature can be adjusted to help the visually impaired person to more accurately control the electrical equipment.

Further, the device state obtaining module is configured to: when the device to be controlled completes the control instruction, read a current parameter value of the device to be controlled, and send the parameter value to the voice The module broadcasts.

For example, if the device to be controlled is an air conditioner, the current state of the air conditioner is monitored, and the air conditioner is obtained. The previous temperature value is broadcasted by the voice module to the current temperature value.

The beneficial technical effect of the above solution is to help the visually impaired person to know the current parameter value of the device to be controlled, so as to facilitate the operation thereof more accurately.

Further, the server further includes a standby processing module, configured to detect whether the instruction sending module sends an instruction to the to-be-controlled device within a preset time period, and if not sent, enters standby status.

The beneficial technical effect of the above solution is that the power consumption can be saved, the working time of the server is reduced, and the service life is improved.

In a second aspect, the present invention provides a smart home control method based on somatosensory interaction, which is applied to a server, and includes the following steps:

Receiving a device code to be controlled sent by the control device;

Receiving the operator's somatosensory data collected by the motion capture device;

Matching the somatosensory data with the pre-stored somatosensory data, and finding a corresponding control instruction according to the matched somatosensory data;

Sending the control instruction to the device to be controlled corresponding to the device code to be controlled for execution.

Further, the pre-stored somatosensory data includes gesture-up somatosensory data, gesture-down body-sensing data, upward-looking somatosensory data, and downward-looking somatosensory data, the gesture-up somatosensory data and the upward-looking body feeling The data corresponds to a control command for increasing the volume of the television and a control command for raising the temperature of the air conditioner, and the down-sensing data of the gesture and the somatosensory data of the downward head both correspond to the control command for reducing the volume of the television and the temperature of the air conditioner is lowered. Control instruction.

Further, the method may further include: when the device to be controlled completes the control instruction, reading a current parameter value of the device to be controlled, and broadcasting the parameter value.

For example, if the device to be controlled is an air conditioner, the current state of the air conditioner is monitored, and the current temperature value of the air conditioner is obtained, and the current temperature value is broadcasted by the voice module.

Further, the method may further include the step of: entering a standby state when the instruction is not sent to the device to be controlled within the preset time period.

In a third aspect, the present invention provides a smart home control system based on somatosensory interaction, including a control device, a motion capture device, and the smart home server;

The control device is provided with a plurality of buttons on the outer surface thereof, and the plurality of buttons are respectively corresponding to the device to be controlled, and when the shortcut button is pressed, the corresponding device to be controlled code is sent to the smart home server;

The motion capture device includes an infrared emitter, a CMOS sensor, and a processor;

The infrared light emitter is configured to emit infrared rays;

The CMOS sensor for detecting infrared rays reflected from the operator to capture an operator's motion;

The processor is configured to convert the infrared ray into three-dimensional coordinates, determine a position of each point in the space, generate somatosensory data, and send the somatosensory data to a server;

The server matches the somatosensory data with the pre-stored somatosensory data, and finds a corresponding control instruction according to the matched somatosensory data;

DRAWINGS

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from

FIG. 1 is a block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention;

2 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention;

3 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention;

4 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention;

FIG. 5 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention; FIG.

FIG. 6 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention;

FIG. 7 is a block diagram of a module of a motion capture apparatus according to an embodiment of the present invention;

FIG. 8 is a flowchart of another method for a smart home control method based on a somatosensory interaction according to an embodiment of the present invention;

FIG. 9 is a flowchart of another method for a smart home control method based on somatosensory interaction according to an embodiment of the present invention;

10 is a flowchart of another method for a smart home control method based on somatosensory interaction according to an embodiment of the present invention;

FIG. 11 is a flowchart of another method for a smart home control method based on somatosensory interaction according to an embodiment of the present invention;

FIG. 12 is a schematic diagram of signaling flow of a smart home server and a control device according to an embodiment of the present invention;

FIG. 13 is a schematic diagram of connection between a smart home server and a control device according to an embodiment of the present invention.

Detailed ways

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are intended to be illustrative of the invention and are not to be construed as limiting.

In the description of the present invention, it is to be understood that the terms "center", "longitudinal", "transverse", "upper", Orientation or position of indications such as "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc. The relationship is based on the orientation or positional relationship shown in the drawings, and is merely for the convenience of the description of the invention and the simplification of the description, and does not indicate or imply that the device or component referred to has a specific orientation, is constructed and operated in a specific orientation, and thus It is not to be understood as limiting the invention. Moreover, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

In the description of the present invention, it should be noted that the terms "installation", "connected", and "connected" are to be understood broadly, and may be fixed or detachable, for example, unless otherwise explicitly defined and defined. Connected, or integrally connected; can be mechanical or electrical; can be directly connected, or indirectly connected through an intermediate medium, can be the internal communication of the two components. The specific meaning of the above terms in the present invention can be understood in a specific case by those skilled in the art.

These and other aspects of the embodiments of the present invention will be apparent from the description and appended claims. In the description and drawings, specific embodiments of the embodiments of the invention are disclosed This limit. Rather, the invention is to cover all modifications, variations and equivalents within the spirit and scope of the appended claims.

People with visual impairments have great obstacles in their daily lives because they cannot see or see things in their eyes. For example, they cannot open or close various electrical equipment, and they need to rely on other people everywhere, causing them to bear a lot of pressure. With the maturity of smart home IoT technology and somatosensory technology, how to control people's electrical equipment through human-computer interaction technology, especially visually impaired people, is the direction that needs to be studied.

The embodiments of the present invention provide a smart home server, a control system, and a control method based on somatosensory interaction to solve the above technical problems. Each solution is described in detail below with reference to the accompanying drawings.

As shown in FIG. 1 , an embodiment of the present invention provides a smart home server based on somatosensory interaction, including:

a first receiving module 01, configured to receive a device code to be controlled sent by the control device;

The second receiving module 02 is configured to receive the somatosensory data of the operator collected by the motion capture device;

The instruction generating module 03 is configured to match the somatosensory data with the pre-stored somatosensory data, and find a corresponding control instruction according to the matched somatosensory data;

The instruction sending module 04 is configured to send the control instruction to be executed in a device to be controlled corresponding to the device code to be controlled.

The command generating module 03 is specifically configured to: save the pre-stored somatosensory data and the corresponding control command; and specifically, to match the somatosensory data collected by the motion capture device with the pre-stored somatosensory data, according to the matched The pre-stored somatosensory data finds the corresponding control command.

In the above embodiment, when controlling an electrical device, the problem of finding a corresponding remote controller in a plurality of remote controllers can be avoided, and the problem of misoperation when adjusting the volume or temperature can be avoided, which is convenient for people, especially visually impaired people. The control of each electrical device can capture the operator's movements, obtain the somatosensory data, and then obtain corresponding control commands to control the corresponding electrical equipment, thereby achieving good human-computer interaction.

Specifically, in the instruction generating module 03, the pre-stored somatosensory data may include a gesture-up body number According to the sensory data of the gesture down, the somatosensory data of the upward head, and the somatosensory data of the downward head, the gesture-up somatosensory data and the upward-sense somatosensory data correspond to the control command of the TV volume increase and the air-conditioning temperature. The elevated control command, the gesture down sensation data and the downward head sensation data all correspond to a control command for decreasing the volume of the television and a control command for decreasing the temperature of the air conditioner.

In the above embodiment, the most commonly used TV volume and air conditioning temperature can be adjusted to help the visually impaired person to more accurately control the electrical equipment. The present invention is not limited to the above-described control of the above-described electrical equipment, and control of other parameters of other electrical equipment is also within the scope of the present invention.

2 is a block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention;

Optionally, as an embodiment of the present invention, as shown in FIG. 2, the server may further include a connection module 00, where the connection module 00 is configured to receive a connection request sent by the control device, and The network is connected to the control device.

In the foregoing embodiment, specifically, the server and the control device may be interconnected by using a Bluetooth connection mode or a ZigBee connection mode.

Optionally, as an embodiment of the present invention, on the basis of the embodiment shown in FIG. 1, as shown in FIG. 3, the server further includes a guiding module 05 and a voice connected to the first receiving module 01. Module 06,

The guiding module 05 is configured to acquire positioning information of the control device in real time, and generate a voice guiding the operator to approach the motion capturing device according to the positioning information;

The voice module 06 is configured to broadcast the voice.

Specifically, on the basis of the embodiment shown in FIG. 3, as shown in FIG. 4, the guiding module includes a positioning unit 051 and a navigation unit 052.

The positioning unit 051 is configured to set a distance range value between the server and the control device, and acquire positioning information of the control device in real time, and calculate a distance between the current location of the control device and the server according to the positioning information 051. Whether the difference is less than or equal to the distance range value, and if so, sending an instruction to the voice module 06;

The voice module 06 is specifically configured to: play a voice that has reached the control area according to the instruction;

The navigation unit 052 is configured to generate navigation information according to real-time positioning information of the control device and location information of the server, and convert the navigation information into an audio file, and send the audio file to the voice Module 06;

The voice module 06 is further configured to perform voice broadcast on the audio file.

In the above embodiment, the operator holds the control device, and the server determines the position of the control device in real time, and helps the operator to move to the control area by means of voice navigation. For the visually impaired, although the eyes are invisible, the voice can be passed. Move smoothly to the control area for operation.

Optionally, as an embodiment of the present invention, on the basis of the embodiment shown in FIG. 1, as shown in FIG. 6, the device state obtaining module is further configured to be used when the device to be controlled completes. When the control instruction is described, the current parameter value of the device to be controlled is read, and the parameter value is sent to the voice module for broadcast.

For example, the device to be controlled is an air conditioner. When the air conditioner completes the control command, the current parameter value of the air conditioner is read, and the current temperature value is broadcasted by the voice module.

In the above embodiment, the visually impaired person is helped to know the current parameter value of the device to be controlled, so as to facilitate the operation thereof more accurately.

Optionally, as an embodiment of the present invention, on the basis of the embodiment shown in FIG. 1, as shown in FIG. 7, the server further includes a standby processing module 08, and the standby processing module 08 is used to pre- It is determined whether the instruction sending module sends an instruction to the device to be controlled within a time period, and if the instruction is not sent, enters a standby state.

In the above embodiment, the power consumption can be saved, the working time of the server can be reduced, and the service life can be improved.

Optionally, as another embodiment of the present invention, as shown in FIG. 7, a smart home control system based on a somatosensory interaction includes a control device, a motion capture device, and the smart home server;

The motion capture device includes an infrared emitter 001, a CMOS sensor 002, and a processor 003;

The infrared light emitter 001 is configured to emit infrared rays;

The CMOS sensor 002 is configured to detect infrared rays reflected from the operator to capture an action of an operator;

The processor 003 is configured to convert the infrared ray into three-dimensional coordinates, determine a position of each point in the space, generate somatosensory data, and send the somatosensory data to a server;

In the above embodiment, it should be understood that the optical portion includes two parts: an infrared emitter and a CMOS sensor. The infrared emitter emits a "laser" covering the entire range of the Kinect, and the CMOS sensor (the CMOS sensor is disposed on the camera group) receives The light is reflected to identify the operator. The infrared camera recognizes the image as a “Depth Field” in which the color of each pixel represents the distance from that object to the camera. For example, the body near the camera is bright red, green, etc., while the object far from the camera is dark gray.

The motion capture device is implemented by using light coding technology. Unlike traditional ToF or structured light measurement technology, light coding uses continuous illumination (rather than pulse), and does not require a special photosensitive chip. Only a common CMOS sensor chip is needed, which greatly reduces the cost of the solution.

Light coding, as its name implies, uses light source illumination to encode the space that needs to be measured. However, unlike the traditional structured light method, the light source is not a periodic two-dimensional image coding, but a "Body coding" with three-dimensional depth. This kind of light source is called laser speckle, which is a random diffraction spot formed when the laser is irradiated to a rough object or penetrates the frosted glass.

These speckles are highly random and vary in pattern with distance. That is to say, the speckle pattern of any two places in the space is different. As long as such structured light is applied to the space, the entire space is marked. Put an object into this space, just look at the speckle pattern on the object, you can know where the object is. Of course, before you can record the speckle pattern of the entire space, you must first do a calibration of the light source. The calibration method is such that at every distance, a reference plane is taken to record the speckle pattern on the reference plane. Assuming that the user's activity space is within a range of 1 to 4 meters from the TV set, a reference plane is taken every 10 cm, and 30 speckle images have been saved after calibration. When you need to make a measurement, take a speckle image of the scene to be tested, and then cross-correlate the image with the 30 reference images we saved, so that we will get 30 correlation images, and there are The position where the object exists will show a peak on the correlation image. By layering these peaks one layer at a time, after some interpolation, you will get the three-dimensional shape of the entire scene. After determining the position of each point in the space, the somatosensory data is generated.

Optionally, as another embodiment of the present invention, as shown in FIG. 8, a smart home control method based on somatosensory interaction is applied to a server, and includes the following steps:

Step S01: receiving a device code to be controlled sent by the control device;

Step S02: receiving the somatosensory data of the operator collected by the motion capture device;

Step S03: matching the somatosensory data with the pre-stored somatosensory data, and finding a corresponding control instruction according to the matched somatosensory data;

Step S04: Send the control instruction to the device to be controlled corresponding to the device code to be controlled for execution.

In the above embodiments, it is possible to help people, especially visually impaired people, to conveniently control various electrical appliances, capture operator actions, obtain somatosensory data, and then obtain corresponding control commands to control corresponding electrical devices. Achieve good human-computer interaction.

Specifically, the pre-stored somatosensory data includes the gesture-up somatosensory data, the gesture-down body-sensing data, the upward-looking somatosensory data, and the downward-looking somatosensory data, the gesture-up somatosensory data and the upward-looking body feeling. The data corresponds to a control command for increasing the volume of the television and a control command for raising the temperature of the air conditioner, and the down-sensing data of the gesture and the somatosensory data of the downward head both correspond to the control command for reducing the volume of the television and the temperature of the air conditioner is lowered. Control instruction.

In the above embodiment, the most commonly used TV volume and air conditioning temperature can be adjusted to help the visually impaired person to more accurately control the electrical equipment.

Optionally, as an embodiment of the present invention, on the basis of the embodiment shown in FIG. 8, the method further includes the steps of: receiving a connection request sent by the control device, and connecting the control device by using a wireless network.

In the foregoing embodiment, specifically, the server and the control device may be interconnected by using a Bluetooth connection mode or a ZigBee connection mode. After the interconnection succeeds, the server receives the code of the device to be controlled sent by the control device.

It should be understood that the operator needs to be close to the motion capture device, so that the server can capture the action of the operator, and the server can guide the operator into the control region by voice. On the basis of the embodiment shown in FIG. 8, as shown in FIG. The method further includes the following steps: acquiring the positioning information of the control device in real time, generating a voice guiding the operator to approach the motion capturing device according to the positioning information, and then broadcasting the voice.

On the basis of the embodiment shown in FIG. 10, as shown in FIG. 11, specifically, the generation guides the operator to be close to The specific steps of the voice information of the motion capture device are:

Step A11: setting a distance range value between the server and the control device, and acquiring the positioning information of the control device in real time, and calculating, according to the positioning information, whether the difference between the current position of the control device and the server is less than or equal to The distance range value, if yes, perform step A12;

Step A12: playing the voice that has reached the control area;

Step A13: Generate navigation information according to the real-time positioning information of the control device and the location information of the server, convert the navigation information into an audio file, and perform voice announcement on the audio file.

Optionally, as another embodiment of the present invention, the method may further include: when the device to be controlled completes the control instruction, reading a current parameter value of the device to be controlled, and broadcasting the parameter value.

Optionally, as another embodiment of the present invention, the method may further include the step of: entering a standby state when an instruction is not sent to the device to be controlled within a preset time period.

Optionally, as an embodiment of the present invention, the method may further include: displaying the name of the device to be controlled, the code of the device to be controlled, and the current parameter value of the device to be controlled. Specifically, the display device can be set on the server side to display the parameter values.

The beneficial technical effect of the above solution is to help people quickly understand the device information currently controlled.

Optionally, as an embodiment of the present invention, on the basis of the embodiment shown in FIG. 8, as shown in FIG. 11, the specific steps of finding the corresponding control instruction are:

Step S031: matching the somatosensory data with the pre-stored somatosensory data, and finding a corresponding control instruction according to the matched somatosensory data;

Step S032: Matching the collected somatosensory data of the operator with the pre-stored somatosensory data, and searching for the corresponding control command according to the matched pre-stored somatosensory data.

FIG. 13 is a schematic diagram of connection between a smart home server and a control device according to an embodiment of the present invention;

The steps of data interaction between the server and the control device are described in detail below with reference to FIGS. 12-13:

1. The control device 101 sends a connection request to the server 102;

2. After receiving the connection request, the server 102 performs a wireless connection; and may select a Bluetooth connection mode or a ZigBee connection mode for interconnection;

3. The server 102 acquires the positioning information of the control device 101 in real time, and calculates the location according to the positioning information. Whether the difference between the current position of the control device 101 and the server 102 is less than or equal to the distance range value, and generating navigation information according to the real-time positioning information of the control device 101 and the location information of the server 102, Converting the navigation information into an audio file for voice playback so that the operator has moved to the control area, and when the distance difference of the server 102 is less than or equal to the distance range value, the play has reached the control area. Voice

4. The control device 101 sends the device code to be controlled to the server 102;

5. After receiving the code of the device to be controlled, the server 102 captures the action of the operator, obtains the somatosensory data, matches the somatosensory data with the pre-stored somatosensory data, and finds corresponding corresponding data according to the matched somatosensory data. Controlling the instruction, and sending the control instruction to the corresponding device to be controlled according to the received device code to be controlled; when the device to be controlled completes the control instruction, reading the current parameter value of the device to be controlled, and Broadcasting the parameter value;

6. The server 102 enters a standby state if an instruction is not sent to the device to be controlled within a preset time period.

In step 5, for example, when the received device to be controlled code is 01, the corresponding air conditioner is used to capture the operator's motion, and the sensory data of the gesture down is obtained, and the corresponding control command for lowering the air conditioner temperature is cooled. The control command is sent to the device to be controlled 01, that is, the air conditioner. It should be understood that the cooling control command causes the air conditioner to cool down by 1 degree Celsius, and broadcasts the current temperature value to 28 degrees Celsius, and continues to capture the operator's motion. Obtaining the sensory data of the downward direction of the gesture, similarly, the corresponding control command for reducing the temperature of the air conditioner is sent, and the cooling control command is sent to the device to be controlled 01, and the current temperature value is reported to be 27 degrees Celsius; the server is within the preset time period. If the command is not sent to the device to be controlled, that is, the temperature adjustment operation is completed, the standby state is entered.

The outer surface of the terminal body of the control device further includes a liquid crystal display screen for displaying the name of the device to be controlled, the code of the device to be controlled, and the current parameter value of the device to be controlled. Help people quickly understand the device information currently controlled.

The invention can help people, especially the visually impaired people, to conveniently control various electrical equipments, capture the movements of the operator, obtain the somatosensory data, and then obtain corresponding control commands to control the corresponding electrical equipment, thereby controlling the electrical equipment. The control is refined, for example, the temperature and volume can be specifically adjusted to achieve good human-computer interaction.

The reader should understand that in the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means that the embodiment or example is incorporated. The specific features, structures, materials, or characteristics described are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification and features of various embodiments or examples may be combined and combined without departing from the scope of the invention.

A person skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working process of the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of cells is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or integrated. Go to another system, or some features can be ignored or not executed.

The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

An integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, can be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention contributes in essence or to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

The above is only the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any equivalent modification or can be easily conceived by those skilled in the art within the technical scope of the present disclosure. Such modifications or substitutions are intended to be included within the scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

A smart home server based on somatosensory interaction, characterized in that it comprises:

a first receiving module, configured to receive a device code to be controlled sent by the control device;

a second receiving module, configured to receive the operator's somatosensory data collected by the motion capture device;

An instruction generating module, configured to match the somatosensory data with pre-stored somatosensory data, and find a corresponding control instruction according to the matched somatosensory data;

And an instruction sending module, configured to send the control instruction to be executed in a device to be controlled corresponding to the device code to be controlled.
The smart home server based on the somatosensory interaction according to claim 1, further comprising a guiding module and a voice module connected to the first receiving module,

The guiding module is configured to acquire positioning information of the control device in real time, and generate a voice guiding the operator to be close to the motion capturing device according to the positioning information;

The voice module is configured to broadcast the voice.
The somatosensory interaction-based smart home server according to claim 2, wherein the guiding module comprises a positioning unit and a navigation unit,

The positioning unit is configured to set a distance range value between the server and the control device, and acquire positioning information of the control device in real time, and calculate a distance difference between the current location of the control device and the server according to the positioning information. Whether it is less than or equal to the distance range value, and if so, sending an instruction to the voice module;

The voice module is specifically configured to play a voice that has reached the control area according to the instruction;

The navigation unit is configured to generate navigation information according to real-time positioning information of the control device and location information of the server, and convert the navigation information into an audio file, and send the audio file to the voice module. in;

The voice module is further configured to perform voice broadcast on the audio file.
A smart home server based on somatosensory interaction according to any one of claims 1-3, characterized in that

The command generating module is specifically configured to: save the pre-stored somatosensory data and the corresponding control command; and specifically, to match the somatosensory data collected by the motion capture device with the pre-stored somatosensory data, according to the matched pre-stored The somatosensory data finds the corresponding control command.
A smart home control system based on a somatosensory interaction, comprising: a control device, a motion capture device, and the smart home server according to any one of claims 1-4;

The control device is provided with a plurality of buttons on the outer surface thereof, and the plurality of buttons are respectively corresponding to the device to be controlled, and when the shortcut button is pressed, the corresponding device to be controlled code is sent to the smart home server;

The motion capture device includes an infrared emitter, a CMOS sensor, and a processor;

The infrared light emitter is configured to emit infrared rays;

The CMOS sensor for detecting infrared rays reflected from the operator to capture an operator's motion;

The processor is configured to convert the infrared ray into three-dimensional coordinates, determine a position of each point in the space, generate somatosensory data, and send the somatosensory data to a server;

The server matches the somatosensory data with the pre-stored somatosensory data, and finds a corresponding control instruction according to the matched somatosensory data;

Sending the control instruction to the device to be controlled corresponding to the device code to be controlled for execution.
A smart home control method based on somatosensory interaction is applied to a server, which is characterized in that it comprises the following steps:

Receiving a device code to be controlled sent by the control device;

Receiving the operator's somatosensory data collected by the motion capture device;

Matching the somatosensory data with the pre-stored somatosensory data, and finding a corresponding control instruction according to the matched somatosensory data;

Sending the control instruction to the device to be controlled corresponding to the device code to be controlled for execution.
The smart home control method based on the somatosensory interaction according to claim 6, further comprising the steps of: acquiring positioning information of the control device in real time, and generating a guiding operator to approach the motion capturing device according to the positioning information. The voice, then broadcast the voice.
The somatosensory interaction-based smart home control method according to claim 6, wherein the specific steps of generating the voice information that guides the operator to be close to the motion capture device are:

Setting a distance range value of the server and the control device, and acquiring the positioning information of the control device in real time, and calculating, according to the positioning information, whether the difference between the current position of the control device and the server is less than or equal to the distance Range value, if yes,

Playing the voice that has reached the control area;

And generating navigation information according to the real-time positioning information of the control device and the location information of the server, and converting the navigation information into an audio file, and performing voice announcement on the audio file.
The smart home control method based on the somatosensory interaction according to any one of claims 6-8, wherein the specific step of finding the corresponding control instruction is: matching the somatosensory data with pre-stored somatosensory data. Finding corresponding control instructions according to the matched somatosensory data;

The collected somatosensory data of the operator is matched with the pre-stored somatosensory data, and the corresponding control command is found according to the matched pre-stored somatosensory data.
The smart home control method based on the somatosensory interaction according to any one of claims 6-8, further comprising the steps of: reading the current parameter value of the device to be controlled when the device to be controlled completes the control instruction, And the parameter values are broadcast.