WO2018232945A1 - 基于体感交互的智能家居服务端、控制系统及控制方法 - Google Patents

基于体感交互的智能家居服务端、控制系统及控制方法 Download PDF

Info

Publication number
WO2018232945A1
WO2018232945A1 PCT/CN2017/098022 CN2017098022W WO2018232945A1 WO 2018232945 A1 WO2018232945 A1 WO 2018232945A1 CN 2017098022 W CN2017098022 W CN 2017098022W WO 2018232945 A1 WO2018232945 A1 WO 2018232945A1
Authority
WO
WIPO (PCT)
Prior art keywords
somatosensory
control
controlled
smart home
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/098022
Other languages
English (en)
French (fr)
Inventor
杜光东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Shenglu IoT Communication Technology Co Ltd
Original Assignee
Shenzhen Shenglu IoT Communication Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Shenglu IoT Communication Technology Co Ltd filed Critical Shenzhen Shenglu IoT Communication Technology Co Ltd
Publication of WO2018232945A1 publication Critical patent/WO2018232945A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Program-control systems
    • G05B19/02—Program-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/26—Pc applications
    • G05B2219/2642—Domotique, domestic, home control, automation, smart house
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the invention relates to the technical field of smart home control, in particular to a smart home server, a control system and a control method based on somatosensory interaction.
  • the present invention provides a smart home server, a control system and a control method based on somatosensory interaction.
  • the present invention provides a smart home server based on somatosensory interaction, including:
  • a first receiving module configured to receive a device code to be controlled sent by the control device
  • a second receiving module configured to receive the operator's somatosensory data collected by the motion capture device
  • An instruction generating module configured to match the somatosensory data with pre-stored somatosensory data, and find a corresponding control instruction according to the matched somatosensory data;
  • an instruction sending module configured to send the control instruction to be executed in a device to be controlled corresponding to the device code to be controlled.
  • the beneficial technical effect of the above solution is that when controlling an electrical device, the problem of finding a corresponding remote controller in a plurality of remote controllers can be avoided, and the problem of misoperation when adjusting the volume or temperature is avoided, thereby helping people, especially vision.
  • the obstacle group conveniently controls each electrical device, can capture the action of the operator, obtain the somatosensory data, and then obtain corresponding control commands to control the corresponding electrical equipment, thereby achieving good human-computer interaction.
  • the pre-stored somatosensory data includes gesture-up somatosensory data, gesture-down body-sensing data, upward-looking somatosensory data, and downward-looking somatosensory data, the gesture-up sense of body
  • Both the data and the upward sensing data correspond to a control command for increasing the volume of the television and a control command for raising the temperature of the air conditioner, the downward somatosensory data and the downward looking somatosensory data corresponding to the television volume reduction.
  • the beneficial technical effect of the above solution is that the most commonly used TV volume and air conditioning temperature can be adjusted to help the visually impaired person to more accurately control the electrical equipment.
  • the device state obtaining module is configured to: when the device to be controlled completes the control instruction, read a current parameter value of the device to be controlled, and send the parameter value to the voice The module broadcasts.
  • the device to be controlled is an air conditioner
  • the current state of the air conditioner is monitored, and the air conditioner is obtained.
  • the previous temperature value is broadcasted by the voice module to the current temperature value.
  • the beneficial technical effect of the above solution is to help the visually impaired person to know the current parameter value of the device to be controlled, so as to facilitate the operation thereof more accurately.
  • the server further includes a standby processing module, configured to detect whether the instruction sending module sends an instruction to the to-be-controlled device within a preset time period, and if not sent, enters standby status.
  • the beneficial technical effect of the above solution is that the power consumption can be saved, the working time of the server is reduced, and the service life is improved.
  • the present invention provides a smart home control method based on somatosensory interaction, which is applied to a server, and includes the following steps:
  • the beneficial technical effect of the above solution is that when controlling an electrical device, the problem of finding a corresponding remote controller in a plurality of remote controllers can be avoided, and the problem of misoperation when adjusting the volume or temperature is avoided, thereby helping people, especially vision.
  • the obstacle group conveniently controls each electrical device, can capture the action of the operator, obtain the somatosensory data, and then obtain corresponding control commands to control the corresponding electrical equipment, thereby achieving good human-computer interaction.
  • the pre-stored somatosensory data includes gesture-up somatosensory data, gesture-down body-sensing data, upward-looking somatosensory data, and downward-looking somatosensory data, the gesture-up somatosensory data and the upward-looking body feeling
  • the data corresponds to a control command for increasing the volume of the television and a control command for raising the temperature of the air conditioner
  • the down-sensing data of the gesture and the somatosensory data of the downward head both correspond to the control command for reducing the volume of the television and the temperature of the air conditioner is lowered. Control instruction.
  • the beneficial technical effect of the above solution is that the most commonly used TV volume and air conditioning temperature can be adjusted to help the visually impaired person to more accurately control the electrical equipment.
  • the method may further include: when the device to be controlled completes the control instruction, reading a current parameter value of the device to be controlled, and broadcasting the parameter value.
  • the device to be controlled is an air conditioner
  • the current state of the air conditioner is monitored, and the current temperature value of the air conditioner is obtained, and the current temperature value is broadcasted by the voice module.
  • the beneficial technical effect of the above solution is to help the visually impaired person to know the current parameter value of the device to be controlled, so as to facilitate the operation thereof more accurately.
  • the method may further include the step of: entering a standby state when the instruction is not sent to the device to be controlled within the preset time period.
  • the beneficial technical effect of the above solution is that the power consumption can be saved, the working time of the server is reduced, and the service life is improved.
  • the present invention provides a smart home control system based on somatosensory interaction, including a control device, a motion capture device, and the smart home server;
  • the control device is provided with a plurality of buttons on the outer surface thereof, and the plurality of buttons are respectively corresponding to the device to be controlled, and when the shortcut button is pressed, the corresponding device to be controlled code is sent to the smart home server;
  • the motion capture device includes an infrared emitter, a CMOS sensor, and a processor;
  • the infrared light emitter is configured to emit infrared rays
  • the CMOS sensor for detecting infrared rays reflected from the operator to capture an operator's motion
  • the processor is configured to convert the infrared ray into three-dimensional coordinates, determine a position of each point in the space, generate somatosensory data, and send the somatosensory data to a server;
  • the server matches the somatosensory data with the pre-stored somatosensory data, and finds a corresponding control instruction according to the matched somatosensory data;
  • the beneficial technical effect of the above solution is that when controlling an electrical device, the problem of finding a corresponding remote controller in a plurality of remote controllers can be avoided, and the problem of misoperation when adjusting the volume or temperature is avoided, thereby helping people, especially vision.
  • the obstacle group conveniently controls each electrical device, can capture the action of the operator, obtain the somatosensory data, and then obtain corresponding control commands to control the corresponding electrical equipment, thereby achieving good human-computer interaction.
  • FIG. 1 is a block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention
  • FIG. 2 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention
  • FIG. 3 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention
  • FIG. 4 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention
  • FIG. 5 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention.
  • FIG. 6 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention.
  • FIG. 7 is a block diagram of a module of a motion capture apparatus according to an embodiment of the present invention.
  • FIG. 8 is a flowchart of another method for a smart home control method based on a somatosensory interaction according to an embodiment of the present invention.
  • FIG. 9 is a flowchart of another method for a smart home control method based on somatosensory interaction according to an embodiment of the present invention.
  • FIG. 10 is a flowchart of another method for a smart home control method based on somatosensory interaction according to an embodiment of the present invention.
  • FIG. 11 is a flowchart of another method for a smart home control method based on somatosensory interaction according to an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of signaling flow of a smart home server and a control device according to an embodiment of the present invention.
  • FIG. 13 is a schematic diagram of connection between a smart home server and a control device according to an embodiment of the present invention.
  • connection In the description of the present invention, it should be noted that the terms “installation”, “connected”, and “connected” are to be understood broadly, and may be fixed or detachable, for example, unless otherwise explicitly defined and defined. Connected, or integrally connected; can be mechanical or electrical; can be directly connected, or indirectly connected through an intermediate medium, can be the internal communication of the two components.
  • Connected, or integrally connected can be mechanical or electrical; can be directly connected, or indirectly connected through an intermediate medium, can be the internal communication of the two components.
  • the specific meaning of the above terms in the present invention can be understood in a specific case by those skilled in the art.
  • the embodiments of the present invention provide a smart home server, a control system, and a control method based on somatosensory interaction to solve the above technical problems.
  • FIG. 1 is a block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention
  • an embodiment of the present invention provides a smart home server based on somatosensory interaction, including:
  • a first receiving module 01 configured to receive a device code to be controlled sent by the control device
  • the second receiving module 02 is configured to receive the somatosensory data of the operator collected by the motion capture device;
  • the instruction generating module 03 is configured to match the somatosensory data with the pre-stored somatosensory data, and find a corresponding control instruction according to the matched somatosensory data;
  • the instruction sending module 04 is configured to send the control instruction to be executed in a device to be controlled corresponding to the device code to be controlled.
  • the command generating module 03 is specifically configured to: save the pre-stored somatosensory data and the corresponding control command; and specifically, to match the somatosensory data collected by the motion capture device with the pre-stored somatosensory data, according to the matched The pre-stored somatosensory data finds the corresponding control command.
  • the problem of finding a corresponding remote controller in a plurality of remote controllers can be avoided, and the problem of misoperation when adjusting the volume or temperature can be avoided, which is convenient for people, especially visually impaired people.
  • the control of each electrical device can capture the operator's movements, obtain the somatosensory data, and then obtain corresponding control commands to control the corresponding electrical equipment, thereby achieving good human-computer interaction.
  • the pre-stored somatosensory data may include a gesture-up body number According to the sensory data of the gesture down, the somatosensory data of the upward head, and the somatosensory data of the downward head, the gesture-up somatosensory data and the upward-sense somatosensory data correspond to the control command of the TV volume increase and the air-conditioning temperature.
  • the elevated control command, the gesture down sensation data and the downward head sensation data all correspond to a control command for decreasing the volume of the television and a control command for decreasing the temperature of the air conditioner.
  • the most commonly used TV volume and air conditioning temperature can be adjusted to help the visually impaired person to more accurately control the electrical equipment.
  • the present invention is not limited to the above-described control of the above-described electrical equipment, and control of other parameters of other electrical equipment is also within the scope of the present invention.
  • FIG. 2 is a block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention
  • the server may further include a connection module 00, where the connection module 00 is configured to receive a connection request sent by the control device, and The network is connected to the control device.
  • the server and the control device may be interconnected by using a Bluetooth connection mode or a ZigBee connection mode.
  • FIG. 3 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention
  • the server further includes a guiding module 05 and a voice connected to the first receiving module 01.
  • Module 06 the server further includes a guiding module 05 and a voice connected to the first receiving module 01.
  • the guiding module 05 is configured to acquire positioning information of the control device in real time, and generate a voice guiding the operator to approach the motion capturing device according to the positioning information;
  • the voice module 06 is configured to broadcast the voice.
  • FIG. 4 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention
  • the guiding module includes a positioning unit 051 and a navigation unit 052.
  • the positioning unit 051 is configured to set a distance range value between the server and the control device, and acquire positioning information of the control device in real time, and calculate a distance between the current location of the control device and the server according to the positioning information 051. Whether the difference is less than or equal to the distance range value, and if so, sending an instruction to the voice module 06;
  • the voice module 06 is specifically configured to: play a voice that has reached the control area according to the instruction;
  • the navigation unit 052 is configured to generate navigation information according to real-time positioning information of the control device and location information of the server, and convert the navigation information into an audio file, and send the audio file to the voice Module 06;
  • the voice module 06 is further configured to perform voice broadcast on the audio file.
  • the operator holds the control device, and the server determines the position of the control device in real time, and helps the operator to move to the control area by means of voice navigation. For the visually impaired, although the eyes are invisible, the voice can be passed. Move smoothly to the control area for operation.
  • FIG. 5 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention.
  • the device state obtaining module is further configured to be used when the device to be controlled completes.
  • the control instruction is described, the current parameter value of the device to be controlled is read, and the parameter value is sent to the voice module for broadcast.
  • the device to be controlled is an air conditioner.
  • the air conditioner completes the control command
  • the current parameter value of the air conditioner is read, and the current temperature value is broadcasted by the voice module.
  • the visually impaired person is helped to know the current parameter value of the device to be controlled, so as to facilitate the operation thereof more accurately.
  • FIG. 6 is another block diagram of a smart home server based on somatosensory interaction according to an embodiment of the present invention.
  • the server further includes a standby processing module 08, and the standby processing module 08 is used to pre- It is determined whether the instruction sending module sends an instruction to the device to be controlled within a time period, and if the instruction is not sent, enters a standby state.
  • the power consumption can be saved, the working time of the server can be reduced, and the service life can be improved.
  • FIG. 7 is a block diagram of a module of a motion capture apparatus according to an embodiment of the present invention.
  • a smart home control system based on a somatosensory interaction includes a control device, a motion capture device, and the smart home server;
  • the control device is provided with a plurality of buttons on the outer surface thereof, and the plurality of buttons are respectively corresponding to the device to be controlled, and when the shortcut button is pressed, the corresponding device to be controlled code is sent to the smart home server;
  • the motion capture device includes an infrared emitter 001, a CMOS sensor 002, and a processor 003;
  • the infrared light emitter 001 is configured to emit infrared rays
  • the CMOS sensor 002 is configured to detect infrared rays reflected from the operator to capture an action of an operator;
  • the processor 003 is configured to convert the infrared ray into three-dimensional coordinates, determine a position of each point in the space, generate somatosensory data, and send the somatosensory data to a server;
  • the server matches the somatosensory data with the pre-stored somatosensory data, and finds a corresponding control instruction according to the matched somatosensory data;
  • the optical portion includes two parts: an infrared emitter and a CMOS sensor.
  • the infrared emitter emits a "laser” covering the entire range of the Kinect
  • the CMOS sensor receives The light is reflected to identify the operator.
  • the infrared camera recognizes the image as a “Depth Field” in which the color of each pixel represents the distance from that object to the camera. For example, the body near the camera is bright red, green, etc., while the object far from the camera is dark gray.
  • the motion capture device is implemented by using light coding technology. Unlike traditional ToF or structured light measurement technology, light coding uses continuous illumination (rather than pulse), and does not require a special photosensitive chip. Only a common CMOS sensor chip is needed, which greatly reduces the cost of the solution.
  • Light coding uses light source illumination to encode the space that needs to be measured.
  • the light source is not a periodic two-dimensional image coding, but a "Body coding" with three-dimensional depth.
  • This kind of light source is called laser speckle, which is a random diffraction spot formed when the laser is irradiated to a rough object or penetrates the frosted glass.
  • speckles are highly random and vary in pattern with distance. That is to say, the speckle pattern of any two places in the space is different. As long as such structured light is applied to the space, the entire space is marked. Put an object into this space, just look at the speckle pattern on the object, you can know where the object is. Of course, before you can record the speckle pattern of the entire space, you must first do a calibration of the light source. The calibration method is such that at every distance, a reference plane is taken to record the speckle pattern on the reference plane. Assuming that the user's activity space is within a range of 1 to 4 meters from the TV set, a reference plane is taken every 10 cm, and 30 speckle images have been saved after calibration.
  • FIG. 8 is a flowchart of another method for a smart home control method based on a somatosensory interaction according to an embodiment of the present invention.
  • a smart home control method based on somatosensory interaction is applied to a server, and includes the following steps:
  • Step S01 receiving a device code to be controlled sent by the control device
  • Step S02 receiving the somatosensory data of the operator collected by the motion capture device
  • Step S03 matching the somatosensory data with the pre-stored somatosensory data, and finding a corresponding control instruction according to the matched somatosensory data;
  • Step S04 Send the control instruction to the device to be controlled corresponding to the device code to be controlled for execution.
  • the pre-stored somatosensory data includes the gesture-up somatosensory data, the gesture-down body-sensing data, the upward-looking somatosensory data, and the downward-looking somatosensory data, the gesture-up somatosensory data and the upward-looking body feeling.
  • the data corresponds to a control command for increasing the volume of the television and a control command for raising the temperature of the air conditioner, and the down-sensing data of the gesture and the somatosensory data of the downward head both correspond to the control command for reducing the volume of the television and the temperature of the air conditioner is lowered. Control instruction.
  • the most commonly used TV volume and air conditioning temperature can be adjusted to help the visually impaired person to more accurately control the electrical equipment.
  • the method further includes the steps of: receiving a connection request sent by the control device, and connecting the control device by using a wireless network.
  • the server and the control device may be interconnected by using a Bluetooth connection mode or a ZigBee connection mode. After the interconnection succeeds, the server receives the code of the device to be controlled sent by the control device.
  • FIG. 9 is a flowchart of another method for a smart home control method based on somatosensory interaction according to an embodiment of the present invention.
  • the method further includes the following steps: acquiring the positioning information of the control device in real time, generating a voice guiding the operator to approach the motion capturing device according to the positioning information, and then broadcasting the voice.
  • FIG. 10 is a flowchart of another method for a smart home control method based on somatosensory interaction according to an embodiment of the present invention.
  • the generation guides the operator to be close to
  • the specific steps of the voice information of the motion capture device are:
  • Step A11 setting a distance range value between the server and the control device, and acquiring the positioning information of the control device in real time, and calculating, according to the positioning information, whether the difference between the current position of the control device and the server is less than or equal to The distance range value, if yes, perform step A12;
  • Step A12 playing the voice that has reached the control area
  • Step A13 Generate navigation information according to the real-time positioning information of the control device and the location information of the server, convert the navigation information into an audio file, and perform voice announcement on the audio file.
  • the operator holds the control device, and the server determines the position of the control device in real time, and helps the operator to move to the control area by means of voice navigation. For the visually impaired, although the eyes are invisible, the voice can be passed. Move smoothly to the control area for operation.
  • the method may further include: when the device to be controlled completes the control instruction, reading a current parameter value of the device to be controlled, and broadcasting the parameter value.
  • the device to be controlled is an air conditioner
  • the current state of the air conditioner is monitored, and the current temperature value of the air conditioner is obtained, and the current temperature value is broadcasted by the voice module.
  • the visually impaired person is helped to know the current parameter value of the device to be controlled, so as to facilitate the operation thereof more accurately.
  • the method may further include the step of: entering a standby state when an instruction is not sent to the device to be controlled within a preset time period.
  • the power consumption can be saved, the working time of the server can be reduced, and the service life can be improved.
  • the method may further include: displaying the name of the device to be controlled, the code of the device to be controlled, and the current parameter value of the device to be controlled.
  • the display device can be set on the server side to display the parameter values.
  • the beneficial technical effect of the above solution is to help people quickly understand the device information currently controlled.
  • FIG. 11 is a flowchart of another method for a smart home control method based on somatosensory interaction according to an embodiment of the present invention.
  • Step S031 matching the somatosensory data with the pre-stored somatosensory data, and finding a corresponding control instruction according to the matched somatosensory data;
  • Step S032 Matching the collected somatosensory data of the operator with the pre-stored somatosensory data, and searching for the corresponding control command according to the matched pre-stored somatosensory data.
  • FIG. 12 is a schematic diagram of signaling flow of a smart home server and a control device according to an embodiment of the present invention.
  • FIG. 13 is a schematic diagram of connection between a smart home server and a control device according to an embodiment of the present invention.
  • the control device 101 sends a connection request to the server 102;
  • the server 102 After receiving the connection request, the server 102 performs a wireless connection; and may select a Bluetooth connection mode or a ZigBee connection mode for interconnection;
  • the server 102 acquires the positioning information of the control device 101 in real time, and calculates the location according to the positioning information. Whether the difference between the current position of the control device 101 and the server 102 is less than or equal to the distance range value, and generating navigation information according to the real-time positioning information of the control device 101 and the location information of the server 102, Converting the navigation information into an audio file for voice playback so that the operator has moved to the control area, and when the distance difference of the server 102 is less than or equal to the distance range value, the play has reached the control area.
  • Voice Voice
  • the control device 101 sends the device code to be controlled to the server 102;
  • the server 102 After receiving the code of the device to be controlled, the server 102 captures the action of the operator, obtains the somatosensory data, matches the somatosensory data with the pre-stored somatosensory data, and finds corresponding corresponding data according to the matched somatosensory data. Controlling the instruction, and sending the control instruction to the corresponding device to be controlled according to the received device code to be controlled; when the device to be controlled completes the control instruction, reading the current parameter value of the device to be controlled, and Broadcasting the parameter value;
  • the server 102 enters a standby state if an instruction is not sent to the device to be controlled within a preset time period.
  • step 5 for example, when the received device to be controlled code is 01, the corresponding air conditioner is used to capture the operator's motion, and the sensory data of the gesture down is obtained, and the corresponding control command for lowering the air conditioner temperature is cooled.
  • the control command is sent to the device to be controlled 01, that is, the air conditioner.
  • the cooling control command causes the air conditioner to cool down by 1 degree Celsius, and broadcasts the current temperature value to 28 degrees Celsius, and continues to capture the operator's motion.
  • the corresponding control command for reducing the temperature of the air conditioner is sent, and the cooling control command is sent to the device to be controlled 01, and the current temperature value is reported to be 27 degrees Celsius; the server is within the preset time period. If the command is not sent to the device to be controlled, that is, the temperature adjustment operation is completed, the standby state is entered.
  • the outer surface of the terminal body of the control device further includes a liquid crystal display screen for displaying the name of the device to be controlled, the code of the device to be controlled, and the current parameter value of the device to be controlled. Help people quickly understand the device information currently controlled.
  • the invention can help people, especially the visually impaired people, to conveniently control various electrical equipments, capture the movements of the operator, obtain the somatosensory data, and then obtain corresponding control commands to control the corresponding electrical equipment, thereby controlling the electrical equipment.
  • the control is refined, for example, the temperature and volume can be specifically adjusted to achieve good human-computer interaction.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of cells is only a logical function division.
  • multiple units or components may be combined or integrated. Go to another system, or some features can be ignored or not executed.
  • the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • An integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, can be stored in a computer readable storage medium.
  • the technical solution of the present invention contributes in essence or to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Automation & Control Theory (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Selective Calling Equipment (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本发明涉及包括一种基于体感交互的智能家居服务端、控制系统及控制方法，其中服务端包括：第一接收模块，用于接收控制装置发送来的待控制设备编码；第二接收模块，用于接收动作捕捉装置采集的操作者的体感数据；指令生成模块，用于将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；指令发送模块，用于将所述控制指令发送至与所述待控制设备编码对应的待控制设备中执行。本发明能够帮助人们尤其是视觉障碍人群方便的控制各电器设备，能够对操作者的动作进行捕捉，得到体感数据，再对应的匹配得到控制指令，由此来控制对应的电器设备，实现了良好的人机交互。

Description

基于体感交互的智能家居服务端、控制系统及控制方法 技术领域
本发明涉及智能家居控制技术领域，尤其涉及一种基于体感交互的智能家居服务端、控制系统及控制方法。
背景技术
视觉障碍者由于眼睛看不见或看不清东西，造成日常生活中出现很大的障碍，例如无法开启或关闭各个电器设备，处处需要依赖其他人，造成他们心里承受很大的压力。而且一台电器设备配备一个遥控器，对于视觉障碍者来说，要区分不同的遥控器实在是太困难了。随着智能家居物联技术及体感技术的成熟化，如何通过人机交互技术来帮助人们尤其是视觉障碍者对各电器设备进行控制，是目前亟待研究的方向。
发明内容
为解决上述技术问题，本发明提供了一种基于体感交互的智能家居服务端、控制系统及控制方法。
第一方面，本发明提供了一种基于体感交互的智能家居服务端，包括：
第一接收模块，用于接收控制装置发送来的待控制设备编码；
第二接收模块，用于接收动作捕捉装置采集的操作者的体感数据；
指令生成模块，用于将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；
指令发送模块，用于将所述控制指令发送至与所述待控制设备编码对应的待控制设备中执行。
上述方案的有益技术效果在于，当控制某个电器设备时，能够避免在众多的遥控器中查找对应遥控器的问题，且避免在调节音量或温度时，误操作的问题，帮助人们尤其是视觉障碍人群方便的控制各电器设备，能够对操作者的动作进行捕捉，得到体感数据，再对应的匹配得到控制指令，由此来控制对应的电器设备，实现了良好的人机交互。
进一步的，所述指令生成模块中，所述预存的体感数据包括手势向上的体感数据、手势向下的体感数据、向上仰头的体感数据和向下低头的体感数据，所述手势向上的体感数据和向上仰头的体感数据均对应于电视音量增大的控制指令和空调温度升高的控制指令，所述手势向下的体感数据和向下低头的体感数据均对应于电视音量减小的控制指令和空调温度降低的控制指令。
上述方案的有益技术效果在于，可以针对最常用的电视音量及空调温度进行调节，帮助视觉障碍者更准确的控制电器设备。
进一步的，还包括设备状态获取模块，所述设备状态获取模块用于当待控制设备完成所述控制指令时，读取待控制设备当前的参数值，并将所述参数值发送至所述语音模块进行播报。
例如，待控制设备为空调设备，则对空调设备当前的状态进行监测，得到空调设备当 前的温度值，通过所述语音模块将当前的温度值进行播报。
上述方案的有益技术效果在于，帮助视觉障碍者了解待控制设备的当前参数值，便于更准确对其进行操作。
进一步的，所述服务端还包括待机处理模块，所述待机处理模块用于在预设时间段内检测所述指令发送模块是否向所述待控制设备发送指令，如果未发送指令，则进入待机状态。
上述方案的有益技术效果在于，能够节约耗电量，减少服务端的工作时间，提高使用寿命。
第二方面，本发明提供了一种基于体感交互的智能家居控制方法，应用于服务端，包括如下步骤：
接收控制装置发送来的待控制设备编码；
接收动作捕捉装置采集的操作者的体感数据；
将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；
将所述控制指令发送至与所述待控制设备编码对应的待控制设备中执行。
上述方案的有益技术效果在于，当控制某个电器设备时，能够避免在众多的遥控器中查找对应遥控器的问题，且避免在调节音量或温度时，误操作的问题，帮助人们尤其是视觉障碍人群方便的控制各电器设备，能够对操作者的动作进行捕捉，得到体感数据，再对应的匹配得到控制指令，由此来控制对应的电器设备，实现了良好的人机交互。
进一步的，所述预存的体感数据包括手势向上的体感数据、手势向下的体感数据、向上仰头的体感数据和向下低头的体感数据，所述手势向上的体感数据和向上仰头的体感数据均对应于电视音量增大的控制指令和空调温度升高的控制指令，所述手势向下的体感数据和向下低头的体感数据均对应于电视音量减小的控制指令和空调温度降低的控制指令。
上述方案的有益技术效果在于，可以针对最常用的电视音量及空调温度进行调节，帮助视觉障碍者更准确的控制电器设备。
进一步的，还可以包括步骤：当待控制设备完成所述控制指令时，读取待控制设备当前的参数值，并将所述参数值进行播报。
例如，待控制设备为空调设备，则对空调设备当前的状态进行监测，得到空调设备当前的温度值，通过所述语音模块将当前的温度值进行播报。
上述方案的有益技术效果在于，帮助视觉障碍者了解待控制设备的当前参数值，便于更准确对其进行操作。
进一步的，还可以包括步骤：当预设时间段内未向所述待控制设备发送指令，则进入待机状态。
上述方案的有益技术效果在于，能够节约耗电量，减少服务端的工作时间，提高使用寿命。
第三方面，本发明提供了一种基于体感交互的智能家居控制系统，包括控制装置、动作捕捉装置和所述智能家居服务端；
所述控制装置外表面上设有多个按键，多个所述按键一一对应待控制设备编码，当按下所述快捷按钮时将其对应的待控制设备编码发送至智能家居服务端中；
所述动作捕捉装置包括红外线发射器、CMOS传感器和处理器；
所述红外光发射器，用于发射红外线；
所述CMOS传感器，用于检测从所述操作者处反射回的红外线来捕捉操作者的动作；
所述处理器，用于将所述红外线转换成三维坐标，并确定空间中每个点的位置，生成体感数据，并将所述体感数据发送至服务端；
所述服务端将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；
将所述控制指令发送至与所述待控制设备编码对应的待控制设备中执行。
上述方案的有益技术效果在于，当控制某个电器设备时，能够避免在众多的遥控器中查找对应遥控器的问题，且避免在调节音量或温度时，误操作的问题，帮助人们尤其是视觉障碍人群方便的控制各电器设备，能够对操作者的动作进行捕捉，得到体感数据，再对应的匹配得到控制指令，由此来控制对应的电器设备，实现了良好的人机交互。
附图说明
本发明上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解，其中：
图1为本发明实施例提供的基于体感交互的智能家居服务端的模块框图；
图2为本发明实施例提供的基于体感交互的智能家居服务端的另一种模块框图；
图3为本发明实施例提供的基于体感交互的智能家居服务端的另一种模块框图；
图4为本发明实施例提供的基于体感交互的智能家居服务端的另一种模块框图；
图5为本发明实施例提供的基于体感交互的智能家居服务端的另一种模块框图；
图6为本发明实施例提供的基于体感交互的智能家居服务端的另一种模块框图；
图7为本发明实施例提供的动作捕捉装置的模块框图；
图8为本发明实施例提供的基于体感交互的智能家居控制方法的另一种方法流程图；
图9为本发明实施例提供的基于体感交互的智能家居控制方法的另一种方法流程图；
图10为本发明实施例提供的基于体感交互的智能家居控制方法的另一种方法流程图；
图11为本发明实施例提供的基于体感交互的智能家居控制方法的另一种方法流程图；
图12为本发明实施例提供的智能家居服务端和控制装置的信令流程示意图；
图13为本发明实施例提供的智能家居服务端和控制装置的连接示意图。
具体实施方式
下面详细描述本发明的实施例，所述实施例的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的，仅用于解释本发明，而不能理解为对本发明的限制。
在本发明的描述中，需要理解的是，术语“中心”、“纵向”、“横向”、“上”、 “下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系，仅是为了便于描述本发明和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作，因此不能理解为对本发明的限制。此外，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性。
在本发明的描述中，需要说明的是，除非另有明确的规定和限定，术语“安装”、“相连”、“连接”应做广义理解，例如，可以是固定连接，也可以是可拆卸连接，或一体地连接；可以是机械连接，也可以是电连接；可以是直接相连，也可以通过中间媒介间接相连，可以是两个元件内部的连通。对于本领域的普通技术人员而言，可以具体情况理解上述术语在本发明中的具体含义。
参照下面的描述和附图，将清楚本发明的实施例的这些和其他方面。在这些描述和附图中，具体公开了本发明的实施例中的一些特定实施方式，来表示实施本发明的实施例的原理的一些方式，但是应当理解，本发明的实施例的范围不受此限制。相反，本发明的实施例包括落入所附加权利要求书的精神和内涵范围内的所有变化、修改和等同物。
视觉障碍者由于眼睛看不见或看不清东西，造成日常生活中出现很大的障碍，例如无法开启或关闭各个电器设备，处处需要依赖其他人，造成他们心里承受很大的压力。随着智能家居物联技术及体感技术的成熟化，如何通过人机交互技术来帮助人们尤其是视觉障碍者对各电器设备进行控制，是目前亟待研究的方向。
本发明实施例提供了一种基于体感交互的智能家居服务端、控制系统及控制方法来解决上述技术问题，下面结合附图对各方案进行详细的介绍。
图1为本发明实施例提供的基于体感交互的智能家居服务端的模块框图；
如图1所示，本发明实施例提供了一种基于体感交互的智能家居服务端，包括：
第一接收模块01，用于接收控制装置发送来的待控制设备编码；
第二接收模块02，用于接收动作捕捉装置采集的操作者的体感数据；
指令生成模块03，用于将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；
指令发送模块04，用于将所述控制指令发送至与所述待控制设备编码对应的待控制设备中执行。
所述指令生成模块03具体用于，将预存体感数据与对应的控制指令进行保存；还具体用于，将所述动作捕捉装置采集的体感数据与预存体感数据进行匹配，根据匹配到的所述预存体感数据查找到对应的控制指令。
上述实施例中，当控制某个电器设备时，能够避免在众多的遥控器中查找对应遥控器的问题，且避免在调节音量或温度时，误操作的问题，帮助人们尤其是视觉障碍人群方便的控制各电器设备，能够对操作者的动作进行捕捉，得到体感数据，再对应的匹配得到控制指令，由此来控制对应的电器设备，实现了良好的人机交互。
具体的，所述指令生成模块03中，所述预存的体感数据可以包括手势向上的体感数 据、手势向下的体感数据、向上仰头的体感数据和向下低头的体感数据，所述手势向上的体感数据和向上仰头的体感数据均对应于电视音量增大的控制指令和空调温度升高的控制指令，所述手势向下的体感数据和向下低头的体感数据均对应于电视音量减小的控制指令和空调温度降低的控制指令。
上述实施例中，可以针对最常用的电视音量及空调温度进行调节，帮助视觉障碍者更准确的控制电器设备。本发明不限于对上述电器设备的上述控制，对其他电器设备的其他参数的控制也在本发明的保护范围内。
图2为本发明实施例提供的基于体感交互的智能家居服务端的模块框图；
可选地，作为本发明的一个实施例，如图2所示，所述服务端还可以包括连接模块00，所述连接模块00用于接收所述控制装置发送来的连接请求，并通过无线网络连接所述控制装置。
上述实施例中，具体的，所述服务端和控制装置可通过蓝牙连接方式或ZigBee连接方式进行互联。
图3为本发明实施例提供的基于体感交互的智能家居服务端的另一种模块框图；
可选地，作为本发明的一个实施例，在图1所示实施例的基础上，如图3所示，所述服务端还包括与所述第一接收模块01连接的引导模块05和语音模块06，
所述引导模块05，用于实时获取所述控制装置的定位信息，根据所述定位信息生成引导所述操作者靠近动作捕捉装置的语音；
所述语音模块06，用于将所述语音进行播报。
图4为本发明实施例提供的基于体感交互的智能家居服务端的另一种模块框图；
具体的，在图3所示实施例的基础上，如图4所示，所述引导模块包括定位单元051和导航单元052，
所述定位单元051，用于设定服务端与控制装置的距离范围值，并实时获取所述控制装置的定位信息，根据所述定位信息051计算所述控制装置当前位置与所述服务端的距离差值是否小于或等于所述距离范围值，如果是，则发送指令至所述语音模块06；
所述语音模块06具体用于，根据所述指令播放已到达控制区域的语音；
所述导航单元052，用于根据所述控制装置的实时定位信息和所述服务端的位置信息，生成导航信息，并将所述导航信息转换为音频文件，将所述音频文件发送至所述语音模块06中；
所述语音模块06还具体用于，将所述音频文件进行语音播报。
上述实施例中，操作者手持控制装置，服务端实时判断控制装置的位置，并通过语音导航的方式，帮助操作者移动至控制区域，对于视觉障碍者来说虽然眼睛看不见，但能通过声音顺利移动至控制区域进行操作。
图5为本发明实施例提供的基于体感交互的智能家居服务端的另一种模块框图；
可选地，作为本发明的一个实施例，在图1所示实施例的基础上，如图6所示，还包括设备状态获取模块，所述设备状态获取模块用于当待控制设备完成所述控制指令时，读取待控制设备当前的参数值，并将所述参数值发送所述语音模块进行播报。
例如，待控制设备为空调设备，当空调设备完成控制指令时，读取空调设备当前的参数值，通过所述语音模块将当前的温度值进行播报。
上述实施例中，帮助视觉障碍者了解待控制设备的当前参数值，便于更准确对其进行操作。
图6为本发明实施例提供的基于体感交互的智能家居服务端的另一种模块框图；
可选地，作为本发明的一个实施例，在图1所示实施例的基础上，如图7所示，所述服务端还包括待机处理模块08，所述待机处理模块08用于在预设时间段内检测所述指令发送模块是否向所述待控制设备发送指令，如果未发送指令，则进入待机状态。
上述实施例中，能够节约耗电量，减少服务端的工作时间，提高使用寿命。
图7为本发明实施例提供的动作捕捉装置的模块框图；
可选地，作为本发明的另一个实施例，如图7所示，一种基于体感交互的智能家居控制系统，包括控制装置、动作捕捉装置和所述智能家居服务端；
所述控制装置外表面上设有多个按键，多个所述按键一一对应待控制设备编码，当按下所述快捷按钮时将其对应的待控制设备编码发送至智能家居服务端中；
所述动作捕捉装置包括红外线发射器001、CMOS传感器002和处理器003；
所述红外光发射器001，用于发射红外线；
所述CMOS传感器002，用于检测从所述操作者处反射回的红外线来捕捉操作者的动作；
所述处理器003，用于将所述红外线转换成三维坐标，并确定空间中每个点的位置，生成体感数据，并将所述体感数据发送至服务端；
所述服务端将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；
将所述控制指令发送至与所述待控制设备编码对应的待控制设备中执行。
上述实施例中，应理解的，光学部分包括两部分：红外线发射器和CMOS传感器，红外线发射器发出一道“激光”覆盖整个Kinect的可视范围，CMOS传感器(CMOS传感器设置在摄像头组上)接收反射光线来识别操作者，红外摄像头识别图像的是一个“深度场”(Depth Field)，其中每一像素的颜色代表了那一点物体到摄像头的距离。比如离摄像头近的身体呈亮红色、绿色等，而离摄像头远的物体则呈暗灰色。
所述动作捕捉装置利用光编码(light coding)技术来实现，不同于传统的ToF或者结构光测量技术，light coding使用的是连续的照明(而非脉冲)，也不需要特制的感光芯片，而只需要普通的CMOS感光芯片，这让方案的成本大大降低。
Light coding，顾名思义就是用光源照明给需要测量的空间编上码，但与传统的结构光方法不同的是，其光源打出去的并不是一副周期性变化的二维的图像编码，而是一个具有三维纵深的“体编码”。这种光源叫做激光散斑(laser speckle)，是当激光照射到粗糙物体或穿透毛玻璃后形成的随机衍射斑点。
这些散斑具有高度的随机性，而且会随着距离的不同变换图案。也就是说空间中任意两处的散斑图案都是不同的。只要在空间中打上这样的结构光，整个空间就都被做了标记， 把一个物体放进这个空间，只要看看物体上面的散斑图案，就可以知道这个物体在什么位置了。当然，在这之前要把整个空间的散斑图案都记录下来，所以要先做一次光源的标定。标定的方法是这样的：每隔一段距离，取一个参考平面，把参考平面上的散斑图案记录下来。假设用户活动空间是距离电视机1米到4米的范围，每隔10cm取一个参考平面，那么标定下来就已经保存了30幅散斑图像。需要进行测量的时候，拍摄一副待测场景的散斑图像，将这幅图像和我们保存下来的30幅参考图像依次做互相关运算，这样我们会得到30幅相关度图像，而空间中有物体存在的位置，在相关度图像上就会显示出峰值。把这些峰值一层层叠在一起，再经过一些插值，就会得到整个场景的三维形状了。确定空间中每个点的位置后，生成体感数据。
图8为本发明实施例提供的基于体感交互的智能家居控制方法的另一种方法流程图；
可选地，作为本发明的另一个实施例，如图8所示，一种基于体感交互的智能家居控制方法，应用于服务端，包括如下步骤：
步骤S01：接收控制装置发送来的待控制设备编码；
步骤S02：接收动作捕捉装置采集的操作者的体感数据；
步骤S03：将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；
步骤S04：将所述控制指令发送至与所述待控制设备编码对应的待控制设备中执行。
上述实施例中，能够帮助人们尤其是视觉障碍人群方便的控制各电器设备，能够对操作者的动作进行捕捉，得到体感数据，再对应的匹配得到控制指令，由此来控制对应的电器设备，实现了良好的人机交互。
具体的，所述预存的体感数据包括手势向上的体感数据、手势向下的体感数据、向上仰头的体感数据和向下低头的体感数据，所述手势向上的体感数据和向上仰头的体感数据均对应于电视音量增大的控制指令和空调温度升高的控制指令，所述手势向下的体感数据和向下低头的体感数据均对应于电视音量减小的控制指令和空调温度降低的控制指令。
上述实施例中，可以针对最常用的电视音量及空调温度进行调节，帮助视觉障碍者更准确的控制电器设备。
可选地，作为本发明的一个实施例，在图8所示实施例的基础上，还包括如下步骤：接收所述控制装置发送来的连接请求，并通过无线网络连接所述控制装置。
上述实施例中，具体的，所述服务端和控制装置可通过蓝牙连接方式或ZigBee连接方式进行互联，互联成功后服务端接收控制装置发送来的待控制设备编码。
图9为本发明实施例提供的基于体感交互的智能家居控制方法的另一种方法流程图；
应理解的，操作者需要靠近动作捕捉装置，以便服务端捕捉操作者的动作，服务端可通过语音引导操作者进入控制区域，在图8所示实施例的基础上，如图9所示，还包括如下步骤A：实时获取所述控制装置的定位信息，根据所述定位信息生成引导所述操作者靠近动作捕捉装置的语音，再将所述语音进行播报。
图10为本发明实施例提供的基于体感交互的智能家居控制方法的另一种方法流程图；
在图10所示实施例的基础上，如图11所示，具体的，所述生成引导所述操作者靠近 动作捕捉装置的语音信息的具体步骤为：
步骤A11：设定服务端与控制装置的距离范围值，并实时获取所述控制装置的定位信息，根据所述定位信息计算所述控制装置当前位置与所述服务端的距离差值是否小于或等于所述距离范围值，如果是，执行步骤A12；
步骤A12：播放已到达控制区域的语音；
步骤A13：根据所述控制装置的实时定位信息和所述服务端的位置信息，生成导航信息，并将所述导航信息转换为音频文件，将所述音频文件进行语音播报。
上述实施例中，操作者手持控制装置，服务端实时判断控制装置的位置，并通过语音导航的方式，帮助操作者移动至控制区域，对于视觉障碍者来说虽然眼睛看不见，但能通过声音顺利移动至控制区域进行操作。
可选地，作为本发明的另一个实施例，还可以包括步骤：当待控制设备完成所述控制指令时，读取待控制设备当前的参数值，并将所述参数值进行播报。
例如，待控制设备为空调设备，则对空调设备当前的状态进行监测，得到空调设备当前的温度值，通过所述语音模块将当前的温度值进行播报。
上述实施例中，帮助视觉障碍者了解待控制设备的当前参数值，便于更准确对其进行操作。
可选地，作为本发明的另一个实施例，还可以包括步骤：当预设时间段内未向所述待控制设备发送指令，则进入待机状态。
上述实施例中，能够节约耗电量，减少服务端的工作时间，提高使用寿命。
可选地，作为本发明的一个实施例，还可以包括步骤：将待控制设备名称、待控制设备编码以及待控制设备当前的参数值进行显示。具体的，可在服务器端设置显示屏设备，将参数值进行显示。
上述方案的有益技术效果在于，帮助人们快速了解当前所控制的设备信息。
图11为本发明实施例提供的基于体感交互的智能家居控制方法的另一种方法流程图；
可选地，作为本发明的一个实施例，在图8所示实施例的基础上，如图11所示，所述查找到对应的控制指令的具体步骤为：
步骤S031：将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；
步骤S032：将采集的操作者的体感数据与预存体感数据进行匹配，根据匹配到的所述预存体感数据查找到对应的控制指令。
图12为本发明实施例提供的智能家居服务端和控制装置的信令流程示意图；
图13为本发明实施例提供的智能家居服务端和控制装置的连接示意图；
下面结合附图12-13，再从服务端和控制装置数据交互的步骤进行详细说明：
1.控制装置101向服务端102发送连接请求；
2.服务端102接收到所述连接请求后，进行无线连接；可选择蓝牙连接方式或ZigBee连接方式进行互联；
3.服务端102实时获取所述控制装置101的定位信息，根据所述定位信息计算所述 控制装置101当前位置与所述服务端102的距离差值是否小于或等于所述距离范围值，同时根据所述控制装置101的实时定位信息和所述服务端102的位置信息，生成导航信息，并将所述导航信息转换为音频文件进行语音播放，以便已到操作者移动至控制区域内，当所述服务端102的距离差值小于或等于所述距离范围值时，播放已到达控制区域的语音；
4.控制装置101向服务端102发送待控制设备编码；
5.服务端102接收到所述待控制设备编码后，对操作者的动作进行捕捉，得到体感数据，将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令，并根据接收的所述待控制设备编码将所述控制指令发送至对应的待控制设备中执行；当待控制设备完成所述控制指令时，读取待控制设备当前的参数值，并将所述参数值进行播报；
6.服务端102在预设时间段内如果未向所述待控制设备发送指令，则进入待机状态。
步骤5中，例如，当接收的待控制设备编码为01时，则对应空调设备，对操作者动作进行捕捉，得到手势向下的体感数据，则对应的得到空调温度降低的控制指令，将降温控制指令发送待控制设备01即空调设备中，需理解的是，本次降温控制指令使得空调设备的降温幅度为1摄氏度，并播报当前的温度值为28摄氏度，继续对操作者动作进行捕捉，得到手势向下的体感数据，同理，则对应的得到空调温度降低的控制指令，向待控制设备01发送降温控制指令，并播报当前的温度值为27摄氏度；服务端在预设时间段内如果未向所述待控制设备发送指令，即完成本次调温操作，则进入待机状态。
所述控制装置的终端本体的外表面上还包括液晶显示屏，液晶显示屏用于对显示待控制设备名称、待控制设备编码以及待控制设备当前的参数值。帮助人们快速了解当前所控制的设备信息。
本发明能够帮助人们尤其是视觉障碍人群方便的控制各电器设备，能够对操作者的动作进行捕捉，得到体感数据，再对应的匹配得到控制指令，由此来控制对应的电器设备，对电器设备的控制精细化，例如可具体调节温度和音量等，实现了良好的人机交互。
读者应理解，在本说明书的描述中，参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不必针对的是相同的实施例或示例。而且，描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外，在不相互矛盾的情况下，本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
所属领域的技术人员可以清楚地了解到，为了描述的方便和简洁，上述描述的装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。
作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本发明实施例方案的目的。
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以是两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分，或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到各种等效的修改或替换，这些修改或替换都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应以权利要求的保护范围为准。

Claims (10)

  1. 一种基于体感交互的智能家居服务端，其特征在于，包括：
    第一接收模块，用于接收控制装置发送来的待控制设备编码；
    第二接收模块，用于接收动作捕捉装置采集的操作者的体感数据；
    指令生成模块，用于将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；
    指令发送模块，用于将所述控制指令发送至与所述待控制设备编码对应的待控制设备中执行。
  2. 根据权利要求1所述的基于体感交互的智能家居服务端，其特征在于，还包括与所述第一接收模块连接的引导模块和语音模块，
    所述引导模块用于实时获取所述控制装置的定位信息，根据所述定位信息生成引导操作者靠近所述动作捕捉装置的语音；
    所述语音模块，用于将所述语音进行播报。
  3. 根据权利要求2所述的基于体感交互的智能家居服务端，其特征在于，所述引导模块包括定位单元和导航单元，
    所述定位单元，用于设定服务端与控制装置的距离范围值，并实时获取所述控制装置的定位信息，根据所述定位信息计算所述控制装置当前位置与所述服务端的距离差值是否小于或等于距离范围值，如果是，则发送指令至所述语音模块；
    所述语音模块具体用于根据所述指令播放已到达控制区域的语音；
    所述导航单元，用于根据所述控制装置的实时定位信息和所述服务端的位置信息，生成导航信息，并将所述导航信息转换为音频文件，将所述音频文件发送至所述语音模块中；
    所述语音模块还具体用于将所述音频文件进行语音播报。
  4. 根据权利要求1-3任一项所述一种基于体感交互的智能家居服务端，其特征在于，
    所述指令生成模块具体用于，将预存体感数据与对应的控制指令进行保存；还具体用于，将所述动作捕捉装置采集的体感数据与预存体感数据进行匹配，根据匹配到的所述预存体感数据查找到对应的控制指令。
  5. 一种基于体感交互的智能家居控制系统，其特征在于，包括控制装置、动作捕捉装置和权利要求1-4任一项所述智能家居服务端；
    所述控制装置外表面上设有多个按键，多个所述按键一一对应待控制设备编码，当按下所述快捷按钮时将其对应的待控制设备编码发送至智能家居服务端中；
    所述动作捕捉装置包括红外线发射器、CMOS传感器和处理器；
    所述红外光发射器，用于发射红外线；
    所述CMOS传感器，用于检测从所述操作者处反射回的红外线来捕捉操作者的动作；
    所述处理器，用于将所述红外线转换成三维坐标，并确定空间中每个点的位置，生成体感数据，并将所述体感数据发送至服务端；
    所述服务端将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；
    将所述控制指令发送至与所述待控制设备编码对应的待控制设备中执行。
  6. 一种基于体感交互的智能家居控制方法，应用于服务端，其特征在于，包括如下步骤：
    接收控制装置发送来的待控制设备编码；
    接收动作捕捉装置采集的操作者的体感数据；
    将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；
    将所述控制指令发送至与所述待控制设备编码对应的待控制设备中执行。
  7. 根据权利要求6所述的基于体感交互的智能家居控制方法，其特征在于，还包括如下步骤：实时获取所述控制装置的定位信息，根据所述定位信息生成引导操作者靠近所述动作捕捉装置的语音，再将所述语音进行播报。
  8. 根据权利要求6所述的基于体感交互的智能家居控制方法，其特征在于，所述生成引导操作者靠近所述动作捕捉装置的语音信息的具体步骤为：
    设定服务端与控制装置的距离范围值，并实时获取所述控制装置的定位信息，根据所述定位信息计算所述控制装置当前位置与所述服务端的距离差值是否小于或等于所述距离范围值，如果是，
    则播放已到达控制区域的语音；以及
    根据所述控制装置的实时定位信息和所述服务端的位置信息，生成导航信息，并将所述导航信息转换为音频文件，将所述音频文件进行语音播报。
  9. 根据权利要求6-8任一项所述的基于体感交互的智能家居控制方法，其特征在于，所述查找到对应的控制指令的具体步骤为：将所述体感数据与预存的体感数据进行匹配，根据匹配到的体感数据查找到对应的控制指令；以及
    将采集的操作者的体感数据与预存体感数据进行匹配，根据匹配到的所述预存体感数据查找到对应的控制指令。
  10. 根据权利要求6-8任一项所述的基于体感交互的智能家居控制方法，其特征在于，还包括步骤：当待控制设备完成所述控制指令时，读取待控制设备当前的参数值，并将所述参数值进行播报。
PCT/CN2017/098022 2017-06-23 2017-08-18 基于体感交互的智能家居服务端、控制系统及控制方法 Ceased WO2018232945A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710488760.5 2017-06-23
CN201710488760.5A CN107272902B (zh) 2017-06-23 2017-06-23 基于体感交互的智能家居服务端、控制系统及控制方法

Publications (1)

Publication Number Publication Date
WO2018232945A1 true WO2018232945A1 (zh) 2018-12-27

Family

ID=60068689

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/098022 Ceased WO2018232945A1 (zh) 2017-06-23 2017-08-18 基于体感交互的智能家居服务端、控制系统及控制方法

Country Status (2)

Country Link
CN (1) CN107272902B (zh)
WO (1) WO2018232945A1 (zh)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108375911B (zh) * 2018-01-22 2020-03-27 珠海格力电器股份有限公司 一种设备控制方法、装置、存储介质及设备
CN110737325A (zh) * 2018-07-19 2020-01-31 杭州大穿越旅游策划有限公司 交互式操作设施
CN109327760B (zh) * 2018-08-13 2019-12-31 北京中科睿芯科技有限公司 一种智能音响及其播放控制方法
CN109088803B (zh) * 2018-09-20 2023-11-07 塔普翊海（上海）智能科技有限公司 一种ar遥控装置、智能家居遥控系统及方法
CN111722779A (zh) * 2019-03-22 2020-09-29 上海博泰悦臻网络技术服务有限公司 人机交互方法、终端及计算机可读存储介质
CN109947031B (zh) * 2019-04-15 2020-07-28 美的集团股份有限公司 一种智能家居设备控制方法、介质、移动终端和装置
CN114973639B (zh) * 2022-07-27 2022-11-15 广州华途信息科技有限公司 用于人行横道信号灯的视障人士过街音响提示方法及系统
CN115348304B (zh) * 2022-08-22 2024-11-29 杭州拼格文化创意有限公司 一种交互体感盒子的中控系统及其控制方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101699370A (zh) * 2009-11-10 2010-04-28 北京思比科微电子技术有限公司 基于深度检测的身体识别控制装置
CN103529778A (zh) * 2013-09-30 2014-01-22 福建星网视易信息系统有限公司 一种智能家居控制方法、装置和系统
CN103869966A (zh) * 2012-12-17 2014-06-18 力格设计实业有限公司 体感家居用电产品控制设备及其系统
US20150220159A1 (en) * 2014-02-04 2015-08-06 Pointgrab Ltd. System and method for control of a device based on user identification
CN105785782A (zh) * 2016-03-29 2016-07-20 北京小米移动软件有限公司 智能家居设备控制方法及装置
CN105827933A (zh) * 2015-06-29 2016-08-03 维沃移动通信有限公司 一种摄像方法、装置以及移动终端

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102055925A (zh) * 2009-11-06 2011-05-11 康佳集团股份有限公司 支持手势遥控的电视机及其使用方法
CN102881137B (zh) * 2012-09-28 2016-11-16 惠州Tcl移动通信有限公司 通过手持终端实现遥控多个设备的方法、系统及手持终端
CN106155301A (zh) * 2015-04-27 2016-11-23 阿里巴巴集团控股有限公司 一种家庭物联网控制方法、装置及系统
CN106338926A (zh) * 2016-11-01 2017-01-18 成都铅笔科技有限公司 基于人体感应的智慧家居控制系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101699370A (zh) * 2009-11-10 2010-04-28 北京思比科微电子技术有限公司 基于深度检测的身体识别控制装置
CN103869966A (zh) * 2012-12-17 2014-06-18 力格设计实业有限公司 体感家居用电产品控制设备及其系统
CN103529778A (zh) * 2013-09-30 2014-01-22 福建星网视易信息系统有限公司 一种智能家居控制方法、装置和系统
US20150220159A1 (en) * 2014-02-04 2015-08-06 Pointgrab Ltd. System and method for control of a device based on user identification
CN105827933A (zh) * 2015-06-29 2016-08-03 维沃移动通信有限公司 一种摄像方法、装置以及移动终端
CN105785782A (zh) * 2016-03-29 2016-07-20 北京小米移动软件有限公司 智能家居设备控制方法及装置

Also Published As

Publication number Publication date
CN107272902A (zh) 2017-10-20
CN107272902B (zh) 2019-12-10

Similar Documents

Publication Publication Date Title
CN107272902B (zh) 基于体感交互的智能家居服务端、控制系统及控制方法
US12273661B2 (en) Apparatus and method of location determination in a thermal imaging system
US20230205151A1 (en) Systems and methods of gestural interaction in a pervasive computing environment
RU2455676C2 (ru) Способ управления устройством с помощью жестов и 3d-сенсор для его осуществления
CN204480228U (zh) 运动感测和成像设备
US12375785B2 (en) Imaging apparatuses and enclosures
US20140037135A1 (en) Context-driven adjustment of camera parameters
JP6973394B2 (ja) 情報処理装置、情報処理方法、およびプログラム
CN107832712A (zh) 活体检测方法、装置和计算机可读存储介质
KR20170026164A (ko) 가상 현실 디스플레이 장치 및 그 장치의 표시 방법
CN106104650A (zh) 经由凝视检测进行远程设备控制
US11062422B2 (en) Image processing apparatus, image communication system, image processing method, and recording medium
CN111083453A (zh) 一种投影装置、方法及计算机可读存储介质
US20170038912A1 (en) Information providing device
US9268408B2 (en) Operating area determination method and system
KR101523046B1 (ko) 영상처리기반의 거리 측정장치
KR20170066054A (ko) 오디오 제공 방법 및 그 장치
KR101961266B1 (ko) 시선 추적 장치 및 이의 시선 추적 방법
CN104270664B (zh) 光笔遥控器、实现智能操作平台输入控制的系统及方法
JP2019220145A (ja) 操作端末、音声入力方法、及びプログラム
WO2016170804A1 (ja) ユーザインタフェース装置及びユーザインタフェースシステム
KR102574730B1 (ko) Ar 글라스를 이용한 증강 현실 화면 및 리모컨 제공 방법 및 그를 위한 장치 및 시스템
KR20120132930A (ko) 사용자 동작 기반 디스플레이 장치 및 디스플레이 방법
CN111880422B (zh) 设备控制方法及装置、设备、存储介质
WO2021241110A1 (ja) 情報処理装置、情報処理方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17914552

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: 1205A 13.05.2020

122 Ep: pct application non-entry in european phase

Ref document number: 17914552

Country of ref document: EP

Kind code of ref document: A1