WO2018006373A1 - 一种基于意图识别控制家电的方法、系统及机器人 - Google Patents

一种基于意图识别控制家电的方法、系统及机器人 Download PDF

Info

Publication number
WO2018006373A1
WO2018006373A1 PCT/CN2016/089217 CN2016089217W WO2018006373A1 WO 2018006373 A1 WO2018006373 A1 WO 2018006373A1 CN 2016089217 W CN2016089217 W CN 2016089217W WO 2018006373 A1 WO2018006373 A1 WO 2018006373A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
parameter
robot
variable
parameters
Prior art date
Application number
PCT/CN2016/089217
Other languages
English (en)
French (fr)
Inventor
邱楠
杨新宇
王昊奋
Original Assignee
深圳狗尾草智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳狗尾草智能科技有限公司 filed Critical 深圳狗尾草智能科技有限公司
Priority to CN201680001723.0A priority Critical patent/CN106462124A/zh
Priority to PCT/CN2016/089217 priority patent/WO2018006373A1/zh
Publication of WO2018006373A1 publication Critical patent/WO2018006373A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house

Definitions

  • the present invention relates to the field of robot interaction technologies, and in particular, to a method, system and robot for controlling home appliances based on intention recognition.
  • robots As an interactive tool with humans, robots are used more and more. For example, some elderly people and children can interact with robots, including dialogue and entertainment.
  • Smart home is a residential platform, using integrated wiring technology, network communication technology, security technology, automatic control technology, audio and video technology to integrate home life related facilities, and build efficient management system for residential facilities and family schedules.
  • a method for controlling home appliances based on intent recognition includes:
  • the home appliance is controlled in accordance with the context record and the variable parameters according to the user's multimodal information and user intent.
  • the context record includes a dialogue record between the robot and the user in a preset time period; and the step of controlling the home appliance by combining the context record and the variable parameter comprises: combining the dialogue record between the robot and the user in the preset time period And variable parameters control the appliance.
  • variable parameter includes at least one or more of temperature, weather, brightness, cleanliness, and humidity.
  • the home appliance includes an air conditioner
  • the conversation record includes user's evaluation information on temperature or weather
  • the step of controlling the home appliance by combining the context record and the variable parameter specifically includes:
  • the home appliance is controlled by combining the user's evaluation of temperature or weather and variable parameters within a preset time period.
  • variable parameter comprises a change of the outdoor real-time temperature
  • step of controlling the home appliance by combining the context record and the variable parameter comprises: controlling the home appliance according to the context record and the change of the outdoor real-time temperature
  • the method for generating the variable parameter of the robot comprises: fitting a parameter of the self-cognition of the robot with a parameter of the scene in the variable parameter to generate a variable parameter of the robot.
  • variable parameter includes at least a behavior of changing a user's original behavior and a change, and a parameter value representing a behavior of changing a user's original behavior and a change.
  • the step of generating the interactive content according to the multimodal information and the variable parameter specifically includes: generating the interactive content according to the multimodal information and the variable parameter and the fitting curve of the parameter changing probability.
  • the method for generating a fitting curve of the parameter change probability comprises: using a probability algorithm, using a network to make a probability estimation of parameters between the robots, and calculating a scene parameter change of the robot on the life time axis on the life time axis. After that, the probability of each parameter change forms a fitted curve of the parameter change probability.
  • the invention discloses a system for controlling home appliances based on intention recognition, comprising:
  • An obtaining module configured to acquire multi-modal information of the user
  • An intent identification module configured to identify a user intent according to the multimodal information
  • the artificial intelligence module is configured to control the home appliance according to the user's multi-modal information and user intention, combined with the context record and the variable parameter.
  • the context record includes a dialogue record between the robot and the user in a preset time period; the artificial intelligence module is specifically configured to: control the home appliance by using a dialogue record and a variable parameter of the robot and the user in a preset time period. .
  • variable parameter includes at least one or more of temperature, weather, brightness, cleanliness, and humidity.
  • the home appliance includes an air conditioner
  • the conversation record includes user evaluation information on temperature or weather
  • the artificial intelligence module is specifically configured to:
  • variable parameter includes a change of the outdoor real-time temperature
  • artificial intelligence module is specifically configured to: control the home appliance according to the context record and the change of the outdoor real-time temperature.
  • the system further comprises a processing module for fitting the self-cognitive parameters of the robot with the parameters of the scene in the variable parameters to generate variable parameters.
  • variable parameter includes at least a behavior of changing a user's original behavior and a change, and a parameter value representing a behavior of changing a user's original behavior and a change.
  • the artificial intelligence module is specifically configured to: generate interaction content according to the multi-modal information and the variable parameter and the fitting curve of the parameter change probability.
  • the system includes a fitting curve generating module for using a probability algorithm to estimate a parameter between the robots using a network, and calculating a scene parameter of the robot on the life time axis after the life time axis is changed.
  • the probability of each parameter change forms a fitted curve of the parameter change probability.
  • the present invention discloses a robot comprising a system for controlling home appliances based on intention recognition as described in any of the above.
  • the method for controlling the home appliance based on the intention identification of the present invention comprises: acquiring multimodal information of the user; identifying the user intention according to the multimodal information; and multimodal information according to the user And the user's intention, combined with context records and variable parameters to control the appliance.
  • the user's intention can be identified by one or more of the user's multimodal information such as user voice, user expression, user action, etc., for example, the user wants to be a little cold and wants to raise the indoor temperature or the user is somewhat eager to lower.
  • the invention applies artificial intelligence to the smart home, and more Convenient and accurate control of home appliances makes people's daily life more convenient, and can also increase the fun and interactivity of life, add more excitement to life, and make robots more anthropomorphic, and improve artificial intelligence in smart homes. User experience.
  • FIG. 1 is a flow chart of a method for controlling home appliances based on intention recognition according to a first embodiment of the present invention
  • FIG. 2 is a schematic diagram of a system for controlling home appliances based on intention recognition according to a second embodiment of the present invention.
  • Computer devices include user devices and network devices.
  • the user equipment or the client includes but is not limited to a computer, a smart phone, a PDA, etc.;
  • the network device includes but is not limited to a single network server, a server group composed of multiple network servers, or a cloud computing-based computer or network server. cloud.
  • the computer device can operate alone to carry out the invention, and can also access the network and implement the invention through interoperation with other computer devices in the network.
  • the network in which the computer device is located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, and the like.
  • first means “first,” “second,” and the like may be used herein to describe the various elements, but the elements should not be limited by these terms, and the terms are used only to distinguish one element from another.
  • the term “and/or” used herein includes any and all combinations of one or more of the associated listed items. When a unit is referred to as being “connected” or “coupled” to another unit, it can be directly connected or coupled to the other unit, or an intermediate unit can be present.
  • a method for controlling a home appliance based on intention recognition is disclosed in the embodiment, including:
  • the method for controlling home appliance based on intention recognition includes: acquiring multimodal information of a user; identifying user intent according to the multimodal information; combining context record and variable parameter pair according to multimodal information of the user and user intention Home appliances are controlled.
  • the user's intention can be identified by one or more of the user's multimodal information such as user voice, user expression, user action, etc., for example, the user wants to be a little cold and wants to raise the indoor temperature or the user is somewhat eager to lower.
  • the invention applies artificial intelligence to the smart home, and more Convenient and accurate control of home appliances makes people's daily life more convenient, and can also increase the fun and interactivity of life, add more excitement to life, and make robots more anthropomorphic, and improve artificial intelligence in smart homes. User experience.
  • the multimodal information in this embodiment may be one or more of user expression, voice information, gesture information, scene information, image information, video information, face information, pupil iris information, light sense information, and fingerprint information.
  • voice information voice information
  • gesture information scene information
  • image information video information
  • face information face information
  • pupil iris information light sense information
  • fingerprint information fingerprint information
  • variable parameters are specifically: sudden changes in people and machines, such as one day on the time axis is eating, sleeping, interacting, running, eating, sleeping. In this case, if the scene of the robot is suddenly changed, such as taking the beach at the time of running, etc., these human active parameters for the robot, as variable parameters, will cause the robot's self-cognition to change.
  • the life timeline and variable parameters can be used to change the attributes of self-cognition, such as mood values, fatigue values, etc., and can also automatically add new self-awareness information, such as no previous anger value, based on the life time axis and The scene of the variable factor will automatically add to the self-cognition of the robot based on the scene that previously simulated the human self-cognition.
  • the robot will use this as a variable parameter.
  • the robot will go out to go shopping at 12 noon to generate interactive content, instead of combining the previous 12 noon to generate interactive content in the meal, in the specific interaction
  • the robot generates the multi-modal information of the acquired user, such as voice information, video information, picture information, and the like, and variable parameters. In this way, some unexpected events in human life can be added to the life axis of the robot, making the interaction of the robot more anthropomorphic.
  • the home appliance may be a household appliance used in daily life, such as a lamp, a refrigerator, an air conditioner, a television, a washing machine, a microwave oven, or the like.
  • the variable parameters in this embodiment are correspondingly selected according to different home appliances.
  • the variable parameters include at least temperature, weather, brightness, One or several of cleanliness and humidity.
  • the variable parameter may be temperature.
  • the variable parameter may be temperature, weather, etc.
  • the variable parameter may be humidity.
  • the variable parameters can be cleanliness and the like.
  • air conditioning When it is an air conditioner, the user adjusts the temperature of the air conditioner or the air conditioner is turned on or off.
  • the artificial intelligence module judges the variable parameters, for example, the weather is raining, and the outdoor temperature is lowered, so that the robot will increase the temperature of the air conditioner according to the temperature in the context record.
  • the conversation record includes user's evaluation information on temperature or weather; the step of controlling the air conditioner in combination with the context record and the variable parameter specifically includes:
  • the air conditioner is controlled by combining the user's evaluation of temperature or weather and variable parameters within a preset time period.
  • the temperature of the air conditioner can be judged according to the temperature in the previous context record. For example, if the user has said that the heat is good before, the temperature of the air conditioner can be lowered when the air conditioner is turned on.
  • variable parameter includes a change in outdoor real-time temperature
  • step of controlling the air conditioner in conjunction with the context record and the variable parameter includes controlling the air conditioner in conjunction with a change in the context record and the outdoor real-time temperature
  • the temperature of the air conditioner can be controlled in real time according to the outdoor temperature.
  • the method for generating a robot variable parameter includes: fitting a self-cognitive parameter of the robot with a parameter of a scene in the variable parameter to generate a robot variable parameter.
  • the parameters in the self-cognition are matched with the parameters of the scene used in the variable participation axis, and the influence of the personification is generated.
  • variable parameter includes at least a behavior that changes the user's original behavior and the change, and a parameter value that represents a change in the user's original behavior and the behavior after the change.
  • variable parameters are in the same state as the original plan.
  • the sudden change causes the user to be in another state.
  • the variable parameter represents the change of the behavior or state, and the state or behavior of the user after the change. For example, it was originally running at 5 pm, and suddenly there were other things, such as going to play, then changing from running to playing is a variable parameter, and also to study this The chance of change.
  • the step of generating the interactive content according to the multimodal information and the variable parameter specifically includes: generating the interactive content according to the multimodal information and the variable parameter and the fitting curve of the parameter change probability.
  • the fitting curve can be generated by the probability training of the variable parameters, thereby generating the robot interaction content.
  • the method for generating a fitting curve of the parameter change probability includes: using a probability algorithm, using a network to make a probability estimation of parameters between the robots, and calculating a scene of the robot on the life time axis on the life time axis. After the parameter is changed, the probability of each parameter changing forms a fitting curve of the parameter change probability.
  • the probability algorithm can adopt the Bayesian probability algorithm.
  • the parameters in the self-cognition are matched with the parameters of the scene used in the variable participation axis, and the influence of the personification is generated.
  • the robot will know its geographical location, and will change the way the interactive content is generated according to the geographical environment in which it is located.
  • Bayesian probability algorithm to estimate the parameters between robots using Bayesian network, and calculate the probability of each parameter change after the change of the time axis scene parameters of the robot itself on the life time axis.
  • the curve dynamically affects the self-recognition of the robot itself.
  • This innovative module makes the robot itself a human lifestyle. For the expression, it can be changed according to the location scene.
  • a system for controlling home appliances based on intent identification including:
  • the obtaining module 201 is configured to acquire multi-modal information of the user
  • the intent identification module 202 is configured to identify a user intent according to the multimodal information, wherein the variable parameter is generated by the variable parameter module 301;
  • the artificial intelligence module 203 is configured to control the home appliance according to the multi-modality information of the user and the user intention, in combination with the context record and the variable parameter, wherein the variable parameter is generated by the variable parameter module 301, wherein the context record is recorded by the context record module 401 generated.
  • the user's intention can be identified by one or more of the user's multimodal information such as user voice, user expression, user action, etc., for example, the user wants to be a little cold and wants to improve the room.
  • the internal temperature or the user is a bit hot to reduce the indoor temperature, etc.
  • the present invention will be artificial Intelligent application to smart home, more convenient and accurate control of air conditioning, making people's daily life more convenient, and can also increase the fun and interactivity of life, add more excitement to life, and make the robot more anthropomorphic, also Improve the user experience of artificial intelligence in smart homes.
  • variable parameters are specifically: sudden changes in people and machines, such as one day on the time axis is eating, sleeping, interacting, running, eating, sleeping. In this case, if the scene of the robot is suddenly changed, such as taking the beach at the time of running, etc., these human active parameters for the robot, as variable parameters, will cause the robot's self-cognition to change.
  • the life timeline and variable parameters can be used to change the attributes of self-cognition, such as mood values, fatigue values, etc., and can also automatically add new self-awareness information, such as no previous anger value, based on the life time axis and The scene of the variable factor will automatically add to the self-cognition of the robot based on the scene that previously simulated the human self-cognition.
  • the robot will use this as a variable parameter.
  • the robot will go out to go shopping at 12 noon to generate interactive content, instead of combining the previous 12 noon to generate interactive content in the meal, in the specific interaction
  • the robot generates the multi-modal information of the acquired user, such as voice information, video information, picture information, and the like, and variable parameters. In this way, some unexpected events in human life can be added to the life axis of the robot, making the interaction of the robot more anthropomorphic.
  • the home appliance may be a household appliance used in daily life, such as a lamp, a refrigerator, an air conditioner, a television, a washing machine, a microwave oven, or the like.
  • a household appliance used in daily life such as a lamp, a refrigerator, an air conditioner, a television, a washing machine, a microwave oven, or the like.
  • the following is an example of air conditioning.
  • the user adjusts the temperature of the air conditioner or the air conditioner is turned on or off.
  • the artificial intelligence module judges the variable parameters, for example, the weather is raining, and the outdoor temperature is lowered, so that the robot will increase the temperature of the air conditioner according to the temperature in the context record.
  • the conversation record includes user evaluation information on temperature or weather; the artificial intelligence module is specifically configured to:
  • the air conditioner is controlled by combining the user's evaluation of temperature or weather and variable parameters within a preset time period.
  • the temperature of the air conditioner can be judged according to the temperature in the previous context record. For example, if the user has said that the heat is good before, the temperature of the air conditioner can be lowered when the air conditioner is turned on.
  • variable parameter includes a change in outdoor real-time temperature
  • artificial intelligence module is specifically configured to: control the air conditioner in combination with a change in the context record and the outdoor real-time temperature.
  • the temperature of the air conditioner can be controlled in real time according to the outdoor temperature.
  • the system further includes a processing module for fitting the self-cognitive parameters of the robot with the parameters of the scene in the variable parameters to generate variable parameters.
  • variable parameter includes at least a behavior that changes the user's original behavior and the change, and a parameter value that represents a change in the user's original behavior and the behavior after the change.
  • variable parameters are in the same state as the original plan.
  • the sudden change causes the user to be in another state.
  • the variable parameter represents the change of the behavior or state, and the state or behavior of the user after the change. For example, it was originally running at 5 pm, and suddenly there were other things, such as going to play, then changing from running to playing is a variable parameter, and the probability of such a change is also studied.
  • the artificial intelligence module is specifically configured to: generate interaction content according to the multi-modality information and the variable parameter and the fitting curve of the parameter change probability.
  • the fitting curve can be generated by the probability training of the variable parameters, thereby generating the robot interaction content.
  • the system includes a fitting curve generation module for using a probability algorithm to estimate a parameter between the robots using a network for probability estimation, and calculating a scene parameter change of the robot on the life time axis on the life time axis. After that, the probability of each parameter change forms a fitted curve of the parameter change probability.
  • the probability algorithm can adopt the Bayesian probability algorithm.
  • the parameters in the self-cognition are matched with the parameters of the scene used in the variable participation axis, and the influence of the personification is generated.
  • the robot will know its geographical location, and will change the way the interactive content is generated according to the geographical environment in which it is located.
  • Bayesian probability algorithm to estimate the parameters between robots using Bayesian network, and calculate the probability of each parameter change after the change of the time axis scene parameters of the robot itself on the life time axis.
  • the curve dynamically affects the self-recognition of the robot itself.
  • This innovative module makes the robot itself a human lifestyle. For the expression, it can be changed according to the location scene.
  • the present invention discloses a robot comprising a system for controlling home appliances based on intention recognition as described in any of the above.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Manipulator (AREA)

Abstract

一种基于意图识别控制家电的方法,包括:获取用户的多模态信息(S101);根据所述多模态信息识别用户意图(S102);根据用户的多模态信息和用户意图,结合上下文记录(300)和可变参数(400)对家电进行控制(S103)。这样就可以通过用户的多模态信息例如用户语音、用户表情、用户动作等的一种或几种,来识别出用户意图,结合上下文记录(300)和可变参数(400)来对家电进行控制,从而更加智能化了自动调节家电。

Description

一种基于意图识别控制家电的方法、系统及机器人 技术领域
本发明涉及机器人交互技术领域,尤其涉及一种基于意图识别控制家电的方法、系统及机器人。
背景技术
机器人作为与人类的交互工具,使用的场合越来越多,例如一些老人、小孩较孤独时,就可以与机器人交互,包括对话、娱乐等。
智能家居是以住宅为平台,利用综合布线技术、网络通信技术、安全防范技术、自动控制技术、音视频技术将家居生活有关的设施集成,构建高效的住宅设施与家庭日程事务的管理系统,提升家居安全性、便利性、舒适性、艺术性,并实现环保节能的居住环境。
而在智能家居方面,机器人的使用还比较少,因此发明人研究如何既可以与人类进行交互,也可以在智能家居方面使用的机器人,将人工智能应用到智能家居方面的问题,以期提出更好的解决方案,提升用户体验。
发明内容
本发明的目的是提供一种基于意图识别控制家电的方法、系统及机器人,提升人工智能在智能家居方面的用户体验。
本发明的目的是通过以下技术方案来实现的:
一种基于意图识别控制家电的方法,包括:
获取用户的多模态信息;
根据所述多模态信息识别用户意图;
根据用户的多模态信息和用户意图,结合上下文记录和可变参数对家电进行控制。
优选的,所述上下文记录包括在预设时间段内机器人与用户的对话记录;所述结合上下文记录和可变参数对家电进行控制步骤具体包括:结合预设时间段内机器人与用户的对话记录和可变参数对家电进行控制。
优选的,所述可变参数至少包括温度、天气、亮度、洁净度、湿度中的一种或几种。
优选的,所述家电包括空调,所述对话记录中包括用户对温度或天气的评价信息;所述结合上下文记录和可变参数对家电进行控制的步骤具体包括:
结合在预设时间段内用户对温度或天气的评价和可变参数对家电进行控制。
优选的,所述可变参数包括室外实时温度的变化,所述结合上下文记录和可变参数对家电进行控制的步骤包括:结合上下文记录和室外实时温度的变化对家电进行控制。
优选的,所述机器人可变参数的生成方法包括:将机器人的自我认知的参数与可变参数中场景的参数进行拟合,生成机器人可变参数。
优选的,所述可变参数至少包括改变用户原本的行为和改变之后的行为,以及代表改变用户原本的行为和改变之后的行为的参数值。
优选的,所述根据所述多模态信息和可变参数生成交互内容的步骤具体包括:根据所述多模态信息和可变参数以及参数改变概率的拟合曲线生成交互内容。
优选的,所述参数改变概率的拟合曲线的生成方法包括:使用概率算法,将机器人之间的参数用网络做概率估计,计算当生活时间轴上的机器人在生活时间轴上的场景参数改变后,每个参数改变的概率,形成所述参数改变概率的拟合曲线。
本发明公开一种基于意图识别控制家电的系统,包括:
获取模块,用于获取用户的多模态信息;
意图识别模块,用于根据所述多模态信息识别用户意图;
人工智能模块,用于根据用户的多模态信息和用户意图,结合上下文记录和可变参数对家电进行控制。
优选的,所述上下文记录包括在预设时间段内机器人与用户的对话记录;所述人工智能模块具体用于:结合预设时间段内机器人与用户的对话记录和可变参数对家电进行控制。
优选的,所述可变参数至少包括温度、天气、亮度、洁净度、湿度中的一种或几种。
优选的,所述家电包括空调,所述对话记录中包括用户对温度或天气的评价信息;所述人工智能模块具体用于:
结合在预设时间段内用户对温度或天气的评价和可变参数对家电进行 控制。
优选的,所述可变参数包括室外实时温度的变化,所述人工智能模块具体用于:结合上下文记录和室外实时温度的变化对家电进行控制。
优选的,所述系统还包括处理模块,用于将机器人的自我认知的参数与可变参数中场景的参数进行拟合,生成可变参数。
优选的,所述可变参数至少包括改变用户原本的行为和改变之后的行为,以及代表改变用户原本的行为和改变之后的行为的参数值。
优选的,所述人工智能模块具体用于:根据所述多模态信息和可变参数以及参数改变概率的拟合曲线生成交互内容。
优选的,所述系统包括拟合曲线生成模块,用于使用概率算法,将机器人之间的参数用网络做概率估计,计算当生活时间轴上的机器人在生活时间轴上的场景参数改变后,每个参数改变的概率,形成所述参数改变概率的拟合曲线。
本发明公开一种机器人,包括如上述任一所述的一种基于意图识别控制家电的系统。
相比现有技术,本发明具有以下优点:本发明的基于意图识别控制家电的方法包括:获取用户的多模态信息;根据所述多模态信息识别用户意图;根据用户的多模态信息和用户意图,结合上下文记录和可变参数对家电进行控制。这样就可以通过用户的多模态信息例如用户语音、用户表情、用户动作等的一种或几种,来识别出用户意图,例如用户是想要有点冷想提高室内温度或用户有点热想降低室内温度等,然后根据用户的多模态信息和用户意图,结合上下文记录和可变参数来对家电进行控制,从而更加智能化了自动调节家电,本发明将人工智能应用到智能家居中,更加便捷、准确的控制家电,使人们的日常生活更加方便,并且还可以增加生活的趣味性和互动性,为生活添加更多精彩,并且使机器人更加拟人化,也提高了人工智能在智能家居方面的用户体验。
附图说明
图1是本发明实施例一的一种基于意图识别控制家电的方法的流程图;
图2是本发明实施例二的一种基于意图识别控制家电的系统的示意图。
具体实施方式
虽然流程图将各项操作描述成顺序的处理,但是其中的许多操作可以被并行地、并发地或者同时实施。各项操作的顺序可以被重新安排。当其操作完成时处理可以被终止,但是还可以具有未包括在附图中的附加步骤。处理可以对应于方法、函数、规程、子例程、子程序等等。
计算机设备包括用户设备与网络设备。其中,用户设备或客户端包括但不限于电脑、智能手机、PDA等;网络设备包括但不限于单个网络服务器、多个网络服务器组成的服务器组或基于云计算的由大量计算机或网络服务器构成的云。计算机设备可单独运行来实现本发明,也可接入网络并通过与网络中的其他计算机设备的交互操作来实现本发明。计算机设备所处的网络包括但不限于互联网、广域网、城域网、局域网、VPN网络等。
在这里可能使用了术语“第一”、“第二”等等来描述各个单元,但是这些单元不应当受这些术语限制,使用这些术语仅仅是为了将一个单元与另一个单元进行区分。这里所使用的术语“和/或”包括其中一个或更多所列出的相关联项目的任意和所有组合。当一个单元被称为“连接”或“耦合”到另一单元时,其可以直接连接或耦合到所述另一单元,或者可以存在中间单元。
这里所使用的术语仅仅是为了描述具体实施例而不意图限制示例性实施例。除非上下文明确地另有所指,否则这里所使用的单数形式“一个”、“一项”还意图包括复数。还应当理解的是,这里所使用的术语“包括”和/或“包含”规定所陈述的特征、整数、步骤、操作、单元和/或组件的存在,而不排除存在或添加一个或更多其他特征、整数、步骤、操作、单元、组件和/或其组合。
下面结合附图和较佳的实施例对本发明作进一步说明。
实施例一
如图1所示,本实施例中公开一种基于意图识别控制家电的方法,包括:
S101、获取用户的多模态信息;
S102、根据所述多模态信息识别用户意图;
S103、根据用户的多模态信息和用户意图,结合上下文记录300和可变参数400对家电进行控制。
本发明的基于意图识别控制家电的方法包括:获取用户的多模态信息;根据所述多模态信息识别用户意图;根据用户的多模态信息和用户意图,结合上下文记录和可变参数对家电进行控制。这样就可以通过用户的多模态信息例如用户语音、用户表情、用户动作等的一种或几种,来识别出用户意图,例如用户是想要有点冷想提高室内温度或用户有点热想降低室内温度等,然后根据用户的多模态信息和用户意图,结合上下文记录和可变参数来对家电进行控制,从而更加智能化了自动调节家电,本发明将人工智能应用到智能家居中,更加便捷、准确的控制家电,使人们的日常生活更加方便,并且还可以增加生活的趣味性和互动性,为生活添加更多精彩,并且使机器人更加拟人化,也提高了人工智能在智能家居方面的用户体验。
本实施例中的多模态信息可以是用户表情、语音信息、手势信息、场景信息、图像信息、视频信息、人脸信息、瞳孔虹膜信息、光感信息和指纹信息等其中的一种或几种。
本实施例中,可变参数具体是:人与机器发生的突发改变,比如时间轴上的一天生活是吃饭、睡觉、交互、跑步、吃饭、睡觉。那在这个情况下,假如突然改变机器人的场景,比如在跑步的时间段带去海边等等,这些人类主动对于机器人的参数,作为可变参数,这些改变会使得机器人的自我认知产生改变。生活时间轴与可变参数可以对自我认知中的属性,例如心情值,疲劳值等等的更改,也可以自动加入新的自我认知信息,比如之前没有愤怒值,基于生活时间轴和可变因素的场景就会自动根据之前模拟人类自我认知的场景,从而对机器人的自我认知进行添加。
例如,按照生活时间轴,在中午12点的时候应该是吃饭的时间,而如果改变了这个场景,比如在中午12点的时候出去逛街了,那么机器人就会将这个作为其中的一个可变参数进行写入,在这个时间段内用户与机器人交互时,机器人就会结合到中午12点出去逛街进行生成交互内容,而不是以之前的中午12点在吃饭进行结合生成交互内容,在具体生成交互内容时,机器人就会结合获取的用户的多模态信息,例如语音信息、视屏信息、图片信息等和可变参数进行生成。这样就可以加入一些人类生活中的突发事件在机器人的生活轴中,让机器人的交互更加拟人化。
本实施例中,家电可以是日常生活中使用的家用电器,例如灯具,冰箱,空调,电视机,洗衣机,微波炉等。本实施例中的可变参数是根据不同的家电进行对应选择的。对应的,可变参数至少包括温度、天气、亮度、 洁净度、湿度中的一种或几种。当家电为冰箱、空调等时,可变参数就可以是温度,当家电是空调时,可变参数就可以是温度、天气等,当家电是除湿器时,可变参数就可以是湿度,当家电是扫地机器人时,可变参数就可以是洁净度等。
下面以空调为例进行说明,当为空调时,用户调节的就是空调的温度或空调的开或关。
例如,用户说开空调,人工智能模块判断可变参数,例如天气为下雨,室外温度下降,这样机器人就会根据上下文记录中的温度,会提高空调的温度。
当然,本实施例仅以空调为例进行说明,其余家电也可以应用到本实施例中。
根据其中一个示例,所述对话记录中包括用户对温度或天气的评价信息;所述结合上下文记录和可变参数对空调进行控制的步骤具体包括:
结合在预设时间段内用户对温度或天气的评价和可变参数对空调进行控制。
这样就可以根据之前上下文记录中的温度进行判断空调的温度,例如用户之前说过好热,那么在开启空调的时候,就可以将空调的温度调低。
根据其中一个示例,所述可变参数包括室外实时温度的变化,所述结合上下文记录和可变参数对空调进行控制的步骤包括:结合上下文记录和室外实时温度的变化对空调进行控制。
这样就可以根据室外的温度实时的对空调的温度进行控制。
根据其中一个示例,所述机器人可变参数的生成方法包括:将机器人的自我认知的参数与可变参数中场景的参数进行拟合,生成机器人可变参数。这样通过在结合可变参数的机器人的场景,将机器人本身的自我认知行扩展,对自我认知中的参数与可变参会苏轴中使用场景的参数进行拟合,产生拟人化的影响。
根据其中一个示例,所述可变参数至少包括改变用户原本的行为和改变之后的行为,以及代表改变用户原本的行为和改变之后的行为的参数值。
可变参数就是按照原本计划,是处于一种状态的,突然的改变让用户处于了另一种状态,可变参数就代表了这种行为或状态的变化,以及变化之后用户的状态或者行为,例如原本在下午5点是在跑步,突然有其他的事,例如去打球,那么从跑步改为打球就是可变参数,另外还要研究这种 改变的几率。
根据其中一个示例,所述根据所述多模态信息和可变参数生成交互内容的步骤具体包括:根据所述多模态信息和可变参数以及参数改变概率的拟合曲线生成交互内容。
这样就可以通过可变参数的概率训练生成拟合曲线,从而生成机器人交互内容。
根据其中一个示例,所述参数改变概率的拟合曲线的生成方法包括:使用概率算法,将机器人之间的参数用网络做概率估计,计算当生活时间轴上的机器人在生活时间轴上的场景参数改变后,每个参数改变的概率,形成所述参数改变概率的拟合曲线。其中,概率算法可以采用贝叶斯概率算法。
通过在结合可变参数的机器人的场景,将机器人本身的自我认知行扩展,对自我认知中的参数与可变参会苏轴中使用场景的参数进行拟合,产生拟人化的影响。同时,加上对于地点场景的识别,使得机器人会知道自己的地理位置,会根据自己所处的地理环境,改变交互内容生成的方式。另外,我们使用贝叶斯概率算法,将机器人之间的参数用贝叶斯网络做概率估计,计算生活时间轴上的机器人本身时间轴场景参数改变后,每个参数改变的概率,形成拟合曲线,动态影响机器人本身的自我认知。这种创新的模块使得机器人本身具有人类的生活方式,对于表情这块,可按照所处的地点场景,做表情方面的改变。
实施例二
如图2所示,本实施例中公开一种基于意图识别控制家电的系统,包括:
获取模块201,用于获取用户的多模态信息;
意图识别模块202,用于根据所述多模态信息识别用户意图,其中可变参数由可变参数模块301生成;
人工智能模块203,用于根据用户的多模态信息和用户意图,结合上下文记录和可变参数对家电进行控制,其中可变参数由可变参数模块301生成,,其中上下文记录由上下文记录模块401生成。
这样就可以通过用户的多模态信息例如用户语音、用户表情、用户动作等的一种或几种,来识别出用户意图,例如用户是想要有点冷想提高室 内温度或用户有点热想降低室内温度等,然后根据用户的多模态信息和用户意图,结合上下文记录和可变参数来对空调进行控制,从而更加智能化了自动调节空调,本发明将人工智能应用到智能家居中,更加便捷、准确的控制空调,使人们的日常生活更加方便,并且还可以增加生活的趣味性和互动性,为生活添加更多精彩,并且使机器人更加拟人化,也提高了人工智能在智能家居方面的用户体验。
本实施例中,可变参数具体是:人与机器发生的突发改变,比如时间轴上的一天生活是吃饭、睡觉、交互、跑步、吃饭、睡觉。那在这个情况下,假如突然改变机器人的场景,比如在跑步的时间段带去海边等等,这些人类主动对于机器人的参数,作为可变参数,这些改变会使得机器人的自我认知产生改变。生活时间轴与可变参数可以对自我认知中的属性,例如心情值,疲劳值等等的更改,也可以自动加入新的自我认知信息,比如之前没有愤怒值,基于生活时间轴和可变因素的场景就会自动根据之前模拟人类自我认知的场景,从而对机器人的自我认知进行添加。
例如,按照生活时间轴,在中午12点的时候应该是吃饭的时间,而如果改变了这个场景,比如在中午12点的时候出去逛街了,那么机器人就会将这个作为其中的一个可变参数进行写入,在这个时间段内用户与机器人交互时,机器人就会结合到中午12点出去逛街进行生成交互内容,而不是以之前的中午12点在吃饭进行结合生成交互内容,在具体生成交互内容时,机器人就会结合获取的用户的多模态信息,例如语音信息、视屏信息、图片信息等和可变参数进行生成。这样就可以加入一些人类生活中的突发事件在机器人的生活轴中,让机器人的交互更加拟人化。
本实施例中,家电可以是日常生活中使用的家用电器,例如灯具,冰箱,空调,电视机,洗衣机,微波炉等。下面以空调为例进行说明,当为空调时,用户调节的就是空调的温度或空调的开或关。
例如,用户说开空调,人工智能模块判断可变参数,例如天气为下雨,室外温度下降,这样机器人就会根据上下文记录中的温度,会提高空调的温度。
当然,本实施例仅以空调为例进行说明,其余家电也可以应用到本实施例中。
根据其中一个示例,所述对话记录中包括用户对温度或天气的评价信息;所述人工智能模块具体用于:
结合在预设时间段内用户对温度或天气的评价和可变参数对空调进行控制。
这样就可以根据之前上下文记录中的温度进行判断空调的温度,例如用户之前说过好热,那么在开启空调的时候,就可以将空调的温度调低。
根据其中一个示例,所述可变参数包括室外实时温度的变化,所述人工智能模块具体用于:结合上下文记录和室外实时温度的变化对空调进行控制。
这样就可以根据室外的温度实时的对空调的温度进行控制。
根据其中一个示例,所述系统还包括处理模块,用于将机器人的自我认知的参数与可变参数中场景的参数进行拟合,生成可变参数。
这样通过在结合可变参数的机器人的场景,将机器人本身的自我认知行扩展,对自我认知中的参数与可变参会苏轴中使用场景的参数进行拟合,产生拟人化的影响。
根据其中一个示例,所述可变参数至少包括改变用户原本的行为和改变之后的行为,以及代表改变用户原本的行为和改变之后的行为的参数值。
可变参数就是按照原本计划,是处于一种状态的,突然的改变让用户处于了另一种状态,可变参数就代表了这种行为或状态的变化,以及变化之后用户的状态或者行为,例如原本在下午5点是在跑步,突然有其他的事,例如去打球,那么从跑步改为打球就是可变参数,另外还要研究这种改变的几率。
根据其中一个示例,所述人工智能模块具体用于:根据所述多模态信息和可变参数以及参数改变概率的拟合曲线生成交互内容。
这样就可以通过可变参数的概率训练生成拟合曲线,从而生成机器人交互内容。
根据其中一个示例,所述系统包括拟合曲线生成模块,用于使用概率算法,将机器人之间的参数用网络做概率估计,计算当生活时间轴上的机器人在生活时间轴上的场景参数改变后,每个参数改变的概率,形成所述参数改变概率的拟合曲线。其中,概率算法可以采用贝叶斯概率算法。
通过在结合可变参数的机器人的场景,将机器人本身的自我认知行扩展,对自我认知中的参数与可变参会苏轴中使用场景的参数进行拟合,产生拟人化的影响。同时,加上对于地点场景的识别,使得机器人会知道自己的地理位置,会根据自己所处的地理环境,改变交互内容生成的方式。 另外,我们使用贝叶斯概率算法,将机器人之间的参数用贝叶斯网络做概率估计,计算生活时间轴上的机器人本身时间轴场景参数改变后,每个参数改变的概率,形成拟合曲线,动态影响机器人本身的自我认知。这种创新的模块使得机器人本身具有人类的生活方式,对于表情这块,可按照所处的地点场景,做表情方面的改变。
本发明公开一种机器人,包括如上述任一所述的一种基于意图识别控制家电的系统。
以上内容是结合具体的优选实施方式对本发明所作的进一步详细说明,不能认定本发明的具体实施只局限于这些说明。对于本发明所属技术领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干简单推演或替换,都应当视为属于本发明的保护范围。

Claims (19)

  1. 一种基于意图识别控制家电的方法,其特征在于,包括:
    获取用户的多模态信息;
    根据所述多模态信息识别用户意图;
    根据用户的多模态信息和用户意图,结合上下文记录和可变参数对家电进行控制。
  2. 根据权利要求1所述的方法,其特征在于,所述上下文记录包括在预设时间段内机器人与用户的对话记录;所述结合上下文记录和可变参数对家电进行控制步骤具体包括:结合预设时间段内机器人与用户的对话记录和可变参数对家电进行控制。
  3. 根据权利要求1所述的方法,其特征在于,所述可变参数至少包括温度、天气、亮度、洁净度、湿度中的一种或几种。
  4. 根据权利要求2所述的方法,其特征在于,所述家电包括空调,所述对话记录中包括用户对温度或天气的评价信息;所述结合上下文记录和可变参数对家电进行控制的步骤具体包括:
    结合在预设时间段内用户对温度或天气的评价和可变参数对空调进行控制。
  5. 根据权利要求4所述的方法,其特征在于,所述可变参数包括室外实时温度的变化,所述结合上下文记录和可变参数对家电进行控制的步骤包括:结合上下文记录和室外实时温度的变化对空调进行控制。
  6. 根据权利要求1所述的方法,其特征在于,所述机器人可变参数的生成方法包括:将机器人的自我认知的参数与可变参数中场景的参数进行拟合,生成机器人可变参数。
  7. 根据权利要求6所述的方法,其特征在于,所述可变参数至少包括改变用户原本的行为和改变之后的行为,以及代表改变用户原本的行为和改变之后的行为的参数值。
  8. 根据权利要求1所述的方法,其特征在于,所述根据所述多模态信息和可变参数生成交互内容的步骤具体包括:根据所述多模态信息和可变参数以及参数改变概率的拟合曲线生成交互内容。
  9. 根据权利要求8所述的方法,其特征在于,所述参数改变概率的拟合曲线的生成方法包括:使用概率算法,将机器人之间的参数用网络做概率估计,计算当生活时间轴上的机器人在生活时间轴上的场景参数改变后, 每个参数改变的概率,形成所述参数改变概率的拟合曲线。
  10. 一种基于意图识别控制家电的系统,其特征在于,包括:
    获取模块,用于获取用户的多模态信息;
    意图识别模块,用于根据所述多模态信息识别用户意图;
    人工智能模块,用于根据用户的多模态信息和用户意图,结合上下文记录和可变参数对家电进行控制。
  11. 根据权利要求10所述的系统,其特征在于,所述上下文记录包括在预设时间段内机器人与用户的对话记录;所述人工智能模块具体用于:结合预设时间段内机器人与用户的对话记录和可变参数对家电进行控制。
  12. 根据权利要求10所述的系统,其特征在于,所述可变参数至少包括温度、天气、亮度、洁净度、湿度中的一种或几种。
  13. 根据权利要求11所述的系统,其特征在于,所述家电包括空调,所述对话记录中包括用户对温度或天气的评价信息;所述人工智能模块具体用于:
    结合在预设时间段内用户对温度或天气的评价和可变参数对空调进行控制。
  14. 根据权利要求13所述的系统,其特征在于,所述可变参数包括室外实时温度的变化,所述人工智能模块具体用于:结合上下文记录和室外实时温度的变化对空调进行控制。
  15. 根据权利要求10所述的系统,其特征在于,所述系统还包括处理模块,用于将机器人的自我认知的参数与可变参数中场景的参数进行拟合,生成可变参数。
  16. 根据权利要求15所述的系统,其特征在于,所述可变参数至少包括改变用户原本的行为和改变之后的行为,以及代表改变用户原本的行为和改变之后的行为的参数值。
  17. 根据权利要求10所述的系统,其特征在于,所述人工智能模块具体用于:根据所述多模态信息和可变参数以及参数改变概率的拟合曲线生成交互内容。
  18. 根据权利要求17所述的系统,其特征在于,所述系统包括拟合曲线生成模块,用于使用概率算法,将机器人之间的参数用网络做概率估计,计算当生活时间轴上的机器人在生活时间轴上的场景参数改变后,每个参数改变的概率,形成所述参数改变概率的拟合曲线。
  19. 一种机器人,其特征在于,包括如权利要求10至18任一所述的一种基于意图识别控制家电的系统。
PCT/CN2016/089217 2016-07-07 2016-07-07 一种基于意图识别控制家电的方法、系统及机器人 WO2018006373A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201680001723.0A CN106462124A (zh) 2016-07-07 2016-07-07 一种基于意图识别控制家电的方法、系统及机器人
PCT/CN2016/089217 WO2018006373A1 (zh) 2016-07-07 2016-07-07 一种基于意图识别控制家电的方法、系统及机器人

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/089217 WO2018006373A1 (zh) 2016-07-07 2016-07-07 一种基于意图识别控制家电的方法、系统及机器人

Publications (1)

Publication Number Publication Date
WO2018006373A1 true WO2018006373A1 (zh) 2018-01-11

Family

ID=58215740

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/089217 WO2018006373A1 (zh) 2016-07-07 2016-07-07 一种基于意图识别控制家电的方法、系统及机器人

Country Status (2)

Country Link
CN (1) CN106462124A (zh)
WO (1) WO2018006373A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114280947A (zh) * 2021-11-30 2022-04-05 重庆电子工程职业学院 应用于智能家居的安全防护系统

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107121937A (zh) * 2017-06-30 2017-09-01 成都智建新业建筑设计咨询有限公司 一种智能家居多模态交互装置
CN107562816B (zh) * 2017-08-16 2021-02-09 苏州狗尾草智能科技有限公司 用户意图自动识别方法及装置
CN108563321A (zh) * 2018-01-02 2018-09-21 联想(北京)有限公司 信息处理方法和电子设备
CN110059819B (zh) * 2018-01-17 2022-11-25 腾讯科技(深圳)有限公司 器件的工作控制方法、装置、系统、控制设备及存储介质
CN108415262A (zh) * 2018-03-06 2018-08-17 西北工业大学 智能网关对家电设备的控制方法
CN108710308A (zh) * 2018-05-29 2018-10-26 广东汇泰龙科技有限公司 一种基于智能云锁的特定姿势触发场景联动的方法及系统
CN109063100A (zh) * 2018-07-27 2018-12-21 联想(北京)有限公司 一种数据处理方法、服务器及电子设备
CN110174888B (zh) * 2018-08-09 2022-08-12 深圳瑞科时尚电子有限公司 自移动机器人控制方法、装置、设备及存储介质
CN109597313A (zh) * 2018-11-30 2019-04-09 新华三技术有限公司 场景切换方法及装置
CN111756603B (zh) * 2019-03-26 2023-05-26 北京京东尚科信息技术有限公司 智能家居系统的控制方法、装置、电子设备和可读介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102103707A (zh) * 2009-12-16 2011-06-22 群联电子股份有限公司 情感引擎、情感引擎系统及电子装置的控制方法
JP2011169663A (ja) * 2010-02-17 2011-09-01 Alpine Electronics Inc 電気自動車の電池残量警報装置
CN104238369A (zh) * 2014-09-02 2014-12-24 百度在线网络技术(北京)有限公司 智能家电控制方法和装置
CN105425602A (zh) * 2015-11-30 2016-03-23 青岛海尔智能家电科技有限公司 一种家电设备自动控制方法及装置
CN105446156A (zh) * 2015-12-30 2016-03-30 百度在线网络技术(北京)有限公司 基于人工智能的家用电器的控制方法、装置和系统
CN105704013A (zh) * 2016-03-18 2016-06-22 北京光年无限科技有限公司 基于上下文的话题更新数据处理方法及装置
CN105740948A (zh) * 2016-02-04 2016-07-06 北京光年无限科技有限公司 一种面向智能机器人的交互方法及装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001277166A (ja) * 2000-03-31 2001-10-09 Sony Corp ロボット及びロボットの行動決定方法
CN100488149C (zh) * 2007-11-23 2009-05-13 北京工业大学 智能家居保姆系统和多网络单点接入集成方法
CN201892856U (zh) * 2010-07-12 2011-07-06 昆山语意自动化科技有限公司 语意电器控制系统
US9479890B2 (en) * 2012-07-31 2016-10-25 Michael Lu Open wireless architecture (OWA) mobile cloud infrastructure and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102103707A (zh) * 2009-12-16 2011-06-22 群联电子股份有限公司 情感引擎、情感引擎系统及电子装置的控制方法
JP2011169663A (ja) * 2010-02-17 2011-09-01 Alpine Electronics Inc 電気自動車の電池残量警報装置
CN104238369A (zh) * 2014-09-02 2014-12-24 百度在线网络技术(北京)有限公司 智能家电控制方法和装置
CN105425602A (zh) * 2015-11-30 2016-03-23 青岛海尔智能家电科技有限公司 一种家电设备自动控制方法及装置
CN105446156A (zh) * 2015-12-30 2016-03-30 百度在线网络技术(北京)有限公司 基于人工智能的家用电器的控制方法、装置和系统
CN105740948A (zh) * 2016-02-04 2016-07-06 北京光年无限科技有限公司 一种面向智能机器人的交互方法及装置
CN105704013A (zh) * 2016-03-18 2016-06-22 北京光年无限科技有限公司 基于上下文的话题更新数据处理方法及装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114280947A (zh) * 2021-11-30 2022-04-05 重庆电子工程职业学院 应用于智能家居的安全防护系统

Also Published As

Publication number Publication date
CN106462124A (zh) 2017-02-22

Similar Documents

Publication Publication Date Title
WO2018006373A1 (zh) 一种基于意图识别控制家电的方法、系统及机器人
WO2018006372A1 (zh) 一种基于意图识别控制家电的方法、系统及机器人
US20190349214A1 (en) Smart home automation systems and methods
DE102017129939B4 (de) Gesprächsbewusste proaktive Benachrichtigungen für eine Sprachschnittstellenvorrichtung
US10931758B2 (en) Utilizing context information of environment component regions for event/activity prediction
CN112051743A (zh) 设备控制方法、冲突处理方法、相应的装置及电子设备
US9489772B2 (en) Environment actuation by one or more augmented reality elements
WO2018006370A1 (zh) 一种虚拟3d机器人的交互方法、系统及机器人
WO2016155676A1 (zh) 一种智能家居系统及其产品
JP6355939B2 (ja) 音声サーバおよびその制御方法、並びに音声システム
CN105446156B (zh) 基于人工智能的家用电器的控制方法、装置和系统
US10687109B2 (en) Video integration with home assistant
WO2016180090A1 (zh) 一种信息推送方法及装置
JP2005529548A (ja) 局所環境の環境性を局所環境内の場所及び人の好みに適応させるシステム及び方法
Ramadan et al. The intelligent classroom: towards an educational ambient intelligence testbed
WO2018006374A1 (zh) 一种基于主动唤醒的功能推荐方法、系统及机器人
US10359993B2 (en) Contextual user interface based on environment
CN107229262A (zh) 一种智能家居系统
CN109164713B (zh) 一种智能家居控制方法及装置
CN109357366B (zh) 调节控制方法、装置、存储介质和空调系统
CN106057201A (zh) 一种家电智能语音交互控制方法及装置
CN107367952B (zh) 智能家居的控制方法及装置、存储介质、终端
CN109595757A (zh) 空调器的控制方法、装置及具有其的空调器
WO2018000258A1 (zh) 一种机器人交互内容的生成方法、系统及机器人
WO2020078076A1 (zh) 控制空调的方法及系统、空调器、家用电器

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16907878

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16907878

Country of ref document: EP

Kind code of ref document: A1