WO2017000785A1 - System and method for training robot - Google Patents

System and method for training robot Download PDF

Info

Publication number
WO2017000785A1
WO2017000785A1 PCT/CN2016/085910 CN2016085910W WO2017000785A1 WO 2017000785 A1 WO2017000785 A1 WO 2017000785A1 CN 2016085910 W CN2016085910 W CN 2016085910W WO 2017000785 A1 WO2017000785 A1 WO 2017000785A1
Authority
WO
WIPO (PCT)
Prior art keywords
instruction
unit
condition data
robot
operation instruction
Prior art date
Application number
PCT/CN2016/085910
Other languages
French (fr)
Chinese (zh)
Inventor
蔡明峻
Original Assignee
芋头科技(杭州)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 芋头科技(杭州)有限公司 filed Critical 芋头科技(杭州)有限公司
Publication of WO2017000785A1 publication Critical patent/WO2017000785A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems

Definitions

  • the present invention relates to the field of robots, and more particularly to a system and method for training a robot through an image interface.
  • the training method for robots is limited to modifying the program of the robot by writing code.
  • the training method is difficult to write, and requires the user to have professional programming development skills and excellent code.
  • Management literacy have a deep understanding of the bottom of the system, can find problems. Due to the complexity of the process of writing code, it is prone to training logic errors, so the current training methods of robots can not meet the needs of users who do not understand programming languages.
  • a system for training robots including:
  • An obtaining unit configured to acquire an operation instruction sent by the user, each of the operation instructions corresponding to a corresponding operation, where the operation instruction includes an acquisition instruction and/or an editing instruction;
  • a storage unit for storing the operation instruction
  • An operation unit configured to execute the operation corresponding to the editing instruction
  • a processing unit which is respectively connected to the collection unit, the acquisition unit, the storage unit and the operation unit, for storing the operation instruction in the storage unit, and controlling the operation unit and/or The collecting unit performs the operation corresponding to the operation instruction;
  • a display unit is connected to the processing unit, and the display unit includes a preset template, the preset template includes an area for displaying the condition data and an area for displaying an execution image of the operation.
  • condition data comprises: a light value, and/or a humidity value, and/or a temperature value, and/or pyroelectric data, and/or a PM2.5 value, and/or a carbon dioxide content, and/or time. , and / or user attributes.
  • the user attributes include a manager and/or a visitor.
  • the obtaining unit comprises:
  • the voice recognition module is configured to receive a voice operation instruction sent by the user, and convert the voice operation instruction into a text operation instruction.
  • the processing unit comprises:
  • a receiving module configured to receive the condition data and the operation instruction
  • An identification module is connected to the receiving module, configured to identify whether the operation instruction is the collection instruction, and output a recognition result
  • If the operation instruction is the collection instruction, controlling an operation state of the collection unit according to the collection instruction;
  • An extraction module connected to the identification module, when the operation instruction is not the acquisition instruction, the operation instruction is the editing instruction, and the extraction module is configured to extract the operation key in the editing instruction Word and reference condition data, each set of the operation keywords corresponds to one of the operations, and outputs the operation.
  • the processing unit further includes:
  • a matching module which is respectively connected to the receiving module and the extraction module, for using the condition Matching the data with the reference condition data to obtain a matching result
  • the operation unit When the results match, the operation unit performs the operation corresponding to the editing instruction.
  • a method of training a robot for controlling the operation of the robot includes the following steps:
  • the step S4 includes:
  • the operation instruction is the collection instruction, stop acquiring the condition data or start collecting the condition data according to the collection instruction;
  • the operation instruction is not the acquisition instruction
  • the operation instruction is the editing instruction
  • the operation keyword and the reference condition data in the editing instruction are extracted, and each group of the operation keyword corresponds to one The operation and outputting the operation.
  • the step S4 further includes:
  • the operation instruction sent by the user is acquired by the acquisition unit, the operation instruction is stored in the storage unit by the processing unit, and the control operation unit and/or the acquisition unit is executed to execute the operation instruction.
  • Operation, display condition data through the display unit And the execution image of the operation the user can train the robot in an intuitive manner, and the training process is simple, and the user who does not have the basis of programming development can be supported to participate in the behavior training of the robot.
  • the robot can be controlled to perform an operation corresponding to the operation instruction, and display the condition data and the execution image of the operation in a preset template, the operation process is simple, and the user can intuitively understand the training process.
  • FIG. 1 is a block diagram of an embodiment of a system for training a robot according to the present invention
  • FIG. 2 is a flow chart of a method of an embodiment of a method for training a robot according to the present invention
  • FIG. 3 is a schematic diagram of an embodiment of the display unit in a normal state according to the present invention.
  • FIG. 4 is a schematic diagram of an embodiment of the display unit in an edit state according to the present invention.
  • a system for training a robot includes:
  • An acquisition unit 3 configured to collect condition data
  • An obtaining unit 2 is configured to acquire an operation instruction sent by the user, where each operation instruction corresponds to a corresponding operation, and the operation instruction includes an acquisition instruction and/or an editing instruction;
  • a storage unit 5 for storing an operation instruction
  • An operation unit 1 configured to perform an operation corresponding to the editing instruction
  • a processing unit 4 is connected to the acquisition unit 3, the acquisition unit 2, the storage unit 5 and the operation unit 1, respectively, for storing the operation instruction in the storage unit 5, and controlling the operation unit 1 and/or the acquisition unit 3 to execute the operation instruction Corresponding operation;
  • a display unit 6 is connected to the processing unit 4.
  • the display unit 6 includes a preset template including an area for displaying condition data and an area for displaying an execution image of the operation.
  • the acquiring instruction includes stopping the collecting instruction and starting the collecting instruction; the collecting instruction is for controlling the working state of the collecting unit 3.
  • the robot in the system of the embodiment, it is embedded in the robot system in actual application, and the robot can be trained when the robot system is in the integrated development environment.
  • the acquisition unit 3 collects the condition data at a predetermined time interval, and the display unit 6 displays the collected condition data in real time in the display area of the condition data, and the user can input the stop acquisition instruction, specifically: a method of starting the edit mode by triggering (such as clicking “coagulation”
  • the "button” causes the robot to enter a solid state. In this state, all the acquisition condition data of the robot is not updated, and is solidified at the triggering moment, and the user performs editing in the operation execution image of the display area of the display unit 6 in the solidified state, and the operation is performed.
  • the image can be associated with the corresponding operation action corresponding to the editing instruction.
  • the user can input the start acquisition instruction.
  • the editing action can be uploaded to the robot by triggering the end of the editing mode (clicking the "release” button). (Operation unit 1) is up and running, and the data in the robot continues to be updated in real time.
  • the operation instruction sent by the user is acquired by the acquisition unit 2, the operation instruction is stored in the storage unit 5 by the processing unit 4, and the operation unit 1 and/or the acquisition unit 3 are controlled to perform an operation corresponding to the operation instruction.
  • the display unit 6 displays the condition data and the execution image of the operation, so that the user can train the robot in an intuitive manner, and the training process is simple, and can support no programming development.
  • the basic users participate in the behavioral training of the robot.
  • condition data includes: light values, and/or humidity values, and/or temperature values, and/or pyroelectric data, and/or PM2.5 values. , and / or carbon dioxide (CO 2 ) content, and / or time, and / or user attributes.
  • CO 2 carbon dioxide
  • the collecting unit 3 may include: a light sensor for collecting light values; a humidity sensor for collecting humidity values; a pyroelectric infrared sensor for collecting whether there is a user near the robot; and a PM2.5 collecting module for Collecting PM2.5 values; carbon dioxide sensors for collecting CO 2 content; and an authentication module for identifying user attributes.
  • the user attributes include a manager and/or a visitor.
  • the identity verification module can be used to identify that the user is a manager or a visitor. If the administrator can directly train the robot, if the visitor can acquire the relationship with the administrator, the corresponding behavior is performed on the robot according to the corresponding authority. operating.
  • the obtaining unit 2 may include:
  • the voice recognition module 42 is configured to receive a voice operation instruction sent by the user, and convert the voice operation instruction into a text operation instruction.
  • a natural language processing module of artificial intelligence may be further included for converting the text operation instruction into digital data for the robot to recognize.
  • the processing unit 4 can include:
  • a receiving module 41 configured to receive condition data and an operation instruction
  • An identification module 42 is connected to the receiving module 41 for identifying whether the operation instruction is an acquisition instruction, and outputting the recognition result;
  • If the operation instruction is an acquisition instruction, controlling the working state of the collection unit 3 according to the acquisition instruction;
  • An extraction module 44 is connected to the identification module 42.
  • the operation instruction is an acquisition instruction
  • the operation instruction is an editing instruction
  • the extraction module 44 is configured to extract an operation keyword and reference condition data in the editing instruction, and each group of operation keywords corresponds to An operation and output operation.
  • the operation may be to turn on the phone function to make a call to a pre-stored contact in the robot, or to activate the prompt tone function, or to control the LED light on the robot to be turned on/off, or to enable the video player function, or to turn on the music.
  • the player function or open the search engine function to search for keywords that the user needs to search, or turn on the TTS (Text To Speech) voice module function to convert the text into a voice function.
  • TTS Text To Speech
  • the processing unit 4 further includes:
  • a matching module 43 is respectively connected to the receiving module 41 and the extracting module 44 for matching the condition data with the reference condition data to obtain a matching result;
  • the operation unit 1 When the results match, the operation unit 1 performs an operation corresponding to the editing instruction.
  • the operation keyword may be pre-stored in the storage unit 5, and when the matching result is matched and the operation keyword in the received editing instruction is the same as the pre-stored operation keyword, the control robot performs the corresponding operation.
  • a method for training a robot for controlling the operation of the robot includes the following steps:
  • the control robot performs an operation corresponding to the operation instruction, and displays the condition data and the execution image of the operation in a preset template.
  • the acquiring instruction includes stopping the acquiring instruction and starting the collecting instruction; and the collecting instruction is used to control whether the robot performs condition data collecting.
  • the robot can be controlled to perform an operation corresponding to the operation instruction, and display the condition data and the execution image of the operation in a preset template, the operation process is simple, and the user can intuitively understand the training process.
  • step S4 may include:
  • the operation instruction is an acquisition instruction, stop acquiring the condition data or start collecting the condition data according to the acquisition instruction;
  • the operation instruction is not an acquisition instruction
  • the operation instruction is an edit instruction
  • the operation keyword and the reference condition data in the edit instruction are extracted, and each group of operation keywords corresponds to an operation, and the operation is output.
  • the operation may be to turn on the phone function to make a call to a pre-stored contact in the robot, or to activate the prompt tone function, or to control the LED light on the robot to be turned on/off, or to enable the video player function, or to turn on the music.
  • the player function or open the search engine function to search for keywords that the user needs to search, or turn on the TTS (Text To Speech) voice module function to convert the text into a voice function.
  • TTS Text To Speech
  • step S4 further includes:
  • control robot When the matching results match, the control robot performs an operation corresponding to the editing instruction
  • the robot system is in an integrated development environment, and the real-time condition state of the robot is displayed on the condition data of the preset template. Area; if the temperature is 20 °C at this time, click the “Coagulation” button (stop the acquisition command) to stop the real-time condition status, and display 20°C in the “Temperature” column (the condition data display area of the preset template).
  • the temperature range can be manually set to 10 ° C to 16 ° C; activate the TTS voice module in the operation operation display area of the preset template, enter the text "temperature below 16 degrees Celsius, please turn on the air conditioner" (editing instructions); click "release "Button (start acquisition command), the automatically generated code is uploaded to the robot and updated to run.
  • the temperature collected by the robot is lower than 16 °C, it will automatically remind the user to turn on the air conditioner.

Abstract

A system for training a robot, comprising: a collecting unit (3) used for collecting conditional data; a fetching unit (2) used for fetching an operation instruction transmitted by a user; a storage unit (5) used for storing the operation instruction; an operating unit (1) used for executing an operation corresponding to an edit instruction; a processing unit (4) connected respectively to the collecting unit (3), the fetching unit (2), the storage unit (5), and the operating unit (1) and used for storing the operation instruction in the storage unit (5) and controlling the operating unit (1) and/or the collecting unit (3) to execute an operation corresponding to the operation instruction; and a display unit (6) connected to the processing unit (4) and comprising a preset template. This system is structurally simple and facilitates user observation. Also provided is a method for training the robot.

Description

一种对机器人进行训练的系统及方法System and method for training robot 技术领域Technical field
本发明涉及机器人领域,尤其涉及一种通过图像界面对机器人进行训练的系统及方法。The present invention relates to the field of robots, and more particularly to a system and method for training a robot through an image interface.
背景技术Background technique
目前针对机器人的训练方式仅限于通过编写代码的形式对机器人的程序进行修改,对于不懂编程语言的用户而言,该训练方式编写难度大,要求用户要有专业的编程开发技能以及优秀的代码管理素养,对系统底层有深入的了解,能查找问题。由于编写代码过程复杂,容易出现训练逻辑错误,因此目前的机器人的训练方法无法满足不懂编程语言的用户的需求。At present, the training method for robots is limited to modifying the program of the robot by writing code. For users who do not understand the programming language, the training method is difficult to write, and requires the user to have professional programming development skills and excellent code. Management literacy, have a deep understanding of the bottom of the system, can find problems. Due to the complexity of the process of writing code, it is prone to training logic errors, so the current training methods of robots can not meet the needs of users who do not understand programming languages.
发明内容Summary of the invention
针对现有的机器人的训练方法存在的上述问题,现提供一种旨在实现可支持没有编程开发基础的用户参与机器人行为训练的系统及方法。In view of the above problems existing in the training methods of existing robots, there is now provided a system and method for implementing user behavior training that can support the user without a programming development foundation.
具体技术方案如下:The specific technical solutions are as follows:
一种对机器人进行训练的系统,包括:A system for training robots, including:
一采集单元,用于采集条件数据;An acquisition unit for collecting condition data;
一获取单元,用于获取用户发送的操作指令,每条所述操作指令对应一相应的操作,所述操作指令包括采集指令和/或编辑指令; An obtaining unit, configured to acquire an operation instruction sent by the user, each of the operation instructions corresponding to a corresponding operation, where the operation instruction includes an acquisition instruction and/or an editing instruction;
一存储单元,用于存储所述操作指令;a storage unit for storing the operation instruction;
一操作单元,用于执行与所述编辑指令对应的所述操作;An operation unit, configured to execute the operation corresponding to the editing instruction;
一处理单元,分别连接所述采集单元、所述获取单元、所述存储单元和所述操作单元,用于将所述操作指令存储于所述存储单元中,并控制所述操作单元和/或所述采集单元执行与所述操作指令对应的所述操作;a processing unit, which is respectively connected to the collection unit, the acquisition unit, the storage unit and the operation unit, for storing the operation instruction in the storage unit, and controlling the operation unit and/or The collecting unit performs the operation corresponding to the operation instruction;
一显示单元,连接所述处理单元,所述显示单元包括一预设模板,所述预设模板包括显示所述条件数据的区域和显示所述操作的执行图像的区域。A display unit is connected to the processing unit, and the display unit includes a preset template, the preset template includes an area for displaying the condition data and an area for displaying an execution image of the operation.
优选的,所述条件数据包括:光线值,和/或湿度值,和/或温度值,和/或热释电数据,和/或PM2.5值,和/或二氧化碳含量,和/或时间,和/或用户属性。Preferably, the condition data comprises: a light value, and/or a humidity value, and/or a temperature value, and/or pyroelectric data, and/or a PM2.5 value, and/or a carbon dioxide content, and/or time. , and / or user attributes.
优选的,所述用户属性包括管理者和/或访问者。Preferably, the user attributes include a manager and/or a visitor.
优选的,所述获取单元包括:Preferably, the obtaining unit comprises:
语音识别模块,用于接收用户发出的语音操作指令,并将所述语音操作指令转换为文字操作指令。The voice recognition module is configured to receive a voice operation instruction sent by the user, and convert the voice operation instruction into a text operation instruction.
优选的,所述处理单元包括:Preferably, the processing unit comprises:
一接收模块,用以接收所述条件数据和所述操作指令;a receiving module, configured to receive the condition data and the operation instruction;
一识别模块,连接所述接收模块,用以识别所述操作指令是否为所述采集指令,并输出识别结果;An identification module is connected to the receiving module, configured to identify whether the operation instruction is the collection instruction, and output a recognition result;
若所述操作指令是所述采集指令,则根据所述采集指令控制所述采集单元的工作状态;If the operation instruction is the collection instruction, controlling an operation state of the collection unit according to the collection instruction;
一提取模块,连接所述识别模块,当所述操作指令不是所述采集指令时,则所述操作指令为所述编辑指令,所述提取模块用于提取所述编辑指令中的所述操作关键词和参考条件数据,每一组所述操作关键词对应一所述操作,并输出所述操作。An extraction module, connected to the identification module, when the operation instruction is not the acquisition instruction, the operation instruction is the editing instruction, and the extraction module is configured to extract the operation key in the editing instruction Word and reference condition data, each set of the operation keywords corresponds to one of the operations, and outputs the operation.
优选的,所述处理单元还包括:Preferably, the processing unit further includes:
一匹配模块,分别连接所述接收模块和所述提取模块,用于将所述条件 数据与所述参考条件数据进行匹配,以获取匹配结果;a matching module, which is respectively connected to the receiving module and the extraction module, for using the condition Matching the data with the reference condition data to obtain a matching result;
当结果匹配时,所述操作单元执行与所述编辑指令对应的所述操作。When the results match, the operation unit performs the operation corresponding to the editing instruction.
一种对机器人进行训练的方法,用于控制机器人的操作,包括下述步骤:A method of training a robot for controlling the operation of the robot includes the following steps:
S1.采集条件数据;S1. Collecting condition data;
S2.获取用户发送的操作指令,每条所述操作指令对应一相应的操作,所述操作指令包括采集指令和/或编辑指令;S2. Obtain an operation instruction sent by the user, where each operation instruction corresponds to a corresponding operation, where the operation instruction includes an acquisition instruction and/or an edit instruction;
S3.存储所述操作指令;S3. storing the operation instruction;
S4.控制所述机器人执行与所述操作指令对应的所述操作,并在一预设模板中显示所述条件数据和所述操作的执行图像。S4. Control the robot to perform the operation corresponding to the operation instruction, and display the condition data and the execution image of the operation in a preset template.
优选的,所述步骤S4包括:Preferably, the step S4 includes:
S41.接收所述条件数据和所述操作指令;S41. Receiving the condition data and the operation instruction;
S42.识别所述操作指令是否为所述采集指令,并输出识别结果;S42. Identify whether the operation instruction is the collection instruction, and output a recognition result;
若所述操作指令是所述采集指令时,则根据所述采集指令执行停止采集所述条件数据或开始采集所述条件数据;If the operation instruction is the collection instruction, stop acquiring the condition data or start collecting the condition data according to the collection instruction;
若所述操作指令不是所述采集指令时,则所述操作指令为所述编辑指令,提取所述编辑指令中的所述操作关键词和参考条件数据,每一组所述操作关键词对应一所述操作,并输出所述操作。If the operation instruction is not the acquisition instruction, the operation instruction is the editing instruction, and the operation keyword and the reference condition data in the editing instruction are extracted, and each group of the operation keyword corresponds to one The operation and outputting the operation.
优选的,所述步骤S4还包括:Preferably, the step S4 further includes:
S43.将所述条件数据与所述参考条件数据进行匹配,以获取匹配结果;S43. Match the condition data with the reference condition data to obtain a matching result;
当匹配结果匹配时,则控制所述机器人执行与所述编辑指令对应的所述操作;When the matching results match, controlling the robot to perform the operation corresponding to the editing instruction;
当匹配结果不匹配时,则返回执行步骤S1。When the matching results do not match, the process returns to step S1.
上述技术方案的有益效果:The beneficial effects of the above technical solutions:
在本技术方案中,在对机器人进行训练的系统中通过获取单元获取用户发送的操作指令,通过处理单元将操作指令存储于存储单元中,并控制操作单元和/或采集单元执行与操作指令对应的操作,通过显示单元显示条件数据 和操作的执行图像,可使用户以直观的方式训练机器人,且训练过程简单,可支持没有编程开发基础的用户参与机器人的行为训练。在对机器人进行训练的方法中,可控制机器人执行与操作指令对应的操作,并在一预设模板中显示条件数据和操作的执行图像,操作过程简单,且方便用户直观的了解训练过程。In the technical solution, in the system for training the robot, the operation instruction sent by the user is acquired by the acquisition unit, the operation instruction is stored in the storage unit by the processing unit, and the control operation unit and/or the acquisition unit is executed to execute the operation instruction. Operation, display condition data through the display unit And the execution image of the operation, the user can train the robot in an intuitive manner, and the training process is simple, and the user who does not have the basis of programming development can be supported to participate in the behavior training of the robot. In the method of training the robot, the robot can be controlled to perform an operation corresponding to the operation instruction, and display the condition data and the execution image of the operation in a preset template, the operation process is simple, and the user can intuitively understand the training process.
附图说明DRAWINGS
图1为本发明所述对机器人进行训练的系统的一种实施例的模块图;1 is a block diagram of an embodiment of a system for training a robot according to the present invention;
图2为本发明所述对机器人进行训练的方法的一种实施例的方法流程图;2 is a flow chart of a method of an embodiment of a method for training a robot according to the present invention;
图3为本发明所述显示单元处于正常状态的一种实施例的示意图;3 is a schematic diagram of an embodiment of the display unit in a normal state according to the present invention;
图4为本发明所述显示单元处于编辑状态的一种实施例的示意图。4 is a schematic diagram of an embodiment of the display unit in an edit state according to the present invention.
具体实施方式detailed description
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动的前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
需要说明的是,在不冲突的情况下,本发明中的实施例及实施例中的特征可以相互组合。It should be noted that the embodiments in the present invention and the features in the embodiments may be combined with each other without conflict.
下面结合附图和具体实施例对本发明作进一步说明,但不作为本发明的限定。The invention is further illustrated by the following figures and specific examples, but is not to be construed as limiting.
如图1所示,一种对机器人进行训练的系统,包括:As shown in Figure 1, a system for training a robot includes:
一采集单元3,用于采集条件数据; An acquisition unit 3, configured to collect condition data;
一获取单元2,用于获取用户发送的操作指令,每条操作指令对应一相应的操作,操作指令包括采集指令和/或编辑指令;An obtaining unit 2 is configured to acquire an operation instruction sent by the user, where each operation instruction corresponds to a corresponding operation, and the operation instruction includes an acquisition instruction and/or an editing instruction;
一存储单元5,用于存储操作指令;a storage unit 5 for storing an operation instruction;
一操作单元1,用于执行与编辑指令对应的操作;An operation unit 1 configured to perform an operation corresponding to the editing instruction;
一处理单元4,分别连接采集单元3、获取单元2、存储单元5和操作单元1,用于将操作指令存储于存储单元5中,并控制操作单元1和/或采集单元3执行与操作指令对应的操作;A processing unit 4 is connected to the acquisition unit 3, the acquisition unit 2, the storage unit 5 and the operation unit 1, respectively, for storing the operation instruction in the storage unit 5, and controlling the operation unit 1 and/or the acquisition unit 3 to execute the operation instruction Corresponding operation;
一显示单元6,连接处理单元4,显示单元6包括一预设模板,预设模板包括显示条件数据的区域和显示操作的执行图像的区域。A display unit 6 is connected to the processing unit 4. The display unit 6 includes a preset template including an area for displaying condition data and an area for displaying an execution image of the operation.
进一步地,采集指令包括停止采集指令和开始采集指令;采集指令用于控制采集单元3的工作状态。Further, the acquiring instruction includes stopping the collecting instruction and starting the collecting instruction; the collecting instruction is for controlling the working state of the collecting unit 3.
如图3和图4所示,在本实施例的系统中在实际应用时需嵌入于机器人系统中,当机器人系统处于集成开发环境中时可对机器人进行训练。采集单元3以预定时间间隔采集条件数据,显示单元6在条件数据的显示区域实时显示采集到的条件数据,用户可输入停止采集指令具体地:可通过触发开始编辑模式的方式(如点击“凝固”按钮)使机器人进入凝固状态,在这个状态下,机器人的所有采集条件数据不再更新,凝固于触发时刻,用户在凝固状态下在显示单元6显示区域的操作执行图像中进行编辑,操作执行图像可关联编辑指令对应的相应的操作动作,当用户编辑完成后,用户可输入开始采集指令具体地:可通过触发结束编辑模式的方式(点击“释放”按钮)即可把编辑动作上传到机器人(操作单元1)上并运行,同时机器人中的数据重新继续保持实时更新。As shown in FIG. 3 and FIG. 4, in the system of the embodiment, it is embedded in the robot system in actual application, and the robot can be trained when the robot system is in the integrated development environment. The acquisition unit 3 collects the condition data at a predetermined time interval, and the display unit 6 displays the collected condition data in real time in the display area of the condition data, and the user can input the stop acquisition instruction, specifically: a method of starting the edit mode by triggering (such as clicking “coagulation” The "button" causes the robot to enter a solid state. In this state, all the acquisition condition data of the robot is not updated, and is solidified at the triggering moment, and the user performs editing in the operation execution image of the display area of the display unit 6 in the solidified state, and the operation is performed. The image can be associated with the corresponding operation action corresponding to the editing instruction. After the user completes the editing, the user can input the start acquisition instruction. Specifically, the editing action can be uploaded to the robot by triggering the end of the editing mode (clicking the "release" button). (Operation unit 1) is up and running, and the data in the robot continues to be updated in real time.
在本实施例中,通过获取单元2获取用户发送的操作指令,通过处理单元4将操作指令存储于存储单元5中,并控制操作单元1和/或采集单元3执行与操作指令对应的操作,通过显示单元6显示条件数据和操作的执行图像,可使用户以直观的方式训练机器人,且训练过程简单,可支持没有编程开发 基础的用户参与机器人的行为训练。In this embodiment, the operation instruction sent by the user is acquired by the acquisition unit 2, the operation instruction is stored in the storage unit 5 by the processing unit 4, and the operation unit 1 and/or the acquisition unit 3 are controlled to perform an operation corresponding to the operation instruction. The display unit 6 displays the condition data and the execution image of the operation, so that the user can train the robot in an intuitive manner, and the training process is simple, and can support no programming development. The basic users participate in the behavioral training of the robot.
如图3和图4所示,在优选的实施例中,条件数据包括:光线值,和/或湿度值,和/或温度值,和/或热释电数据,和/或PM2.5值,和/或二氧化碳(CO2)含量,和/或时间,和/或用户属性。As shown in Figures 3 and 4, in a preferred embodiment, the condition data includes: light values, and/or humidity values, and/or temperature values, and/or pyroelectric data, and/or PM2.5 values. , and / or carbon dioxide (CO 2 ) content, and / or time, and / or user attributes.
进一步地,采集单元3可包括:光线传感器,用于采集光线值;湿度传感器,用于采集湿度值;热释电红外传感器,用于采集是机器人附近是否存在用户;PM2.5采集模块,用于采集PM2.5值;二氧化碳传感器,用于采集CO2含量;身份验证模块,用于识别用户的属性。Further, the collecting unit 3 may include: a light sensor for collecting light values; a humidity sensor for collecting humidity values; a pyroelectric infrared sensor for collecting whether there is a user near the robot; and a PM2.5 collecting module for Collecting PM2.5 values; carbon dioxide sensors for collecting CO 2 content; and an authentication module for identifying user attributes.
在优选的实施例中,用户属性包括管理者和/或访问者。In a preferred embodiment, the user attributes include a manager and/or a visitor.
在本实施例中,可通过身份验证模块识别用户是管理者或访问者,若是管理者可直接对机器人进行训练,若是访问者可获取与管理者的关系,根据相应的权限对机器人进行相应的操作。In this embodiment, the identity verification module can be used to identify that the user is a manager or a visitor. If the administrator can directly train the robot, if the visitor can acquire the relationship with the administrator, the corresponding behavior is performed on the robot according to the corresponding authority. operating.
在优选的实施例中,获取单元2可包括:In a preferred embodiment, the obtaining unit 2 may include:
语音识别模块42,用于接收用户发出的语音操作指令,并将语音操作指令转换为文字操作指令。The voice recognition module 42 is configured to receive a voice operation instruction sent by the user, and convert the voice operation instruction into a text operation instruction.
在本实施例中,还可包括人工智能的自然语言处理模块,用于将文字操作指令转换为数字数据,以使机器人识别。In this embodiment, a natural language processing module of artificial intelligence may be further included for converting the text operation instruction into digital data for the robot to recognize.
在优选的实施例中,处理单元4可包括:In a preferred embodiment, the processing unit 4 can include:
一接收模块41,用以接收条件数据和操作指令;a receiving module 41, configured to receive condition data and an operation instruction;
一识别模块42,连接接收模块41,用以识别操作指令是否为采集指令,并输出识别结果;An identification module 42 is connected to the receiving module 41 for identifying whether the operation instruction is an acquisition instruction, and outputting the recognition result;
若操作指令是采集指令,则根据采集指令控制采集单元3的工作状态;If the operation instruction is an acquisition instruction, controlling the working state of the collection unit 3 according to the acquisition instruction;
一提取模块44,连接识别模块42,当操作指令不是采集指令时,则操作指令为编辑指令,提取模块44用于提取编辑指令中的操作关键词和参考条件数据,每一组操作关键词对应一操作,并输出操作。 An extraction module 44 is connected to the identification module 42. When the operation instruction is not an acquisition instruction, the operation instruction is an editing instruction, and the extraction module 44 is configured to extract an operation keyword and reference condition data in the editing instruction, and each group of operation keywords corresponds to An operation and output operation.
在本实施例中,操作可以是开启电话功能给机器人中预先存储的联系人打电话,或开启提示音功能,或控制机器人上的LED灯亮起/熄灭,或开启视频播放器功能,或开启音乐播放器功能,或开启搜索引擎功能对用户需要搜索的关键词进行搜索,或开启TTS(Text To Speech,文语转换)语音模块功能将文字转换为语音功能等。In this embodiment, the operation may be to turn on the phone function to make a call to a pre-stored contact in the robot, or to activate the prompt tone function, or to control the LED light on the robot to be turned on/off, or to enable the video player function, or to turn on the music. The player function, or open the search engine function to search for keywords that the user needs to search, or turn on the TTS (Text To Speech) voice module function to convert the text into a voice function.
在优选的实施例中,处理单元4还包括:In a preferred embodiment, the processing unit 4 further includes:
一匹配模块43,分别连接接收模块41和提取模块44,用于将条件数据与参考条件数据进行匹配,以获取匹配结果;a matching module 43 is respectively connected to the receiving module 41 and the extracting module 44 for matching the condition data with the reference condition data to obtain a matching result;
当结果匹配时,操作单元1执行与编辑指令对应的操作。When the results match, the operation unit 1 performs an operation corresponding to the editing instruction.
在本实施例中,存储单元5中还可预先存储操作关键词,当匹配结果为匹配且接收到的编辑指令中的操作关键词与预先存储操作关键词相同时,控制机器人执行相应的操作。In the embodiment, the operation keyword may be pre-stored in the storage unit 5, and when the matching result is matched and the operation keyword in the received editing instruction is the same as the pre-stored operation keyword, the control robot performs the corresponding operation.
如图2所示,一种对机器人进行训练的方法,用于控制机器人的操作,包括下述步骤:As shown in FIG. 2, a method for training a robot for controlling the operation of the robot includes the following steps:
S1.采集条件数据;S1. Collecting condition data;
S2.获取用户发送的操作指令,每条操作指令对应一相应的操作,操作指令包括采集指令和/或编辑指令;S2. Obtain an operation instruction sent by the user, where each operation instruction corresponds to a corresponding operation, and the operation instruction includes an acquisition instruction and/or an editing instruction;
S3.存储操作指令;S3. storing operation instructions;
S4.控制机器人执行与操作指令对应的操作,并在一预设模板中显示条件数据和操作的执行图像。S4. The control robot performs an operation corresponding to the operation instruction, and displays the condition data and the execution image of the operation in a preset template.
进一步地,采集指令包括停止采集指令和开始采集指令;采集指令用于控制机器人是否进行条件数据采集。Further, the acquiring instruction includes stopping the acquiring instruction and starting the collecting instruction; and the collecting instruction is used to control whether the robot performs condition data collecting.
在本实施例中,可控制机器人执行与操作指令对应的操作,并在一预设模板中显示条件数据和操作的执行图像,操作过程简单,且方便用户直观的了解训练过程。 In this embodiment, the robot can be controlled to perform an operation corresponding to the operation instruction, and display the condition data and the execution image of the operation in a preset template, the operation process is simple, and the user can intuitively understand the training process.
在优选的实施例中,步骤S4可包括:In a preferred embodiment, step S4 may include:
S41.接收条件数据和操作指令;S41. Receiving condition data and an operation instruction;
S42.识别操作指令是否为采集指令,并输出识别结果;S42. Identifying whether the operation instruction is an acquisition instruction, and outputting the recognition result;
若操作指令是采集指令时,则根据采集指令执行停止采集条件数据或开始采集条件数据;If the operation instruction is an acquisition instruction, stop acquiring the condition data or start collecting the condition data according to the acquisition instruction;
若操作指令不是采集指令时,则操作指令为编辑指令,提取编辑指令中的操作关键词和参考条件数据,每一组操作关键词对应一操作,并输出操作。If the operation instruction is not an acquisition instruction, the operation instruction is an edit instruction, and the operation keyword and the reference condition data in the edit instruction are extracted, and each group of operation keywords corresponds to an operation, and the operation is output.
在本实施例中,操作可以是开启电话功能给机器人中预先存储的联系人打电话,或开启提示音功能,或控制机器人上的LED灯亮起/熄灭,或开启视频播放器功能,或开启音乐播放器功能,或开启搜索引擎功能对用户需要搜索的关键词进行搜索,或开启TTS(Text To Speech,文语转换)语音模块功能将文字转换为语音功能等。In this embodiment, the operation may be to turn on the phone function to make a call to a pre-stored contact in the robot, or to activate the prompt tone function, or to control the LED light on the robot to be turned on/off, or to enable the video player function, or to turn on the music. The player function, or open the search engine function to search for keywords that the user needs to search, or turn on the TTS (Text To Speech) voice module function to convert the text into a voice function.
在优选的实施例中,步骤S4还包括:In a preferred embodiment, step S4 further includes:
S43.将条件数据与参考条件数据进行匹配,以获取匹配结果;S43. Match the condition data with the reference condition data to obtain a matching result;
当匹配结果匹配时,则控制机器人执行与编辑指令对应的操作;When the matching results match, the control robot performs an operation corresponding to the editing instruction;
当匹配结果不匹配时,则返回执行步骤S1。When the matching results do not match, the process returns to step S1.
如图3和图4所示,以需要训练机器人在温度低于16℃时语音提醒用户开空调为例:机器人系统处于集成开发环境,使机器人的实时条件状态显示于预设模板的条件数据显示区域;若此时温度为20℃,可点击“凝固”按钮(停止采集指令),以使实时条件状态停止更新,在“温度”一栏(预设模板的条件数据显示区域)显示20℃,可手动将温度区间设定为10℃到16℃;在预设模板的操作操作显示区域中激活TTS语音模块,输入文字“温度低于16摄氏度,请开空调”(编辑指令);点击“释放”按钮(开始采集指令),自动生成的代码上传到机器人并更新运行。从而完成了一次机器人的行为训 练,当机器人采集到的温度低于16℃时,就会主动提醒用户开启空调。As shown in FIG. 3 and FIG. 4, for example, when the training robot needs to prompt the user to turn on the air conditioner when the temperature is lower than 16 ° C, the robot system is in an integrated development environment, and the real-time condition state of the robot is displayed on the condition data of the preset template. Area; if the temperature is 20 °C at this time, click the “Coagulation” button (stop the acquisition command) to stop the real-time condition status, and display 20°C in the “Temperature” column (the condition data display area of the preset template). The temperature range can be manually set to 10 ° C to 16 ° C; activate the TTS voice module in the operation operation display area of the preset template, enter the text "temperature below 16 degrees Celsius, please turn on the air conditioner" (editing instructions); click "release "Button (start acquisition command), the automatically generated code is uploaded to the robot and updated to run. Thus completing a robotic behavior training Practice, when the temperature collected by the robot is lower than 16 °C, it will automatically remind the user to turn on the air conditioner.
以上所述仅为本发明较佳的实施例,并非因此限制本发明的实施方式及保护范围,对于本领域技术人员而言,应当能够意识到凡运用本发明说明书及图示内容所作出的等同替换和显而易见的变化所得到的方案,均应当包含在本发明的保护范围内。 The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the embodiments and the scope of the present invention, and those skilled in the art should be able to Alternatives and obvious variations are intended to be included within the scope of the invention.

Claims (9)

  1. 一种对机器人进行训练的系统,其特征在于,包括:A system for training a robot, comprising:
    一采集单元,用于采集条件数据;An acquisition unit for collecting condition data;
    一获取单元,用于获取用户发送的操作指令,每条所述操作指令对应一相应的操作,所述操作指令包括采集指令和/或编辑指令;An obtaining unit, configured to acquire an operation instruction sent by the user, each of the operation instructions corresponding to a corresponding operation, where the operation instruction includes an acquisition instruction and/or an editing instruction;
    一存储单元,用于存储所述操作指令;a storage unit for storing the operation instruction;
    一操作单元,用于执行与所述编辑指令对应的所述操作;An operation unit, configured to execute the operation corresponding to the editing instruction;
    一处理单元,分别连接所述采集单元、所述获取单元、所述存储单元和所述操作单元,用于将所述操作指令存储于所述存储单元中,并控制所述操作单元和/或所述采集单元执行与所述操作指令对应的所述操作;a processing unit, which is respectively connected to the collection unit, the acquisition unit, the storage unit and the operation unit, for storing the operation instruction in the storage unit, and controlling the operation unit and/or The collecting unit performs the operation corresponding to the operation instruction;
    一显示单元,连接所述处理单元,所述显示单元包括一预设模板,所述预设模板包括显示所述条件数据的区域和显示所述操作的执行图像的区域。A display unit is connected to the processing unit, and the display unit includes a preset template, the preset template includes an area for displaying the condition data and an area for displaying an execution image of the operation.
  2. 如权利要求1所述对机器人进行训练的系统,其特征在于,所述条件数据包括:光线值,和/或湿度值,和/或温度值,和/或热释电数据,和/或PM2.5值,和/或二氧化碳含量,和/或时间,和/或用户属性。A system for training a robot according to claim 1, wherein said condition data comprises: a light value, and/or a humidity value, and/or a temperature value, and/or pyroelectric data, and/or PM2. .5 value, and / or carbon dioxide content, and / or time, and / or user attributes.
  3. 如权利要求2所述对机器人进行训练的系统,其特征在于,所述用户属性包括管理者和/或访问者。A system for training a robot as claimed in claim 2, wherein said user attributes comprise a manager and/or a visitor.
  4. 如权利要求1所述对机器人进行训练的系统,其特征在于,所述获取单元包括:The system for training a robot according to claim 1, wherein the obtaining unit comprises:
    语音识别模块,用于接收用户发出的语音操作指令,并将所述语音操作指令转换为文字操作指令。The voice recognition module is configured to receive a voice operation instruction sent by the user, and convert the voice operation instruction into a text operation instruction.
  5. 如权利要求1所述对机器人进行训练的系统,其特征在于,所述处理单元包括:The system for training a robot according to claim 1, wherein the processing unit comprises:
    一接收模块,用以接收所述条件数据和所述操作指令;a receiving module, configured to receive the condition data and the operation instruction;
    一识别模块,连接所述接收模块,用以识别所述操作指令是否为所述采 集指令,并输出识别结果;An identification module, connected to the receiving module, to identify whether the operation instruction is the Set instructions and output recognition results;
    若所述操作指令是所述采集指令,则根据所述采集指令控制所述采集单元的工作状态;If the operation instruction is the collection instruction, controlling an operation state of the collection unit according to the collection instruction;
    一提取模块,连接所述识别模块,当所述操作指令不是所述采集指令时,则所述操作指令为所述编辑指令,所述提取模块用于提取所述编辑指令中的所述操作关键词和参考条件数据,每一组所述操作关键词对应一所述操作,并输出所述操作。An extraction module, connected to the identification module, when the operation instruction is not the acquisition instruction, the operation instruction is the editing instruction, and the extraction module is configured to extract the operation key in the editing instruction Word and reference condition data, each set of the operation keywords corresponds to one of the operations, and outputs the operation.
  6. 如权利要求5所述对机器人进行训练的系统,其特征在于,所述处理单元还包括:The system for training a robot according to claim 5, wherein the processing unit further comprises:
    一匹配模块,分别连接所述接收模块和所述提取模块,用于将所述条件数据与所述参考条件数据进行匹配,以获取匹配结果;a matching module, configured to respectively connect the receiving module and the extracting module, to match the condition data with the reference condition data to obtain a matching result;
    当结果匹配时,所述操作单元执行与所述编辑指令对应的所述操作。When the results match, the operation unit performs the operation corresponding to the editing instruction.
  7. 一种对机器人进行训练的方法,其特征在于,用于控制机器人的操作,包括下述步骤:A method of training a robot, characterized in that, for controlling the operation of the robot, the following steps are included:
    S1.采集条件数据;S1. Collecting condition data;
    S2.获取用户发送的操作指令,每条所述操作指令对应一相应的操作,所述操作指令包括采集指令和/或编辑指令;S2. Obtain an operation instruction sent by the user, where each operation instruction corresponds to a corresponding operation, where the operation instruction includes an acquisition instruction and/or an edit instruction;
    S3.存储所述操作指令;S3. storing the operation instruction;
    S4.控制所述机器人执行与所述操作指令对应的所述操作,并在一预设模板中显示所述条件数据和所述操作的执行图像。S4. Control the robot to perform the operation corresponding to the operation instruction, and display the condition data and the execution image of the operation in a preset template.
  8. 如权利要求7所述对机器人进行训练的方法,其特征在于,所述步骤S4包括:The method of training a robot according to claim 7, wherein the step S4 comprises:
    S41.接收所述条件数据和所述操作指令;S41. Receiving the condition data and the operation instruction;
    S42.识别所述操作指令是否为所述采集指令,并输出识别结果;S42. Identify whether the operation instruction is the collection instruction, and output a recognition result;
    若所述操作指令是所述采集指令时,则根据所述采集指令执行停止采集所述条件数据或开始采集所述条件数据; If the operation instruction is the collection instruction, stop acquiring the condition data or start collecting the condition data according to the collection instruction;
    若所述操作指令不是所述采集指令时,则所述操作指令为所述编辑指令,提取所述编辑指令中的所述操作关键词和参考条件数据,每一组所述操作关键词对应一所述操作,并输出所述操作。If the operation instruction is not the acquisition instruction, the operation instruction is the editing instruction, and the operation keyword and the reference condition data in the editing instruction are extracted, and each group of the operation keyword corresponds to one The operation and outputting the operation.
  9. 如权利要求8所述对机器人进行训练的方法,其特征在于,所述步骤S4还包括:The method of training a robot according to claim 8, wherein the step S4 further comprises:
    S43.将所述条件数据与所述参考条件数据进行匹配,以获取匹配结果;S43. Match the condition data with the reference condition data to obtain a matching result;
    当匹配结果匹配时,则控制所述机器人执行与所述编辑指令对应的所述操作;When the matching results match, controlling the robot to perform the operation corresponding to the editing instruction;
    当匹配结果不匹配时,则返回执行步骤S1。 When the matching results do not match, the process returns to step S1.
PCT/CN2016/085910 2015-06-30 2016-06-15 System and method for training robot WO2017000785A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510385251.0A CN106313113B (en) 2015-06-30 2015-06-30 The system and method that a kind of pair of robot is trained
CN201510385251.0 2015-06-30

Publications (1)

Publication Number Publication Date
WO2017000785A1 true WO2017000785A1 (en) 2017-01-05

Family

ID=57607861

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/085910 WO2017000785A1 (en) 2015-06-30 2016-06-15 System and method for training robot

Country Status (4)

Country Link
CN (1) CN106313113B (en)
HK (1) HK1231439A1 (en)
TW (1) TWI594857B (en)
WO (1) WO2017000785A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109101107A (en) * 2018-06-29 2018-12-28 温州大学 A kind of system and method that VR virtual classroom trains virtual robot
CN110026983B (en) * 2019-04-30 2020-06-23 南京云图机器人科技有限公司 Robot programming system
CN110334140B (en) * 2019-05-24 2022-04-08 深圳绿米联创科技有限公司 Method and device for processing data reported by equipment and server
CN111152228B (en) * 2020-01-22 2021-07-09 深圳国信泰富科技有限公司 Robot action self-planning system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1970247A (en) * 2006-12-01 2007-05-30 南开大学 Inset type mobile robot core controller
US20070191969A1 (en) * 2006-02-13 2007-08-16 Jianying Shi Automated state change notification
US20070282858A1 (en) * 2006-06-01 2007-12-06 Michael Arner System and method for playing rich internet applications in remote computing devices
CN202079595U (en) * 2010-01-08 2011-12-21 哈尔滨理工大学 Novel control platform for tele-operation of remote robot
CN104102346A (en) * 2014-07-01 2014-10-15 华中科技大学 Household information acquisition and user emotion recognition equipment and working method thereof
CN104688491A (en) * 2013-12-04 2015-06-10 中国科学院宁波材料技术与工程研究所 Training robot and control method

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20020008848A (en) * 2000-03-31 2002-01-31 이데이 노부유끼 Robot device, robot device action control method, external force detecting device and external force detecting method
CN100562844C (en) * 2005-12-13 2009-11-25 台达电子工业股份有限公司 The module of user's self-setting acoustically-controlled fast mode and method thereof
FR2963132A1 (en) * 2010-07-23 2012-01-27 Aldebaran Robotics HUMANOID ROBOT HAVING A NATURAL DIALOGUE INTERFACE, METHOD OF USING AND PROGRAMMING THE SAME
CN201940040U (en) * 2010-09-27 2011-08-24 深圳市杰思谷科技有限公司 Domestic robot
DE102011005985B4 (en) * 2011-03-23 2019-01-24 Kuka Roboter Gmbh Robot, control device for a robot and method for operating a robot
KR101945185B1 (en) * 2012-01-12 2019-02-07 삼성전자주식회사 robot and method to recognize and handle exceptional situations
CN103065629A (en) * 2012-11-20 2013-04-24 广东工业大学 Speech recognition system of humanoid robot
CN104635651A (en) * 2013-11-13 2015-05-20 沈阳新松机器人自动化股份有限公司 Multifunctional programming demonstration box
CN103631221B (en) * 2013-11-20 2016-05-04 华南理工大学广州学院 A kind of distant operate services robot system
CN104057458B (en) * 2014-06-16 2015-12-02 浙江大学 A kind of Multi-shaft mechanical arm visual control system and method based on body sense and touch

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070191969A1 (en) * 2006-02-13 2007-08-16 Jianying Shi Automated state change notification
US20070282858A1 (en) * 2006-06-01 2007-12-06 Michael Arner System and method for playing rich internet applications in remote computing devices
CN1970247A (en) * 2006-12-01 2007-05-30 南开大学 Inset type mobile robot core controller
CN202079595U (en) * 2010-01-08 2011-12-21 哈尔滨理工大学 Novel control platform for tele-operation of remote robot
CN104688491A (en) * 2013-12-04 2015-06-10 中国科学院宁波材料技术与工程研究所 Training robot and control method
CN104102346A (en) * 2014-07-01 2014-10-15 华中科技大学 Household information acquisition and user emotion recognition equipment and working method thereof

Also Published As

Publication number Publication date
TW201700237A (en) 2017-01-01
CN106313113A (en) 2017-01-11
TWI594857B (en) 2017-08-11
HK1231439A1 (en) 2017-12-22
CN106313113B (en) 2019-06-07

Similar Documents

Publication Publication Date Title
KR102041063B1 (en) Information processing device, information processing method and program
WO2018000280A1 (en) Multi-mode based intelligent robot interaction method and intelligent robot
TWI594857B (en) A system and method for training robots
US10146318B2 (en) Techniques for using gesture recognition to effectuate character selection
US10909982B2 (en) Electronic apparatus for processing user utterance and controlling method thereof
CN103021409B (en) A kind of vice activation camera system
EP3396666B1 (en) Electronic device for providing speech recognition service and method thereof
RU2653283C2 (en) Method for dialogue between machine, such as humanoid robot, and human interlocutor, computer program product and humanoid robot for implementing such method
WO2017059815A1 (en) Fast identification method and household intelligent robot
WO2021135685A1 (en) Identity authentication method and device
CN105575395A (en) Voice wake-up method and apparatus, terminal, and processing method thereof
US11120792B2 (en) System for processing user utterance and controlling method thereof
EP3396664B1 (en) Electronic device for providing speech recognition service and method thereof
CN111197841A (en) Control method, control device, remote control terminal, air conditioner, server and storage medium
US11763690B2 (en) Electronic apparatus and controlling method thereof
US10067738B2 (en) Device control based on its operational context
WO2017143951A1 (en) Expression feedback method and smart robot
US20210272564A1 (en) Voice processing device, voice processing method, and recording medium
KR20190101100A (en) Voice input processing method and electronic device supportingthe same
CN115713936A (en) Voice control method and device based on smart home
WO2017187677A1 (en) Information processing device, information processing method, and program
US11017772B1 (en) Natural language programming
CN112579035A (en) Voice acquisition terminal input system and input method
CN113419440A (en) Intelligent control system based on use under intelligent house environment
US20190267002A1 (en) Intelligent system for creating and editing work instructions

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16817149

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16817149

Country of ref document: EP

Kind code of ref document: A1