WO2018028360A1 - Control method and device for smart robot, and robot - Google Patents

Control method and device for smart robot, and robot Download PDF

Info

Publication number
WO2018028360A1
WO2018028360A1 PCT/CN2017/091972 CN2017091972W WO2018028360A1 WO 2018028360 A1 WO2018028360 A1 WO 2018028360A1 CN 2017091972 W CN2017091972 W CN 2017091972W WO 2018028360 A1 WO2018028360 A1 WO 2018028360A1
Authority
WO
WIPO (PCT)
Prior art keywords
control command
target user
perform
intelligent robot
determining
Prior art date
Application number
PCT/CN2017/091972
Other languages
French (fr)
Chinese (zh)
Inventor
刘若鹏
李志�
张莹莹
Original Assignee
深圳光启合众科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳光启合众科技有限公司 filed Critical 深圳光启合众科技有限公司
Publication of WO2018028360A1 publication Critical patent/WO2018028360A1/en

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion

Definitions

  • the present invention relates to the field of robots, and in particular to a control method and apparatus for an intelligent robot and a robot.
  • the existing intelligent robots are large and versatile, and have a low degree of intelligence. They are all biased towards service type, and there are fewer external signals that can be processed.
  • the implementation of technologies such as grabbed items and the requirements of serving humans are still There is a big gap and basically no practical significance.
  • the accompanying robot is also limited to a small amount of voice and audio video playback. In view of the problem that the intelligent robot in the prior art cannot respond according to people's commands, an effective solution has not been proposed yet.
  • a main object of the present invention is to provide a control method and apparatus for an intelligent robot and a robot to solve at least the problem that the intelligent robot cannot respond according to a person's command in the related art.
  • a control method for an intelligent robot includes: detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user, wherein the first control command is a command for controlling the intelligent robot to perform the first operation, the target user An object for interacting with the intelligent robot; determining a first operation that the intelligent robot needs to perform according to the first control command; performing the first operation in response to the first control command.
  • detecting the behavior of the target user and generating the first control command corresponding to the behavior of the target user includes: detecting an action of the target user and generating an action control command corresponding to the action of the target user, determining according to the first control command
  • the first operation that the intelligent robot needs to perform includes: determining, according to the motion control command, a first operation that the intelligent robot needs to perform, and in response to the first control command, performing the first operation includes: switching a current state of the intelligent robot according to the motion control command, The first operation is performed in response to the action control command.
  • detecting an action of the target user and generating a motion control command corresponding to the action of the target user includes: detecting a pressure signal generated by the target user on the intelligent robot, obtaining pressure data, and determining, according to the motion control command, that the intelligent robot needs to perform
  • the first operation includes: determining, according to the pressure data, a first operation that the intelligent robot needs to perform.
  • the control method for the intelligent robot further includes: detecting a distance signal generated between the intelligent robot and the surrounding object, and obtaining the distance data. Determining, according to the first control command, the first operation that the intelligent robot needs to perform includes: determining, according to the distance data, a first operation that the intelligent robot needs to perform.
  • detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user includes: detecting a voice sent by the target user and generating a voice control command corresponding to the voice sent by the target user, according to the first control
  • the command determining the first operation that the intelligent robot needs to perform includes: determining, according to the voice control command, the first operation that the intelligent robot needs to perform, and in response to the first control command, performing the first operation comprises: performing the first operation in response to the voice control command.
  • determining, according to the voice control command, the first operation that the intelligent robot needs to perform includes: acquiring an image acquisition command in the voice control command; acquiring the target image according to the image acquisition command; performing processing on the target image according to the image processing algorithm, Processing result; determining the first operation that the intelligent robot needs to perform according to the processing result.
  • performing the first operation comprises: selecting an audio file to be played according to the voice control command; performing playback on the audio file.
  • the control method for the intelligent robot further includes: detecting a behavior of the target user and generating a second control command corresponding to the behavior of the target user,
  • the second control command is a command for controlling the intelligent robot to perform the second operation; Determining whether there is a change between the second control command and the first control command; if it is determined that there is a change between the second control command and the first control command, adjusting the first operation according to the first control command and the second control command to obtain a second operation, the response And performing a second operation on the second control command; and performing a first operation in response to the second control command if it is determined that there is no change between the second control command and the first control command.
  • a control apparatus for an intelligent robot includes: a detecting unit, configured to detect a behavior of the target user and generate a first control command corresponding to the behavior of the target user, wherein the first control command is used to control the intelligent robot to perform the first operation
  • the target user is an object that interacts with the intelligent robot; the determining unit is configured to determine, according to the first control command, a first operation that the intelligent robot needs to perform; and the executing unit, configured to perform the first operation in response to the first control command .
  • the detecting unit is configured to detect an action of the target user and generate a motion control command corresponding to the action of the target user, where the determining unit is configured to determine, according to the motion control command, a first operation that the smart robot needs to perform, and the executing unit is configured to use The current state of the intelligent robot is switched according to the motion control command, and the first operation is performed in response to the motion control command.
  • the detecting unit is configured to detect a pressure signal generated by the target user on the intelligent robot to obtain pressure data
  • the determining unit is configured to determine, according to the pressure data, a first operation that the intelligent robot needs to perform.
  • the detecting unit is further configured to: before determining the first operation that the intelligent robot needs to perform according to the first control command, detecting a distance signal generated between the intelligent robot and the surrounding object to obtain distance data, where the determining unit is further used to The first operation that the intelligent robot needs to perform is determined based on the distance data.
  • the detecting unit is configured to detect a voice sent by the target user and generate a voice control command corresponding to the voice sent by the target user, where the determining unit is configured to determine, according to the voice control command, a first operation that the smart robot needs to perform, and the executing unit For performing a first operation in response to a voice control command.
  • an acquiring module is configured to acquire an image capturing command in the voice control command, an acquiring module, configured to collect the target image according to the image capturing command, and a processing module, configured to perform processing on the target image according to the image processing algorithm, to obtain Processing result; determining module, configured to determine, according to the processing result, a first operation that the intelligent robot needs to perform.
  • the executing unit includes: a selecting module, configured to select an audio file to be played according to the voice control command; and a playing module, configured to perform playing on the audio file.
  • the first control command corresponding to the behavior of the target user is generated by detecting the behavior of the target user, wherein the first control command is a command for controlling the intelligent robot to perform the first operation, and the target user is An intelligent robot performs an interaction object; determining, according to the first control command, a first operation that the intelligent robot needs to perform; and performing a first operation in response to the first control command, solving a problem that the intelligent robot cannot respond according to a human command, In turn, the effect of the intelligent robot responding according to people's commands is achieved.
  • FIG. 1 is a flowchart of a control method for an intelligent robot according to a first embodiment of the present invention
  • FIG. 2 is a flowchart of a control method for an intelligent robot according to a second embodiment of the present invention
  • FIG. 3 is a flowchart of a control method for an intelligent robot according to a third embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a control device for an intelligent robot according to a first embodiment of the present invention
  • FIG. 5 is a schematic diagram of a control apparatus for an intelligent robot according to a second embodiment of the present invention
  • FIG. 6 is a schematic diagram of a control apparatus for an intelligent robot according to a third embodiment of the present invention.
  • Embodiments of the present invention provide a control method for an intelligent robot.
  • control method for an intelligent robot includes the following steps:
  • Step S101 detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user
  • the target user is an object that interacts with the intelligent robot, and the target user can perform a voice interaction or an action interaction with the intelligent robot.
  • the target user calls the intelligent robot, and the intelligent robot moves toward the target user according to the target user's voice.
  • the target user strokes or taps the robot, and the robot responds according to the target user's motion.
  • the behavior of the target user is detected, whether the target user emits a voice, or whether there is a behavior action for the intelligent robot.
  • the target user issues a voice to the intelligent robot, generates a first control command corresponding to the voice issued by the target user, to control the intelligent robot to perform the first operation, and meets the target user's needs, and the target user applies an action to the intelligent robot to generate and target the user.
  • the applied action corresponds to the first control command to control the intelligent robot to perform the first operation to meet the needs of the target user.
  • the voice data is received by the voice module, and the voice data is transmitted to the main control module through the UART serial port, and the main control module further processes the voice data;
  • the action is to generate action data, collect action data generated by the action of the target user, and transmit the action data to the main control module through the UART, and the main control module further processes the action data.
  • the acquiring the sensing signal generates a first control command, and the first control command may be generated by acquiring the multiple sensing signals.
  • Step S102 Determine, according to the first control command, a first operation that the intelligent robot needs to perform.
  • the intelligent robot after detecting the behavior of the target user and generating a first control command corresponding to the behavior of the target user, determining, according to the first control command, a first operation that the intelligent robot needs to perform, that is, making a decision according to the first control command, Further determining what first operation the intelligent robot needs to perform, for example, performing a first operation of image acquisition, performing a first operation of state switching, performing a first operation of playing an audio file, performing a first operation of continuous walking, performing and motion control The first operation of the module for communication, etc.
  • the intelligent robot can be a home smart robot.
  • the main control module processes the first control command to obtain a processing result.
  • the first control command is processed according to the image acquisition algorithm, and is processed.
  • the data is collected through the UA RT serial port and transmitted to the main control module.
  • the main control module converts the data and obtains the processing result.
  • the first operation that the family can perform the intelligent robot is determined according to the processing result.
  • Step S103 Perform a first operation in response to the first control command.
  • the embodiment detects the behavior of the target user and generates a first control command corresponding to the behavior of the target user, wherein the first control command is a command for controlling the intelligent robot to perform the first operation, and the target user is the smart An object that the robot interacts with; determining, according to the first control command, a first operation that the intelligent robot needs to perform; performing the first operation in response to the first control command, reaching the intelligent robot according to the The effect of people's commands responding.
  • detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user includes: detecting an action of the target user and generating an action control command corresponding to the action of the target user, Determining, according to the first control command, the first operation that the intelligent robot needs to perform comprises: determining, according to the motion control command, a first operation that the intelligent robot needs to perform, and in response to the first control command, performing the first operation, comprising: the intelligent robot according to the motion control command The current state is switched, and the first operation is performed in response to the action control command.
  • the action of the target user can be detected, for example, detecting the action of the target user touching the smart robot or tapping the intelligent robot.
  • Generating a motion control command corresponding to the action of the target user may be: when detecting that the target user touches the smart robot, generating an action control command for issuing a call and a comfortable action, and determining, according to the action control command, that the smart robot needs to execute A first operation of issuing a squeaking sound and a comfortable motion, switching a current state of the intelligent robot according to the motion control command, and issuing a first operation of the scream and the comfortable motion in response to the motion control command.
  • the first operation of continuously walking may be performed in response to the first control command, or may be communicated with the motion control module after completing an action.
  • detecting an action of the target user and generating a motion control command corresponding to the action of the target user includes: detecting a pressure signal generated by the target user on the intelligent robot, obtaining pressure data, and controlling according to the action
  • the command determines the first operation that the intelligent robot needs to perform includes: determining, according to the pressure data, the first operation that the intelligent robot needs to perform.
  • the target user applies pressure on the intelligent robot to generate a pressure signal
  • the force sensitive module determines the magnitude of the force according to the pressure signal to generate different pressure data.
  • the target user taps the smart robot, and the strokes and the like have different actions.
  • the strength of the force sensitive module will detect different pressure data according to the action of different strengths.
  • the main control module determines, according to the pressure data detected by the force sensitive module, the target user to tap or stroke the intelligent robot, thereby determining the first operation that the intelligent robot needs to perform.
  • the force sensitive module when the target user touches the intelligent robot, the force sensitive module generates pressure data according to the magnitude of the force, and the intelligent robot will make a sounding call and a comfortable motion, so that people can feel the intelligence of the intelligent robot, thereby making people Intelligent robots generate feelings of love and dependence.
  • detecting a distance signal generated between the intelligent robot and the surrounding object before determining the first operation that the intelligent robot needs to perform according to the first control command, detecting a distance signal generated between the intelligent robot and the surrounding object, and obtaining distance data, according to the first control
  • the command determining the first operation that the intelligent robot needs to perform includes: determining, according to the distance data, a first operation that the intelligent robot needs to perform.
  • the intelligent robot Before determining the first operation that the intelligent robot needs to perform according to the first control command, detecting a distance signal generated between the smart robot and the surrounding object to obtain distance data, and obtaining the distance data by measuring the distance signal by the ranging module.
  • the robot generates a distance signal between the object and the surrounding object during the walking process, and the robot determines the obstacles around the distance according to the distance signal to determine the obstacle avoidance behavior of the obstacle avoiding obstacle.
  • the target user calls for the intelligent robot, and the intelligent robot advances toward the target user, and judges the distance of the obstacle according to the change of the distance signal to perform obstacle avoidance behavior and the like.
  • detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user includes: detecting a voice sent by the target user and generating voice control corresponding to the voice sent by the target user
  • the command, determining, according to the first control command, the first operation that the intelligent robot needs to perform includes: determining, according to the voice control command, a first operation that the intelligent robot needs to perform, and in response to the first control command, performing the first operation includes: responding to the voice control command , perform the first operation.
  • Detecting the behavior of the target user may be detecting a voice uttered by the target user, and the voice uttered by the target user may be a command to command the intelligent robot to perform the first operation. Determining, according to the voice control command, a first operation that the intelligent robot needs to perform, for example, the target user calls the intelligent robot, detects that the target user calls the voice of the intelligent robot, and generates a voice control command corresponding to the voice sent by the target user, and the voice control command may be a first control command for controlling the intelligent robot to advance toward the target user, and the intelligent robot performs a first operation toward the target user in response to the voice control command, thereby satisfying the target user's demand, and improving the target user and the intelligent robot
  • the amount of interaction between the home intelligence robots receives external information and makes appropriate decisions, in response to the needs of the target users, to make people feel emotional.
  • determining, according to the voice control command, the first operation that the intelligent robot needs to perform includes: determining, according to the voice control command, the first operation that the intelligent robot needs to perform, including: acquiring image collection in the voice control command Command; acquiring a target image according to an image acquisition command; performing processing on the target image according to the image processing algorithm, obtaining a processing result; and determining the smart machine according to the processing result The first action that the person needs to perform.
  • the image acquisition module may be called to collect the target image, for example, Collecting face images, object images, moving images, etc., passing the collected image data to the main control module through the USB interface, and obtaining the processing result through the image processing algorithm, for example, obtaining the processing result of the face image, the processing result of the object image, Dynamically tracking the processing result of the image, etc., placing the processing result into the main control decision queue, and determining the first operation that the intelligent robot needs to perform according to the processing result, wherein the image acquisition module can be a camera.
  • the image acquisition module is not called to collect the image.
  • performing the first operation includes: selecting an audio file to be played according to the voice control command; performing playback on the audio file.
  • the audio file to be played is selected according to the voice control command, and the first operation of performing playback on the audio file is completed in the audio play thread.
  • the second control command is a command for controlling the intelligent robot to perform the second operation; determining whether there is a change between the second control command and the first control command; if it is determined that the second control command and the first control command are changed, according to the first control command and the The second control command adjusts the first operation to obtain a second operation, and in response to the second control command, performs a second operation; and if it is determined that the second control command and the first control command do not change, the second control command is executed in response to the second control command An operation.
  • the interaction behavior of the robot with the target user is continuously detected, and a control command is generated.
  • the main control module may determine whether there is a change between the second control command and the first control command. , and then adjust.
  • Determining whether the first control command changes if it is determined that the first control command changes, adjusting the first control command, obtaining an adjustment first control command; determining the first operation that the intelligent robot needs to perform according to adjusting the first control command, thereby Achieved the effect of intelligent robots responding according to people's orders
  • control method for an intelligent robot includes the following steps:
  • Step S201 Generate a first control command.
  • detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user, and collecting control data corresponding to the first control command for example, motion control data, voice data, image data, pressure data, distance data , audio data, etc.
  • the motion control module, the image acquisition module, the voice module, the force sensitive module, the ranging module, the audio module communicate with the main control module through the U ART interface
  • the audio playback module communicates with the main control module through the audio interface
  • the image acquisition module communicates with the main control module through the USB interface.
  • the main control module is connected to communicate, and the main control module receives control data collected by various sensors through the UART and the USB interface, and generates a first control command according to the control data.
  • Step S202 performing processing on the first control command, and obtaining a processing result.
  • performing processing on the first control command for example, processing the image data collected by the image acquisition module according to an image processing algorithm, and obtaining a processing result, and acquiring pressure data collected by the force sensitive module. Data conversion is performed, the processing result is obtained, and the processing result is placed in the decision queue of the intelligent robot.
  • Step S203 Determine a first operation that the intelligent robot needs to perform.
  • Step S204 executing the first operation in response to the first control command.
  • the first operation is performed in response to the first control command corresponding to the control data.
  • This embodiment proposes a decision model of an intelligent robot, which enables the robot to receive a variety of external information, and processes and makes decisions on various external information to make an appropriate response, so that people feel no longer to the robot. Then rigid.
  • the decision model includes an interface of a main control module, a motion control module, a voice module, an image acquisition module, a force sensitive module, a ranging module, an audio playback module, and various types of sensors.
  • the voice module, the motion control module, the force sensitive module and the ranging module communicate with the main control module through the UART interface;
  • the audio playback module communicates with the main control module through the audio interface;
  • the image acquisition module communicates with the main control module through the USB interface.
  • the main control module receives the control data collected by various sensors through the UART and the USB interface, and then controls the data for processing, obtains the processing result, and then makes a decision on the processing result, and outputs corresponding actions and sounds, and the intelligent robot is made according to the commands of the people. The effect of the response.
  • control method for an intelligent robot includes the following steps:
  • step S301 detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user
  • detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user and receiving voice data, pressure data, distance data, and the like through the UART serial port, and generating a first control command corresponding to the behavior of the target user.
  • Step S302 Determine, according to the first control command, a first operation that the intelligent robot needs to perform.
  • the decision is made to determine, by the first control command, the first operation that the intelligent robot needs to perform.
  • Step S303 image acquisition.
  • the image acquisition function is started, and the camera may be called to acquire an image.
  • Image acquisition is processed in the image acquisition processing thread.
  • Step S304 identifying the image.
  • Image acquisition After image acquisition, an image may be identified. Optionally, you can recognize faces, objects, etc. . Image recognition is processed in the image acquisition processing thread.
  • Step S305 selecting to play the audio file according to the first control command.
  • the audio file is selected to be played according to the first control command.
  • the playback audio file is selected to be processed in the audio playback thread according to the first control command.
  • Step S306 the state machine is called to implement state switching.
  • the state machine After determining the first operation that the intelligent robot needs to perform according to the first control command, the state machine is called to implement state switching, for example, the smart robot's twisting, bending, running, etc. state switching.
  • Step S307 combining single steps to achieve continuous walking.
  • Step S308 completing an action to perform communication with the motion control module.
  • Step S309 delaying.
  • step S301 is re-executed to detect the behavior of the target user and generate a first control command corresponding to the behavior of the target user.
  • the command of the target user to the intelligent robot is received by the voice module, and is transmitted to the main control module through the UART serial port. If the image acquisition is involved in the command, the camera capture image is transmitted to the main control module through the USB interface, and the image processing algorithm is used to process the result into the main control decision queue.
  • the pressure signal generated by the intelligent robot touching or tapping and the distance signal of the intelligent robot to the surrounding objects during the walking process are transmitted to the main control module through the UART serial port, and the conversion result is put into the decision queue through data conversion. in.
  • the main control module adjusts and adjusts according to the change of the current input data, and plays audio or different actions to respond to different first operations of the people, so that people feel vivid and not boring, for example, people gently touch the robot
  • the force sensitive module will generate different pressure values according to the magnitude of the force.
  • the robot will make a scream and a comfortable movement.
  • People call the intelligent robot.
  • the robot will move toward the direction of the people and judge according to the change of the distance signal. Obstacle avoidance Obstacle behavior, etc., make people feel the robot intelligence and not rigid, thus generating feelings of like and dependence, and achieving the effect that the intelligent robot responds according to people's commands.
  • Embodiments of the present invention also provide a control apparatus for an intelligent robot. It is to be noted that the control device for the intelligent robot of this embodiment can be used to execute the control method for the intelligent robot of the embodiment of the present invention.
  • control device for an intelligent robot comprises: a detecting unit 10, a determining unit 20 and an executing unit 30.
  • the detecting unit 10 is configured to detect a behavior of the target user and generate a first control command corresponding to the behavior of the target user, where the first control command is a command for controlling the intelligent robot to perform the first operation, and the target user is An object that interacts with an intelligent robot.
  • the determining unit 20 is configured to determine, according to the first control command, a first operation that the intelligent robot needs to perform.
  • the executing unit 30 is configured to perform a first operation in response to the first control command.
  • the detecting unit 10 is configured to detect an action of the target user and generate a motion control command corresponding to the action of the target user
  • the determining unit 20 is configured to determine, according to the motion control command, the first operation that the smart robot needs to perform, and execute
  • the unit 30 is configured to switch the current state of the intelligent robot according to the motion control command, and perform the first operation in response to the motion control command.
  • the detecting unit 10 is configured to detect pressure data generated by the target user on the intelligent robot, and the determining unit 20 is configured to determine, according to the pressure data, a first operation that the intelligent robot needs to perform.
  • the detecting unit 10 is further configured to: before determining the first operation that the intelligent robot needs to perform according to the first control command, detecting a distance signal generated between the intelligent robot and the surrounding object, to obtain distance data, and determining unit 20 It is also used to determine the first operation that the intelligent robot needs to perform based on the distance data.
  • the detecting unit 10 is configured to detect a voice sent by the target user and generate a voice control command corresponding to the voice sent by the target user
  • the determining unit 20 is configured to determine, according to the voice control command, the first operation that the smart robot needs to perform.
  • the executing unit 30 is configured to perform the first operation in response to the voice control command.
  • 5 is a schematic diagram of a control device for an intelligent robot according to a second embodiment of the present invention.
  • the control device for the intelligent robot includes: a detecting unit 10, a determining unit 20, and an executing unit 30.
  • the determining unit 20 includes: an obtaining module 21, an acquiring module 22, a processing module 23, and a determining module 24.
  • the detecting unit 10, the determining unit 20 and the executing unit 30 of this embodiment have the same functions as those of the control device for the intelligent robot of the first embodiment of the present invention, and are not described herein again.
  • the obtaining module 21 is configured to acquire an image capturing command in the voice first control command.
  • the acquisition module 22 is configured to collect a target image acquisition target image according to an image acquisition command.
  • the processing module 23 is configured to perform processing on the target image according to the image processing algorithm to obtain a processing result.
  • the determining module 24 is configured to determine, according to the processing result, a first operation that the intelligent robot needs to perform.
  • control device for an intelligent robot comprises: a detecting unit 10, a determining unit 20 and an executing unit 3
  • the execution unit 30 includes: a selection module 31 and a playback module 32.
  • the detecting unit 10, the determining unit 20 and the executing unit 30 of the embodiment have the same functions as those of the control device for the intelligent robot of the first embodiment of the present invention, and details are not described herein again.
  • the selecting module 31 is configured to select an audio file to be played according to the voice control command.
  • the playing module 32 is configured to perform playing on the audio file.
  • the playing module 32 can be used to execute the method performed by the audio playing module in the above-described embodiment of the control method for the intelligent robot.
  • the embodiment of the present invention detects the behavior of the target user by the detecting unit 10 and generates a first control command corresponding to the behavior of the target user, where the first control command is a command for controlling the intelligent robot to perform the first operation, and the target user is The object interacting with the intelligent robot determines the first operation that the intelligent robot needs to perform according to the first control command, and performs the first operation by the execution unit 30 in response to the first control command, and the intelligent robot is determined according to the The effect of the command responding.
  • the present invention also provides an embodiment of a robot for an intelligent robot according to an embodiment of the present invention.
  • the embodiments of the present invention can be applied to applications in robots in other fields, and communication and control with external smart devices can be extended to other actuators or execution devices with communication modules.
  • the decision model of the embodiment of the present invention can simultaneously collect multi-channel sensor signals, can interact with people, and control the actuator to actively respond appropriately.
  • the control decision model can be applied to robots with other sensor devices and intelligence.
  • the home or the execution device, the control decision model can also be controlled by other sensors, and achieve the effect that the intelligent robot responds according to people's commands.
  • modules or steps of the present invention described above can be implemented by a general-purpose computing device, which can be centralized on a single computing device or distributed across multiple computing devices.
  • they may be implemented by program code executable by the computing device, such that they may be stored in the storage device by the computing device, or they may be separately fabricated into individual integrated circuit modules, or Implementing multiple modules or steps in them as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)

Abstract

Disclosed are a control method and device for a smart robot. The control method for a smart robot comprises: detecting a behavior of a target user and generating a first control command corresponding to the behavior of the target user, the first control command being a command for controlling a smart robot to perform a first operation, the target user being an object interacting with the smart robot; determining, according to the first control command, a first operation to be performed by the smart robot; and performing the first operation in response to the first control command. The control device for a smart robot comprises a detecting unit (10), a determining unit (20), and a performing unit (30) corresponding to the method. Also disclosed is a smart robot comprising the control device and capable of responding to commands of humans.

Description

用于智能机器人的控制方法和装置及机器人 技术领域  Control method and device for intelligent robot and robot
[0001] 本发明涉及机器人领域, 具体而言, 涉及一种用于智能机器人的控制方法和装 置及机器人。  [0001] The present invention relates to the field of robots, and in particular to a control method and apparatus for an intelligent robot and a robot.
背景技术  Background technique
[0002] 目前, 随着人们生活质量提高和机器人技术的发展, 人们对智能机器人的需求 越来越多, 各种功能的机器人应运而生, 比如, 扫地机器人, 送餐机器人, 陪 护机器人等。 但是, 这些机器人只能提供特定的服务, 跟人的交互量低, 并且 没有什么附加值, 无法根据人们的需求做出相应的响应, 无法使人们产生感情 依赖。  [0002] At present, with the improvement of people's quality of life and the development of robot technology, people are increasingly demanding intelligent robots, and various functional robots have emerged, such as sweeping robots, food delivery robots, and accompanying robots. However, these robots can only provide specific services, have low interaction with people, and have no added value. They can't respond according to people's needs, and they can't make people feel emotionally dependent.
技术问题  technical problem
[0003] 现有的智能机器人大多功能单一, 智能化程度低, 都是偏向于服务型的, 能够 处理的外界信号也较少, 所标榜的抓取物品等技术的实现与服务人类的要求还 有很大的差距, 基本上没有什么实际意义。 陪护型的机器人也仅限于少量的语 音和音频视频播放功能。 针对现有技术中的智能机器人无法根据人们的命令做 出响应的问题, 目前尚未提出有效的解决方案。  [0003] The existing intelligent robots are large and versatile, and have a low degree of intelligence. They are all biased towards service type, and there are fewer external signals that can be processed. The implementation of technologies such as grabbed items and the requirements of serving humans are still There is a big gap and basically no practical significance. The accompanying robot is also limited to a small amount of voice and audio video playback. In view of the problem that the intelligent robot in the prior art cannot respond according to people's commands, an effective solution has not been proposed yet.
问题的解决方案  Problem solution
技术解决方案  Technical solution
[0004] 本发明的主要目的在于提供一种用于智能机器人的控制方法和装置及机器人, 以至少解决相关技术中智能机器人无法根据人们的命令做出响应问题。  [0004] A main object of the present invention is to provide a control method and apparatus for an intelligent robot and a robot to solve at least the problem that the intelligent robot cannot respond according to a person's command in the related art.
[0005] 为了实现上述目的, 根据本发明的一个方面, 提供了一种用于智能机器人的控 制方法。 该用于智能机器人的控制方法包括: 检测目标用户的行为并生成与目 标用户的行为对应的第一控制命令, 其中, 第一控制命令为用于控制智能机器 人执行第一操作的命令, 目标用户为与智能机器人进行交互的对象; 根据第一 控制命令确定智能机器人需要执行的第一操作; 响应于第一控制命令, 执行第 一操作。 [0006] 进一步地, 检测目标用户的行为并生成与目标用户的行为对应的第一控制命令 包括: 检测目标用户的动作并生成与目标用户的动作对应的动作控制命令, 根 据第一控制命令确定智能机器人需要执行的第一操作包括: 根据动作控制命令 确定智能机器人需要执行的第一操作, 响应于第一控制命令, 执行第一操作包 括: 根据动作控制命令对智能机器人的当前状态进行切换, 响应于动作控制命 令, 执行第一操作。 In order to achieve the above object, according to an aspect of the present invention, a control method for an intelligent robot is provided. The control method for the intelligent robot includes: detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user, wherein the first control command is a command for controlling the intelligent robot to perform the first operation, the target user An object for interacting with the intelligent robot; determining a first operation that the intelligent robot needs to perform according to the first control command; performing the first operation in response to the first control command. [0006] Further, detecting the behavior of the target user and generating the first control command corresponding to the behavior of the target user includes: detecting an action of the target user and generating an action control command corresponding to the action of the target user, determining according to the first control command The first operation that the intelligent robot needs to perform includes: determining, according to the motion control command, a first operation that the intelligent robot needs to perform, and in response to the first control command, performing the first operation includes: switching a current state of the intelligent robot according to the motion control command, The first operation is performed in response to the action control command.
[0007] 进一步地, 检测目标用户的动作并生成与目标用户的动作对应的动作控制命令 包括: 检测目标用户在智能机器人上产生的压力信号, 得到压力数据, 根据动 作控制命令确定智能机器人需要执行的第一操作包括: 根据压力数据确定智能 机器人需要执行的第一操作。  [0007] Further, detecting an action of the target user and generating a motion control command corresponding to the action of the target user includes: detecting a pressure signal generated by the target user on the intelligent robot, obtaining pressure data, and determining, according to the motion control command, that the intelligent robot needs to perform The first operation includes: determining, according to the pressure data, a first operation that the intelligent robot needs to perform.
[0008] 进一步地, 在根据第一控制命令确定智能机器人需要执行的第一操作之前, 该 用于智能机器人的控制方法还包括: 检测智能机器人与周围物体之间产生的距 离信号, 得到距离数据, 根据第一控制命令确定智能机器人需要执行的第一操 作包括: 根据距离数据确定智能机器人需要执行的第一操作。  [0008] Further, before determining the first operation that the intelligent robot needs to perform according to the first control command, the control method for the intelligent robot further includes: detecting a distance signal generated between the intelligent robot and the surrounding object, and obtaining the distance data. Determining, according to the first control command, the first operation that the intelligent robot needs to perform includes: determining, according to the distance data, a first operation that the intelligent robot needs to perform.
[0009] 进一步地, 检测目标用户的行为并生成与目标用户的行为对应的第一控制命令 包括: 检测目标用户发出的语音并生成与目标用户发出的语音对应的语音控制 命令, 根据第一控制命令确定智能机器人需要执行的第一操作包括: 根据语音 控制命令确定智能机器人需要执行的第一操作, 响应于第一控制命令, 执行第 一操作包括: 响应于语音控制命令, 执行第一操作。  [0009] Further, detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user includes: detecting a voice sent by the target user and generating a voice control command corresponding to the voice sent by the target user, according to the first control The command determining the first operation that the intelligent robot needs to perform includes: determining, according to the voice control command, the first operation that the intelligent robot needs to perform, and in response to the first control command, performing the first operation comprises: performing the first operation in response to the voice control command.
[0010] 进一步地, 根据语音控制命令确定智能机器人需要执行的第一操作包括: 获取 语音控制命令中的图像采集命令; 根据图像采集命令采集目标图像; 根据图像 处理算法对目标图像执行处理, 得到处理结果; 根据处理结果确定智能机器人 需要执行的第一操作。  [0010] Further, determining, according to the voice control command, the first operation that the intelligent robot needs to perform includes: acquiring an image acquisition command in the voice control command; acquiring the target image according to the image acquisition command; performing processing on the target image according to the image processing algorithm, Processing result; determining the first operation that the intelligent robot needs to perform according to the processing result.
[0011] 进一步地, 响应于语音控制命令, 执行第一操作包括: 根据语音控制命令选择 待播放的音频文件; 对音频文件执行播放。  [0011] Further, in response to the voice control command, performing the first operation comprises: selecting an audio file to be played according to the voice control command; performing playback on the audio file.
[0012] 进一步地, 在响应于第一控制命令, 执行第一操作之后, 该用于智能机器人的 控制方法还包括: 检测目标用户的行为并生成与目标用户的行为对应的第二控 制命令, 其中, 第二控制命令为用于控制智能机器人执行第二操作的命令; 判 断第二控制命令与第一控制命令是否存在变化; 如果判断出第二控制命令与第 一控制命令存在变化, 根据第一控制命令和第二控制命令调整第一操作, 得到 第二操作, 响应于第二控制命令, 执行第二操作; 以及如果判断出第二控制命 令与第一控制命令不存在变化, 响应于第二控制命令执行第一操作。 [0012] Further, after performing the first operation in response to the first control command, the control method for the intelligent robot further includes: detecting a behavior of the target user and generating a second control command corresponding to the behavior of the target user, The second control command is a command for controlling the intelligent robot to perform the second operation; Determining whether there is a change between the second control command and the first control command; if it is determined that there is a change between the second control command and the first control command, adjusting the first operation according to the first control command and the second control command to obtain a second operation, the response And performing a second operation on the second control command; and performing a first operation in response to the second control command if it is determined that there is no change between the second control command and the first control command.
[0013] 为了实现上述目的, 根据本发明的另一方面, 还提供了一种用于智能机器人的 控制装置。 该用于智能机器人的控制装置包括: 检测单元, 用于检测目标用户 的行为并生成与目标用户的行为对应的第一控制命令, 其中, 第一控制命令为 用于控制智能机器人执行第一操作的命令, 目标用户为与智能机器人进行交互 的对象; 确定单元, 用于根据第一控制命令确定智能机器人需要执行的第一操 作; 执行单元, 用于响应于第一控制命令, 执行第一操作。  In order to achieve the above object, according to another aspect of the present invention, a control apparatus for an intelligent robot is also provided. The control device for the intelligent robot includes: a detecting unit, configured to detect a behavior of the target user and generate a first control command corresponding to the behavior of the target user, wherein the first control command is used to control the intelligent robot to perform the first operation The target user is an object that interacts with the intelligent robot; the determining unit is configured to determine, according to the first control command, a first operation that the intelligent robot needs to perform; and the executing unit, configured to perform the first operation in response to the first control command .
[0014] 进一步地, 检测单元用于检测目标用户的动作并生成与目标用户的动作对应的 动作控制命令, 确定单元用于根据动作控制命令确定智能机器人需要执行的第 一操作, 执行单元用于根据动作控制命令对智能机器人的当前状态进行切换, 响应于动作控制命令, 执行第一操作。  [0014] Further, the detecting unit is configured to detect an action of the target user and generate a motion control command corresponding to the action of the target user, where the determining unit is configured to determine, according to the motion control command, a first operation that the smart robot needs to perform, and the executing unit is configured to use The current state of the intelligent robot is switched according to the motion control command, and the first operation is performed in response to the motion control command.
[0015] 进一步地, 检测单元用于检测目标用户在智能机器人上产生的压力信号, 得到 压力数据, 确定单元用于根据压力数据确定智能机器人需要执行的第一操作。  [0015] Further, the detecting unit is configured to detect a pressure signal generated by the target user on the intelligent robot to obtain pressure data, and the determining unit is configured to determine, according to the pressure data, a first operation that the intelligent robot needs to perform.
[0016] 进一步地, 检测单元还用于在根据第一控制命令确定智能机器人需要执行的第 一操作之前, 检测智能机器人与周围物体之间产生的距离信号, 得到距离数据 , 确定单元还用于根据距离数据确定智能机器人需要执行的第一操作。  [0016] Further, the detecting unit is further configured to: before determining the first operation that the intelligent robot needs to perform according to the first control command, detecting a distance signal generated between the intelligent robot and the surrounding object to obtain distance data, where the determining unit is further used to The first operation that the intelligent robot needs to perform is determined based on the distance data.
[0017] 进一步地, 检测单元用于检测目标用户发出的语音并生成与目标用户发出的语 音对应的语音控制命令, 确定单元用于根据语音控制命令确定智能机器人需要 执行的第一操作, 执行单元用于响应于语音控制命令, 执行第一操作。  [0017] Further, the detecting unit is configured to detect a voice sent by the target user and generate a voice control command corresponding to the voice sent by the target user, where the determining unit is configured to determine, according to the voice control command, a first operation that the smart robot needs to perform, and the executing unit For performing a first operation in response to a voice control command.
[0018] 进一步地, 获取模块, 用于获取语音控制命令中的图像采集命令; 采集模块, 用于根据图像采集命令采集目标图像; 处理模块, 用于根据图像处理算法对目 标图像执行处理, 得到处理结果; 确定模块, 用于根据处理结果确定智能机器 人需要执行的第一操作。  [0018] Further, an acquiring module is configured to acquire an image capturing command in the voice control command, an acquiring module, configured to collect the target image according to the image capturing command, and a processing module, configured to perform processing on the target image according to the image processing algorithm, to obtain Processing result; determining module, configured to determine, according to the processing result, a first operation that the intelligent robot needs to perform.
[0019] 进一步地, 执行单元包括: 选择模块, 用于根据语音控制命令选择待播放的音 频文件; 播放模块, 用于对音频文件执行播放。 发明的有益效果 [0019] Further, the executing unit includes: a selecting module, configured to select an audio file to be played according to the voice control command; and a playing module, configured to perform playing on the audio file. Advantageous effects of the invention
有益效果  Beneficial effect
[0020] 通过本发明, 采用检测目标用户的行为并生成与目标用户的行为对应的第一控 制命令, 其中, 第一控制命令为用于控制智能机器人执行第一操作的命令, 目 标用户为与智能机器人进行交互的对象; 根据第一控制命令确定智能机器人需 要执行的第一操作; 以及响应于第一控制命令, 执行第一操作, 解决了智能机 器人无法根据人们的命令做出响应的问题, 进而达到了智能机器人根据人们的 命令做出响应的效果。  [0020] With the present invention, the first control command corresponding to the behavior of the target user is generated by detecting the behavior of the target user, wherein the first control command is a command for controlling the intelligent robot to perform the first operation, and the target user is An intelligent robot performs an interaction object; determining, according to the first control command, a first operation that the intelligent robot needs to perform; and performing a first operation in response to the first control command, solving a problem that the intelligent robot cannot respond according to a human command, In turn, the effect of the intelligent robot responding according to people's commands is achieved.
对附图的简要说明  Brief description of the drawing
附图说明  DRAWINGS
[0021] 构成本申请的一部分的附图用来提供对本发明的进一步理解, 本发明的示意性 实施例及其说明用于解释本发明, 并不构成对本发明的不当限定。 在附图中: [0022] 图 1是根据本发明第一实施例的用于智能机器人的控制方法的流程图;  [0021] The accompanying drawings, which are incorporated in FIG. In the drawings: [0022] FIG. 1 is a flowchart of a control method for an intelligent robot according to a first embodiment of the present invention;
[0023] 图 2是根据本发明第二实施例的用于智能机器人的控制方法的流程图; 2 is a flowchart of a control method for an intelligent robot according to a second embodiment of the present invention;
[0024] 图 3是根据本发明第三实施例的用于智能机器人的控制方法的流程图; 3 is a flowchart of a control method for an intelligent robot according to a third embodiment of the present invention;
[0025] 图 4是根据本发明第一实施例的用于智能机器人的控制装置的示意图; 4 is a schematic diagram of a control device for an intelligent robot according to a first embodiment of the present invention;
[0026] 图 5是根据本发明第二实施例的用于智能机器人的控制装置的示意图; 以及 [0027] 图 6是根据本发明第三实施例的用于智能机器人的控制装置的示意图。 5 is a schematic diagram of a control apparatus for an intelligent robot according to a second embodiment of the present invention; and FIG. 6 is a schematic diagram of a control apparatus for an intelligent robot according to a third embodiment of the present invention.
本发明的实施方式 Embodiments of the invention
[0028] 需要说明的是, 在不冲突的情况下, 本申请中的实施例及实施例中的特征可以 相互组合。 下面将参考附图并结合实施例来详细说明本发明。  [0028] It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be combined with each other. The invention will be described in detail below with reference to the drawings in conjunction with the embodiments.
[0029] 为了使本技术领域的人员更好地理解本申请方案, 下面将结合本申请实施例中 的附图, 对本申请实施例中的技术方案进行清楚、 完整地描述, 显然, 所描述 的实施例仅仅是本申请一部分的实施例, 而不是全部的实施例。 基于本申请中 的实施例, 本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其 他实施例, 都应当属于本申请保护的范围。 [0030] 需要说明的是, 本申请的说明书和权利要求书及上述附图中的术语"第一"、 " 第二"等是用于区别类似的对象, 而不必用于描述特定的顺序或先后次序。 应该 理解这样使用的数据在适当情况下可以互换, 以便这里描述的本申请的实施例 。 此外, 术语"包括"和"具有"以及他们的任何变形, 意图在于覆盖不排他的包含 , 例如, 包含了一系列步骤或单元的过程、 方法、 系统、 产品或设备不必限于 清楚地列出的那些步骤或单元, 而是可包括没有清楚地列出的或对于这些过程 、 方法、 产品或设备固有的其它步骤或单元。 The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. The embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope should fall within the scope of the present application. [0030] It should be noted that the terms "first", "second" and the like in the specification and claims of the present application and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or Prioritization. It should be understood that the data so used may be interchanged where appropriate to enable the embodiments of the present application described herein. In addition, the terms "comprises" and "comprising" and "comprises" and "the" are intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to Those steps or units may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.
[0031] 本发明实施例提供了一种用于智能机器人的控制方法。  [0031] Embodiments of the present invention provide a control method for an intelligent robot.
[0032] 图 1是根据本发明第一实施例的用于智能机器人的控制方法的流程图。 如图 1所 示, 该用于智能机器人的控制方法包括以下步骤:  1 is a flow chart of a control method for an intelligent robot according to a first embodiment of the present invention. As shown in FIG. 1, the control method for the intelligent robot includes the following steps:
[0033] 步骤 S101, 检测目标用户的行为并生成与目标用户的行为对应的第一控制命令 [0033] Step S101: detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user
[0034] 目标用户为与智能机器人进行交互的对象, 目标用户可以与智能机器人进行语 音上的交互或者动作上的交互等。 比如, 目标用户呼唤智能机器人, 智能机器 人根据目标用户的语音朝向目标用户的方向运动, 再比如, 目标用户抚摸或者 拍打机器人, 机器人根据目标用户的动作做出回应。 在目标用户与智能机器人 交互吋, 对目标用户的行为进行检测, 确定目标用户是否发出语音, 或者是否 有针对于智能机器人的行为动作。 当检测到目标用户的行为吋, 生成与目标用 户的行为对应的第一控制命令, 该第一控制命令为用于控制智能机器人执行第 一操作的命令, 为实现目标用户的需求的命令, 比如, 目标用户对智能机器人 发出语音, 生成与目标用户发出的语音对应的第一控制命令, 以控制智能机器 人执行第一操作, 满足目标用户的需求, 目标用户对智能机器人施加动作, 生 成与目标用户施加的动作对应的第一控制命令, 以控制智能机器人执行第一操 作, 满足目标用户的需求。 [0034] The target user is an object that interacts with the intelligent robot, and the target user can perform a voice interaction or an action interaction with the intelligent robot. For example, the target user calls the intelligent robot, and the intelligent robot moves toward the target user according to the target user's voice. For example, the target user strokes or taps the robot, and the robot responds according to the target user's motion. After the target user interacts with the intelligent robot, the behavior of the target user is detected, whether the target user emits a voice, or whether there is a behavior action for the intelligent robot. When the behavior of the target user is detected, generating a first control command corresponding to the behavior of the target user, the first control command being a command for controlling the intelligent robot to perform the first operation, and a command for realizing the demand of the target user, for example The target user issues a voice to the intelligent robot, generates a first control command corresponding to the voice issued by the target user, to control the intelligent robot to perform the first operation, and meets the target user's needs, and the target user applies an action to the intelligent robot to generate and target the user. The applied action corresponds to the first control command to control the intelligent robot to perform the first operation to meet the needs of the target user.
[0035] 可选地, 当目标用户的行为为发出语音吋, 通过语音模块接收语音数据, 再将 该语音数据通过 UART串口传输至主控模块, 主控模块对语音数据进一步处理; 当目标用户的行为为发出动作吋, 采集目标用户的动作产生的动作数据, 将该 动作数据通过 UART传输至主控模块, 主控模块对动作数据进一步处理。 [0036] 可选地, 采集传感信号生成第一控制命令, 可以同吋采集多路传感信号生成该 第一控制命令。 [0035] Optionally, when the behavior of the target user is voice, the voice data is received by the voice module, and the voice data is transmitted to the main control module through the UART serial port, and the main control module further processes the voice data; The action is to generate action data, collect action data generated by the action of the target user, and transmit the action data to the main control module through the UART, and the main control module further processes the action data. [0036] Optionally, the acquiring the sensing signal generates a first control command, and the first control command may be generated by acquiring the multiple sensing signals.
[0037] 检测目标用户的行为并生成与目标用户的行为对应的第一控制命令, 实现了智 能机器人接收外界信息。  [0037] detecting the behavior of the target user and generating a first control command corresponding to the behavior of the target user, so that the intelligent robot receives the external information.
[0038] 步骤 S 102, 根据第一控制命令确定智能机器人需要执行的第一操作。  [0038] Step S102: Determine, according to the first control command, a first operation that the intelligent robot needs to perform.
[0039] 在检测目标用户的行为并生成与目标用户的行为对应的第一控制命令之后, 根 据第一控制命令确定智能机器人需要执行的第一操作, 也即, 根据第一控制命 令进行决策, 进而确定智能机器人需要执行什么第一操作, 比如, 执行图像采 集的第一操作, 执行状态切换的第一操作, 执行播放音频文件的第一操作, 执 行连续走动的第一操作, 执行与运动控制模块进行通讯的第一操作等。 该智能 机器人可以为家庭智能机器人。  [0039] after detecting the behavior of the target user and generating a first control command corresponding to the behavior of the target user, determining, according to the first control command, a first operation that the intelligent robot needs to perform, that is, making a decision according to the first control command, Further determining what first operation the intelligent robot needs to perform, for example, performing a first operation of image acquisition, performing a first operation of state switching, performing a first operation of playing an audio file, performing a first operation of continuous walking, performing and motion control The first operation of the module for communication, etc. The intelligent robot can be a home smart robot.
[0040] 可选地, 主控模块对第一控制命令进行处理, 得到处理结果, 比如, 当第一控 制命令中有图像采集命令吋, 对第一控制命令按照图像采集算法进行处理, 得 到处理结果, 当第一控制命令为人们对智能机器人进行抚摸或者拍打产生的压 力信号吋, 或者为智能机器人在行走过程中与周围物体的距离信号吋, 通过 UA RT串口采集数据并传输至主控模块, 主控模块对该数据进行转化, 得到处理结 果。 根据处理结果确定家庭能够智能机器人需要执行的第一操作。  [0040] Optionally, the main control module processes the first control command to obtain a processing result. For example, when there is an image acquisition command in the first control command, the first control command is processed according to the image acquisition algorithm, and is processed. As a result, when the first control command is a pressure signal generated by a person touching or tapping the intelligent robot, or a distance signal from the surrounding object during the walking of the intelligent robot, the data is collected through the UA RT serial port and transmitted to the main control module. The main control module converts the data and obtains the processing result. The first operation that the family can perform the intelligent robot is determined according to the processing result.
[0041] 根据第一控制命令确定智能机器人需要执行的第一操作实现了智能机器人在接 收外界信息之后, 根据外界信息做出合理的决策。  [0041] determining, according to the first control command, the first operation that the intelligent robot needs to perform realizes that the intelligent robot makes a reasonable decision according to the external information after receiving the external information.
[0042] 步骤 S 103, 响应于第一控制命令, 执行第一操作。  [0042] Step S103: Perform a first operation in response to the first control command.
[0043] 在根据第一控制命令确定智能机器人需要执行的第一操作之后, 响应于第一控 制命令, 执行根据第一控制命令确定的第一操作, 提高了智能机器人跟目标用 户的交互量, 根据目标用户的需求做出相应的响应, 达到了智能机器人根据人 们的命令做出响应的效果。  [0043] after determining, according to the first control command, the first operation that the intelligent robot needs to perform, performing the first operation determined according to the first control command in response to the first control command, increasing the amount of interaction between the intelligent robot and the target user, According to the needs of the target users, the corresponding response is achieved, and the effect of the intelligent robot responding according to people's commands is achieved.
[0044] 该实施例通过检测目标用户的行为并生成与目标用户的行为对应的第一控制命 令, 其中, 第一控制命令为用于控制智能机器人执行第一操作的命令, 目标用 户为与智能机器人进行交互的对象; 根据第一控制命令确定智能机器人需要执 行的第一操作; 响应于第一控制命令, 执行第一操作, 达到了智能机器人根据 人们的命令做出响应的效果。 [0044] The embodiment detects the behavior of the target user and generates a first control command corresponding to the behavior of the target user, wherein the first control command is a command for controlling the intelligent robot to perform the first operation, and the target user is the smart An object that the robot interacts with; determining, according to the first control command, a first operation that the intelligent robot needs to perform; performing the first operation in response to the first control command, reaching the intelligent robot according to the The effect of people's commands responding.
[0045] 作为一种可选的实施方式, 检测目标用户的行为并生成与目标用户的行为对应 的第一控制命令包括: 检测目标用户的动作并生成与目标用户的动作对应的动 作控制命令, 根据第一控制命令确定智能机器人需要执行的第一操作包括: 根 据动作控制命令确定智能机器人需要执行的第一操作, 响应于第一控制命令, 执行第一操作包括: 根据动作控制命令对智能机器人的当前状态进行切换, 响 应于动作控制命令, 执行第一操作。  [0045] As an optional implementation manner, detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user includes: detecting an action of the target user and generating an action control command corresponding to the action of the target user, Determining, according to the first control command, the first operation that the intelligent robot needs to perform comprises: determining, according to the motion control command, a first operation that the intelligent robot needs to perform, and in response to the first control command, performing the first operation, comprising: the intelligent robot according to the motion control command The current state is switched, and the first operation is performed in response to the action control command.
[0046] 检测目标用户的行为, 可以检测目标用户的动作, 比如, 检测目标用户抚摸智 能机器人或者拍打智能机器人的动作。 生成与目标用户的动作对应的动作控制 命令可以为当检测到目标用户抚摸智能机器人吋, 生成用于发出幵心的叫声和 舒服动作的动作控制命令, 根据该动作控制命令确定智能机器人需要执行发出 幵心的叫声和舒服的动作的第一操作, 根据该动作控制命令对智能机器人的当 前状态进行切换, 响应于该动作控制命令发出幵心的叫声和舒服的动作的第一 操作。 在根据该动作控制命令对智能机器人的当前状态进行切换之后, 还可以 响应于第一控制命令执行连续走动的第一操作, 或者在完成一个动作之后与运 动控制模块进行通讯。  [0046] Detecting the behavior of the target user, the action of the target user can be detected, for example, detecting the action of the target user touching the smart robot or tapping the intelligent robot. Generating a motion control command corresponding to the action of the target user may be: when detecting that the target user touches the smart robot, generating an action control command for issuing a call and a comfortable action, and determining, according to the action control command, that the smart robot needs to execute A first operation of issuing a squeaking sound and a comfortable motion, switching a current state of the intelligent robot according to the motion control command, and issuing a first operation of the scream and the comfortable motion in response to the motion control command. After switching the current state of the intelligent robot according to the motion control command, the first operation of continuously walking may be performed in response to the first control command, or may be communicated with the motion control module after completing an action.
[0047] 作为一种可选的实施方式, 检测目标用户的动作并生成与目标用户的动作对应 的动作控制命令包括: 检测目标用户在智能机器人上产生的压力信号, 得到压 力数据, 根据动作控制命令确定智能机器人需要执行的第一操作包括: 根据压 力数据确定智能机器人需要执行的第一操作。  [0047] As an optional implementation manner, detecting an action of the target user and generating a motion control command corresponding to the action of the target user includes: detecting a pressure signal generated by the target user on the intelligent robot, obtaining pressure data, and controlling according to the action The command determines the first operation that the intelligent robot needs to perform includes: determining, according to the pressure data, the first operation that the intelligent robot needs to perform.
[0048] 目标用户在智能机器人上施加压力, 产生压力信号, 力敏模块会根据压力信号 判断力度的大小从而产生不同的压力数据, 比如, 目标用户对智能机器人进行 拍打, 抚摸等动作吋具有不同的力度, 力敏模块会根据不同力度的动作检测出 不同的压力数据。 主控模块根据力敏模块检测到的压力数据确定目标用户对智 能机器人进行拍打还是抚摸等动作, 从而决策出智能机器人需要执行的第一操 作。 比如, 当目标用户抚摸智能机器人吋, 力敏模块根据力度的大小产生压力 数据, 智能机器人会决策发出幵心的叫声和舒服的动作, 使人们感受到智能机 器人的智能化, 从而使人们对智能机器人产生喜欢和依赖的感情。 [0049] 作为一种可选的实施方式, 在根据第一控制命令确定智能机器人需要执行的第 一操作之前, 检测智能机器人与周围物体之间产生的距离信号, 得到距离数据 , 根据第一控制命令确定智能机器人需要执行的第一操作包括: 根据距离数据 确定智能机器人需要执行的第一操作。 [0048] The target user applies pressure on the intelligent robot to generate a pressure signal, and the force sensitive module determines the magnitude of the force according to the pressure signal to generate different pressure data. For example, the target user taps the smart robot, and the strokes and the like have different actions. The strength of the force sensitive module will detect different pressure data according to the action of different strengths. The main control module determines, according to the pressure data detected by the force sensitive module, the target user to tap or stroke the intelligent robot, thereby determining the first operation that the intelligent robot needs to perform. For example, when the target user touches the intelligent robot, the force sensitive module generates pressure data according to the magnitude of the force, and the intelligent robot will make a sounding call and a comfortable motion, so that people can feel the intelligence of the intelligent robot, thereby making people Intelligent robots generate feelings of love and dependence. [0049] As an optional implementation manner, before determining the first operation that the intelligent robot needs to perform according to the first control command, detecting a distance signal generated between the intelligent robot and the surrounding object, and obtaining distance data, according to the first control The command determining the first operation that the intelligent robot needs to perform includes: determining, according to the distance data, a first operation that the intelligent robot needs to perform.
[0050] 在根据第一控制命令确定智能机器人需要执行的第一操作之前, 检测智能机器 人与周围物体之间产生的距离信号, 得到距离数据, 可以通过测距模块测量距 离信号得到距离数据。 机器人在行走的过程中与周围物体之间产生距离信号, 机器人根据该距离信号判断周围的障碍物进而确定避幵障碍物的避障行为。 可 选地, 目标用户呼唤智能机器人, 智能机器人会朝着目标用户的方向前进, 并 且根据距离信号的变化判断障碍物的远近进而进行避障行为等操作。  [0050] Before determining the first operation that the intelligent robot needs to perform according to the first control command, detecting a distance signal generated between the smart robot and the surrounding object to obtain distance data, and obtaining the distance data by measuring the distance signal by the ranging module. The robot generates a distance signal between the object and the surrounding object during the walking process, and the robot determines the obstacles around the distance according to the distance signal to determine the obstacle avoidance behavior of the obstacle avoiding obstacle. Alternatively, the target user calls for the intelligent robot, and the intelligent robot advances toward the target user, and judges the distance of the obstacle according to the change of the distance signal to perform obstacle avoidance behavior and the like.
[0051] 作为一种可选的实施方式, 检测目标用户的行为并生成与目标用户的行为对应 的第一控制命令包括: 检测目标用户发出的语音并生成与目标用户发出的语音 对应的语音控制命令, 根据第一控制命令确定智能机器人需要执行的第一操作 包括: 根据语音控制命令确定智能机器人需要执行的第一操作, 响应于第一控 制命令, 执行第一操作包括: 响应于语音控制命令, 执行第一操作。  [0051] As an optional implementation manner, detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user includes: detecting a voice sent by the target user and generating voice control corresponding to the voice sent by the target user The command, determining, according to the first control command, the first operation that the intelligent robot needs to perform includes: determining, according to the voice control command, a first operation that the intelligent robot needs to perform, and in response to the first control command, performing the first operation includes: responding to the voice control command , perform the first operation.
[0052] 检测目标用户的行为可以为检测目标用户发出的语音, 目标用户发出的语音可 以为命令智能机器人执行第一操作的命令。 根据语音控制命令确定智能机器人 需要执行的第一操作, 比如, 目标用户呼唤智能机器人, 检测目标用户呼唤智 能机器人的语音, 生成与目标用户发出的语音对应的语音控制命令, 该语音控 制命令可以为控制智能机器人朝向目标用户的方向前进的第一控制命令, 智能 机器人响应于该语音控制命令, 执行朝向目标用户的方向前进的第一操作, 从 而满足目标用户的需求, 提高了目标用户和智能机器人之间的交互量, 使家庭 智能机器人接收外界信息, 并做出合适的决策, 响应于目标用户的需求, 使人 们产生感情寄托。  [0052] Detecting the behavior of the target user may be detecting a voice uttered by the target user, and the voice uttered by the target user may be a command to command the intelligent robot to perform the first operation. Determining, according to the voice control command, a first operation that the intelligent robot needs to perform, for example, the target user calls the intelligent robot, detects that the target user calls the voice of the intelligent robot, and generates a voice control command corresponding to the voice sent by the target user, and the voice control command may be a first control command for controlling the intelligent robot to advance toward the target user, and the intelligent robot performs a first operation toward the target user in response to the voice control command, thereby satisfying the target user's demand, and improving the target user and the intelligent robot The amount of interaction between the home intelligence robots receives external information and makes appropriate decisions, in response to the needs of the target users, to make people feel emotional.
[0053] 作为一种可选的实施方式, 根据语音控制命令确定智能机器人需要执行的第一 操作包括: 根据语音控制命令确定智能机器人需要执行的第一操作包括: 获取 语音控制命令中的图像采集命令; 根据图像采集命令采集目标图像; 根据图像 处理算法对目标图像执行处理, 得到处理结果; 以及根据处理结果确定智能机 器人需要执行的第一操作。 [0053] As an optional implementation manner, determining, according to the voice control command, the first operation that the intelligent robot needs to perform includes: determining, according to the voice control command, the first operation that the intelligent robot needs to perform, including: acquiring image collection in the voice control command Command; acquiring a target image according to an image acquisition command; performing processing on the target image according to the image processing algorithm, obtaining a processing result; and determining the smart machine according to the processing result The first action that the person needs to perform.
[0054] 判断语音控制命令中是否有用于图像采集的图像采集命令; 如果判断出语音控 制中有图像采集命令, 获取语音控制命令中的图像采集命令, 可以调用图像采 集模块采集目标图像, 比如, 采集人脸图像, 物体图像, 动态图像等, 将采集 的图像数据通过 USB接口传入主控模块, 经过图像处理算法得到处理结果, 比如 , 得到人脸图像的处理结果, 物体图像的处理结果, 动态追踪图像的处理结果 等, 将处理结果放入主控决策队列中, 根据处理结果确定智能机器人需要执行 的第一操作, 其中, 图像采集模块可以为摄像头。 可选地, 如果判断出语音控 制命令中没有用于图像采集的图像采集命令, 则不调用图像采集模块采集图像  [0054] determining whether there is an image acquisition command for image acquisition in the voice control command; if it is determined that there is an image acquisition command in the voice control, and acquiring an image acquisition command in the voice control command, the image acquisition module may be called to collect the target image, for example, Collecting face images, object images, moving images, etc., passing the collected image data to the main control module through the USB interface, and obtaining the processing result through the image processing algorithm, for example, obtaining the processing result of the face image, the processing result of the object image, Dynamically tracking the processing result of the image, etc., placing the processing result into the main control decision queue, and determining the first operation that the intelligent robot needs to perform according to the processing result, wherein the image acquisition module can be a camera. Optionally, if it is determined that there is no image acquisition command for image acquisition in the voice control command, the image acquisition module is not called to collect the image.
[0055] 作为一种可选的实施方式, 响应于语音控制命令, 执行第一操作包括: 根据语 音控制命令选择待播放的音频文件; 对音频文件执行播放。 [0055] As an optional implementation manner, in response to the voice control command, performing the first operation includes: selecting an audio file to be played according to the voice control command; performing playback on the audio file.
[0056] 根据语音控制命令选择待播放的音频文件, 对音频文件执行播放的第一操作在 音频播放线程中完成。 [0056] The audio file to be played is selected according to the voice control command, and the first operation of performing playback on the audio file is completed in the audio play thread.
[0057] 作为一种可选的实施方式, 在响应于第一控制命令, 执行第一操作之后, 检测 目标用户的行为并生成与目标用户的行为对应的第二控制命令, 其中, 第二控 制命令为用于控制智能机器人执行第二操作的命令; 判断第二控制命令与第一 控制命令是否存在变化; 如果判断出第二控制命令与第一控制命令存在变化, 根据第一控制命令和第二控制命令调整第一操作, 得到第二操作, 响应于第二 控制命令, 执行第二操作; 以及如果判断出第二控制命令与第一控制命令不存 在变化, 响应于第二控制命令执行第一操作。  [0057] As an optional implementation manner, after performing the first operation in response to the first control command, detecting a behavior of the target user and generating a second control command corresponding to the behavior of the target user, where the second control The command is a command for controlling the intelligent robot to perform the second operation; determining whether there is a change between the second control command and the first control command; if it is determined that the second control command and the first control command are changed, according to the first control command and the The second control command adjusts the first operation to obtain a second operation, and in response to the second control command, performs a second operation; and if it is determined that the second control command and the first control command do not change, the second control command is executed in response to the second control command An operation.
[0058] 在该实施例中, 不断检测机器人与目标用户的交互行为, 并生成控制指令。 在 根据第一控制命令确定智能机器人需要执行的第一操作之后, 检测当前机器人 与目标用户的交互行为并生成第二控制命令, 主控模块可以判断第二控制命令 与第一控制命令是否存在变化, 继而进行调整。 如果判断出第二控制命令与第 一控制命令存在变化, 根据第一控制命令和第二控制命令调整第一操作, 得到 第二操作, 响应于第二控制命令, 执行第二操作, 如果判断出第二控制命令与 第一控制命令不存在变化, 响应于第二控制命令, 继续执行第一操作, 从而实 现根据第二控制命令的变化在决策中及吋进行调整, 做出播放音频或者不同的 动作来响应于人们的不同操作, 使人们对智能机器人感觉生动而不乏味。 判断 第一控制命令是否发生变化; 如果判断出第一控制命令发生变化, 调整第一控 制命令, 得到调整第一控制命令; 根据调整第一控制命令进而确定智能机器人 需要执行的第一操作, 从而达到了智能机器人根据人们的命令做出响应的效果 [0058] In this embodiment, the interaction behavior of the robot with the target user is continuously detected, and a control command is generated. After determining the first operation that the intelligent robot needs to perform according to the first control command, detecting an interaction behavior between the current robot and the target user, and generating a second control command, the main control module may determine whether there is a change between the second control command and the first control command. , and then adjust. If it is determined that there is a change between the second control command and the first control command, adjusting the first operation according to the first control command and the second control command to obtain a second operation, and performing a second operation in response to the second control command, if it is determined The second control command and the first control command do not change, and in response to the second control command, continue to perform the first operation, thereby Now, according to the change of the second control command, the adjustment is made in the decision, and the audio or different actions are played to respond to different operations of the people, so that people feel vivid and not boring to the intelligent robot. Determining whether the first control command changes; if it is determined that the first control command changes, adjusting the first control command, obtaining an adjustment first control command; determining the first operation that the intelligent robot needs to perform according to adjusting the first control command, thereby Achieved the effect of intelligent robots responding according to people's orders
[0059] 下面结合优选的实施例对本发明的技术方案进行说明。 [0059] The technical solution of the present invention will be described below in conjunction with preferred embodiments.
[0060] 图 2是根据本发明第二实施例的用于智能机器人的控制方法的流程图。 如图 2所 示, 该用于智能机器人的控制方法包括以下步骤:  2 is a flow chart of a control method for an intelligent robot according to a second embodiment of the present invention. As shown in FIG. 2, the control method for the intelligent robot includes the following steps:
[0061] 步骤 S201 , 生成第一控制命令。 [0061] Step S201: Generate a first control command.
[0062] 检测目标用户的行为并生成与目标用户的行为对应的第一控制命令, 采集与第 一控制命令对应的控制数据, 比如, 运动控制数据, 语音数据, 图像数据, 压 力数据, 距离数据, 音频数据等, 可以通过运动控制模块采集运动控制数据, 通过语音模块采集语音数据, 通过图像采集模块采集图像数据, 通过力敏模块 采集压力数据, 通过测距模块采集距离数据, 通过音频模块采集音频数据。 运 动控制模块, 图像采集模块, 语音模块, 力敏模块, 测距模块, 音频模块通过 U ART接口和主控模块通信, 音频播放模块通过 audio接口与主控模块通信, 图像 采集模块通过 USB接口与主控模块连接通信, 主控模块通过 UART和 USB接口接 收各类传感器采集的控制数据, 根据控制数据生成第一控制命令。  [0062] detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user, and collecting control data corresponding to the first control command, for example, motion control data, voice data, image data, pressure data, distance data , audio data, etc., can collect motion control data through the motion control module, collect voice data through the voice module, collect image data through the image acquisition module, collect pressure data through the force sensitive module, collect distance data through the distance measuring module, and collect through the audio module Audio data. The motion control module, the image acquisition module, the voice module, the force sensitive module, the ranging module, the audio module communicate with the main control module through the U ART interface, and the audio playback module communicates with the main control module through the audio interface, and the image acquisition module communicates with the main control module through the USB interface. The main control module is connected to communicate, and the main control module receives control data collected by various sensors through the UART and the USB interface, and generates a first control command according to the control data.
[0063] 步骤 S202, 对第一控制命令执行处理, 得到处理结果。  [0063] Step S202, performing processing on the first control command, and obtaining a processing result.
[0064] 在生成第一控制命令之后, 对第一控制命令执行处理, 比如, 对通过图像采集 模块采集的图像数据按照图像处理算法进行处理, 得到处理结果, 对通过力敏 模块采集的压力数据进行数据转换, 得到处理结果, 将处理结果放入智能机器 人的决策队列中。  [0064] after the first control command is generated, performing processing on the first control command, for example, processing the image data collected by the image acquisition module according to an image processing algorithm, and obtaining a processing result, and acquiring pressure data collected by the force sensitive module. Data conversion is performed, the processing result is obtained, and the processing result is placed in the decision queue of the intelligent robot.
[0065] 步骤 S203 , 确定智能机器人需要执行的第一操作。  [0065] Step S203: Determine a first operation that the intelligent robot needs to perform.
[0066] 在采集控制数据之后, 可以直接通过控制数据确定智能机器人需要执行的第一 操作, 也可以在对控制数据执行处理, 得到处理结果之后, 确定智能机器人需 要执行的第一操作。 [0067] 步骤 S204, 响应于第一控制命令, 执行第一操作。 [0066] After the control data is collected, the first operation that the intelligent robot needs to perform may be directly determined by the control data, or the first operation that the intelligent robot needs to perform may be determined after the processing is performed on the control data to obtain the processing result. [0067] Step S204, executing the first operation in response to the first control command.
[0068] 在确定智能机器人需要执行的第一操作之后, 响应于控制数据对应的第一控制 命令, 执行第一操作。  [0068] After determining the first operation that the intelligent robot needs to perform, the first operation is performed in response to the first control command corresponding to the control data.
[0069] 该实施例于提出一种智能机器人的决策模型, 使机器人能够接收多种外界信息 , 并对多种外界信息进行处理、 决策以做出合适的响应, 使人们对机器人的感 觉不再那么死板。 该决策模型包括主控模块、 运动控制模块、 语音模块、 图像 采集模块、 力敏模块、 测距模块、 音频播放模块和各类传感器的接口。 语音模 块、 运动控制模块、 力敏模块和测距模块通过 UART接口与主控模块连接通信; 音频播放模块通过 audio接口与主控模块连接通信; 图像采集模块通过 USB接口 与主控模块连接通信。 主控模块通过 UART和 USB接口接收各类传感器采集的控 制数据, 然后控制数据进行处理, 得到处理结果, 再对处理结果进行决策, 输 出相应的动作和声音, 达到了智能机器人根据人们的命令做出响应的效果。  [0069] This embodiment proposes a decision model of an intelligent robot, which enables the robot to receive a variety of external information, and processes and makes decisions on various external information to make an appropriate response, so that people feel no longer to the robot. Then rigid. The decision model includes an interface of a main control module, a motion control module, a voice module, an image acquisition module, a force sensitive module, a ranging module, an audio playback module, and various types of sensors. The voice module, the motion control module, the force sensitive module and the ranging module communicate with the main control module through the UART interface; the audio playback module communicates with the main control module through the audio interface; and the image acquisition module communicates with the main control module through the USB interface. The main control module receives the control data collected by various sensors through the UART and the USB interface, and then controls the data for processing, obtains the processing result, and then makes a decision on the processing result, and outputs corresponding actions and sounds, and the intelligent robot is made according to the commands of the people. The effect of the response.
[0070] 图 3是根据本发明第三实施例的用于智能机器人的控制方法的流程图。 如图 3所 示, 该用于智能机器人的控制方法包括以下步骤:  3 is a flow chart of a control method for an intelligent robot according to a third embodiment of the present invention. As shown in FIG. 3, the control method for the intelligent robot includes the following steps:
[0071] 步骤 S301, 检测目标用户的行为并生成与目标用户的行为对应的第一控制命令  [0071] step S301, detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user
[0072] 检测目标用户的行为并生成与目标用户的行为对应的第一控制命令, 可以通过 UART串口接收语音数据、 压力数据、 距离数据等, 生成与目标用户的行为对应 的第一控制命令。 [0072] detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user, and receiving voice data, pressure data, distance data, and the like through the UART serial port, and generating a first control command corresponding to the behavior of the target user.
[0073] 步骤 S302, 根据第一控制命令确定智能机器人需要执行的第一操作。  [0073] Step S302: Determine, according to the first control command, a first operation that the intelligent robot needs to perform.
[0074] 在检测目标用户的行为并生成与目标用户的行为对应的第一控制命令之后, 进 行决策, 通过第一控制命令确定智能机器人需要执行的第一操作。  [0074] After detecting the behavior of the target user and generating a first control command corresponding to the behavior of the target user, the decision is made to determine, by the first control command, the first operation that the intelligent robot needs to perform.
[0075] 步骤 S303, 图像采集。 [0075] Step S303, image acquisition.
[0076] 在根据第一控制命令确定智能机器人需要执行的第一操作之后, 当第一控制命 令中涉及到图像采集命令吋, 启动图像采集功能, 可以调用摄像头采集图像。 图像采集在图像采集处理线程中进行处理。  [0076] After determining the first operation that the intelligent robot needs to perform according to the first control command, when the image acquisition command is involved in the first control command, the image acquisition function is started, and the camera may be called to acquire an image. Image acquisition is processed in the image acquisition processing thread.
[0077] 步骤 S304, 对图像识别。  [0077] Step S304, identifying the image.
[0078] 在图像采集之后, 可以进行对图像进行识别。 可选地, 可以识别人脸, 物体等 。 对图像识别在图像采集处理线程中进行处理。 [0078] After image acquisition, an image may be identified. Optionally, you can recognize faces, objects, etc. . Image recognition is processed in the image acquisition processing thread.
[0079] 步骤 S305, 根据第一控制命令选择播放音频文件。  [0079] Step S305, selecting to play the audio file according to the first control command.
[0080] 在根据第一控制命令确定智能机器人需要执行的第一操作之后, 当第一控制命 令中涉及到语音命令吋, 根据第一控制命令选择播放音频文件。 根据第一控制 命令选择播放音频文件在音频播放线程中进行处理。  [0080] After determining the first operation that the intelligent robot needs to perform according to the first control command, when the voice command is involved in the first control command, the audio file is selected to be played according to the first control command. The playback audio file is selected to be processed in the audio playback thread according to the first control command.
[0081] 步骤 S306, 调用状态机实现状态切换。  [0081] Step S306, the state machine is called to implement state switching.
[0082] 在根据第一控制命令确定智能机器人需要执行的第一操作之后, 调用状态机实 现状态切换, 比如, 智能机器人的扭头, 弯腰, 跑步等状态切换等。  [0082] After determining the first operation that the intelligent robot needs to perform according to the first control command, the state machine is called to implement state switching, for example, the smart robot's twisting, bending, running, etc. state switching.
[0083] 步骤 S307, 组合单步, 实现连续走动。 [0083] Step S307, combining single steps to achieve continuous walking.
[0084] 在调用状态机实现状态切换之后, 可以在走步状态机中组合单步, 实现智能机 器人连续走动。  [0084] After the state machine is called to implement state switching, a single step can be combined in the walking state machine to realize continuous walking of the intelligent robot.
[0085] 步骤 S308, 完成一个动作, 与运动控制模块执行通讯。  [0085] Step S308, completing an action to perform communication with the motion control module.
[0086] 在调用状态机实现状态切换之后, 完成一个动作, 可以与运动控制模块执行通 讯。 与运动控制模块执行通讯在动作状态机中进行。  [0086] After the state machine is called to implement state switching, an action is completed and communication with the motion control module can be performed. Performing communication with the motion control module takes place in the action state machine.
[0087] 步骤 S309, 延吋。 [0087] Step S309, delaying.
[0088] 在调用状态机实现状态切换之后, 进行延吋, 延吋吋间为毫秒级别。 在延吋吋 间到达之后, 重新执行步骤 S301, 检测目标用户的行为并生成与目标用户的行 为对应的第一控制命令。  [0088] After the state machine is called to implement the state switching, the delay is performed, and the delay is in the millisecond level. After the delay arrives, step S301 is re-executed to detect the behavior of the target user and generate a first control command corresponding to the behavior of the target user.
[0089] 目标用户对智能机器人的命令由语音模块接收, 通过 UART串口传入主控模块 。 如果命令中涉及到图像采集则会调用摄像头采集图像通过 USB接口传入主控模 块, 经过图像处理算法得到处理结果放入主控决策队列中。 人们对智能机器人 抚摸或者拍打而产生的压力信号以及智能机器人在行走的过程中对周围物体的 距离信号通过 UART串口将采集到的数据传入主控模块, 经过数据转换将转换结 果放入决策队列中。 主控模块根据当前输入数据的变化在决策中及吋调整, 做 出播放音频或者不同的动作来响应人们的不同第一操作, 使人们感觉到生动不 会乏味, 比如, 人们轻轻地抚摸机器人, 力敏模块会根据力度的大小产生不同 的压力值, 机器人会决策发出幵心的叫声和舒服的动作, 人们呼唤智能机器人 , 机器人会朝着人们的方向前进, 并且根据距离信号的变化判断障碍物进行避 障行为等, 使人们感受到机器人智能而不死板, 从而产生喜欢和依赖的感情, 达到了智能机器人根据人们的命令做出响应的效果。 [0089] The command of the target user to the intelligent robot is received by the voice module, and is transmitted to the main control module through the UART serial port. If the image acquisition is involved in the command, the camera capture image is transmitted to the main control module through the USB interface, and the image processing algorithm is used to process the result into the main control decision queue. The pressure signal generated by the intelligent robot touching or tapping and the distance signal of the intelligent robot to the surrounding objects during the walking process are transmitted to the main control module through the UART serial port, and the conversion result is put into the decision queue through data conversion. in. The main control module adjusts and adjusts according to the change of the current input data, and plays audio or different actions to respond to different first operations of the people, so that people feel vivid and not boring, for example, people gently touch the robot The force sensitive module will generate different pressure values according to the magnitude of the force. The robot will make a scream and a comfortable movement. People call the intelligent robot. The robot will move toward the direction of the people and judge according to the change of the distance signal. Obstacle avoidance Obstacle behavior, etc., make people feel the robot intelligence and not rigid, thus generating feelings of like and dependence, and achieving the effect that the intelligent robot responds according to people's commands.
[0090] 需要说明的是, 在附图的流程图示出的步骤可以在诸如一组计算机可执行指令 的计算机系统中执行, 并且, 虽然在流程图中示出了逻辑顺序, 但是在某些情 况下, 可以以不同于此处的顺序执行所示出或描述的步骤。  [0090] It should be noted that the steps shown in the flowchart of the accompanying drawings may be performed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some In this case, the steps shown or described may be performed in a different order than the ones described herein.
[0091] 本发明实施例还提供了一种用于智能机器人的控制装置。 需要说明的是, 该实 施例的用于智能机器人的控制装置可以用于执行本发明实施例的用于智能机器 人的控制方法。  [0091] Embodiments of the present invention also provide a control apparatus for an intelligent robot. It is to be noted that the control device for the intelligent robot of this embodiment can be used to execute the control method for the intelligent robot of the embodiment of the present invention.
[0092] 图 4是根据本发明第一实施例的用于智能机器人的控制装置的示意图。 如图 4所 示, 该用于智能机器人的控制装置包括: 检测单元 10, 确定单元 20和执行单元 3 0。  4 is a schematic diagram of a control device for an intelligent robot according to a first embodiment of the present invention. As shown in Fig. 4, the control device for the intelligent robot comprises: a detecting unit 10, a determining unit 20 and an executing unit 30.
[0093] 检测单元 10, 用于检测目标用户的行为并生成与目标用户的行为对应的第一控 制命令, 其中, 第一控制命令为用于控制智能机器人执行第一操作的命令, 目 标用户为与智能机器人进行交互的对象。  [0093] The detecting unit 10 is configured to detect a behavior of the target user and generate a first control command corresponding to the behavior of the target user, where the first control command is a command for controlling the intelligent robot to perform the first operation, and the target user is An object that interacts with an intelligent robot.
[0094] 确定单元 20, 用于根据第一控制命令确定智能机器人需要执行的第一操作。  [0094] The determining unit 20 is configured to determine, according to the first control command, a first operation that the intelligent robot needs to perform.
[0095] 执行单元 30, 用于响应于第一控制命令, 执行第一操作。 [0095] The executing unit 30 is configured to perform a first operation in response to the first control command.
[0096] 可选地, 检测单元 10用于检测目标用户的动作并生成与目标用户的动作对应的 动作控制命令, 确定单元 20用于根据动作控制命令确定智能机器人需要执行的 第一操作, 执行单元 30用于根据动作控制命令对智能机器人的当前状态进行切 换, 响应于动作控制命令, 执行第一操作。  [0096] Optionally, the detecting unit 10 is configured to detect an action of the target user and generate a motion control command corresponding to the action of the target user, and the determining unit 20 is configured to determine, according to the motion control command, the first operation that the smart robot needs to perform, and execute The unit 30 is configured to switch the current state of the intelligent robot according to the motion control command, and perform the first operation in response to the motion control command.
[0097] 可选地, 检测单元 10用于检测目标用户在智能机器人上产生的压力数据, 确定 单元 20用于根据压力数据确定智能机器人需要执行的第一操作。  [0097] Optionally, the detecting unit 10 is configured to detect pressure data generated by the target user on the intelligent robot, and the determining unit 20 is configured to determine, according to the pressure data, a first operation that the intelligent robot needs to perform.
[0098] 可选地, 检测单元 10还用于在根据第一控制命令确定智能机器人需要执行的第 一操作之前, 检测智能机器人与周围物体之间产生的距离信号, 得到距离数据 , 确定单元 20还用于根据距离数据确定智能机器人需要执行的第一操作。  [0098] Optionally, the detecting unit 10 is further configured to: before determining the first operation that the intelligent robot needs to perform according to the first control command, detecting a distance signal generated between the intelligent robot and the surrounding object, to obtain distance data, and determining unit 20 It is also used to determine the first operation that the intelligent robot needs to perform based on the distance data.
[0099] 可选地, 检测单元 10用于检测目标用户发出的语音并生成与目标用户发出的语 音对应的语音控制命令, 确定单元 20用于根据语音控制命令确定智能机器人需 要执行的第一操作, 执行单元 30用于响应于语音控制命令, 执行第一操作。 [0100] 图 5是根据本发明第二实施例的用于智能机器人的控制装置的示意图。 如图 5所 示, 该用于智能机器人的控制装置包括: 检测单元 10, 确定单元 20和执行单元 3 0。 其中, 确定单元 20包括: 获取模块 21, 采集模块 22, 处理模块 23和确定模块 24。 [0099] Optionally, the detecting unit 10 is configured to detect a voice sent by the target user and generate a voice control command corresponding to the voice sent by the target user, and the determining unit 20 is configured to determine, according to the voice control command, the first operation that the smart robot needs to perform. The executing unit 30 is configured to perform the first operation in response to the voice control command. 5 is a schematic diagram of a control device for an intelligent robot according to a second embodiment of the present invention. As shown in FIG. 5, the control device for the intelligent robot includes: a detecting unit 10, a determining unit 20, and an executing unit 30. The determining unit 20 includes: an obtaining module 21, an acquiring module 22, a processing module 23, and a determining module 24.
[0101] 该实施例的检测单元 10, 确定单元 20和执行单元 30与本发明第一实施例的用于 智能机器人的控制装置中的作用相同, 此处不再赘述。  The detecting unit 10, the determining unit 20 and the executing unit 30 of this embodiment have the same functions as those of the control device for the intelligent robot of the first embodiment of the present invention, and are not described herein again.
[0102] 获取模块 21, 用于获取语音第一控制命令中的图像采集命令。  [0102] The obtaining module 21 is configured to acquire an image capturing command in the voice first control command.
[0103] 采集模块 22, 用于根据图像采集命令采集目标图像采集目标图像。 [0103] The acquisition module 22 is configured to collect a target image acquisition target image according to an image acquisition command.
[0104] 处理模块 23, 用于根据图像处理算法对目标图像执行处理, 得到处理结果。 [0104] The processing module 23 is configured to perform processing on the target image according to the image processing algorithm to obtain a processing result.
[0105] 确定模块 24, 用于根据处理结果确定智能机器人需要执行的第一操作。 [0105] The determining module 24 is configured to determine, according to the processing result, a first operation that the intelligent robot needs to perform.
[0106] 图 6是根据本发明第三实施例的用于智能机器人的控制装置的示意图。 如图 6所 示, 该用于智能机器人的控制装置包括: 检测单元 10, 确定单元 20和执行单元 36 is a schematic diagram of a control device for an intelligent robot according to a third embodiment of the present invention. As shown in Fig. 6, the control device for the intelligent robot comprises: a detecting unit 10, a determining unit 20 and an executing unit 3
0。 其中, 执行单元 30包括: 选择模块 31和播放模块 32。 0. The execution unit 30 includes: a selection module 31 and a playback module 32.
[0107] 该实施例的检测单元 10, 确定单元 20和执行单元 30与本发明第一实施例的用于 智能机器人的控制装置中的作用相同, 此处不再赘述。  The detecting unit 10, the determining unit 20 and the executing unit 30 of the embodiment have the same functions as those of the control device for the intelligent robot of the first embodiment of the present invention, and details are not described herein again.
[0108] 选择模块 31, 用于根据语音控制命令选择待播放的音频文件。  [0108] The selecting module 31 is configured to select an audio file to be played according to the voice control command.
[0109] 播放模块 32, 用于对音频文件执行播放。 [0109] The playing module 32 is configured to perform playing on the audio file.
[0110] 需要说明的是, 该播放模块 32可以用于执行上述用于智能机器人的控制方法实 施例中的音频播放模块所执行的方法。 [0110] It should be noted that the playing module 32 can be used to execute the method performed by the audio playing module in the above-described embodiment of the control method for the intelligent robot.
[0111] 本发明实施例通过检测单元 10检测目标用户的行为并生成与目标用户的行为对 应的第一控制命令, 第一控制命令为用于控制智能机器人执行第一操作的命令 , 目标用户为与智能机器人进行交互的对象, 通过确定单元 20根据第一控制命 令确定智能机器人需要执行的第一操作, 通过执行单元 30响应于第一控制命令 , 执行第一操作, 达到了智能机器人根据人们的命令做出响应的效果。  [0111] The embodiment of the present invention detects the behavior of the target user by the detecting unit 10 and generates a first control command corresponding to the behavior of the target user, where the first control command is a command for controlling the intelligent robot to perform the first operation, and the target user is The object interacting with the intelligent robot determines the first operation that the intelligent robot needs to perform according to the first control command, and performs the first operation by the execution unit 30 in response to the first control command, and the intelligent robot is determined according to the The effect of the command responding.
[0112] 本发明是实施例还提供了一种机器人, 包括本发明实施例的用于智能机器人的  [0112] The present invention also provides an embodiment of a robot for an intelligent robot according to an embodiment of the present invention.
[0113] 本发明实施例可以应用于其他领域机器人中的应用, 与外界的智能设备的通信 和控制可以扩展为其它的带有通讯模块的执行器或者执行装置。 [0114] 本发明实施例的决策模型可以同吋采集多路传感器信号, 可以与人们交互, 控 制执行机构积极做出合适的响应, 该控制决策模型可以适用于带有其它传感器 设备的机器人、 智能家居或者执行装置, 该控制决策模型还可以外加其它传感 器进行控制决策, 达到了智能机器人根据人们的命令做出响应的效果。 [0113] The embodiments of the present invention can be applied to applications in robots in other fields, and communication and control with external smart devices can be extended to other actuators or execution devices with communication modules. [0114] The decision model of the embodiment of the present invention can simultaneously collect multi-channel sensor signals, can interact with people, and control the actuator to actively respond appropriately. The control decision model can be applied to robots with other sensor devices and intelligence. The home or the execution device, the control decision model can also be controlled by other sensors, and achieve the effect that the intelligent robot responds according to people's commands.
[0115] 显然, 本领域的技术人员应该明白, 上述的本发明的各模块或各步骤可以用通 用的计算装置来实现, 它们可以集中在单个的计算装置上, 或者分布在多个计 算装置所组成的网络上, 可选地, 它们可以用计算装置可执行的程序代码来实 现, 从而, 可以将它们存储在存储装置中由计算装置来执行, 或者将它们分别 制作成各个集成电路模块, 或者将它们中的多个模块或步骤制作成单个集成电 路模块来实现。 这样, 本发明不限制于任何特定的硬件和软件结合。  [0115] It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device, which can be centralized on a single computing device or distributed across multiple computing devices. Optionally, they may be implemented by program code executable by the computing device, such that they may be stored in the storage device by the computing device, or they may be separately fabricated into individual integrated circuit modules, or Implementing multiple modules or steps in them as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.
[0116] 以上所述仅为本发明的优选实施例而已, 并不用于限制本发明, 对于本领域的 技术人员来说, 本发明可以有各种更改和变化。 凡在本发明的精神和原则之内 , 所作的任何修改、 等同替换、 改进等, 均应包含在本发明的保护范围之内。  The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

权利要求书 Claim
[权利要求 1] 一种用于智能机器人的控制方法, 其特征在于, 包括:  [Claim 1] A control method for an intelligent robot, comprising:
检测目标用户的行为并生成与所述目标用户的行为对应的第一控制命 令, 其中, 所述第一控制命令为用于控制智能机器人执行第一操作的 命令, 所述目标用户为与所述智能机器人进行交互的对象; 根据所述第一控制命令确定所述智能机器人需要执行的第一操作; 以 及  Detecting a behavior of the target user and generating a first control command corresponding to the behavior of the target user, where the first control command is a command for controlling the intelligent robot to perform a first operation, and the target user is An object that the intelligent robot performs interaction; determining, according to the first control command, a first operation that the intelligent robot needs to perform;
响应于所述第一控制命令, 执行所述第一操作。  The first operation is performed in response to the first control command.
[权利要求 2] 根据权利要求 1所述的方法, 其特征在于,  [Claim 2] The method according to claim 1, characterized in that
检测所述目标用户的行为并生成与所述目标用户的行为对应的第一控 制命令包括: 检测所述目标用户的动作并生成与所述目标用户的动作 对应的动作控制命令,  Detecting the behavior of the target user and generating a first control command corresponding to the behavior of the target user includes: detecting an action of the target user and generating an action control command corresponding to the action of the target user,
根据所述第一控制命令确定所述智能机器人需要执行的第一操作包括 : 根据所述动作控制命令确定所述智能机器人需要执行的第一操作, 响应于所述第一控制命令, 执行所述第一操作包括: 根据所述动作控 制命令对所述智能机器人的当前状态进行切换, 响应于所述动作控制 命令, 执行所述第一操作。  Determining, according to the first control command, the first operation that the smart robot needs to perform includes: determining, according to the action control command, a first operation that the smart robot needs to perform, and performing the first operation command in response to the first control command The first operation includes: switching a current state of the smart robot according to the action control command, and performing the first operation in response to the action control command.
[权利要求 3] 根据权利要求 2所述的方法, 其特征在于, [Claim 3] The method according to claim 2, characterized in that
检测所述目标用户的动作并生成与所述目标用户的动作对应的动作控 制命令包括: 检测所述目标用户在所述智能机器人上产生的压力信号 , 得到压力数据,  Detecting the action of the target user and generating an action control command corresponding to the action of the target user includes: detecting a pressure signal generated by the target user on the intelligent robot, and obtaining pressure data,
根据所述动作控制命令确定所述智能机器人需要执行的第一操作包括 : 根据所述压力数据确定所述智能机器人需要执行的第一操作。  Determining, according to the action control command, the first operation that the intelligent robot needs to perform comprises: determining, according to the pressure data, a first operation that the intelligent robot needs to perform.
[权利要求 4] 根据权利要求 1所述的方法, 其特征在于, [Claim 4] The method according to claim 1, wherein
在根据所述第一控制命令确定所述智能机器人需要执行的第一操作之 前, 所述方法还包括: 检测所述智能机器人与周围物体之间产生的距 离信号, 得到距离数据,  Before determining, according to the first control command, the first operation that the intelligent robot needs to perform, the method further includes: detecting a distance signal generated between the intelligent robot and a surrounding object, and obtaining distance data,
根据所述第一控制命令确定所述智能机器人需要执行的第一操作包括 : 根据所述距离数据确定所述智能机器人需要执行的第一操作。 Determining, according to the first control command, a first operation that the smart robot needs to perform includes : determining, according to the distance data, a first operation that the intelligent robot needs to perform.
[权利要求 5] 根据权利要求 1所述的方法, 其特征在于,  [Claim 5] The method according to claim 1, wherein
检测所述目标用户的行为并生成与所述目标用户的行为对应的第一控 制命令包括: 检测所述目标用户发出的语音并生成与所述目标用户发 出的语音对应的语音控制命令,  Detecting the behavior of the target user and generating a first control command corresponding to the behavior of the target user includes: detecting a voice sent by the target user and generating a voice control command corresponding to the voice sent by the target user,
根据所述第一控制命令确定所述智能机器人需要执行的第一操作包括 : 根据所述语音控制命令确定所述智能机器人需要执行的第一操作, 响应于所述第一控制命令, 执行所述第一操作包括: 响应于所述语音 控制命令, 执行所述第一操作。  Determining, according to the first control command, the first operation that the smart robot needs to perform includes: determining, according to the voice control command, a first operation that the smart robot needs to perform, and performing the first operation command in response to the first control command The first operation includes: performing the first operation in response to the voice control command.
[权利要求 6] 根据权利要求 5所述的方法, 其特征在于, 根据所述语音控制命令确 定所述智能机器人需要执行的第一操作包括: [Claim 6] The method according to claim 5, wherein determining, according to the voice control command, the first operation that the smart robot needs to perform comprises:
获取所述语音控制命令中的图像采集命令;  Obtaining an image collection command in the voice control command;
根据所述图像采集命令采集目标图像;  Collecting a target image according to the image acquisition command;
根据图像处理算法对所述目标图像执行处理, 得到处理结果; 以及 根据所述处理结果确定所述智能机器人需要执行的第一操作。  Performing processing on the target image according to an image processing algorithm to obtain a processing result; and determining a first operation that the smart robot needs to perform according to the processing result.
[权利要求 7] 根据权利要求 5所述的方法, 其特征在于, 响应于所述语音控制命令[Claim 7] The method according to claim 5, wherein the voice control command is responsive to
, 执行所述第一操作包括: Performing the first operation includes:
根据所述语音控制命令选择待播放的音频文件; 以及  Selecting an audio file to be played according to the voice control command;
对所述音频文件执行播放。  Playback is performed on the audio file.
[权利要求 8] 根据权利要求 1所述的方法, 其特征在于, 在响应于所述第一控制命 令, 执行所述第一操作之后, 所述方法还包括: 检测所述目标用户的行为并生成与所述目标用户的行为对应的第二控 制命令, 其中, 所述第二控制命令为用于控制所述智能机器人执行第 二操作的命令; [Claim 8] The method according to claim 1, wherein after performing the first operation in response to the first control command, the method further comprises: detecting behavior of the target user and Generating a second control command corresponding to the behavior of the target user, where the second control command is a command for controlling the smart robot to perform a second operation;
判断所述第二控制命令与所述第一控制命令是否存在变化; 如果判断出所述第二控制命令与所述第一控制命令存在变化, 根据所 述第一控制命令和所述第二控制命令调整所述第一操作, 得到第二操 作, 响应于所述第二控制命令, 执行所述第二操作; 以及 如果判断出所述第二控制命令与所述第一控制命令不存在变化, 响应 于所述第二控制命令执行所述第一操作。 Determining whether there is a change between the second control command and the first control command; if it is determined that there is a change between the second control command and the first control command, according to the first control command and the second control Commanding the first operation to obtain a second operation, in response to the second control command, performing the second operation; If it is determined that there is no change between the second control command and the first control command, the first operation is performed in response to the second control command.
一种用于智能机器人的控制装置, 其特征在于, 包括: A control device for an intelligent robot, comprising:
检测单元, 用于检测目标用户的行为并生成与所述目标用户的行为对 应的第一控制命令, 其中, 所述第一控制命令为用于控制智能机器人 执行第一操作的命令, 所述目标用户为与所述智能机器人进行交互的 对象; a detecting unit, configured to detect a behavior of the target user and generate a first control command corresponding to the behavior of the target user, where the first control command is a command for controlling an intelligent robot to perform a first operation, the target The user is an object that interacts with the intelligent robot;
确定单元, 用于根据所述第一控制命令确定所述智能机器人需要执行 的第一操作; 以及 a determining unit, configured to determine, according to the first control command, a first operation that the smart robot needs to perform;
执行单元, 用于响应于所述第一控制命令, 执行所述第一操作。 根据权利要求 9所述的装置, 其特征在于, And an execution unit, configured to perform the first operation in response to the first control command. The device according to claim 9, wherein
所述检测单元用于检测所述目标用户的动作并生成与所述目标用户的 动作对应的动作控制命令, The detecting unit is configured to detect an action of the target user and generate an action control command corresponding to the action of the target user,
所述确定单元用于根据所述动作控制命令确定所述智能机器人需要执 行的第一操作, The determining unit is configured to determine, according to the action control command, a first operation that the smart robot needs to perform,
所述执行单元用于根据所述动作控制命令对所述智能机器人的当前状 态进行切换, 响应于所述动作控制命令, 执行所述第一操作。 The execution unit is configured to switch a current state of the smart robot according to the action control command, and execute the first operation in response to the action control command.
根据权利要求 10所述的装置, 其特征在于, The device according to claim 10, characterized in that
所述检测单元用于检测所述目标用户在所述智能机器人上产生的压力 信号, 得到压力数据, The detecting unit is configured to detect a pressure signal generated by the target user on the intelligent robot, and obtain pressure data.
所述确定单元用于根据所述压力数据确定所述智能机器人需要执行的 第一操作。 The determining unit is configured to determine, according to the pressure data, a first operation that the intelligent robot needs to perform.
根据权利要求 9所述的装置, 其特征在于, The device according to claim 9, wherein
所述检测单元还用于在根据所述第一控制命令确定所述智能机器人需 要执行的第一操作之前, 检测所述智能机器人与周围物体之间产生的 距离信号, 得到距离数据, The detecting unit is further configured to: before determining the first operation that the smart robot needs to perform according to the first control command, detecting a distance signal generated between the intelligent robot and a surrounding object to obtain distance data,
所述确定单元还用于根据所述距离数据确定所述智能机器人需要执行 的第一操作。 [权利要求 13] 根据权利要求 9所述的装置, 其特征在于, The determining unit is further configured to determine, according to the distance data, a first operation that the smart robot needs to perform. [Claim 13] The apparatus according to claim 9, wherein
所述检测单元用于检测所述目标用户发出的语音并生成与所述目标用 户发出的语音对应的语音控制命令,  The detecting unit is configured to detect a voice sent by the target user and generate a voice control command corresponding to the voice sent by the target user,
所述确定单元用于根据所述语音控制命令确定所述智能机器人需要执 行的第一操作,  The determining unit is configured to determine, according to the voice control command, a first operation that the smart robot needs to perform,
所述执行单元用于响应于所述语音控制命令, 执行所述第一操作。  The execution unit is configured to perform the first operation in response to the voice control command.
[权利要求 14] 根据权利要求 13所述的装置, 其特征在于, 所述确定单元包括: 获取模块, 用于获取所述语音控制命令中的图像采集命令; 采集模块, 用于根据所述图像采集命令采集目标图像;  The device according to claim 13, wherein the determining unit comprises: an acquiring module, configured to acquire an image capturing command in the voice control command; and an acquiring module, configured to use the image according to the image The acquisition command collects the target image;
处理模块, 用于根据图像处理算法对所述目标图像执行处理, 得到处 理结果; 以及  a processing module, configured to perform processing on the target image according to an image processing algorithm, to obtain a processing result;
确定模块, 用于根据所述处理结果确定所述智能机器人需要执行的第 一操作。  And a determining module, configured to determine, according to the processing result, a first operation that the intelligent robot needs to perform.
[权利要求 15] 根据权利要求 13所述的装置, 其特征在于, 所述执行单元包括: 选择模块, 用于根据所述语音控制命令选择待播放的音频文件; 以及 播放模块, 用于对所述音频文件执行播放。  The device according to claim 13, wherein the execution unit comprises: a selection module, configured to select an audio file to be played according to the voice control command; and a playing module, configured to The audio file is played to play.
[权利要求 16] 一种机器人, 其特征在于, 包括权利要求 9至 15中任一项所述的用于 智能机器人的控制装置。  [Claim 16] A robot comprising the control device for an intelligent robot according to any one of claims 9 to 15.
PCT/CN2017/091972 2016-08-08 2017-07-06 Control method and device for smart robot, and robot WO2018028360A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610643386.7A CN107696028B (en) 2016-08-08 2016-08-08 Control method and device for intelligent robot and robot
CN201610643386.7 2016-08-08

Publications (1)

Publication Number Publication Date
WO2018028360A1 true WO2018028360A1 (en) 2018-02-15

Family

ID=61162670

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/091972 WO2018028360A1 (en) 2016-08-08 2017-07-06 Control method and device for smart robot, and robot

Country Status (2)

Country Link
CN (1) CN107696028B (en)
WO (1) WO2018028360A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113766285A (en) * 2020-06-02 2021-12-07 云米互联科技(广东)有限公司 Volume control method, television and storage medium
CN117435058A (en) * 2023-12-21 2024-01-23 北京赛凡策划有限公司 Interactive control method and system for intelligent exhibition hall

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108687768B (en) * 2018-04-02 2022-08-05 深圳臻迪信息技术有限公司 Wading robot and wading robot information input method
CN113467448A (en) * 2018-06-07 2021-10-01 科沃斯机器人股份有限公司 Fixed-point working method, self-moving robot and storage medium
CN110576433B (en) * 2018-06-08 2021-05-18 香港商女娲创造股份有限公司 Robot motion generation method
CN114327056A (en) * 2021-12-23 2022-04-12 新疆爱华盈通信息技术有限公司 Target object control method, device and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1313803A (en) * 1998-06-23 2001-09-19 索尼公司 Robot and information processing system
JP2004230480A (en) * 2003-01-28 2004-08-19 Sony Corp Robot device and robot control method, recording medium, and program
KR20070019441A (en) * 2005-08-12 2007-02-15 (주)테크노전자 Sensitive robot based on internet and method for operating an internet cyberspace in connection with the robot
CN102500113A (en) * 2011-11-11 2012-06-20 山东科技大学 Comprehensive greeting robot based on smart phone interaction
CN205201537U (en) * 2015-11-04 2016-05-04 上海拓趣信息技术有限公司 Robot of accompanying and attending to
CN205384783U (en) * 2015-12-18 2016-07-13 深圳市中科睿成智能科技有限公司 A intelligent robot for interactive study
CN105787471A (en) * 2016-03-25 2016-07-20 南京邮电大学 Gesture identification method applied to control of mobile service robot for elder and disabled

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102323817A (en) * 2011-06-07 2012-01-18 上海大学 Service robot control platform system and multimode intelligent interaction and intelligent behavior realizing method thereof
CN104440925B (en) * 2014-11-27 2016-05-04 国家康复辅具研究中心 A kind of pet type accompany and attend to robot and system
CN104965426A (en) * 2015-06-24 2015-10-07 百度在线网络技术(北京)有限公司 Intelligent robot control system, method and device based on artificial intelligence
CN105785813A (en) * 2016-03-18 2016-07-20 北京光年无限科技有限公司 Intelligent robot system multi-modal output method and device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1313803A (en) * 1998-06-23 2001-09-19 索尼公司 Robot and information processing system
JP2004230480A (en) * 2003-01-28 2004-08-19 Sony Corp Robot device and robot control method, recording medium, and program
KR20070019441A (en) * 2005-08-12 2007-02-15 (주)테크노전자 Sensitive robot based on internet and method for operating an internet cyberspace in connection with the robot
CN102500113A (en) * 2011-11-11 2012-06-20 山东科技大学 Comprehensive greeting robot based on smart phone interaction
CN205201537U (en) * 2015-11-04 2016-05-04 上海拓趣信息技术有限公司 Robot of accompanying and attending to
CN205384783U (en) * 2015-12-18 2016-07-13 深圳市中科睿成智能科技有限公司 A intelligent robot for interactive study
CN105787471A (en) * 2016-03-25 2016-07-20 南京邮电大学 Gesture identification method applied to control of mobile service robot for elder and disabled

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113766285A (en) * 2020-06-02 2021-12-07 云米互联科技(广东)有限公司 Volume control method, television and storage medium
CN117435058A (en) * 2023-12-21 2024-01-23 北京赛凡策划有限公司 Interactive control method and system for intelligent exhibition hall
CN117435058B (en) * 2023-12-21 2024-03-29 北京赛凡策划有限公司 Interactive control method and system for intelligent exhibition hall

Also Published As

Publication number Publication date
CN107696028B (en) 2021-11-02
CN107696028A (en) 2018-02-16

Similar Documents

Publication Publication Date Title
WO2018028360A1 (en) Control method and device for smart robot, and robot
CN104410883B (en) The mobile wearable contactless interactive system of one kind and method
CN108231079B (en) Method, apparatus, device and computer-readable storage medium for controlling electronic device
US8885851B2 (en) Portable device that performs an action in response to magnitude of force, method of operating the portable device, and computer program
CN104049721B (en) Information processing method and electronic equipment
KR102423712B1 (en) Transfer of automation assistant routines between client devices during routine execution
CN102932212A (en) Intelligent household control system based on multichannel interaction manner
US20130222338A1 (en) Apparatus and method for processing a plurality of types of touch inputs
US10572017B2 (en) Systems and methods for providing dynamic haptic playback for an augmented or virtual reality environments
CN111045511B (en) Gesture-based control method and terminal equipment
CN110709931B (en) System and method for audio pattern recognition
CN103970264B (en) Gesture recognition and control method and device
JP2012040655A (en) Method for controlling robot, program, and robot
CN107133368B (en) Human-computer interaction method and system and robot
CN105323612B (en) A kind of button multiplexing method and device of television set
US11188145B2 (en) Gesture control systems
CN110426962A (en) A kind of control method and system of smart home device
US11003252B2 (en) Method for capturing haptic content in multiple communication devices
CN103036988A (en) Control system and control method for demonstration of internet of things
CN103974112B (en) A kind of TV set control method and device
CN114442503A (en) Smart home linkage management method and system
CN109618234A (en) Video playing control method, device, mobile terminal and storage medium
TW201029710A (en) Electronic pet system and control method of electronic pet
CN110012325A (en) A kind of television set and its control system
CN112002326A (en) Interaction method and robot equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17838490

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03.06.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17838490

Country of ref document: EP

Kind code of ref document: A1