WO2016206642A1

WO2016206642A1 - Method and apparatus for generating control data of robot

Info

Publication number: WO2016206642A1
Application number: PCT/CN2016/087257
Authority: WO
Inventors: 聂华闻
Original assignee: 北京贝虎机器人技术有限公司
Priority date: 2015-06-26
Filing date: 2016-06-27
Publication date: 2016-12-29
Also published as: WO2016206645A1; WO2016206644A1; WO2016206646A1; WO2016206643A1; WO2016206647A1

Abstract

A method and an apparatus for generating control data of a robot. The method for generating control data of a robot comprises: setting, according to one or more preset sensing units, a triggering condition for controlling an interaction behavior of a robot (S202), wherein the sensing unit is configured as a minimum unit for controlling the interaction behavior of the robot; setting, according to one or more preset interaction behaviors configured to be executed by the robot, an interaction behavior triggered by the triggering condition (S204); and generating, according to the set triggering condition and interaction behavior, a control item for controlling, in response to information sensed by the robot, the interaction behavior of the robot (S206). In the method, a control item is set according to a sensing unit and an interaction behavior, to control an interaction behavior of a robot, thus effectively improving an adaptive interaction behavior capability and intelligent level of the robot.

Description

Method and device for generating control data of robot

Technical field

The present invention relates to the field of robot technology, and in particular, to a method and an apparatus for generating control data of a robot.

Background technique

Today's robots are mostly industrial robots, while industrial robots are mostly non-sense. The operating procedures of these robots are pre-defined and the determined tasks are completed without fail in accordance with the predetermined procedures. They lack adaptability and produce consistent results only when the objects involved are the same.

Summary of the invention

The embodiment of the invention provides a method and a device for generating control data of a robot, so as to at least effectively improve the adaptive interaction behavior and the degree of intelligence of the robot.

In some embodiments, a method for generating control data of a robot includes: setting a trigger condition for controlling a robot interaction behavior according to one or more preset sensing units, wherein the sensing unit is configured to control the robot interaction a minimum unit of behavior; setting an interaction behavior triggered by the trigger condition according to one or more preset interaction behaviors set for the robot to execute; generating information for responding to the robot perception according to the set trigger condition and interaction behavior A control entry that controls the interaction of the robot.

In some embodiments, setting a trigger condition for controlling a robot interaction behavior according to one or more preset sensing units includes: selecting at least one sensing unit from a preset sensing unit; setting an attribute of the selected sensing unit The attribute of the sensing unit includes the value of the sensing unit; and the triggering condition for controlling the interaction behavior of the robot is set according to the selected sensing unit and the attribute of the sensing unit.

In some embodiments, the triggering condition triggered interaction behavior is set according to one or more preset interaction behaviors set for the robot to perform, including: selecting at least from the preset interaction behavior set for the robot to perform An interaction behavior; setting an attribute of the selected interaction behavior, wherein the attribute of the interaction behavior includes one or more action instructions of the interaction behavior that can be parsed by the robot to execute and parameters of the action instruction; according to the selected interaction behavior and the interaction behavior The property sets the interaction behavior triggered by the trigger condition.

In some embodiments, a control device for robot interaction behavior includes: a trigger condition setting module, configured to set a trigger condition for controlling a robot interaction behavior according to one or more preset sensing units, wherein the sensing unit The smallest unit that is set to control the interactive behavior of the robot; the interactive behavior setting module is used to The plurality of presets are set as interaction behaviors performed by the robot, and the interaction behavior triggered by the trigger condition is set; the generating module is configured to generate the information for responding to the robot to control the robot interaction behavior according to the set trigger condition and the interaction behavior. Control entry.

In the embodiment of the present invention, a method and a device for generating control data of a robot are proposed. The sensing unit is defined as a minimum unit for controlling the interaction behavior of the robot, and defines an interaction behavior, and the control item is controlled according to the sensing unit and the interaction behavior to control the robot. The interaction behavior unifies the input and output standards of robot control, so that non-technical personnel can also edit the behavior of the robot, effectively improving the robot's adaptive interaction behavior and intelligence.

DRAWINGS

The drawings described herein are provided to provide a further understanding of the invention, and are not intended to limit the invention. In the drawing:

1 illustrates a schematic structural view of a robot in accordance with some embodiments of the present invention;

2a illustrates a flow chart of a method of generating control data for a robot in accordance with some embodiments of the present invention;

2b illustrates a schematic diagram of a generation interface of robot control data in accordance with some embodiments of the present invention;

2c illustrates a schematic diagram of a generation interface for controlling interaction behavior in data, in accordance with some embodiments of the present invention;

3 illustrates a flow chart 1 of a method of controlling robot interaction behavior in accordance with some embodiments of the present invention;

4 illustrates a flow chart 2 of a method of controlling robot interaction behavior in accordance with some embodiments of the present invention;

5 illustrates a flow chart 3 of a method of controlling robot interaction behavior in accordance with some embodiments of the present invention;

6 is a block diagram showing the structure of a device for generating control data of a machine according to some embodiments of the present invention;

7 illustrates a block diagram of a trigger condition setting module in accordance with some embodiments of the present invention;

8 illustrates a block diagram of another trigger condition setting module in accordance with some embodiments of the present invention;

9 illustrates a structural block diagram of an interactive behavior setting module in accordance with some embodiments of the present invention;

Figure 10 illustrates a block diagram of another interactive behavior setting module in accordance with some embodiments of the present invention.

detailed description

Reference is now made in detail to the embodiments described in the drawings. In order to fully understand the invention, numerous specific details are recited in the following detailed description. However, it will be understood by those skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known methods, procedures, components, and circuits are not described in detail to avoid unnecessarily obscuring the embodiments.

1 illustrates a schematic structural view of a robot in accordance with some embodiments of the present invention. The robot 100 includes a memory 102, a memory controller 104, one or more processing units (CPUs) 106, a peripheral interface 108, a radio frequency (RF) circuit 114, an audio circuit 116, a speaker 118, a microphone 120, a sensing subsystem 122, a gesture Sensor 132, camera 134, tactile sensor 136, and one or more other sensing devices 138, as well as external interface 140. These components communicate over one or more communication buses or signal lines 110.

It should be understood that the robot 100 is just one example of the robot 100, which may have more or fewer components than the illustration, or have different component configurations. For example, in some embodiments, the bot 100 can include one or more CPUs 106, memory 102, one or more sensing devices (eg, sensing devices as described above), and one or more are stored in the memory 102 to A module, program, or instruction set that performs a robot interaction behavior control method. The various components shown in FIG. 1 can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

In some embodiments, the robot 100 may be an electromechanical device having a biological shape (eg, a humanoid, etc.), or may be a smart device that does not have a biological appearance but has human characteristics (eg, language communication, etc.), the smart device may Mechanical devices are also included, as well as virtual devices implemented by software (eg, virtual chat bots, etc.). The virtual chat bot can perceive information through the device in which it is located, and the device in which it is located includes electronic devices such as handheld electronic devices, personal computers, and the like.

Memory 102 can include high speed random access memory and can also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state storage devices. In some embodiments, memory 102 may also include memory remote from one or more CPUs 106, such as network attached memory accessed via RF circuitry 114 or external interface 140 and a communication network (not shown), wherein the communication network It can be the Internet, one or more intranets, a local area network (LAN), a wide area network (WLAN), a storage area network (SAN), etc., or a suitable combination thereof. Memory controller 104 can control access to memory 102 by other components of robot 100, such as CPU 106 and peripheral interface 108.

Peripheral interface 108 couples the input and output peripherals of the device to CPU 106 and memory 102. The one or more processors 106 described above execute various software programs and/or sets of instructions stored in the memory 102 to perform various functions of the robot 100 and process the data.

In some embodiments, peripheral interface 108, CPU 106, and memory controller 104 can be implemented on a single chip, such as chip 112. In some other embodiments, they may be implemented on multiple discrete chips.

The RF circuit 114 receives and transmits electromagnetic waves. The RF circuit 114 converts an electrical signal into an electromagnetic wave, or converts the electromagnetic wave into an electrical signal, and communicates with the communication network and other communication devices via the electromagnetic wave. The RF Circuitry 114 may include well-known circuitry for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODEC chipsets, Subscriber Identity Module (SIM) card, memory, etc. The RF circuit 112 can communicate with a network and other devices via wireless communication, such as the World Wide Web (WWW) Internet, an intranet, and/or a wireless network such as a cellular telephone network, a wireless local area network (LAN), and / or Metropolitan Area Network (MAN).

The above wireless communication may use any of a variety of communication standards, protocols, and technologies including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (W-CDMA). ), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (eg IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and/or IEEE 802.11n), Internet-based Protocol Voice over Internet Protocol (VoIP), Wi-MAX, protocols for e-mail, instant messaging, and/or short message service (SMS), or any other suitable communication protocol, including those not yet developed at the filing date of this document. letter of agreement.

Audio circuitry 116, speaker 118, and microphone 120 provide an audio interface between the user and the robot 100. Audio circuitry 116 receives audio data from peripheral interface 108, converts the audio data into electrical signals, and transmits the electrical signals to speaker 118. The speaker transforms the electrical signal into a human audible sound wave. Audio circuit 116 also receives electrical signals that are converted from sound waves by microphone 118. The audio circuit 116 converts the electrical signals into audio data and transmits the audio data to the peripheral interface 108 for processing. Audio data may be retrieved from memory 102 and/or RF circuitry 114 by peripheral interface 108 and/or transmitted to memory 102 and/or RF circuitry 114.

In some embodiments, a plurality of microphones 120 can be included, the plurality of microphones 120 being distributed at different locations, and the direction in which the sound is emitted is determined according to a predetermined strategy based on the microphones 120 at different locations. It should be understood that the direction of the sound can also be identified by some sensors.

In some embodiments, audio circuit 116 also includes a headset jack (not shown). The headset jack provides an interface between the audio circuit 114 and a removable audio input/output peripheral, for example, the audio input/output peripheral can be either a pure output headset or both Output (for single or binaural headphones) and input (microphone) headset.

In some embodiments, a speech recognition device (not shown) is also included for implementing speech-to-text recognition and synthesizing speech based on text. The speech recognition device can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits. The audio circuit 116 receives the audio data from the peripheral interface 108, converts the audio data into electrical signals, and the voice recognition device can identify the audio data and convert the audio data into text data. The speech recognition apparatus can also synthesize the audio data based on the text data, convert the audio data into an electrical signal through the audio circuit 116, and transmit the electrical signal to the speaker 118.

Perception subsystem 122 provides an interface between the perceptual peripherals of robot 100 and peripheral interface 108, such as attitude sensor 132, camera 134, tactile sensor 136, and other sensing devices 128. Perception subsystem 122 includes an attitude controller 124, a visual controller 126, a haptic controller 128, and one or more other perceptual device controllers 130. The one or more other sensing device controllers 130 receive/transmit electrical signals from/to other sensing devices 138. The other sensing devices 138 may include temperature sensors, distance sensors, proximity sensors, air pressure sensors, air quality detecting devices, and the like.

In some embodiments, the robot 100 can have a plurality of attitude controllers 124 to control different limbs of the robot 100, which can include, but are not limited to, arms, feet, and heads. Accordingly, the robot 100 can include a plurality of attitude sensors 132. In some embodiments, the robot 100 may not have the attitude controller 124 and the attitude sensor 132. The robot 100 may be in a fixed configuration and does not have mechanical moving parts such as an arm or a foot. In some embodiments, the pose of the robot 100 may not be a mechanical arm, foot, and head, but may also employ a deformable configuration.

The robot 100 also includes a power system 142 for powering various components. The power system 142 can include a power management system, one or more power sources (eg, batteries, alternating current (AC)), charging systems, power failure detection circuits, power converters or inverters, power status indicators (eg, light emitting diodes (eg LED)), as well as any other components associated with power generation, management, and distribution in portable devices. The charging system can be a wired charging system or a wireless charging system.

In some embodiments, the software components include an operating system 144, a communication module (or set of instructions) 146, an interactive behavior control device (or set of instructions) 148, and one or more other devices (or sets of instructions) 150.

Operating system 144 (eg, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as Vxworks) includes controls and management of general system tasks (eg, memory management, storage device control, power management, etc.) Etc.) and various software components and/or drivers that facilitate communication between various hardware and software components.

Communication module 146 facilitates communication with other devices via one or more external interfaces 140, and it also includes various software components for processing data received by RF circuitry 114 and/or external interface 140. External interface 140 (eg, Universal Serial Bus (USB), FIREWIRE, etc.) is adapted to be indirectly coupled to other devices either directly or via a network (eg, the Internet, wireless LAN, etc.).

In some embodiments, the robot 100 may also include a display device (not shown), which may include, but is not limited to, a touch sensitive display, a touch pad, and the like. One or more of the other devices 150 described above can include a graphics module (not shown) that includes various known software components for presenting and displaying graphics on the display device. Attention The term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (eg, user interface objects including soft keys), digital images, video, animation, and the like. Touch sensitive displays or touch pads can also be used for user input.

The robot 100 senses the external environment of the robot 10 and the condition of the robot itself by, for example, the attitude sensor 132, the camera 134, the tactile sensor 136, and other sensing devices 128, the microphone 120, etc., and the information perceived by the robot 100 is controlled via the sensing peripheral. The device processes and is processed by one or more CPUs 106. The perception of the environment by the robot 100 includes, but is not limited to, information detected by its own sensors (eg, the attitude sensor 132, the camera 134, the tactile sensor 136, and other sensing devices 128), and may also be an external device connected to the robot 100 (not shown) The detected information establishes a communication connection between the robot 100 and the external device through which the robot 100 and the external device transmit data. External devices include various types of sensors, smart home devices, and the like.

In some embodiments, the information perceived by the robot 100 includes, but is not limited to, sound, images, environmental parameters, haptic information, time, space, and the like. Environmental parameters include, but are not limited to, temperature, humidity, gas concentration, etc.; tactile information includes, but is not limited to, contact with the robot 100, including but not limited to contact with a touch sensitive display, contact or proximity to a tactile sensor, and the tactile sensor can be placed at The head, arm, etc. of the robot (not shown) should be described to include other forms of information. The sound may include voice and other sounds, the sound may be the sound collected by the microphone 120, or may be the sound stored in the memory 102; the voice may include, but is not limited to, human speaking or singing. The image may be a single picture or video, including but not limited to captured by camera 134, or may be read from memory 102 or transmitted to the robot 100 over a network.

The information perceived by the robot 100 includes not only information external to the robot 100 but also information of the robot 100 itself, including but not limited to information such as the amount of power, temperature, and the like of the robot 100. For example, the robot 100 can be moved to the charging position for automatic charging when it is perceived that the power of the machine 100 is less than 20%.

It should be understood that the robot 100 is not limited to perceiving information in the manner described above, but may also perceive information in other forms, including perceptual techniques that have not been developed at the filing date of this document. Further, the sensing device of the robot 100 is not limited to the sensing device provided on the robot 100, and may also include a sensing device associated with the robot 100 and not provided on the robot 100, such as various sensors for sensing information. As an example, the robot 100 may be associated with a temperature sensor, a humidity sensor (not shown), or the like disposed within a certain area through which the corresponding information is perceived. The robot 100 can communicate with these sensors through various types of communication protocols to obtain information from these sensors.

In some embodiments, the information perceived by the robot 100 may be set according to preset conditions, which may include, but are not limited to, setting which information the robot 100 perceives, when to perceive the information, and the like. For example, it may be set to sense the user's voice, track the user's face, recognize the user's gesture, etc., in the user's voice conversation, without perceiving other information, or reducing the effect of other information when generating the sensing unit, or sensing the Other information is processed, etc.; or, during a certain period of time (for example, when the user goes out, the robot 100 is indoors alone), the environmental parameters, the perceived image, and the video data are sensed, and the environmental parameters are used to determine whether it is necessary to interact with the air conditioner or the like. Use image and video data to determine if there are strangers entering the room. It should be understood that the condition for setting the perceived information is not limited thereto, and the above conditions are merely exemplified, and the information that the robot 100 needs to perceive may be set depending on the situation.

About the sensing unit

At least one sensing unit is defined, which is the smallest unit (or referred to as a minimum input unit) that controls the robot 100, and the robot 100 makes interactive behavior based on at least the sensing unit. The interaction behavior of the robot 100 may be controlled by one or more sensing units, for example, when the values of one or more sensing units change, the robot 100 may react to the changes in response to the changes; or, when one or more perceptions When the value of the unit is within a certain value range or equal to a certain value, the robot 100 can perform an interactive behavior in response to the sensing unit. It should be understood that the control of the interaction behavior of the robot 100 by the sensing unit is not limited to the above case, and the above case is merely illustrative.

In some embodiments, the sensing unit can include multiple levels, and the higher level sensing unit can include one or more sensing units of the lower level. In some embodiments, the higher level perceptual unit may include one or more perceptual units of the lower level adjacent thereto, and the sensing unit of the same higher level may include different lower level perceptual units. In time, the low-level sensing units that synthesize the high-level sensing units include, but are not limited to, low-level sensing units of the same time or time period, and historical low-level sensing units of the time or time period. In some embodiments, the higher level perceptual units are determined by lower level sensing units at different times.

In some embodiments, the value of the sensing unit may be one or a set of values, or may be a range of one or more values. The value of the sensing unit may be determined according to the information perceived by the robot 100. One sensing unit may be determined by one or more pieces of information that is perceived, and the same sensing unit may be determined by different data that is perceived. The perceived information may include real-time perceived information, or historically perceived information (such as information perceived at a certain time or some time in the past). In some cases, the value of the sensing unit is determined by the information perceived in real time and the information perceived by the history.

As an example, it is possible to set ear, eye, timer, whether there are people at home (so_at_home), and environment (pervironment). Hearing describes the voice heard, on the machine When the person 100 receives the sound, the voice recognition process is performed on the received voice to identify the text of the voice in the voice, and the value of the hearing may be the text of the voice heard; in some embodiments, the vision may also include The direction of the sound, the direction of the sound is referenced to the face of the robot, including left, right, front, back and other directions. Visually describing the video surveillance situation, the robot 100 can analyze the image or video to determine whether there is or is there a current movement, and the visual value can include whether or not someone has moved or not. Whether someone at home can be "0" or "1", "0" means no one is at home, and "1" means someone is at home. The time describes the time information, and the value may be a time point or a time range, for example, 14:00 every February 1st. The environment describes the environmental conditions, including temperature, humidity, noise, PM2.5, ppm of gas in the air, carbon monoxide content in the air, oxygen content in the air, etc., and the value may be the value or range of each parameter.

In some embodiments, the value of the sensing unit can be predefined. The value of the predefined sensing unit may be one or more specific values, or one or more ranges of values. The value of the sensing unit may be an explicit value, or may be formed by a wildcard (or the like) together with an explicit value, but is not limited thereto. For example, when the sensing unit is “speech”, the value may be “*rain*”, indicating that any voice information containing “raining” is included; or the value may be “*[below] rain*”, indicating Any voice message that contains "rain" or "rain".

The robot 100 may generate the sensing data according to the sensing unit and the perceived information, and the sensing data may include one or more sensing units, where the sensing data includes the identification and value of the sensing unit. For the value of each sensing unit in the sensing data, refer to the description of the sensing unit. The robot 100 generates the sensing data according to the perceived information according to the sensing unit, and can obtain the value of the sensing unit according to the perceived information by using various analysis methods, for example, obtaining the text of the voice through the voice recognition technology, and analyzing the sensing through the image recognition technology. Whether there is a portrait in the image to be obtained, the attribute of the portrait is determined by the portrait (face) recognition technique, and the like. It should be understood that the robot 100 is not limited to obtaining the value of the sensing unit by the above manner, and may also include processing techniques that have not been developed at the filing date of this document by other means.

About control entries

Based on the pre-defined sensing unit and the preset interaction behavior for the robot, the trigger condition and the interaction behavior triggered by the trigger condition can be set. According to the interaction behavior triggered by the trigger condition and the trigger condition, a control item for controlling the interaction behavior of the robot in response to the information perceived by the robot is generated. Control entries can have unique identifiers to distinguish control entries.

The triggering condition may be composed of one or more sensing units, and the logical units may be configured between the sensing units, and the logical relationships include, but are not limited to, “and”, “or”, “not”, and the like. In some embodiments, the triggering condition may include an identifier and a value of the sensing unit constituting the triggering condition, and the value of the sensing unit may be one or a set of values, or one Or a set of values. The value of the sensing unit may be an explicit value, or may be composed of a wildcard (or the like) and an explicit value, but is not limited thereto. For example, when the sensing unit in the trigger condition is “speech”, the value may be “*rain*”, indicating that any voice information containing “rain” is included; or the value may be “*[below] rain* "," means that any voice message containing "rain" or "rain" is included.

One or more interactions that the trigger condition can trigger. In some embodiments, the order between interactions can be set to perform multiple interactions in a set order. The interaction behavior can be configured as one or more action instructions that can be parsed by the robot for execution, and the action instructions can also include one or more parameters. In some embodiments, the order of execution of the one or more action instructions can also be configured. The execution order may include, but is not limited to, randomly executing one or a set of action instructions to effect random execution of one or more actions; or executing a plurality of action instructions in a predetermined sequence of steps.

The operating system 144 of the robot 100 and other related devices can parse the action instructions of the interactive behavior, so that the robot performs the interactive behavior. For example, to move the robot forward by 5 meters, the action command can be "move{"m":5}". The robot interaction behavior control device 148 parses the action instruction, obtains the task (move) and task parameters (5 meters forward) to be executed, passes the task and parameters to the operating system 144, and the operating system 144 further processes the mobile device (not shown) To perform the movement, the mobile device may include a foot, a wheel, a crawler, and the like. It should be understood that specific instructions, such as parameters of individual motors (or similar components) of the mobile device, may also be provided.

In some embodiments, the action instructions of the interactive behavior include: links to other control entries set for execution of other control entries, and/or for selecting content from a plurality of content and/or parameters and/or A link to multiple parameters and/or multiple content set by parameters or parameters. Each control entry may have a unique identification to which an action instruction may refer to the control entry. The content of the action instruction link may be a set of actions, and the robot 100 may perform actions in a set of actions according to other factors. For example, attributes such as personality or gender of the robot 100 may be pre-configured, and the attributes may be stored in the memory 102, different genders. Alternatively, the interactive robot 100 may have different interaction behaviors for the same situation (or called a scene), and the robot 100 may select an executed action from a set of actions according to attributes such as a set personality or gender, and the actions may include, but are not limited to, the robot 100. Physical movements, etc. The action instruction may be linked to one or a group of content, which may include, but is not limited to, the content of the voice chat, various Internet information, etc., for example, the action performed by the robot 100 according to the control item is to query the weather in Beijing, and the action instruction may be a Querying the weather address, the robot 100 obtains the weather in Beijing at this address, which may include a uniform resource locator (URL), a memory address, a database field, and the like.

The interactive behavior of the robot 100 includes, but is not limited to, by outputting a voice, adjusting a gesture, outputting an image or video, interacting with other devices, and the like. Output speech includes, but is not limited to, chatting with a user, playing music; adjusting gestures including, but not limited to, moving (eg, mimicking human walking, etc.), limb swings (eg, arm, head swing), posture adjustment, etc.; outputting images or videos Including but not limited to displaying an image or video on a display device, the image may be a dynamic electronic expression or the like, or may be a captured image, or an image obtained from a network; interaction with other devices includes, but is not limited to, controlling other devices ( For example, adjusting the operating parameters of the air conditioner, etc., transferring data to other devices, establishing connections with other devices, and the like. It should be understood that the interactive behavior is not limited to the above enumerated contents, and the reaction of the robot 100 to the perceived information can be regarded as the interactive behavior of the robot 100.

Control entries can be configured in a data exchange format, although other formats can be used. Data exchange formats include, but are not limited to, XML, JSON, or YAML. Take JSON as an example, you need to implement: When the user says, "Sing me a song," first go back to 10cm at a medium speed of 0 and then start singing a song. After singing the song, take a photo and send it to the user 10 seconds later. Then 0 angle forward 5CM. The control entry for the JSON data format can be as follows:

In the above control entry, the "ifs" part is a trigger condition set according to the sensing unit, "ear" is the identification of the sensing unit, and "singing" is the value of the sensing unit. The "trigger" part is the interactive behavior triggered by the trigger condition, including three interaction behaviors of "move", "song" and "take_pic", each of which includes a corresponding action instruction. Among them, "song" is linked to "http://bpeer.com/i.mp3", the content of singing is obtained from "http://bpeer.com/i.mp3", and "gr" is action Execution order.

In some embodiments, multiple control entries may be stored as documents in a data exchange format, or may also be stored in a database. In some embodiments, the bot 100 can also include a database system for storing control entries. The database system provides an interface for one or more CPUs 106 to read data from the database and to write data to the database system.

The control device 148 of the robot interaction behavior may control the interaction behavior of the robot according to the control item, and the control device 148 acquires the information perceived by the robot, and generates the sensing data according to the perceived information, at least according to a predefined sensing unit, wherein the sensing data includes the sensing. The identification and value of the unit; finding a control entry that matches the generated perceptual data; if the control entry matching the generated perceptual data is found, causing the robot to perform the interaction behavior in the found control entry.

In some embodiments, the control device 148 can also transmit the information perceived by the robot 100, and the remote server (not shown) generates the sensing data according to the sensed information and the sensing unit, and searches for and generates the sensing unit. The matching control entries are then sent to the control device 148, which causes the robot to perform the interactive behavior in the control entry. Alternatively, an identification of the perceptual information may be generated to determine if the received control entry is a control entry for the transmitted perceptual information. Optionally, the control device 148 may be sent to the control entry itself, or may be an identifier of the control entry, or interactive behavior data that controls the configuration of the entry, or other information that causes the control device 148 to determine the interaction behavior of the control entry configuration.

In some embodiments, the control device 148 can generate the sensing data according to the information and the sensing unit perceived by the robot 100, and send the generated sensing data to the remote server, and the remote server receives the sensing data to find the control that matches the sensing data. An entry, which sends the found control entry to the robot 100, causes the robot 100 to perform the interactive behavior in the control entry.

It should be understood that the control device 148 is not limited to controlling the interactive behavior of the robot by the manner described above, but may be a combination of the above several manners or other means.

About generating control entries

In some embodiments, the trigger condition may be set according to the sensing unit, and the interaction behavior triggered by the trigger condition, the control item is obtained, and the control item is used as data for controlling the interaction behavior of the robot 100.

2a illustrates a flow chart of a method of generating control data for a robot, as shown in FIG. 2a, in accordance with some embodiments of the present invention, the method comprising:

Step S202, setting a trigger condition for controlling the interaction behavior of the robot according to one or more preset sensing units;

Step S204, setting an interaction behavior triggered by the trigger condition according to one or more preset interaction behaviors set for the robot to perform;

Step S206, generating a control item for controlling the interaction behavior of the robot in response to the information perceived by the robot according to the set trigger condition and the interaction behavior.

In the above step S202, at least one sensing unit may be selected from the preset sensing unit; the attribute of the selected sensing unit is set, wherein the attribute of the sensing unit includes the value of the sensing unit; according to the selected sensing unit and the sensing unit The property settings are used to control the triggering conditions of the robot's interactive behavior. In some embodiments, a relationship between the plurality of sensing units is further set, and the relationship between the sensing units includes, but is not limited to, logical relationships such as “AND”, “OR”, and “NO”; the foregoing step S202 may be selected according to the selection. A trigger condition is set for the relationship between the sensing unit and the sensing unit and the relationship between the sensing units. In some embodiments, the weight of the sensing unit may also be set to distinguish the importance of the different sensing units, thereby correspondingly interacting with the important sensing units.

In the above step S204, at least one interaction behavior may be selected from a preset interaction behavior set for the robot to perform; setting an attribute of the selected interaction behavior, wherein the attribute of the interaction behavior includes one or more interaction behaviors The robot parses the action instruction and the parameters of the action instruction; and sets the interaction behavior triggered by the trigger condition according to the selected interaction behavior and the attribute of the interaction behavior. In some embodiments, the execution order of the multiple interaction behaviors may also be set. In the above step S204, the interaction behavior triggered by the trigger condition may be set according to the selected interaction behavior and the attributes of the interaction behavior and the execution order. The execution order of the interaction behavior includes, but is not limited to, randomly performing one or more interaction behaviors, or performing a plurality of interaction behaviors according to predetermined steps.

In some embodiments, the triggering condition and the triggering condition triggered interaction behavior are described in terms of a predetermined data representation. Alternatively, the control entry may be generated using a data exchange format based on the interaction behavior triggered by the trigger condition and the trigger condition. Data exchange formats include, but are not limited to, one or any combination of the following: XML, JSON, or YAML. It should be understood that other formats may also be used to generate triggering conditions triggered by trigger conditions and trigger conditions, including data representations that have not yet been developed on the filing date of this document.

In some embodiments, multiple control entries can be set and multiple control entries stored as documents in a data exchange format. Alternatively, multiple control entries can also be stored in the database. When storing multiple control entries as documents in a data exchange format, adjacent control entries can be separated by a predetermined symbol to distinguish between different control entries. The document storing the control entry may be stored in the memory 102 of the robot 100, and the document of the control entry may also be stored in the remote server.

The interaction behavior is configured as one or more action instructions. The above action instructions include: links to other control entries set for executing other control entries, and/or multiple parameters set for selecting content and/or parameters from a plurality of content and/or parameters. And/or links to multiple content. For example, for the action command of "query weather", it is possible to link to a webpage providing weather information, and obtain weather information of the city to be queried from the webpage. After the weather information is queried, it may be displayed on the display device of the robot 100, or the weather information may be broadcasted by voice. In some embodiments, when linking to a set of action parameters, the actions performed may be selected according to other configurations. Parameters; Similarly, when linking to multiple content (such as multiple corpora of chats), you can also choose what to render based on other configurations.

The execution order of the action instructions may also be set, wherein the execution sequence includes: randomly executing one or more action instructions, or executing a plurality of action instructions in predetermined steps. The order of execution can be marked with symbols. If there is no mark, it can be in the order in which the actions are described. The same type of action can be used as a whole, and the order of actions can be marked. For example, “move forward 5 meters, nod 5 times, then back 10 meters”, the action instruction can be expressed as [move:{gr: 0,m:+5;gr:2,m:-10};head{gr:1,head:5}], "gr" indicates the execution order of the action, and the action with a small value is executed first.

In some embodiments, a graphical user interface (GUI) can be provided for setting trigger conditions and interaction behaviors, the graphical user interface providing a set sensing unit (eg, the name of the sensing unit, the identification, etc.), a perceptible unit that can be set The value of the relationship between the sensing unit and the sensing unit. The user who sets the triggering condition can select the sensing unit, the value of the sensing unit, and the logical relationship of the sensing unit. After selecting the sensing unit that sets the triggering condition, the triggering condition is generated according to the corresponding format. . The graphical user interface can also provide set interaction behaviors, which can be pre-defined interaction behaviors, and after the interaction behavior is selected, the interaction behavior is generated according to the corresponding format. In some embodiments, the trigger condition and the interaction behavior may also be directly edited, for example, according to the data exchange format described above, the action instruction specification using the predefined sensing unit and the interaction behavior, and the interaction behavior triggered by the trigger condition and the trigger condition are edited. Get control entries.

Figure 2b illustrates a generation interface for control data for a robot of certain embodiments. As shown in Figure 2b, a graphical user interface is added to add control entries (referred to as add rules in Figure 2b). The graphical user interface includes two parts: the trigger condition and the interaction behavior triggered by the trigger condition:

(1) The first part is "execution condition for selecting a robot rule" (trigger condition in the embodiment of the present invention), as shown in FIG. 2b, the sensing unit includes "voice", "video monitoring situation", "time", "whether or not" Some people are at home, "environment", where the value of "voice" can be the text spoken to the robot, and the value of "video surveillance situation" includes the robot monitoring to someone or having to move. In Fig. 2b, the relationship between the sensing units is also included, and the relationship of "simultaneous satisfaction" (logical AND) and "satisfying one" (logical OR) are shown in Fig. 2b.

(2) The second part is "adding robot's execution action" (interaction behavior in the embodiment of the present invention), as shown in FIG. 2b, including "speaking", "entering standby", "recording audio and video", "playing music" Interactive behaviors such as "moving", "vacuum", and "charging". In Figure 2b, the attributes of the "go to standby" interaction include "stop all work into standby" and "exit".

Figure 2c illustrates a generation interface for interactive behavior in control data of certain embodiments. As shown in Figure 2c, after selecting the interaction behavior to be added and setting the properties of the selected interaction behavior, click the "Add" button, and the data of the added interaction behavior can be displayed in the "Action List" section. As shown in Figure 2c, the added interactive behaviors include: "record audio and video", "play music", "move", "vacuum" and "charge". Where "gr" indicates the execution order of the interaction behavior. In Figure 2c, "gr" is automatically generated according to the order in which the actions are added; "path" in "song" is linked to a group of content to be played (for example, Music in MP3 format); the attribute "power" in "suck" is set to 3, and "m (moving distance)" is set to 3.

After the setup is complete, click the "Submit" button to generate the following control entries:

{

"ifs":{"ear":[{"txt":"Hello"}],"eye":{"action":"human"},"is_and":"0"},

"trigger":{"record":[{"gr":"1","sint":"1"}],"song":[{"gr":"2","path":["http :\/\/"]}],"move":[{"gr":"3","dire":"left","dire_value":"0","speed":"3"}], "suck":[{"gr":"4","power":"3","m":"3"}],"battery":[{"gr":"5","b": "1"}]},

"rule_name": "patent"

}

It should be understood that Figures 2b and 2c are only one example. In some embodiments, a graphical user interface for generating control entries may also be provided by other means, such as setting icons, by adding "drag" the icon to the editing area. Perceived unit or interactive behavior.

In some embodiments, content may be fetched from the Internet (eg, a web page, etc.), the captured content may be analyzed, content for setting control entries may be obtained, and triggering conditions triggered by trigger conditions and trigger conditions may be set according to the content. For example, if you call the emergency number when you are ill from the Internet, you can set the trigger condition of “ill” according to the sensing unit, and set the interaction behavior triggered by the trigger condition to “call emergency call”, for example, the preset interaction. The behavior of the "Call" parameter is set to the emergency number. If the sensing unit of “health status” is predefined, the value of the sensing unit can be directly set to “ill”, and the triggering condition can be {if(“health”: “sick”)}. The robot 100 can determine the health status of the user based on the perceived data, determine whether the health condition is "ill", for example, perform a voice chat with the user to understand the state of the user, and detect the heart rate, body temperature, and the like of the user. When the health condition is "ill", the sensor 100 generates perceptual data including {"health": "sick"}.

In some embodiments, the plurality of robots 100 may also constitute a robotic system based on the interaction of the robot 100 with the user. When no control item can control the interactive behavior of the robot 100, the robot 100 can transmit the situation to the other one or more robots 100, and the other one or more robots 100 can communicate with other users. Mutual, get interactions based on interactions with other users, and generate control entries based on this process. For example, when the robot 100 perceives the user's voice information "how to do Kung Pao Chicken", if the control item matching the voice information is not found, the robot 100 can transmit the voice information to the other robot 100, and the other robots 100 take the initiative. Interact with other users, ask other users "How to do Kung Pao Chicken", and record and analyze the answers of other users to generate corresponding control items. The robot 100 can select the transmitted robot 100 according to the information of the user of the other robot 100. For example, the robot 100 determines that the subject of the problem is law, and the robot 100 can find the robot 100 that the user is a legal professional, and send the above problem to the robot 100. .

About using control items to control robot interaction

After the control item is used as the data to control the interaction behavior of the robot, the interaction behavior of the robot can be controlled according to the control item.

3 illustrates a flow chart 1 of a method of controlling robot interaction behavior, as shown in FIG. 3, in accordance with some embodiments of the present invention, including:

Step S302, acquiring data that is perceived by the robot;

Step S304: Generate sensing data according to the perceptual information, at least according to a predefined sensing unit, where the sensing data includes an identifier and a value of the sensing unit.

Step S306, searching for a control entry that matches the generated sensing data among the stored plurality of control entries;

Step S308, if the control item matching the generated sensing data is found, the robot is caused to perform the interactive behavior in the found control item.

In some embodiments, the bot 100 communicates with a remote server (not shown) over a network, the bot 100 perceives at least one piece of data, and the remote server acquires information perceived by the bot from the bot 100, the acquisition including a remote server request The robot 100 transmits the information it perceives, or the robot senses the information, and transmits the information perceived by the robot 100 to the remote server. The robot 100 may periodically transmit the perceived information to the remote server or transmit the perceived information to the remote server when the perceived information changes to reduce the amount of data transmission between the remote server and the robot 100.

The control entry document can be stored in a remote server that includes one or more processors and one or more modules, programs, or sets of instructions that are stored in memory to perform the method illustrated in FIG. The remote server can be a single server or a server cluster consisting of multiple servers. It should be understood that the above described program or set of instructions is not limited to running on a single server, but can also be run on distributed computing resources.

In some embodiments, the found control entry can be sent to the bot 100, which reads the interactive behavior from the control entry and performs the interactive behavior. Or, you can interact with the found control entry The data is sent to the robot 100. Alternatively, the data of the interactive behavior in the control entry may be parsed to obtain an instruction that the robot 100 can execute, and the obtained command is transmitted to the robot 100, and the robot 100 executes the instruction. It should be understood that the above manner is merely illustrative.

4 illustrates a flow chart 2 of a method of controlling robot interaction behavior, as shown in FIG. 4, according to some embodiments of the present invention, the method comprising:

Step S402, receiving the sensing data of the robot, wherein the sensing data is generated according to the information perceived by the robot, at least according to a predefined sensing unit, and the sensing data includes the identifier and the value of the sensing unit;

Step S404, searching for a control item matching the sensing data of the robot among the stored plurality of control items;

Step S406, if the control item matching the perceptual data of the robot is found, the robot is caused to perform the interaction behavior in the found control item.

As shown in FIG. 4, the robot 100 senses at least one piece of information, and generates sensing data based on the sensed information and the sensing unit, and transmits the sensing data. In some embodiments, the bot 100 sends the sensory data to a remote server (not shown). The robot 100 may transmit the sensing data after generating the sensing data, or may send the sensing data after receiving the request from the remote server.

In some embodiments, the remote server stores documents that control entries, such as documents in a data exchange format, or a database, and the like. Of course, control entry documents can be distributed across multiple storage spaces. The remote server may include one or more processors and one or more modules, programs or sets of instructions stored in memory to perform the method illustrated in FIG.

FIG. 5 illustrates a third flowchart of a method for controlling the interaction behavior of a robot according to some embodiments of the present invention. As shown in FIG. 5, the method includes:

Step S502, sensing at least one piece of information;

In step S504, the sensing data is generated according to the perceptual information, at least according to the predefined sensing unit, where the sensing data includes the identifier and the value of the sensing unit;

Step S506, sending the generated sensing data;

Step S508, receiving information of a control item that matches the sensing data;

Step S510, performing an interaction behavior of the control item configuration according to the information of the control item.

In some embodiments, the interactive behavior control device 148 of the robot 100 performs the method as shown in FIG. The robot 100 perceives at least one piece of information, generates a policy according to the perceptual data, and generates perceptual data according to the sensing unit. After the robot 100 generates the sensing data, it transmits the sensing data to the remote server. A document storing a control entry in the remote server, and searching for a control entry matching the perceptual data of the robot in storing a plurality of control entries, if searching The control entry is sent to the robot 100 to a control entry that matches the sensory data of the robot. In some embodiments, an action instruction that controls the interactive behavior in the entry can be sent to the robot 100.

In some embodiments, the identification of the generated sensory data may also be determined prior to transmitting the generated sensory data. After determining the identifier of the generated sensing data, the generated sensing data and its identifier are sent out. After the remote server finds the control entry that matches the generated sensing data, the information of the control entry and the identifier of the corresponding sensing data are sent to the control device 148, and the information of the control entry may be the control entry itself, the identifier of the control entry, The behavior of the control bar entry configuration and any combination thereof, but is not limited to this. The control device receives the information of the control entry, and determines whether the information of the received control entry is the information of the control entry that matches the generated sensing data according to the identifier of the sensing data carried in the information of the control entry.

Control device 148 can determine a corresponding control entry based on the identification of the control entry and perform an interaction behavior in the control entry. Alternatively, the control device 148 can read the interaction behavior of the control entry configuration directly from the control entry sent by the remote server to perform the interaction. Moreover, if the remote server sends the interaction behavior configured in the control entry, the control device 148 can directly parse and execute the interaction behavior.

In some embodiments, the sensory data of the robot may be matched with a trigger condition in the control entry, including but not limited to determining whether there is a certain sensing unit, the value of the comparison sensing unit.

In some embodiments, when a plurality of trigger conditions matching the perceptual data items of the robot are found, the degree of matching between the perceptual data of the robot and the matched plurality of trigger conditions may be determined, at least according to the degree of matching. A control entry that senses data matching. As an example, for the speech text in the perceptual data, the degree of matching may be determined by using the editing distance, and the smaller the value of the editing distance, the more similar the two texts are. Speech text can also be matched using regular expressions.

In some embodiments, the priority of the control entry can also be set, and the priority of the control entry can be referenced when selecting the control entry. For example, control entries can be classified into core control entries, user control entries, and temporary control entries, with the core control entry being the highest priority control entry, followed by the user control entry, and finally the temporary control entry. When looking up a control entry, you can first look up the control entry that matches the perceptual data from the core control entry. If a control entry that matches the perceptual data is not found in the core control entry, a control entry that matches the perceptual data can be found in the user control entry. If a control entry that matches the perceptual data is not found in the user control entry, a control entry that matches the perceptual data can be found in the temporary training library.

In some embodiments, the robot 100 can perceive at least one piece of information, generate perceptual data based on the perceptual information and sensing unit, and read control items (including but not limited to reading from the memory 102 of the robot 100), A control entry that matches the generated perceptual data is found, and if a control entry that matches the generated perceptual data is found, the robot 100 performs an interaction behavior in the found control entry.

In some embodiments, the document of the control entry may be stored in the memory 102 and the remote server of the bot 100. The robot 100 perceives at least one piece of information, generates sensing data based on the sensed information and the sensing unit, reads the control item from the memory 102, and searches for the control item matching the generated sensing data in the read control item. If the control entry matching the generated perceptual data is found, the robot 100 performs the interaction behavior in the found control entry; if the control entry matching the generated perceptual data is not found in the read control entry, the robot 100 may Sending the generated sensing data to the remote server, the remote server searching for the control entry matching the received sensing data in the stored control entry, and if the control entry matching the received sensing data is found, causing the robot 100 to execute The interaction behavior in this control entry. The remote server can also send the found control entry to the bot 100, which can receive the control entry via an interface (not shown) and store the received control entry.

As described above, when a control entry that matches the perceptual data is found, the robot 100 is caused to perform an interactive behavior in the control entry. When the control item matching the perceptual data is not found, the interaction behavior may be omitted, and the robot 100 may continue to perceive at least one piece of information, and perceive what information can be determined according to the preset condition. In some embodiments, when a control entry that matches the perceptual data is not found, a voice reply can be made or imported into the Internet (eg, displaying web page information, etc.). When the control item matching the sensing data is not found, it may be determined whether the sensing data is related to the voice (for example, whether the user's voice instruction is received, etc.), and if the sensing data is determined to be related to the voice, the voice response may be performed, or according to the voice. The content is searched for relevant content in the Internet and presented to the user in the display device of the robot 100.

In some embodiments, the control entries can be set based on the interaction behavior of the robot with the user. When the control item matching the sensing data of the robot 100 is not found, the robot 100 can perform a voice chat with the user. During the chat, the robot 100 analyzes the user's needs and intentions, and obtains the interaction behavior of the scene and the robot in the situation. According to the situation, the interaction behavior of the robot, the control item is generated according to the sensing unit. For example, when the user is sick, the robot says "I am sick", and the control item of the robot 100 does not have an interaction behavior when the user is sick. At this time, the robot 100 can perform a voice interaction with the user, such as asking the user "I don't know what needs to be done. What, the user can say "Help me call my private doctor, the phone number is ....", the robot 100 can make a call. In addition, in this case, the robot 100 needs to contact the doctor when analyzing that the user is "ill", and according to the result of the analysis, the robot 100 can generate a control item, for example, the trigger condition is [if(health:sick)], The interaction behavior triggered by the trigger condition is [call{number:"//doctor_number.php"].

The structure of the apparatus for generating control data of the robot of some embodiments will be described below. Since the principle of solving the problem by the generating device of the control data of the robot is similar to the control method of the interactive behavior of the robot, the implementation of the generating device for controlling the data of the robot can be referred to the implementation of the method for generating the control data of the robot, and the repeated description will not be repeated. As used hereinafter, the term "unit" or "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.

6 is a block diagram showing the structure of a control device for generating control data of a robot according to some embodiments of the present invention. As shown in FIG. 6, the device includes:

The trigger condition setting module 602 is configured to set a trigger condition for controlling the interaction behavior of the robot according to the one or more preset sensing units, wherein the sensing unit is set as a minimum unit that controls the interaction behavior of the robot;

The interaction behavior setting module 604 is connected to the trigger condition setting module 602, and configured to set an interaction behavior triggered by the trigger condition according to one or more preset interaction behaviors set for the robot to perform;

The generating module 606 is connected to the interaction behavior setting module 604, and is configured to generate a control item for controlling the interaction behavior of the robot in response to the information perceived by the robot according to the set trigger condition and the interaction behavior.

FIG. 7 illustrates a structural block diagram of a trigger condition setting module 602. As shown in FIG. 7, the trigger condition setting module 602 may include: a sensing unit selecting unit 702 for using a preset sensing unit. At least one sensing unit is selected; the sensing unit attribute setting unit 704 is connected to the sensing unit selecting unit 702, and configured to set the attribute of the selected sensing unit, wherein the attribute of the sensing unit includes the value of the sensing unit; the trigger condition setting unit 706 And connected to the sensing unit attribute setting unit 704, configured to set a trigger condition for controlling the interaction behavior of the robot according to the selected sensing unit and the attribute of the sensing unit.

FIG. 8 illustrates a block diagram of another trigger condition setting module 602 according to some embodiments of the present invention. As shown in FIG. 8, the trigger condition setting module 602 may further include: a relationship setting unit, in addition to the unit included in FIG. 708, connected to the trigger condition setting unit 706, for setting a relationship between the plurality of sensing units. The trigger condition setting unit 706 is further configured to set a trigger condition according to the attributes of the selected sensing unit and the sensing unit and the relationship between the sensing units.

FIG. 9 illustrates a structural block diagram of an interaction behavior setting module 604. As shown in FIG. 9, the interaction behavior setting module 604 may include an interaction behavior selection unit 902 for setting from a preset. Selecting at least one interaction behavior for the interaction behavior performed by the robot; the interaction behavior attribute setting unit 904 is connected to the interaction behavior selection unit 902, and configured to set the attribute of the selected interaction behavior, wherein the attribute of the interaction behavior includes one of the interaction behaviors. Or a plurality of motion instructions that can be parsed by the robot to execute and parameters of the motion instruction; The interaction behavior setting unit 906 is connected to the interaction behavior attribute setting unit 904, and sets the interaction behavior triggered by the trigger condition according to the selected interaction behavior and the attribute of the interaction behavior.

FIG. 10 illustrates a block diagram of another interaction behavior setting module 604. As shown in FIG. 10, in addition to the unit included in FIG. 9, the interaction behavior setting module 604 may further include: a sequence setting unit. 908, connected to the interaction behavior setting unit 906, for setting an execution order of the plurality of interaction behaviors. The interaction behavior setting unit 906 is configured to set an interaction behavior triggered by the trigger condition according to the selected interaction behavior and the attribute of the interaction behavior, and the foregoing execution order.

In the embodiment of the present invention, the sensing unit is defined as a minimum unit for controlling the interaction behavior of the robot, and defines an interaction behavior, and controls the interaction behavior of the robot according to the sensing unit and the interaction behavior setting control item, and unifies the input and output standards of the robot control, and It enables non-technical personnel to edit the behavior of the robot and effectively improve the robot's adaptive interaction behavior and intelligence.

Obviously, those skilled in the art should understand that the above modules or steps of the embodiments of the present invention can be implemented by a general computing device, which can be concentrated on a single computing device or distributed in multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from The steps shown or described are performed sequentially, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated into a single integrated circuit module. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various changes and modifications may be made to the embodiments of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

A method for generating control data of a robot, comprising:

Setting a trigger condition for controlling a robot interaction behavior according to one or more preset sensing units, wherein the sensing unit is set as a minimum unit that controls the robot interaction behavior;

Setting an interaction behavior triggered by the trigger condition according to one or more preset interaction behaviors set for the robot to perform;

A control entry for controlling the interaction behavior of the robot in response to the information perceived by the robot is generated according to the set trigger condition and the interaction behavior.
The method according to claim 1, wherein the triggering condition for controlling the interaction behavior of the robot is set according to one or more preset sensing units, including:

Selecting at least one sensing unit from a preset sensing unit;

Setting an attribute of the selected sensing unit, where the attribute of the sensing unit includes a value of the sensing unit;

A trigger condition for controlling the interaction behavior of the robot is set according to the selected sensing unit and the attribute of the sensing unit.
The method according to claim 1 or 2, wherein the interaction behavior triggered by the trigger condition is set according to one or more preset interaction behaviors set for the robot to perform, including:

Selecting at least one interactive behavior from a preset interaction behavior set for the robot to perform;

Setting an attribute of the selected interaction behavior, wherein the attribute of the interaction behavior includes one or more action instructions of the interaction behavior that can be parsed by the robot to execute and parameters of the action instruction;

The interaction behavior triggered by the trigger condition is set according to the selected interaction behavior and the attribute of the interaction behavior.
The method according to claim 2 or 3, further comprising: setting a relationship between the plurality of sensing units;

The setting a trigger condition according to the selected attributes of the sensing unit and the sensing unit includes: setting a trigger condition according to the selected sensing unit and the attribute of the sensing unit and the relationship between the sensing units.
The method according to any one of claims 2 to 4, further comprising: setting an execution order of the plurality of interaction behaviors;

The interaction behavior triggered by the trigger condition is set according to the selected interaction behavior and the attribute of the interaction behavior, including: setting the trigger behavior triggered by the trigger condition according to the selected interaction behavior and the attribute of the interaction behavior, and the execution order.
The method according to claim 2, wherein the value of the sensing unit is one or more predefined values.

The setting the attribute of the selected sensing unit includes: selecting a value of the sensing unit from one or more predefined values of the sensing unit.
The method according to claim 3, wherein the parameters of the action instruction comprise: links to other control entries set for executing other control entries, and/or for use from multiple content and/or more A link to a plurality of parameters and/or a plurality of contents set by selecting content and/or parameters among the parameters.
The method according to any one of claims 1 to 7, characterized in that the control item for controlling the interaction behavior of the robot in response to the information perceived by the robot is generated according to the set trigger condition and the interaction behavior, including:

Generating trigger condition data according to the set trigger condition according to the first predetermined format;

Generating interactive behavior data according to the set interaction behavior according to a second predetermined format, wherein the first predetermined format is the same as or different from the second predetermined format;

Correlating the trigger condition data and the interaction behavior data, obtaining a control item for controlling the robot interaction behavior in response to the information perceived by the robot.
The method of claim 8 wherein said first predetermined format and said second predetermined format are data exchange formats.
The method of claim 9, wherein the data exchange format comprises one or any combination of the following: XML, JSON, or YAML.
The method according to any one of claims 1 to 10, wherein the preset sensing unit comprises a plurality of levels, wherein the high-level sensing unit comprises one or more sensing units of a lower level.
The method of claim 11 wherein the higher level sensing unit comprises one or more sensing units of the lower level adjacent thereto.
The method of claim 1 further comprising:

Set up and generate multiple control entries;

Assign a unique identifier to each control entry;

The plurality of control entries are stored in a document and/or database document in a data exchange format.
The method according to any one of claims 1 to 13, further comprising:

Obtain the information that the robot perceives;

Generating the sensing data according to the at least one sensing unit according to the perceived information, where the sensing data includes an identifier and a value of the sensing unit;

Find a control entry that matches the generated perceptual data;

If a control entry that matches the generated perceptual data is found, the robot is caused to perform the interactive behavior of the found control entry configuration.
The method according to any one of claims 1 to 13, further comprising:

Perceive at least one piece of information;

Generating the sensing data according to the at least one sensing unit according to the perceived information, wherein the sensing data includes an identifier and a value of the sensing unit;

Send the generated sensory data;

Receiving information of a control entry that matches the generated perceptual data;

Performing the interactive behavior of the control entry configuration.
The method according to any one of claims 1 to 13, further comprising:

Receiving the sensory data of the robot, wherein the sensory data is generated according to at least one sensing unit according to the information perceived by the robot, and the sensing data includes the identifier and the value of the sensing unit;

Find a control entry that matches the perceptual data of the robot;

If a control entry that matches the perceptual data of the robot is found, the robot is caused to perform the interactive behavior of the found control entry configuration.
A device for generating control data of a robot, comprising:

a trigger condition setting module, configured to set a trigger condition for controlling a robot interaction behavior according to one or more preset sensing units, wherein the sensing unit is set as a minimum unit that controls the robot interaction behavior;

An interaction behavior setting module, configured to set an interaction behavior triggered by the trigger condition according to one or more preset interaction behaviors set for the robot to perform;

And a generating module, configured to generate, according to the set trigger condition and the interaction behavior, a control item for controlling the interaction behavior of the robot in response to the information perceived by the robot.
The device according to claim 17, wherein the trigger condition setting module comprises:

a sensing unit selecting unit, configured to select at least one sensing unit from the preset sensing unit;

a sensing unit attribute setting unit, configured to set an attribute of the selected sensing unit, where the attribute of the sensing unit includes a value of the sensing unit;

The trigger condition setting unit is configured to set a trigger condition for controlling the interaction behavior of the robot according to the selected sensing unit and the attribute of the sensing unit.
The device according to claim 17 or 18, wherein the interaction behavior setting module comprises:

An interaction behavior selection unit, configured to select at least one interaction behavior from a preset interaction behavior set for the robot to perform;

An interaction behavior attribute setting unit, configured to set an attribute of the selected interaction behavior, where the attribute of the interaction behavior includes one or more action instructions of the interaction behavior that can be parsed by the robot to execute and parameters of the action instruction;

The interaction behavior setting unit sets the interaction behavior triggered by the trigger condition according to the selected interaction behavior and the attribute of the interaction behavior.
The device according to claim 18 or 19, wherein the trigger condition setting module further comprises: a relationship setting unit, configured to set a relationship between the plurality of sensing units;

The trigger condition setting unit is configured to set a trigger condition according to the attributes of the selected sensing unit and the sensing unit and the relationship between the sensing units.
The device according to claim 19 or 20, wherein the interaction behavior setting module further comprises: a sequence setting unit configured to set an execution order of the plurality of interaction behaviors;

The interaction behavior setting unit is configured to set an interaction behavior triggered by a trigger condition according to the selected interaction behavior and the attribute of the interaction behavior, and the execution order.