WO2020103247A1 - Control system and method for ai intelligent programming bionic robot, and storage medium - Google Patents

Control system and method for ai intelligent programming bionic robot, and storage medium

Info

Publication number
WO2020103247A1
WO2020103247A1 PCT/CN2018/121778 CN2018121778W WO2020103247A1 WO 2020103247 A1 WO2020103247 A1 WO 2020103247A1 CN 2018121778 W CN2018121778 W CN 2018121778W WO 2020103247 A1 WO2020103247 A1 WO 2020103247A1
Authority
WO
WIPO (PCT)
Prior art keywords
module
interactive
data
bionic robot
control
Prior art date
Application number
PCT/CN2018/121778
Other languages
French (fr)
Chinese (zh)
Inventor
欧阳建军
Original Assignee
深圳市天博智科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市天博智科技有限公司 filed Critical 深圳市天博智科技有限公司
Publication of WO2020103247A1 publication Critical patent/WO2020103247A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/004Artificial life, i.e. computing arrangements simulating life
    • G06N3/008Artificial life, i.e. computing arrangements simulating life based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. based on robots replicating pets or humans in their appearance or behaviour
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1602Programme controls characterised by the control system, structure, architecture
    • B25J9/161Hardware, e.g. neural networks, fuzzy logic, interfaces, processor

Definitions

  • the present application relates to the technical field of intelligent robots, and in particular, to a control system, method, and computer-readable storage medium of an AI intelligent programming bionic robot.
  • the main purpose of the present application is to provide a control system, method and computer-readable storage medium for an AI intelligently programmed bionic robot, which aims to solve the technical problem that the overall interaction effect of the robot in the prior art is poor and the true bionic effect cannot be achieved.
  • the present application provides a control system for an AI intelligent programming bionic robot.
  • the control system includes: a data acquisition module, a processor module, and a reaction adaptation module.
  • the data acquisition module and reaction adaptation module are
  • the processor module is communicatively connected,
  • the data acquisition module After acquiring the external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module;
  • the processor module transmits the interactive control instruction to the corresponding reaction adaptation module
  • the reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
  • control system further includes: an application control module and a Bluetooth module, and the application control module is communicatively connected to the processor module through the Bluetooth module,
  • the application control module After obtaining the operation instructions of the user, the application control module enters the corresponding preset interaction modes according to the operation instructions, and sends the interaction control instructions in the preset interaction modes to the Bluetooth module The processor module.
  • the application control module is provided with an intelligent programming unit that generates programming interaction instructions according to text content input by the user, and the AI intelligent programming bionic robot implements corresponding logic and / or according to the programming interaction instructions Features.
  • the Bluetooth module is a dual-mode Bluetooth module
  • the Bluetooth module transmits the interaction control instruction in each of the preset interaction modes of the application control module to the processor module, and transmits audio data to the audio module of the AI intelligent programming bionic robot.
  • control system further includes: an attitude detection module, the attitude detection module is in communication connection with the processor module, and
  • the posture detection module generates posture adjustment data based on detecting the current posture of the AI intelligent programming bionic robot, and sends the preset posture adjustment data to the processor module;
  • the processor module transmits the posture adjustment data to the motion control module
  • the motion control module controls the moving parts of the AI intelligently programmed bionic robot to perform corresponding actions according to the motion data according to the posture adjustment parameters.
  • the data acquisition module includes: a voice interaction module, a touch detection module and an obstacle detection module,
  • the voice module After receiving the user voice, the voice module generates a voice interaction control instruction according to the voice feature value of the user voice, and sends the voice control instruction to the processor module;
  • the touch detection module After detecting the user's touch operation, the touch detection module generates a touch interaction control instruction according to the touch parameter of the touch operation, and sends the touch interaction control instruction to the processor module;
  • the obstacle detection module After detecting the obstacle, the obstacle detection module generates an avoidance interaction control instruction, and sends the avoidance interaction instruction to the processor module.
  • reaction adaptation module adapts each interactive feedback data according to the current state of the AI intelligent programming bionic robot according to each interactive control instruction transmitted by the processor module.
  • the reaction adaptation module includes: a motion control module, a display module and an audio output module,
  • the motion control module controls the moving parts of the AI intelligent programming bionic robot to perform corresponding actions according to the motion data according to the motion data in the interactive feedback data;
  • the display module displays various expressions according to the expression data in the interaction feedback data, and displays a corresponding prompt when detecting that the control system enters each of the preset interaction modes;
  • the audio output module controls the sound output part of the AI intelligent programming bionic robot to play the corresponding sound according to the audio data in the interactive feedback data.
  • the present application also provides a control method of an AI intelligent programming bionic robot.
  • the control method of the AI intelligent programming bionic robot is based on the control system of the AI intelligent programming bionic robot described above.
  • the control method includes:
  • the data acquisition module After acquiring the external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module;
  • the processor module transmits the interactive control instruction to the corresponding reaction adaptation module
  • the present application also provides a computer-readable storage medium having computer-readable instructions stored on the computer-readable storage medium, the computer-readable instructions executed by the processor to achieve the above AI intelligent programming bionic robot control method steps.
  • an interactive control instruction is generated according to the external environment data, and the interactive control instruction is sent to the processor module; the processor module controls the interaction The instruction is transferred to the corresponding reaction adaptation module; the reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
  • the AI intelligent programming bionic robot Based on external environment data and user's various control operations, it automatically detects and recognizes environmental data and generates interactive control instructions. According to the interactive control instructions and AI intelligent programming bionic robot current state parameters, it automatically matches the corresponding interactive feedback data, and according to the interactive feedback data Control the AI intelligent programming bionic robot to complete the corresponding interactive feedback action, improve the overall interactive performance of the robot, and make the intelligent robot truly achieve the effect of real bionic.
  • FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in an embodiment of the present application
  • FIG. 2 is a schematic diagram of the structural layout of the control system of the AI intelligent programming bionic robot of the present application
  • FIG. 3 is a schematic view of an interface in an embodiment of a control system of an AI intelligent programming bionic robot of the present application
  • FIG. 4 is a schematic flowchart of an embodiment of a control method of an AI intelligent programming bionic robot of the present application.
  • Label name Label name 1 Data acquisition module 2 Processor module 3 Reaction adaptation module 4 Application Control Module 5 Bluetooth module 6 Attitude detection module 7 Voice interaction module 8 Touch detection module 9 Obstacle detection module 10 Motion control module 11 Display module 12 Audio output module
  • the main solution of the embodiment of the present application is: after acquiring the external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module; The processor module transmits the interactive control instruction to the corresponding reaction adaptation module; the reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI according to the interactive feedback data The intelligent programming bionic robot completes the corresponding feedback.
  • FIG. 1 is a schematic structural diagram of a terminal to which a device in a hardware operating environment according to an embodiment of the present application belongs.
  • the terminal of the embodiment of the present application carries a control system of an AI intelligent programming bionic robot.
  • the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
  • the communication bus 1002 is used to implement connection communication between these components.
  • the user interface 1003 may include a display (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage.
  • the memory 1005 may optionally be a storage device independent of the foregoing processor 1001.
  • the mobile terminal can be used for applications that recognize the posture of mobile terminals (such as horizontal and vertical screen switching, Related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tap), etc.
  • the mobile terminal can also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. No longer.
  • terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or fewer components than those illustrated, or combine certain components, or arrange different components.
  • the network interface 1004 is mainly used to connect to the back-end server and perform data communication with the back-end server;
  • the user interface 1003 is mainly used to connect to the client (user end) and perform data communication with the client;
  • the processor 1001 can be used to call computer-readable instructions stored in the memory 1005 and perform the following operations:
  • the data acquisition module After acquiring the external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module;
  • the processor module transmits the interactive control instruction to the corresponding reaction adaptation module
  • the reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
  • the application control module After obtaining the operation instructions of the user, the application control module enters the corresponding preset interaction modes according to the operation instructions, and sends the interaction control instructions in the preset interaction modes to the Bluetooth module The processor module.
  • the application control module is provided with an intelligent programming unit that generates programming interaction instructions according to text content input by the user, and the AI intelligent programming bionic robot implements corresponding logic and / or functions according to the programming interaction instructions .
  • the Bluetooth module is a dual-mode Bluetooth module
  • the Bluetooth module transmits the interaction control instruction in each of the preset interaction modes of the application control module to the processor module, and transmits audio data to the audio output module of the AI intelligent programming bionic robot .
  • control system further includes: an attitude detection module, the attitude detection module is in communication connection with the processor module,
  • the posture detection module matches a preset posture adjustment instruction according to detecting the current posture of the AI intelligent programming bionic robot, and sends the preset posture adjustment instruction to the processor module, and the processor module according to the A preset posture adjustment instruction controls the motion module to perform the corresponding action in the preset motion mode.
  • the data acquisition module includes: a voice interaction module, a touch detection module and an obstacle detection module,
  • the voice module After receiving the user voice, the voice module generates a voice interaction control instruction according to the voice feature value of the user voice, and sends the voice control instruction to the processor module;
  • the touch detection module After detecting the user's touch operation, the touch detection module generates a touch interaction control instruction according to the touch parameter of the touch operation, and sends the touch interaction control instruction to the processor module;
  • the obstacle detection module After detecting the obstacle, the obstacle detection module generates an avoidance interaction control instruction, and sends the avoidance interaction instruction to the processor module.
  • reaction adaptation module adapts each interactive feedback data according to each interactive control instruction transmitted by the processor module, combined with state parameters of the current state of the AI intelligent programming bionic robot.
  • reaction adaptation module includes: a motion control module, a display module and an audio output module,
  • the motion control module controls the moving parts of the AI intelligent programming bionic robot to perform corresponding actions according to the motion data according to the motion data in the interactive feedback data;
  • the display module displays various expressions according to the expression data in the interaction feedback data, and displays a corresponding prompt when detecting that the control system enters each of the preset interaction modes;
  • FIG. 2 is a schematic structural layout diagram of an embodiment of a sensor fusion system of the present application.
  • the transmission control system includes: a data acquisition module 1, a processor module 2, a reaction adaptation module 3, an application control module 4, and a Bluetooth module 5 and the posture detection module 6, the data acquisition module 1 and the reaction adaptation module 3 are respectively communicatively connected to the processor module 2, and the application control module 4 is communicatively connected to the processor module 2 through the Bluetooth module 5; wherein, the data acquisition module 1 includes: The voice interaction module 7, the touch detection module 8 and the obstacle detection module 9, and the reaction adaptation module 3 include: a motion control module 10, a display module 11 and an audio output module 12.
  • the data acquisition module 1 extracts the sound, image or vibration data through a specific extraction algorithm In the feature value in, the extracted feature value is matched with the preset interactive control instruction, and then the corresponding interactive control instruction is generated.
  • the preset interactive control instruction may be a corresponding interactive control instruction library that previously saves text information, volume level, obstacle image, or vibration amount level.
  • the voice interaction module 7 in the data acquisition module 1 receives the "seat me down” voice issued by the user
  • the "seat me down” voice issued by the user is extracted through a voice text extraction algorithm "Sit me down” text information feature value, and match the extracted "seat me down” text information feature value in the interactive control instruction library corresponding to the pre-saved text information to the "sit me down” text information place Corresponding to the "sit down” voice control instruction, thereby realizing the recognition of the "sit down” voice control instruction in the "sit me” voice issued by the user.
  • the voice interaction module 7 can also identify the volume of the sound volume emitted by the user or the volume of the ambient sound according to the sound volume extraction algorithm, and generate interactive responses to the volume based on the volume.
  • the control system of the AI intelligent programming bionic robot can be based on this The volume responds to the interactive control instruction, and controls the motion control module 10 and / or the audio output module 12 and the display module 11 in the response adaptation module 3 to corresponding interactive feedback.
  • the voice interaction module 7 detects that the ambient sound contains a loud "thunder” sound, it generates a corresponding "stun” reaction interaction instruction, and the processor module 20 in the control system receives the "stun” reaction interaction After the instruction, the audio output module 12 in the reaction adaptation module 3 is simultaneously controlled to output the preset "scared” sound, the display module 11 is controlled to display the preset "scared” expression, and the motion control module 10 is controlled to complete the preset "Fright” action.
  • the motion control module 10 controls the moving parts of the AI intelligent programming bionic robot according to the motion data in the interactive feedback data matched by the reaction adaptation module 3 to perform corresponding actions according to the motion data.
  • the AI intelligent programming bionic robot moves.
  • the processor module 2 may be a dual-core processor including two 32-bit MCUs.
  • the voice interaction module 7 in the data acquisition module 1 recognizes the "sit down” voice control instruction in the user's voice
  • the recognized "sit down” voice control instruction is sent to the dual-core processor, and the dual-core processor receives And execute the “sit down” voice control instruction, and send the "sit down” voice control instruction to the motion control module 10 in the reaction adaptation module 3 that is suitable for the "sit down” action.
  • the reaction adaptation module 3 After receiving the interactive control instruction sent by the processor module 2, the reaction adaptation module 3 adapts the interactive feedback data according to the interactive control instruction and the AI intelligent programming bionic robot, and controls the AI intelligent programming bionic robot to complete the corresponding feedback according to the interactive feedback data.
  • the motion control module 10 after receiving the "sit down" voice control instruction sent by the processor module 2, the motion control module 10 adapts interactive feedback according to the "sit down” voice control instruction and the current state parameters of the AI intelligent programming bionic robot Data, for example, the current state of the AI intelligent programming bionic robot is "hungry", the motion control module 10 reduces the "speed” parameter in the motion data of the "sit down” action pointed to by the "sit down” voice control instruction, According to the motion data of the "sit down” action after reducing the "speed” parameter, the AI intelligent programming bionic robot is controlled to "slow down” the moving parts.
  • each moving part of the AI intelligent programming bionic robot is a hardware structure such as movable limbs or joints.
  • the data acquisition module 1 after receiving the sound, image or vibration data in the external environment, extracts the feature values in the sound, image or vibration data through a specific extraction algorithm, and extracts the extracted feature values Match the preset interactive control instructions to generate corresponding interactive control instructions. After the data acquisition module 1 generates the interactive control instructions, send the generated interactive control instructions to the processor module 2 in the control system.
  • the processor module 2 Receive each interactive control instruction and send each interactive control instruction to the motion control module 10, display module 11 or audio output module 12 in the reaction adaptation module 3, the reaction adaptation module 3 receives the interaction sent by the processor module 2 After the control instruction, the interactive feedback data is adapted to the AI intelligent programming bionic robot according to the interactive control instruction, and the AI intelligent programming bionic robot is controlled according to the interactive feedback data to complete the corresponding feedback. Based on external environment data and user's various control operations, it automatically detects and recognizes environmental data and generates interactive control instructions.
  • the interactive control instructions and AI intelligent programming bionic robot current state parameters, it automatically matches the corresponding interactive feedback data, and according to the interactive feedback data Control the AI intelligent programming bionic robot to complete the corresponding interactive feedback actions, improve the interactive performance between the intelligent robot and the user and the environment, make the intelligent robot truly achieve the real bionic effect, and improve the user's experience.
  • the application control module 4 enters the corresponding preset interaction according to the operation parameters of the operation instructions after acquiring the operation instructions input by the user based on the application interaction mode
  • the interactive control commands generated based on user operations are transmitted to the processor module 2 through the Bluetooth module 5.
  • the preset interaction mode is a mode pre-saved in the application module 4 that controls the AI intelligent programming bionic robot to make corresponding interaction reactions with user operations according to different operations of the user.
  • the application control module 4 obtains a user-entered interactive mode operation instruction based on the click operation input on the display interface of the AI intelligent programming bionic robot as shown in FIG. 3, and determines application control according to the entered interactive mode operation instruction In each preset interaction mode of the module, the instruction points to the target preset interaction mode, and enters the target preset interaction mode. After entering the target preset interaction mode, the user's specific operation is obtained, and an interaction control instruction is generated to interact The control instruction is sent to the processor module 2 of the control system through the Bluetooth module 5.
  • the application control module 4 is provided with an intelligent programming unit, an action remote control unit, an online music unit, an intelligent feeding unit, and a multi-polar interactive unit. Each unit can control the corresponding functions of the AI intelligent programming bionic robot.
  • the intelligent programming unit is based on the text input by the user
  • the content generates programming interaction instructions, and the AI intelligent programming bionic robot realizes corresponding logic and / or functions according to the programming interaction instructions.
  • the user after the user clicks the "intelligent programming mode” operation on the display interface of the control system of the AI intelligent programming bionic robot as shown in FIG. 3 through the mobile phone, the user enters the control system and saves according to the user's click.
  • "Intelligent programming mode” operation which controls the AI intelligent programming bionic robot to make corresponding interactive response according to the "program content” input by the user.
  • the user writes a robot to lie down and then turn Circle action: Drag the "program start” box from the control instruction area to the editing area in the middle of the screen.
  • the instruction block under the "program start” box When the program is executed, the instruction block under the "program start” box will be executed first, and “get down” from the action instruction area “Block, connect it under the” program start “block, then drag the” turn circle “block from the action instruction area, connect it under the” squat down “block, and finally click to execute, the intelligent programming unit in the application control module 4 will The user writes and enters the "pull down-turn a circle” interactive control instruction to be transmitted to the dual-core processor module 2 through the Bluetooth module 5, and the dual-core processor module 2 executes the "paw down-turns a circle” interactive control instruction to control the motion control module 10 carry out “Paw down-turn a circle” action, that is, control the moving parts of the AI intelligent programming bionic robot "lie down, and then turn a circle”.
  • the intelligent programming unit can be composed of a compilation area, a control module, a logic module, a condition module, an action module, a sound module, and an expression module
  • the AI intelligent programming bionic robot can be customized through the application control module 4 and the Bluetooth module 5
  • each module in the intelligent programming unit has a corresponding instruction icon, and the user can drag to the compilation area to compile and execute.
  • the instruction icon in the control module has instruction icons such as program start and start by head.
  • the instruction icons in the logic module include "if", "while” and other instruction icons. The user can compile according to the action expression sound he envisions.
  • each instruction sequence can be modified and deleted in order to achieve specific kinetic energy.
  • the Bluetooth module 5 may be a dual-mode Bluetooth module, and all data of the application control module 4, including: classic Bluetooth data stream, BLE data stream, etc., are all transmitted by the Bluetooth module 5, specifically, for example, the application control module 4 is transmitted using Bluetooth 2.0
  • the audio data output from the online music unit uses Bluetooth 4.0 to transmit the interactive control command data generated in each preset mode of the application control module 4 in a transparent transmission manner, such as a BLE data stream.
  • the audio output module 12 in the control system of the AI intelligent programming bionic robot can be an audio amplifier and a speaker, amplify the sound source output by the Bluetooth chip, and drive the amplified sound source to the speaker, the speaker can play a high High-fidelity sounds and music, and when the AI intelligent programming bionic robot is in the music playback mode, output high-quality high-fidelity music or stories.
  • the corresponding preset interaction modes are entered, and through the Bluetooth module 5, the preset interaction modes
  • the interactive control instruction is sent to the processor module 2, and the programming interactive instruction is generated according to the interactive program input by the user through the intelligent programming unit of the application control module 4,
  • the AI intelligent programming bionic robot realizes the corresponding logic and / or functions according to the programming interactive instructions.
  • the Bluetooth module 5 transmits the interactive control instructions in the preset interactive modes of the application control module 4 to the processor module 2 and transmits the audio data to the AI The audio output module 12 of the intelligently programmed bionic robot.
  • the posture detection module detects the current standing, falling down, right falling, and lying postures of the AI intelligent programming bionic robot at all times in 360 degrees at all times. And the AI intelligent programming bionic robot will detect its posture in different modes, generate posture adjustment parameters in the posture according to the detected current posture, and send the posture adjustment parameters to the processor module 2, and the processor module 2 adjusts the posture The parameters are sent to the motion control module 10 in the reaction adaptation module 3, and the motion control module 10 matches and controls each active part of the AI intelligently programmed bionic robot to complete the corresponding posture adjustment action.
  • the AI intelligent programming bionic robot is provided with five independent potentiometers, each angle of the potentiometer has an AD value, and each action and posture has a corresponding AD value.
  • the posture detection module 6 is The processor module 2 is connected, and the posture detection module 6 corrects and confirms whether the AI intelligent programming bionic robot is in a "standing" attitude by sampling each AD value, and a pair of AI intelligent programming bionic robots can also be set.
  • the inverted detection sensor which is connected to the processor module 2, determines whether the AI intelligent programming bionic robot is in the "inverted” posture by collecting the sensor information, and when the attitude detection module 6 determines that the AI intelligent programming bionic robot is in the "standing” or When “Inverted”, match the posture adjustment parameters matching the “standing” or “inverted” posture in the posture detection module 6 according to the “standing” or “inverted” posture, and send the matched posture adjustment parameters to the control
  • the processor module 2 of the system the processor module 2 receives and sends the posture adjustment parameters to the motion control module 10, and the motion
  • the touch detection module 8 After detecting the user's touch operation, the touch detection module 8 matches the touch interaction control instruction in the touch detection module 8 according to each touch parameter of the user's touch operation, and sends the touch interaction control instruction to the processor module 2, the processor The module 2 sends the touch interaction control instruction to the reaction adaptation module 3, the reaction adaptation module 3 matches corresponding motion parameters, and controls the AI intelligent programming bionic robot to complete the corresponding interactive feedback action.
  • the touch detection module 8 may be a touch point set at multiple positions on the body of the AI intelligent programming bionic robot, for example, setting a touch point on the chin and back of the AI intelligent programming bionic robot respectively, and detecting through the touch point Whether the user touches the AI intelligent programming bionic robot.
  • the touch detection module 8 matches the touch that matches the touch parameter according to the touch parameters such as the touch intensity and the duration of the user's touch operation.
  • Interactive control instructions and send the matched touch interactive control instructions to the processor module 2 of the control system
  • the processor module 2 receives and sends the touch interactive control instructions to the reaction adaptation module 3 of the control system, reacts
  • the adaptation module 3 matches the motion data corresponding to the preset touch response instruction, and controls the AI intelligently programmed bionic robot interactive feedback action according to the motion data.
  • the obstacle detection module 9 After detecting the obstacle, the obstacle detection module 9 generates the avoidance interaction control instruction and sends the avoidance interaction control instruction to the processor module 2, and the processor module 2 transmits the avoidance interaction control instruction to the motion control in the reaction adaptation module 3 Module 10, the motion control module 10 matches and controls the moving parts to complete the corresponding avoidance actions according to the motion parameters.
  • the obstacle detection module 9 may be set as an infrared vision module, AI intelligent programming bionic robot perceives external objects based on the infrared vision module.
  • the infrared vision module includes an infrared transmitting unit and an infrared receiving unit.
  • the infrared transmitting unit is used to emit infrared light beams
  • the infrared receiving unit is used to receive infrared light reflected by the objects; when the AI Intelligent programming bionic robot In motion, the AI intelligent programming bionic robot can detect whether there is an obstacle in front through the infrared vision module.
  • the dual-core processor receives and sends the avoidance interaction control instruction to the motion control module 10, and the motion control module 10 matches the motion parameters of the corresponding avoidance action according to the avoidance interaction control instruction, and controls the movement of the moving part according to the avoidance action
  • the parameters complete the avoidance action, that is, control the AI intelligent programming bionic robot to adjust the direction or movement mode, so as to avoid obstacles.
  • the display module 11 displays various expressions according to the adapted expression data, and displays a corresponding prompt when it detects that the control system enters each preset interaction mode of each application control module 4.
  • the display module 11 may be two special eye-shaped LED dot matrix screens.
  • the dot matrix screen is two 8 * 8 total 128 independent LED dot matrixes, and the LED emission color is a yellow matte surface.
  • the touch detection module 8 matches the touch interaction control instructions in the touch detection module 8 according to each touch parameter of the user's touch operation; the posture detection module 6 always detects 360 degrees in all directions AI smart programming bionic robot's current standing, falling down, right down and lying down postures, and will detect its posture when the AI smart programming bionic robot is in different modes, matching the posture adjustment parameters according to the detected current posture; obstacles After detecting the obstacle, the detection module 9 generates an avoidance interactive control instruction; each module transmits the matched interactive control instruction or adjustment parameter to the processor module 2, and the processor module 2 sends each received interactive control instruction and adjustment parameter To each module in the reaction adaptation module 3, the AI intelligent programming bionic robot completes the corresponding feedback from each module, and the display module 11 displays various expressions according to the expression data display instructions to express the emotional changes of the AI intelligent programming bionic robot, When the control system enters each preset interaction mode, a corresponding prompt is displayed.
  • the motion control module 10 controls each moving part of the AI intelligent programming bionic robot to complete corresponding actions, such as turning, sitting, lying, rolling, advancing, retreating, etc.
  • the motion control module 10 may include: an angle detection unit, a PID algorithm unit, and a motor execution unit, the angle detection unit is used to detect the rotation angle of the structure-separated steering gear built into the AI intelligent programming bionic robot;
  • the PID algorithm unit is used to calculate the motion of the AI intelligently programmed bionic robot through the PID algorithm according to the rotation angle;
  • the motor execution unit is used to control the AI intelligently programmed bionic robot to perform the corresponding motion through the motor according to the motion.
  • the application control module 4 can control the movement of the AI intelligent programming bionic robot and play audio content based on the operation input by the user through the mobile phone.
  • the application control module 4 includes four major unit blocks: an action remote control unit, an intelligent programming unit, an online music unit, and an intelligent feeding unit And multi-machine interactive unit.
  • the motion remote control unit can receive the user's real-time control of the AI smart programming bionic robot movement through the mobile phone APP, for example, by acquiring the touch sliding path input by the user through the mobile phone APP to control the AI smart programming bionic robot to move forward, backward, walk left and right, and complete Such as sitting down, rolling, turning in circles, dancing with a music show for a variety of movements;
  • the online music unit can receive audio through the Bluetooth module 5 of the AI intelligent programming bionic robot and play the audio data content selected by the user through the audio output module 12;
  • the intelligent feeding unit is used to receive the food from the user by dragging the food option to the AI intelligent programming bionic robot.
  • the AI intelligent programming bionic robot makes different reactions according to different foods.
  • the user uses the interactive mode interface shown in After entering the loving feeding mode, the user selects and drags "food” on the displayed food chain, and according to the dragging path, "posts” the picture corresponding to "food” to the displayed AI intelligent programming bionics according to the dragging path Near the robot picture to complete the "feeding" action, the application control module determines the type of "food” selected by the user, matches the matching results of "not eatable” and “not favorite food” according to the type of "food”, and passes the Bluetooth module 5.
  • the processor module 2 controls the motion control module 10 to save “dead” and all actions of the AI intelligent programming bionic robot. "Ignored” and other actions.
  • the multi-machine interactive unit is used to receive user on-demand information through the mobile APP, and connect multiple AI intelligent programming bionic robots to perform specific performances, for example, when the user uses the mobile APP to connect multiple AI intelligent programming bionic robots via Bluetooth BLE , Number the robots accordingly, other users can perform individual operation performance on the specific number of AI intelligent programming bionic robots through the mobile phone APP, or choose any number to combine to perform actions and audio operations on the combined AI intelligent programming bionic robots.
  • the AI intelligent programming bionic robot is controlled by the motion control module 10 to complete corresponding actions.
  • the application control module 4 includes four major unit blocks: an action remote control unit, an intelligent programming unit, an online music unit, an intelligent feeding unit, and multi-machine interaction
  • the unit based on the operation input by the user through the mobile phone, controls the movement of the AI intelligent programming bionic robot and plays audio content, receives the audio through the Bluetooth module 5 of the AI intelligent programming bionic robot, and plays the content selected by the user through the audio output module 12, so that the user Choose to play any online or local audio data, and based on each unit module, add various entertainment interaction modes to control the AI intelligent programming bionic robot to start various functions or complete corresponding interactive actions, which not only enhances the entertainment of the robot, but also achieves The educational and educational effects of robots on users.
  • FIG. 4 is a schematic flowchart of an embodiment of a control method of an AI intelligent programming bionic robot of the present application.
  • the embodiment of the present application provides an embodiment of the control method of the AI intelligent programming bionic robot. It should be noted that although the logic sequence is shown in the flowchart, in some cases, it may be executed in an order different from here The steps shown or described.
  • Step S10 After acquiring external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module.
  • the data acquisition module After receiving the sound, image or vibration data in the external environment, the data acquisition module extracts the feature value of the sound, image or vibration data through a specific extraction algorithm, and matches the extracted feature value with the preset interactive control instruction To generate corresponding interactive control instructions.
  • the "send me” voice of the "sit me down” voice issued by the user is extracted through a speech text extraction algorithm "Sit down” text information feature value, and match the extracted "Sit me down” text information feature value to the corresponding "Sit me down” text information in the interactive control instruction library corresponding to the pre-saved text information "Sit down” voice control instruction, thereby realizing recognition of the "sit down” voice control instruction in the "sit down” voice issued by the user.
  • the voice interaction module can also identify the volume of the user's voice or the ambient sound volume according to the sound volume extraction algorithm, and generate interactive responses to the interactive commands according to the volume.
  • the control system of the AI intelligent programming bionic robot can use the volume React to interactive control instructions, control the corresponding interactive feedback of the motion control module and / or audio output module and the display module in the reaction adaptation module. For example, when the voice interaction module detects that the ambient sound contains a loud “thunder” sound, it generates a corresponding “fright” reaction interactive instruction.
  • the audio output module in the reaction adaptation module is simultaneously controlled to output a preset “scared” sound
  • the display module is controlled to display a preset “scared” expression
  • the motion control module is controlled to complete a preset “scared” action.
  • step S20 the processor module transmits the interactive control instruction to the corresponding reaction adaptation module.
  • the generated interactive control instructions are sent to the processor module in the control system.
  • the processor module receives the interactive control instructions and sends the interactive control instructions to the reaction adaptation module. Motion control module, display module or audio output module.
  • the motion control module controls the moving parts of the AI intelligent programming bionic robot according to the motion data in the interactive feedback data matched by the reaction adaptation module to perform corresponding actions according to the motion data.
  • the AI intelligent programming bionic robot moves.
  • the processor module may be a dual-core processor including two 32-bit MCUs.
  • the voice interaction module in the data acquisition module recognizes the "sit down” voice control instruction in the voice made by the user
  • the recognized "sit down” voice control instruction is sent to the dual-core processor, and the dual-core processor receives and executes
  • the "sit down” voice control instruction sends the "sit down” voice control instruction to the motion control module in the reaction adaptation module adapted to the "sit down” action.
  • Step S30 the reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
  • the reaction adaptation module After receiving the interactive control instruction sent by the processor module, the reaction adaptation module adapts the interactive feedback data according to the interactive control instruction and the AI intelligent programming bionic robot, and controls the AI intelligent programming bionic robot to complete the corresponding feedback according to the interactive feedback data.
  • the motion control module after receiving the "sitting down” voice control instruction sent by the processor module, the motion control module adapts the interactive feedback data according to the "sitting down” voice control instruction and the current state parameter of the AI intelligent programming bionic robot, For example, if the current state of the AI intelligent programming bionic robot is "hungry", the motion control module will reduce the "speed” parameter in the motion data of the "sit down” action pointed to by the "sit down” voice control instruction.
  • the "speed” parameter reduces the motion data of the "sit down” action after adaptation, and controls the moving parts of the AI intelligent programming bionic robot to "slow down”.
  • each moving part of the AI intelligent programming bionic robot is a hardware structure such as movable limbs or joints.
  • an interactive control instruction is generated according to the external environment data, and the interactive control instruction is sent to the processor module; the processor The module transmits the interactive control instruction to the corresponding reaction adaptation module; the reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionics according to the interactive feedback data
  • the robot completes the corresponding feedback.
  • the voice feature value in the user's voice or the ambient voice is extracted through a specific extraction algorithm, and the extracted feature value and the voice control instruction in the preset voice mode library
  • the voice control instruction in the voice made by the user is recognized, and after the voice module recognizes the voice control instruction in the voice made by the user, the recognized voice control instruction is sent to the processor module in the control system.
  • the module receives the voice control instruction and executes the voice control instruction to control the motion module in the control system of the AI intelligent programming bionic robot to complete the corresponding action in the preset motion mode.
  • the characteristic value in the sound, image or vibration data is extracted through a specific extraction algorithm, and the extracted characteristic value is performed with the preset interactive control instruction Match, and then generate corresponding interactive control instructions.
  • the generated interactive control instructions are sent to the processor module in the control system.
  • the processor module receives the interactive control instructions and sends each interactive The control instruction is sent to the motion control module, the display module or the audio output module in the reaction adaptation module.
  • the reaction adaptation module adapts to the AI intelligent programming bionic robot according to the interactive control instruction Interactive feedback data, and control the AI intelligent programming bionic robot to complete the corresponding feedback according to the interactive feedback data.
  • the AI intelligent programming bionic robot Based on external environment data and user's various control operations, it automatically detects and recognizes environmental data and generates interactive control instructions. According to the interactive control instructions and AI intelligent programming bionic robot current state parameters, it automatically matches the corresponding interactive feedback data, and according to the interactive feedback data Control the AI intelligent programming bionic robot to complete the corresponding interactive feedback actions, improve the interactive performance between the intelligent robot and the user and the environment, make the intelligent robot truly achieve the real bionic effect, and improve the user's experience.
  • the embodiments of the present application also provide a computer-readable storage medium, and the computer-readable storage medium may be a non-volatile readable storage medium.
  • the computer-readable storage medium of the present application stores computer-readable instructions, which when executed by the processor, implement the steps of the control method of the AI intelligent programming bionic robot as described above.

Abstract

A control system and method for an AI intelligent programming bionic robot, and a readable storage medium, comprising: a data acquisition module (1), a processor module (2), and a reactive adaptation module (3). The data acquisition module (1) and the reactive adaptation module (3) respectively are communicatively connected to the processor module (2). When the data acquisition module (1) acquires external environment data, same generates an interactive control instruction on the basis of the external environment data and transmits the interactive control instruction to the processor module (2); the processor module (2) transmits the interactive control instruction to the corresponding reactive adaptation module (3); and the reactive adaptation module (3) adapts to interactive feedback data on the basis of the interactive control instruction and controls the AI intelligent programming bionic robot to complete a corresponding feedback on the basis of the interactive feedback data. The overall interactive performance of the robot is increased, thus allowing the intelligent robot to truly attain real bionic effects.

Description

AI智能编程仿生机器人的控制系统、方法及存储介质 Control system, method and storage medium of AI intelligent programming bionic robot The
本申请要求于2018年11月19日提交中国专利局、申请号为201811380146.8、发明名称为“AI智能编程仿生机器人的控制系统、方法及计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在申请中。This application requires the priority of the Chinese patent application filed on November 19, 2018 in the Chinese Patent Office with the application number 201811380146.8 and the invention titled "AI Intelligent Programming Bionic Robot Control System, Method and Computer-readable Storage Medium" The entire content is incorporated into the application by reference.
技术领域Technical field
本申请涉及智能机器人技术领域,尤其涉及一种AI智能编程仿生机器人的控制系统、方法及计算机可读存储介质。The present application relates to the technical field of intelligent robots, and in particular, to a control system, method, and computer-readable storage medium of an AI intelligent programming bionic robot.
背景技术Background technique
伴随科技和时代的进步和人们生活质量的提高,越来越多的家庭都会选择饲养宠物,但是由于饲养宠物需要花费大量的时间,且宠物身上通常携带有病菌等情况,非常不适于人体健康,于是为了解决这些问题,众多的仿生机器玩具就出现了,例如仿生机器人和仿生机器宠物等。但是,现有的仿生机器人和仿生机器宠物结构外形单一,动作僵硬,没有情感,并且不能实现教育益智。机器人整体互动效果差,无法达到真实仿生的效果。因此,现有技术急需改进和进一步发展。With the advancement of technology and the times and the improvement of people's quality of life, more and more families will choose to keep pets, but because it takes a lot of time to keep pets, and the pets usually carry bacteria and other conditions, it is very unsuitable for human health. So in order to solve these problems, many bionic machine toys appeared, such as bionic robots and bionic robot pets. However, the existing bionic robots and bionic robot pets have a single structure, rigid movements, no emotions, and cannot achieve educational puzzles. The overall interaction effect of the robot is poor, and the real bionic effect cannot be achieved. Therefore, the existing technology urgently needs improvement and further development.
发明内容Summary of the invention
本申请的主要目的在于提供一种AI智能编程仿生机器人的控制系统、方法及计算机可读存储介质,旨在解决现有技术中机器人整体互动效果差,无法达到真实仿生的效果的技术问题。The main purpose of the present application is to provide a control system, method and computer-readable storage medium for an AI intelligently programmed bionic robot, which aims to solve the technical problem that the overall interaction effect of the robot in the prior art is poor and the true bionic effect cannot be achieved.
为实现上述目的,本申请提供一种AI智能编程仿生机器人的控制系统,所述控制系统包括:数据获取模块、处理器模块和反应适配模块,所述数据获取模块和反应适配模块分别与所述处理器模块通信连接,In order to achieve the above object, the present application provides a control system for an AI intelligent programming bionic robot. The control system includes: a data acquisition module, a processor module, and a reaction adaptation module. The data acquisition module and reaction adaptation module are The processor module is communicatively connected,
所述数据获取模块在获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令,并将所述交互控制指令发送至所述处理器模块;After acquiring the external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module;
所述处理器模块将所述交互控制指令传递至对应的所述反应适配模块;The processor module transmits the interactive control instruction to the corresponding reaction adaptation module;
所述反应适配模块根据所述交互控制指令适配交互反馈数据,并根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈。The reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
可选地,所述控制系统还包括:应用控制模块和蓝牙模块,所述应用控制模块通过所述蓝牙模块与所述处理器模块通信连接,Optionally, the control system further includes: an application control module and a Bluetooth module, and the application control module is communicatively connected to the processor module through the Bluetooth module,
所述应用控制模块在获取用户的各操作指令之后,根据各所述操作指令进入相应的各预设交互模式,并通过所述蓝牙模块将各所述预设交互模式中的交互控制指令发送至所述处理器模块。After obtaining the operation instructions of the user, the application control module enters the corresponding preset interaction modes according to the operation instructions, and sends the interaction control instructions in the preset interaction modes to the Bluetooth module The processor module.
可选地,所述应用控制模块设置有智能编程单元,所述智能编程单元根据用户输入的文本内容生成编程交互指令,所述AI智能编程仿生机器人根据所述编程交互指令实现相应逻辑和/或功能。Optionally, the application control module is provided with an intelligent programming unit that generates programming interaction instructions according to text content input by the user, and the AI intelligent programming bionic robot implements corresponding logic and / or according to the programming interaction instructions Features.
可选地,所述蓝牙模块为双模蓝牙模块,Optionally, the Bluetooth module is a dual-mode Bluetooth module,
所述蓝牙模块将所述应用控制模块各所述预设交互模式中的所述交互控制指令,传输至所述处理器模块,并将音频数据传输至所述AI智能编程仿生机器人的音频模块。The Bluetooth module transmits the interaction control instruction in each of the preset interaction modes of the application control module to the processor module, and transmits audio data to the audio module of the AI intelligent programming bionic robot.
可选地,所述控制系统还包括:姿态检测模块,所述姿态检测模块与所述处理器模块通信连接,Optionally, the control system further includes: an attitude detection module, the attitude detection module is in communication connection with the processor module,
所述姿态检测模块根据检测所述AI智能编程仿生机器人当前的姿态,生成姿态调整数据,并将所述预设姿态调整数据发送至所述处理器模块;The posture detection module generates posture adjustment data based on detecting the current posture of the AI intelligent programming bionic robot, and sends the preset posture adjustment data to the processor module;
所述处理器模块将所述姿态调整数据传递至所述运动控制模块;The processor module transmits the posture adjustment data to the motion control module;
所述运功控制模块根据所述姿态调整参数控制所述AI智能编程仿生机器人的所述运动部件根据所述运动数据执行相应动作。The motion control module controls the moving parts of the AI intelligently programmed bionic robot to perform corresponding actions according to the motion data according to the posture adjustment parameters.
可选地,所述数据获取模块包括:语音交互模块、触摸检测模块和障碍检测模块,Optionally, the data acquisition module includes: a voice interaction module, a touch detection module and an obstacle detection module,
所述语音模块在接收到用户声音之后,根据所述用户声音的声音特征值生成语音交互控制指令,并将所述语音控制指令发送至所述处理器模块;After receiving the user voice, the voice module generates a voice interaction control instruction according to the voice feature value of the user voice, and sends the voice control instruction to the processor module;
所述触摸检测模块在检测到用户的触摸操作之后,根据所述触摸操作的触摸参数生成触摸交互控制指令,并将所述触摸交互控制指令发送至所述处理器模块;After detecting the user's touch operation, the touch detection module generates a touch interaction control instruction according to the touch parameter of the touch operation, and sends the touch interaction control instruction to the processor module;
所述障碍检测模块在检测到障碍物之后,生成避让交互控制指令,并将所述避让交互指令发送至所述处理器模块。After detecting the obstacle, the obstacle detection module generates an avoidance interaction control instruction, and sends the avoidance interaction instruction to the processor module.
可选地,所述反应适配模块根据所述处理器模块传递的各所述交互控制指令,结合所述AI智能编程仿生机器人当前所处状态适配各交互反馈数据。Optionally, the reaction adaptation module adapts each interactive feedback data according to the current state of the AI intelligent programming bionic robot according to each interactive control instruction transmitted by the processor module.
可选地,所述反应适配模块包括:运动控制模块、显示模块和音频输出模块,Optionally, the reaction adaptation module includes: a motion control module, a display module and an audio output module,
所述运动控制模块根据所述交互反馈数据中的运动数据,控制所述AI智能编程仿生机器人的运动部件根据所述运动数据执行相应动作;The motion control module controls the moving parts of the AI intelligent programming bionic robot to perform corresponding actions according to the motion data according to the motion data in the interactive feedback data;
所述显示模块根据所述交互反馈数据中的表情数据显示各种表情,并在检测到所述控制系统进入各所述预设交互模式时,显示相应提示;The display module displays various expressions according to the expression data in the interaction feedback data, and displays a corresponding prompt when detecting that the control system enters each of the preset interaction modes;
所述音频输出模块根据所述交互反馈数据中的音频数据,控制所述AI智能编程仿生机器人的声音输出部件播放相应声音。The audio output module controls the sound output part of the AI intelligent programming bionic robot to play the corresponding sound according to the audio data in the interactive feedback data.
本申请还提供AI智能编程仿生机器人的控制方法,所述AI智能编程仿生机器人的控制方法基于上述AI智能编程仿生机器人的控制系统,所述控制方法包括:The present application also provides a control method of an AI intelligent programming bionic robot. The control method of the AI intelligent programming bionic robot is based on the control system of the AI intelligent programming bionic robot described above. The control method includes:
所述数据获取模块在获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令,并将所述交互控制指令发送至所述处理器模块;After acquiring the external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module;
所述处理器模块将所述交互控制指令传递至对应的所述反应适配模块;The processor module transmits the interactive control instruction to the corresponding reaction adaptation module;
所述反应适配模块根据所述交互控制指令适配交互反馈数据,并根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈。The reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
此外,为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机可读指令,所述计算机可读指令被处理器执行时实现如上所述的AI智能编程仿生机器人的控制方法步骤。In addition, in order to achieve the above object, the present application also provides a computer-readable storage medium having computer-readable instructions stored on the computer-readable storage medium, the computer-readable instructions executed by the processor to achieve the above AI intelligent programming bionic robot control method steps.
本申请通过数据获取模块在获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令,并将所述交互控制指令发送至所述处理器模块;所述处理器模块将所述交互控制指令传递至对应的所述反应适配模块;所述反应适配模块根据所述交互控制指令适配交互反馈数据,并根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈。In this application, after acquiring external environment data through a data acquisition module, an interactive control instruction is generated according to the external environment data, and the interactive control instruction is sent to the processor module; the processor module controls the interaction The instruction is transferred to the corresponding reaction adaptation module; the reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
通过该控制系统中的数据获取模块在接收外部环境数据之后,根据声音识别、图像识别或者振动监测算法,提取出该外部环境数据中的声音、图像或者振动特征值,并根据各特征值生成相应的语音交互控制指令、避让交互控制指令或者触摸交互控制指令,并将各交互控制指令发送至该控制系统的处理器模块,处理器模块将接收到的各交互控制指令分别发送至相应的反应适配模块中,反应适配模块根据各交互控制指令和AI智能编程仿生机器人的当前的状态参数适配与各交互控制指令相应的交互反馈数据,各反应适配模块根据各交互反馈数据控制AI智能编程仿生机器人完成相应的交互反馈。After receiving the external environment data, the data acquisition module in the control system extracts the sound, image or vibration characteristic values in the external environment data according to the sound recognition, image recognition or vibration monitoring algorithm, and generates corresponding according to each characteristic value Voice interactive control instruction, avoidance interactive control instruction or touch interactive control instruction, and send each interactive control instruction to the processor module of the control system, and the processor module sends each received interactive control instruction to the corresponding response appropriate In the matching module, the reaction adaptation module adapts the interactive feedback data corresponding to each interactive control instruction according to each interactive control instruction and the current state parameters of the AI intelligent programming bionic robot, and each reaction adaptation module controls the AI intelligence according to each interactive feedback data Programming the bionic robot to complete the corresponding interactive feedback.
实现了基于外部环境数据和用户的各控制操作,自动检测识别环境数据并生成交互控制指令,根据交互控制指令和AI智能编程仿生机器人当前状态参数自动匹配相应的交互反馈数据,并根据交互反馈数据控制AI智能编程仿生机器人完成相应交互反馈动作,提高了机器人整体互动性能,使智能机器人真正达到真实仿生的效果。Based on external environment data and user's various control operations, it automatically detects and recognizes environmental data and generates interactive control instructions. According to the interactive control instructions and AI intelligent programming bionic robot current state parameters, it automatically matches the corresponding interactive feedback data, and according to the interactive feedback data Control the AI intelligent programming bionic robot to complete the corresponding interactive feedback action, improve the overall interactive performance of the robot, and make the intelligent robot truly achieve the effect of real bionic.
附图说明BRIEF DESCRIPTION
图1是本申请实施例方案涉及的硬件运行环境的终端结构示意图;FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in an embodiment of the present application;
图2为本申请AI智能编程仿生机器人的控制系统的结构布局示意图;2 is a schematic diagram of the structural layout of the control system of the AI intelligent programming bionic robot of the present application;
图3为本申请AI智能编程仿生机器人的控制系统一实施例中界面示意图;3 is a schematic view of an interface in an embodiment of a control system of an AI intelligent programming bionic robot of the present application;
图4为本申请AI智能编程仿生机器人的控制方法一实施例的流程示意图。4 is a schematic flowchart of an embodiment of a control method of an AI intelligent programming bionic robot of the present application.
附图标号说明:Description of Drawing Symbols:
标号Label 名称name 标号Label 名称name
11 数据获取模块Data acquisition module 22 处理器模块Processor module
33 反应适配模块Reaction adaptation module 44 应用控制模块Application Control Module
55 蓝牙模块Bluetooth module 66 姿态检测模块Attitude detection module
77 语音交互模块Voice interaction module 88 触摸检测模块Touch detection module
99 障碍检测模块Obstacle detection module 1010 运动控制模块Motion control module
1111 显示模块Display module 1212 音频输出模块Audio output module
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The implementation, functional characteristics and advantages of the present application will be further described in conjunction with the embodiments and with reference to the drawings.
具体实施方式detailed description
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.
本申请实施例的主要解决方案是:所述数据获取模块在获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令,并将所述交互控制指令发送至所述处理器模块;所述处理器模块将所述交互控制指令传递至对应的所述反应适配模块;所述反应适配模块根据所述交互控制指令适配交互反馈数据,并根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈。The main solution of the embodiment of the present application is: after acquiring the external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module; The processor module transmits the interactive control instruction to the corresponding reaction adaptation module; the reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI according to the interactive feedback data The intelligent programming bionic robot completes the corresponding feedback.
如图1所示,图1是本申请实施例方案涉及的硬件运行环境的装置所属终端结构示意图。As shown in FIG. 1, FIG. 1 is a schematic structural diagram of a terminal to which a device in a hardware operating environment according to an embodiment of the present application belongs.
本申请实施例终端承载有AI智能编程仿生机器人的控制系统。The terminal of the embodiment of the present application carries a control system of an AI intelligent programming bionic robot.
如图1所示,该终端可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to implement connection communication between these components. The user interface 1003 may include a display (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage. The memory 1005 may optionally be a storage device independent of the foregoing processor 1001.
可选地,终端还可以包括摄像头、RF(Radio Frequency,射频)电路,传感器、音频电路、WiFi模块等等。其中,传感器比如光传感器、运动传感器以及其他传感器。具体地,光传感器可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示屏的亮度,接近传感器可在移动终端移动到耳边时,关闭显示屏和/或背光。作为运动传感器的一种,重力加速度传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别移动终端姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;当然,移动终端还可配置陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。Optionally, the terminal may also include a camera, RF (Radio Frequency (radio frequency) circuits, sensors, audio circuits, WiFi modules, etc. Among them, sensors such as light sensors, motion sensors and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display screen according to the brightness of the ambient light, and the proximity sensor may turn off the display screen and / or when the mobile terminal moves to the ear Backlight. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when at rest. It can be used for applications that recognize the posture of mobile terminals (such as horizontal and vertical screen switching, Related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tap), etc. Of course, the mobile terminal can also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. No longer.
本领域技术人员可以理解,图1中示出的终端结构并不构成对终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art may understand that the terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or fewer components than those illustrated, or combine certain components, or arrange different components.
如图1所示,作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及计算机可读指令。As shown in FIG. 1, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and computer-readable instructions.
在图1所示的终端中,网络接口1004主要用于连接后台服务器,与后台服务器进行数据通信;用户接口1003主要用于连接客户端(用户端),与客户端进行数据通信;而处理器1001可以用于调用存储器1005中存储的传计算机可读指令,并执行以下操作:In the terminal shown in FIG. 1, the network interface 1004 is mainly used to connect to the back-end server and perform data communication with the back-end server; the user interface 1003 is mainly used to connect to the client (user end) and perform data communication with the client; and the processor 1001 can be used to call computer-readable instructions stored in the memory 1005 and perform the following operations:
所述数据获取模块在获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令,并将所述交互控制指令发送至所述处理器模块;After acquiring the external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module;
所述处理器模块将所述交互控制指令传递至对应的所述反应适配模块;The processor module transmits the interactive control instruction to the corresponding reaction adaptation module;
所述反应适配模块根据所述交互控制指令适配交互反馈数据,并根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈。The reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
进一步地,所述控制系统还包括:应用控制模块和蓝牙模块,所述应用控制模块通过所述蓝牙模块与所述处理器模块通信连接,Further, the control system further includes: an application control module and a Bluetooth module, and the application control module communicates with the processor module through the Bluetooth module,
所述应用控制模块在获取用户的各操作指令之后,根据各所述操作指令进入相应的各预设交互模式,并通过所述蓝牙模块将各所述预设交互模式中的交互控制指令发送至所述处理器模块。After obtaining the operation instructions of the user, the application control module enters the corresponding preset interaction modes according to the operation instructions, and sends the interaction control instructions in the preset interaction modes to the Bluetooth module The processor module.
进一步地,所述应用控制模块设置有智能编程单元,所述智能编程单元根据用户输入的文本内容生成编程交互指令,所述AI智能编程仿生机器人根据所述编程交互指令实现相应逻辑和/或功能。Further, the application control module is provided with an intelligent programming unit that generates programming interaction instructions according to text content input by the user, and the AI intelligent programming bionic robot implements corresponding logic and / or functions according to the programming interaction instructions .
进一步地,所述蓝牙模块为双模蓝牙模块,Further, the Bluetooth module is a dual-mode Bluetooth module,
所述蓝牙模块将所述应用控制模块各所述预设交互模式中的所述交互控制指令,传输至所述处理器模块,并将音频数据传输至所述AI智能编程仿生机器人的音频输出模块。The Bluetooth module transmits the interaction control instruction in each of the preset interaction modes of the application control module to the processor module, and transmits audio data to the audio output module of the AI intelligent programming bionic robot .
进一步地,所述控制系统还包括:姿态检测模块,所述姿态检测模块与所述处理器模块通信连接,Further, the control system further includes: an attitude detection module, the attitude detection module is in communication connection with the processor module,
所述姿态检测模块根据检测所述AI智能编程仿生机器人当前的姿态,匹配预设姿态调整指令,并将所述预设姿态调整指令发送至所述处理器模块,所述处理器模块根据所述预设姿态调整指令,控制所述运动模块执行所述预设运动模式中的相应动作。The posture detection module matches a preset posture adjustment instruction according to detecting the current posture of the AI intelligent programming bionic robot, and sends the preset posture adjustment instruction to the processor module, and the processor module according to the A preset posture adjustment instruction controls the motion module to perform the corresponding action in the preset motion mode.
进一步地,所述数据获取模块包括:语音交互模块、触摸检测模块和障碍检测模块,Further, the data acquisition module includes: a voice interaction module, a touch detection module and an obstacle detection module,
所述语音模块在接收到用户声音之后,根据所述用户声音的声音特征值生成语音交互控制指令,并将所述语音控制指令发送至所述处理器模块;After receiving the user voice, the voice module generates a voice interaction control instruction according to the voice feature value of the user voice, and sends the voice control instruction to the processor module;
所述触摸检测模块在检测到用户的触摸操作之后,根据所述触摸操作的触摸参数生成触摸交互控制指令,并将所述触摸交互控制指令发送至所述处理器模块;After detecting the user's touch operation, the touch detection module generates a touch interaction control instruction according to the touch parameter of the touch operation, and sends the touch interaction control instruction to the processor module;
所述障碍检测模块在检测到障碍物之后,生成避让交互控制指令,并将所述避让交互指令发送至所述处理器模块。After detecting the obstacle, the obstacle detection module generates an avoidance interaction control instruction, and sends the avoidance interaction instruction to the processor module.
进一步地,所述反应适配模块根据所述处理器模块传递的各所述交互控制指令,结合所述AI智能编程仿生机器人当前所处状态的状态参数适配各交互反馈数据。Further, the reaction adaptation module adapts each interactive feedback data according to each interactive control instruction transmitted by the processor module, combined with state parameters of the current state of the AI intelligent programming bionic robot.
进一步地,所述反应适配模块包括:运动控制模块、显示模块和音频输出模块,Further, the reaction adaptation module includes: a motion control module, a display module and an audio output module,
所述运动控制模块根据所述交互反馈数据中的运动数据,控制所述AI智能编程仿生机器人的运动部件根据所述运动数据执行相应动作;The motion control module controls the moving parts of the AI intelligent programming bionic robot to perform corresponding actions according to the motion data according to the motion data in the interactive feedback data;
所述显示模块根据所述交互反馈数据中的表情数据显示各种表情,并在检测到所述控制系统进入各所述预设交互模式时,显示相应提示;The display module displays various expressions according to the expression data in the interaction feedback data, and displays a corresponding prompt when detecting that the control system enters each of the preset interaction modes;
所述音频输出模块根据所述交互反馈数据中的音频数据,控制所述AI智能编程仿生机器人的声音输出部件播放相应声音。The audio output module controls the sound output part of the AI intelligent programming bionic robot to play the corresponding sound according to the audio data in the interactive feedback data.
参照图2,图2是本申请传感器融合系统一实施例的结构布局示意图。Referring to FIG. 2, FIG. 2 is a schematic structural layout diagram of an embodiment of a sensor fusion system of the present application.
本申请提出一种AI智能编程仿生机器人的控制系统,如图2所示,所述传控制系统包括:数据获取模块1、处理器模块2、反应适配模块3、应用控制模块4、蓝牙模块5和姿态检测模块6,数据获取模块1和反应适配模块3分别与处理器模块2通信连接,应用控制模块4通过蓝牙模块5和处理器模块2通信连接;其中,数据获取模块1包括:语音交互模块7、触摸检测模块8和障碍检测模块9,反应适配模块3包括:运动控制模块10、显示模块11和音频输出模块12。This application proposes a control system of AI intelligent programming bionic robot. As shown in FIG. 2, the transmission control system includes: a data acquisition module 1, a processor module 2, a reaction adaptation module 3, an application control module 4, and a Bluetooth module 5 and the posture detection module 6, the data acquisition module 1 and the reaction adaptation module 3 are respectively communicatively connected to the processor module 2, and the application control module 4 is communicatively connected to the processor module 2 through the Bluetooth module 5; wherein, the data acquisition module 1 includes: The voice interaction module 7, the touch detection module 8 and the obstacle detection module 9, and the reaction adaptation module 3 include: a motion control module 10, a display module 11 and an audio output module 12.
在本申请AI智能编程仿生机器人的控制系统的第一实施例中,数据获取模块1在接收到外部环境中声音、图像或者振动数据后,通过特定的提取算法提取出该声音、图像或者振动数据中的特征值,将提取到的特征值与预设交互控制指令进行匹配,进而生成相应的交互控制指令。In the first embodiment of the control system of the AI intelligent programming bionic robot of the present application, after receiving the sound, image or vibration data in the external environment, the data acquisition module 1 extracts the sound, image or vibration data through a specific extraction algorithm In the feature value in, the extracted feature value is matched with the preset interactive control instruction, and then the corresponding interactive control instruction is generated.
需要说明的是,预设交互控制指令可以为预先保存文本信息、音量大小、障碍图像或者振动量大小等对应的交互控制指令库。It should be noted that the preset interactive control instruction may be a corresponding interactive control instruction library that previously saves text information, volume level, obstacle image, or vibration amount level.
具体地,例如,当数据获取模块1中的语音交互模块7接收到用户发出的“给我坐下”声音之后,通过语音文本提取算法提取出用户发出的“给我坐下”声音中的“给我坐下”文本信息特征值,并将提取出的“给我坐下”文本信息特征值,在预先保存文本信息所对应的交互控制指令库中匹配到“给我坐下”文本信息所对应的“坐下”语音控制指令,由此实现识别出用户发出的“给我坐下”声音中的“坐下”语音控制指令。Specifically, for example, after the voice interaction module 7 in the data acquisition module 1 receives the "seat me down" voice issued by the user, the "seat me down" voice issued by the user is extracted through a voice text extraction algorithm "Sit me down" text information feature value, and match the extracted "seat me down" text information feature value in the interactive control instruction library corresponding to the pre-saved text information to the "sit me down" text information place Corresponding to the "sit down" voice control instruction, thereby realizing the recognition of the "sit down" voice control instruction in the "sit me" voice issued by the user.
在另一个实施例中,语音交互模块7还可以根据声量提取算法识别用户发出的声音音量或者环境声音音量的大小,根据音量大小生音量反应交互指令,AI智能编程仿生机器人的控制系统可以根据该音量反应交互控制指令,控制反应适配模块3中的运动控制模块10和/或音频输出模块12以及显示模块11相应交互反馈。例如,当语音交互模块7检测到环境声音中含有音量较大的“打雷”声音时,生成相应的“惊吓”反应交互指令,该控制系统中的处理器模块20接收到该“惊吓”反应交互指令之后,则同时控制反应适配模块3中的音频输出模块12输出预先设定的“惊吓”声音,控制显示模块11显示预先设定的“惊吓”表情,以及控制运动控制模块10完成预设的“惊吓”动作。In another embodiment, the voice interaction module 7 can also identify the volume of the sound volume emitted by the user or the volume of the ambient sound according to the sound volume extraction algorithm, and generate interactive responses to the volume based on the volume. The control system of the AI intelligent programming bionic robot can be based on this The volume responds to the interactive control instruction, and controls the motion control module 10 and / or the audio output module 12 and the display module 11 in the response adaptation module 3 to corresponding interactive feedback. For example, when the voice interaction module 7 detects that the ambient sound contains a loud "thunder" sound, it generates a corresponding "stun" reaction interaction instruction, and the processor module 20 in the control system receives the "stun" reaction interaction After the instruction, the audio output module 12 in the reaction adaptation module 3 is simultaneously controlled to output the preset "scared" sound, the display module 11 is controlled to display the preset "scared" expression, and the motion control module 10 is controlled to complete the preset "Fright" action.
在数据获取模块1生成交互控制指令之后,将生成的各交互控制指令发送给控制系统中的处理器模块2,处理器模块2接收各交互控制指令,并将各交互控制指令发送至反应适配模块3中的运动控制模块10、显示模块11或者音频输出模块12。After the data acquisition module 1 generates the interactive control instructions, the generated interactive control instructions are sent to the processor module 2 in the control system, and the processor module 2 receives the interactive control instructions and sends the interactive control instructions to the reaction adaptation The motion control module 10, the display module 11 or the audio output module 12 in the module 3.
需要说明的是,运动控制模块10根据反应适配模块3匹配的交互反馈数据中的运动数据,控制AI智能编程仿生机器人的运动部件根据运动数据执行相应动作AI智能编程仿生机器人动作。It should be noted that the motion control module 10 controls the moving parts of the AI intelligent programming bionic robot according to the motion data in the interactive feedback data matched by the reaction adaptation module 3 to perform corresponding actions according to the motion data. The AI intelligent programming bionic robot moves.
具体地,处理器模块2可以为包括两片32位MCU的双核处理器。Specifically, the processor module 2 may be a dual-core processor including two 32-bit MCUs.
例如,在数据获取模块1中的语音交互模块7识别出用户发出的声音中的“坐下”语音控制指令之后,将识别的“坐下”语音控制指令发送给双核处理器,双核处理器接收并执行该“坐下”语音控制指令,将该坐下”语音控制指令发送给与“坐下”动作相适应的反应适配模块3中的运动控制模块10。For example, after the voice interaction module 7 in the data acquisition module 1 recognizes the "sit down" voice control instruction in the user's voice, the recognized "sit down" voice control instruction is sent to the dual-core processor, and the dual-core processor receives And execute the "sit down" voice control instruction, and send the "sit down" voice control instruction to the motion control module 10 in the reaction adaptation module 3 that is suitable for the "sit down" action.
反应适配模块3在接收到处理器模块2发送的交互控制指令之后,根据交互控制指令和AI智能编程仿生机器人适配交互反馈数据,并根据交互反馈数据控制AI智能编程仿生机器人完成相应反馈。After receiving the interactive control instruction sent by the processor module 2, the reaction adaptation module 3 adapts the interactive feedback data according to the interactive control instruction and the AI intelligent programming bionic robot, and controls the AI intelligent programming bionic robot to complete the corresponding feedback according to the interactive feedback data.
具体地,运动控制模块10在接收到处理器模块2发送的“坐下”语音控制指令后,根据该“坐下”语音控制指令和AI智能编程仿生机器人当前所处的状态参数适配交互反馈数据,例如,AI智能编程仿生机器人当前所处的状态为“饥饿”,则运动控制模块10将“坐下”语音控制指令指向的“坐下”动作的运动数据中“速度”参数减小,根据将“速度”参数减小适配后的“坐下”动作的运动数据,控制AI智能编程仿生机器人的各运动部件“缓慢坐下”。Specifically, after receiving the "sit down" voice control instruction sent by the processor module 2, the motion control module 10 adapts interactive feedback according to the "sit down" voice control instruction and the current state parameters of the AI intelligent programming bionic robot Data, for example, the current state of the AI intelligent programming bionic robot is "hungry", the motion control module 10 reduces the "speed" parameter in the motion data of the "sit down" action pointed to by the "sit down" voice control instruction, According to the motion data of the "sit down" action after reducing the "speed" parameter, the AI intelligent programming bionic robot is controlled to "slow down" the moving parts.
需要说明的是,AI智能编程仿生机器人的各运动部件为可以活动的各肢体或者关节等硬件结构。It should be noted that each moving part of the AI intelligent programming bionic robot is a hardware structure such as movable limbs or joints.
在本实施例中,通过数据获取模块1在接收到外部环境中声音、图像或者振动数据后,通过特定的提取算法提取出该声音、图像或者振动数据中的特征值,将提取到的特征值与预设交互控制指令进行匹配,进而生成相应的交互控制指令,在数据获取模块1生成交互控制指令之后,将生成的各交互控制指令发送给控制系统中的处理器模块2,处理器模块2接收各交互控制指令,并将各交互控制指令发送至反应适配模块3中的运动控制模块10、显示模块11或者音频输出模块12,反应适配模块3在接收到处理器模块2发送的交互控制指令之后,根据交互控制指令和AI智能编程仿生机器人适配交互反馈数据,并根据交互反馈数据控制AI智能编程仿生机器人完成相应反馈。实现了基于外部环境数据和用户的各控制操作,自动检测识别环境数据并生成交互控制指令,根据交互控制指令和AI智能编程仿生机器人当前状态参数自动匹配相应的交互反馈数据,并根据交互反馈数据控制AI智能编程仿生机器人完成相应交互反馈动作,提高了智能机器人与用户和环境之间的互动性能,使智能机器人真正达到了真实仿生的效果,提高了用户的使用体验。In this embodiment, after receiving the sound, image or vibration data in the external environment, the data acquisition module 1 extracts the feature values in the sound, image or vibration data through a specific extraction algorithm, and extracts the extracted feature values Match the preset interactive control instructions to generate corresponding interactive control instructions. After the data acquisition module 1 generates the interactive control instructions, send the generated interactive control instructions to the processor module 2 in the control system. The processor module 2 Receive each interactive control instruction and send each interactive control instruction to the motion control module 10, display module 11 or audio output module 12 in the reaction adaptation module 3, the reaction adaptation module 3 receives the interaction sent by the processor module 2 After the control instruction, the interactive feedback data is adapted to the AI intelligent programming bionic robot according to the interactive control instruction, and the AI intelligent programming bionic robot is controlled according to the interactive feedback data to complete the corresponding feedback. Based on external environment data and user's various control operations, it automatically detects and recognizes environmental data and generates interactive control instructions. According to the interactive control instructions and AI intelligent programming bionic robot current state parameters, it automatically matches the corresponding interactive feedback data, and according to the interactive feedback data Control the AI intelligent programming bionic robot to complete the corresponding interactive feedback actions, improve the interactive performance between the intelligent robot and the user and the environment, make the intelligent robot truly achieve the real bionic effect, and improve the user's experience.
在本申请AI智能编程仿生机器人的控制系统的第二实施例中,应用控制模块4在获取到用户基于应用交互模式输入的各操作指令之后,根据各操作指令的操作参数进入相应的预设交互模式,在预设交互模式中,将基于用户操作产生的交互控制指令,通过蓝牙模块5传递至处理器模块2。In the second embodiment of the control system of the AI intelligent programming bionic robot of the present application, the application control module 4 enters the corresponding preset interaction according to the operation parameters of the operation instructions after acquiring the operation instructions input by the user based on the application interaction mode In the preset interaction mode, the interactive control commands generated based on user operations are transmitted to the processor module 2 through the Bluetooth module 5.
需要说明的是,预设交互模式为应用模块4中,预先保存的根据用户各不同操作控制AI智能编程仿生机器人作出与用户操作相应交互反应的模式。It should be noted that the preset interaction mode is a mode pre-saved in the application module 4 that controls the AI intelligent programming bionic robot to make corresponding interaction reactions with user operations according to different operations of the user.
具体地,应用控制模块4在如图3所示的AI智能编程仿生机器人的控制系统显示界面中,获取到用户基于点击操作输入的进入交互模式操作指令,根据该进入交互模式操作指令确定应用控制模块的各预设交互模式中,指令指向的目标预设交互模式,并进入该目标预设交互模式,在进入目标预设交互模式之后,获取用户的具体操作,并生成交互控制指令,将交互控制指令通过蓝牙模块5发送给控制系统的处理器模块2。Specifically, the application control module 4 obtains a user-entered interactive mode operation instruction based on the click operation input on the display interface of the AI intelligent programming bionic robot as shown in FIG. 3, and determines application control according to the entered interactive mode operation instruction In each preset interaction mode of the module, the instruction points to the target preset interaction mode, and enters the target preset interaction mode. After entering the target preset interaction mode, the user's specific operation is obtained, and an interaction control instruction is generated to interact The control instruction is sent to the processor module 2 of the control system through the Bluetooth module 5.
应用控制模块4设置有智能编程单元、动作遥控单元、在线音乐单元、智能喂养单元以及多极互动单元,每个单元可以控制AI智能编程仿生机器人相对应的功能,智能编程单元根据用户输入的文本内容生成编程交互指令,AI智能编程仿生机器人根据该编程交互指令实现相应逻辑和/或功能。The application control module 4 is provided with an intelligent programming unit, an action remote control unit, an online music unit, an intelligent feeding unit, and a multi-polar interactive unit. Each unit can control the corresponding functions of the AI intelligent programming bionic robot. The intelligent programming unit is based on the text input by the user The content generates programming interaction instructions, and the AI intelligent programming bionic robot realizes corresponding logic and / or functions according to the programming interaction instructions.
具体地,例如,应用控制模块4在用户通过手机点击如图3所示的AI智能编程仿生机器人的控制系统显示界面中的“智能编程模式”操作后,进入控制系统预先保存的根据用户点击“智能编程模式”操作,控制AI智能编程仿生机器人根据用户输入的“程序内容”作出相应交互反应的预设编程交互模式,在该预设编程交互模式中,用户编写一个机器人趴下后再转个圈的动作:从控制指令区里拖出“程序开始”方块至屏幕中间的编辑区,程序执行时,会先执行“程序开始”方块下的指令方块,从动作指令区里拖出“趴下”方块,接在“程序开始”方块下面,再从动作指令区里拖出“转个圈”方块,接在“趴下”方块下面,最后点击执行,应用控制模块4中的智能编程单元将用户编写输入的“趴下-转个圈”交互控制指令通过蓝牙模块5传递至双核处理器模块2,双核处理器模块2执行该“趴下-转个圈”交互控制指令控制运动控制模块10完成 “趴下-转个圈”动作,即控制AI智能编程仿生机器人的各运动部件“趴下来,然后再转个圈”。Specifically, for example, after the user clicks the "intelligent programming mode" operation on the display interface of the control system of the AI intelligent programming bionic robot as shown in FIG. 3 through the mobile phone, the user enters the control system and saves according to the user's click. "Intelligent programming mode" operation, which controls the AI intelligent programming bionic robot to make corresponding interactive response according to the "program content" input by the user. In this preset programming interaction mode, the user writes a robot to lie down and then turn Circle action: Drag the "program start" box from the control instruction area to the editing area in the middle of the screen. When the program is executed, the instruction block under the "program start" box will be executed first, and "get down" from the action instruction area "Block, connect it under the" program start "block, then drag the" turn circle "block from the action instruction area, connect it under the" squat down "block, and finally click to execute, the intelligent programming unit in the application control module 4 will The user writes and enters the "pull down-turn a circle" interactive control instruction to be transmitted to the dual-core processor module 2 through the Bluetooth module 5, and the dual-core processor module 2 executes the "paw down-turns a circle" interactive control instruction to control the motion control module 10 carry out "Paw down-turn a circle" action, that is, control the moving parts of the AI intelligent programming bionic robot "lie down, and then turn a circle".
需要说明的是,智能编程单元可以由编译区、控制模块、逻辑模块、条件模块、动作模块、声音模块和表情模块组成,通过应用控制模块4和蓝牙模块5对AI智能编程仿生机器人进行自定义编程,具体地,智能编程单元中的每个模块都有对应的指令图标,用户可拖动到编译区进行编译和执行,比如控制模块里的指令图标有程序开始、按头开始等指令图标,例如,逻辑模块里的指令图标有“if”、“while”等指令图标,用户可以根据自己设想的动作表情声音进行编译,编译当中可以对每条指令顺序进行修改和删除,以实现特定动能。It should be noted that the intelligent programming unit can be composed of a compilation area, a control module, a logic module, a condition module, an action module, a sound module, and an expression module, and the AI intelligent programming bionic robot can be customized through the application control module 4 and the Bluetooth module 5 Programming, specifically, each module in the intelligent programming unit has a corresponding instruction icon, and the user can drag to the compilation area to compile and execute. For example, the instruction icon in the control module has instruction icons such as program start and start by head. For example, the instruction icons in the logic module include "if", "while" and other instruction icons. The user can compile according to the action expression sound he envisions. During compilation, each instruction sequence can be modified and deleted in order to achieve specific kinetic energy.
蓝牙模块5可以为双模蓝牙模块,应用控制模块4的所有数据,包括:经典蓝牙数据流、BLE数据流等均由蓝牙模块5完成传输,具体地,例如,使用蓝牙2.0传输应用控制模块4在线音乐单元输出的音频类数据,同时使用蓝牙4.0以透传的方式传输应用控制模块4各预设模式中生成的交互控制指令数据,如BLE数据流。The Bluetooth module 5 may be a dual-mode Bluetooth module, and all data of the application control module 4, including: classic Bluetooth data stream, BLE data stream, etc., are all transmitted by the Bluetooth module 5, specifically, for example, the application control module 4 is transmitted using Bluetooth 2.0 At the same time, the audio data output from the online music unit uses Bluetooth 4.0 to transmit the interactive control command data generated in each preset mode of the application control module 4 in a transparent transmission manner, such as a BLE data stream.
需要说明的是,该AI智能编程仿生机器人的控制系统中的音频输出模块12可以为音频放大器和扬声器,将蓝牙芯片输出的音源进行放大,并将放大后的音源驱动扬声器,扬声器可以播放出高品质高保真的声音和音乐,并且当AI智能编程仿生机器人处于音乐播放模式时,输出高品质高保真音乐或者故事。It should be noted that the audio output module 12 in the control system of the AI intelligent programming bionic robot can be an audio amplifier and a speaker, amplify the sound source output by the Bluetooth chip, and drive the amplified sound source to the speaker, the speaker can play a high High-fidelity sounds and music, and when the AI intelligent programming bionic robot is in the music playback mode, output high-quality high-fidelity music or stories.
在本实施例中,通过应用控制模块4在获取用户的各操作指令之后,根据各操作指令进入相应的各预设交互模式,并通过所述蓝牙模块5将各所述预设交互模式中的交互控制指令发送至处理器模块2,并且通过应用控制模块4的智能编程单元根据用户输入的交互程序生成编程交互指令, AI智能编程仿生机器人根据编程交互指令实现相应逻辑和/或功能,蓝牙模块5将应用控制模块4各预设交互模式中的交互控制指令,传输至处理器模块2,并将音频数据传输至AI智能编程仿生机器人的音频输出模块12。实现了基于应用控制模块为用户提供交互内容丰富的交互模式,并根据用户在交互模式中的操作控制AI智能编程仿生机器人实现与用户操作相应的逻辑动作和或者功能,使得AI智能编程仿生机器人与用户的交互性更强,功能更加多元,通过增加智能编程单元锻炼用户的动手能力、想象能力和逻辑思维能力,丰富用户的创造力等,进一步提升了机器人的互动效果和价值性。In this embodiment, after obtaining the user's operation instructions through the application control module 4, according to the operation instructions, the corresponding preset interaction modes are entered, and through the Bluetooth module 5, the preset interaction modes The interactive control instruction is sent to the processor module 2, and the programming interactive instruction is generated according to the interactive program input by the user through the intelligent programming unit of the application control module 4, The AI intelligent programming bionic robot realizes the corresponding logic and / or functions according to the programming interactive instructions. The Bluetooth module 5 transmits the interactive control instructions in the preset interactive modes of the application control module 4 to the processor module 2 and transmits the audio data to the AI The audio output module 12 of the intelligently programmed bionic robot. Realize the interactive mode based on the application control module to provide users with rich interactive content, and control the AI intelligent programming bionic robot according to the user's operation in the interactive mode to realize the logical actions and or functions corresponding to the user's operation, making the AI intelligent programming bionic robot and The user's interaction is stronger and the functions are more diverse. By adding intelligent programming units to exercise the user's practical ability, imagination ability and logical thinking ability, and enriching the user's creativity, the interactive effect and value of the robot are further improved.
在本申请AI智能编程仿生机器人的控制系统的第三实施例中,姿态检测模块6时刻360度全方位检测AI智能编程仿生机器人的当前站立、左倒下、右倒下和躺下等姿态,并在AI智能编程仿生机器人处于不同模式下会检测其姿态,根据检测到的当前姿态在姿态生成姿态调整参数,并将该姿态调整参数发送至处理器模块2,处理器模块2将该姿态调整参数发送至反应适配模块3中的运动控制模块10,运动控制模块10匹配并控制AI智能编程仿生机器人的各活动部件完成相应姿态调整动作。In the third embodiment of the control system of the AI intelligent programming bionic robot of the present application, the posture detection module detects the current standing, falling down, right falling, and lying postures of the AI intelligent programming bionic robot at all times in 360 degrees at all times. And the AI intelligent programming bionic robot will detect its posture in different modes, generate posture adjustment parameters in the posture according to the detected current posture, and send the posture adjustment parameters to the processor module 2, and the processor module 2 adjusts the posture The parameters are sent to the motion control module 10 in the reaction adaptation module 3, and the motion control module 10 matches and controls each active part of the AI intelligently programmed bionic robot to complete the corresponding posture adjustment action.
具体地,例如,在AI智能编程仿生机器人身上设置有五个独立的电位器,电位器上每个角度都有AD值大小,每个动作和姿态都有对应的AD值,姿态检测模块6与处理器模块2连接,姿态检测模块6通过采样每个AD值大小,来矫正和确认AI智能编程仿生机器人当前时刻是否处于“站立”姿态,此外还可以在AI智能编程仿生机器人身体上设置一对倒立检测传感器,倒立检测传感器与处理器模块2连接,通过采集该传感器信息确定AI智能编程仿生机器人是否处于“倒立”姿态,当姿态检测模块6确定当前时刻AI智能编程仿生机器人处于“站立”或者“倒立”时,根据“站立”或者“倒立”姿态在姿态检测模块6中匹配与该“站立”或者“倒立”姿态相匹配的姿态调整参数,并将匹配到的姿态调整参数发送至该控制系统的处理器模块2,处理器模块2接收并将该姿态调整参数发送至运动控制模块10,运动控制模块10根据该姿态调整参数控制该AI智能编程仿生机器人的运动部件根据该姿态调整参数对应的“站直”矫正动作,或者“支撑”调整动作,并控制运动模块30完成匹配成功的“站直”矫正动作,或者“支撑”调整反应动作。Specifically, for example, the AI intelligent programming bionic robot is provided with five independent potentiometers, each angle of the potentiometer has an AD value, and each action and posture has a corresponding AD value. The posture detection module 6 is The processor module 2 is connected, and the posture detection module 6 corrects and confirms whether the AI intelligent programming bionic robot is in a "standing" attitude by sampling each AD value, and a pair of AI intelligent programming bionic robots can also be set The inverted detection sensor, which is connected to the processor module 2, determines whether the AI intelligent programming bionic robot is in the "inverted" posture by collecting the sensor information, and when the attitude detection module 6 determines that the AI intelligent programming bionic robot is in the "standing" or When “Inverted”, match the posture adjustment parameters matching the “standing” or “inverted” posture in the posture detection module 6 according to the “standing” or “inverted” posture, and send the matched posture adjustment parameters to the control The processor module 2 of the system, the processor module 2 receives and sends the posture adjustment parameters to the motion control module 10, and the motion control module 10 controls the moving parts of the AI intelligently programmed bionic robot according to the posture adjustment parameters according to the posture adjustment parameters The "stand straight" corrective action, or "support" adjustment action, and control the motion module 30 to complete the matching "stand straight" corrective action, or "support" adjustment response action.
触摸检测模块8在检测到用户的触摸操作之后,根据用户触摸操作的各触摸参数在触摸检测模块8中匹配触摸交互控制指令,并将触摸交互控制指令发送至所述处理器模块2,处理器模块2将该触摸交互控制指令发送至反应适配模块3,反应适配模块3匹配相应的运动参数,并控制AI智能编程仿生机器人完成相应交互反馈动作。After detecting the user's touch operation, the touch detection module 8 matches the touch interaction control instruction in the touch detection module 8 according to each touch parameter of the user's touch operation, and sends the touch interaction control instruction to the processor module 2, the processor The module 2 sends the touch interaction control instruction to the reaction adaptation module 3, the reaction adaptation module 3 matches corresponding motion parameters, and controls the AI intelligent programming bionic robot to complete the corresponding interactive feedback action.
具体地,触摸检测模块8可以为设置在AI智能编程仿生机器人身体多个位置的触摸点,例如,分别在AI智能编程仿生机器人的下巴部位和后背部位,设置触摸点,通过该触摸点检测用户是否触摸AI智能编程仿生机器人,当检测到用户有触摸AI智能编程仿生机器人时,根据用户触摸操作的触摸力度和触摸时长等触摸参数在触摸检测模块8中匹配与该触摸参数相匹配的触摸交互控制指令,并将匹配到的触摸交互控制指令发送至该控制系统的处理器模块2,处理器模块2接收并将该触摸交互控制指令,发送至该控制系统的反应适配模块3,反应适配模块3匹配与该预设触摸反应指令相对应的运动数据,并根据运动数据控制AI智能编程仿生机器人交互反馈动作。Specifically, the touch detection module 8 may be a touch point set at multiple positions on the body of the AI intelligent programming bionic robot, for example, setting a touch point on the chin and back of the AI intelligent programming bionic robot respectively, and detecting through the touch point Whether the user touches the AI intelligent programming bionic robot. When it is detected that the user has touched the AI intelligent programming bionic robot, the touch detection module 8 matches the touch that matches the touch parameter according to the touch parameters such as the touch intensity and the duration of the user's touch operation. Interactive control instructions, and send the matched touch interactive control instructions to the processor module 2 of the control system, the processor module 2 receives and sends the touch interactive control instructions to the reaction adaptation module 3 of the control system, reacts The adaptation module 3 matches the motion data corresponding to the preset touch response instruction, and controls the AI intelligently programmed bionic robot interactive feedback action according to the motion data.
障碍检测模块9在检测到障碍物之后,生成避让交互控制指令,并将避让交互控制指令发送至处理器模块2,处理器模块2将避让交互控制指令传递至反应适配模块3中的运动控制模块10,运动控制模块10匹配并根据运动参数控制运动部件完成相应的避让动作。After detecting the obstacle, the obstacle detection module 9 generates the avoidance interaction control instruction and sends the avoidance interaction control instruction to the processor module 2, and the processor module 2 transmits the avoidance interaction control instruction to the motion control in the reaction adaptation module 3 Module 10, the motion control module 10 matches and controls the moving parts to complete the corresponding avoidance actions according to the motion parameters.
具体地,障碍检测模块9可以设置为红外视觉模块, AI智能编程仿生机器人基于该红外视觉模块感知外界物体,红外视觉模块包括红外发射单元和红外接收单元,红外发射单元用于发射红外光束,红外接收单元用于接收物体反射回来的红外光;当AI智能编程仿生机器人在运动状态下,AI智能编程仿生机器人可以通过红外视觉模块检测前方是否有障碍物,当检测到有障碍物时,生成避让交互控制指令,并将该避让交互控制指令发送至双核处理器,双核处理器接收并将该避让交互控制指令发送至运动控制模块10,运动控制模块10根据该避让交互控制指令匹配相应的避让动作的运动参数,并控制运动部件根据该避让动作的运动参数完成避让动作,即控制AI智能编程仿生机器人调整方向或者运动模式,从而躲避障碍物。Specifically, the obstacle detection module 9 may be set as an infrared vision module, AI intelligent programming bionic robot perceives external objects based on the infrared vision module. The infrared vision module includes an infrared transmitting unit and an infrared receiving unit. The infrared transmitting unit is used to emit infrared light beams, and the infrared receiving unit is used to receive infrared light reflected by the objects; when the AI Intelligent programming bionic robot In motion, the AI intelligent programming bionic robot can detect whether there is an obstacle in front through the infrared vision module. When an obstacle is detected, it generates an avoidance interactive control instruction and sends the avoidance interactive control instruction to the dual core The processor, the dual-core processor receives and sends the avoidance interaction control instruction to the motion control module 10, and the motion control module 10 matches the motion parameters of the corresponding avoidance action according to the avoidance interaction control instruction, and controls the movement of the moving part according to the avoidance action The parameters complete the avoidance action, that is, control the AI intelligent programming bionic robot to adjust the direction or movement mode, so as to avoid obstacles.
显示模块11根据适配的表情数据显示各种表情,并在检测到控制系统进入各应用控制模块4的各预设交互模式时,显示相应提示。The display module 11 displays various expressions according to the adapted expression data, and displays a corresponding prompt when it detects that the control system enters each preset interaction mode of each application control module 4.
具体地,例如,显示模块11可以为两个特殊的眼睛形状的LED点阵屏,该点阵屏为两个8*8一共128个独立的LED点阵,LED发光颜色为黄色雾面。Specifically, for example, the display module 11 may be two special eye-shaped LED dot matrix screens. The dot matrix screen is two 8 * 8 total 128 independent LED dot matrixes, and the LED emission color is a yellow matte surface.
在本实施例中,通过触摸检测模块8在检测到用户的触摸操作之后,根据用户触摸操作的各触摸参数在触摸检测模块8中匹配触摸交互控制指令;姿态检测模块6时刻360度全方位检测AI智能编程仿生机器人的当前站立、左倒下、右倒下和躺下等姿态,并在AI智能编程仿生机器人处于不同模式下会检测其姿态,根据检测到的当前姿态匹配姿态调整参数;障碍检测模块9在检测到障碍物之后,生成避让交互控制指令;各模块将匹配的交互控制指令或者调整参数传递至处理器模块2,处理器模块2将接收到的各交互控制指令和调整参数发送至反应适配模块3中的各模块,由各模块AI智能编程仿生机器人完成相应反馈,显示模块11根据表情数据显示指令显示各种表情,以表现AI智能编程仿生机器人的情绪变化,并在检测到控制系统进入各预设交互模式时,显示相应提示。In this embodiment, after detecting the user's touch operation, the touch detection module 8 matches the touch interaction control instructions in the touch detection module 8 according to each touch parameter of the user's touch operation; the posture detection module 6 always detects 360 degrees in all directions AI smart programming bionic robot's current standing, falling down, right down and lying down postures, and will detect its posture when the AI smart programming bionic robot is in different modes, matching the posture adjustment parameters according to the detected current posture; obstacles After detecting the obstacle, the detection module 9 generates an avoidance interactive control instruction; each module transmits the matched interactive control instruction or adjustment parameter to the processor module 2, and the processor module 2 sends each received interactive control instruction and adjustment parameter To each module in the reaction adaptation module 3, the AI intelligent programming bionic robot completes the corresponding feedback from each module, and the display module 11 displays various expressions according to the expression data display instructions to express the emotional changes of the AI intelligent programming bionic robot, When the control system enters each preset interaction mode, a corresponding prompt is displayed.
实现了依据用户的触摸操作和AI智能编程仿生机器人当前所处的姿态作出相应的交互反应或者响应动作,并通过设置障碍检测模块防止AI智能编程仿生机器人撞上障碍物,并保护AI智能编程仿生机器人本体受损,基于显示模块显示丰富多彩的动画表情,以表现机器人的情绪变化情况,并且显示光线柔和保护了用户眼睛,使得AI智能编程仿生机器人更加智能,并且具有更高的真实性,用户的使用体验更佳。Realize the corresponding interaction reaction or response action according to the user's touch operation and the current attitude of the AI intelligent programming bionic robot, and prevent the AI intelligent programming bionic robot from colliding with obstacles by setting an obstacle detection module, and protect the AI intelligent programming bionic The robot body is damaged. Based on the display module, it displays colorful animated expressions to show the robot's emotional changes. It also shows that the soft light protects the user's eyes, making the AI intelligent programming bionic robot more intelligent and more authentic. The user Experience is better.
在本申请AI智能编程仿生机器人的控制系统的第四实施例中,运动控制模块10控制AI智能编程仿生机器人的各运动部件完成相应的动作,如转圈、坐、卧、打滚、前进、后退等动作,具体地,运动控制模块10可以包括:角度检测单元、PID算法单元、以及电机执行单元,角度检测单元用于检测内置于AI智能编程仿生机器人中结构分离式舵机的旋转角度; PID算法单元用于根据所述旋转角度通过PID算法计算AI智能编程仿生机器人的运动动作;电机执行单元用于根据所述运动动作通过电机控制AI智能编程仿生机器人执行相应的动作。In the fourth embodiment of the control system of the AI intelligent programming bionic robot of the present application, the motion control module 10 controls each moving part of the AI intelligent programming bionic robot to complete corresponding actions, such as turning, sitting, lying, rolling, advancing, retreating, etc. Actions, specifically, the motion control module 10 may include: an angle detection unit, a PID algorithm unit, and a motor execution unit, the angle detection unit is used to detect the rotation angle of the structure-separated steering gear built into the AI intelligent programming bionic robot; The PID algorithm unit is used to calculate the motion of the AI intelligently programmed bionic robot through the PID algorithm according to the rotation angle; the motor execution unit is used to control the AI intelligently programmed bionic robot to perform the corresponding motion through the motor according to the motion.
应用控制模块4可以基于用户通过手机输入的操作,控制AI智能编程仿生机器人运动和播放音频内容,应用控制模块4包括四大单元块:动作遥控单元、智能编程单元、在线音乐单元、智能喂养单元和多机互动单元。The application control module 4 can control the movement of the AI intelligent programming bionic robot and play audio content based on the operation input by the user through the mobile phone. The application control module 4 includes four major unit blocks: an action remote control unit, an intelligent programming unit, an online music unit, and an intelligent feeding unit And multi-machine interactive unit.
具体地,动作遥控单元可以接收用户通过手机APP实时控制AI智能编程仿生机器人运动,例如,通过获取用户通过手机APP输入的触摸滑动路径实时控制AI智能编程仿生机器人前进、后退、左右行走,以及完成如坐下、打滚、转圈、随音乐秀一段舞蹈各种动作;Specifically, the motion remote control unit can receive the user's real-time control of the AI smart programming bionic robot movement through the mobile phone APP, for example, by acquiring the touch sliding path input by the user through the mobile phone APP to control the AI smart programming bionic robot to move forward, backward, walk left and right, and complete Such as sitting down, rolling, turning in circles, dancing with a music show for a variety of movements;
在线音乐单元可以通过AI智能编程仿生机器人的蓝牙模块5接收音频并通过音频输出模块12播放用户选择的音频数据内容;The online music unit can receive audio through the Bluetooth module 5 of the AI intelligent programming bionic robot and play the audio data content selected by the user through the audio output module 12;
智能喂养单元用于接收用户通过拖动食物选项内食物喂给AI智能编程仿生机器人操作,AI智能编程仿生机器人根据不同食物做出不同的反应,例如,用户通过如图3所示的交互模式界面进入爱心喂养模式后,获取用户在显示的食物链条上选择“食物”并拖动的操作,根据拖动路径,将“食物”对应的图片按照拖动路径“投递”至显示的AI智能编程仿生机器人图片附近,以完成“喂养”动作,应用控制模块通过判断用户所选“食物”的类型,根据“食物”类型匹配“不可吃”和“不是喜欢的食物”等匹配结果,并通过蓝牙模块5发送对应“死掉”和“拒绝”等交互指令给处理器模块2,处理器模块2控制运动控制模块10作出保存AI智能编程仿生机器人全部动作中的“死掉”和 “不理睬”等动作。The intelligent feeding unit is used to receive the food from the user by dragging the food option to the AI intelligent programming bionic robot. The AI intelligent programming bionic robot makes different reactions according to different foods. For example, the user uses the interactive mode interface shown in After entering the loving feeding mode, the user selects and drags "food" on the displayed food chain, and according to the dragging path, "posts" the picture corresponding to "food" to the displayed AI intelligent programming bionics according to the dragging path Near the robot picture to complete the "feeding" action, the application control module determines the type of "food" selected by the user, matches the matching results of "not eatable" and "not favorite food" according to the type of "food", and passes the Bluetooth module 5. Send interactive commands corresponding to "dead" and "reject" to the processor module 2. The processor module 2 controls the motion control module 10 to save "dead" and all actions of the AI intelligent programming bionic robot. "Ignored" and other actions.
多机互动单元用于接收用户通过手机APP点播信息,并连接多台AI智能编程仿生机器人,进行特定表演,例如,当用户使用手机APP通过蓝牙BLE多连方式连接多台AI智能编程仿生机器人时,对机器人进行相应编号,其他用户可以通过手机APP对特定编号的AI智能编程仿生机器人进行单独操作表演,或者任意选取编号进行组合,对组合的AI智能编程仿生机器人进行动作和音频的操作。The multi-machine interactive unit is used to receive user on-demand information through the mobile APP, and connect multiple AI intelligent programming bionic robots to perform specific performances, for example, when the user uses the mobile APP to connect multiple AI intelligent programming bionic robots via Bluetooth BLE , Number the robots accordingly, other users can perform individual operation performance on the specific number of AI intelligent programming bionic robots through the mobile phone APP, or choose any number to combine to perform actions and audio operations on the combined AI intelligent programming bionic robots.
本实施例中,通过运动控制模块10控制AI智能编程仿生机器人完成相应的动作,应用控制模块4包括四大单元块:动作遥控单元、智能编程单元、在线音乐单元、智能喂养单元和多机互动单元,基于用户通过手机输入的操作,控制AI智能编程仿生机器人运动和播放音频内容,通过AI智能编程仿生机器人的蓝牙模块5接收音频,并通过音频输出模块12播放用户选择的内容,使得用户可选择播放任意线上或者本地音频数据,并且基于各单元模块,增设各种娱乐交互模式,控制AI智能编程仿生机器人启动各项功能或者完成相应交互动作,不仅增强了机器人的娱乐性,并且达到了通过机器人对于用户的教育益智效果。In this embodiment, the AI intelligent programming bionic robot is controlled by the motion control module 10 to complete corresponding actions. The application control module 4 includes four major unit blocks: an action remote control unit, an intelligent programming unit, an online music unit, an intelligent feeding unit, and multi-machine interaction The unit, based on the operation input by the user through the mobile phone, controls the movement of the AI intelligent programming bionic robot and plays audio content, receives the audio through the Bluetooth module 5 of the AI intelligent programming bionic robot, and plays the content selected by the user through the audio output module 12, so that the user Choose to play any online or local audio data, and based on each unit module, add various entertainment interaction modes to control the AI intelligent programming bionic robot to start various functions or complete corresponding interactive actions, which not only enhances the entertainment of the robot, but also achieves The educational and educational effects of robots on users.
基于上述硬件结构和AI智能编程仿生机器人的控制系统,提出本申请AI智能编程仿生机器人的控制方法实施例。Based on the above hardware structure and the control system of the AI intelligent programming bionic robot, an embodiment of the control method of the AI intelligent programming bionic robot of the present application is proposed.
参照图4,图4为本申请AI智能编程仿生机器人的控制方法实施例的流程示意图。Referring to FIG. 4, FIG. 4 is a schematic flowchart of an embodiment of a control method of an AI intelligent programming bionic robot of the present application.
本申请实施例提供了AI智能编程仿生机器人的控制方法的实施例,需要说明的是,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。The embodiment of the present application provides an embodiment of the control method of the AI intelligent programming bionic robot. It should be noted that although the logic sequence is shown in the flowchart, in some cases, it may be executed in an order different from here The steps shown or described.
如图4所示,所述AI智能编程仿生机器人的控制方法包括:As shown in FIG. 4, the control method of the AI intelligent programming bionic robot includes:
步骤S10,所述数据获取模块在获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令,并将所述交互控制指令发送至所述处理器模块。Step S10: After acquiring external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module.
数据获取模块在接收到外部环境中声音、图像或者振动数据后,通过特定的提取算法提取出该声音、图像或者振动数据中的特征值,将提取到的特征值与预设交互控制指令进行匹配,进而生成相应的交互控制指令。After receiving the sound, image or vibration data in the external environment, the data acquisition module extracts the feature value of the sound, image or vibration data through a specific extraction algorithm, and matches the extracted feature value with the preset interactive control instruction To generate corresponding interactive control instructions.
具体地,例如,当数据获取模块中的语音交互模块接收到用户发出的“给我坐下”声音之后,通过语音文本提取算法提取出用户发出的“给我坐下”声音中的“给我坐下”文本信息特征值,并将提取出的“给我坐下”文本信息特征值,在预先保存文本信息所对应的交互控制指令库中匹配到“给我坐下”文本信息所对应的“坐下”语音控制指令,由此实现识别出用户发出的“给我坐下”声音中的“坐下”语音控制指令。Specifically, for example, after the voice interaction module in the data acquisition module receives the "seat me down" voice issued by the user, the "send me" voice of the "sit me down" voice issued by the user is extracted through a speech text extraction algorithm "Sit down" text information feature value, and match the extracted "Sit me down" text information feature value to the corresponding "Sit me down" text information in the interactive control instruction library corresponding to the pre-saved text information "Sit down" voice control instruction, thereby realizing recognition of the "sit down" voice control instruction in the "sit down" voice issued by the user.
在另一个实施例中,语音交互模块还可以根据声量提取算法识别用户发出的声音音量或者环境声音音量的大小,根据音量大小生音量反应交互指令,AI智能编程仿生机器人的控制系统可以根据该音量反应交互控制指令,控制反应适配模块中的运动控制模块和/或音频输出模块以及显示模块相应交互反馈。例如,当语音交互模块检测到环境声音中含有音量较大的“打雷”声音时,生成相应的“惊吓”反应交互指令,该控制系统中的处理器模块接收到该“惊吓”反应交互指令之后,则同时控制反应适配模块中的音频输出模块输出预先设定的“惊吓”声音,控制显示模块显示预先设定的“惊吓”表情,以及控制运动控制模块完成预设的“惊吓”动作。In another embodiment, the voice interaction module can also identify the volume of the user's voice or the ambient sound volume according to the sound volume extraction algorithm, and generate interactive responses to the interactive commands according to the volume. The control system of the AI intelligent programming bionic robot can use the volume React to interactive control instructions, control the corresponding interactive feedback of the motion control module and / or audio output module and the display module in the reaction adaptation module. For example, when the voice interaction module detects that the ambient sound contains a loud “thunder” sound, it generates a corresponding “fright” reaction interactive instruction. After the processor module in the control system receives the “fright” reaction interactive instruction , The audio output module in the reaction adaptation module is simultaneously controlled to output a preset “scared” sound, the display module is controlled to display a preset “scared” expression, and the motion control module is controlled to complete a preset “scared” action.
步骤S20,所述处理器模块将所述交互控制指令传递至对应的所述反应适配模块。In step S20, the processor module transmits the interactive control instruction to the corresponding reaction adaptation module.
在数据获取模块生成交互控制指令之后,将生成的各交互控制指令发送给控制系统中的处理器模块,处理器模块接收各交互控制指令,并将各交互控制指令发送至反应适配模块中的运动控制模块、显示模块或者音频输出模块。After the data acquisition module generates the interactive control instructions, the generated interactive control instructions are sent to the processor module in the control system. The processor module receives the interactive control instructions and sends the interactive control instructions to the reaction adaptation module. Motion control module, display module or audio output module.
需要说明的是,运动控制模块根据反应适配模块匹配的交互反馈数据中的运动数据,控制AI智能编程仿生机器人的运动部件根据运动数据执行相应动作AI智能编程仿生机器人动作。It should be noted that the motion control module controls the moving parts of the AI intelligent programming bionic robot according to the motion data in the interactive feedback data matched by the reaction adaptation module to perform corresponding actions according to the motion data. The AI intelligent programming bionic robot moves.
具体地,处理器模块可以为包括两片32位MCU的双核处理器。Specifically, the processor module may be a dual-core processor including two 32-bit MCUs.
例如,在数据获取模块中的语音交互模块识别出用户发出的声音中的“坐下”语音控制指令之后,将识别的“坐下”语音控制指令发送给双核处理器,双核处理器接收并执行该“坐下”语音控制指令,将该坐下”语音控制指令发送给与“坐下”动作相适应的反应适配模块中的运动控制模块。For example, after the voice interaction module in the data acquisition module recognizes the "sit down" voice control instruction in the voice made by the user, the recognized "sit down" voice control instruction is sent to the dual-core processor, and the dual-core processor receives and executes The "sit down" voice control instruction sends the "sit down" voice control instruction to the motion control module in the reaction adaptation module adapted to the "sit down" action.
步骤S30,所述反应适配模块根据所述交互控制指令适配交互反馈数据,并根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈。Step S30, the reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
反应适配模块在接收到处理器模块发送的交互控制指令之后,根据交互控制指令和AI智能编程仿生机器人适配交互反馈数据,并根据交互反馈数据控制AI智能编程仿生机器人完成相应反馈。After receiving the interactive control instruction sent by the processor module, the reaction adaptation module adapts the interactive feedback data according to the interactive control instruction and the AI intelligent programming bionic robot, and controls the AI intelligent programming bionic robot to complete the corresponding feedback according to the interactive feedback data.
具体地,运动控制模块在接收到处理器模块发送的“坐下”语音控制指令后,根据该“坐下”语音控制指令和AI智能编程仿生机器人当前所处的状态参数适配交互反馈数据,例如,AI智能编程仿生机器人当前所处的状态为“饥饿”,则运动控制模块将“坐下”语音控制指令指向的“坐下”动作的运动数据中“速度”参数减小,根据将“速度”参数减小适配后的“坐下”动作的运动数据,控制AI智能编程仿生机器人的各运动部件“缓慢坐下”。Specifically, after receiving the "sitting down" voice control instruction sent by the processor module, the motion control module adapts the interactive feedback data according to the "sitting down" voice control instruction and the current state parameter of the AI intelligent programming bionic robot, For example, if the current state of the AI intelligent programming bionic robot is "hungry", the motion control module will reduce the "speed" parameter in the motion data of the "sit down" action pointed to by the "sit down" voice control instruction. The "speed" parameter reduces the motion data of the "sit down" action after adaptation, and controls the moving parts of the AI intelligent programming bionic robot to "slow down".
需要说明的是,AI智能编程仿生机器人的各运动部件为可以活动的各肢体或者关节等硬件结构。It should be noted that each moving part of the AI intelligent programming bionic robot is a hardware structure such as movable limbs or joints.
在本实施例中,通过所述数据获取模块在获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令,并将所述交互控制指令发送至所述处理器模块;所述处理器模块将所述交互控制指令传递至对应的所述反应适配模块;所述反应适配模块根据所述交互控制指令适配交互反馈数据,并根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈。In this embodiment, after acquiring external environment data through the data acquisition module, an interactive control instruction is generated according to the external environment data, and the interactive control instruction is sent to the processor module; the processor The module transmits the interactive control instruction to the corresponding reaction adaptation module; the reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionics according to the interactive feedback data The robot completes the corresponding feedback.
通过语音模块在接收到用户发出的声音后,通过特定的提取算法提取出用户的声音中或者环境声音中的声音特征值,将提取到的特征值与预设的语音模式库中的语音控制指令进行匹配,进而识别出用户发出的声音中的语音控制指令,在语音模块识别出用户发出的声音中的语音控制指令之后,将识别的语音控制指令发送给控制系统中的处理器模块,处理器模块接收该语音控制指令,并执行该语音控制指令,控制该AI智能编程仿生机器人的控制系统中的运动模块完成预设运动模式中的相应动作。After receiving the user's voice through the voice module, the voice feature value in the user's voice or the ambient voice is extracted through a specific extraction algorithm, and the extracted feature value and the voice control instruction in the preset voice mode library After matching, the voice control instruction in the voice made by the user is recognized, and after the voice module recognizes the voice control instruction in the voice made by the user, the recognized voice control instruction is sent to the processor module in the control system. The module receives the voice control instruction and executes the voice control instruction to control the motion module in the control system of the AI intelligent programming bionic robot to complete the corresponding action in the preset motion mode.
通过数据获取模块在接收到外部环境中声音、图像或者振动数据后,通过特定的提取算法提取出该声音、图像或者振动数据中的特征值,将提取到的特征值与预设交互控制指令进行匹配,进而生成相应的交互控制指令,在数据获取模块生成交互控制指令之后,将生成的各交互控制指令发送给控制系统中的处理器模块,处理器模块接收各交互控制指令,并将各交互控制指令发送至反应适配模块中的运动控制模块、显示模块或者音频输出模块,反应适配模块在接收到处理器模块发送的交互控制指令之后,根据交互控制指令和AI智能编程仿生机器人适配交互反馈数据,并根据交互反馈数据控制AI智能编程仿生机器人完成相应反馈。After receiving the sound, image or vibration data in the external environment through the data acquisition module, the characteristic value in the sound, image or vibration data is extracted through a specific extraction algorithm, and the extracted characteristic value is performed with the preset interactive control instruction Match, and then generate corresponding interactive control instructions. After the data acquisition module generates the interactive control instructions, the generated interactive control instructions are sent to the processor module in the control system. The processor module receives the interactive control instructions and sends each interactive The control instruction is sent to the motion control module, the display module or the audio output module in the reaction adaptation module. After receiving the interactive control instruction sent by the processor module, the reaction adaptation module adapts to the AI intelligent programming bionic robot according to the interactive control instruction Interactive feedback data, and control the AI intelligent programming bionic robot to complete the corresponding feedback according to the interactive feedback data.
实现了基于外部环境数据和用户的各控制操作,自动检测识别环境数据并生成交互控制指令,根据交互控制指令和AI智能编程仿生机器人当前状态参数自动匹配相应的交互反馈数据,并根据交互反馈数据控制AI智能编程仿生机器人完成相应交互反馈动作,提高了智能机器人与用户和环境之间的互动性能,使智能机器人真正达到了真实仿生的效果,提高了用户的使用体验。Based on external environment data and user's various control operations, it automatically detects and recognizes environmental data and generates interactive control instructions. According to the interactive control instructions and AI intelligent programming bionic robot current state parameters, it automatically matches the corresponding interactive feedback data, and according to the interactive feedback data Control the AI intelligent programming bionic robot to complete the corresponding interactive feedback actions, improve the interactive performance between the intelligent robot and the user and the environment, make the intelligent robot truly achieve the real bionic effect, and improve the user's experience.
此外,本申请实施例还提出一种计算机可读存储介质,所述计算机可读存储介质可以为非易失性可读存储介质。In addition, the embodiments of the present application also provide a computer-readable storage medium, and the computer-readable storage medium may be a non-volatile readable storage medium.
本申请计算机可读存储介质上存储有计算机可读指令,所述计算机可读指令被处理器执行时实现如上所述的AI智能编程仿生机器人的控制方法的步骤。The computer-readable storage medium of the present application stores computer-readable instructions, which when executed by the processor, implement the steps of the control method of the AI intelligent programming bionic robot as described above.
本申请计算机可读存储介质具体实施方式与上述AI智能编程仿生机器人的控制方法各实施例基本相同,在此不再赘述。The specific implementation of the computer-readable storage medium of the present application is basically the same as the above embodiments of the control method of the AI intelligent programming bionic robot, which will not be repeated here.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。It should be noted that in this article, the terms "include", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system that includes a series of elements includes not only those elements, It also includes other elements that are not explicitly listed, or include elements inherent to this process, method, article, or system. Without more restrictions, the element defined by the sentence "include one ..." does not exclude that there are other identical elements in the process, method, article or system that includes the element.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The sequence numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods in the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware, but in many cases the former is better Implementation. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence or part of contributions to the existing technology, and the computer software products are stored in a storage medium (such as ROM / RAM, magnetic disk, The CD-ROM includes several instructions to enable a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the embodiments of the present application.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only the preferred embodiments of the present application, and do not limit the scope of the patent of the present application. Any equivalent structure or equivalent process transformation made by the description and drawings of this application, or directly or indirectly used in other related technical fields The same reason is included in the patent protection scope of this application.

Claims (16)

  1. 一种AI智能编程仿生机器人的控制系统,其特征在于,所述控制系统包括:数据获取模块、处理器模块和反应适配模块,所述数据获取模块和反应适配模块分别与所述处理器模块通信连接,An AI intelligent programming bionic robot control system, characterized in that the control system includes: a data acquisition module, a processor module and a reaction adaptation module, the data acquisition module and the reaction adaptation module are respectively connected to the processor Module communication connection,
    所述数据获取模块在获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令,并将所述交互控制指令发送至所述处理器模块;After acquiring the external environment data, the data acquisition module generates an interactive control instruction according to the external environment data, and sends the interactive control instruction to the processor module;
    所述处理器模块将所述交互控制指令传递至对应的所述反应适配模块;The processor module transmits the interactive control instruction to the corresponding reaction adaptation module;
    所述反应适配模块根据所述交互控制指令适配交互反馈数据,并根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈。The reaction adaptation module adapts interactive feedback data according to the interactive control instruction, and controls the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
  2. 如权利要求1所述的AI智能编程仿生机器人的控制系统,其特征在于,所述控制系统还包括:应用控制模块和蓝牙模块,所述应用控制模块通过所述蓝牙模块与所述处理器模块通信连接,The control system of the AI intelligent programming bionic robot according to claim 1, wherein the control system further comprises: an application control module and a Bluetooth module, and the application control module communicates with the processor module through the Bluetooth module Communication connection,
    所述应用控制模块在获取用户的各操作指令之后,根据各所述操作指令进入相应的各预设交互模式,并通过所述蓝牙模块将各所述预设交互模式中的交互控制指令发送至所述处理器模块。After obtaining the operation instructions of the user, the application control module enters the corresponding preset interaction modes according to the operation instructions, and sends the interaction control instructions in the preset interaction modes to the Bluetooth module The processor module.
  3. 如权利要求2所述的AI智能编程仿生机器人的控制系统,其特征在于,所述应用控制模块设置有智能编程单元,所述智能编程单元根据用户输入的文本内容生成编程交互指令,所述AI智能编程仿生机器人根据所述编程交互指令实现相应逻辑和/或功能。The control system of the AI intelligent programming bionic robot according to claim 2, wherein the application control module is provided with an intelligent programming unit, and the intelligent programming unit generates programming interaction instructions according to the text content input by the user, the AI The intelligent programming bionic robot realizes corresponding logic and / or functions according to the programming interaction instructions.
  4. 如权利要求2所述的AI智能编程仿生机器人的控制系统,其特征在于,所述蓝牙模块为双模蓝牙模块,The control system of the AI intelligent programming bionic robot according to claim 2, wherein the Bluetooth module is a dual-mode Bluetooth module,
    所述蓝牙模块将所述应用控制模块各所述预设交互模式中的所述交互控制指令,传输至所述处理器模块,并将音频数据传输至所述AI智能编程仿生机器人的音频输出模块。The Bluetooth module transmits the interaction control instruction in each of the preset interaction modes of the application control module to the processor module, and transmits audio data to the audio output module of the AI intelligent programming bionic robot .
  5. 如权利要求1所述的AI智能编程仿生机器人的控制系统,其特征在于,所述控制系统还包括:姿态检测模块,所述姿态检测模块与所述处理器模块通信连接,The control system of the AI intelligent programming bionic robot according to claim 1, wherein the control system further comprises: a posture detection module, and the posture detection module is in communication connection with the processor module,
    所述姿态检测模块根据检测所述AI智能编程仿生机器人当前的姿态,生成姿态调整数据,并将所述预设姿态调整数据发送至所述处理器模块;The posture detection module generates posture adjustment data based on detecting the current posture of the AI intelligent programming bionic robot, and sends the preset posture adjustment data to the processor module;
    所述处理器模块将所述姿态调整数据传递至所述运动控制模块;The processor module transmits the posture adjustment data to the motion control module;
    所述运功控制模块根据控制所述AI智能编程仿生机器人的所述运动部件根据所述姿态调整参数执行相应动作。The motion control module performs corresponding actions according to the posture adjustment parameters according to controlling the moving parts of the AI intelligent programming bionic robot.
  6. 如权利要求1所述的AI智能编程仿生机器人的控制系统,其特征在于,所述数据获取模块包括:语音交互模块、触摸检测模块和障碍检测模块,The control system of the AI intelligent programming bionic robot according to claim 1, wherein the data acquisition module includes: a voice interaction module, a touch detection module and an obstacle detection module,
    所述语音模块在接收到用户声音之后,根据所述用户声音的声音特征值生成语音交互控制指令,并将所述语音控制指令发送至所述处理器模块;After receiving the user voice, the voice module generates a voice interaction control instruction according to the voice feature value of the user voice, and sends the voice control instruction to the processor module;
    所述触摸检测模块在检测到用户的触摸操作之后,根据所述触摸操作的触摸参数生成触摸交互控制指令,并将所述触摸交互控制指令发送至所述处理器模块;After detecting the user's touch operation, the touch detection module generates a touch interaction control instruction according to the touch parameter of the touch operation, and sends the touch interaction control instruction to the processor module;
    所述障碍检测模块在检测到障碍物之后,生成避让交互控制指令,并将所述避让交互指令发送至所述处理器模块。After detecting the obstacle, the obstacle detection module generates an avoidance interaction control instruction, and sends the avoidance interaction instruction to the processor module.
  7. 如权利要求1所述的AI智能编程仿生机器人的控制系统,其特征在于,所述反应适配模块根据所述处理器模块传递的各所述交互控制指令,结合所述AI智能编程仿生机器人当前所处状态的状态参数适配各交互反馈数据。The control system of the AI intelligent programming bionic robot according to claim 1, wherein the reaction adaptation module combines the current AI intelligent programming bionic robot according to each interactive control instruction transmitted by the processor module The state parameters of the state are adapted to the interactive feedback data.
  8. 如权利要求7所述的AI智能编程仿生机器人的控制系统,其特征在于,所述反应适配模块包括:运动控制模块、显示模块和音频输出模块,The control system of the AI intelligent programming bionic robot according to claim 7, wherein the reaction adaptation module includes: a motion control module, a display module and an audio output module,
    所述运动控制模块根据所述交互反馈数据中的运动数据,控制所述AI智能编程仿生机器人的运动部件根据所述运动数据执行相应动作;The motion control module controls the moving parts of the AI intelligent programming bionic robot to perform corresponding actions according to the motion data according to the motion data in the interactive feedback data;
    所述显示模块根据所述交互反馈数据中的表情数据显示各种表情,并在检测到所述控制系统进入各所述预设交互模式时,显示相应提示;The display module displays various expressions according to the expression data in the interaction feedback data, and displays a corresponding prompt when detecting that the control system enters each of the preset interaction modes;
    所述音频输出模块根据所述交互反馈数据中的音频数据,控制所述AI智能编程仿生机器人的声音输出部件播放相应声音。The audio output module controls the sound output part of the AI intelligent programming bionic robot to play the corresponding sound according to the audio data in the interactive feedback data.
  9. 一种AI智能编程仿生机器人的控制方法,其特征在于,所述AI智能编程仿生机器人的控制方法包括:An AI intelligent programming bionic robot control method, characterized in that the AI intelligent programming bionic robot control method includes:
    当获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令;After acquiring the external environment data, generate an interactive control instruction according to the external environment data;
    根据所述交互控制指令适配交互反馈数据,并根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈。Adapt interactive feedback data according to the interactive control instruction, and control the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
  10. 如权利要求9所述的AI智能编程仿生机器人的控制方法,其特征在于,所述当获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令的步骤包括:The control method of the AI intelligent programming bionic robot according to claim 9, wherein the step of generating interactive control instructions according to the external environment data after acquiring the external environment data includes:
    在接收到用户声音之后,根据所述用户声音的声音特征值生成语音交互控制指令;After receiving the user voice, generate a voice interaction control instruction according to the voice feature value of the user voice;
    当检测到用户的触摸操作之后,根据所述触摸操作的触摸参数生成触摸交互控制指令;After detecting the user's touch operation, generate a touch interaction control instruction according to the touch parameter of the touch operation;
    当检测到障碍物之后,生成避让交互控制指令。When an obstacle is detected, an avoidance interactive control instruction is generated.
  11. 如权利要求9所述的AI智能编程仿生机器人的控制方法,其特征在于,所述根据所述交互控制指令适配交互反馈数据的步骤包括:The control method of the AI intelligent programming bionic robot according to claim 9, wherein the step of adapting interactive feedback data according to the interactive control instruction includes:
    根据各所述交互控制指令,结合所述AI智能编程仿生机器人当前所处状态的状态参数适配各交互反馈数据。According to the interactive control instructions, combined with the state parameters of the current state of the AI intelligent programming bionic robot, adapt the interactive feedback data.
  12. 如权利要求11所述的AI智能编程仿生机器人的控制方法,其特征在于,所述根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈的步骤包括:The control method of the AI intelligent programming bionic robot according to claim 11, wherein the step of controlling the AI intelligent programming bionic robot to complete the corresponding feedback according to the interactive feedback data includes:
    根据所述交互反馈数据中的运动数据,控制所述AI智能编程仿生机器人的运动部件根据所述运动数据执行相应动作;According to the motion data in the interactive feedback data, control the moving parts of the AI intelligent programming bionic robot to perform corresponding actions according to the motion data;
    根据所述交互反馈数据中的表情数据显示各种表情,并在检测到所述控制系统进入各所述预设交互模式时,显示相应提示;Display various expressions according to the expression data in the interaction feedback data, and display a corresponding prompt when it is detected that the control system enters each of the preset interaction modes;
    根据所述交互反馈数据中的音频数据,控制所述AI智能编程仿生机器人的声音输出部件播放相应声音。According to the audio data in the interactive feedback data, the sound output part of the AI intelligently programmed bionic robot is controlled to play the corresponding sound.
  13. 一种计算机可读存储介质,其特征在于,所述计算机存储介质上存储有计算机可读指令,其中所述计算机可读指令被处理器执行时实现如下步骤:A computer-readable storage medium, characterized in that computer-readable instructions are stored on the computer storage medium, where the computer-readable instructions are executed by a processor to implement the following steps:
    当获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令;After acquiring the external environment data, generate an interactive control instruction according to the external environment data;
    根据所述交互控制指令适配交互反馈数据,并根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈。Adapt interactive feedback data according to the interactive control instruction, and control the AI intelligent programming bionic robot to complete corresponding feedback according to the interactive feedback data.
  14. 如权利要求13所述的计算机可读存储介质,其特征在于,所述当获取到外部环境数据之后,根据所述外部环境数据生成交互控制指令的步骤包括:The computer-readable storage medium according to claim 13, wherein the step of generating the interactive control instruction according to the external environment data after acquiring the external environment data includes:
    在接收到用户声音之后,根据所述用户声音的声音特征值生成语音交互控制指令;After receiving the user voice, generate a voice interaction control instruction according to the voice feature value of the user voice;
    当检测到用户的触摸操作之后,根据所述触摸操作的触摸参数生成触摸交互控制指令;After detecting the user's touch operation, generate a touch interaction control instruction according to the touch parameter of the touch operation;
    当检测到障碍物之后,生成避让交互控制指令。When an obstacle is detected, an avoidance interactive control instruction is generated.
  15. 如权利要求13所述的计算机可读存储介质,其特征在于,所述根据所述交互控制指令适配交互反馈数据的步骤包括:The computer-readable storage medium of claim 13, wherein the step of adapting interactive feedback data according to the interactive control instruction includes:
    根据各所述交互控制指令,结合所述AI智能编程仿生机器人当前所处状态的状态参数适配各交互反馈数据。According to the interactive control instructions, combined with the state parameters of the current state of the AI intelligent programming bionic robot, adapt the interactive feedback data.
  16. 如权利要求15所述的计算机可读存储介质,其特征在于,所述根据所述交互反馈数据控制所述AI智能编程仿生机器人完成相应反馈的步骤包括:The computer-readable storage medium according to claim 15, wherein the step of controlling the AI intelligent programming bionic robot to complete the corresponding feedback according to the interactive feedback data includes:
    根据所述交互反馈数据中的运动数据,控制所述AI智能编程仿生机器人的运动部件根据所述运动数据执行相应动作;According to the motion data in the interactive feedback data, control the moving parts of the AI intelligent programming bionic robot to perform corresponding actions according to the motion data;
    根据所述交互反馈数据中的表情数据显示各种表情,并在检测到所述控制系统进入各所述预设交互模式时,显示相应提示;Display various expressions according to the expression data in the interaction feedback data, and display a corresponding prompt when it is detected that the control system enters each of the preset interaction modes;
    根据所述交互反馈数据中的音频数据,控制所述AI智能编程仿生机器人的声音输出部件播放相应声音。According to the audio data in the interactive feedback data, the sound output part of the AI intelligently programmed bionic robot is controlled to play the corresponding sound.
PCT/CN2018/121778 2018-11-19 2018-12-18 Control system and method for ai intelligent programming bionic robot, and storage medium WO2020103247A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811380146.8A CN109434833A (en) 2018-11-19 2018-11-19 Control system, method and the storage medium of AI intelligence programming bio-robot
CN201811380146.8 2018-11-19

Publications (1)

Publication Number Publication Date
WO2020103247A1 true WO2020103247A1 (en) 2020-05-28

Family

ID=65553237

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/121778 WO2020103247A1 (en) 2018-11-19 2018-12-18 Control system and method for ai intelligent programming bionic robot, and storage medium

Country Status (2)

Country Link
CN (1) CN109434833A (en)
WO (1) WO2020103247A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110370280B (en) * 2019-07-25 2021-11-30 深圳市天博智科技有限公司 Feedback control method, system and computer readable storage medium for robot behavior
CN110533991A (en) * 2019-08-27 2019-12-03 南京蓝宙科技有限公司 A kind of graphic programming educational robot based on double-core MCU
CN110764618A (en) * 2019-10-25 2020-02-07 郑子龙 Bionic interaction system and method and corresponding generation system and method
CN110779148B (en) * 2019-11-14 2021-05-14 宁波奥克斯电气股份有限公司 Millimeter wave-based interesting control method and device for air conditioner and air conditioner
CN110815231A (en) * 2019-11-25 2020-02-21 深圳市天博智科技有限公司 Robot control method and device
CN111309992B (en) * 2020-02-19 2023-06-13 深圳市天博智科技有限公司 Intelligent robot response method, system, robot and storage medium
CN111300429A (en) * 2020-03-25 2020-06-19 深圳市天博智科技有限公司 Robot control system, method and readable storage medium
CN115079684A (en) * 2021-03-15 2022-09-20 华为技术有限公司 Feedback method of robot and robot
CN113442135A (en) * 2021-06-11 2021-09-28 深圳市天博智科技有限公司 Robot programming method, robot programming apparatus, robot, and storage medium
CN115845404B (en) * 2023-02-27 2023-06-16 自贡创赢智能科技有限公司 Simulated dinosaur model

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101251756A (en) * 2007-12-21 2008-08-27 西北工业大学 All fours type bionic robot control device
CN102303700A (en) * 2011-05-26 2012-01-04 中国科学院自动化研究所 Multiple control surface robotic fish with embedded vision
CN202237254U (en) * 2011-10-28 2012-05-30 杨雄波 A robotic toy dog
CN102637036A (en) * 2012-05-08 2012-08-15 北京理工大学 Combined type bionic quadruped robot controller
CN103605375A (en) * 2013-10-24 2014-02-26 国家电网公司 Bionic robot control method and bionic robot control device
CN107596698A (en) * 2017-09-27 2018-01-19 深圳市天博智科技有限公司 A kind of control system and implementation method of Intelligent bionic machinery dog

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101251756A (en) * 2007-12-21 2008-08-27 西北工业大学 All fours type bionic robot control device
CN102303700A (en) * 2011-05-26 2012-01-04 中国科学院自动化研究所 Multiple control surface robotic fish with embedded vision
CN202237254U (en) * 2011-10-28 2012-05-30 杨雄波 A robotic toy dog
CN102637036A (en) * 2012-05-08 2012-08-15 北京理工大学 Combined type bionic quadruped robot controller
CN103605375A (en) * 2013-10-24 2014-02-26 国家电网公司 Bionic robot control method and bionic robot control device
CN107596698A (en) * 2017-09-27 2018-01-19 深圳市天博智科技有限公司 A kind of control system and implementation method of Intelligent bionic machinery dog

Also Published As

Publication number Publication date
CN109434833A (en) 2019-03-08

Similar Documents

Publication Publication Date Title
WO2020103247A1 (en) Control system and method for ai intelligent programming bionic robot, and storage medium
WO2013094821A1 (en) Method and system for remote control, and remote-controlled user interface
WO2018054056A1 (en) Interactive exercise method and smart head-mounted device
US8909370B2 (en) Interactive systems employing robotic companions
KR101169674B1 (en) Telepresence robot, telepresence system comprising the same and method for controlling the same
US8914139B2 (en) Robot
JP4972218B1 (en) Action body toy
CN107596698A (en) A kind of control system and implementation method of Intelligent bionic machinery dog
WO2018108024A1 (en) Method and system for remote controlling smart television on the basis of mobile terminal, and mobile terminal
JPWO2005014242A1 (en) Communication robot control system
CN108073112A (en) A kind of intelligent Service humanoid robot with role playing
WO2018129792A1 (en) Vr playing method, vr playing apparatus and vr playing system
US20210004132A1 (en) Information processing device, information processing method, and program
Lee et al. The design of a semi-autonomous robot avatar for family communication and education
WO2019114587A1 (en) Information processing method and apparatus for virtual reality terminal, and readable storage medium
WO2020256161A1 (en) Artificial intelligence home robot and control method therefor
KR100264371B1 (en) Electronic game device and method using a doll
US20230195401A1 (en) Information processing apparatus and information processing method
JP2004042151A (en) Communication robot
Cuan Dances with robots: Choreographing, correcting, and performing with moving machines
JP2018126209A (en) Control device, control method, and control program
Lee et al. Semi-autonomous robot avatar as a medium for family communication and education
US20210329982A1 (en) Kigurumi staging support apparatus, kigurumi staging support system, and kigurumi staging support method
WO2018038337A1 (en) Virtual reality content system enabling interaction between hmd user and plurality of ordinary people and control method thereof
JP6754819B2 (en) Kigurumi production support device, costume production support system and costume production support method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18940526

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18940526

Country of ref document: EP

Kind code of ref document: A1