AU2017101085A4 - Control system and control method - Google Patents

Control system and control method Download PDF

Info

Publication number
AU2017101085A4
AU2017101085A4 AU2017101085A AU2017101085A AU2017101085A4 AU 2017101085 A4 AU2017101085 A4 AU 2017101085A4 AU 2017101085 A AU2017101085 A AU 2017101085A AU 2017101085 A AU2017101085 A AU 2017101085A AU 2017101085 A4 AU2017101085 A4 AU 2017101085A4
Authority
AU
Australia
Prior art keywords
processing unit
unit
output
communication unit
collection data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2017101085A
Inventor
Tao Jiang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yutou Technology Hangzhou Co Ltd
Original Assignee
Yutou Technology Hangzhou Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/CN2015/081385 external-priority patent/WO2016112624A1/en
Application filed by Yutou Technology Hangzhou Co Ltd filed Critical Yutou Technology Hangzhou Co Ltd
Priority to AU2017101085A priority Critical patent/AU2017101085A4/en
Application granted granted Critical
Publication of AU2017101085A4 publication Critical patent/AU2017101085A4/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Abstract

The present invention includes a collection device, a communication module, a first processing unit, a second processing unit 5 and an execution unit. The benefit of the invention compared to the prior art is: by the cooperation of the using of the first processing unit and the second processing unit, the complicated operation with which the second processing unit can not accomplish is transferred to the first processing unit, the first processing unit then accomplish the operation, 10 thus the processing speed and accuracy are increased. Meanwhile the simple logic operation processed by the first processing unit is transferred to the second processing unit, the second processing unit then processes the logic operation and forms control signal to control the execution unit, so that the delayed processing of the execution unit is avoided. Collection Device Communication Module Voice Signal ______Fis First Recognition Module Cmnt nProcessing Unit Image Detecting Second Module Communication Unit| Second Processing nit Execution Unit Detecting Unit Audio PlaUi DipaemetSno Light Regulation TeprtueSnr Unit Drive Unit Light Sensor Figure 1

Description

CONTROL SYSTEM AND CONTROL METHOD 2017101085 10 Aug 2017 BACKGROUND OF THE INVENTION 5 1. Field of the Invention
The invention relates to a field of robot technology, more specifically, to a control system and a control method for the behavior of a robot. ίο 2. Description of the Related Art
Since 2000, with the development of the low power consumption chip based on ARM architecture, various sensor components are modularized and miniaturized, the voice technology and image technology are improved rapidly, the robot industry has developed 15 quickly. The modern robot analyzes and executes the action which meets the requirement of the user by combining the recognizing instruction of the voice, expression and gesture made by the user and the various data sent back by the sensor. The processing method makes a breakthrough for the limits of the external input of the key and the mouse, 20 or for the limits of the input of the precompile instruction, and it evolves the interactive model between machine and human beings into the interactive model by natural language or natural behavior. 1
Currently, there are two kinds of robot behavior controls: (1) Process all requests by the processor of the robot, the server is functioned as a passive service provider, the behavior of the robot is limited by the processor or by the control unit. This kind of process mode removes the 5 dependency from the remote server, avoiding the behavior delay caused by the data transmission. However, this kind of robot has high requirements for the data processing capacity of the processor and the network cost is high as well. (2) Deliver all the behavior process to the remote server, the robot itself does not do any data analysis and ίο processing. The robot itself only collects and transfers the data. As this kind of process manner simplifies the robot itself extremely, the manufacture cost decrease greatly. Nevertheless, all the data has to be determined after it has processed by the server, thus the reaction speed of the robot is affected. Meanwhile, the simplified front-end robot involve 15 the modesty of the function without doing any complicated action. 2017101085 10 Aug 2017
SUMMARY OF THE INVENTION
To address the disadvantages of the prior art, the invention 20 provides a control system and a control method with low cost and high efficiency.
The technical solution of the invention is: 2 A control system, applied to behavioral control device of home service robot, comprising: 2017101085 10 Aug 2017 a collection device configured on a preset position of the robot to collect operation instructions input by the user, and to form an output of 5 collection data; a communication module including a first communication unit and a second communication unit, the first communication unit being connected to the collection device to receive the collection data, and transforming the collection data to the output of the collection data to matched to the first communication unit; a first processing unit connected to the first communication unit and the second communication unit respectively, to receive the collection data, and to recognize and process the collection data, to form a control command output by the second communication unit; 15 a second processing unit connected to the second communication unit to receive the control command output by the second communication unit, and form output of control instruction according to the control command; an execution unit connected to the second processing unit to 20 execute actions under the effect of the control instruction, and the action being matched to the control instruction.
Preferably, the collection device comprises: 3 a sound capture module connected to the first communication unit to capture voice message, and to form an output of voice collection data matched to the first communication unit format; 2017101085 10 Aug 2017 an image capture module connected to the first communication 5 unit to capture the image message, and to form an output of image collection data matched to the first communication unit format.
Preferably, the first processing unit comprises: a voice recognition unit connected to the sound capture module to recognize voice control command according to the voice collection data; 10 an image recognition unit connected to the image capture module to recognize image control command according to the image collection data.
Preferably, it further comprises a detecting unit connected to the second processing unit, to detect the status information of the robot at 15 present physical environment, and to form a detection information output to the second processing unit.
Preferably, the detecting unit comprises: a temperature sensor connected to the second processing unit, to acquire the temperature information of present environment, and to form 20 a temperature signal output to the second processing unit; a light sensor connected to the second processing unit, to acquire the light information of present environment, and to form a light signal 4 output to the second processing unit; 2017101085 10 Aug 2017 a displacement sensor connected to the second processing unit, to acquire the position information of present environment, and to form a position signal output to the second processing unit. 5 Preferably, the second processing unit comprises a memory unit, the memory unit has a plurality of preset scene modes and matching relation between the scene modes and the status information of physical environment.
Preferably, the execution unit comprises: ίο an audio play unit connected to the second processing unit to execute the action of audio play under the effect of the control signal which is output by the second processing unit and is in relevant to the audio play unit; a light regulation unit connected to the second processing unit to 15 execute the action of light regulation under the effect of the control signal which is output by the second processing unit and is in relevant to the light regulation unit; a drive unit connected to the second processing unit to execute the action of position movement under the effect of the control signal 20 which is output by the second processing unit and is in relevant to the drive unit.
Preferably, the audio play unit is an audio play device inside the 5 robot and/or an audio play device in the present environment where the robot locates, whose control end is connected to the corresponding output end of the second processing unit. 2017101085 10 Aug 2017
Preferably, the light regulation unit is the lighting system in the 5 present environment where the robot locates, whose control end is connected to the corresponding output end of the second processing unit, to regulate the light intensity of the present environment. A control method, applied to behavioral control device of home service robot, comprising the steps of: 10 controlling a collection device to collect operation instructions input by users to form an output of collection data; controlling the first communication unit to receive the collection data, and to transform the collection data to the output of the collection data matched to the first communication unit; 15 controlling the first processing unit to receive the collection data, and to analyze and process the collection data, to form a control command output by the second communication unit; controlling the second communication unit to transfer the control command to the second processing unit; 20 controlling the second processing unit to form an output of control instruction according to the control command; controlling the execution unit to execute the action under the 6 effect of the control instruction, and the action being matched to the control instruction. 2017101085 10 Aug 2017
The benefit of the invention compared to the prior art is: by the cooperation in the use of the first processing unit and the second 5 processing unit, the complicated operation with which the second processing unit can not accomplish is transferred to the first processing unit, the first processing unit then accomplish the operation, thus the processing speed and accuracy are increased. Meanwhile the simple logic operation processed by the first processing unit is transferred to the 10 second processing unit, the second processing unit then processes the logic operation, and forms control signal to control the execution unit, so that the delayed processing of the execution unit is avoided, the processing demands of the second processing unit is reduced, the production cost and the maintenance charge is decreased. 15
BRIEF DESCRIPTIONS OF THE DRAWINGS
Figure 1 is a structure schematic structure view of the control system according to the invention.
Figure 2 is a flow chart of the control method according to the 20 invention.
DETAILED DESCRIPTIONS 7
The following is the further description of the invention by combining the drawing and the embodiments, and it can not be the limitation for the invention. 2017101085 10 Aug 2017
Referring to Figure 1, it shows a control system which is applied 5 to the robot behavioral control system, wherein it comprises: a collection device configured on a preset position of the robot to collect operation instructions input by the user, and to form an output of collection data; a communication module including a first communication unit 10 and a second communication unit, the first communication unit being connected to the collection device to receive the collection data, and transforming the collection data to the output of the collection data matched to the first communication unit; a first processing unit connected to the first communication unit 15 and the second communication unit respectively, to receive the collection data, and to recognize and process the collection data, to form a control command output by the second communication unit; a second processing unit connected to the second communication unit to receive the control command output by the second communication 20 unit, and form output of control instruction according to the control command; an execution unit connected to the second processing unit to 8 execute actions under the effect of the control instruction, and the action being matched to the control instruction. 2017101085 10 Aug 2017
The operation principle of the invention is: the image collection device collects the operation instruction input by the user, and forms the 5 collection data which is output to the first processing unit by the first communication unit, the operation instruction can further be a gesture action command or voice command. The first processing unit recognizes the control command according to the collection data, and transfer the control command to the second processing unit by the second 10 communication unit. The second processing unit forms a control instruction which controls the execution unit according to the control command. The first processing unit is a remote processing unit which can be formed by servers, to preprocess the collection signal output by the collection device, the first processing unit is mainly used to process and 15 calculate the data relationship with complicated logic, and to transform it into data relationship with simple logic structure and output it. The second processing unit can be a local processing unit configured at the inner of the robot, the second processing unit is mainly used to process the data relationship with simple logic, and to form control instruction to 20 drive the execution unit to execute corresponding action. When the communication module is failed and the transmission function is unavailable, the second processing unit can also execute the transmission 9 and process with complicated logic, and form output of the control instruction. In the invention, by the cooperation in the use of the first processing unit and the second processing unit, the complicated operation with which the second processing unit spends a lot of time to accomplish 5 is transferred to the first processing unit, and the operation is processed by the remote processing capacity of the first processing unit, thus the processing speed and accuracy are increased. Meanwhile the simple logic operation processed by the first processing unit is transferred to the second processing unit, the second processing unit then processes the 10 logic operation, and forms control signal to control the execution unit, to avoid the delayed processing of the execution unit, and to decrease the processing demands of the second processing unit, to decrease the production cost and the maintenance charge including network maintenance cost, so that the user has well experience. 2017101085 10 Aug 2017 15 Based on the above technical solution, the collection device can comprises a sound capture module connected to the first communication unit to capture the voice message, and to form voice collection data matched to the first communication unit format, the voice collection data is output to the first processing unit, the first processing unit recognizes 20 the voice control command according to the voice collection data.
Based on the above technical solution, the collection device can comprises an image capture module connected to the first communication 10 unit to capture the image message, and to form output of image collection data matched to the first communication unit format. The first communication unit recognizes the image control command according to the image collection data, and transfers the image control command to the 5 second processing unit by the second communication unit. The image information can include gesture action signal and face information. 2017101085 10 Aug 2017
Based on the above technical solution, the first communication unit can be long distance communication module, the second communication unit can be a Bluetooth communication module, a WiFi ίο communication module, a Zigbee communication module or other close distance communication module.
Based on the above technical solution, the first processing unit comprises a voice recognition unit connected to the sound capture module to recognize voice control command according to the voice collection 15 data.
Based on the above technical solution, the first processing unit comprises an image recognition unit connected to the image capture module to recognize image control command according to the image collection data. 20 Based on the above technical solution, the second processing unit comprises a memory unit, the memory unit has a plurality of preset scene modes and matching relations between the scene modes and the status π information of physical environment. The scene modes include the information parameters such as time, data and geographical location. 2017101085 10 Aug 2017
Based on the above technical solution, the second processing unit is connected to the detecting unit, the detecting unit is configured to 5 detect the status of the present physical environment, and to form detecting data output to the second processing data, the second processing data acquires the present scene mode according to the detecting data. The second processing unit further forms the control instruction according to the present scene mode and the control command output by ίο the first processing unit, and transfers the control instruction to the execution unit. Meanwhile the second processing unit sends the present scene mode, control command and control instruction to the first processing unit by the second communication unit, the first processing unit analyzes the received data, to form analysis result to return to the 15 second processing unit, the first processing unit updates the relationship between the physical environment in the memory unit and the scene mode according to the analysis result. By analyzing the operation the user “used to” do and acquiring the control instruction required by the user, the response is accomplished at once, and the operation by the user is 20 reduced. The operation the user “used to” do can be acquired by frequent operating instructions. And the method for the acquirement is various and it is not described any more. 12
Based on the above technical solution, the detecting unit comprises: 2017101085 10 Aug 2017 a temperature sensor connected to the second processing unit, to acquire the temperature information of present environment, and to form 5 a temperature signal output to the second processing unit. The second processing unit forms an output of temperature control signal according to the present temperature signal. a light sensor connected to the second processing unit, to acquire the light information of present environment, and to form a light signal ίο output to the second processing unit. The second processing unit forms an output of light control signal according to the present light signal. a displacement sensor connected to the second processing unit, to acquire the position information of present environment, and to form a position signal output to the second processing unit. The second 15 processing unit forms an output of position control signal according to the present position signal.
As a further preferred solution, the control signal comprises an audio control signal, a light control signal, a displacement control signal, the execution unit can also comprises: 20 an audio play unit connected to the second processing unit to execute the action of audio play under the effect of the control signal which is output by the second processing unit and is in relevant to the 13 audio play unit; further, the audio play unit is an audio play device inside the robot and/or an audio play device in the present environment where the robot locates, whose control end is connected to the corresponding output end of the second processing unit. 2017101085 10 Aug 2017 5 a light regulation unit connected to the second processing unit to execute the action of light regulation under the effect of the control signal which is output by the second processing unit and is in relevant to the light regulation unit; the light regulation unit is the lighting system in the present environment where the robot locates, whose control end is ίο connected to the corresponding output end of the second processing unit, to regulate the light intensity of the present environment. a drive unit connected to the second processing unit to execute the action of position movement under the effect of the control signal which is output by the second processing unit and is in relevant to the 15 drive unit. For example, when the collection unit needs to collect the image information, the second processing unit sends out the control signal, the drive unit drives the robot to move under the effect of the control signal, and selects the image information which matches to the control signal. 20 The invention can also includes timing device connected to the control end of the audio play unit, the control end of the light regulation unit, and the control end of the temperature regulation unit respectively, 14 2017101085 10 Aug 2017 to output the timing control signal, to timing control the audio play unit, light regulation unit, temperature regulation unit, so that the robot can be utilized conveniently.
Referring to Figure 2, the invention also provides a control 5 method which is applied to robot behavioral control system, wherein it comprises the steps of: controlling a collection device to collect operation instructions input by users to form an output of collection data; controlling the first communication unit to receive the collection 10 data, and to transform the collection data to the output of the collection data matched to the first communication unit; controlling the first processing unit to receive the collection data, and to analyze and process the collection data, to form a control command output by the second communication unit; 15 controlling the second communication unit to transfer the control command to the second processing unit; controlling the second processing unit to form an output of control instruction according to the control command; controlling the execution unit to execute the action under the 20 effect of the control instruction, and the action being matched to the control instruction.
The operation principle of the control method is described in the above description and it will not be explained any more. 2017101085 10 Aug 2017
The above description is only the preferred embodiments of the invention, and it does not limit the implement method and protecting scope of the invention. It is obvious for the skilled in the art that the 5 changing and variation made by the specification and drawings of the invention should fall into the scope of the invention.
The term ‘comprising’ as used in this specification and claims means ‘consisting at least in part of’. When interpreting statements in this specification and claims which include the term ‘comprising’, other ίο features besides the features prefaced by this term in each statement can also be present. Related terms such as ‘comprise’ and ‘comprised’ are to be interpreted in similar manner. 16

Claims (5)

  1. What is claimed is:
    1. A control system, applied to behavioral control device of home service robot, comprising: a collection device configured on a preset position of the robot to collect operation instructions input by the user, and to form an output of collection data; a communication module including a first communication unit and a second communication unit, the first communication unit being connected to the collection device to receive the collection data, and transforming the collection data to the output of the collection data matched to the first communication unit; a first processing unit connected to the first communication unit and the second communication unit respectively, to receive the collection data, and to recognize and process the collection data, to form a control command output by the second communication unit; a second processing unit connected to the second communication unit to receive the control command output by the second communication unit, and form output of control instruction according to the control command; an execution unit connected to the second processing unit to execute actions under the effect of the control instruction, and the action being matched to the control instruction.
  2. 2. The control system as claimed in Claim 1, wherein the collection device comprises: a sound capture module connected to the first communication unit to capture voice message, and to form an output of voice collection data matched to the first communication unit format; an image capture module connected to the first communication unit to capture the image message, and to form an output of image collection data matched to the first communication unit format.
  3. 3. The control system as claimed in Claim 2, wherein the first processing unit comprises: a voice recognition unit connected to the sound capture module to recognize voice control command according to the voice collection data; an image recognition unit connected to the image capture module to recognize image control command according to the image collection data.
  4. 4. The control system as claimed in Claim 1, wherein it further comprises a detecting unit connected to the second processing unit, to detect the status information of the robot at present physical environment, and to form a detection information output to the second processing unit.
  5. 5. The control system as claimed in Claim 4, wherein the detecting unit comprises: a temperature sensor connected to the second processing unit, to acquire the temperature information of present environment, and to form a temperature signal output to the second processing unit; a light sensor connected to the second processing unit, to acquire the light information of present environment, and to form a light signal output to the second processing unit; a displacement sensor connected to the second processing unit, to acquire the position information of present environment, and to form a position signal output to the second processing unit.
AU2017101085A 2015-01-12 2017-08-10 Control system and control method Ceased AU2017101085A4 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2017101085A AU2017101085A4 (en) 2015-01-12 2017-08-10 Control system and control method

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201510015929.6 2015-01-12
PCT/CN2015/081385 WO2016112624A1 (en) 2015-01-12 2015-06-12 Control system and control method
AU2017101085A AU2017101085A4 (en) 2015-01-12 2017-08-10 Control system and control method

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/081385 Division WO2016112624A1 (en) 2015-01-12 2015-06-12 Control system and control method

Publications (1)

Publication Number Publication Date
AU2017101085A4 true AU2017101085A4 (en) 2017-09-14

Family

ID=59798064

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2017101085A Ceased AU2017101085A4 (en) 2015-01-12 2017-08-10 Control system and control method

Country Status (1)

Country Link
AU (1) AU2017101085A4 (en)

Similar Documents

Publication Publication Date Title
CA2973019C (en) Control system and control method for the behavior of a robot
TWI665584B (en) A voice controlling system and method
WO2019091171A1 (en) Voice control method, device, system, and electronic apparatus for smart home appliance
EP3656094B1 (en) Controlling a device based on processing of image data that captures the device and/or an installation environment of the device
CN102945672B (en) Voice control system for multimedia equipment, and voice control method
KR101510860B1 (en) Service Method and Server for Providing Application Comprehended User Intention
US11449672B2 (en) Method for operating speech recognition service and electronic device and server for supporting the same
JP2017010518A (en) Control system, method, and device for intelligent robot based on artificial intelligence
US9899022B2 (en) Multimodal information processing device
JP7017598B2 (en) Data processing methods, devices, devices and storage media for smart devices
US11620995B2 (en) Voice interaction processing method and apparatus
US20190061164A1 (en) Interactive robot
CN111966212A (en) Multi-mode-based interaction method and device, storage medium and smart screen device
CN112908321A (en) Device control method, device, storage medium, and electronic apparatus
EP3769168A1 (en) Processing a command
CN103761967A (en) Embedded speech recognition system
WO2018205105A1 (en) Apparatus and method for implementing sensor of virtual machine
AU2017101085A4 (en) Control system and control method
US11620996B2 (en) Electronic apparatus, and method of controlling to execute function according to voice command thereof
CA3181228A1 (en) Automated assistant control of external applications lacking automated assistant application programming interface functionality
NZ734488B2 (en) A control system for the behaviour of a home service robot
OA18301A (en) Control system and control method.
WO2018023513A1 (en) Home control method based on motion recognition
CN206226617U (en) A kind of distributed RGB D video flowing acquisition systems
Hou et al. SMG: A System-Level Modality Gating Facility for Fast and Energy-Efficient Multimodal Computing

Legal Events

Date Code Title Description
FGI Letters patent sealed or granted (innovation patent)
MK22 Patent ceased section 143a(d), or expired - non payment of renewal fee or expiry