CN104552295A - Man-machine skill transmission system based on multi-information fusion - Google Patents

Man-machine skill transmission system based on multi-information fusion Download PDF

Info

Publication number
CN104552295A
CN104552295A CN201410810610.8A CN201410810610A CN104552295A CN 104552295 A CN104552295 A CN 104552295A CN 201410810610 A CN201410810610 A CN 201410810610A CN 104552295 A CN104552295 A CN 104552295A
Authority
CN
China
Prior art keywords
man
control strategy
robot
myoelectricity
technical ability
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410810610.8A
Other languages
Chinese (zh)
Other versions
CN104552295B (en
Inventor
杨辰光
梁培栋
李智军
李瑞峰
赵立军
张科
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Chuangze Information AND Technology Co., Ltd.
Original Assignee
Nanjing Jixi Automation Technology Co Ltd
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Jixi Automation Technology Co Ltd, South China University of Technology SCUT filed Critical Nanjing Jixi Automation Technology Co Ltd
Priority to CN201410810610.8A priority Critical patent/CN104552295B/en
Publication of CN104552295A publication Critical patent/CN104552295A/en
Application granted granted Critical
Publication of CN104552295B publication Critical patent/CN104552295B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1674Programme controls characterised by safety, monitoring, diagnostic
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • B25J13/08Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • B25J13/085Force or torque sensors
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02Sensing devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02Sensing devices
    • B25J19/04Viewing devices

Abstract

The invention discloses a man-machine skill transmission system based on multi-information fusion. The man-machine skill transmission system comprises a computer connected with a robot, a sensor mounting bracket, and a somatosensory sensor, a binocular vision camera, a human body electromyographic signal acquisition instrument, a man-machine skill transmission adjusting interface and a monitoring display which are connected with the computer respectively, wherein the somatosensory sensor, the binocular vision camera, the human body electromyographic signal acquisition instrument and the man-machine skill transmission adjusting interface are mounted on the sensor mounting bracket respectively; the human body electromyographic signal acquisition instrument is connected with a human body by a measurement electrode; the somatosensory sensor is arranged on a joint of the human body. According to the system, man-machine interaction of a service robot is sufficient and diversified control policies are provided; a plurality of sensors are convenient to mount and the investment cost is remarkably reduced.

Description

A kind of man-machine technical ability transmission system based on Multi-information acquisition
Technical field
The present invention relates to intelligent robot study and control field, particularly a kind of man-machine technical ability transmission system based on Multi-information acquisition.
Background technology
Service robot technology development in recent years is rapid, is day by day subject to people and payes attention to.Compared with traditional industrial robot, people's daily life served by service robot, thus with people closer to, requiring must safety with service robot man-machine interaction, reliable and stable.Simultaneously due to Man's Demands diversity, require that service robot has class people behavioral trait flexibly.It is a kind of convenient that the characteristic of above-mentioned service robot and the expectation of people to service robot impel researcher to find, simple and easy, the human-computer interaction technology that stable and cost is low, namely can realize the stable delivery of technical ability to service robot of people, make service robot better serve popular real life.
China's publication number: CN 103302668A, title: based on control system and the method thereof of the Space teleoperation robot of Kinect.The method realizes the crawl work to space object based on Kinect, but in people's real life, more by fulfiling assignment based on impedance Control, user cannot be made to understand the practical operation situation of robot in real time only by Kinect remote operating, also well cannot complete some complicated meticulous work.Thus more sensor information fusion is needed to carry out more these deficiencies of foot.
China publication number: CN202471117U, title: mounting frame for sensor.The installation of sensor adopts perforating to be fixed on main support, the installation method of this mode needs to offer installing hole, bring certain problem, as inconvenient in located adjustment, the sky offered reduces the intensity of main support, if any positioning requirements, can cause certain agitation error by ectocine, this support Design lacks the fixed mechanism of position adjustment flexibly in addition, is not suitable for having certain requirements experimental occasions to precision.
China publication number: CN202676197U, title: sensor stand.This support Design is scalable, adopts screw-driven.But in large scale position adjustments occasion, this design needs to increase reach, and bring certain difficulty to processing, regulated efficiency can reduce greatly in addition.And lack necessary detent mechanism, when after thread abrasion, bring certain interference can to the location of sensor.
In addition along with the progress of technology, increasing sensor is used for the service field of robot, as binocular vision, and body propagated sensation sensor, touch sensor etc.These sensor installation accuracy cause many harmful effects by the effect of service, as synchronously man-machine in realized, man-machine interaction distortion etc.; In addition due to market upper sensor wide variety, need different sensor mounting interfaces, and the interface of most criteria of right and wrong, need customized separately, bring inconvenience to experimental debugging, spend suitable time and funds.Existing vision sensor is fixed on the crossbeam in wall or room more, and during installation fee, effort, needs technical professional to hole sometimes.As fixing experiment porch, these sensors are fixed on these positions may can not affect normal experimental duties, but once because ambient influnence is as illumination, vibration etc. causes sensor accuracy to decline, at this moment need manually to revise sensor alignment error, obviously the not convenient increase causing adjustment difficulty owing to installing, in addition when needs increase number of sensors or kind, the drawback of the deficient extensibility of traditional installation method is more apparent.In addition some experimental occasions is not suitable for drill hole on wall or lifting operation, as comparatively spacious area or house wiring too much, construction easily causes the generation of contingency.
Summary of the invention
The object of the invention is to overcome the shortcoming of prior art and deficiency, a kind of man-machine technical ability transmission system based on Multi-information acquisition is provided.
Object of the present invention is realized by following technical scheme:
A kind of man-machine technical ability transmission system based on Multi-information acquisition, comprise the computer be connected with robot, mounting frame for sensor, and the body propagated sensation sensor be connected with computer respectively, binocular vision camera, human body electromyographic signal collection instrument, man-machine technical ability transmission adjustment interface, monitor display, described body propagated sensation sensor, binocular vision camera, human body electromyographic signal collection instrument, man-machine technical ability transmission adjustment interface is arranged on mounting frame for sensor respectively, described human body electromyographic signal collection instrument is connected with human body by measurement electrode, described body propagated sensation sensor is arranged on human synovial place.
The described man-machine technical ability transmission system based on Multi-information acquisition, also comprises the force snesor be fixed on handle.Force snesor is fixed on handle, user by applying different power on the different directions of space, the increment of the power passed through estimates that the impedance of human synovial is as rigidity, damping increment, add the accuracy of impedance estimation and the security of man-machine interaction, avoid because man-robot impedance information does not mate the dangerous accident caused.
The described man-machine technical ability transmission system based on Multi-information acquisition, realizes various modes and carries out human-computer interactive control strategy: myoelectricity control strategy, myoelectricity-body sense control strategy, body sense control strategy, myoelectricity-body sense-Visual Feedback Control strategy, body sense-Visual Feedback Control strategy, myoelectricity-Visual Feedback Control strategy.
Described myoelectricity control strategy is specially: gather human body electromyographic signal by electromyographic signal collection instrument, the increment of amplitude increment wherein as human synovial impedance is extracted through process, thus the impedance of acquisition physical activity is planned and is realized the transmission of behavioral trait to robot of people by the impedance control module of robot, makes robot have the impedance characteristics of planning of people.
Described myoelectricity control strategy comprises the step of following order:
S1. the own surface electromyogram signal of user's collection, records corresponding electromyographic signal applied force simultaneously and adopts 20-500Hz bandpass filter to carry out pretreatment to signal and 50Hz notch filter to signal;
S2. adopt AF-FM algorithm to carry out feature extraction to signal, extracting cycle is 0.1s, obtains signal amplitude envelope curve;
S3. the increment of computing power and the surface electromyogram signal amplitude increment of correspondence, utilizes the coefficient of the linear approximate relationship settling signal of electromyographic signal and force signal to estimate and impedance estimation;
S4. by the impedance control module of robot, the data transfer mode of TCP or UDP is adopted to realize the transmission of technical ability to robot of people.
Described myoelectricity-body sense control strategy is: on myoelectricity control strategy basis, introduces body propagated sensation sensor, is obtained the position of human synovial, the information such as speed by body propagated sensation sensor, by controlling while the impedance Control Interface realization impedance of robot and position.
Described body sense control strategy is: only by body propagated sensation sensor, obtains human body joint motion information and carries out man-machine interaction.
Whether described myoelectricity-body sense-Visual Feedback Control strategy is: at myoelectricity-body sense control strategy, visual feedback is introduced on basis, mated, and adjust in real time by binocular camera real-time monitored robot behavior with the behavior of people.Myoelectricity-body sense-Visual Feedback Control strategy is adopted to reach safety, accurate human-computer interactive control object.
Described body sense-Visual Feedback Control strategy is: on body sense control strategy basis, introduce visual feedback, makes the behavior of people consistent with robot behavior height.
Described myoelectricity-Visual Feedback Control strategy is: on myoelectricity control strategy basis, introduce visual feedback, and the change being convenient to user's environment according to robot adjusts self behavior in time, corrects the behavior of robot.Myoelectricity-Visual Feedback Control strategy makes robot stabilized, reliability service.
Compared with prior art, tool has the following advantages and beneficial effect in the present invention:
1, the invention provides one based on the man-machine technical ability transmission system of Multi-information acquisition, system sensor positioning precision is high, reliable and stable, system modular degree is high, volume is little, easy to operate, low cost of manufacture, can overcome that conventional stent installation accuracy is low, interface does not mate, sensor installs by problems such as limited space, input cost are high and control system is simple, control model is various.
2, system of the present invention, service robot human-machine interactive information is abundant, control strategy is various, and multisensor is easy for installation, input cost significantly reduces.
Accompanying drawing explanation
Fig. 1 is the structural representation of a kind of man-machine technical ability transmission system based on Multi-information acquisition of the present invention;
Fig. 2 is for the system described in Fig. 1 is based on surface electromyogram signal impedance increment estimation principle figure;
Fig. 3 always schemes for the system myoelectricity described in Fig. 1-body propagated sensation sensor-binocular vision control strategy;
Fig. 4 is the system surfaces electromyographic signal process chart described in Fig. 1;
The sensor support structure schematic diagram that Fig. 5 is the system described in Fig. 1;
The structural representation of the binocular camera visual angle fine setting rotary joint that Fig. 6 is the system described in Fig. 1;
The structural representation of the body propagated sensation sensor visual angle fine setting rotation platform that Fig. 7 is the system described in Fig. 1.
Detailed description of the invention
Below in conjunction with embodiment and accompanying drawing, the present invention is described in further detail, but embodiments of the present invention are not limited thereto.
A kind of based on the man-machine technical ability transmission system of Multi-information acquisition, be made up of body propagated sensation sensor, binocular vision camera, human body electromyographic signal collection instrument, man-machine technical ability transmission adjustment interface, monitor display, sensor support support.System sensor is fixed on the adjustable platform support of three-dimensional, user gathers the electromyographic signal of self by electromyographic signal collection instrument, extract impedance information wherein, the movable information of self is extracted by body propagated sensation sensor, through man-machine technical ability transmission adjustment interface, above-mentioned information is assessed, then robot is transferred to by motion planning and robot control interface, complete the technical ability of people to robotic delivery, binocular vision sensor is as feedback element, make user control robot running status in real time, guarantee accuracy and the security of service.Whole system framework as shown in Figure 1.
This system has following subsystem to form: surface electromyogram signal measures adjustment System: be made up of measurement electrode and electromyographic signal collection instrument, this system carries out On-line Estimation by the electromyographic signal recorded to human synovial impedance information, thus obtain the value of human synovial impedance and the impedance planning of corresponding actions, and be mapped on robot body.
Body motion information measuring system: obtain human body joint motion information by body propagated sensation sensor, is mapped to robot after adjustment.
Vision feedback system: by the Real-time Feedback of binocular camera, makes user understand the ruuning situation of robot in time, improves accuracy and the security of service.
Wherein, the adjusting stage of surface electromyogram signal measurement adjustment System adopts force snesor to merge with electromyographic signal the joint impedance information extracted under the different behavior of human body.Force snesor is fixed on handle, user by applying different power on the different directions of space, the increment of the power passed through estimates that the impedance of human synovial is as rigidity, damping increment, add the accuracy of impedance estimation and the security of man-machine interaction, avoid because man-robot impedance information does not mate the dangerous accident caused.
Human body impedance increment estimates flow process as shown in Figure 2, its concrete steps are: stick myoelectricity acquisition electrode on the muscle skin surface of user's arm relevant position, obtain original electromyographic signal by the muscles of the arm motion, obtain the power that produces of arm muscles by force snesor simultaneously.Original electromyographic signal waits process to obtain its amplitude envelope and increment after filtering, obtains the power increment under the same sampling time simultaneously.Obtain corresponding stiffness coefficient through human muscle's stiffness coefficient assessment interface, thus obtain the incremental stiffness of articular muscle.
Signal processing flow as shown in Figure 4.This handling process divides following several stages:
(1) pretreatment, this stage mainly completes the filtering process of electromyographic signal, obtains the electromyographic signal of corresponding frequencies scope and removes the interference of ambient noise;
(2) signal subsection, this stage is according to the windowing process of the main settling signal of the minimal time delay of real-time control system;
(3) signal decomposition, each signal subsection divides five sub-bandwidth according to FIR filter;
(4) according to the amplitude envelope of the Energy Decomposition algorithm acquisition electromyographic signal of Teager;
(5) sequence is level and smooth, utilizes 21 mean filters to remove the burr of amplitude envelope;
(6) space-time is average, is mainly divided into two stages, i.e. time average and space average.The former amplitude fluctuations in smoothingtime sequence, the latter is used for the smoothing processing between different passage.
Body motion information measuring system: obtain human body joint motion information by body propagated sensation sensor, be mapped on robot body by inverse kinematics, robot is made to complete some complexity by teaching, highly difficult task, improve the convenience of man-machine interaction, reduce algorithm complex, and extend man-machine interaction mode.
Vision feedback system: for user provides teaching operation feedback intuitively, add reliability and the controllability of service robot teaching operation.Sensor adopts binocular vision camera, is connected on man-machine interaction support, its base adjustable field of view angle, is convenient to obtain good visual effect.
The man-machine technical ability transmission system of described service robot Multi-information acquisition, this system can realize various modes and carry out human-computer interactive control strategy:
Myoelectricity control strategy;
Myoelectricity-body sense control strategy;
Body sense control strategy;
Myoelectricity-body sense-Visual Feedback Control strategy;
Body sense-Visual Feedback Control strategy;
Myoelectricity-Visual Feedback Control strategy.
Described myoelectricity control strategy is: gather human body electromyographic signal by electromyographic signal collection instrument, the increment of amplitude increment wherein as human synovial impedance is extracted through process, thus the impedance of acquisition physical activity is planned and is realized the transmission of behavioral trait to robot of people by robot impedance control module, makes robot have the impedance characteristics of planning of people.
Described myoelectricity-body sense control strategy is: on myoelectricity control strategy basis, introduces body propagated sensation sensor, is obtained the position of human synovial, the information such as speed by body propagated sensation sensor, by controlling while robot impedance Control Interface realization impedance and position.
Described body sense control strategy is: simple by body propagated sensation sensor, obtains human body joint motion information and carries out man-machine interaction.
Described myoelectricity-body sense-Visual Feedback Control strategy is: at myoelectricity-body sense control strategy, visual feedback is introduced on basis, whether mated with the behavior of people by binocular camera real-time monitored robot behavior, and carry out real-time adjustment, reach safety, accurate human-computer interactive control object.As Fig. 3, user obtains its arm motion information by body propagated sensation sensor and passes to service robot in real time, makes service robot perform corresponding task according to the motion intention of people, is obtained the tasks carrying situation of service robot by binocular vision feedback in real time.At impedance Control end, user is by being obtained from skill arm surface electromyogram signal, information fusion through force snesor and myoelectricity Acquisition Instrument carries out incremental stiffness assessment, obtains rigidity metewand, realizes the impedance Control of service robot through Dynamic Models of Robot Manipulators and Torque Control interface.User also obtains the force feedback of robot in task implementation in real time by force snesor.
Described body sense-Visual Feedback Control strategy is: on body sense control strategy basis, introduce visual feedback, makes the behavior of people consistent with robot behavior height.
Described myoelectricity-Visual Feedback Control strategy is: on myoelectricity control strategy basis, introduce visual feedback, and the change being convenient to user's environment according to robot adjusts self behavior in time, corrects the behavior of robot, makes robot stabilized, reliability service.
Multi-information acquisition system, by motion interface system, information fusion sensor as aforementioned obtained, to this system, completes service.
Described myoelectricity control strategy key step is as follows:
Step 1: the surface electromyogram signal of user's collection own, records corresponding electromyographic signal applied force simultaneously and adopts 20-500Hz bandpass filter to carry out pretreatment to signal and 50Hz notch filter to signal;
Step 2: adopt AF-FM algorithm to carry out feature extraction to signal, extracting cycle is 0.1s, obtains signal amplitude envelope curve;
Step 3: the increment of computing power and corresponding surface electromyogram signal amplitude increment, utilizes the coefficient of the linear approximate relationship settling signal of electromyographic signal and force signal to estimate and impedance estimation;
Step 4: by man-machine impedance Control interface, adopts the data transfer mode of TCP or UDP to realize the transmission of technical ability to robot of people.
As Fig. 5,6,7, sensor stand is made up of base 1, balanced adjustment bar 2, balance connector 3, height adjusting link 4, corner connector 5, visual angle adjusting lever 6, binocular camera 7, visual field adjustment platform 8, body propagated sensation sensor 9, body propagated sensation sensor turntable 10, mounting frame for sensor 11.Connection between aluminium section bar all adopts dismountable corner connector, is convenient to dismounting and adjustment.The height adjustable of balanced adjustment bar, length direction is adjustable, is convenient to keep the stable of whole framework and Appropriate application space.Visual angle adjusting lever and sensor support frame height adjustable, be convenient to adjust visual field.
Height adjusting link 4 is by screw and be tightly fixed on base 1, and height adjusting link 4 is connected by corner connector with balanced adjustment bar 2, makes it not to be moved by external force affects, and improves the balance of height adjusting link; Balance connector 3 connects balanced adjustment bar 2 and testing stand bracing frame by screw fastening, reaches the object of balance; Visual angle adjusting lever 6 is connected by corner connector 5 and height adjusting link 4, simultaneously connecting sensor mounting bracket 11, and mounting frame for sensor 11 is provided with all types of sensor mechanism joint visual field adjustment platforms 8 and body propagated sensation sensor turntable 10 above; Visual field adjustment platform 8 is connected with binocular camera 7 by top flange dish, and body propagated sensation sensor 9 is connected by its top flange with body propagated sensation sensor turntable 10.
Balance connector 3 can according to testing stand, and the height of operating desk etc. regulates the position of self, makes it reach center rest, reduces the object of usage space.This support triangle base can move simultaneously, makes it be in desirable position.
Visual field adjustment platform 8 is connected with binocular camera 7 by top flange dish, can elevating movement, finely tunes the visual angle of camera.Visual field adjustment platform 8 rotary joint be threaded connection formed fastening.Mounting frame for sensor 11 freely can adjust the distance of self and testee on visual angle adjusting lever 6 length direction, plays focusing action.Visual field adjustment platform 8 and body propagated sensation sensor turntable 10 can pass through slide block on mounting frame for sensor 11 length direction, and slide block can also be fastenedly connected by screw and mounting frame for sensor 11, play location maintenance effect.Visual angle adjusting lever 6 freely can adjust oneself height on height adjusting link 4 length direction, the size at adjustment visual angle.
As Fig. 6, visual field adjustment platform 8 is revolutes, connects binocular camera 7 by dynamic boss 12, determine boss 13 connecting sensor support 11, after camera 7 adjusts attitude, tighten by screw bolt and nut, until this revolute can not be rotated under certain External Force Acting.
Body propagated sensation sensor turntable 10 is made up of three parts, moving platform 14, rotating shaft 15 and the flange 16 be connected with sensor stand 11, moving platform 14 can do 360 degree of rotations by rotating shaft 15, and positioned by holding screw, stablizing of holder propagated sensation sensor, is not subject to the impact of ambient vibration and maloperation.
Above-described embodiment is the present invention's preferably embodiment; but embodiments of the present invention are not restricted to the described embodiments; change, the modification done under other any does not deviate from Spirit Essence of the present invention and principle, substitute, combine, simplify; all should be the substitute mode of equivalence, be included within protection scope of the present invention.

Claims (10)

1. the man-machine technical ability transmission system based on Multi-information acquisition, it is characterized in that: comprise the computer be connected with robot, mounting frame for sensor, and the body propagated sensation sensor be connected with computer respectively, binocular vision camera, human body electromyographic signal collection instrument, man-machine technical ability transmission adjustment interface, monitor display, described body propagated sensation sensor, binocular vision camera, human body electromyographic signal collection instrument, man-machine technical ability transmission adjustment interface is arranged on mounting frame for sensor respectively, described human body electromyographic signal collection instrument is connected with human body by measurement electrode, described body propagated sensation sensor is arranged on human synovial place.
2. the man-machine technical ability transmission system based on Multi-information acquisition according to claim 1, is characterized in that: the described man-machine technical ability transmission system based on Multi-information acquisition, also comprises the force snesor be fixed on handle.
3. the man-machine technical ability transmission system based on Multi-information acquisition according to claim 1, is characterized in that: this system realizes various modes and carries out human-computer interactive control strategy: myoelectricity control strategy, myoelectricity-body sense control strategy, body sense control strategy, myoelectricity-body sense-Visual Feedback Control strategy, body sense-Visual Feedback Control strategy, myoelectricity-Visual Feedback Control strategy.
4. the man-machine technical ability transmission system based on Multi-information acquisition according to claim 3, it is characterized in that: described myoelectricity control strategy is specially: gather human body electromyographic signal by electromyographic signal collection instrument, the increment of amplitude increment wherein as human synovial impedance is extracted through process, thus the impedance of acquisition physical activity is planned and is realized the transmission of behavioral trait to robot of people by the impedance control module of robot, makes robot have the impedance characteristics of planning of people.
5. the man-machine technical ability transmission system based on Multi-information acquisition according to claim 4, is characterized in that: described myoelectricity control strategy comprises the step of following order:
S1. the own surface electromyogram signal of user's collection, records corresponding electromyographic signal applied force simultaneously and adopts 20-500Hz bandpass filter to carry out pretreatment to signal and 50Hz notch filter to signal;
S2. adopt AF-FM algorithm to carry out feature extraction to signal, extracting cycle is 0.1s, obtains signal amplitude envelope curve;
S3. the increment of computing power and the surface electromyogram signal amplitude increment of correspondence, utilizes the coefficient of the linear approximate relationship settling signal of electromyographic signal and force signal to estimate and impedance estimation;
S4. by the impedance control module of robot, the data transfer mode of TCP or UDP is adopted to realize the transmission of technical ability to robot of people.
6. the man-machine technical ability transmission system based on Multi-information acquisition according to claim 3, it is characterized in that: described myoelectricity-body sense control strategy is: on myoelectricity control strategy basis, introduce body propagated sensation sensor, the position of human synovial is obtained by body propagated sensation sensor, velocity information, by controlling while the impedance Control Interface realization impedance of robot and position.
7. the man-machine technical ability transmission system based on Multi-information acquisition according to claim 3, is characterized in that: described body sense control strategy is: only by body propagated sensation sensor, obtains human body joint motion information and carries out man-machine interaction.
8. the man-machine technical ability transmission system based on Multi-information acquisition according to claim 3, it is characterized in that: described myoelectricity-body sense-Visual Feedback Control strategy is: at myoelectricity-body sense control strategy, visual feedback is introduced on basis, whether mated with the behavior of people by binocular camera real-time monitored robot behavior, and adjust in real time.
9. the man-machine technical ability transmission system based on Multi-information acquisition according to claim 3, it is characterized in that: described body sense-Visual Feedback Control strategy is: on body sense control strategy basis, introduce visual feedback, makes the behavior of people consistent with robot behavior height.
10. the man-machine technical ability transmission system based on Multi-information acquisition according to claim 3, it is characterized in that: described myoelectricity-Visual Feedback Control strategy is: on myoelectricity control strategy basis, introduce visual feedback, the change being convenient to user's environment according to robot adjusts self behavior in time, corrects the behavior of robot.
CN201410810610.8A 2014-12-19 2014-12-19 A kind of man-machine technical ability transmission system based on Multi-information acquisition Active CN104552295B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410810610.8A CN104552295B (en) 2014-12-19 2014-12-19 A kind of man-machine technical ability transmission system based on Multi-information acquisition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410810610.8A CN104552295B (en) 2014-12-19 2014-12-19 A kind of man-machine technical ability transmission system based on Multi-information acquisition

Publications (2)

Publication Number Publication Date
CN104552295A true CN104552295A (en) 2015-04-29
CN104552295B CN104552295B (en) 2016-06-22

Family

ID=53069893

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410810610.8A Active CN104552295B (en) 2014-12-19 2014-12-19 A kind of man-machine technical ability transmission system based on Multi-information acquisition

Country Status (1)

Country Link
CN (1) CN104552295B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105389008A (en) * 2015-11-04 2016-03-09 惠州Tcl移动通信有限公司 Smart unlocking method and system for mobile terminal
CN105710856A (en) * 2015-06-01 2016-06-29 李锦辉 Remote motion sensing control robot
CN106109174A (en) * 2016-07-14 2016-11-16 燕山大学 A kind of healing robot control method based on myoelectric feedback impedance self-adaptive
CN108062102A (en) * 2018-01-16 2018-05-22 苏州晨本智能科技有限公司 A kind of gesture control has the function of the Mobile Robot Teleoperation System Based of obstacle avoidance aiding
CN109048916A (en) * 2018-09-12 2018-12-21 遂昌睿丰科技有限公司 Portable industrial robot based on multidimensional sensor real time data feedback fusion
CN109676615A (en) * 2019-01-18 2019-04-26 合肥工业大学 A kind of spray robot teaching method and device using arm electromyography signal and motion capture signal
CN110134242A (en) * 2019-05-17 2019-08-16 北京理工大学 A kind of arm rigidity discrimination method and system based on surface electromyogram signal
CN111300408A (en) * 2020-02-06 2020-06-19 北京凡川智能机器人科技有限公司 Humanoid double-arm robot motion planning control method combining shape similarity and expression similarity
CN111590573A (en) * 2020-05-15 2020-08-28 深圳国信泰富科技有限公司 Construction method and system for three-dimensional environment of robot
CN114848315A (en) * 2022-05-05 2022-08-05 广东工业大学 Intelligent wheelchair man-machine cooperative control system based on surface electromyogram signals

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090259338A1 (en) * 2006-04-29 2009-10-15 The Hong Kong Polytechnic University Robotic system and training method for rehabilitation using emg signals to provide mechanical help
CN202471117U (en) * 2011-11-30 2012-10-03 凯迈(洛阳)环测有限公司 Sensor mounting bracket
CN102824176A (en) * 2012-09-24 2012-12-19 南通大学 Upper limb joint movement degree measuring method based on Kinect sensor
JP2013013969A (en) * 2011-07-04 2013-01-24 Hirotaka Niitsuma Robot control by microsoft kinect (r), and application thereof
CN103170973A (en) * 2013-03-28 2013-06-26 上海理工大学 Man-machine cooperation device and method based on Kinect video camera
CN103302668A (en) * 2013-05-22 2013-09-18 东南大学 Kinect-based space teleoperation robot control system and method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090259338A1 (en) * 2006-04-29 2009-10-15 The Hong Kong Polytechnic University Robotic system and training method for rehabilitation using emg signals to provide mechanical help
JP2013013969A (en) * 2011-07-04 2013-01-24 Hirotaka Niitsuma Robot control by microsoft kinect (r), and application thereof
CN202471117U (en) * 2011-11-30 2012-10-03 凯迈(洛阳)环测有限公司 Sensor mounting bracket
CN102824176A (en) * 2012-09-24 2012-12-19 南通大学 Upper limb joint movement degree measuring method based on Kinect sensor
CN103170973A (en) * 2013-03-28 2013-06-26 上海理工大学 Man-machine cooperation device and method based on Kinect video camera
CN103302668A (en) * 2013-05-22 2013-09-18 东南大学 Kinect-based space teleoperation robot control system and method thereof

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
PEIDONG LIANG: "Implementation and Test of Human-Operated and Human-Like Adaptive Impedance Controls on Baxter Robot", 《ADVANCES IN AUTONOMOUS ROBOTICS SYSTEMS,15TH ANNUAL CONFERENCE, TAROS 2014,BIRMINGHAM, UK》 *
王文会等: "基于多传感器信息检测和融合的中国手语识别研究", 《中国生物医学工程学报》 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105710856A (en) * 2015-06-01 2016-06-29 李锦辉 Remote motion sensing control robot
CN105389008B (en) * 2015-11-04 2019-02-26 惠州Tcl移动通信有限公司 A kind of mobile terminal intelligent unlocking method and system
CN105389008A (en) * 2015-11-04 2016-03-09 惠州Tcl移动通信有限公司 Smart unlocking method and system for mobile terminal
CN106109174A (en) * 2016-07-14 2016-11-16 燕山大学 A kind of healing robot control method based on myoelectric feedback impedance self-adaptive
CN106109174B (en) * 2016-07-14 2018-06-08 燕山大学 A kind of healing robot control method based on myoelectric feedback impedance self-adaptive
CN108062102A (en) * 2018-01-16 2018-05-22 苏州晨本智能科技有限公司 A kind of gesture control has the function of the Mobile Robot Teleoperation System Based of obstacle avoidance aiding
CN109048916A (en) * 2018-09-12 2018-12-21 遂昌睿丰科技有限公司 Portable industrial robot based on multidimensional sensor real time data feedback fusion
CN109676615A (en) * 2019-01-18 2019-04-26 合肥工业大学 A kind of spray robot teaching method and device using arm electromyography signal and motion capture signal
CN110134242A (en) * 2019-05-17 2019-08-16 北京理工大学 A kind of arm rigidity discrimination method and system based on surface electromyogram signal
CN110134242B (en) * 2019-05-17 2020-07-24 北京理工大学 Arm stiffness identification method and system based on surface electromyographic signals
CN111300408A (en) * 2020-02-06 2020-06-19 北京凡川智能机器人科技有限公司 Humanoid double-arm robot motion planning control method combining shape similarity and expression similarity
CN111590573A (en) * 2020-05-15 2020-08-28 深圳国信泰富科技有限公司 Construction method and system for three-dimensional environment of robot
CN114848315A (en) * 2022-05-05 2022-08-05 广东工业大学 Intelligent wheelchair man-machine cooperative control system based on surface electromyogram signals
CN114848315B (en) * 2022-05-05 2022-12-13 广东工业大学 Intelligent wheelchair man-machine cooperative control system based on surface electromyogram signals

Also Published As

Publication number Publication date
CN104552295B (en) 2016-06-22

Similar Documents

Publication Publication Date Title
CN104552295B (en) A kind of man-machine technical ability transmission system based on Multi-information acquisition
CN103934823B (en) A kind of 6-PTRT type parallel robot with self calibrating function
CN106584093A (en) Self-assembly system and method for industrial robots
CN107479698A (en) A kind of more fingers collaboration force feedback of air pressure driving and touch feedback gloves apparatus
CN103995478A (en) Modularized hydraulic mechanical arm experimental platform and method based on interaction of virtual and reality
CN107199566B (en) A kind of remote control system of the space-oriented station robot based on virtual arm
CN203831398U (en) 6-PTRT type parallel-connected robot with automatic calibrating function
CN1947960A (en) Environment-identification and proceeding work type real-man like robot
CN101972170B (en) Self-adapting filter for least square support vector machine and filtering method thereof
CN104008052A (en) Universal computer product testing system and method
CN105278382A (en) Method of intelligent wearable equipment for controlling automobile central control system in wireless remote manner
CN107560777A (en) Three-dimensional force feedback handle restoring force control structure and method based on power/torque sensor
CN107942726A (en) A kind of magnetic levitation ball lever system HWIL simulation experiment porch based on accelerated model
CN105650064B (en) A kind of Pneumatic position control device based on DSP
CN205336450U (en) Imitative hawk eye vision image device of distinguishable rate transform
CN204195750U (en) Modular hand-held dual operation end main robot
CN105302307A (en) Method for behavior matching by acquiring direction information through acceleration sensor
CN105425660A (en) Analysis matching work method realizing human body behavior determination through inertia sensor
CN202507280U (en) Humanoid robot
CN101539468B (en) Testing system for joint internal force of climbing worm type robot
CN105243720B (en) The method that pulse data carries out gate inhibition's safe identification is obtained by Intelligent bracelet
CN201147303Y (en) Dynamic pedal device of human body balance function testing system
CN105425658A (en) Intelligent wearable equipment control strategy for controlling voice database through gesture identification
CN111906774A (en) Assembly robot gravity compensation control device and method based on real-time force control
CN105404182B (en) Acceleration of gravity instrument obtains the method that directional information carries out behavioural analysis

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20171122

Address after: 276800 Rizhao City Economic Development Zone, Wenzhou Road, No., science and technology incubator building, building 4, building 1

Patentee after: Shandong Chuangze Information AND Technology Co., Ltd.

Address before: 510640 Tianhe District, Guangdong, No. five road, No. 381,

Co-patentee before: NANJING JIXI AUTOMATION TECHNOLOGY CO., LTD.

Patentee before: South China University of Technology

TR01 Transfer of patent right