CN102789327A - Method for controlling mobile robot on basis of hand signals - Google Patents

Method for controlling mobile robot on basis of hand signals Download PDF

Info

Publication number
CN102789327A
CN102789327A CN2012102795856A CN201210279585A CN102789327A CN 102789327 A CN102789327 A CN 102789327A CN 2012102795856 A CN2012102795856 A CN 2012102795856A CN 201210279585 A CN201210279585 A CN 201210279585A CN 102789327 A CN102789327 A CN 102789327A
Authority
CN
China
Prior art keywords
mobile robot
finger
screen
control
gesture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012102795856A
Other languages
Chinese (zh)
Other versions
CN102789327B (en
Inventor
孟偲
郭树德
曲圣悦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei Sineva Intelligent Machine Co Ltd
Original Assignee
Beihang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihang University filed Critical Beihang University
Priority to CN201210279585.6A priority Critical patent/CN102789327B/en
Publication of CN102789327A publication Critical patent/CN102789327A/en
Application granted granted Critical
Publication of CN102789327B publication Critical patent/CN102789327B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

A method for controlling a mobile robot on basis of hand signals is realized according to the following steps of: selecting appropriate control terminal equipment and an appropriate mobile robot, and building a control system of the mobile robot; and mapping a hand signal which is made by an operator on a touch screen of a control terminal into a movement control command of the mobile robot, sending the command to the mobile robot, and realizing the movement of the mobile robot according to the movement command. The method has the following advantages that the hand signals are utilized to realize the movement control of the mobile robot, is intuitive and simple and convenient to operate, and is in accordance with human operation habits; and the control terminal of the mobile robot can be simplified, the size and weight are reduced, and the mobile robot is convenient to carry and transport.

Description

A kind of mobile robot control method based on gesture
Technical field
The present invention relates to a kind of mobile robot control method based on gesture; Mainly be with the steering order that is mapped as the video camera that carries on mobile robot, the last The Cloud Terrace that carries of mobile robot and the The Cloud Terrace at the gesture operation on the touch screen equipment; Realization utilizes the purpose of gesture control mobile robot, The Cloud Terrace and camera motion, belongs to mobile robot's interaction control technology field.
Background technology
Because circumstance complication, the system handles information capability is limited, and the mobile robot mainly relies on operating personnel's manual operation control at present.
Traditional mobile robot control method mainly contains two kinds, and a kind of is on the control enclosure panel, to use operating rod (or rocking bar) to combine button that robot is controlled.Its advantage is visual in image, and shortcoming is that the control enclosure build is huge, influences portable transportation and manipulates; Another kind is on the computer software interface, to use button to combine external operating rod (or rocking bar) that robot is controlled.Its advantage is the space of having saved part control enclosure panel, and shortcoming is a complicated operation, can't break away from the dependence to operating rod.
Therefore, traditional mobile robot control method, operation easier is big, is not easy to carrying and transporting of operating personnel, thereby when the mobile robot is directly controlled, is limited to.
Summary of the invention
Technology of the present invention is dealt with problems: the mobile robot control terminal bodily form is huge to having now, the problem of complicated operation, provides a kind of gesture operation that is utilized on the touch screen equipment directly to control mobile robot's method.This method can be simplified control terminal, makes it to be easy to carry; Utilize gesture control mobile robot, meet people's operating habit more, simplify the operation, can let the convenient control moveable robot movement of operating personnel.
The mobile robot control method that the present invention is based on gesture realizes on following hardware carrier: control terminal and mobile robot with touch display screen.The connected mode of above hardware is as shown in Figure 1: will be mobile robot's motion control instruction in the operation map on the control terminal touch display screen, and send to the mobile robot, the mobile robot carries out this steering order; The video camera shooting environmental video of the last lift-launch of mobile robot feeds back to the control terminal display screen and shows, so that operating personnel observe operation.
Wherein, control terminal can be selected panel computer for use.Panel computer has the function of complete computing machine as knowing the touch input device of knowledge, can the software that compile be moved on panel computer, and can realize and the information interaction of robot.
Wherein, the mobile robot can select wheeled or caterpillar robot for use, mobile robot's last installation two-degree-of-freedom cradle head and Zoom camera, and the focal length of the angle of pitch of The Cloud Terrace and deflection angle and Zoom camera can be controlled through instruction.
The present invention is based on the mobile robot control method of gesture, its control method FB(flow block) is as shown in Figure 2, is realized by following concrete steps:
(1) set up the mobile robot control system, be embodied as:
(1.1) the calculation display equipment of selecting to have touch function is as control terminal;
(1.2) controlling object is the mobile robot, and this mobile robot goes up the equipment that carries and comprises the Zoom camera that carries on two-degree-of-freedom cradle head and the The Cloud Terrace at least;
(1.3) set up control terminal and mobile robot's communication channel;
(1.4) on control terminal, show the video image that video camera is taken;
(2) set up the mapping relations of gesture and moveable robot movement state, said mapping relations are:
(2.1) when a finger touch screen only being arranged and slide in effective viewing area of video image on screen, as shown in Figure 3, the finger sliding action is mapped as the steering order to The Cloud Terrace, is specially:
(2.1.1) when finger sliding distance on screen surpasses predetermined threshold, begin to produce steering order to The Cloud Terrace;
(2.1.2) finger slip component of horizontal direction and vertical direction on screen is mapped as the control to the The Cloud Terrace deflection angle and the angle of pitch respectively.It is identical with finger horizontal slip component direction that the The Cloud Terrace deflection angle changes direction; It is identical with the vertical slip component direction of finger that the The Cloud Terrace angle of pitch changes direction;
(2.1.3) frame out when finger, stop control The Cloud Terrace;
(2.2) when a finger touch screen only being arranged and double-click effective viewing area of video image on screen, as shown in Figure 4, The Cloud Terrace produces homing action, gets back to initial position;
When (2.3) effective viewing area of video image all produced slip as two finger touch screens and on screen, as shown in Figure 5, the finger sliding action was mapped as the steering order to focal length of camera, is specially:
(2.3.1) when the relative distance of two fingers on screen changes above predetermined threshold, begin to produce steering order to focal length of camera;
(2.3.2) when two finger relative distances increase, i.e. during two finger disengaging movements, expression is carried out amplifieroperation to present image, and the control focal length of camera increases with the observation that furthers;
(2.3.3) when two finger relative distances when reducing, promptly during two finger move toward one another, expression is carried out reduction operation to present image, and the control focal length of camera diminishes to increase field of view;
(2.3.4) when two fingers stop are moved or frameed out, stop control to focal length of camera;
(2.4) as two finger touch screens; But producing, the effective viewing area of having only finger video image on screen slides and during an other finger transfixion; As shown in Figure 6, the finger sliding action is mapped as the motion control instruction to the mobile robot, is specially:
(2.4.1) when a finger touch screen transfixion and another finger sliding distance on screen when surpassing predetermined threshold begins to produce the motion control instruction to the mobile robot;
(2.4.2) initial touch point with the finger that slides is an initial point; Touch point with in the finger slip of sliding is that terminal point is set up vector; The distance map of sliding is the control to mobile robot's rate travel or slewing rate; The direction of vector is mapped as the control to the moveable robot movement direction: when the angle of direction vector and screen vertical direction during less than setting threshold, the mobile robot moves forward or backward; When the angle of direction vector and screen level direction during less than setting threshold, mobile robot's pivot stud or parallel being displaced sideways; When the angle of direction vector and screen level direction and vertical direction all was not less than setting threshold, the mobile robot produced in traveling process and turns to or be displaced sideways;
(2.4.3) when a finger frames out, stop motion control, mobile robot's stop motion to the mobile robot.
The present invention's advantage compared with prior art is: traditional mobile robot's control enclosure comprises parts such as operating rod, control button and display screen, and control enclosure is heavier and bulky, is not easy to carrying and transporting of operating personnel.Technical scheme of the present invention utilizes gesture to realize the mutual control to the mobile robot; Can save parts such as operating rod and button on the control enclosure; Simplifying control enclosure forms; Effectively increase display area, both helped operating personnel that the mobile robot is carried out operation supervise and control, also help operating personnel to bear transportation.Utilize gesture control mobile robot convenient directly perceived, simple to operate simultaneously; Touch screen equipment is convenient for carrying, and has also enlarged the scope of application of the present invention.In addition, the extensive of touch screen equipment popularized, and makes the present invention have wide application prospect.
Description of drawings
Fig. 1 connects synoptic diagram for the hardware that the inventive method realizes;
Fig. 2 is the control flow block diagram of the inventive method;
Fig. 3 is a slip gesture synoptic diagram;
Fig. 4 is for double-clicking the gesture synoptic diagram;
Fig. 5 is a convergent-divergent gesture synoptic diagram;
Fig. 6 is for dragging the gesture synoptic diagram.
Embodiment
The particular hardware carrier that combines to be selected for use through specific embodiment below is described in detail the mobile robot control method that the present invention is based on gesture, shown in Fig. 1-6.
(1) sets up the mobile robot control system;
Be specially: select the expectant control terminal device; The embodiment of the invention adopts the ViewPad97i panel computer of ViewSonic company as control terminal; Select a wireless router as information interaction equipment; The UP-Voyager II two-wheel drive machines people of wound company production is won as the Be Controlled mobile robot in selection Beijing, and on this mobile robot, carries the EVI-D80P of Sony camera as Be Controlled The Cloud Terrace and video camera.Control terminal is through the information interaction of wireless router realization with the mobile robot.Under Windows XP operating system, utilize the panel computer control program of the Visual C++ exploitation of Microsoft company that the mobile robot is controlled.The mapping transformation of gesture on the control terminal and moveable robot movement state is accomplished by this control program.
(2) when above-mentioned mobile robot control system set up finish after, set up the mapping relations of gesture and moveable robot movement state, said mapping relations are:
(2.1) when a finger touch screen only being arranged and slide in effective viewing area of video image on screen, as shown in Figure 3, the finger sliding action is mapped as the steering order to The Cloud Terrace, is specially:
(2.1.1) sliding distance surpasses predetermined threshold R on screen when pointing 1The time, begin to produce steering order to The Cloud Terrace.Here, R 1=30 pixels;
(2.1.2) finger slip component of vertical direction on screen is mapped as the control to the The Cloud Terrace angle of pitch, pitching angle theta 1=k 1* y, the direction that the The Cloud Terrace angle of pitch changes is identical with the vertical slip component direction of finger; Finger slip component of horizontal direction on screen is mapped as the control to the The Cloud Terrace deflection angle, deflection angle theta 2=k 2* x, the direction that the The Cloud Terrace deflection angle changes is identical with finger horizontal slip component direction.Here, y, x are respectively the slip component of the vertical and horizontal direction of finger on screen, k 1, k 2Be respectively The Cloud Terrace angle of pitch gain coefficient and deflection angle gain coefficient.Here, k 1=k 2=0.216;
(2.1.3) frame out when finger, stop control The Cloud Terrace;
(2.2) when a finger touch screen only being arranged and double-click effective viewing area of video image on screen, as shown in Figure 4, The Cloud Terrace produces homing action, gets back to initial position;
When (2.3) effective viewing area of video image all produced slip as two finger touch screens and on screen, as shown in Figure 5, the finger sliding action was mapped as the steering order to focal length of camera, is specially:
(2.3.1), the relative distance of two fingers on screen surpasses predetermined threshold R when changing 2The time, begin to produce steering order to focal length of camera.Here, R 2=30 pixels;
(2.3.2) when two finger relative distances increase, i.e. during two finger disengaging movements, expression is carried out amplifieroperation to present image, and the control focal length of camera increases with the observation that furthers;
(2.3.3) when two finger relative distances when reducing, promptly during two finger move toward one another, expression is carried out reduction operation to present image, and the control focal length of camera diminishes to increase field of view;
(2.3.4) when two fingers stop are moved or frameed out, stop control to focal length of camera;
(2.4) as two finger touch screens; But producing, the effective viewing area of having only finger video image on screen slides and during an other finger transfixion; As shown in Figure 6, the finger sliding action is mapped as the motion control instruction to the mobile robot, is specially:
(2.4.1) when a finger touch screen transfixion and another finger sliding distance on screen surpasses predetermined threshold R 3The time, begin to produce motion control instruction to the mobile robot.Here, R 3=30 pixels.
(2.4.2) initial touch point with the finger that slides is an initial point, and the touch point in sliding with the finger that slides is that terminal point is set up vector, and the distance map of slip is the control to mobile robot's rate travel or slewing rate, rate travel or slewing rate v=k 3* l, the direction of vector is mapped as the control of mobile robot's direction: when the angle of direction vector and screen vertical direction during less than setting threshold α, the mobile robot moves forward or backward; When the angle of direction vector and screen level direction during less than setting threshold β, mobile robot's pivot stud or parallel being displaced sideways; When the angle of direction vector and horizontal direction and vertical direction all was not less than setting threshold, the mobile robot produced in traveling process and turns to.Wherein, the distance that l moves for the finger that slides, k 3Be the rate gain coefficient.Here, k 3=0.53, α=β=5 °;
(2.4.3) when a finger frames out, stop motion control, mobile robot's stop motion to the mobile robot.
In a word, the present invention has following advantage: utilize gesture to realize the motion control to the mobile robot, operate intuitively easyly, meet people's operating habit; Can simplify the mobile robot control terminal, reduce volume weight, transportation is easy to carry.
Instructions of the present invention is not set forth the known technology that part belongs to those skilled in the art in detail.
The above only is a preferred implementation of the present invention; Should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; Can also make some improvement and retouching, these improvement and retouching also should be regarded as protection scope of the present invention.

Claims (5)

1. mobile robot control method based on gesture is characterized in that performing step is following:
(1) set up the mobile robot control system, be embodied as:
(1.1) the calculation display equipment of selecting to have touch function is as control terminal;
(1.2) controlling object is the mobile robot, and this mobile robot goes up the equipment that carries and comprises at least: the Zoom camera that carries on two-degree-of-freedom cradle head and the The Cloud Terrace;
(1.3) set up control terminal and mobile robot's communication channel;
(1.4) on control terminal, show the video image that video camera is taken;
(2) set up the mapping relations of gesture and moveable robot movement state, said mapping relations are:
(2.1) when a finger touch screen only being arranged and slide in effective viewing area of video image on screen, the finger sliding action is mapped as the steering order to The Cloud Terrace, is specially:
(2.1.1) when finger sliding distance on screen surpasses predetermined threshold, begin to produce steering order to The Cloud Terrace;
(2.1.2) finger slip component of horizontal direction and vertical direction on screen is mapped as the control to the The Cloud Terrace deflection angle and the angle of pitch respectively.It is identical with finger horizontal slip component direction that the The Cloud Terrace deflection angle changes direction; It is identical with the vertical slip component direction of finger that the The Cloud Terrace angle of pitch changes direction;
(2.1.3) frame out when finger, stop control The Cloud Terrace;
(2.2) when a finger touch screen only being arranged and double-click effective viewing area of video image on screen, The Cloud Terrace produces homing action, gets back to initial position;
When (2.3) effective viewing area of video image all produced slip as two finger touch screens and on screen, the finger sliding action was mapped as the steering order to focal length of camera, is specially:
(2.3.1) when the relative distance of two fingers on screen changes above predetermined threshold, begin to produce steering order to focal length of camera;
(2.3.2) when two finger relative distances increase, i.e. during two finger disengaging movements, expression is carried out amplifieroperation to present image, and the control focal length of camera increases with the observation that furthers;
(2.3.3) when two finger relative distances when reducing, promptly during two finger move toward one another, expression is carried out reduction operation to present image, and the control focal length of camera diminishes to increase field of view;
(2.3.4) when two fingers stop are moved or frameed out, stop control to focal length of camera;
(2.4), but have only the effective viewing area of finger video image on screen to produce to slide and during an other finger transfixion, the finger sliding action is mapped as the motion control instruction to the mobile robot, is specially as two finger touch screens:
(2.4.1) when a finger touch screen transfixion and another finger sliding distance on screen when surpassing predetermined threshold begins to produce the motion control instruction to the mobile robot;
(2.4.2) initial touch point with the finger that slides is an initial point; Touch point with in the finger slip of sliding is that terminal point is set up vector; The distance map of sliding is the control to mobile robot's rate travel or slewing rate; The direction of vector is mapped as the control to the moveable robot movement direction: when the angle of direction vector and screen vertical direction during less than setting threshold, the mobile robot moves forward or backward; When the angle of direction vector and screen level direction during less than setting threshold, mobile robot's pivot stud or parallel being displaced sideways; When the angle of direction vector and horizontal direction and vertical direction all was not less than setting threshold, the mobile robot produced in traveling process and turns to or be displaced sideways;
(2.4.3) when a finger frames out, stop motion control, mobile robot's stop motion to the mobile robot.
2. the mobile robot control method based on gesture according to claim 1 is characterized in that: said control terminal is the interactive device that comprises touch-screen, like panel computer, touch-screen smart mobile phone etc.
3. the mobile robot control method based on gesture according to claim 1 is characterized in that: said controlling object is the mobile robot with video monitoring and video scouting function.
4. the mobile robot control method based on gesture according to claim 1; It is characterized in that: gesture is meant the touch point change in location of finger on touch-screen, and the gesture that is used to control the mobile robot has four kinds: single finger contact screen also moves and forms the slip gesture; The double at short notice touch screen of single finger forms double-clicks gesture; Two fingers slide on screen simultaneously and form the convergent-divergent gesture; Motionless and another finger of finger contact screen slide to form and to drag gesture.
5. the mobile robot control method based on gesture according to claim 1 is characterized in that: the slip gesture is mapped as pitching, the yaw motion control of The Cloud Terrace; The double-click gesture is mapped as the control that resets of The Cloud Terrace; The convergent-divergent gesture is mapped as the control of focal length of camera; Drag gesture and be mapped as mobile robot's motion control.
CN201210279585.6A 2012-08-07 2012-08-07 Method for controlling mobile robot on basis of hand signals Active CN102789327B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210279585.6A CN102789327B (en) 2012-08-07 2012-08-07 Method for controlling mobile robot on basis of hand signals

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210279585.6A CN102789327B (en) 2012-08-07 2012-08-07 Method for controlling mobile robot on basis of hand signals

Publications (2)

Publication Number Publication Date
CN102789327A true CN102789327A (en) 2012-11-21
CN102789327B CN102789327B (en) 2015-04-08

Family

ID=47154739

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210279585.6A Active CN102789327B (en) 2012-08-07 2012-08-07 Method for controlling mobile robot on basis of hand signals

Country Status (1)

Country Link
CN (1) CN102789327B (en)

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103729057A (en) * 2013-12-18 2014-04-16 京东方科技集团股份有限公司 Method and system for controlling postures of display device by using gestures
CN103941991A (en) * 2013-01-21 2014-07-23 联想(北京)有限公司 Information processing method and electronic equipment
CN103978487A (en) * 2014-05-06 2014-08-13 北京易拓智谱科技有限公司 Gesture-based control method for terminal position of universal robot
CN104267444A (en) * 2014-10-23 2015-01-07 淮海工学院 Real-time three-dimensional imaging device for hole
CN104781781A (en) * 2014-11-14 2015-07-15 深圳市大疆创新科技有限公司 Control method, apparatus and moving equipment for object moving
CN105137860A (en) * 2015-07-31 2015-12-09 重庆世纪精信实业(集团)有限公司 Remote monitoring and control system for industrial manipulator based on Internet
CN105159157A (en) * 2015-07-31 2015-12-16 重庆世纪精信实业(集团)有限公司 Video-assisted system for industrial manipulator remote control
CN105302021A (en) * 2015-10-23 2016-02-03 哈尔滨工业大学 Wearable gesture control device for controlling movement of robot in human-computer collaborative remanufacturing
CN105313129A (en) * 2015-12-03 2016-02-10 中国电子科技集团公司第二十九研究所 Video-based robot walking motion control method and video-based robot walking motion control device
CN105334851A (en) * 2014-08-12 2016-02-17 深圳市银星智能科技股份有限公司 Mobile device capable of sensing gesture
CN105607513A (en) * 2015-09-30 2016-05-25 北京清川科技有限公司 Intelligent device control system and method based on mobile phone screen sliding
CN105739889A (en) * 2016-01-27 2016-07-06 深圳市高端玩具有限公司 Blind touch control method of APP interface of aircraft
CN106292686A (en) * 2015-05-22 2017-01-04 上海俏动智能化科技有限公司 Method by touch screen operation unmanned plane
CN106658123A (en) * 2016-10-14 2017-05-10 深圳Tcl新技术有限公司 Touch-remote-controller-based gesture recognition method and device
CN106681646A (en) * 2017-02-21 2017-05-17 上海青橙实业有限公司 Terminal control method and mobile terminal
CN106791446A (en) * 2014-05-30 2017-05-31 张琴 Mobile terminal camera and smart mobile phone, panel computer or net book
CN107000839A (en) * 2016-12-01 2017-08-01 深圳市大疆创新科技有限公司 The control method of unmanned plane, device, the control system of equipment and unmanned plane
CN107093040A (en) * 2017-03-03 2017-08-25 北京小度信息科技有限公司 information generating method and device
CN107300918A (en) * 2017-06-21 2017-10-27 上海思依暄机器人科技股份有限公司 A kind of control method and control device for changing motion state
CN107305375A (en) * 2016-04-19 2017-10-31 上海慧流云计算科技有限公司 A kind of robot control method, controller and robot
WO2017185512A1 (en) * 2016-04-25 2017-11-02 中兴通讯股份有限公司 Control method and device based on pressure sensing
CN107408015A (en) * 2015-03-30 2017-11-28 X开发有限责任公司 Method and system for gesture-based switching for machine control
CN107436679A (en) * 2016-05-27 2017-12-05 富泰华工业(深圳)有限公司 Gestural control system and method
CN108139338A (en) * 2015-07-28 2018-06-08 通用电气公司 Control to nondestructive testing device
CN108803669A (en) * 2018-07-05 2018-11-13 北京淳中科技股份有限公司 Holder rotating direction control method, device, electronic equipment and storage medium
CN108789453A (en) * 2018-08-17 2018-11-13 成都跟驰科技有限公司 The touch screen control system of automobile with folding mechanism arm
CN110238857A (en) * 2019-07-11 2019-09-17 深圳市三宝创新智能有限公司 A kind of robot gesture control method and device
CN111742288A (en) * 2019-06-06 2020-10-02 深圳市大疆创新科技有限公司 Remote control movable platform control method, device and computer readable storage medium
CN111917805A (en) * 2019-05-10 2020-11-10 梁友兵 Remote driving and controlling method through intelligent terminal
CN116225294A (en) * 2023-05-06 2023-06-06 科沃斯家用机器人有限公司 Remote control method, device and equipment for surface cleaning robot and readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1380846A (en) * 2000-03-31 2002-11-20 索尼公司 Robot device, robot device action control method, external force detecting device and method
CN201273999Y (en) * 2008-08-29 2009-07-15 湖南工程学院 Tourist guidance robot based on image processing
CN201796272U (en) * 2010-07-27 2011-04-13 上海中为智能机器人有限公司 Wireless remote control intelligent terminal of automatic intelligent detection multi-robot system for mines
CN202110425U (en) * 2010-05-13 2012-01-11 福州冠翔电子有限公司 Security robot system based on internet
CN102314169A (en) * 2010-07-27 2012-01-11 上海中为智能机器人有限公司 Wireless remote control intelligent terminal of mine autonomous intelligent detection multi-robot system
CN102500113A (en) * 2011-11-11 2012-06-20 山东科技大学 Comprehensive greeting robot based on smart phone interaction

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1380846A (en) * 2000-03-31 2002-11-20 索尼公司 Robot device, robot device action control method, external force detecting device and method
CN201273999Y (en) * 2008-08-29 2009-07-15 湖南工程学院 Tourist guidance robot based on image processing
CN202110425U (en) * 2010-05-13 2012-01-11 福州冠翔电子有限公司 Security robot system based on internet
CN201796272U (en) * 2010-07-27 2011-04-13 上海中为智能机器人有限公司 Wireless remote control intelligent terminal of automatic intelligent detection multi-robot system for mines
CN102314169A (en) * 2010-07-27 2012-01-11 上海中为智能机器人有限公司 Wireless remote control intelligent terminal of mine autonomous intelligent detection multi-robot system
CN102500113A (en) * 2011-11-11 2012-06-20 山东科技大学 Comprehensive greeting robot based on smart phone interaction

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103941991A (en) * 2013-01-21 2014-07-23 联想(北京)有限公司 Information processing method and electronic equipment
CN103941991B (en) * 2013-01-21 2017-02-08 联想(北京)有限公司 Information processing method and electronic equipment
CN103729057B (en) * 2013-12-18 2016-05-18 京东方科技集团股份有限公司 A kind of method and system of utilizing gesture motion control display unit attitude
CN103729057A (en) * 2013-12-18 2014-04-16 京东方科技集团股份有限公司 Method and system for controlling postures of display device by using gestures
CN103978487B (en) * 2014-05-06 2017-01-11 宁波易拓智谱机器人有限公司 Gesture-based control method for terminal position of universal robot
CN103978487A (en) * 2014-05-06 2014-08-13 北京易拓智谱科技有限公司 Gesture-based control method for terminal position of universal robot
CN106791446A (en) * 2014-05-30 2017-05-31 张琴 Mobile terminal camera and smart mobile phone, panel computer or net book
CN105334851A (en) * 2014-08-12 2016-02-17 深圳市银星智能科技股份有限公司 Mobile device capable of sensing gesture
CN104267444A (en) * 2014-10-23 2015-01-07 淮海工学院 Real-time three-dimensional imaging device for hole
CN104781781B (en) * 2014-11-14 2018-06-05 深圳市大疆创新科技有限公司 A kind of control method of mobile object, device and mobile equipment
WO2016074235A1 (en) * 2014-11-14 2016-05-19 深圳市大疆创新科技有限公司 Control method and apparatus for moving object and mobile device
US20170242578A1 (en) * 2014-11-14 2017-08-24 SZ DJI Technology Co., Ltd. Method and a device for controlling a moving object, and a mobile apparatus
CN104781781A (en) * 2014-11-14 2015-07-15 深圳市大疆创新科技有限公司 Control method, apparatus and moving equipment for object moving
US10908799B2 (en) * 2014-11-14 2021-02-02 SZ DJI Technology Co., Ltd. Method and a device for controlling a moving object, and a mobile apparatus
CN107408015A (en) * 2015-03-30 2017-11-28 X开发有限责任公司 Method and system for gesture-based switching for machine control
CN107408015B (en) * 2015-03-30 2021-05-11 X开发有限责任公司 Method and system for gesture-based switching for machine control
CN106292686A (en) * 2015-05-22 2017-01-04 上海俏动智能化科技有限公司 Method by touch screen operation unmanned plane
CN108139338A (en) * 2015-07-28 2018-06-08 通用电气公司 Control to nondestructive testing device
CN105137860A (en) * 2015-07-31 2015-12-09 重庆世纪精信实业(集团)有限公司 Remote monitoring and control system for industrial manipulator based on Internet
CN105159157B (en) * 2015-07-31 2017-11-21 重庆世纪精信实业(集团)有限公司 Video auxiliary system for industry mechanical arm remote control
CN105159157A (en) * 2015-07-31 2015-12-16 重庆世纪精信实业(集团)有限公司 Video-assisted system for industrial manipulator remote control
CN105607513A (en) * 2015-09-30 2016-05-25 北京清川科技有限公司 Intelligent device control system and method based on mobile phone screen sliding
CN105302021A (en) * 2015-10-23 2016-02-03 哈尔滨工业大学 Wearable gesture control device for controlling movement of robot in human-computer collaborative remanufacturing
CN105313129A (en) * 2015-12-03 2016-02-10 中国电子科技集团公司第二十九研究所 Video-based robot walking motion control method and video-based robot walking motion control device
CN105739889A (en) * 2016-01-27 2016-07-06 深圳市高端玩具有限公司 Blind touch control method of APP interface of aircraft
CN107305375A (en) * 2016-04-19 2017-10-31 上海慧流云计算科技有限公司 A kind of robot control method, controller and robot
WO2017185512A1 (en) * 2016-04-25 2017-11-02 中兴通讯股份有限公司 Control method and device based on pressure sensing
CN107436679A (en) * 2016-05-27 2017-12-05 富泰华工业(深圳)有限公司 Gestural control system and method
WO2018068403A1 (en) * 2016-10-14 2018-04-19 深圳Tcl新技术有限公司 Gesture recognition method and apparatus based on touch control remote controller
CN106658123A (en) * 2016-10-14 2017-05-10 深圳Tcl新技术有限公司 Touch-remote-controller-based gesture recognition method and device
CN107000839A (en) * 2016-12-01 2017-08-01 深圳市大疆创新科技有限公司 The control method of unmanned plane, device, the control system of equipment and unmanned plane
CN107000839B (en) * 2016-12-01 2019-05-03 深圳市大疆创新科技有限公司 The control method of unmanned plane, device, equipment and unmanned plane control system
CN106681646A (en) * 2017-02-21 2017-05-17 上海青橙实业有限公司 Terminal control method and mobile terminal
CN107093040A (en) * 2017-03-03 2017-08-25 北京小度信息科技有限公司 information generating method and device
CN107300918A (en) * 2017-06-21 2017-10-27 上海思依暄机器人科技股份有限公司 A kind of control method and control device for changing motion state
CN108803669A (en) * 2018-07-05 2018-11-13 北京淳中科技股份有限公司 Holder rotating direction control method, device, electronic equipment and storage medium
CN108803669B (en) * 2018-07-05 2021-08-24 北京淳中科技股份有限公司 Cloud deck steering control method and device, electronic equipment and storage medium
CN108789453A (en) * 2018-08-17 2018-11-13 成都跟驰科技有限公司 The touch screen control system of automobile with folding mechanism arm
CN111917805A (en) * 2019-05-10 2020-11-10 梁友兵 Remote driving and controlling method through intelligent terminal
CN111742288A (en) * 2019-06-06 2020-10-02 深圳市大疆创新科技有限公司 Remote control movable platform control method, device and computer readable storage medium
WO2020243953A1 (en) * 2019-06-06 2020-12-10 深圳市大疆创新科技有限公司 Control method for remote control movable platform, device and computer-readable storage medium
CN110238857A (en) * 2019-07-11 2019-09-17 深圳市三宝创新智能有限公司 A kind of robot gesture control method and device
CN116225294A (en) * 2023-05-06 2023-06-06 科沃斯家用机器人有限公司 Remote control method, device and equipment for surface cleaning robot and readable storage medium
CN116225294B (en) * 2023-05-06 2023-08-18 科沃斯家用机器人有限公司 Remote control method, device and equipment for surface cleaning robot and readable storage medium

Also Published As

Publication number Publication date
CN102789327B (en) 2015-04-08

Similar Documents

Publication Publication Date Title
CN102789327B (en) Method for controlling mobile robot on basis of hand signals
CN104598108B (en) Method for proportionally remotely controlling remotely controlled equipment in intelligent terminal touch mode
CN108549489B (en) gesture control method and system based on hand shape, posture, position and motion characteristics
JP6470112B2 (en) Mobile device operation terminal, mobile device operation method, and mobile device operation program
CN103076919B (en) A kind of wireless touch remote control thereof and system
CN107765855A (en) A kind of method and system based on gesture identification control machine people motion
CN103217984B (en) Based on the unmanned vehicle steering order sending/receiving method and apparatus of handheld terminal
CN105223957A (en) A kind of method and apparatus of gesture manipulation unmanned plane
CN106681354B (en) The flight control method and device of unmanned plane
CN105681747A (en) Telepresence interaction wheelchair
Mashood et al. A gesture based kinect for quadrotor control
CN102937832A (en) Gesture capturing method and device for mobile terminal
CN103491444B (en) Image interaction method and system and the display device of correspondence
CN104267854A (en) Touch screen terminal control method and device
CN103841442A (en) Method for controlling air mouse, air mouse and set top box
CN103713741A (en) Method for controlling display wall through gestures on basis of Kinect
CN103218061A (en) Control method and control device on basis of handheld terminal device
US20140033045A1 (en) Gestures coupled with voice as input method
CN103064532A (en) Air mouse remote controller
CN103200304A (en) System and method for controlling mobile terminal intelligent cursor
CN106292686A (en) Method by touch screen operation unmanned plane
CN102968245B (en) Mouse touches cooperative control method, device and Intelligent television interaction method, system
CN102707802A (en) Method for controlling speed of mapping of gesture movement to interface
KR101233793B1 (en) Virtual mouse driving method using hand motion recognition
CN202049450U (en) Remote control device and remote control system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CB03 Change of inventor or designer information
CB03 Change of inventor or designer information

Inventor after: Liu Zhengyong

Inventor after: Wang Guangyan

Inventor after: He Fengguang

Inventor after: Lu Wei

Inventor before: Meng Cai

Inventor before: Guo Shude

Inventor before: Qu Shengyue

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20171113

Address after: 230013 Anhui province Hefei New Station District Dragon Lake Road and road junction southwest.

Patentee after: HEFEI SINEVA INTELLIGENT MACHINE Co.,Ltd.

Address before: 100191 Haidian District, Xueyuan Road, No. 37,

Patentee before: Beihang University

CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: 230013 Southwest District of Hefei City, Anhui Province

Patentee after: Hefei xinyihua Intelligent Machine Co.,Ltd.

Address before: 230013 Southwest District of Hefei City, Anhui Province

Patentee before: HEFEI SINEVA INTELLIGENT MACHINE Co.,Ltd.