CN104970754A - Method for controlling endoscope optical fiber on basis of Kinect sensor gestures - Google Patents

Method for controlling endoscope optical fiber on basis of Kinect sensor gestures Download PDF

Info

Publication number
CN104970754A
CN104970754A CN201510358348.2A CN201510358348A CN104970754A CN 104970754 A CN104970754 A CN 104970754A CN 201510358348 A CN201510358348 A CN 201510358348A CN 104970754 A CN104970754 A CN 104970754A
Authority
CN
China
Prior art keywords
endoscope
optical fiber
control
kinect sensor
processing unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510358348.2A
Other languages
Chinese (zh)
Other versions
CN104970754B (en
Inventor
张轩
刘荣海
吴章勤
郭新良
杨迎春
郑欣
许宏伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electric Power Research Institute of Yunnan Power System Ltd
Original Assignee
Electric Power Research Institute of Yunnan Power System Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electric Power Research Institute of Yunnan Power System Ltd filed Critical Electric Power Research Institute of Yunnan Power System Ltd
Priority to CN201510358348.2A priority Critical patent/CN104970754B/en
Publication of CN104970754A publication Critical patent/CN104970754A/en
Application granted granted Critical
Publication of CN104970754B publication Critical patent/CN104970754B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064Constructional details of the endoscope body
    • A61B1/00071Insertion part of the endoscope body
    • A61B1/0008Insertion part of the endoscope body characterised by distal tip features
    • A61B1/00096Optical elements
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163Optical arrangements
    • A61B1/00165Optical arrangements with light-conductive means, e.g. fibre optics
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/07Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements using light-conductive means, e.g. optical fibres
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures

Abstract

The invention provides a method for controlling an endoscope optical fiber on the basis of Kinect sensor gestures. The method includes the steps that a Microsoft Kinect sensor is arranged on an endoscope control terminal and detects changes of positions of arms and fingers of human bodies, wherein the endoscope control terminal comprises a data analysis central processing unit and a control single-chip microcomputer, the central processing unit is used for analyzing data collected by the Kinect sensor, and the control single-chip microcomputer drives a controller to act; the central processing unit analyzes and processes the collected data and sends the processing result to the control single-chip microcomputer as a control command through a serial port; the control single-chip microcomputer generates pulses after receiving the command and drives the controller, and the controller acts and controls the endoscope optical fiber to move. The endoscope optical fiber is controlled to move upwards/downwards/leftwards/rightwards when the fingers move upwards/downwards/leftwards/rightwards, movement of the endoscope optical fiber can be more intelligent, and the optical fiber control accuracy can be improved.

Description

A kind of method controlling endoscope's optical fiber based on Kinect sensor gesture
Technical field
The invention belongs to control technology field, be specially a kind of method controlling endoscope's optical fiber movement based on Kinect sensor gesture.
Background technology
Along with the development of technology, modern society is intellectuality and hommization more and more.The contactless operation modes such as gesture control, Voice command, recognition of face are that the live and work of people brings great convenience.Break away from the constraint of remote controller, mouse etc., people can realize man-machine interaction by the most comfortable mode.
Endoscope is the important tool of inspected object internal flaw, operator can observe interior of articles situation by endoscope lens, if need to observe interior of articles defect details, need mobile endoscope lens, endoscope lens is contained on endoscope's optical fiber, and the movement of camera lens is the drive of inner sight glass optical fiber movement.But at present, the movement of endoscope's optical fiber on market, is controlled by endoscope's control end handle mostly, the clumsy inconvenient operation of these class methods operation, have impact on its convenience and interactivity greatly.
Summary of the invention
In order to overcome above-mentioned the deficiencies in the prior art, the invention provides a kind of method controlling endoscope's optical fiber based on Kinect sensor gesture.
Technical scheme of the present invention is as follows:
Control a method for endoscope's optical fiber based on Kinect sensor gesture, comprise following steps:
Step one: the Kinect sensor provided in control end installation Microsoft of endoscope, the change of real-time human body arm finger position; Endoscope's control end comprises data analysis central processing unit and control single chip computer, wherein the data that collect for analyzing Kinect sensor of central processing unit, the action of control single chip computer driving governor;
Step 2: the data analysis process that the central processing unit of endoscope's control end will collect, is sent to control single chip computer as control command by serial ports using the result of process;
Step 3: after control single chip computer receives order, produces pulse, driving governor, controller action, controls endoscope's optical fiber and moves.
Kinect sensor monitoring human arm finger position of the present invention change, described position be changed to up/down/left/right movements.
Kinect sensor of the present invention is used for human body image information being carried out analysis and obtains skeleton model.
This method method makes the control of endoscope's optical fiber become more intelligent.Operator no longer carries out endoscope's optical fiber by clumsy handle and moves, and only need stand in the position within first two meters of Kinect sensor, and action is pointed, and just can control endoscope's optical fiber and move, compared with technology in the past, convenient, quick, directly perceived.
Accompanying drawing explanation
Fig. 1 is control flow chart of the present invention;
Fig. 2 is apparatus of the present invention structural representation.
Detailed description of the invention
In order to make object of the present invention and technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
Control a method for endoscope's optical fiber based on Kinect sensor gesture, comprise following steps:
Step one: the Kinect sensor provided in control end installation Microsoft of endoscope, the change of real-time human body arm finger position; Endoscope's control end comprises data analysis central processing unit and control single chip computer, wherein the data that collect for analyzing Kinect sensor of central processing unit, the action of control single chip computer driving governor;
Step 2: the data analysis process that the central processing unit of endoscope's control end will collect, is sent to control single chip computer as control command by serial ports using the result of process;
Step 3: after control single chip computer receives order, produces pulse, driving governor, controller action, controls endoscope's optical fiber and moves.
Kinect sensor monitoring human arm finger position of the present invention change, described position be changed to up/down/left/right movements.Kinect sensor is used for human body image information being carried out analysis and obtains skeleton model.
Figure 1 shows that this method schematic flow sheet, Fig. 2 is apparatus of the present invention structural representation.On endoscope's control end 2, install the Kinect sensor 1 that provides of Microsoft, now, human arm points action within 3 range sensor 2m, human arm finger 3 can upwards, downwards, left, paddling to the right.Kinect sensor 1 analysis obtains the skeleton model of human body image information, gathers action data.The data analysis process that central processing unit in endoscope's control end 2 will collect, is sent in endoscope control end 2 control single chip computer as control command by serial ports using the result of process.After control single chip computer in endoscope's control end 2 receives order, produce pulse, driving governor, controller action, action is delivered to endoscope's optical fiber 5 by controller, and endoscope's optical fiber drives endoscope lens 4 upwards, downwards, left, to the right, thus reaches optimal viewing position.

Claims (1)

1. control a method for endoscope's optical fiber based on Kinect sensor gesture, it is characterized in that, comprise following steps:
Step one: the Kinect sensor provided in control end installation Microsoft of endoscope, the change of real-time human body arm finger position; Endoscope's control end comprises data analysis central processing unit and control single chip computer, wherein the data that collect for analyzing Kinect sensor of central processing unit, the action of control single chip computer driving governor;
Step 2: the data analysis process that the central processing unit of endoscope's control end will collect, is sent to control single chip computer as control command by serial ports using the result of process;
Step 3: after control single chip computer receives order, produces pulse, driving governor, controller action, controls endoscope's optical fiber and moves;
Kinect sensor monitoring human arm finger position change, described position be changed to up/down/left/right movements; Kinect sensor is used for human body image information being carried out analysis and obtains skeleton model.
CN201510358348.2A 2015-06-25 2015-06-25 A kind of method controlling endoscope's optical fiber based on Kinect sensor gesture Active CN104970754B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510358348.2A CN104970754B (en) 2015-06-25 2015-06-25 A kind of method controlling endoscope's optical fiber based on Kinect sensor gesture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510358348.2A CN104970754B (en) 2015-06-25 2015-06-25 A kind of method controlling endoscope's optical fiber based on Kinect sensor gesture

Publications (2)

Publication Number Publication Date
CN104970754A true CN104970754A (en) 2015-10-14
CN104970754B CN104970754B (en) 2016-09-28

Family

ID=54268129

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510358348.2A Active CN104970754B (en) 2015-06-25 2015-06-25 A kind of method controlling endoscope's optical fiber based on Kinect sensor gesture

Country Status (1)

Country Link
CN (1) CN104970754B (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011060185A1 (en) * 2009-11-13 2011-05-19 Intuitive Surgical Operations, Inc. Method and system for hand presence detection in a minimally invasive surgical system
CN102647955A (en) * 2009-11-13 2012-08-22 直观外科手术操作公司 Method and apparatus for hand gesture control in a minimally invasive surgical system
CN202512439U (en) * 2012-02-28 2012-10-31 陶重犇 Human-robot cooperation system with webcam and wearable sensor
CN103491848A (en) * 2011-12-26 2014-01-01 奥林巴斯医疗株式会社 Medical endoscope system
US20140018819A1 (en) * 2012-07-16 2014-01-16 Anil K Raj Anthro-Centric Multisensory Interface for Sensory Augmentation of Telesurgery
CN103729057A (en) * 2013-12-18 2014-04-16 京东方科技集团股份有限公司 Method and system for controlling postures of display device by using gestures
CN103903011A (en) * 2014-04-02 2014-07-02 重庆邮电大学 Intelligent wheelchair gesture recognition control method based on image depth information
CN104108097A (en) * 2014-06-25 2014-10-22 陕西高华知本化工科技有限公司 Feeding and discharging mechanical arm system based on gesture control
CN203973551U (en) * 2014-06-13 2014-12-03 济南翼菲自动化科技有限公司 A kind of remote control robot of controlling by body gesture
CN104284637A (en) * 2012-05-18 2015-01-14 奥林巴斯株式会社 Medical operation assistance device
CN104335139A (en) * 2012-05-10 2015-02-04 皇家飞利浦有限公司 Gesture control
CN104375504A (en) * 2014-09-12 2015-02-25 中山大学 Running accompanying robot and tracking control strategy and movement control method for running accompanying robot

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011060185A1 (en) * 2009-11-13 2011-05-19 Intuitive Surgical Operations, Inc. Method and system for hand presence detection in a minimally invasive surgical system
CN102647955A (en) * 2009-11-13 2012-08-22 直观外科手术操作公司 Method and apparatus for hand gesture control in a minimally invasive surgical system
CN103491848A (en) * 2011-12-26 2014-01-01 奥林巴斯医疗株式会社 Medical endoscope system
CN202512439U (en) * 2012-02-28 2012-10-31 陶重犇 Human-robot cooperation system with webcam and wearable sensor
CN104335139A (en) * 2012-05-10 2015-02-04 皇家飞利浦有限公司 Gesture control
CN104284637A (en) * 2012-05-18 2015-01-14 奥林巴斯株式会社 Medical operation assistance device
US20140018819A1 (en) * 2012-07-16 2014-01-16 Anil K Raj Anthro-Centric Multisensory Interface for Sensory Augmentation of Telesurgery
CN103729057A (en) * 2013-12-18 2014-04-16 京东方科技集团股份有限公司 Method and system for controlling postures of display device by using gestures
CN103903011A (en) * 2014-04-02 2014-07-02 重庆邮电大学 Intelligent wheelchair gesture recognition control method based on image depth information
CN203973551U (en) * 2014-06-13 2014-12-03 济南翼菲自动化科技有限公司 A kind of remote control robot of controlling by body gesture
CN104108097A (en) * 2014-06-25 2014-10-22 陕西高华知本化工科技有限公司 Feeding and discharging mechanical arm system based on gesture control
CN104375504A (en) * 2014-09-12 2015-02-25 中山大学 Running accompanying robot and tracking control strategy and movement control method for running accompanying robot

Also Published As

Publication number Publication date
CN104970754B (en) 2016-09-28

Similar Documents

Publication Publication Date Title
CN106681354B (en) The flight control method and device of unmanned plane
CN102508546A (en) Three-dimensional (3D) virtual projection and virtual touch user interface and achieving method
EP2650754A3 (en) Gesture recognition apparatus, electronic device, gesture recognition method, control program, and recording medium
EP2693323A3 (en) Method and apparatus for virtual tour creation in mobile device
CN103941864A (en) Somatosensory controller based on human eye binocular visual angle
CN105677040A (en) Terminal control method, device and wearable device
CN102566933A (en) Method for effectively distinguishing command gestures and characters in full-screen handwriting
WO2015158242A1 (en) Surface treatment robotic system
CN105373230A (en) Gesture recognition method and device of on-board unit
EP2420741A3 (en) Control system for a range hood having an automatic fume detection device and control method
CN106354129A (en) Kinect based gesture recognition control system and method for smart car
CN104970754A (en) Method for controlling endoscope optical fiber on basis of Kinect sensor gestures
CN103186264A (en) Touch control electronic device and touch control method thereof
CN109249138A (en) The cross-platform kinetic control system of laser engraving machine
CN102200849A (en) Dual-mode control method of wireless location type touch screen
CN102929447B (en) A kind of extracting method of perception image effective area of optical sensor
CN206311938U (en) Intelligent carriage kinetic control system
CN102749994B (en) The reminding method of the direction of motion of gesture and speed intensity in interactive system
CN105159157B (en) Video auxiliary system for industry mechanical arm remote control
CN105125155A (en) Gesture-based method for controlling endoscope optical fiber
CN203350136U (en) Bending strength detecting device
CN202815786U (en) Interaction module group and interaction mobile phone
CN104698940A (en) Automatic plugging and pulling control system suitable for automobile tail gas sampling probe and working method
CN204303032U (en) Based on motion control and the vision inspection apparatus of touch-screen
CN107533388B (en) Air mouse implementation method based on smart phone

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant