CN105242689A - Holder tracking visual system based on optical reflection - Google Patents

Holder tracking visual system based on optical reflection Download PDF

Info

Publication number
CN105242689A
CN105242689A CN201510613850.3A CN201510613850A CN105242689A CN 105242689 A CN105242689 A CN 105242689A CN 201510613850 A CN201510613850 A CN 201510613850A CN 105242689 A CN105242689 A CN 105242689A
Authority
CN
China
Prior art keywords
deflection device
optical reflection
optical
optical deflection
drive unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510613850.3A
Other languages
Chinese (zh)
Other versions
CN105242689B (en
Inventor
章逸丰
吴珺
熊蓉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN201510613850.3A priority Critical patent/CN105242689B/en
Publication of CN105242689A publication Critical patent/CN105242689A/en
Application granted granted Critical
Publication of CN105242689B publication Critical patent/CN105242689B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Studio Devices (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention discloses a holder tracking visual system based on optical reflection. The system comprises a holder based on optical refection, a controller, a computer and a power supply unit. The holder based on the optical reflection comprises a fixed camera, at least two optical reflection devices and rotation driving units in the same quantity as the optical reflection devices. The optical reflection devices are fixed on the rotating shafts of the rotation driving units, the rotation driving units control reflection planes of the optical reflection devices to move to any angles, the rotating shafts of the at least two optical reflection devices cannot be all parallel, and thus two or more than two degrees of freedom is formed; through calibration, the system establishes a relation with a world coordinate system, tracking can be carried out according to world coordinate information of an object to be observed, and even if the current position of the object is not within a visual field, the object can also be tracked quickly; and an image feedback method is employed for maintaining that the image of the object to be observed is at the center of the view field so that the observation precision is improved.

Description

A kind of The Cloud Terrace based on optical reflection follows the tracks of vision system
Technical field
The invention belongs to field of machine vision, specifically, is that a kind of The Cloud Terrace based on reflection type mirror for accurately locating moving object and follow the trail of follows the tracks of vision system.
Background technology
Existing vision system structure is varied, and identification and the track algorithm of employing are also had nothing in common with each other, comprising the system that a class is observed object based on optical reflection principle.Be different from the direct observed objects of camera in other system, this type systematic adopts the optical deflection device auxiliary cameras such as level crossing, prism, fiber optics to observe.Such as: the periscope used in submarine is exactly a kind of common optical reflection type vision system, the level crossing that it utilizes two sides vertically to place changes field range, so that situation in observer's observation water under water.Again such as: at medical instruments field, the instrument for checking human visual function often adopts completely reflecting mirror to carry out omnibearing observation to the eyeball of those who are investigated.But in these existing vision systems, the pose of minute surface and camera is generally changeless, makes them can only be used for specific occasion, limits to larger.
In fields such as military affairs, industry, physical culture, security monitorings, object to be observed is often kept in motion, and range of movement is wide, and movement velocity is fast.Tracking Recognition to be carried out to such object, follow object one with regard to needing the observation scope of vision system and change.The scientist of Tokyo University has developed the Novel tripod head vision system that one is named as " pan mirror ".In this cover system, camera is fixing, has the level crossing that two sides can rotate around stationary shaft outside camera, and object to be observed enters camera through this two sides specularly reflected.This system Observable swiftly passing object, but because its internal trace algorithm is completely based on image feedback, camera was not demarcated, system does not contact with world's establishment of coordinate system, once object to be observed is not in the initial visual field of camera, or blocked, system cannot continue to follow the tracks of object.
Summary of the invention
The present invention is just for the defect that prior art exists, and propose a kind of The Cloud Terrace Visual Tracking System based on optical reflection, the present invention is achieved through the following technical solutions:
The invention discloses a kind of The Cloud Terrace Visual Tracking System based on optical reflection, system comprises the The Cloud Terrace based on optical reflection, controller, computer and power supply unit, The Cloud Terrace based on optical reflection comprises a fixing camera, optical deflection device at least more than two sides, the rotary drive unit consistent with optical deflection device quantity, optical deflection device is fixed in the rotating shaft of rotary drive unit, controlling its plane of reflection by rotary drive unit moves to arbitrarily angled, the rotating shaft of the optical deflection device at least more than two sides can not be all parallel, thus form two or more degree of freedom, rotary drive unit is connected with controller, receive controller instruction, and feed back the state of rotary drive unit, controller is connected with computer, same reception instruction and feedback states, The Cloud Terrace based on optical reflection is also connected with computer, send collected by camera image to computer, the described The Cloud Terrace based on optical reflection is connected with power supply unit.
The invention also discloses a kind of as the method based on the The Cloud Terrace Visual Tracking System of optical reflection, concrete steps are as follows:
1), according to embody rule demand, design rotary shaft position and the direction of each optical deflection device, the support that intensity is suitable is built the equipment needed for camera, optical deflection device, rotary drive unit and all the other system cloud gray model, as external power supply unit, controller etc.;
2), to camera carry out off-line calibration, set up the form mapping relations of each unique point in the corner of each optical deflection device and world coordinates according to calibration result;
3), when working online, when providing the world coordinates positional information of object to be observed, according to mapping relations, obtain the corner of each optical deflection device, control rotary drive unit works, and drives optical deflection device to turn to required angle, thus observe this point by rotating shaft;
4), work online while, the image treating observed objects identifies, adopts image feedback algorithm, drives optical deflection device fine setting, keeps the image of object to be observed at central region.
Compared to the prior art, beneficial effect of the present invention is as follows in the present invention:
(1) adopt camera motionless, the mode that optical deflection device rotates follows the trail of object to be observed, and motor load is light, and response speed is faster;
(2) when adopting two sides reflecting device construction system, the positional information of traceable object to be observed, and when employing three and above reflecting device construction system, the also attitude information of traceable object to be observed;
(3) through demarcating, system and world coordinate system opening relationships, can follow the tracks of according to the world coordinates information of object to be observed, even if object current location is not in the visual field, also can catch up with rapidly;
(4) adopt the method for image feedback to keep the image of object to be observed at central region, improve the precision of observation.
Accompanying drawing explanation
Fig. 1 is the structural representation of present system;
Fig. 2 adopts n face based on the structural representation of the The Cloud Terrace of optical deflection device;
Fig. 3 is the example schematic of the The Cloud Terrace tracking vision system based on optical reflection;
Fig. 4 is that present system entirety controls schematic block diagram;
Fig. 5 is that image feedback of the present invention controls schematic block diagram.
Embodiment
Below with reference to the accompanying drawings, by specific embodiment, technical scheme of the present invention is further described:
Fig. 1 is the structural representation of present system, rotary drive unit based on the The Cloud Terrace of optical reflection is connected with controller, receive controller instruction, and feed back the state of rotary drive unit, controller is connected with computer, same reception instruction and feedback states, and the The Cloud Terrace based on optical reflection is also connected with computer, send collected by camera image to computer, the The Cloud Terrace based on optical reflection is connected with power supply unit.
Fig. 2 is the structural representation of the The Cloud Terrace adopting n face optical deflection device; System comprises a fixing camera, optical deflection device at least more than two sides, the rotary drive unit consistent with optical deflection device quantity, optical deflection device is fixed in the rotating shaft of rotary drive unit, move to arbitrarily angled by rotary drive unit by the plane of reflection of rotating shaft control both optical reflecting device, the rotating shaft of the optical deflection device at least more than two sides can not be all parallel, thus form two or more degree of freedom.
Fig. 3 is a kind of application example figure of the The Cloud Terrace based on optical reflection; In this example, optical deflection device is level crossing, and two sides level crossing has the degree of freedom of pitching and yawing moment respectively, and the level crossing to first surface with pitch orientation degree of freedom seen by camera, and rotary drive unit is DC-disc type motor.
Fig. 4 is that present system entirety controls schematic block diagram; It is the prerequisite of carrying out working online that off-line calibration sets up that corner and spatial point map.In off-line calibration, adopt traditional scaling method, as the internal reference of Zhang Zhengyou standardization calibration for cameras.Because the internal reference of camera is only by inner structure and the decision of selected focal length of camera, therefore no matter carry out the imaging of how many times optical reflection, the internal reference of camera is constant, demarcates the internal reference obtained and is actual internal reference.Then in the space that object to be observed is possible in units of 1cm yardstick, choose space characteristics point, each optical deflection device of manual control rotates, and travels through all unique points, thus sets up the form mapping relations between corner and unique point.As carried out off-line calibration to the application example shown in Fig. 2, the part mapping relation obtained between corner and unique point is as shown in the table:
Spatial point coordinate (x, y, z) (mm) First surface level crossing corner (rad) Second facial plane mirror corner (rad)
(-500,-500,0) 0.7320 0.9379
(-500,0,0) 0.7356 0.8316
(-500,500,0) 0.7404 0.7491
(0,-500,0) 0.7867 0.9235
(0,0,0) 0.7905 0.8236
(0,500,0) 0.7940 0.7295
(500,-500,0) 0.8624 0.9310
(500,0,0) 0.8665 0.8127
(500,500,0) 0.8660 0.7034
(-500,-500,100) 0.7170 0.9178
(-500,0,100) 0.7207 0.8296
(-500,500,100) 0.7262 0.7455
(0,-500,100) 0.7703 0.9235
(0,0,100) 0.7743 0.8211
(0,500,100) 0.7786 0.7249
(500,-500,100) 0.8453 0.9313
(500,0,100) 0.8496 0.8095
(500,500,100) 0.8500 0.6974
When working online, when providing the spatial positional information of object to be observed, control module obtains the corner of each optical deflection device according to above-mentioned mapping relations and drives the execution of rotary drive unit; Identify the image of object to be observed while working online, and adopt image feedback algorithm, PID controls vernier device corner, thus follows the tracks of the center of object to be observed.
Fig. 5 is that image feedback controls schematic block diagram, in the present invention, identifies main adopt background difference algorithm and based on hsv color feature to the image of collected by camera [16]target Segmentation algorithm.Background difference algorithm is shown below:
Wherein P x, yrepresent the planimetric coordinates of pixel, R x, yrepresent the R passage value of pixel, R0 x, yrepresent the R passage value of background image, T is the tolerance between background and non-background.Here get R channel value, be only and illustrate and use, in actual applications, the target signature channel value of image to be observed should be got.After carrying out the thick extraction of target, establishing target and the feature histogram of background in hsv color space respectively, again by after background characteristics histogram and the normalization of target signature histogram, can background noise in Filtration Goal feature histogram, target image can be partitioned into from background accordingly.
After obtaining target image central point pixel coordinate, construct such closed-loop control system to control it: setting value is optical axis pixel coordinate, output valve is the central point pixel coordinate of target, output valve is obtained by image recognition measurement, topworks is the rotating level crossing motor in two sides, controlled device is the The Cloud Terrace proposed in the present invention, in controller part write-in program.Controller portion is wherein divided and is selected ratio (P) to control, and object improves tracking velocity as far as possible.Wherein the algorithm of PID controller is provided by following formula:
What more than exemplify is only the preferred embodiment of the present invention; the present invention is not limited to above embodiment; the oher improvements and changes that those skilled in the art directly derive without departing from the spirit and concept in the present invention or associate, all should think and be included in protection scope of the present invention.

Claims (2)

1. the The Cloud Terrace Visual Tracking System based on optical reflection, it is characterized in that, described system comprises the The Cloud Terrace based on optical reflection, controller, computer and power supply unit, the described The Cloud Terrace based on optical reflection comprises a fixing camera, optical deflection device at least more than two sides, the rotary drive unit consistent with optical deflection device quantity, described optical deflection device is fixed in the rotating shaft of rotary drive unit, controlling its plane of reflection by rotary drive unit moves to arbitrarily angled, the rotating shaft of optical deflection device more than described at least two sides can not be all parallel, thus form two or more degree of freedom, described rotary drive unit is connected with controller, receive controller instruction, and feed back the state of rotary drive unit, described controller is connected with computer, same reception instruction and feedback states, the described The Cloud Terrace based on optical reflection is also connected with computer, send collected by camera image to computer, the described The Cloud Terrace based on optical reflection is connected with power supply unit.
2., as claimed in claim 1 based on a method for the The Cloud Terrace Visual Tracking System of optical reflection, it is characterized in that, concrete steps are as follows:
1), according to embody rule demand, design rotary shaft position and the direction of each optical deflection device, the support that intensity is suitable is built the equipment needed for camera, optical deflection device, rotary drive unit and all the other system cloud gray model, external power supply unit, controller and computer;
2), to camera carry out off-line calibration, set up the form mapping relations of each unique point in the corner of each optical deflection device and world coordinates according to calibration result;
3), when working online, when providing the world coordinates positional information of object to be observed, according to mapping relations, obtain the corner of each optical deflection device, control rotary drive unit works, and drives optical deflection device to turn to required angle, thus observe this point by rotating shaft;
4), work online while, the image treating observed objects identifies, adopts image feedback algorithm, drives optical deflection device fine setting, keeps the image of object to be observed at central region.
CN201510613850.3A 2015-09-23 2015-09-23 A kind of holder tracking vision system based on optical reflection Active CN105242689B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510613850.3A CN105242689B (en) 2015-09-23 2015-09-23 A kind of holder tracking vision system based on optical reflection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510613850.3A CN105242689B (en) 2015-09-23 2015-09-23 A kind of holder tracking vision system based on optical reflection

Publications (2)

Publication Number Publication Date
CN105242689A true CN105242689A (en) 2016-01-13
CN105242689B CN105242689B (en) 2019-03-26

Family

ID=55040365

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510613850.3A Active CN105242689B (en) 2015-09-23 2015-09-23 A kind of holder tracking vision system based on optical reflection

Country Status (1)

Country Link
CN (1) CN105242689B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105657233A (en) * 2016-03-31 2016-06-08 北京格灵深瞳信息技术有限公司 Cloud deck camcorder and linkage camera
CN105872325A (en) * 2016-03-31 2016-08-17 北京格灵深瞳信息技术有限公司 Image obtaining system
CN105872475A (en) * 2016-05-20 2016-08-17 北京格灵深瞳信息技术有限公司 Monitoring camera device
CN106027887A (en) * 2016-05-20 2016-10-12 北京格灵深瞳信息技术有限公司 Box and ball linkage control method and device aiming at rotating mirror holder, as well as electronic equipment
CN107918499A (en) * 2016-10-09 2018-04-17 狒特科技(北京)有限公司 Optical positioning system and method, positioning optical observation equipment
CN108960082A (en) * 2018-06-16 2018-12-07 南京理工大学 The deicing target identification method of view-based access control model servo
CN110324571A (en) * 2018-03-29 2019-10-11 株式会社日立制作所 Moving body photographic device and moving body image capture method
CN111798514A (en) * 2020-06-29 2020-10-20 山东大学日照智能制造研究院 Intelligent moving target tracking and monitoring method and system for marine ranching
CN114153108A (en) * 2021-10-22 2022-03-08 中国科学院自动化研究所 Omnidirectional monocular vision device, omnidirectional binocular vision device and tracking method

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1304058A (en) * 1999-11-26 2001-07-18 李朝辉 Camera sweep expansion head
CN2462427Y (en) * 2000-12-11 2001-11-28 青岛市广播电视科学研究所 Visual field converter of camera
CN201426154Y (en) * 2009-05-19 2010-03-17 厦门金网科技有限公司 Pan-tilt camera remote monitoring device
CN101930628A (en) * 2010-09-21 2010-12-29 北京大学 Monocular-camera and multiplane mirror catadioptric device-based motion capturing method
CN102261907A (en) * 2011-04-20 2011-11-30 北京大学 Multiple viewpoint polar geometric measuring method used in multiple flat mirror catadioptric imaging system
CN102368137A (en) * 2011-10-24 2012-03-07 北京理工大学 Embedded calibrating stereoscopic vision system
CN102419165A (en) * 2011-08-16 2012-04-18 福建汇川数码技术科技有限公司 Positioning method of distance measurement laser point of remote distance measurement system based on coaxial laser and camera
CN102645282A (en) * 2011-12-22 2012-08-22 中国兵器工业第五九研究所 Adiabatic shearing failure temperature online detection method and system based on infrared thermal imaging
CN102981270A (en) * 2012-12-25 2013-03-20 中国科学院长春光学精密机械与物理研究所 Unblocked adaptive varifocal optical system and calibration method thereof
CN103356293A (en) * 2013-08-05 2013-10-23 南京工业大学 Surgery navigation system and method based on multispectral image fusion of reflecting mirror faces with adjustable angles and adjustable positions
CN104133346A (en) * 2014-07-24 2014-11-05 中国科学院光电技术研究所 Real-time focusing detection and adjustment method suitable for projection photoetching machine
CN104359461A (en) * 2014-11-06 2015-02-18 中国人民解放军装备学院 Binocular vision measuring system having variable structure and parameter determining method

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1304058A (en) * 1999-11-26 2001-07-18 李朝辉 Camera sweep expansion head
CN2462427Y (en) * 2000-12-11 2001-11-28 青岛市广播电视科学研究所 Visual field converter of camera
CN201426154Y (en) * 2009-05-19 2010-03-17 厦门金网科技有限公司 Pan-tilt camera remote monitoring device
CN101930628A (en) * 2010-09-21 2010-12-29 北京大学 Monocular-camera and multiplane mirror catadioptric device-based motion capturing method
CN102261907A (en) * 2011-04-20 2011-11-30 北京大学 Multiple viewpoint polar geometric measuring method used in multiple flat mirror catadioptric imaging system
CN102419165A (en) * 2011-08-16 2012-04-18 福建汇川数码技术科技有限公司 Positioning method of distance measurement laser point of remote distance measurement system based on coaxial laser and camera
CN102368137A (en) * 2011-10-24 2012-03-07 北京理工大学 Embedded calibrating stereoscopic vision system
CN102645282A (en) * 2011-12-22 2012-08-22 中国兵器工业第五九研究所 Adiabatic shearing failure temperature online detection method and system based on infrared thermal imaging
CN102981270A (en) * 2012-12-25 2013-03-20 中国科学院长春光学精密机械与物理研究所 Unblocked adaptive varifocal optical system and calibration method thereof
CN103356293A (en) * 2013-08-05 2013-10-23 南京工业大学 Surgery navigation system and method based on multispectral image fusion of reflecting mirror faces with adjustable angles and adjustable positions
CN104133346A (en) * 2014-07-24 2014-11-05 中国科学院光电技术研究所 Real-time focusing detection and adjustment method suitable for projection photoetching machine
CN104359461A (en) * 2014-11-06 2015-02-18 中国人民解放军装备学院 Binocular vision measuring system having variable structure and parameter determining method

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
付生鹏等: "基于平面镜的相机-显示器快速标定方法", 《仪器仪表学报》 *
冯晓锋等: "基于平面镜成像的单摄像机立体视觉传感器研究", 《光学学报》 *
邓小明等: "基于一维标定物的反射折射摄像机标定方法", 《计算机学报》 *
项志宇等: "折反射全向相机镜面位姿的自标定方法", 《光学学报》 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105657233A (en) * 2016-03-31 2016-06-08 北京格灵深瞳信息技术有限公司 Cloud deck camcorder and linkage camera
CN105872325A (en) * 2016-03-31 2016-08-17 北京格灵深瞳信息技术有限公司 Image obtaining system
CN105657233B (en) * 2016-03-31 2018-11-27 北京格灵深瞳信息技术有限公司 A kind of PTZ camera and the camera that links
CN105872325B (en) * 2016-03-31 2019-04-12 北京格灵深瞳信息技术有限公司 A kind of image-taking system
CN105872475A (en) * 2016-05-20 2016-08-17 北京格灵深瞳信息技术有限公司 Monitoring camera device
CN106027887A (en) * 2016-05-20 2016-10-12 北京格灵深瞳信息技术有限公司 Box and ball linkage control method and device aiming at rotating mirror holder, as well as electronic equipment
CN106027887B (en) * 2016-05-20 2019-01-25 北京格灵深瞳信息技术有限公司 For the method, apparatus and electronic equipment of the rifle ball linkage control of rotating mirror holder
CN107918499A (en) * 2016-10-09 2018-04-17 狒特科技(北京)有限公司 Optical positioning system and method, positioning optical observation equipment
CN107918499B (en) * 2016-10-09 2022-09-06 北京墨土科技有限公司 Optical positioning system and method, optical observation equipment for positioning
CN110324571A (en) * 2018-03-29 2019-10-11 株式会社日立制作所 Moving body photographic device and moving body image capture method
CN108960082A (en) * 2018-06-16 2018-12-07 南京理工大学 The deicing target identification method of view-based access control model servo
CN111798514A (en) * 2020-06-29 2020-10-20 山东大学日照智能制造研究院 Intelligent moving target tracking and monitoring method and system for marine ranching
CN114153108A (en) * 2021-10-22 2022-03-08 中国科学院自动化研究所 Omnidirectional monocular vision device, omnidirectional binocular vision device and tracking method

Also Published As

Publication number Publication date
CN105242689B (en) 2019-03-26

Similar Documents

Publication Publication Date Title
CN105242689A (en) Holder tracking visual system based on optical reflection
US10234278B2 (en) Aerial device having a three-dimensional measurement device
KR101988083B1 (en) Systems and methods for tracking location of movable target object
CN105652891B (en) A kind of rotor wing unmanned aerial vehicle movement Target self-determination tracks of device and its control method
CN105953771B (en) A kind of active theodolite system and measuring method
Wang et al. Polarized light compass-aided visual-inertial navigation under foliage environment
KR20020097172A (en) Method for Measuring Three- dimensional Coordinate, Apparatus Thereof and Method for Building Large Construction Therewith
CN106896343B (en) Servo follow-up machine vision device and dynamic tracking ranging method
CN110622091A (en) Cloud deck control method, device and system, computer storage medium and unmanned aerial vehicle
CN114838668B (en) Tunnel displacement monitoring method and system
CN109581456A (en) Unmanned plane Laser navigation system based on Position-Sensitive Detector
CN104034261A (en) Surface normal measurement device and method
CN109341701A (en) Ground robot course angle real time acquiring method based on laser tracking total station
CN109358071A (en) The large scale equipment surface damage detection system and its method of autonomous cover type operation
CN111780715A (en) Visual ranging method
Barreto et al. Active Stereo Tracking of $ N\le 3$ Targets Using Line Scan Cameras
CN108646760B (en) Monocular vision based mobile robot target tracking and platform control system and method
Grudziński et al. Stereovision tracking system for monitoring loader crane tip position
JP2001066138A (en) Measuring system, and prism-type optical path control used for it
CN205785171U (en) A kind of active theodolite system
Duan et al. Image digital zoom based single target apriltag recognition algorithm in large scale changes on the distance
WO2020024150A1 (en) Map processing method, apparatus, and computer readable storage medium
Pajor et al. Stereovision system for motion tracking and position error compensation of loading crane
Wu et al. A novel precise guiding method for visual guiding theodolite measurement in volume space
Ma et al. Moving to OOP: An active observation approach for a novel composite visual servoing configuration

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant