JPS60161512A - Three-dimensional eyesight system - Google Patents

Three-dimensional eyesight system

Info

Publication number
JPS60161512A
JPS60161512A JP59015187A JP1518784A JPS60161512A JP S60161512 A JPS60161512 A JP S60161512A JP 59015187 A JP59015187 A JP 59015187A JP 1518784 A JP1518784 A JP 1518784A JP S60161512 A JPS60161512 A JP S60161512A
Authority
JP
Japan
Prior art keywords
image
distance
visibility
eyesight
stored
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP59015187A
Other languages
Japanese (ja)
Inventor
Koichi Honma
弘一 本間
Akira Maeda
章 前田
Fuminobu Furumura
文伸 古村
Nobutake Yamagata
山縣 振武
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Ltd
Original Assignee
Hitachi Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Ltd filed Critical Hitachi Ltd
Priority to JP59015187A priority Critical patent/JPS60161512A/en
Publication of JPS60161512A publication Critical patent/JPS60161512A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures

Abstract

PURPOSE:To calculate the distance between an eyesight system and objective matter at a high speed with high accuracy, by calculating the distance information between the objective matter and the eyesight system by the positional change of the focal point on an image and the detection of image visibility so as to correspond to the small region on the image. CONSTITUTION:The image of the objective matter 3 constituting a three-dimensional model is formed on a solid image pick-up sensor 5 through a lens system 4. The distance of the lens system 4 and the solid image pick-up sensor 5 is changed by a lens system driving apparatus 6 and image data is stored in image memory 7 while small region image data Ii (x, y) around image coordinates (x, y) is delivered and a visibility is calculated with respect to an entire small region by a visibility calculation apparatus 8 and stored in a sharpness degree memory apparatus 9. Then, the visibility Ci (x, y) relating to a certain distance bi is compared with the visibility relating to the distance bi-1 before one point of time and, when the peak of the visibility is detected, the distance (b) from a position detector 13 is stored by a sampler 12.

Description

【発明の詳細な説明】 〔発明のオリ用分餉〕 不兄明は3仄元+M冗システム、竹に、商運、 44棺
祇に、祝nホと刈板物体との距離ゲ釆めるVこ灯右な3
次元視覚システムに関する。
[Detailed Description of the Invention] [Original portion of the invention] The bad brother is the 3 yen + M red system, bamboo, business luck, 44 coffins, the distance between the lucky nho and the cutting board object. Ru V Ko light right na 3
Concerning dimensional visual systems.

〔発明の背景〕[Background of the invention]

知能ロボットシステムでは、環境の3次元モテルケ購成
するための視見システムが皇女な役割ケ待つ。このよう
な伐寛システムは、目上!1辺型と受動型に分灯られ、
北@型には、モワレ縞利用、レーザーヒーム走査方式な
どがあり、受動型には、ステレオ視方式などかめる。i
ll、fJIJ型岱寛システムは、封板の性質、光源環
境などに圧右されにくいという利点はめるが、光の照射
機購が4JL雑になるという欠点がめった。−万、ステ
レオ視方式は、J:!7人聞の視覚システムに近い。異
なる位置からの2枚の撮源画稼上の対応点の位置情報か
ら対象物の距離を得るため愼博が11)単となる。とこ
ろが、2枚の画像の対応魚倉すべての点について抽出す
る処理時間は膨大なものとなり、誤1つだ対応点を抽出
する可能性も市いという欠点がめった。
In an intelligent robot system, a viewing system for understanding the three-dimensional environment plays a role as a princess. This kind of sekkan system is superior! Divided into single-sided type and passive type,
Kita@ types include moire fringe usage and laser beam scanning methods, while passive types include stereo viewing methods. i
ll, f The JIJ type Daikan system has the advantage of being less affected by the properties of the sealing plate, the light source environment, etc., but it has the disadvantage that the purchase of the light irradiation equipment is often complicated. - 10,000, the stereo viewing method is J:! It is similar to the visual system of a 7-person hearing system. In order to obtain the distance of the object from the position information of the corresponding points on the two source images taken from different positions, the distance of the object becomes 11). However, the processing time required to extract all the corresponding points in the two images is enormous, and the possibility of extracting even one corresponding point by mistake is very low.

〔発明の目的〕[Purpose of the invention]

不発明は上6己欠点に踵牟てなされたもので、その目的
とするところは、便米の3次元視覚7ステムに2ける上
述の如き問題忙解消し、短時間に正確な距喘悄@をめる
ことを可能とした3次元視覚システムを提供するど】に
るる。
The invention was made based on the above 6 self-deficiencies, and its purpose is to solve the above-mentioned problems in the 3-dimensional vision 7 stems of stool rice, and to achieve accurate distance palpitation in a short time. [Ruru] provides a three-dimensional visual system that makes it possible to see @.

〔発明のg安〕[G cheap of invention]

第1図(al K示すし/ズ糸1と画1家セッサ2から
成る撮像系において、レンズ1の焦点距1* 1e変化
させると、距離dに位置する点0の像は画像セ/す2上
で大きさδのほけを生する。ここで、開口住の大きさを
Dとすると、f盆けδは、となる。
In an imaging system consisting of a lens 1 and a sensor 2 shown in Fig. 1, when the focal length of the lens 1 is changed by 1*1e, the image of point 0 located at a distance d becomes 2. If the size of the opening is D, then the f-bonding δ is as follows.

以上の撮像糸で、同図(1)Jのように3仄元壊境全撮
渾すると、Li1U像上の小領域SIの画像片5r(P
Using the above-mentioned imaging thread, if we image the entire 3-source destruction area as shown in Figure 1 (1) J, we can obtain an image piece 5r (P
.

qlP、Q座標の鮮明度Ci 、 例えば、下式の評価
値 Ci−Σtsi(1’+1.(l)−1−8+(P、q
+11 2Si(P、q))”Ip ・・・(2) は、上記はけδに応じて変化する。すなわち、はけδが
大きい場合には、#明咬Ciは低下し、δ=Oのとき鮮
明/At CIは最大となる。ここで、ぼけδは式(υ
の工うに焦点距離fの関叔でるるため、焦点距離fを便
化させつつ、谷小狽域Siごとの鮮明度Ciをめ、最大
の鮮明朋eiゲ与える焦点距*’1ffi求めれば、式
+IJ=Ojt7.1)11 dI −□ ・・・(3) 1)−fi ?針具することKL9、各画像小領域8 tに対応する
対象物と撮1水系の距Mlfdtがブることになり、3
次元環境ゲ構成で@たことになる。
qlP, the sharpness Ci of the Q coordinate, for example, the evaluation value Ci-Σtsi(1'+1.(l)-1-8+(P, q
+11 2Si(P, q))"Ip...(2) changes according to the brush δ. In other words, when the brush δ is large, #clear bite Ci decreases, and δ=O Sharpness/At CI is maximum when .Here, blur δ is expressed by the formula (υ
In order to solve the problem of the focal length f, we can simplify the focal length f, find the sharpness Ci for each valley Si, and find the focal length *'1ffi that gives the maximum sharpness. Formula +IJ=Ojt7.1)11 dI -□...(3) 1)-fi? By using the needle KL9, the distance Mlfdt between the object corresponding to each image small area 8t and the water system in the first image will be 3.
It will be @ in the dimensional environment game composition.

以上が本発明請求範囲第1項の要点でめり、いいかえれ
ば、自動焦点カメラに利用例のろる、小領域画像のコン
トラスト敢大勿晶卑とじた焦点甘わせの原理を、撮像画
像上の全小狐域に烟出し、3次元視覚勿可能とした点が
新しい。
The above is the main point of claim 1 of the present invention. In other words, the principle of softening the focus by increasing the contrast of a small area image, which is used in an autofocus camera, can be applied to a captured image. It is new in that it emits smoke in the entire small fox area and enables three-dimensional vision.

’J7m、促米のステレオ化による3次元化党システム
、すなわち2つの撮穂糸から成り、2つの円像の対応点
勿、画像11Jの相関8を昇、相関値ピーク位置探索に
工!7xめ、三角測量の原理で対象の3次元モテルft
溝成するシステムでは、あらかじめ2つの画像の対応点
が一定硝)屍でX箇っていれば相関饋ヒーク位置探累の
処理時10Jゲ短縮できるとともに、誤まったピーク位
置探紫の可能性ゲ低減さぜることかできる。
'J7m, a three-dimensional party system by making rice into stereo, that is, it consists of two picking threads, the corresponding points of the two circular images, of course, the correlation 8 of image 11J is raised, and the correlation value peak position is searched! 7x, target 3D motel ft using the principle of triangulation
In a groove forming system, if there are X corresponding points in the two images in advance for a certain number of corpses, the processing time for correlating heat peak position detection can be shortened by 10J, and the possibility of erroneous peak position detection can be reduced. It can also be used to reduce hair loss.

〔発明の実施例〕[Embodiments of the invention]

以下、本発明の一央IM例ケ第3,4図により説明する
An example of the central IM of the present invention will be explained below with reference to FIGS. 3 and 4.

@3図の実施例ケ祝明する。3仄元モデルを溝底すべき
肘板′+!!IJ坏3の塚は、し/ズ糸4勿コ川して、
固体撮1譲七ンサ5の上に#i稼する。レンズ基4と固
体撮像セッサ5の距離はし7ズ糸秘勤裟直6により、b
+>bz>・・・、bi、・・・と変化する。%配陥t
)iに2いて、画1家テータはN渾メモリ7に格納され
、画像座標IX、 ’/)’r:甲心とした小領域1…
11体データ1;(x、y)が切出され、鮮明度算出装
置8において、式(2)の鮮明波UitX、)’Iが算
出される。
Congratulations on the example shown in Figure @3. Elbow plate that should be the bottom of the 3-piece model! ! IJ Kyo 3's mound is Shi/zu Ito 4 Nakogawa,
I earn #i on top of the solid-state camera 1 and 7 sensor 5. According to the distance between the lens base 4 and the solid-state image sensor 5, b
+>bz>..., bi,... % fall t
) i, the image 1 data is stored in the memory 7, the image coordinates IX, '/)'r: the small area 1 that is the center of gravity...
11 body data 1; (x, y) is cut out, and the sharpness calculation device 8 calculates the sharpness wave UitX, )'I of equation (2).

1Ii111故上の全小娯域について岬明親が算出され
、岬uAI、it記憶装置9に把1息される。ある距離
b1に関する#明度Ci IX、:Yンは、l暗点前の
距離b i−+に関する装置i19上の鮮明3 Ci’
−11x、 )’ )と比較される。谷鮮明駿変化は変
換器lOにエリ、・・・t4J のごとく変換される。谷饋域ごとの鮮明度変化ΔC((
X + Y )は、記憶装置11に格納された1時点前
の4C+−+ l x、)’ )と比較され、十から−
の符号変化があった場合のみ、すなわち、鮮明駿のピー
クが検出された時、サノプラ12にエリ位(幌検出器1
3からの距離すが記1意される。鮮明度のヒーク勿与え
るレンズ/セッサ間距離すは、小憤域位ill、 I 
X、 Y )ごとに異なるが、レンズ糸駆動装+t6に
よるレンズ基4の駆動が終了した時には、記憶装置14
には、全慎ノ威に関する距1111t hが伯納される
ことになる。レンズ糸4の駆!IJ/I扱、震侯装置纜
15は、記憶装置14上の距離blX、y)ケt33式
にエリ、小領域の対応点と視覚システムとの短間i’f
ftx、lにf侯し出力する。
1Ii111 Therefore, Misaki Akichika is calculated for all the above small entertainment areas and stored in the Misaki uAI and IT storage device 9. #Brightness Ci IX,:Yn for a certain distance b1 is brightness 3 Ci' on the device i19 for a distance b i-+ in front of l scotoma
-11x, )'). The Tani Shinkansen change is converted into the converter lO as Eri...t4J. Visibility change ΔC ((
X + Y) is compared with 4C+-+l x,)') stored in the storage device 11 one time before,
Only when there is a change in sign of
The distance from 3 is indicated by 1. The distance between the lens and the sensor that gives rise to sharpness is in the slightest range, I
Although it differs depending on
In , the distance 1111th related to Zenshin no I will be paid. Kakeru of Lens Thread 4! Treated as IJ/I, the control device line 15 is the distance blX, y) on the storage device 14, and the short time i'f between the corresponding point in the small area and the visual system.
ftx, output f to l.

第4図の実施例を祝明する。2組の撮塚示(4a。Congratulations on the embodiment of FIG. Two sets of photos (4a.

58)と(4b、 5t))の−刀14a、 5a)に
、し/ズ秘鯛装置改6aと、レノズ位置検出益13a欠
11mえる。1ffll像メモリ7aと要用d、?13
aの出力から第3図の実施例」装置16により、撮1奴
糸(4a。
58) and (4b, 5t)) - Sword 14a, 5a), Shi/zu secret sea bream device modification 6a, Renozu position detection gain 13a missing 11m. 1ffll image memory 7a and required d, ? 13
From the output of a, the apparatus 16 in FIG.

5alと対象物との距離d(X、ylがボめられる。撮
像系14a、5a)のIg隊メモIJ 7 a上の各位
置座標tx、y)自送の画像片i T’X、 Y、)と
、撮像ホ(4b、5b)のla塚メモU7bVJ相関泳
叔のヒーク位置がII!it 1mメモ+77 b上の
座$IX、YJとして、相1列ヒーク位I!検出器18
により検出さnる。検出器18におけるヒーク位置探系
の初期位置fX、Ylは、装(416からの画像小領域
ごとの対象物1212離情報d (x、 y)旬演真装
虐19上で釆める。不演算は第2図1alに示すような
炊例学的耐界となる。同図に示すように、右側のm稼1
r上の位置(X、、)’)が決inは対象点P2の方向
が決筐り、距隔d (X、 )l’)により位1嵯が矩
する。点P2が左側の撮塚禾でどの方間にあるか決する
kめ、画+’41 + 上の位置IX、Y)kポめるこ
とかでさる。
Distance d between 5al and the object (X, yl are blurred. Ig team memo IJ of imaging system 14a, 5a) Each position coordinate tx, y on 7a) Self-transmitted image piece i T'X, Y ,) and the heak position of the imaging ho (4b, 5b) lazuka memo U7bVJ correlative stroke is II! it 1m memo +77 As position $IX, YJ on b, phase 1 row heat position I! Detector 18
Detected by n. The initial position fX, Yl of the heat position search system in the detector 18 is determined on the object 1212 distance information d (x, y) for each image small area from the sensor 416. The calculation results in a mechanical tolerance as shown in Figure 2 1al.As shown in the figure,
When the position (X, , )') on r is determined, the direction of the target point P2 is determined, and the distance d (X, )l') makes the position 1 square. Determine in which direction point P2 is located on the left side by moving the image + '41 + upper position IX, Y).

概略のものでるるため、無の対応点77)らすれて寂9
、装置18の相関ピークのgt昇にJ:v稍缶な対応点
+X、Y)となるわけである。ステレオ祝頂Ei、mI
# 19は、2つのIJMJINi、 7 a、 7 
b上の対応点のベアIX、)’)、fX、Y)から精密
な対板点出力する。
Since there is an outline, the corresponding point of nothing 77) Lost and sad 9
, the correlation peak of the device 18 becomes a corresponding point +X, Y) which corresponds to J:v slightly. Stereo celebration Ei, mI
#19 is two IJMJINi, 7 a, 7
A precise counter-board point is output from the corresponding points on b (IX, )'), fX, Y).

〔発明の効果〕〔Effect of the invention〕

本発明によれは、IIal琢上の焦点位置の変化と一稼
鮮明変の検出にJ:11+、[i単に対象物体と視覚シ
ステムの距離情報全画像上の小慣域対応に丞めることが
でき、さらに以上のシステムケステレオ視システムに付
加し、2収の画琢対応点探系の初期位置情報として利用
することに、Cす、重速で#ll開度3医元仇寛システ
ムケ提供することかでさる。
According to the present invention, J:11+ can be used to detect changes in the focal position on IIal and sharp changes in sharpness. In addition to the above system, it can be added to the stereo viewing system and used as the initial position information of the 2nd image corresponding point search system. It depends on what you offer.

【図面の簡単な説明】[Brief explanation of drawings]

凶はいずれも本発明に閃するもので、第1図は画法焦点
とl1i11稼鮮明度の閃隆伊ボす凶、第2図はステレ
オ視のJpA理乞ボす図、第3図は視覚7ステムの一夫
施例の購戚凶、第4図は視覚システムの他の実施例の購
a図でるる。 l・・・レンズ、2・・・1filI塚セツサ而、3・
・・対板物俸、4・・・し7ズ、5・・・lI!11稼
セフ丈…J、6・・・#J/Y!ij力装置。 VJ 1 図 (0−〕 第 Z 図 fJ3 図
All of these images are inspired by the present invention, and Figure 1 shows a flash of focus and l1i11 sharpness, Figure 2 shows a stereo view of JpA, and Figure 3 Figure 4 shows a diagram of another embodiment of the vision system. l...lens, 2...1 filI Tsuka set, 3.
... vs. board salary, 4...7z, 5...lI! 11 years old...J, 6...#J/Y! ij force device. VJ 1 Figure (0-) Z Figure fJ3 Figure

Claims (1)

【特許請求の範囲】[Claims] し/ズ糸とN稼セッサと画1隊メモリと画像処理装置か
らなる伐寛7ステムにおいて、画像上フサ上の焦点ケ友
化させる手段と、lI!lal家メモリ上の部分領域の
鮮明度をXめる手取と、部分領域ことの鮮明度を記憶す
るナベと、該部分領域ことの鮮明度の成人iIiτ与え
る焦点距離ゲボめる一r=b−と、咳焦点距離r対板物
坏と視覚システムとの距離に震侠する生成とからなる3
仄元佛寛7ステム。
In the Sekkan 7 stem, which consists of a Shi/zu yarn, an N-processor, a picture 1 group memory, and an image processing device, there is a means for making the focal point on the frame on the image clear, and lI! A hand that calculates the sharpness of a partial area in the family memory by and a generation that trembles between the cough focal length r and the distance between the plate object and the visual system.
7 stems of Fuyuan Butsukan.
JP59015187A 1984-02-01 1984-02-01 Three-dimensional eyesight system Pending JPS60161512A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP59015187A JPS60161512A (en) 1984-02-01 1984-02-01 Three-dimensional eyesight system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP59015187A JPS60161512A (en) 1984-02-01 1984-02-01 Three-dimensional eyesight system

Publications (1)

Publication Number Publication Date
JPS60161512A true JPS60161512A (en) 1985-08-23

Family

ID=11881832

Family Applications (1)

Application Number Title Priority Date Filing Date
JP59015187A Pending JPS60161512A (en) 1984-02-01 1984-02-01 Three-dimensional eyesight system

Country Status (1)

Country Link
JP (1) JPS60161512A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS62140008A (en) * 1985-12-16 1987-06-23 Komatsu Ltd Method for confirming object
JPH0250606U (en) * 1988-10-03 1990-04-09

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS62140008A (en) * 1985-12-16 1987-06-23 Komatsu Ltd Method for confirming object
JPH0250606U (en) * 1988-10-03 1990-04-09

Similar Documents

Publication Publication Date Title
Liu et al. 3D imaging, analysis and applications
CN105894499B (en) A kind of space object three-dimensional information rapid detection method based on binocular vision
CN106595528B (en) A kind of micro- binocular stereo vision measurement method of telecentricity based on digital speckle
KR102166372B1 (en) Optical tracking system and optical tracking method
EP2728374B1 (en) Invention relating to the hand-eye calibration of cameras, in particular depth image cameras
CN110044300A (en) Amphibious 3D vision detection device and detection method based on laser
US10560683B2 (en) System, method and software for producing three-dimensional images that appear to project forward of or vertically above a display medium using a virtual 3D model made from the simultaneous localization and depth-mapping of the physical features of real objects
CN104395694B (en) Motion sensor device with multiple light sources
CN109285189B (en) Method for quickly calculating straight-line track without binocular synchronization
WO2011145285A1 (en) Image processing device, image processing method and program
KR102102291B1 (en) Optical tracking system and optical tracking method
CN107084680A (en) A kind of target depth measuring method based on machine monocular vision
CN108981608B (en) Novel line structured light vision system and calibration method
CN112465778A (en) Underwater fish shoal observation device and method
CN110021035B (en) Marker of Kinect depth camera and virtual marker tracking method based on marker
Deshpande et al. Accuracy in depth recovery and 3D image synthesis from single image using multi-color filter aperture and shallow depth of field
CN110705487B (en) Palm print acquisition equipment and method and image acquisition device thereof
CN107172383B (en) A kind of Obj State detection method and device
JPS60161512A (en) Three-dimensional eyesight system
CN108090930A (en) Barrier vision detection system and method based on binocular solid camera
JP2020194454A (en) Image processing device and image processing method, program, and storage medium
JP2004310777A (en) Combination camera and method of compositing virtual image from two or more inputted images
Abbaspour Tehrani et al. A practical method for fully automatic intrinsic camera calibration using directionally encoded light
CN107610170B (en) Multi-view image refocusing depth acquisition method and system
Du et al. Relative epipolar motion of tracked features for correspondence in binocular stereo