CN102798382A - Embedded visual positioning system - Google Patents

Embedded visual positioning system Download PDF

Info

Publication number
CN102798382A
CN102798382A CN2012102647661A CN201210264766A CN102798382A CN 102798382 A CN102798382 A CN 102798382A CN 2012102647661 A CN2012102647661 A CN 2012102647661A CN 201210264766 A CN201210264766 A CN 201210264766A CN 102798382 A CN102798382 A CN 102798382A
Authority
CN
China
Prior art keywords
module
image
vision
embedded
positioning system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012102647661A
Other languages
Chinese (zh)
Other versions
CN102798382B (en
Inventor
陈龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Axxon Automation Co Ltd
Original Assignee
Shenzhen Axxon Automation Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Axxon Automation Co Ltd filed Critical Shenzhen Axxon Automation Co Ltd
Priority to CN201210264766.1A priority Critical patent/CN102798382B/en
Publication of CN102798382A publication Critical patent/CN102798382A/en
Application granted granted Critical
Publication of CN102798382B publication Critical patent/CN102798382B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

The invention is suitable for the technical field of image identification and positioning, and provides an embedded visual positioning system. The embedded visual positioning system comprises a control device, an embedded operating system and a visual function module, wherein the control device is used for acquiring the basic information of a positioned image and supplying a running environment of the embedded operating system and communicates with the visual function module; the embedded operating system is used for supplying a running environment of the visual function module and communicates with the control device; and the visual function module is used for performing image calibration and visual positioning on the positioned image. By the technical scheme of the invention, the embedded visual positioning system can position an image accurately and is convenient to operate, low in cost and extremely high in practicability.

Description

The embedded vision positioning system
Technical field
The invention belongs to the image recognition technology field, relate in particular to a kind of embedded vision positioning system.
  
Background technology
[0002] image recognition location technology is the difficult point and the focus of research at present; In commercial production is used, generally all adopt powerful industrial computer to carry out the image recognition computing at present, adopting this mode one is that volume is big; Power consumption is high; To the bad adaptability of environment, the 2nd, cost is higher, costs an arm and a leg.
Summary of the invention
The object of the present invention is to provide a kind of embedded vision positioning system, be intended to solve the problem that existing vision positioning system location is inaccurate, cost is high.
The present invention realizes like this; A kind of embedded vision positioning system; Said system comprises control device, embedded OS and visual performance module, and wherein, said control device is used to obtain the essential information of image of being positioned; The running environment of said embedded OS is provided, and communicates with said visual performance module and to be connected; Said embedded OS is used to provide the running environment of said visual performance module, and communicates with said control device and to be connected; Said visual performance module is used for realizing the image that is positioned is carried out image calibration and vision localization.
More excellent, said control device comprises: main frame, display device, input equipment, image capture device, wherein: said main frame is the arithmetic core and control core of said system, is used for the data of interpre(ta)tive system instruction and handling procedure; Said display device is used to show Application Program Interface and relevant result; Said input equipment is used for running program interface and input value, and said image capture device is used for images acquired information.
More excellent; Said display device is a display screen; Said image capture device is an industrial camera; Said input equipment is resistive touch screen or capacitive touch screen, and said display device, said input equipment all connect said main frame, and said image capture device communicates with said main frame through the USB connecting line and is connected.
More excellent, said visual performance module comprises vision calibration module, vision localization module and vision measurement module, wherein, said vision calibration module is used for said system is carried out pixel alignment and mechanically calibrated; Said vision localization module is used to obtain the vision localization coordinate of image of being positioned; Said vision measurement module is used to measure how much numerical value by said image capture device images acquired.
More excellent, said vision calibration module comprises pixel alignment module and mechanically calibrated module, and wherein, said pixel alignment module is used to calibrate the pixel and the relation of the position between the actual range of image of being positioned; Said mechanically calibrated module is used to calibrate the mechanical location of plant equipment and the image that is positioned.
More excellent, said vision localization module comprises memory module and Data Matching module, wherein, said memory module is used for the memory image Template Information; Said Data Matching module is used for the elements of a fix value to the image of confirming to be positioned.
More excellent, said embedded OS is a built-in Linux operating system.
The disclosed technical scheme of the present invention has realized that embedded vision positioning system layout is simple, accurate positioning, and is simple to operate, and reduced production cost.
Description of drawings
Fig. 1 is the structured flowchart of the embedded vision positioning system that provides of the embodiment of the invention;
Fig. 2 is that the vision localization module that the embodiment of the invention provides realizes in the technological algorithm realization of vision localization by search graph S (being image template) synoptic diagram;
Fig. 3 is that the vision localization module that the embodiment of the invention provides realizes template figure T (being elementary area) in the technological algorithm realization of vision localization.
  
Embodiment
In order to make the object of the invention, technical scheme and advantage clearer,, the present invention is further elaborated below in conjunction with accompanying drawing and embodiment.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
See also Fig. 1, be the disclosed embedded vision positioning system of embodiment of the invention structured flowchart,, only show the part relevant with present embodiment for the ease of explanation.As shown in Figure 1; The disclosed embedded vision positioning system of the present invention; Comprise control device 10, embedded OS 20 and visual performance module 30, wherein, control device 10 is used to obtain the essential information of image of being positioned; The running environment of embedded OS 20 is provided, and communicates with visual performance module 30 and to be connected; Embedded OS 20 is used to provide the running environment of visual performance module 30, and communicates with control device 10 and to be connected; Visual performance module 30 is used for realizing the image that is positioned is carried out image calibration and vision localization.
By finding out among Fig. 1; Control device 10 comprises: main frame 101, display device 102, input equipment 103, image capture device 104, wherein: main frame is the arithmetic core and control core of whole embedded vision positioning system, is used for the data of interpre(ta)tive system instruction and handling procedure; Display device 102 is used to show Application Program Interface and relevant result; Input equipment 103 is used for running program interface and input value; Image capture device 104 is used to gather the image information that is positioned.In the present embodiment, main frame 101 is processor chips and the relevant peripherals based on the Cortex-A8 framework; Display device 102 is LED display or LCDs, recommends to use 7 cun display screens; Institute's image capture device 104 is an industrial camera, and industrial camera communicates with main frame 101 through the USB connecting line and is connected, and main frame 101 is the industrial camera power supply through the USB line also and obtains the view data that industrial camera is gathered.Input equipment 103 is resistive touch screen or capacitive touch screen.
Visual performance module 30 comprises vision calibration module 301, vision localization module 302 and vision measurement module 303; Wherein, Vision calibration module 301 is used for the image that is positioned is carried out pixel alignment and mechanically calibrated, and usually, vision calibration module 301 comprises mechanically calibrated module and pixel alignment module.Vision localization module 302 is used to obtain the vision localization coordinate of image of being positioned; Vision measurement module 303 is used for measuring the image geometry numerical value that is positioned.
Set forth in the face of the principle of work of vision measurement module 303 down.System utilizes after image capture device (such as the industrial camera) images acquired, the measurement point of varying number on the zone of the display image of operation interface, can occur according to the difference of measurement function.Move these measurement points in the operation interface after suitable position (general place) according to the object space that will measure; And after the instruction that will begin to carry out measurement was transferred to vision measurement module 303, vision measurement module 303 can be carried out the instruction of measuring according to following steps:
At first obtain the position coordinates of measurement point on the display image of operation interface; Call corresponding measurement function; Calculate its geometric parameter at the display image of operation interface; Utilize the result of pixel alignment afterwards again, geometric parameter promptly can be obtained geometric parameter corresponding physical distance divided by pixel resolution.
Provide following several kinds of measurement functions at present:
Line segment: the distance of point-to-point transmission.The image coordinate of two measurement points is subtracted each other, obtain these 2 on image apart from S1, just can obtain this two measurement point corresponding physical distances divided by pixel resolution again;
Circle: calculate round parameter with three coordinate points, like radius.Obtain the coordinate of three measurement points on the image, guarantee that these three measurement points not on same straight line, call then and ask round algorithm computation to go out radius of a circle.Promptly obtain the physical values of this radius of circle again divided by pixel resolution;
Arc: similar with finding the solution of circle, except that returning radius, also can return arc length.
Distance between parallel lines: utilize the four measuring point, preceding two points constitute article one straight line, and latter two point constitutes the second straight line; Whether calculate two straight lines parallel; If parallel, then return the distance of parallel lines on image, obtain the corresponding physical distance divided by pixel resolution again;
Two included angle of straight line: use the four measuring point, preceding two points constitute article one straight line, and latter two point constitutes the second straight line, calculates the angle of two straight lines.
Concentric circles: utilize six measurement points; First three point constitutes first circle (not conllinear) at 3; Three points in back constitute second circle (not conllinear) at 3, calculate the position in two centers of circle, if home position is consistent; The difference of then calculating two radius of a circles obtains concentrically ringed thickness, otherwise returns error message.
The purpose that the pixel alignment module is carried out pixel alignment is to obtain in the image each pixel and actual range (actual range refers to physical distance; How many physical distances that is each pixel representative is; Such as 1 pixel=0.01mm, generally use its inverse in use, be defined as pixel resolution; Unit is every millimeter of a pixel) between relation, generally be to be used for confirming on every mm distance what pixels are arranged; It is the distance (in a glue action, what the operating point center referred to is exactly Glue dripping head) that calculates industrial camera and operating point center that mechanically calibrated module is carried out mechanically calibrated purpose.Only through pixel alignment and mechanically calibrated after, could accurately carry out vision localization.Below with the be applied as example of embedded vision positioning system, to pixel alignment and the mechanically calibrated detailed in addition explanation of process at a glue platform.
The pixel alignment module is following to the pixel alignment process of the image that is positioned: start main frame, visual calibration procedure can start together; Select " vision calibration " function; Below camera, place one scale ruler clearly; The distance of adjustment camera and ruler makes clear picture; Through operation interface confirm the to be positioned adjacent picture elements of image; The pixel alignment module is extracted the edge line of two adjacent picture elements of the image that is positioned automatically; And write down two pixel numbers between the scale strip; Thereby obtain the relation of pixel and actual range, i.e. physical distance between pixel number/two scale marks between pixel resolution=two scale lines
Mechanically calibrated module is following to the mechanically calibrated process of the image that is positioned: camera fixing on the Z axle of desktop point glue platform, and is connected main frame with Serial Port Line with desktop point glue platform; Start desktop point glue platform, main frame and vision calibration module will be activated; Select " mechanically calibrated " function; Plasticine is placed on the table plane, moves, make dispensing needle head over against plasticine through the arrow button reference mark glue platform on the main frame screen; Move the Z axle at a slow speed through the Z-direction key on the main frame screen, make syringe needle after extruding an impression on the plasticine, stop to move; Move in the camera view through the impression of the directionkeys on the main frame screen, and make its blur-free imaging plasticine; Tracking cross on the moving screen makes its position overlap with the center of impression; " confirming " button at selection operation interface is accomplished mechanically calibrated function.
Vision localization module 302 comprises memory module and Data Matching module, and wherein, memory module is used for the memory image Template Information; The Data Matching module is used for the elements of a fix value to the image of confirming to be positioned.Be example with a glue platform below, the principle of work of vision localization module 302 is described in detail.
User's mobile industrial camera; The elementary area of first elements of a fix point A is appeared in the picture of video camera, and camera views is amplified elementary area this moment, so the user is easy to see the center A (the A point also is first elements of a fix point) of elementary area; In case having confirmed A is first elements of a fix points; Then controller can be given vision localization module 302 with coordinate information value PA1 and the residing elementary area information transmission of A point that A is ordered, and vision localization module 302 obtains the coordinate (X in first elements of a fix point A picture through location technology; Y); (X Y) after commentaries on classics and the coordinate figure PA1 conversion, obtains the coordinate PA that Glue dripping head is ordered at first elements of a fix point A to the coordinate that the controller of main frame is ordered A.
In this embodiment; Location technology refers to and seeks the specific objective image in the database; (the being image template) data that need coupling are arranged in the memory module of known vision localization module 302; And should identical size, direction and pattern be arranged by searching image and elementary area, find elementary area by the position in the searching image (being image template) through matching algorithm.See also Fig. 2 and Fig. 3,, Fig. 2 be in the database by search graph S (being image template), Fig. 3 is template figure T (being elementary area).The width of S is W, and height is H; T is elementary area figure, and the width of T is n, and height is m., the principle of matching algorithm is following:
Elementary area T overlays by search graph S and goes up translation, and elementary area T covers and is called subgraph Sji by the zone of search graph, and (j is the subgraph upper left corner by the coordinate in the search graph i).Following algorithmic formula is followed in the hunting zone:
1≤j≤W-n?;
1≤i≤H-m
Algorithm is through comparing the similarity of Sji and T; Accomplish matching process, matching process is accomplished through the Data Matching module, and concrete matching process is following: elementary area T moves a pixel in by search graph; On new position relatively the similarity c1 of subgraph Sji and T and write down here coordinate (j, i); Elementary area T moves to next location of pixels again, more here the similarity c2 of subgraph Sji and T and write down this place coordinate (j, i); Repeating step 2, up to j=W-n, i=H-m.
(j i), thinks that promptly this position is elementary area T by the optimum position among the search graph S from all similarities, to find out the corresponding coordinate of maximal value.
The acquisition process of the second position coordinate value PB and the 3rd elements of a fix value PC repeats no more with the acquisition process of first elements of a fix value PA here.
The user has obtained to be positioned after the coordinate points of image, manual again input the be positioned total line number of image and the numerical value of total columns, and the controller of main frame can calculate the image information that generates the image that is positioned automatically.
The above is merely preferred embodiment of the present invention, not in order to restriction the present invention, all any modifications of within spirit of the present invention and principle, being done, is equal to and replaces and improvement etc., all should be included within protection scope of the present invention.

Claims (7)

1. embedded vision positioning system; It is characterized in that; Said system comprises control device, embedded OS and visual performance module, and wherein, said control device is used to obtain the essential information of image of being positioned; The running environment of said embedded OS is provided, and communicates with said visual performance module and to be connected; Said embedded OS is used to provide the running environment of said visual performance module, and communicates with said control device and to be connected; Said visual performance module is used for realizing the image that is positioned is carried out image calibration and vision localization.
2. embedded vision positioning system as claimed in claim 1; It is characterized in that; Said control device comprises: main frame, display device, input equipment, image capture device, wherein: said main frame is the arithmetic core and control core of said system, is used for the data of interpre(ta)tive system instruction and handling procedure; Said display device is used to show Application Program Interface and relevant result; Said input equipment is used for running program interface and input value; Said image capture device is used for images acquired information.
3. embedded vision positioning system as claimed in claim 2; It is characterized in that; Said display device is a display screen, and said image capture device is an industrial camera, and said input equipment is resistive touch screen or capacitive touch screen; Said display device, said input equipment all connect said main frame, and said image capture device communicates with said main frame through the USB connecting line and is connected.
4. like claim 1 or 2 or 3 described embedded vision positioning systems; It is characterized in that; Said visual performance module comprises vision calibration module, vision localization module and vision measurement module, and wherein, said vision calibration module is used for said system is carried out pixel alignment and mechanically calibrated; Said vision localization module is used to obtain the vision localization coordinate of image of being positioned; Said vision measurement module is used to measure how much numerical value of said image capture device images acquired.
5. embedded vision positioning system as claimed in claim 4; It is characterized in that; Said vision calibration module comprises pixel alignment module and mechanically calibrated module, and wherein, said pixel alignment module is used to calibrate pixel and the position between the actual range relation of image of being positioned; Said mechanically calibrated module is used to calibrate the mechanical location of plant equipment and the image that is positioned.
6. embedded vision positioning system as claimed in claim 5 is characterized in that, said vision localization module comprises memory module and Data Matching module, and wherein, said memory module is used for the memory image Template Information; Said Data Matching module is used for the elements of a fix value to the image of confirming to be positioned.
7. embedded vision positioning system as claimed in claim 6 is characterized in that, said embedded OS is a built-in Linux operating system.
CN201210264766.1A 2012-07-30 2012-07-30 Embedded vision positioning system Active CN102798382B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210264766.1A CN102798382B (en) 2012-07-30 2012-07-30 Embedded vision positioning system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210264766.1A CN102798382B (en) 2012-07-30 2012-07-30 Embedded vision positioning system

Publications (2)

Publication Number Publication Date
CN102798382A true CN102798382A (en) 2012-11-28
CN102798382B CN102798382B (en) 2015-12-02

Family

ID=47197583

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210264766.1A Active CN102798382B (en) 2012-07-30 2012-07-30 Embedded vision positioning system

Country Status (1)

Country Link
CN (1) CN102798382B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105413956A (en) * 2015-12-29 2016-03-23 武汉巨正环保科技有限公司 Automatic dispensing system for production of MEMS gas sensor and production method thereof
CN112525075A (en) * 2020-12-12 2021-03-19 深圳市轴心自控技术有限公司 Dispensing precision test system for dispensing equipment
CN115388778A (en) * 2022-10-28 2022-11-25 深圳市元硕自动化科技有限公司 Computer screen quality control device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005130912A (en) * 2003-10-28 2005-05-26 Konica Minolta Medical & Graphic Inc Image display device and program
CN101074965A (en) * 2007-06-26 2007-11-21 南京航空航天大学 Method and apparatus for measuring rotation speed based on image discriminating position
US20100241992A1 (en) * 2009-03-21 2010-09-23 Shenzhen Futaihong Precision Industry Co., Ltd. Electronic device and method for operating menu items of the electronic device
CN201594886U (en) * 2010-02-04 2010-09-29 南京航空航天大学 Assistant driving device based on image sensor
JP2010237193A (en) * 2009-03-12 2010-10-21 Omron Corp Calibration apparatus and method for assisting accuracy confirmation of parameter for three-dimensional measurement
CN102436327A (en) * 2011-10-17 2012-05-02 东莞华中科技大学制造工程研究院 Screen input system and implementation method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005130912A (en) * 2003-10-28 2005-05-26 Konica Minolta Medical & Graphic Inc Image display device and program
CN101074965A (en) * 2007-06-26 2007-11-21 南京航空航天大学 Method and apparatus for measuring rotation speed based on image discriminating position
JP2010237193A (en) * 2009-03-12 2010-10-21 Omron Corp Calibration apparatus and method for assisting accuracy confirmation of parameter for three-dimensional measurement
US20100241992A1 (en) * 2009-03-21 2010-09-23 Shenzhen Futaihong Precision Industry Co., Ltd. Electronic device and method for operating menu items of the electronic device
CN201594886U (en) * 2010-02-04 2010-09-29 南京航空航天大学 Assistant driving device based on image sensor
CN102436327A (en) * 2011-10-17 2012-05-02 东莞华中科技大学制造工程研究院 Screen input system and implementation method thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105413956A (en) * 2015-12-29 2016-03-23 武汉巨正环保科技有限公司 Automatic dispensing system for production of MEMS gas sensor and production method thereof
CN112525075A (en) * 2020-12-12 2021-03-19 深圳市轴心自控技术有限公司 Dispensing precision test system for dispensing equipment
CN112525075B (en) * 2020-12-12 2022-09-09 深圳市轴心自控技术有限公司 Dispensing precision test system for dispensing equipment
CN115388778A (en) * 2022-10-28 2022-11-25 深圳市元硕自动化科技有限公司 Computer screen quality control device

Also Published As

Publication number Publication date
CN102798382B (en) 2015-12-02

Similar Documents

Publication Publication Date Title
Wasenmüller et al. Comparison of kinect v1 and v2 depth images in terms of accuracy and precision
JP7165484B2 (en) High precision calibration system and method
KR102129103B1 (en) System and method for calibration of machine vision cameras along at least three discrete planes
CN105066884B (en) A kind of robot end's deviations bearing calibration and system
CN106524912B (en) Light target cursor position scaling method based on the mobile light pen of three coordinate measuring machine
US11568549B2 (en) Method and system for detecting peripheral device displacement
EP2089791B1 (en) Interactive input system and method
CN106989669A (en) Big visual field high-precision vision system calibrating method based on virtual three-dimensional target
CN103235661A (en) Positioning clicking device and method and touch display screen calibration system and method
CN103632364A (en) Camera spatial position relation calibration device in multi-camera photographing measurement system
CN102508578A (en) Projection positioning device and method as well as interaction system and method
US9360966B2 (en) Method for generally continuously calibrating an interactive input system
CN102798382A (en) Embedded visual positioning system
TWI498792B (en) Optical touch system and touch and display system
CN104034259B (en) A kind of image measurer bearing calibration
CN101660895B (en) Computer system and method for accurately positioning element to be measured
Zhong et al. Camera calibration method of binocular stereo vision based on OpenCV
Metzner et al. Automatic camera calibration and sensor registration of a multi-sensor fringe measurement system using hexapod positioning
CN203606106U (en) Optical center calibrating system for projection equipment
CN116399306B (en) Tracking measurement method, device, equipment and medium based on visual recognition
CN109945837B (en) Virtual mapping equipment based on computer vision
US8624929B2 (en) System for transforming and displaying coordinate datum
CN205066691U (en) Measurement device for parallel robot position
Jia et al. A machine vision-based method of high-precision measurement of the size of workpiece
Wang et al. Visual positioning method of printed circuit boards based on spatial moments

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CP02 Change in the address of a patent holder

Address after: 518000 Guangdong Province, Shenzhen city Longhua District Guanlan Street No. 334 Silicon Valley Guangxi Yuelu power automobile electronic business park building A14

Patentee after: Shenzhen Axxon Automation Co., Ltd.

Address before: 518040 Shenzhen, Shenzhen, Guangdong, Futian District Che Kung Temple Tianan Digital City Tianji building CD 3C

Patentee before: Shenzhen Axxon Automation Co., Ltd.

CP02 Change in the address of a patent holder
CP02 Change in the address of a patent holder

Address after: 518000 building 101, 201 and A14, building A15, silicon valley power automotive electronics Pioneer Park, 334 Guiyue Road, Dafu community, Guanlan street, Longhua District, Shenzhen City, Guangdong Province

Patentee after: SHENZHEN AXXON AUTOMATION Co.,Ltd.

Address before: 518000 building A14, silicon valley power automotive electronics Pioneer Park, 334 Guiyue Road, Guanlan street, Longhua District, Shenzhen City, Guangdong Province

Patentee before: SHENZHEN AXXON AUTOMATION Co.,Ltd.

CP02 Change in the address of a patent holder