CN104657985B - Static vision target occlusion bypassing method based on depth image block information - Google Patents
Static vision target occlusion bypassing method based on depth image block information Download PDFInfo
- Publication number
- CN104657985B CN104657985B CN201510053316.1A CN201510053316A CN104657985B CN 104657985 B CN104657985 B CN 104657985B CN 201510053316 A CN201510053316 A CN 201510053316A CN 104657985 B CN104657985 B CN 104657985B
- Authority
- CN
- China
- Prior art keywords
- candidate
- observed direction
- triangle
- small section
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
Abstract
Description
Claims (6)
- A kind of 1. static vision target occlusion bypassing method based on depth image block information, which is characterized in that this method master It comprises the steps of:(1) depth image of sensation target is obtained, and obtains its Ouluding boundary and camera interior and exterior parameter;(2) the lower adjacent boundary point of each Ouluding boundary point in depth image is extracted, and determines three of each pixel in image Dimension coordinate;(3) external surface modeling is carried out to occlusion area according to Ouluding boundary and lower adjacent boundary information:3a) to every section of Ouluding boundary, the three-dimensional coordinate according to its Ouluding boundary point and lower adjacent boundary point obtains its corresponding screening Region is kept off, and triangulation is carried out to occlusion area and obtains triangle grid model;Triangle grid model 3b) based on acquired occlusion area calculates the normal vector and area of each triangle small section;(4) angle point of Ouluding boundary is extracted, and determines candidate observed direction set:The angle point on the boundary 4a) is extracted for every section of Ouluding boundary application corner detection operator;Occlusion area 4b) is divided into several subregions according to the angle point information obtained, and determines that the candidate of all subregion is seen Survey direction;(5) next best observed bearing is determined:5a) appoint from candidate observed direction set and take a candidate observed direction, calculate in candidate's observed direction and all subregion The angle of each triangle small section normal vector determines the corresponding visible space of candidate's observed direction according to angle information;5b) according to step 5a) whole candidate observed directions in candidate observed direction set are traversed, it calculates each candidate and observes The corresponding visible space in direction;The weights of each candidate observed direction 5c) are calculated, and next best observation is determined using the candidate observed direction of weighting Direction VNBVWith observation central point Pview;5d) according to the next best observed direction and observation central point being obtained, cameras view position P is determinedcamera。
- 2. a kind of static vision target occlusion bypassing method based on depth image block information according to claim 1, It is characterized in that extracting the lower adjacent boundary point of each Ouluding boundary point in depth image described in step (2), and determine image In each pixel three-dimensional coordinate, specific steps include:The lower adjacent boundary point of each Ouluding boundary point in depth image 2a) is extracted, calculation formula is as follows:The wherein coordinate of (i, j) for Ouluding boundary point, the coordinate of (x, y) for pixel adjacent thereto in eight neighborhood, Depth (i, j) is depth value of Ouluding boundary point (i, j), and Depth (x, y) is the depth value of a bit (x, y) in eight neighborhood;2b) using camera interior and exterior parameter, back project is carried out to each pixel, obtains its three-dimensional coordinate.
- 3. a kind of static vision target occlusion bypassing method based on depth image block information according to claim 2, It is characterized in that in step 3b) in, the triangle grid model based on acquired occlusion area calculates that each triangle is small to be cutd open The normal vector and area in face, calculation formula are as follows:Normal in formulaiAnd SquaiIt is the normal vector and area of triangle small section respectively, (xa,ya,za)、(xb,yb,zb)、(xc, yc,zc) be respectively triangle small section vertex A, B, C coordinate, VABAnd VACWhat respectively vertex A and B and vertex A and C were formed Vector.
- 4. a kind of static vision target occlusion bypassing method based on depth image block information according to claim 3, It is characterized in that in step 4b) in, occlusion area is divided into several subregions, and really by the angle point information that the foundation is obtained Determine the candidate observed direction of all subregion, be as follows:4b1) using the line of any lower adjacent boundary point in three dimensions in each angle point and its eight neighborhood as line of demarcation, by this Occlusion area is divided into several subregions, and respectively by the normal vector normal vector after being added of the triangle small section in all subregion As the normal vector of the subregion, calculation formula is as follows:Normal in formulaiIt is the normal vector of the triangle small section in subregion, triangle is the collection of subregion intermediate cam small section It closes, VjNormal vector for subregion;Each section of Ouluding boundary 4b2) is traversed, detects it with the presence or absence of angle point, if there is no angle point, by institute in the Ouluding boundary Some triangle small sections are merged into a sub-regions, and according to step 4b1) subregion is handled, while will be obtained after processing To the negative direction of subregion normal vector be added in candidate observed direction set as candidate observed direction;If 4b3) there are angle points on Ouluding boundary, the line of adjacent boundary point lower in the angle point eight neighborhood selected with it is divided The normal vectors of two sub-regions be added, a new vector is obtained at this time, by negative direction and the two subregions of this vector Normal vector negative direction, be added to together in candidate observed direction set, handled all angle points successively, and candidate is seen The identical element surveyed in the set of direction carries out duplicate removal processing, that is, completes and candidate observed direction set is determined.
- 5. a kind of static vision target occlusion bypassing method based on depth image block information according to claim 4, It is characterized in that in step 5a) in, it is described appoint from candidate observed direction set take a candidate observed direction, calculate candidate and see Direction and the angle of triangle small section normal vector each in all subregion are surveyed, candidate's observed direction is determined according to angle information Corresponding visible space, is as follows:5a1) remember VjAnd NormaliCoordinate be respectively (nj,mj,tj) and (xi,yi,zi), in candidate observed direction set J-th candidates observed direction calculates candidate's observed direction and the angle α of the normal vector of each triangle small section respectively, calculates Formula is as follows:5a2) remember SquaiFor the area of i-th of triangle small section in subregion, Sumi-1It is current candidate observed direction to upper one Area after the observation of triangle small section and, candidate observed direction V is determined according to the α angle value calculatedjCorresponding visible space Sj, calculation formula is as follows:5a3) according to step 5a1) and 5a2), traverse the triangle small section in all subregions, you can obtain the candidate observation side To corresponding visible space.
- 6. a kind of static vision target occlusion bypassing method based on depth image block information according to claim 5, It is characterized in that in step 5c) in, it is described to calculate the weights of each candidate observed direction, and utilize the candidate observed direction of weighting Determine next best observed direction VNBVWith observation central point Pview, it is as follows:5c1) calculate the weight w of each observed directionj, calculation formula is as follows:Wherein n represents the number of candidate observed direction;5c2) determine next best observed direction VNBV, calculation formula is as follows:5c3) according to step 5c1) and the information that 5c2) has calculated that, calculating observation central point PviewIf PviewCoordinate be (xview,yview,zview), N is the number of triangle small section, and the coordinate of the central point Mid of each triangle small section is (xmid, ymid,zmid), then calculate PviewFormula is as follows:Coordinate (the x of its intermediate cam small section central point Midmid,ymid,zmid) computational methods it is as follows:
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510053316.1A CN104657985B (en) | 2015-02-02 | 2015-02-02 | Static vision target occlusion bypassing method based on depth image block information |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510053316.1A CN104657985B (en) | 2015-02-02 | 2015-02-02 | Static vision target occlusion bypassing method based on depth image block information |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104657985A CN104657985A (en) | 2015-05-27 |
CN104657985B true CN104657985B (en) | 2018-07-03 |
Family
ID=53249061
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510053316.1A Active CN104657985B (en) | 2015-02-02 | 2015-02-02 | Static vision target occlusion bypassing method based on depth image block information |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104657985B (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110415294A (en) * | 2018-04-28 | 2019-11-05 | 中移(苏州)软件技术有限公司 | A kind of method and device determining next best observed bearing |
CN110954013B (en) * | 2018-09-26 | 2023-02-07 | 深圳中科飞测科技股份有限公司 | Detection method and detection system thereof |
CN109900272B (en) * | 2019-02-25 | 2021-07-13 | 浙江大学 | Visual positioning and mapping method and device and electronic equipment |
CN112747818B (en) * | 2019-11-11 | 2022-11-04 | 中建大成绿色智能科技(北京)有限责任公司 | Blocked visual angle measuring platform, method and storage medium |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102496184A (en) * | 2011-12-12 | 2012-06-13 | 南京大学 | Increment three-dimensional reconstruction method based on bayes and facial model |
CN103810700A (en) * | 2014-01-14 | 2014-05-21 | 燕山大学 | Method for determining next optimal observation orientation by occlusion information based on depth image |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
ES2392229B1 (en) * | 2010-08-27 | 2013-10-16 | Telefónica, S.A. | METHOD OF GENERATING A MODEL OF A FLAT OBJECT FROM VIEWS OF THE OBJECT. |
-
2015
- 2015-02-02 CN CN201510053316.1A patent/CN104657985B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102496184A (en) * | 2011-12-12 | 2012-06-13 | 南京大学 | Increment three-dimensional reconstruction method based on bayes and facial model |
CN103810700A (en) * | 2014-01-14 | 2014-05-21 | 燕山大学 | Method for determining next optimal observation orientation by occlusion information based on depth image |
Non-Patent Citations (3)
Title |
---|
一种基于深度图像的自遮挡检测方法;张世辉, 张煜婕, 孔令富;《小型微型计算机系统》;20100531;第31卷(第5期);第964-968页 * |
一种基于遮挡区域的最佳观测方位算法;曾丽丽,田青;《四川兵工学报》;20100228;第31卷(第2期);第126页 * |
基于深度图像利用随机森林实现遮挡检测;张世辉,刘建新,孔令富;《光学学报》;20140930;第34卷(第9期);第1-12页 * |
Also Published As
Publication number | Publication date |
---|---|
CN104657985A (en) | 2015-05-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109272537B (en) | Panoramic point cloud registration method based on structured light | |
CN106826833B (en) | Autonomous navigation robot system based on 3D (three-dimensional) stereoscopic perception technology | |
Tomasi et al. | Shape and motion from image streams: a factorization method. | |
CN106940704A (en) | A kind of localization method and device based on grating map | |
CN104657985B (en) | Static vision target occlusion bypassing method based on depth image block information | |
Xiao et al. | 3D point cloud registration based on planar surfaces | |
Yue et al. | Fast 3D modeling in complex environments using a single Kinect sensor | |
CN104463899A (en) | Target object detecting and monitoring method and device | |
CN105005964A (en) | Video sequence image based method for rapidly generating panorama of geographic scene | |
CN109410330A (en) | One kind being based on BIM technology unmanned plane modeling method | |
CN109523595A (en) | A kind of architectural engineering straight line corner angle spacing vision measuring method | |
CN101794459A (en) | Seamless integration method of stereoscopic vision image and three-dimensional virtual object | |
CN108133496A (en) | A kind of dense map creating method based on g2o Yu random fern | |
CN112102342B (en) | Plane contour recognition method, plane contour recognition device, computer equipment and storage medium | |
CN107860390A (en) | The nonholonomic mobile robot of view-based access control model ROS systems remotely pinpoints auto-navigation method | |
Pi et al. | Stereo visual SLAM system in underwater environment | |
Dani et al. | Image moments for higher-level feature based navigation | |
EP3825804A1 (en) | Map construction method, apparatus, storage medium and electronic device | |
Boerner et al. | Brute force matching between camera shots and synthetic images from point clouds | |
CN115578460A (en) | Robot grabbing method and system based on multi-modal feature extraction and dense prediction | |
CN103810700A (en) | Method for determining next optimal observation orientation by occlusion information based on depth image | |
JP3512919B2 (en) | Apparatus and method for restoring object shape / camera viewpoint movement | |
CN106959101A (en) | A kind of indoor orientation method based on optical flow method | |
Kitayama et al. | 3D map construction based on structure from motion using stereo vision | |
Wang et al. | RGB-D visual odometry with point and line features in dynamic environment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20210210 Address after: 066000 82 Longhai Road, Qinhuangdao Economic and Technological Development Zone, Hebei Province Patentee after: HENGYE CENTURY SECURITY TECHNOLOGY Co.,Ltd. Address before: 066004 No. 438 west section of Hebei Avenue, seaport District, Hebei, Qinhuangdao Patentee before: Yanshan University |
|
TR01 | Transfer of patent right | ||
PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Static visual object occlusion avoidance method based on depth image occlusion information Effective date of registration: 20220321 Granted publication date: 20180703 Pledgee: Cangzhou Bank Co.,Ltd. Qinhuangdao branch Pledgor: HENGYE CENTURY SECURITY TECHNOLOGY CO.,LTD. Registration number: Y2022980002848 |
|
PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20230314 Granted publication date: 20180703 Pledgee: Cangzhou Bank Co.,Ltd. Qinhuangdao branch Pledgor: HENGYE CENTURY SECURITY TECHNOLOGY CO.,LTD. Registration number: Y2022980002848 |
|
PC01 | Cancellation of the registration of the contract for pledge of patent right |