CN103020988B - Method for generating motion vector of laser speckle image - Google Patents

Method for generating motion vector of laser speckle image Download PDF

Info

Publication number
CN103020988B
CN103020988B CN201210490235.4A CN201210490235A CN103020988B CN 103020988 B CN103020988 B CN 103020988B CN 201210490235 A CN201210490235 A CN 201210490235A CN 103020988 B CN103020988 B CN 103020988B
Authority
CN
China
Prior art keywords
image
pixel
block
motion vector
speckle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210490235.4A
Other languages
Chinese (zh)
Other versions
CN103020988A (en
Inventor
姚慧敏
葛晨阳
葛瑞龙
李倩敏
朱鸣
王峰
李伟
陈磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NINGBO YINGXIN INFORMATION SCIENCE & TECHNOLOGY CO., LTD.
Original Assignee
NINGBO YINGXIN INFORMATION SCIENCE & TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NINGBO YINGXIN INFORMATION SCIENCE & TECHNOLOGY Co Ltd filed Critical NINGBO YINGXIN INFORMATION SCIENCE & TECHNOLOGY Co Ltd
Priority to CN201210490235.4A priority Critical patent/CN103020988B/en
Publication of CN103020988A publication Critical patent/CN103020988A/en
Application granted granted Critical
Publication of CN103020988B publication Critical patent/CN103020988B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Analysis (AREA)

Abstract

The invention provides a method for generating a motion vector of a laser speckle image, which comprises the following steps of: subjecting an input speckle image projected to a target object to image self-adaptive pretreatment, and subjecting the input speckle image to block matching motion estimation according to an image block of a preset size by using a standard speckle image, which is subjected to the same image self-adaptive pretreatment and used as a basic standard, as reference, namely, seeking an optimal matched block in a seeking window which takes the corresponding position of the image block in the standard speckle image as the center by using a certain seeking strategy and similarity measuring index to obtain an offset amount between the image block and the matched block, namely the motion vector of the image block. The motion vector can be expressed by offset amounts in the X-axis direction and in the Y-axis direction (Delta x, Delta y), the starting point is the image block in the standard speckle image, the final point is the image block in the input speckle image, and the precision can reach sub-pixel grade.

Description

A kind of motion vector generation method of laser speckle image
Technical field
The invention belongs to image procossing, natural interaction technical field, be specifically related to a kind of motion vector generation method of laser speckle image.
Background technology
The man-machine interaction mode of natural harmony is the dreamboats of the mankind to manipulation machine, the order making machine can understand people to transmit in state of nature.Utilize image processing techniques acquisition depth information to carry out Real time identification and the motion capture of 3-D view, make people can become possibility alternately with the natural ways such as expression, gesture, the moved work of body and terminal.Being obtained by high-precision image depth information is also one of technological difficulties of Vision Builder for Automated Inspection development.Image depth information acquiring technology is progressively extended to other intelligent terminal from game machine peripheral hardware, comprise intelligent television, smart mobile phone, PC, panel computer etc., for user brings the control mode as " science fiction " and brand-new man-machine interaction experience, all have wide practical use in fields such as Entertainment, consumer electronics, medical treatment, education.
The active vision pattern of structure based light more adequately can obtain the depth information of image, this pattern compares binocular solid camera, and the depth map information with acquisition is more reliable and more stable, by ambient light effects, the advantage such as Stereo matching process is simple, algorithm calculated amount is little.Body sense interactive device Kinect as Microsoft is exactly the active vision pattern adopting infrared structure light, namely fixed mode image is projected to body surface by infrared laser, diffuse reflection through body surface forms speckle point, obtain speckle image by imageing sensor collection, then calculated the depth information obtaining object by picture depth sensor chip.The present invention is directed to the active vision pattern of structure based light, the input speckle pattern (depth information is unknown) utilizing imageing sensor to gather compares with standard speckle pattern (depth distance information is known), obtained the motion vector information of input speckle pattern by the pattern match of image block, calculate for follow-up depth map.Can say that content of the present invention is the key obtaining image depth information quickly and accurately.
Summary of the invention
The invention provides a kind of motion vector generation method of laser speckle image, first image adaptive pre-service is carried out to the input speckle pattern projected on target object (depth information is unknown), again using the standard speckle pattern as benchmark (depth distance information is known) through identical image preprocessing for reference, input speckle pattern is carried out block-based motion estimation by a certain size image block, namely find in the search window of image block in standard speckle pattern centered by correspondence position by certain search strategy and similarity measurement index and find blocks and optimal matching blocks, obtain the side-play amount between this image block and match block, be the motion vector of this image block.This motion vector can by the displacement of X, Y direction ( , ) represent, starting point is the image block in standard speckle pattern, and terminal is the image block of input speckle pattern, and its precision can reach sub-pixel-level.
According to the motion vector generation method of a kind of laser speckle image of the present invention, implementation step comprises:
The acquisition of step one, standard speckle image and input speckle image, wherein, projects fixing speckle pattern with the central axis of speckle grenade instrumentation and in plane apart from described grenade instrumentation gauged distance, catches the standard speckle image in described plane; The input speckle image that seizure projects target object region and obtains;
The image adaptive pre-service of step 2, speckle pattern, wherein, standard speckle image and input speckle image, after the image adaptive pre-service of the same manner, generate pretreated standard speckle image and input speckle image;
Step 3, input speckle image and standard speckle image between block-based motion estimation, wherein, in conjunction with described pretreated standard speckle image and input speckle image, obtain the motion vector on input speckle image regional with Algorithm for Block Matching Motion Estimation.
The beneficial effect of technical solution of the present invention is adopted the elaboration by following examples to be obtained concrete embodiment.
Accompanying drawing explanation
Fig. 1 is the overall flow block diagram of the embodiment of the present invention;
Fig. 2 is the pretreated FB(flow block) of image adaptive of the embodiment of the present invention;
Fig. 3 is the block-based motion estimation schematic diagram of the embodiment of the present invention;
Fig. 4 is the sub-pixel motion estimation schematic diagram of the embodiment of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
Fig. 1 schematically illustrates the overall flow figure that embodiment of the present invention laser speckle image motion vector generates.In order to clearly demonstrate, hereinafter the method is described for composition graphs 2 and Fig. 3.
When generating the motion vector of laser speckle image, first carry out step one, acquisition standard speckle pattern and input speckle pattern, wherein, fixing speckle pattern projected with the central axis of speckle grenade instrumentation and in plane apart from described grenade instrumentation gauged distance, catch the standard speckle image in described plane; The input speckle image that seizure projects target object region and obtains.
The system catching speckle image mainly contains speckle grenade instrumentation and imageing sensor.Speckle grenade instrumentation can be coherent source and pattern maker, and coherent light is projected on object by pattern maker and forms speckle pattern.Speckle grenade instrumentation and imageing sensor have substantially equal distance to object.The space that this system is inswept be the light source optical path visual angle of propagating and imageing sensor for the space that intersects to form, visual angle, thus enable the distance apart from pattern maker be greater than the object imaging of Rayleign distance.
The acquisition of standard speckle pattern laser beam (infrared, visible ray, ultraviolet, invisible light) is projected through the speckle pattern that pattern maker is formed the plane that and known location distance perpendicular with the central shaft of laser beam generating device (Z axis) is d (this plane can be made up of projection cloth, flat board etc., for presenting steady and audible speckle point diagram, this plane can be referred to as standard flat) on, the speckle pattern that plane is formed is standard speckle pattern.
In above process, distance d is the vertical range of standard flat and speckle grenade instrumentation.In another preferred embodiment, standard flat, namely the position of described plane is chosen and is met following constraint condition: the central axis of (1) described plane and grenade instrumentation; (2) d value must be irradiated within the scope of coverage at speckle; (3) speckle pattern in described plane is the view picture speckle image containing fixed pattern formation as far as possible, and the speckle pattern in described plane can be captured.Such as, imageing sensor can catch the speckle pattern in described plane in its angular field of view.
The acquisition methods of input speckle pattern and standard speckle pattern is basically identical, is inputted frame by frame by identical imageing sensor, the target object containing the information that will fathom in speckle pattern, within the scope of the coverage that namely target object must irradiate at speckle.
Before image sensor apparatus catches standard speckle pattern and input speckle pattern, need device after filtering, the function of wave filter be only allow in coherent source wave band or close to the light wave of light source wave band normal through (being all suppressed of other wave band), then through imageing sensor collection.
The standard speckle pattern gathered after filtering and input speckle pattern need through the pre-service of step 2 image adaptive, wherein, standard speckle image and input speckle image, after the image adaptive pre-service of the same manner, generate pretreated standard speckle image and input speckle image.Image adaptive pre-service comprises one or more in following process as shown in Figure 2: Bayer format conversion (depending on the output video form of imageing sensor), color space convert (such as, RGB to YUV), gray level image self-adaptive solution and enhancing etc.Bayer format conversion is a kind of conversion method between gray level image and color image format.Gray level image self-adaptive solution method is used for the elimination of noise, and image enchancing method comprises histogram enhancement, gray scale linearly strengthens, binary conversion treatment etc., but is not limited to these traditional Enhancement Method.Make speckle pattern can carry out block-based motion estimation more accurately by denoising and enhancing.
Pretreated standard speckle pattern and input speckle pattern, enter step 3, carry out block-based motion estimation, in conjunction with described pretreated standard speckle image and input speckle image, obtain the motion vector on input speckle image regional with Algorithm for Block Matching Motion Estimation.Block-based motion estimation specific embodiment as shown in Figure 3.With standard speckle pattern for reference data, in input speckle pattern, extract a certain size image block , , for the size of image block, can be equal, also can be unequal.In standard speckle pattern, with image block the search window of the certain limit centered by corresponding position in, find the blocks and optimal matching blocks of this image block with certain search strategy and similarity measurement index, obtain side-play amount between this image block and match block ( , ), be the motion vector of this image block, wherein , for the size of search window, can be equal, also can be unequal.Exemplarily, search strategy and similarity measurement index can adopt and use in conventional block matching process, such as three step search algorithm (TSS) and absolute error and (SAD), but also can adopt search strategy and the similarity measurement index of other various improvement.
To input speckle pattern, image block is by identical size from left to right, extracts from top to bottom by certain step-length.In the process asking for motion vector, suppose that the displacement of all pixels in image block is all identical.Choosing of the corresponding search window of image block is centered by the corresponding region of this image block in standard speckle pattern, expands identical pixel radius up and down respectively .Preferably, if only pay close attention to the side-play amount of image block X-direction , choosing of search window can the left and right directions of an expanded images block, can reduce a large amount of calculated amount like this, improve travelling speed.In like manner the Y-direction of image block is as the same.
The block matching motion estimation method that the present invention obtains input speckle pattern motion vector is different from traditional block matching algorithm.In the matching process, the step-length of traditional its match block of estimation matching algorithm equals the size of match block, and the step-length of the image block extracted from input speckle pattern in the present invention also can be less than the size of match block.As shown in Figure 3, match block represent just middle with the motion vector of pixel in the shadow region of slash mark through the motion vector that estimation is asked for, shadow region can be made up of one or more pixel, obtains the accuracy rate of motion vector and the compromise of small objects motion vector error hiding phenomenon in this approach.
In the present invention, search strategy is that match block is searched for one by one, and therefore precision can reach Pixel-level, even sub-pixel-level.For subpixel accuracy, for the ease of hardware implementing, H.264 scrambler sub-pixel method for estimating can be adopted, mainly comprise two parts: asking for of interpolation arithmetic and sub-pixel-level motion vector is carried out to pixel.The position of sub-pixel is often with 1/2 nfor unit, exemplarily, below in conjunction with Fig. 4, asking for of 1/4 pixel precision motion vector is described.
The first step, asking for of 1/2 pixel precision motion vector.First 1/2 pixel interpolation is carried out to input speckle pattern and standard speckle pattern, the calculating of 1/2 pixel is obtained through filtering by 6 pixels adjacent in horizontal or vertical direction, two kinds of situations are divided into: if 1/2 pixel position is adjacent with integer pixel point according to whether adjacent with integer pixel point, as the i pixel in Fig. 4, computing formula is such as formula (1); If 1/2 pixel position and integer pixel point non-conterminous, as the j pixel in Fig. 4, calculate with 1/2 pixel of 6 in horizontal direction or vertical direction, computing formula is such as formula (2) or formula (3).5 (>>5) expression that moves to right in formula only intercepts integral parts calculating after 32.
(1)
(2)
(3)
After 1/2 pixel calculates, around each integer pixel point, there are 8 1/2 pixels, as shown in Figure 4, terminal pointed to the motion vector of C point wherein, suppose that C point is a certain summit of image block, motion vector is the corresponding vertex pointing to blocks and optimal matching blocks from image block summit: according to described similarity measurement index, Integer Pel point C point and around it 8 1/2 pixels be respectively in 9 1/2 pixel precision match block of summit composition and find blocks and optimal matching blocks, obtain the motion vector of pixel C to 1/2 pixel around it , then in conjunction with vector , obtain the motion vector of described 1/2 pixel precision between this image block and match block .
Second step, after trying to achieve the motion vector of 1/2 pixel precision, the motion vector of 1/4 pixel precision draws by linear interpolation and with computing method like a upper dry goods.Concrete calculating is also divided into two kinds of situations: if the position of 1/4 pixel and integer pixel point or 1/2 pixel adjacent, as aa and the cc pixel in Fig. 4, computing formula is such as formula (4); If the position of 1/4 pixel and integer pixel point and 1/2 pixel all non-conterminous, as the bb pixel in Fig. 4, calculated by 1/2 pixel of 2 on diagonal line, computing formula is such as formula (5).Move to right 1 (>>1) expression divided by the 2 rear calculating only intercepting integral parts in formula (4) and (5).
(4)
(5)
After 1/4 pixel interpolation, around each 1/2 pixel, there are 8 1/4 pixels, as shown in Figure 4, terminal pointed to the motion vector of i point , according to described similarity measurement index 1/2 pixel i point and around it 8 1/4 pixels be respectively in 9 1/4 pixel precision match block of summit composition and find blocks and optimal matching blocks, obtain the motion vector of pixel i to 1/4 pixel around it , then in conjunction with vector , obtain the motion vector of described 1/4 pixel precision between this image block and match block .
In the present invention, the input speckle image of seizure comprises a series of test patterns caught in described object moving process, and can according to the motion of object in estimated tracking target region, position.
Although the above embodiments complete in specific system, so itself and non-limiting the present invention, what the present invention can be similar is applied in similar pattern projection and image sensor system.Thus amendment without departing from the spirit and scope of the present invention and perfect, all should be included in above-mentioned right.

Claims (6)

1. a laser speckle image motion vector generation method, comprising:
The acquisition of step one, standard speckle image and input speckle image, wherein, fixing speckle pattern is projected with the central axis of speckle grenade instrumentation and apart from described grenade instrumentation be gauged distance d plane on, catch the standard speckle image in described plane; The input speckle image that seizure projects target object region and obtains;
The image adaptive pre-service of step 2, speckle pattern, wherein, standard speckle image and input speckle image, after the image adaptive pre-service of the same manner, generate pretreated standard speckle image and input speckle image;
Step 3, input speckle image and standard speckle image between block-based motion estimation, wherein, in conjunction with described pretreated standard speckle image and input speckle image, obtain the motion vector on input speckle image regional with Algorithm for Block Matching Motion Estimation
Wherein, in input speckle image, extract a certain size image block block m × n; In standard speckle image, with image block block m × nthe search window search_block of the certain limit centered by corresponding position m × Nin, the blocks and optimal matching blocks of this image block is found according to search strategy and similarity measurement index, wherein, m, n are the size of image block, and M, N are the size of search window, and M is more than or equal to m, N is more than or equal to n, obtain side-play amount (the Δ x between this image block and described match block, Δ y), be the motion vector of this image block
And be wherein, 1/2 pixel precision or 1/4 pixel precision according to the motion vector that described Algorithm for Block Matching Motion Estimation obtains, wherein
When calculating 1/2 pixel, be divided into two kinds of situations according to whether adjacent with integer pixel point:
Ask 1/2 pixel position adjacent in the horizontal or vertical directions with integer pixel point if wait, computing formula is formula (1);
Ask if wait 1/2 pixel position and integer pixel point non-conterminous in the horizontal or vertical directions, then computing formula is formula (2) or formula (3);
i=(A-5B+20C+20D-5E+F+16)>>5 (1)
j=(a-5b+20c+20d-5e+f+16)>>5 (2)
j=(g-5h+20i+20k-5l+m+16)>>5 (3)
Wherein, i, j are 1/2 pixel to be asked, and > > 5 expressions move to right 5; A, B, C, D, E and F are be positioned at the integer pixel point in same level direction with i centered by i; A, b, c, d, e, f are be positioned at same level direction with j and 1/2 pixel adjacent with integer pixel point centered by j; G, h, i, k, l and m be centered by j, is positioned at same vertical direction and 1/2 adjacent with integer pixel point pixel with j;
After 1/2 pixel calculates, terminal is pointed to the motion vector of C point wherein, suppose that C point is a certain summit of described image block, motion vector is the corresponding vertex pointing to blocks and optimal matching blocks from image block summit: according to described similarity measurement index, integer pixel point C point and around it 8 1/2 pixels be respectively in 9 1/2 pixel precision match block of summit composition and find blocks and optimal matching blocks, obtain the motion vector of pixel C to surrounding 1/2 pixel again in conjunction with vector obtain the motion vector of 1/2 pixel precision between described image block and match block
2. method according to claim 1, wherein, the position of described plane is chosen and is met following constraint condition: the central axis of (1) described plane and described grenade instrumentation; (2) marking distance d value irradiates within the scope of coverage at speckle; (3) speckle pattern in described plane is the view picture speckle image containing fixed pattern formation as far as possible, and the speckle pattern in described plane can be captured.
3. method according to claim 1, wherein, image adaptive pre-service comprise in following process one or more: Bayer format conversion, color space convert, gray level image self-adaptive solution and enhancing.
4. method according to claim 1, the step-length of the image block extracted from input speckle pattern is less than the size of match block.
5. method according to claim 1, when calculating 1/4 pixel, is characterized in that:
After trying to achieve the motion vector of 1/2 pixel precision, the motion vector of 1/4 pixel precision is also divided into two kinds of situations:
Ask the position of 1/4 pixel and integer pixel point or 1/2 pixel adjacent in the horizontal or vertical directions if wait, computing formula is formula (4);
Ask the position of 1/4 pixel and integer pixel point and 1/2 pixel all non-conterminous in the horizontal or vertical directions if wait, computing formula is formula (5);
aa=(C+i+1)>>1 (4)
bb=(i+c+1)>>1 (5)
Wherein, aa, bb are 1/4 pixel to be asked, and > > 1 expression moves to right 1; In formula (4), C and i is respectively the integer pixel point adjacent with aa and 1/2 pixel; In formula (5), i and c is respectively adjacent with bb, and is positioned at 1/2 pixel on same diagonal line;
After 1/4 pixel interpolation, terminal is pointed to the motion vector of 1/2 pixel precision of i point wherein, suppose that i point is a certain summit of described 1/2 pixel precision image block, motion vector is the corresponding vertex pointing to blocks and optimal matching blocks from image block summit: according to described similarity measurement index, 1/2 pixel i and around it 8 1/4 pixels be respectively in 9 1/4 pixel precision match block of summit composition and find blocks and optimal matching blocks, obtain the motion vector of pixel i to surrounding 1/4 pixel again in conjunction with vector obtain the motion vector of 1/4 pixel precision between described image block and match block
6. method according to claim 1, wherein, the input speckle image that described step one catches is included in a series of test patterns caught in described target object moving process, follows the tracks of the motion of this target object according to the motion vector of this series of test pattern calculated.
CN201210490235.4A 2012-11-27 2012-11-27 Method for generating motion vector of laser speckle image Active CN103020988B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210490235.4A CN103020988B (en) 2012-11-27 2012-11-27 Method for generating motion vector of laser speckle image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210490235.4A CN103020988B (en) 2012-11-27 2012-11-27 Method for generating motion vector of laser speckle image

Publications (2)

Publication Number Publication Date
CN103020988A CN103020988A (en) 2013-04-03
CN103020988B true CN103020988B (en) 2015-02-25

Family

ID=47969554

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210490235.4A Active CN103020988B (en) 2012-11-27 2012-11-27 Method for generating motion vector of laser speckle image

Country Status (1)

Country Link
CN (1) CN103020988B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103561257B (en) * 2013-11-01 2015-05-13 北京航空航天大学 Interference-free light-encoded depth extraction method based on depth reference planes
CN103839259B (en) * 2014-02-13 2016-11-23 西安交通大学 A kind of image searches blocks and optimal matching blocks method and device
CN103810708B (en) * 2014-02-13 2016-11-02 西安交通大学 A kind of laser speckle image depth perception method and device
CN104537657A (en) * 2014-12-23 2015-04-22 西安交通大学 Laser speckle image depth perception method implemented through parallel search GPU acceleration
CN110177266B (en) * 2017-12-18 2021-02-26 西安交通大学 Self-correcting method and device of structured light 3D depth camera
CN112581374A (en) * 2019-09-29 2021-03-30 深圳市光鉴科技有限公司 Speckle sub-pixel center extraction method, system, device and medium
CN111257287B (en) * 2020-01-22 2022-11-25 清华大学深圳国际研究生院 Large-field-of-view scattering imaging method and device based on no-priori target positioning
RU2756375C1 (en) * 2020-12-01 2021-09-29 федеральное государственное автономное образовательное учреждение высшего образования "Санкт-Петербургский политехнический университет Петра Великого" (ФГАОУ ВО "СПбПУ") Method for processing images of speckle structures from scattered laser radiation on ferrofluid nanoparticles oriented in a magnetic field
CN113137939B (en) * 2021-05-19 2022-07-19 东南大学 Unpacking method based on binary characteristic pattern matching
CN113936049A (en) * 2021-10-21 2022-01-14 北京的卢深视科技有限公司 Monocular structured light speckle image depth recovery method, electronic device and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101501442A (en) * 2006-03-14 2009-08-05 普莱姆传感有限公司 Depth-varying light fields for three dimensional sensing
CN101516040A (en) * 2008-02-20 2009-08-26 深圳华为通信技术有限公司 Video matching method, device and system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4598887B2 (en) * 2001-09-28 2010-12-15 株式会社キーエンス Pattern matching method using pyramid structure search, image detection circuit, image processing program, and computer-readable storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101501442A (en) * 2006-03-14 2009-08-05 普莱姆传感有限公司 Depth-varying light fields for three dimensional sensing
CN101516040A (en) * 2008-02-20 2009-08-26 深圳华为通信技术有限公司 Video matching method, device and system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
《基于深度图与彩色图像的跑步机游戏交互系统》;崔怡;《万方数据》;20120426;第19-25页 *
《数字散斑相关方法的全场优化表述》;王显 等;《北京理工大学学报》;20110531;第31卷(第5期);第505-509页 *

Also Published As

Publication number Publication date
CN103020988A (en) 2013-04-03

Similar Documents

Publication Publication Date Title
CN103020988B (en) Method for generating motion vector of laser speckle image
US10142612B2 (en) One method of binocular depth perception based on active structured light
CN103824318B (en) A kind of depth perception method of multi-cam array
CN102999910B (en) Image depth calculating method
CN102970548B (en) Image depth sensing device
EP2531980B1 (en) Depth camera compatibility
Takimoto et al. 3D reconstruction and multiple point cloud registration using a low precision RGB-D sensor
EP2531979B1 (en) Depth camera compatibility
US20140241612A1 (en) Real time stereo matching
CN109360235A (en) A kind of interacting depth estimation method based on light field data
CN103810708A (en) Method and device for perceiving depth of laser speckle image
CN103839258A (en) Depth perception method of binarized laser speckle images
CN104537657A (en) Laser speckle image depth perception method implemented through parallel search GPU acceleration
Hashimoto et al. Dynamic projection mapping with a single IR camera
Chen et al. A color-guided, region-adaptive and depth-selective unified framework for Kinect depth recovery
Wu et al. Freecam3d: Snapshot structured light 3d with freely-moving cameras
Zhang et al. A robust visual odometry based on RGB-D camera in dynamic indoor environments
Shim et al. Performance evaluation of time-of-flight and structured light depth sensors in radiometric/geometric variations
CN116205989A (en) Target detection method, system and equipment based on laser radar and camera fusion
Zhang et al. A novel 2D-to-3D scheme by visual attention and occlusion analysis
Lasang et al. Optimal depth recovery using image guided TGV with depth confidence for high-quality view synthesis
Kim et al. A high quality depth map upsampling method robust to misalignment of depth and color boundaries
Li et al. A real-time collision detection between virtual and real objects based on three-dimensional tracking of hand
Chen et al. Fully in tensor computation manner: a one-shot dense 3D acquisition method using structured light
Soltani et al. Using Augmented-Reality on Planar Surfaced for Previewing Décor Changes

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: NINGBO YINGXIN INFORMATION SCIENCE + TECHNOLOGY CO

Free format text: FORMER OWNER: XI AN JIAOTONG UNIV.

Effective date: 20150121

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 710049 XI AN, SHAANXI PROVINCE TO: 315199

TA01 Transfer of patent application right

Effective date of registration: 20150121

Address after: 315199 room 298, No. 412, bachelor Road, Ningbo, Zhejiang, Yinzhou District

Applicant after: NINGBO YINGXIN INFORMATION SCIENCE & TECHNOLOGY CO., LTD.

Address before: Beilin District Xianning West Road 710049, Shaanxi city of Xi'an province No. 28

Applicant before: Xi'an Jiaotong University

C14 Grant of patent or utility model
GR01 Patent grant