CN106408598A - Three-dimensional portrait reconstruction printing device based on array lens - Google Patents
Three-dimensional portrait reconstruction printing device based on array lens Download PDFInfo
- Publication number
- CN106408598A CN106408598A CN201610842420.3A CN201610842420A CN106408598A CN 106408598 A CN106408598 A CN 106408598A CN 201610842420 A CN201610842420 A CN 201610842420A CN 106408598 A CN106408598 A CN 106408598A
- Authority
- CN
- China
- Prior art keywords
- dimensional
- image
- portrait
- printing
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007639 printing Methods 0.000 title claims abstract description 10
- 238000010146 3D printing Methods 0.000 claims abstract description 9
- 238000000034 method Methods 0.000 claims description 17
- 210000003462 vein Anatomy 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 3
- 230000004438 eyesight Effects 0.000 description 5
- 238000011161 development Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 208000031481 Pathologic Constriction Diseases 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000013517 stratification Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 210000001215 vagina Anatomy 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B33—ADDITIVE MANUFACTURING TECHNOLOGY
- B33Y—ADDITIVE MANUFACTURING, i.e. MANUFACTURING OF THREE-DIMENSIONAL [3-D] OBJECTS BY ADDITIVE DEPOSITION, ADDITIVE AGGLOMERATION OR ADDITIVE LAYERING, e.g. BY 3-D PRINTING, STEREOLITHOGRAPHY OR SELECTIVE LASER SINTERING
- B33Y50/00—Data acquisition or data processing for additive manufacturing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/08—Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10012—Stereo images
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Manufacturing & Machinery (AREA)
- Materials Engineering (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a three-dimensional portrait reconstruction printing device based on array lenses. According to the three-dimensional portrait reconstruction printing device, a plurality of groups of calibration images are shot by the array lenses at first, the obtained images are calibrated, then a target object undergoes 360-degree all-dimensional shooting by means of the plurality of groups of array lenses so as to obtain a plurality of target images, the target images are subjected to three-dimensional matching to realize three-dimensional reconstruction, a three-dimensional model is drawn, and a stereoscopic model of the target object is printed by a 3D printing equipment. The three-dimensional portrait reconstruction printing device comprises a set of software system and hardware equipment, realizes the effect of carrying out real-time shooting and printing on a human body by means of the plurality of groups of array lenses, is high in realism degree of the printed portrait, and has good effect.
Description
Technical field
The invention belongs to image procossing and, computer vision and computer graphics techniques field, specifically include a set of soft
Hardware system, by carrying out, to the many of multiple image, the 3 D stereo mould that three-dimensional reconstruction constructs target object depending on Stereo matching
Type, and can finally print.
Background technology
The shooting of 3D scene and three-dimensionalreconstruction are the new focuses of current image processing techniquess, and it combines optical field imaging theory, 3D
Imaging, the computer vision such as the 3D scene based on image, super resolution and the new method and technology calculating photography aspect.Three-dimensional Gravity
The algorithm aspect of structure, traditional stereo imaging system, using two cameras put together, parallel watches object to be reconstructed attentively.
Conceptually, the image that the similar mankind perceive by eyes is stacked reckoning depth to the method, if known two cameras are each other
Spacing and focal length, and left and right two pictures intercepting can successfully overlap, then depth information can push away rapidly.This method must be faced upward
Rely effective picture pixels the matching analysis, generally use block comparison or Epipolar geometry algorithm is reached.Using two cameras
Stereo vision method, also known as doing stereopsis vision method, separately has three visions to use the extension method of more cameras with other.We institute
With algorithm improved on the basis of conventional stereo visual method, using the solid of the many cameras on multiple lens arrays
Matching process, to reach accurate three-dimensionalreconstruction.
At present, 3D printing technique and its related industry all achieve the development advanced by leaps and bounds, many with 3D printing material
Sample development and the innovation of printing technique, 3D printing not only embodies outstanding development potentiality in traditional manufacturing, with
When its glamour further extend to food manufacturing, clothing luxury goods, video display medium and education etc. multiple live with people closely bound up
Field.But it is applied to the three-dimensionalreconstruction in market at present and 3D printing technique is still immature and equipment is prohibitively expensive, be unfavorable for new
The popularization and application of technology, for this, we devise this system integrating three-dimensionalreconstruction and 3D printing and apply to meet city
Field demand.
Content of the invention
It is an object of the invention to provide a kind of to carry out three-dimensionalreconstruction simultaneously by multigroup array image of array camera gained
The new equipment of portrait stereomodel can be printed.
The present invention adopts Haikang prestige to regard the camera lens composition array camera providing and a 3D printing equipment.By multi-eye stereo
Coupling realizes the stereomodel that three-dimensional reconstruction finally prints three-dimensional portrait.
Brief description
Fig. 1 flow chart of the present invention
The array lens that Fig. 2 present invention uses
Mono- group of scaling board figure of Fig. 3
The parts of images that Fig. 4 array camera multi-angled shooting arrives
Fig. 5 is selected as the center image of reference picture
Fig. 6 software system interface
Fig. 7 three-dimensionalreconstruction the stereoscopic model drawn out
Specific embodiment
For making the object, technical solutions and advantages of the present invention become more apparent, below in conjunction with instantiation with reference to attached
Figure further describes to the three-dimensionalreconstruction of apparatus of the present invention and Method of printing.
The present invention is shot by array lens first and obtains test image, imports the corollary system software of independent development, utilizes
Zhang Zhengyou camera calibration method carries out camera calibration, i.e. the inside and outside parameter of calibration for cameras and distortion factor.With center image as reference
Image carries out regarding Stereo matching more, carries out space by the depth maps of primary objects in many classification MRF algorithm restoration scenarios depending on constraint
Curve reestablishing, is obtained the three-dimensional coordinate at image midpoint, realizes the three-dimensionalreconstruction based on image by image and three-dimensional projection relation.
Apparatus of the present invention flow chart is as shown in Figure 1.
Step 1：Array image obtains
Once shot by same focal length array camera and obtain 4 group pattern images, every group pattern image includes 9 width figures, traditional skill
Art will obtain the three-dimensional stereo model of object, needs object is scanned, different parts, and the scanning of different angles has necessarily
Time difference, can produce certain error, and array camera avoids this defect, precision is higher, can make three-dimensionalreconstruction result
More accurate.The array lens that Fig. 2 uses for the present invention, Fig. 4 is the parts of images that multiple array camera multi-angled shootings arrive.
Step 2：Camera calibration
Array lens shoot different 20 groups of angle calibration plate images, and Fig. 3 is one of which scaling board image.Obtain image
Afterwards, the supporting systems soft ware of importing is demarcated (Fig. 6 is the system interface of software) and is carried out by classical Zhang Zhengyou camera calibration method
Camera calibration, by OpenCV programming realization, obtains inside and outside parameter and the distortion factor of camera.
Step 3：Multi-eye stereo coupling rebuilds three-dimensional scenic
Carry out regarding Stereo matching with center image for reference picture, Fig. 5 is the center image being selected as reference picture more, by
The constraint MRF algorithms that regard carry out the dense reconstruction of space curved surface more, and Depth Stratification is spaced by two adjacent depth on a reference right
Location of pixels difference is answered to determine.Pass through conversion using camera parameter after obtaining depth map, space three-dimensional point cloud can be converted into, realize
Three-dimensional reconstruction.
Step 4：Reconstruct three-dimensional object surface
After realizing the three-dimensional reconstruction of scene, by image and three-dimensional projection relation, can try to achieve any one in image
Three-dimensional coordinate in world coordinate system for the point, is drawn out the profile of target object, and adds color and stricture of vagina using OpenGL programming
Reason details.Finally realize effect such as Fig. 7.
Step 5：Carry out 3 D-printing
The model conversation reconstructing is st1 form, input 3D printer is printed.
The above experimental verification, has been described in detail to the purpose of the present invention, technical scheme and beneficial effect, should
When explanation, the foregoing is only indivedual experimental verifications of the present invention, the invention is not restricted to shown example.Therefore, all
Within the principle of the present invention, any modification, equivalent substitution and improvement done etc., should be included in protection scope of the present invention
Within.
Claims (4)
1. a set of equipment that the target objects such as human body can be shot and carried out with real time print, this equipment includes：
The array lens group that one group can be taken pictures simultaneously；
One 3D printing equipment；
Supporting software system, can demarcate to the image of acquisition of taking pictures, Stereo matching and three-dimensionalreconstruction, and controls 3D printing
Machine carries out the printing of threedimensional model.
2. array lens group according to claim 1 is provided by Hangzhou Hikvision Digital Technology Co., Ltd, by 4
The array lens composition of group 3 × 3, once shoots and obtains 36 coloured images.
3. array camera according to claim 1 shoots and three-dimensionalreconstruction, and step includes：
1) array camera is demarcated；
2) multiple series of images that synchronization is shot carry out demarcating, distortion correction；
3) carry out the Stereo matchings that regard more rebuild three-dimensional scenic surface；
4) three-dimensional coordinate at image midpoint is obtained by image and three-dimensional projection relation；
5) threedimensional model of portrait is drawn out using OpenGL；
6) print portrait stereomodel.
4. the three-dimensional reconstruction method according to right 3 it is characterised in that multiple images obtaining are carried out regard Stereo matching,
Realize the dense three-dimensional reconstruction of scene, obtain the detailed information such as the color and vein of target object simultaneously, and programmed by OpenGL
Repaint out threedimensional model.This device should print portrait, can realize real-time three to the object of any appropriate size
Dimension reconstructs and prints.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610842420.3A CN106408598A (en) | 2016-09-23 | 2016-09-23 | Three-dimensional portrait reconstruction printing device based on array lens |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610842420.3A CN106408598A (en) | 2016-09-23 | 2016-09-23 | Three-dimensional portrait reconstruction printing device based on array lens |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106408598A true CN106408598A (en) | 2017-02-15 |
Family
ID=57997400
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610842420.3A Pending CN106408598A (en) | 2016-09-23 | 2016-09-23 | Three-dimensional portrait reconstruction printing device based on array lens |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106408598A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106933522A (en) * | 2017-03-06 | 2017-07-07 | 武汉中天元科技有限公司 | A kind of long-range 3D printing method and system |
| CN110992474A (en) * | 2019-12-13 | 2020-04-10 | 四川中绳矩阵技术发展有限公司 | Method for realizing time domain technology |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473021A (en) * | 2013-07-10 | 2013-12-25 | 杭州安致文化创意有限公司 | Two-dimensional-image-based 3D (three-dimensional) printing system and method |
| CN103971404A (en) * | 2014-04-14 | 2014-08-06 | 浙江工业大学 | 3D real-scene copying device having high cost performance |
| CN104240289A (en) * | 2014-07-16 | 2014-12-24 | 崔岩 | Three-dimensional digitalization reconstruction method and system based on single camera |
| JP2015055626A (en) * | 2013-09-13 | 2015-03-23 | 點晶科技股▲ふん▼有限公司 | Three-dimensional printing system and three-dimensional printing method |
-
2016
- 2016-09-23 CN CN201610842420.3A patent/CN106408598A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473021A (en) * | 2013-07-10 | 2013-12-25 | 杭州安致文化创意有限公司 | Two-dimensional-image-based 3D (three-dimensional) printing system and method |
| JP2015055626A (en) * | 2013-09-13 | 2015-03-23 | 點晶科技股▲ふん▼有限公司 | Three-dimensional printing system and three-dimensional printing method |
| CN103971404A (en) * | 2014-04-14 | 2014-08-06 | 浙江工业大学 | 3D real-scene copying device having high cost performance |
| CN104240289A (en) * | 2014-07-16 | 2014-12-24 | 崔岩 | Three-dimensional digitalization reconstruction method and system based on single camera |
Non-Patent Citations (1)
| Title |
|---|
| 邹建成等: "基于阵列图像立体匹配的深度信息获取方法", 《北方工业大学学报》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106933522A (en) * | 2017-03-06 | 2017-07-07 | 武汉中天元科技有限公司 | A kind of long-range 3D printing method and system |
| CN110992474A (en) * | 2019-12-13 | 2020-04-10 | 四川中绳矩阵技术发展有限公司 | Method for realizing time domain technology |
| CN110992474B (en) * | 2019-12-13 | 2023-10-31 | 四川中绳矩阵技术发展有限公司 | Method for realizing time domain technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9357206B2 (en) | Systems and methods for alignment, calibration and rendering for an angular slice true-3D display | |
| EP3057317B1 (en) | Light-field camera | |
| CN109919911B (en) | Mobile three-dimensional reconstruction method based on multi-view photometric stereo | |
| CN108475327A (en) | three-dimensional acquisition and rendering | |
| CN109272570A (en) | A kind of spatial point three-dimensional coordinate method for solving based on stereoscopic vision mathematical model | |
| CN107038724A (en) | Panoramic fisheye camera image correction, synthesis and depth of field reconstruction method and system | |
| CN101916455B (en) | Method and device for reconstructing three-dimensional model of high dynamic range texture | |
| CN104599317B (en) | A kind of mobile terminal and method for realizing 3D scanning modeling functions | |
| JPWO2008050904A1 (en) | High resolution virtual focal plane image generation method | |
| GB2465072A (en) | Combining range information with images to produce new images of different perspective | |
| KR102222290B1 (en) | Method for gaining 3D model video sequence | |
| CN107358577B (en) | Rapid splicing method of cubic panoramic image | |
| CN109242898B (en) | Three-dimensional modeling method and system based on image sequence | |
| CN107918948B (en) | 4D video rendering method | |
| CN111064945B (en) | Naked eye 3D image acquisition and generation method | |
| CN111009030A (en) | Multi-view high-resolution texture image and binocular three-dimensional point cloud mapping method | |
| Zilly et al. | Real-time generation of multi-view video plus depth content using mixed narrow and wide baseline | |
| CN112648935A (en) | Image processing method and device and three-dimensional scanning system | |
| Ainsworth et al. | Acquisition of stereo panoramas for display in VR environments | |
| CN108805921A (en) | Image-taking system and method | |
| CN102024272A (en) | Device and method for acquiring computed hologram of three-dimensional motion object | |
| CN106408598A (en) | Three-dimensional portrait reconstruction printing device based on array lens | |
| AU2013308155B2 (en) | Method for description of object points of the object space and connection for its implementation | |
| CN108307179A (en) | A kind of method of 3D three-dimensional imagings | |
| Lucas et al. | 3D Video: From Capture to Diffusion |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190716 Address after: 100144 Beijing City, Shijingshan District Jin Yuan Zhuang Road No. 5 Applicant after: NORTH CHINA University OF TECHNOLOGY Address before: 100144 Beijing City, Shijingshan District Jin Yuan Zhuang Road No. 5 Science College of North China University of Technology Applicant before: Zou Jiancheng |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170215 |