CN103533278B - A kind of large format Free Surface many projections method for automatically split-jointing - Google Patents
A kind of large format Free Surface many projections method for automatically split-jointing Download PDFInfo
- Publication number
- CN103533278B CN103533278B CN201310495590.5A CN201310495590A CN103533278B CN 103533278 B CN103533278 B CN 103533278B CN 201310495590 A CN201310495590 A CN 201310495590A CN 103533278 B CN103533278 B CN 103533278B
- Authority
- CN
- China
- Prior art keywords
- projection
- space
- image
- view field
- free surface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention discloses a kind of large format Free Surface many projections method for automatically split-jointing.Use the present invention can carry out automatic projection splicing on rough large format Free Surface to merge.The present invention, according to effective view field and the position in region to be projected, sets up the corresponding relation between camera image space and display image space；The method using coding structure photoscanning sets up the corresponding relation between each projection space and camera image space；And then obtain the corresponding relation between each projection space and display image space, thus the point in display image space can be mapped to relevant position in the projection space of its correspondence.The present invention can be widely applied for the fields such as large-scale performance, large-scale activity, city image publicity, solve the drawbacks such as traditional manual Free Surface splicing system, adjustment time length high to personnel requirement, external purely manual Free Surface splicing system can be replaced, be substantially reduced the cost of manufacture of culture performance product.
Description
Technical field
The present invention relates to project tiled display technology, be specifically related to a kind of many projections of large format Free Surface automatic
Joining method.
Background technology
Constantly lifting visual experience required along with progress and the people of engineering scialyscope technology, significantly
Face shadow casting technique is widely used in fields such as large-scale activity, display and demonstration, the releases of new products.Greatly
Breadth Free Surface is uneven, and its projection at present the most manually adjusts, during to personnel requirement height, adjustment
Between long.One large-scale outdoor building projection project implementation needs two or three months, the time that manually splicing is merged
It is accomplished by the time of more than one week.The software of large format Free Surface projection is substantially by abroad monopolizing, and price is high
High, and large format Free Surface shadow casting technique is at the early-stage, has the highest scientific research and commercial value, because of
This needs a set of automatic projection joining method being applied to the projection of large format Free Surface in a hurry.
Summary of the invention
In view of this, the invention provides a kind of large format Free Surface many projections method for automatically split-jointing, it is possible to
Rough large format Free Surface carries out automatic projection splicing merge.
Large format Free Surface many projections method for automatically split-jointing of the present invention comprises the following steps:
Step 1, in-site installation sets up scialyscope, adjusts each scialyscope parameter and position makes all scialyscopes throw
Shadow is full of whole selected region to be projected；
Step 2, the viewing location spectators arranges a camera, and this phase function photographs whole large format freely
Surface；
Step 3, view field is made up of the projection of each scialyscope, and the imperial palace calculating view field connects rectangle conduct
Effectively view field, according to four angle points of effective view field coordinate under camera image coordinate system and treat
Four angle points of view field coordinate under display image coordinate system, utilizes homography matrix to calculate camera image empty
Between and display image space between corresponding relation HD；
Step 4, projects the large format Free Surface region covered for every scialyscope, uses coding structure
The method of photoscanning sets up the corresponding relation between each projection space and camera image space；
Step 5, the relation that integrating step 3 and step 4 obtain tries to achieve each projection space and display figure
Corresponding relation M between image spacei, i=1,2 ..., N, N are scialyscope quantity；
Step 6, carries out color correction and integration region brightness decay to image to be projected；
Step 7, the relation between each projection space obtained according to step 5 and display image space,
Point in display image space is mapped to relevant position in the projection space of its correspondence.
Wherein, in described step 3, effective view field acquisition methods is: first control all projector
White and black image, ask for view field by image difference and binarization method, by view field
Imperial palace connects rectangle as effective view field.
In described step 4, the coding structure photoscanning being applied to the projection splicing of large format Free Surface of employing
Method, specifically comprises the following steps that
Step 4.1, controls scialyscope successively projection white and the image of black, by image difference and two-value
Change image procossing and obtain efficient coding region；
Step 4.2, carries out efficient coding region longitudinally encoding and laterally encoding；
Step 4.3, uses stochastic sampling unification algorism to remove error coded point, i.e. exterior point and gets rid of；
Step 4.4, gridding and mesh point matching: camera image space is divided into m × n grid, logical
Cross above-mentioned coding and find grid intersection point corresponding point in projection image space, the point in grid is used two-wire
The method of property interpolation calculates its corresponding point position in projection image space.
Beneficial effect:
The large format Free Surface projection splicing that the present invention proposes can be widely applied for large-scale performance, big
The fields such as type activity, city image publicity, solve traditional manual Free Surface splicing system to personnel requirement
The drawbacks such as high, adjustment time length, it is possible to replace external purely manual Free Surface splicing system, be substantially reduced
The cost of manufacture of culture performance product.
Accompanying drawing explanation
Fig. 1 is the system pie graph that the present invention implements.
Fig. 2 is coding structure light scan method flow chart.
Wherein, 101-large format Free Surface；102-scialyscope；103-camera；104-converged services device, 105-
Automatic projection stitching server, 106-Rendering Control Service device.
Detailed description of the invention
Develop simultaneously embodiment below in conjunction with the accompanying drawings, describes the present invention.
The invention provides a kind of large format Free Surface many projections method for automatically split-jointing, comprise the following steps:
Step 1, in-site installation sets up scialyscope, adjusts each scialyscope parameter and position makes all scialyscopes throw
Shadow is full of whole selected region to be projected；Further, according to the material of projection surface, on-the-spot illumination condition with
And projection brightness requirement etc. determines scialyscope model, projector lens and the scialyscope quantity used.
Step 2, the viewing location spectators arranges camera, selects suitable camera lens and lens focus, makes
Camera can photograph whole large format Free Surface view field.
Step 3, view field is made up of scialyscope projection, and the imperial palace calculating view field connects rectangle as having
Effect view field, according to four angle points of effective view field coordinate under camera image coordinate system and wait to throw
Four, territory, shadow zone angle point coordinate under display image coordinate system, utilizes homography matrix to calculate camera image space
And the corresponding relation H between display image spaceD；Wherein effectively view field's acquisition methods is: first control
All projector white and black image, ask for view field by image difference and binaryzation, i.e.
The pixel of above-mentioned two photo correspondence positions is done difference, error image is carried out binary conversion treatment, white portion
It is divided into view field, black part to be divided into non-view field.The imperial palace of view field is connect rectangle as effectively
View field.
Step 4, projects the large format Free Surface region covered for every scialyscope, spells at automatic projection
Connect and on server, use the method for coding structure photoscanning to set up between each projection space and camera image
Corresponding relation.
Gray Code+Phase Shifting coding structure light scan method as shown in Figure 2 is used to ask for i-th
Corresponding relation G between platform projection space and camera image spacei, i=1,2 ..., N, N are for throwing
Shadow machine quantity, wherein, after each projects images of scialyscope, all takes pictures with camera.Coded structured light is swept
Retouch method step as follows:
Step 4.1, efficient coding region obtains: due to the partial occlusion of body surface during measurement, exist
Measuring dead angle, the light of scialyscope is beaten less than these regions, and during measuring, camera photographed target material object simultaneously
While also can photograph extraneous background, this part background and measure dead angle and be all likely to result in the erroneous matching in later stage,
Increase the amount of calculation of system simultaneously.The present invention uses scialyscope successively projection one secondary white and the image of black,
Processed by simple image difference and binary image and i.e. can get efficient coding region；
Step 4.2, the effective view field to every scialyscope carries out longitudinal coding respectively:
Step 4.2.1, binaryzation coded image obtains: owing to projection is not to carry out, by ring under total darkness environment
Border light and intrinsic colour impact in kind, the black and white strip discrimination being projected on material object is not the highest, causes limit
Edge obscures, and image recognition is difficult, uses calculus of finite differences can effectively solve edge blurring problem, to black and white strip
Effectively identify.Then use image binaryzation method (poor between such as maximum kind (OTSU) method, from
Dynamic threshold method, fixed threshold method etc.) difference image is carried out binaryzation；
Step 4.2.2, coding: picture coding is any point upper for projection, if be at a time in
The black region of this moment binaryzation difference image, then be encoded to 0, otherwise be then encoded to 1, through 9 times
It is the formation of 9 binary codings after Gray code coding, whole screen area is divided into 512 regions.
Finally screen is divided into 1024 regions by 4 Phase Shifting codings afterwards.
Step 4.3, with step 4.2, laterally encodes image, so that in each projection image space
The point being arbitrarily in effective view field all completes encoding operation.
Step 4.4, exterior point eliminating: the coding obtained through aforesaid operations is likely to occur a lot of wrong encoded point,
I.e. exterior point, by using the methods such as consistent (RANSAC) algorithm of stochastic sampling to remove exterior point.
Step 4.5, gridding and mesh point matching: gridding is by camera image space is divided into m × n
Individual grid, finds grid intersection point corresponding point in projection image space by above-mentioned coding.To in grid
Point uses the method for bilinear interpolation to calculate its corresponding point position.
Step 5, the relation that integrating step 3 and step 4 obtain tries to achieve each projection space and display figure
Corresponding relation M between image spacei, i=1,2 ..., N, N are scialyscope quantity, i.e. ask for needing display
Image in each pixel position in each projection.
Step 6, to the color correction that carries out image to be projected, and uses non-linear weight distribution method to merge
Regional luminance is decayed.
Step 7, the relation between each projection space obtained according to step 5 and display image space,
Point in display image space is mapped to relevant position in the projection space of its correspondence, is sequentially completed
In every scialyscope correspondence a little i.e. complete the automatic Mosaic of large format Free Surface projection.Wherein,
Mapping process is as follows: renders the image in whole display image space by Rendering Control Service device, passes through Mi
Find the point (x in display image spaced,yd) position (x' in every projection spacepi,y'pi), use
The Shader of 3 d rendering engine is directly to (x'pi,y'pi) be entered as showing (x in image spaced,yd) color of position
Value, wherein (xd,yd) and (x'pi,y'pi) all use normalization coordinate.
Step 8, renders the video needing projection, carries out on-the-spot projection and shows.Converged services device is used automatically to throw
In shadow stitching server generate correction data, and according to this data efficient generate and show distortion after
Image, uses Rendering Control Service device simultaneously, utilizes ICP/IP protocol to synchronize what all converged services devices were play
Video thus realize large format Free Surface projection.
In sum, these are only presently preferred embodiments of the present invention, be not intended to limit the guarantor of the present invention
Protect scope.All within the spirit and principles in the present invention, any modification, equivalent substitution and improvement etc. made,
Should be included within the scope of the present invention.
Claims (2)
1. large format Free Surface many projections method for automatically split-jointing, it is characterised in that comprise the following steps:
Step 1, in-site installation sets up scialyscope, adjusts each scialyscope parameter and position makes all scialyscopes throw
Shadow is full of whole selected region to be projected；
Step 2, the viewing location spectators arranges a camera, and this phase function photographs whole large format freely
Surface；
Step 3, view field is made up of the projection of each scialyscope, and the imperial palace calculating view field connects rectangle conduct
Effectively view field, according to four angle points of effective view field coordinate under camera image coordinate system and treat
Four angle points of view field coordinate under display image coordinate system, utilizes homography matrix to calculate camera image empty
Between and display image space between corresponding relation HD；
Step 4, projects the large format Free Surface region covered for every scialyscope, uses coding structure
The method of photoscanning sets up the corresponding relation between each projection space and camera image space；
Step 4.1, controls scialyscope successively projection white and the image of black, by image difference and two-value
Change image procossing and obtain efficient coding region；
Step 4.2, carries out efficient coding region longitudinally encoding and laterally encoding；
Step 4.3, uses stochastic sampling unification algorism to remove error coded point, i.e. exterior point and gets rid of；
Step 4.4, gridding and mesh point matching: camera image space is divided into m × n grid, logical
Cross above-mentioned coding and find grid intersection point corresponding point in projection image space, the point in grid is used two-wire
The method of property interpolation calculates its corresponding point position in projection image space；
Step 5, the relation that integrating step 3 and step 4 obtain tries to achieve each projection space and display figure
Corresponding relation M between image spacei, i=1,2 ..., N, N are scialyscope quantity；
Step 6, carries out color correction and integration region brightness decay to image to be projected；
Step 7, the relation between each projection space obtained according to step 5 and display image space,
Point in display image space is mapped to relevant position in the projection space of its correspondence.
2. a kind of large format Free Surface many projections method for automatically split-jointing as claimed in claim 1, its feature
Being, in described step 3, effective view field acquisition methods is: first control all projector white
And black image, ask for view field by image difference and binarization method, by the maximum of view field
Inside connect rectangle as effective view field.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310495590.5A CN103533278B (en) | 2013-10-21 | 2013-10-21 | A kind of large format Free Surface many projections method for automatically split-jointing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310495590.5A CN103533278B (en) | 2013-10-21 | 2013-10-21 | A kind of large format Free Surface many projections method for automatically split-jointing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103533278A CN103533278A (en) | 2014-01-22 |
| CN103533278B true CN103533278B (en) | 2016-08-17 |
Family
ID=49934906
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310495590.5A Active CN103533278B (en) | 2013-10-21 | 2013-10-21 | A kind of large format Free Surface many projections method for automatically split-jointing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103533278B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2015167341A (en) * | 2014-02-13 | 2015-09-24 | 株式会社リコー | multi-projection system |
| CN104778658A (en) * | 2015-04-01 | 2015-07-15 | 北京理工大学 | Full-automatic geometric mosaic correction method for images projected by multiple projectors |
| CN109672870A (en) * | 2018-12-23 | 2019-04-23 | 吉林大学 | A kind of building projection method for automatically split-jointing |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE10251217B3 (en) * | 2002-10-31 | 2004-06-24 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Automatic calibration system for multi projector system e.g. for passive stereo images, using generation, recording and image filtering of strip patterns |
| CN101132535A (en) * | 2007-09-12 | 2008-02-27 | 浙江大学 | Multi-projection large screen split-joint method based on rotating platform |
| CN101321303A (en) * | 2008-07-17 | 2008-12-10 | 上海交通大学 | Geometric and optical correction method for non-plane multi-projection display |
| CN103019643B (en) * | 2012-12-30 | 2015-12-23 | 中国海洋大学 | A kind of large screen projection automatic calibration of plug and play and splicing display method |
| CN103200409B (en) * | 2013-04-10 | 2015-06-03 | 苏州展科光电科技有限公司 | Color correction method of multi-projector display system |
-
2013
- 2013-10-21 CN CN201310495590.5A patent/CN103533278B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN103533278A (en) | 2014-01-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103019643B (en) | A kind of large screen projection automatic calibration of plug and play and splicing display method | |
| US6983082B2 (en) | Reality-based light environment for digital imaging in motion pictures | |
| CN103763479B (en) | The splicing apparatus and its method of real time high-speed high definition panorama video | |
| CN111080724A (en) | Infrared and visible light fusion method | |
| US9195121B2 (en) | Markerless geometric registration of multiple projectors on extruded surfaces using an uncalibrated camera | |
| US10750141B2 (en) | Automatic calibration projection system and method | |
| US8950872B2 (en) | Image projecting device, image processing device, image projecting method, and computer-readable recording medium | |
| CN1204754C (en) | Multi-projector mosaic with automatic registration | |
| CN109920007B (en) | Three-dimensional imaging device and method based on multispectral photometric stereo and laser scanning | |
| CN105308503A (en) | System and method for calibrating a display system using a short throw camera | |
| CN102509093B (en) | Close-range digital certificate information acquisition system | |
| KR101941801B1 (en) | Image processing method and device for led display screen | |
| CN103533276B (en) | Method for quickly splicing multiple projections on plane | |
| CN104794748A (en) | Three-dimensional space map construction method based on Kinect vision technology | |
| CN103533278B (en) | A kind of large format Free Surface many projections method for automatically split-jointing | |
| CN103533318A (en) | Building outer surface projection method | |
| CN102521586A (en) | High-resolution three-dimensional face scanning method for camera phone | |
| CN103500438A (en) | Interactive building surface projection method | |
| CN108090877A (en) | A kind of RGB-D camera depth image repair methods based on image sequence | |
| CN109889799B (en) | Monocular structure light depth perception method and device based on RGBIR camera | |
| CN114049464A (en) | Reconstruction method and device of three-dimensional model | |
| CN108305294A (en) | A kind of camera image curved surface method for precisely marking with grid target | |
| CN108198222A (en) | A kind of wide-angle lens calibration and image correction method | |
| Ortin et al. | Occlusion-free image generation for realistic texture mapping | |
| CN110035275B (en) | Urban panoramic dynamic display system and method based on large-screen fusion projection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |