CN109672870A - A kind of building projection method for automatically split-jointing - Google Patents

A kind of building projection method for automatically split-jointing Download PDF

Info

Publication number
CN109672870A
CN109672870A CN201811578473.4A CN201811578473A CN109672870A CN 109672870 A CN109672870 A CN 109672870A CN 201811578473 A CN201811578473 A CN 201811578473A CN 109672870 A CN109672870 A CN 109672870A
Authority
CN
China
Prior art keywords
image
projection
space
projector
projected
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811578473.4A
Other languages
Chinese (zh)
Inventor
孙晓颖
李翔
燕学智
陈建
佴威至
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jilin University
Original Assignee
Jilin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jilin University filed Critical Jilin University
Priority to CN201811578473.4A priority Critical patent/CN109672870A/en
Publication of CN109672870A publication Critical patent/CN109672870A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof
    • H04N9/3147Multi-projection systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor

Abstract

The invention discloses a kind of buildings to project method for automatically split-jointing, belongs to projection tiled display field.The present invention establishes camera image space and shows the corresponding relationship between image space according to the position of effective view field and region to be projected;The corresponding relationship between each projection space and camera image space is established using the method for coding structure optical scanning;And then obtain each projection space and show the corresponding relationship between image space, it is possible thereby to will show that the point in image space is mapped to corresponding position in its corresponding projection space.The present invention can be widely applied for the fields such as large-scale performance, large-scale activity, city image publicity, solve the drawbacks such as traditional manual Free Surface splicing system is high to personnel requirement, adjustment time is long, external purely manual Free Surface splicing system can be replaced, the cost of manufacture of culture performance product is substantially reduced.

Description

A kind of building projection method for automatically split-jointing
Technical field
The present invention relates to projection tiled display technologies, and in particular to a kind of large format Free Surface projects automatic Mosaic side more Method.
Background technique
With the constantly promotion that the progress and people of engineering projector technology require visual experience, large format projection Technology is widely used in fields such as large-scale activity, display and demonstration, the releases of new products.Large format Free Surface bumps are not Flat, its projection manually adjusts completely at present, long to personnel requirement height, adjustment time.One large-scale outdoor building projects item Mesh implementation needs two or three months, and the time of splicing fusion just needs one week or more time manually.The projection of large format Free Surface Software substantially by foreign countries monopolize, price is high, and large format Free Surface shadow casting technique is at the early-stage, have very high section It grinds and commercial value, therefore needs a set of automatic projection joining method applied to the projection of large format Free Surface in a hurry.
Summary of the invention
The present invention provides a kind of building projection method for automatically split-jointing, can be enterprising in rough large format Free Surface The splicing fusion of row automatic projection.
The technical solution adopted by the present invention is that, including the following steps:
Step 1, in-site installation sets up projector, and adjusting each projector's parameter and position is full of all projector's projections Entirely selected region to be projected;
Step 2, one camera is set in the viewing location of spectators, which takes entire large format Free Surface;
Step 3, view field is made of the projection of each projector, and rectangle is inscribed as effectively throwing in the maximum for calculating view field Shadow zone domain, according to coordinate and to be projected region four angle point of four angle points of effective view field under camera image coordinate system Coordinate in the case where showing image coordinate system is calculated corresponding between camera image space and display image space using homography matrix Relationship HD
Step 4, covered large format Free Surface region is projected for every projector, uses coding structure optical scanning Method establish the corresponding relationship between each projection space and camera image space;
Step 5, each projection space and display image space are acquired in conjunction with the relationship that step 3 and step 4 obtain Between corresponding relationship Mi, i=1,2 ..., N, N is projector's quantity;
Step 6, to progress color correction image to be projected and integration region brightness decay;
Step 7, it according to the relationship between the obtained each projection space of step 5 and display image space, will show Point in image space is mapped to corresponding position in its corresponding projection space;
Step 8, rendering needs the video projected, and the scene projection of progress is shown: being spliced using converged services device automatic projection The correction data generated in server, and according to the data efficient generate and show the image after distortion, while using wash with watercolours Control server is contaminated, synchronizes the video that all converged services devices play using ICP/IP protocol to realize large format Free Surface Projection.
Wherein, effective view field acquisition methods in the step 3 are as follows: it is white and black to control all projectors first Chromatic graph picture seeks view field by image difference and binarization method, and rectangle is inscribed as having in the maximum of view field Imitate view field.
In step 4 of the present invention, the coding structure optical scanning for being applied to the projection splicing of large format Free Surface of use Method, the specific steps are as follows:
Step 4.1, control projector successively projects the image of white and black, passes through image difference and binary image Processing obtains efficient coding region;
Step 4.2, longitudinal coding is carried out to efficient coding region and laterally encoded;
Step 4.3, error coded point is removed using random sampling unification algorism, i.e. exterior point excludes;
Step 4.4, gridding and mesh point fitting: camera image space is divided into m × n grid, by above-mentioned Coding finds corresponding points of the grid intersection point in projected image space, is calculated using the method for bilinearity difference the point in grid Its corresponding points position in projected image space.
The invention has the advantages that:
Large format Free Surface projection splicing proposed by the present invention can be widely applied for large-scale performance, large size is lived The fields such as dynamic, city image publicity solve traditional manual Free Surface splicing system is high to personnel requirement, adjustment time is long etc. Drawback can replace external purely manual Free Surface splicing system, substantially reduce the cost of manufacture of culture performance product.
Detailed description of the invention
Fig. 1 is the system pie graph that the present invention is implemented;
Fig. 2 is coding structure light scan method flow chart;
Wherein, 101- large format Free Surface;102- projector;103- camera;104- converged services device, 105- are thrown automatically Shadow stitching server, 106- Rendering Control Service device.
Specific embodiment
Include the following steps:
Step 1, in-site installation sets up projector, and adjusting each projector's parameter and position is full of all projector's projections Entirely selected region to be projected;Also, really according to the material of projection surface, live illumination condition and projection brightness requirement etc. Determine projector's model, projector lens and used projector's quantity;
Step 2, camera is set in the viewing location of spectators, selects suitable camera lens and lens focus, makes phase function Enough take entire large format Free Surface view field;
Step 3, view field is made of projector's projection, and rectangle is inscribed as effectively projection in the maximum for calculating view field Region exists according to coordinate of four angle points of effective view field under camera image coordinate system and four, region to be projected angle point It shows the coordinate under image coordinate system, the corresponding pass between camera image space and display image space is calculated using homography matrix It is HD;Wherein effective view field's acquisition methods are as follows: control all projector whites and black image first, pass through image Difference and binaryzation seek view field, i.e., do difference to the pixel of above-mentioned two photo corresponding positions, to error image into Row binary conversion treatment, white portion are view field, and black portions are non-view field.Rectangle is inscribed in the maximum of view field As effective view field;
Step 4, covered large format Free Surface region is projected for every projector, is spliced in automatic projection and is serviced The corresponding relationship between each projection space and camera image is established using the method for coding structure optical scanning on device;
I-th throwing is sought using Gray Code+Phase Shifting coding structure light scan method as shown in Figure 2 Corresponding relationship G between shadow machine image space and camera image spacei, i=1,2 ..., N, N is projector's quantity, wherein is thrown After shadow machine projects image every time, taken pictures with camera.Steps are as follows for coding structure light scan method:
Step 4.1, efficient coding region obtains: due to the partial occlusion of body surface in measurement process, it is dead to there is measurement Angle, the light of projector are beaten less than these regions, while camera photographed target material object in measurement process while can also photograph nothing Background is closed, this part background and measurement dead angle may cause the erroneous matching in later period, while increase the calculation amount of system.This hair The bright image that secondary a white and black is successively projected using projector, is handled by simple image difference and binary image Efficient coding region can be obtained;
Step 4.2, longitudinal coding is carried out to effective view field of every projector respectively:
Step 4.2.1, binaryzation coded image obtain: since projection is carried out under total darkness environment, by environment light and Intrinsic colour in kind influences, the black and white strip discrimination being projected on material object be not it is very high, cause edge blurry, image recognition has Difficulty, can effectively solve edge blurring problem using calculus of finite differences, effectively be identified to black and white strip.Then image two-value is used Change method (such as (OTSU) method poor between maximum kind, automatic threshold method, fixed threshold method etc.) carries out two to difference image Value;
Step 4.2.2, coding: image coding is for projecting upper any point, if being at a time in the moment The black region of binaryzation difference image, then be encoded to 0, on the contrary then be encoded to 1, with regard to shape after encoding by 9 Gray code At 9 binary codings, entire screen area is divided into 512 regions.Most by 4 Phase Shifting codings later Screen is divided into 1024 regions eventually;
Step 4.3, with step 4.2, lateral coding is carried out to image, to make arbitrarily to be in each projected image space Point in effective view field all completes encoding operation;
Step 4.4, exterior point excludes: the encoded point of many mistakes is likely to occur by the coding that aforesaid operations obtain, i.e., it is outer Point removes exterior point by using the methods of consistent (RANSAC) algorithm of random sampling;
Step 4.5, gridding and mesh point fitting: gridding is by the way that camera image space is divided into m × n net Lattice find corresponding points of the grid intersection point in projected image space by above-mentioned coding.It is poor using bilinearity to the point in grid The method of value calculates its corresponding points position;
Step 5, each projection space and display image space are acquired in conjunction with the relationship that step 3 and step 4 obtain Between corresponding relationship Mi, i=1,2 ..., N, N is projector's quantity, that is, seeks needing in image to be shown each pixel each Position in projection;
Step 6, to carry out color correction image to be projected, and it is bright using non-linear weight distribution method progress integration region Degree decaying;
Step 7, it according to the relationship between the obtained each projection space of step 5 and display image space, will show Point in image space is mapped to corresponding position in its corresponding projection space, is sequentially completed in every projector and owns The correspondence of point is the automatic Mosaic for completing the projection of large format Free Surface.Wherein, mapping process is as follows: passing through rendering control clothes The image being engaged in the entire display image space of device rendering, passes through MiFind the point (x in display image spaced,yd) projected at every Position (x' in machine image spacepi,y'pi), using the Shader of 3 d rendering engine directly to (x'pi,y'pi) be assigned a value of showing (x in diagram image spaced,yd) position color value, wherein (xd,yd) and (x'pi,y'pi) it is all made of normalized coordinate;
Step 8, rendering needs the video projected, and the scene projection of progress is shown.Spliced using converged services device automatic projection The correction data generated in server, and according to the data efficient generate and show the image after distortion, while using wash with watercolours Control server is contaminated, synchronizes the video that all converged services devices play using ICP/IP protocol to realize large format Free Surface Projection.
In conclusion the above is merely preferred embodiments of the present invention, being not intended to limit the scope of the present invention. All within the spirits and principles of the present invention, any modification, equivalent replacement, improvement and so on should be included in of the invention Within protection scope.

Claims (4)

1. a kind of building projects method for automatically split-jointing, which comprises the following steps:
Step 1, in-site installation sets up projector, and adjusting each projector's parameter and position makes all projector's projections full of entire Selected region to be projected;
Step 2, one camera is set in the viewing location of spectators, which takes entire large format Free Surface;
Step 3, view field is made of the projection of each projector, and rectangle is inscribed as effective projected area in the maximum for calculating view field Domain, according to coordinate of four angle points of effective view field under camera image coordinate system and four, region to be projected angle point aobvious Show the coordinate under image coordinate system, calculate camera image space using homography matrix and shows the corresponding relationship between image space HD
Step 4, covered large format Free Surface region is projected for every projector, uses the side of coding structure optical scanning Method establishes the corresponding relationship between each projection space and camera image space;
Step 5, it is acquired between each projection space and display image space in conjunction with the relationship that step 3 and step 4 obtain Corresponding relationship Mi, i=1,2 ..., N, N is projector's quantity;
Step 6, to progress color correction image to be projected and integration region brightness decay;
Step 7, according to the relationship between the obtained each projection space of step 5 and display image space, image will be shown Point in space is mapped to corresponding position in its corresponding projection space.
2. a kind of building as described in claim 1 projects method for automatically split-jointing, which is characterized in that effectively thrown in the step 3 Shadow area obtaining method are as follows: control all projector whites and black image first, pass through image difference and binaryzation Method seeks view field, and rectangle is inscribed as effective view field in the maximum of view field.
3. a kind of building as described in claim 1 projects method for automatically split-jointing, which is characterized in that in the step 4, use Coding structure light scan method applied to the projection splicing of large format Free Surface, the specific steps are as follows:
Step 4.1, control projector successively projects the image of white and black, is handled by image difference and binary image Obtain efficient coding region;
Step 4.2, longitudinal coding is carried out to efficient coding region and laterally encoded;
Step 4.3, error coded point is removed using random sampling unification algorism, i.e. exterior point excludes;
Step 4.4, gridding and mesh point fitting: camera image space is divided into m × n grid, passes through above-mentioned coding Find corresponding points of the grid intersection point in projected image space, in grid point using bilinearity difference method calculate its Corresponding points position in projected image space.
4. a kind of building as claimed in claim 1,2 or 3 projects method for automatically split-jointing, which is characterized in that further include: step 8, Rendering needs the video projected, and the scene projection of progress is shown: using what is generated in converged services device automatic projection stitching server Correction data, and according to the data efficient generate and show the image after distortion, while using Rendering Control Service device, benefit The video that all converged services devices play is synchronized with ICP/IP protocol to realize that large format Free Surface projects.
CN201811578473.4A 2018-12-23 2018-12-23 A kind of building projection method for automatically split-jointing Pending CN109672870A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811578473.4A CN109672870A (en) 2018-12-23 2018-12-23 A kind of building projection method for automatically split-jointing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811578473.4A CN109672870A (en) 2018-12-23 2018-12-23 A kind of building projection method for automatically split-jointing

Publications (1)

Publication Number Publication Date
CN109672870A true CN109672870A (en) 2019-04-23

Family

ID=66145970

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811578473.4A Pending CN109672870A (en) 2018-12-23 2018-12-23 A kind of building projection method for automatically split-jointing

Country Status (1)

Country Link
CN (1) CN109672870A (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101273534B1 (en) * 2013-01-31 2013-06-17 (주)브이아이앰 3d projecting image auto calibration method
CN103533278A (en) * 2013-10-21 2014-01-22 北京理工大学 Large-width free surface multi-projection automatic splicing method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101273534B1 (en) * 2013-01-31 2013-06-17 (주)브이아이앰 3d projecting image auto calibration method
CN103533278A (en) * 2013-10-21 2014-01-22 北京理工大学 Large-width free surface multi-projection automatic splicing method

Similar Documents

Publication Publication Date Title
CN103019643B (en) A kind of large screen projection automatic calibration of plug and play and splicing display method
US6983082B2 (en) Reality-based light environment for digital imaging in motion pictures
JP4698831B2 (en) Image conversion and coding technology
CN106534817B (en) Curved surface projection automatic geometric correction method based on image recognition
CA3001430C (en) Image processing method and device for led display screen
CN108776980A (en) A kind of scaling method towards lenticule light-field camera
CN102567976A (en) Tone mapping of very large aerial image mosaic
US20230186434A1 (en) Defocus operations for a virtual display with focus and defocus determined based on camera settings
CN111770326B (en) Indoor three-dimensional monitoring method for panoramic video projection
CN103533318A (en) Building outer surface projection method
Aliaga et al. A virtual restoration stage for real-world objects
CN115578970A (en) Spherical LED screen correction method, device and system and electronic equipment
CN103500438A (en) Interactive building surface projection method
CN103533278B (en) A kind of large format Free Surface many projections method for automatically split-jointing
CN114071104B (en) Method for realizing multi-projector projection gradual change fusion based on shader
CN114049464A (en) Reconstruction method and device of three-dimensional model
CN109587464A (en) A kind of open air large format interaction method
CN109996048A (en) A kind of projection correction's method and its system based on structure light
AU2020277170B2 (en) Realistic illumination of a character for a scene
CN109672870A (en) A kind of building projection method for automatically split-jointing
JP2002117413A (en) Image generating device and image generating method for reflecting light source environmental change in real time
CN113905223B (en) Color 3D imaging method based on single color camera zero registration error and color camera
CN111192227B (en) Fusion processing method for overlapped pictures
US11240429B2 (en) Target object elimination method based on panoramic camera
US11838696B2 (en) Projection system, projection system control device, projection method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190423

WD01 Invention patent application deemed withdrawn after publication