CN116634112A - Multi-projector plane fusion projection correction method and system based on illusion engine - Google Patents
Multi-projector plane fusion projection correction method and system based on illusion engine Download PDFInfo
- Publication number
- CN116634112A CN116634112A CN202310498868.8A CN202310498868A CN116634112A CN 116634112 A CN116634112 A CN 116634112A CN 202310498868 A CN202310498868 A CN 202310498868A CN 116634112 A CN116634112 A CN 116634112A
- Authority
- CN
- China
- Prior art keywords
- projection
- sub
- area
- grid
- projector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000004927 fusion Effects 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000012937 correction Methods 0.000 title claims abstract description 19
- 230000009466 transformation Effects 0.000 claims abstract description 21
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 claims abstract description 20
- 238000004364 calculation method Methods 0.000 claims abstract description 14
- 230000000694 effects Effects 0.000 claims description 12
- 239000011159 matrix material Substances 0.000 claims description 9
- 238000004519 manufacturing process Methods 0.000 claims description 4
- 238000004891 communication Methods 0.000 claims description 3
- 238000013507 mapping Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3182—Colour adjustment, e.g. white balance, shading or gamut
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/3147—Multi-projection systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3185—Geometric adjustment, e.g. keystone or convergence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3188—Scale or resolution adjustment
Abstract
The invention discloses a multi-projector plane fusion projection correction method and system based on a illusion engine, comprising the following steps: dividing a projection plane by using an illusion engine to obtain a position P1 of a sub-projection area of each projector in the projection plane; projecting a calibration interface generated by the illusion engine to a sub-projection area by using a projector, determining the grid proportion of the calibration interface, generating a point to be calibrated, and storing the position P2 of the calibration point in the calibration interface in the sub-projection area after calibration is finished; according to P1 and P2, obtaining the position P3 of the calibration point of the sub-projection area on the projection plane; inputting P3 and P1 into a PFM format generator, and generating a PFM file of the projector according to an affine transformation mode; inputting P3 and P1 into an Alpha generator, and generating a transparency covering Alpha file according to the superposition area and the fusion strategy obtained by calculation of P1 and P3; the PFM file and Alpha file are input into the illusion engine to configure and project the item content. The invention can meet the projection requirements under different light and shadow environments and reduce the hardware dependence.
Description
Technical Field
The invention relates to the technical field of multi-projection seamless fusion, in particular to a multi-projector plane fusion projection correction method and system based on a illusion engine.
Background
The multi-projector splicing refers to that 2 or more projectors are used for simultaneous projection to form a large projection, compared with a single projector, the multi-projector splicing can obtain higher resolution, and compared with a display screen with the same size, the scheme cost of the multi-projector splicing is much lower.
The multi-projector stitching can be divided into non-overlapping stitching and overlapping stitching according to the existence or nonexistence of overlapping areas of the projectors during projection, wherein the overlapping stitching is also called seamless stitching due to complete no gap between projection contents. The non-overlapping splicing generally reduces gaps by directly adjusting the pose of the projector on the picture projected by the projector, while the overlapping splicing can project the same content on the overlapping region of the projector, and adjust the brightness, color and the like of the overlapping region to make the naked eye unable to distinguish the overlapping region and the non-overlapping region, thereby achieving the ideal projection effect. Most of the existing multi-projector splicing schemes are mainly realized by means of projector hardware correction plug-ins, and are high in cost and large in limitation.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a multi-projector plane fusion projection correction method and system based on a fantasy engine.
The specific technical scheme is as follows:
a multi-projector plane fusion projection correction method based on a illusion engine comprises the following steps:
s1: dividing the whole projection plane by using an illusion engine, obtaining a plurality of sub-grid areas, arranging projectors in one-to-one correspondence with the sub-grid areas, obtaining the position P1 and the content of the sub-projection area corresponding to each projector in the whole projection plane, and storing the position P1 and the content;
s2: opening a calibration project by using an illusion engine, projecting the calibration interfaces to corresponding sub-projection areas by using a projector, determining the grid proportion used by each calibration interface, generating sub-projection areas to be calibrated one by using points to be calibrated, and storing the positions P2 of the calibration points in the calibration interfaces in each sub-projection area after calibration is finished;
s3: according to P1 and P2, obtaining absolute positions P3 of the calibration points of all the sub-projection areas in the whole projection plane;
s4: inputting P3 and P1 into a PFM format generator, and generating PFM files required by each projector according to an affine transformation mode; inputting P3 and P1 into an Alpha generator, and generating a transparency covering Alpha file required by projection according to the superposition area and the fusion strategy obtained by calculation of P1 and P3;
s5: inputting the PFM file and the Alpha file into an nDisplay editor of the illusion engine for configuration;
s6: project the item content using a illusion engine.
Further, the step S1 is specifically implemented by the following substeps:
(1.1) creating a division item by using an illusion engine, dividing a projection plane with a length L and a width W into grids with m+1, (n+1) grid points, and Q i,j ＝(x i ,y j ) I=0, 1,2, …, m, j=0, 1,2, …, n; abscissa x of grid point i The range of the values of (1) is 0L/m, 2L/m, …, iL/m, …, L and y j The range of the values is 0, W/n,2W/n, …, jW/n, … and W;
(1.2) designating the kth block subgrid region to occupy m k *n k Grid of 0<m k <m，0<n k <n, moving the position of each sub-grid region in a dragging mode, so that the sub-grid region is paved on the whole projection plane, and each two adjacent sub-grid regions comprise a superposition region, namely, the position reaches a designated position; the overlapping areas among the sub-grid areas are areas needing fusion projection; storing all grid point coordinates in all sub-grid areas and at the edges;
(1.3) arranging a plurality of projectors, wherein the projection areas of the projectors are in one-to-one correspondence with the sub-grid areas, the projection area corresponding to each projector is a sub-projection area, the sub-grid area is a part of the whole projection plane on the content, the sub-projection area is a part of the whole projection plane on the physical area, and the position of each sub-projection area in the whole projection plane is recorded as P1 and stored.
Further, the step S2 is specifically implemented by the following substeps:
(2.1) manufacturing a calibration project by using an illusion engine, opening the calibration project, and projecting a calibration interface to a corresponding sub-projection area by using projectors, wherein each projector projects a self calibration interface;
initializing all calibration interfaces, determining the grid proportion used by each calibration interface, namely the grid proportion in each sub-grid area, generating grids covering the whole sub-projection area by each calibration interface according to the corresponding proportion, and generating movable points to be calibrated at the vertexes of each grid;
(2.3) manually clicking and dragging the point to be marked by using the left mouse button, so that the position of the point to be marked is greatly moved, then selecting the point to be marked by using the right mouse button, and finely adjusting the position of the point to be marked by using the direction key of the keyboard; the points to be calibrated of the overlapping areas among the sub-projection areas need to be completely overlapped, and grid blocks of the non-overlapping areas are adjusted to be uniformly distributed after the overlapping areas are calibrated;
and (2.4) after the positions of the calibration points are all adjusted, obtaining the calibration point of each sub-grid area, and outputting and storing the position P2 of the calibration point of the sub-grid area of each projector in the calibration interface.
Further, the step S3 specifically includes: and P2 takes the calibration interface as a reference system, P1 takes the whole projection plane as a reference system, an offset vector of each sub-grid region reference system compared with the whole projection plane reference system is calculated according to P1 during calculation and transformation, and the offset vector is added to the P2 position to obtain the absolute position P3 of the calibration point.
Further, in the step S4, the generation of the PFM file is specifically implemented by the following substeps:
(4.1) the PFM format generator reads in a file storing P1 and P3 information, divides each grid into two triangles at the upper right corner and the lower left corner according to diagonal lines, takes the two triangles as a basic unit T of affine transformation, and generates T3 according to P3 at a position corresponding to the T1 generated by P1 to obtain an affine matrix consisting of T1 and T3; calculating affine matrix for each pair of triangles, for one m 1 *n 1 Will result in 2*m for the sub-grid region of (c) 1 *n 1 A plurality of affine transformation matrixes A;
(4.2) calculating a transformation of the PFM file: in MPCDI protocol, the PFM format is defined as each pixel position P within the raster o (x o ，y o ) Corresponding projection content position P f (x p ，y p )，P o And affine transformation matrix A, P f The relationship of (2) is as follows:
P f ＝P o A
and (3) unfolding:
and obtaining information stored correspondingly for each point in the raster stored in the PFM, and generating the PFM file.
Further, in the step S4, the Alpha file is specifically generated by:
reading a file storing P1 and P3 information by an Alpha generator, wherein the Alpha value is an integer in the range of 0-255 and represents a brightness value; for the whole projection plane, the brightness of the non-projection area is adjusted to 0, and the projection effect is that part of the area is black; for the projection area, the brightness of the non-overlapping area is set to 255, and for the left sub-grid area, the right sub-grid area, the upper sub-grid area and the lower sub-grid area which form the overlapping area, a fusion strategy is used for adjusting the brightness, wherein the fusion strategy is specifically as follows:
for a horizontal overlapping region, assuming that the abscissa range of the horizontal overlapping region is [ a, b ], c is a point in the region, and normalizing the coordinate of the point c to obtain x:
x＝(c-a)/(b-a)
wherein x is more than or equal to 0 and less than or equal to 1;
for the left sub-grid region of the overlapping region, the brightness of the overlapping portion is calculated by adopting any one of the following four fusion algorithms:
linear fusion algorithm:
f(x)＝x
exponential fusion algorithm:
wherein, alpha is a variable parameter, and the fusion effect is adjusted by adjusting the alpha value;
square root fusion algorithm:
cosine fusion algorithm:
for the right sub-grid region of the overlapping region, the brightness of the overlapping part is 1-f (x);
for the overlapping area in the vertical direction, replacing the abscissa of the calculation process with the corresponding ordinate, replacing the left sub-grid area of the overlapping area with the upper sub-grid area of the overlapping area, and replacing the right sub-grid area of the overlapping area with the lower sub-grid area of the overlapping area, so as to finish the brightness calculation of the overlapping area in the vertical direction; and after the brightness calculation of the overlapping area in the horizontal direction and the vertical direction is completed, generating an Alpha file.
A multi-projector plane fusion projection correction system based on a illusion engine adopts any one of the multi-projector plane fusion projection correction methods based on the illusion engine, which comprises the following steps: the system comprises a switch, a projection system host, a projection system slave, a projector and a projection plane;
the switch is an Ethernet switch and is used for realizing network communication between the projection system host and all the projection system slaves; the projection system host is responsible for opening projection items and corresponding plug-ins of the illusion engine, sending projection information to each projection system slave and calibrating sub-projection areas of the corresponding projector; the projection system slave machine is responsible for calibrating the sub-projection area of the corresponding projector and starting the receiving end of the illusion engine projection plug-in unit to project; the projector is connected with the corresponding projection system host and the corresponding projection system slave and displays projection content; the projection plane is the plane of projection display.
The beneficial effects of the invention are as follows:
(1) The invention can select different fusion strategies to meet the projection requirements under different light and shadow environments during projection, and meanwhile, the projection area is customized during projection, has the characteristic of being capable of being projected on an irregular geometric plane, and can meet special projection requirements (for example, projected on a trapezoid plane).
(2) According to the invention, no professional calibration personnel is needed during adjustment, the projector does not need to be accurately placed, a user can obtain a good projection fusion effect only by calibrating according to a fixed principle, and the labor cost is saved.
(3) The invention reduces the hardware dependence of the planar fusion projection system and reduces the projection cost.
(4) The invention is developed based on the open source software illusion engine, the system logic is easy to understand and expand, the curved surface fusion projection can be further developed based on the expansion of the MPCDI protocol on the curved surface projection, and relevant developers can customize a projection fusion system with more powerful functions based on the invention.
Drawings
FIG. 1 is a flow chart of the multiple projector plane fusion projection correction method based on the illusion engine.
Fig. 2 is a schematic flow chart of step S1 of the present invention.
FIG. 3 is a flow chart of step S2 of the present invention
FIG. 4 is a hardware schematic of the multiple projector flat fusion projection correction system based on the illusion engine of the present invention.
Detailed Description
The objects and effects of the present invention will become more apparent from the following detailed description of the preferred embodiments and the accompanying drawings, in which the present invention is further described in detail. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, the multi-projector plane fusion projection correction method based on the illusion engine specifically includes the following steps:
s1: and opening the division items by using the illusion engine, dividing the whole projection plane to obtain the position P1 and the content of each sub-projection area in the whole projection plane, and arranging a plurality of projectors at the corresponding positions of the sub-projection areas. The method is realized by the following substeps:
(1.1) creating division items using a illusion engine, creating division items using UMG components of the illusion engine, using components in the UMG as grid points (the visual effect is a relatively small square block), and connecting the grid points in a grid pattern (i.e., each grid point is connected only to the grid points adjacent to the upper, lower, left and right sides), and outputting coordinates of the grid points to a txt file. Dividing the entire projection plane with length L and width W, designating the division of the entire projection plane into m x n grids, such as 3*5 grids, to obtain (m+1) x (n+1) grid points, obviously, the abscissa x of the grid points i The range of the values of (1) is 0L/m, 2L/m, …, iL/m, …, L and y j The value ranges of (2) are 0, W/n,2W/n, …, jW/n, …, W, and the grid point coordinate Q is obtained i,j ＝(x i ,y j )，i＝0,1,2,…,m，j＝0,1,2,…,n。
(1.2) designating the kth block subgrid region to occupy m k *n k Is defined as (define 0)<m k <m，0<n k <n), each sub-grid area is initially positioned at the left upper corner of the whole projection plane, and then the position of each sub-grid area is moved in a dragging mode, so that the whole projection plane is paved by the sub-grid areas, each two adjacent sub-grid areas comprise coincident grids, and a user can adjust the position of the sub-grid and the size of the coincident areas according to actual requirements when the projection plane is specifically used; the overlapping area is automatically generated in this step, and the overlapping area is the area needing fusion projection. All grid point coordinates within and at the edges of all sub-grid areas are exported to a txt file for storage and noted as P1. As shown in FIG. 2, in the present embodiment, in a projection plane divided into 3*5 grids, the sub-grid regions of the two generated 3*3 are initially both located at the upper left corner of the entire projection plane, and then moved by way of draggingThe positions of the sub-grid areas enable the sub-grid areas of the two blocks 3*3 to be separated to the left and right of the whole projection plane, namely to reach the designated position; the overlapping area of the two sub-grids is the middle 3*1 grid.
(1.3) arranging a plurality of projectors, so that the projection area of each projector is allocated with different sub-grid areas, wherein the projection area corresponding to each projector is a sub-projection area, namely the content of the sub-grid area is the mapping of the sub-projection area (the sub-grid area is a part of the whole projection plane on the content, and the sub-projection area is a part of the whole projection plane on the physical area), and at the moment, P1 is the position of each sub-projection area in the whole projection plane. The projectors only need to guarantee that the projectors are projected in a rough direction, for example, two projectors in the previous example are separated on the left side and the right side, and the sub-projection areas are overlapped by not less than one third.
S2: and opening a calibration item by using the illusion engine and outputting the calibration item to a projector, projecting the projector to a corresponding sub-projection area, determining the proportion of the grid to be used, generating calibration points to calibrate the sub-projection areas one by one, marking the position of the calibration point of each sub-projection area as P2 after calibration is finished, and exporting the calibration points to a txt file for storage. The method is realized by the following substeps:
and (2.1) manufacturing a calibration item by using a illusion engine, manufacturing the calibration item by using a UMG component of the illusion engine, using the component in the UMG as grid points (the visual effect is a relatively small square block), connecting the grid points according to a grid style, adding a left mouse button dragging function to the grid points, using a keyboard direction key moving function after the selection, and exporting the coordinates of the grid points into a txt file to generate the calibration item. And opening a calibration item by using the illusion engine, and projecting the calibration interface to a corresponding sub-projection area by using projectors, wherein each projector needs to project the own calibration interface.
(2.2) initializing all calibration interfaces, and determining the mesh proportion used by each calibration interface: inputting the grid proportion inside each designated sub-grid area into the calibration project of the illusion engine corresponding to the projector, namely, the k-th sub-grid area occupies m k *n k Each calibrated interfacial agentA grid covering the whole sub-projection area in a corresponding proportion, and generating movable calibration points at the vertex of each grid;
and (2.3) as shown in fig. 3, the left mouse button is manually used for clicking and dragging to greatly move the position of the target point, then the target point is selected through the right mouse button, and the position of the target point is finely adjusted by using the direction keys of the keyboard, so that the position of the target point is more accurate. When the overlapping area is marked, special attention needs to be paid to ensure that the marked points of the overlapping area are completely overlapped, otherwise, double images can occur in the overlapping area; after the calibration of the overlapping area is finished, the grid blocks of the non-fusion projection area are regulated as much as possible to be uniformly distributed so as to ensure a good projection effect;
and (2.4) after the positions of the calibration points are all adjusted, outputting and storing the files of the positions P2 to txt of the calibration points of the sub-projection areas of each projector in the calibration interface.
S3: the absolute positions P3 of the calibration points of all the sub-projection areas in the whole projection plane are calculated according to the positions P1 of each sub-projection area in the whole projection plane and the positions P2 of the calibration points of each sub-projection area.
The calibration interface is taken as a reference system by P2, the whole projection plane is taken as a reference system by P1, and when the calculation transformation is performed, the offset vector of each sub-grid area reference system compared with the whole projection plane reference system is calculated according to P1, and the absolute position P3 of the calibration point can be obtained by adding the offset vector to the P2 position.
S4: the PFM file required for each projector is generated, and the transparency required for projection masks the Alpha file.
The absolute position P3 of the calibration point and the position P1 of each sub-projection area in the whole projection plane are sent to a PFM format generator, and the PFM file required by each projector is generated according to an affine transformation mode. The method is realized by the following substeps:
(4.1) the PFM Format Generator reads in the txt File storing P1 and P3 information, divides each grid into two triangles of the upper right corner and the lower left corner by drawing a diagonal line from the upper left corner to the lower right corner, takes the two triangles as basic units T of affine transformation respectively, and takes the two triangles as basic units T of affine transformation according to PGenerating T3 by P3 at the corresponding position of T1 generated by 1 to obtain an affine matrix consisting of T1 and T3; calculating affine matrix for each pair of triangles, for one m 1 *n 1 Will result in 2*m for the sub-grid region of (c) 1 *n 1 And (3) an affine transformation matrix A for calculating the transformation of the PFM file subsequently.
(4.2) calculating a transformation of the PFM file. The PFM format is a simple image information storage format, mainly comprising three parts of format, resolution and raster information, and in MPCDI protocol, the PFM format is defined as the position P of each pixel point in the raster o (x o ，y o ) Corresponding projection content position P f (x p ，y p ) Obtaining information stored correspondingly for each point in the grating stored in the PFM according to the following formula
P f ＝P o A
And (3) unfolding:
since the projection content does not exceed the projection-capable range, a projection area without projection content appears, the position of the projection content of the part uses a default value, and the Alpha file is used to turn the chromaticity of the projection area into full black.
Meanwhile, the absolute position P3 of the calibration point and the position P1 of each sub-projection area in the whole projection plane are sent to an Alpha generator, and a transparency covering Alpha file required by projection is generated according to the superposition area calculated by the P1 and the P3 and the appointed fusion strategy. The specific operation is as follows:
the Alpha file is in PNG format, and for each pixel point, only one integer value of 0-255 is used as an Alpha value to represent the brightness of the point, and the larger the value is, the larger the brightness is represented. For the whole projection plane, firstly, the brightness of an un-projected area is adjusted to 0, and the area of the projection effect becomes full black; for the projection area, the brightness of the non-overlapping area is 255, and for the left sub-grid area, the right sub-grid area, the upper sub-grid area and the lower sub-grid area which form the overlapping area, a fusion strategy is used for adjusting the brightness, wherein the overall principle is that the brightness is gradually decreased from the middle to the edge of the sub-grid area, and the fusion strategy is specifically as follows:
for a horizontal overlapping region, assuming that the abscissa range of the horizontal overlapping region is [ a, b ], c is a point in the region, in order to obtain the alpha value of the point c, the coordinates of the point c are normalized to obtain x:
x＝(c-a)/(b-a)
wherein x is more than or equal to 0 and less than or equal to 1.
For the left sub-grid region of the overlapping region, the brightness calculation of the fusion region of the projector adopts any one of the following four fusion algorithms:
linear fusion algorithm:
f(x)＝x
exponential fusion algorithm:
wherein, alpha is a variable parameter, and the fusion effect can be adjusted by adjusting the alpha value;
square root fusion algorithm:
cosine fusion algorithm:
for the right sub-grid region of the overlap region, the projector's fusion region luminance is 1-f (x).
For a fusion region in the vertical direction, assuming that the ordinate range of the vertical superposition region is [ g, h ], l is a point in the region, and normalizing the coordinates of the point l to obtain y:
y＝(l-g)/(h-g)
wherein y is more than or equal to 0 and less than or equal to 1;
for the upper sub-grid region of the overlapping region, the brightness of the overlapping portion is calculated by adopting any one of the following four fusion algorithms:
linear fusion algorithm:
f(y)＝y
exponential fusion algorithm:
square root fusion algorithm:
cosine fusion algorithm:
for the lower sub-grid region of the overlapping region, the brightness of the overlapping portion is 1-f (y).
And after the brightness calculation of the overlapping area in the horizontal direction and the vertical direction is completed, generating an Alpha file. The fusion algorithm with the best effect can be selected according to the hardware and the shadow environment in practical application.
S5: inputting the PFM file and the Alpha file into an nDisplay editor of the illusion engine for configuration; the method is realized by the following substeps:
(5.1) opening the project to be projected of the illusion engine, opening the nDisplay 3D configuration editor, and modifying three parts of components, clusters and output mapping in the project to ensure that the project accords with the connection of hardware used by projection and a network;
and (5.2) dragging the configured nDisplay asset into the project to be projected, automatically generating a projection cone and a projection image, and adjusting the nDisplay asset until the projection requirement is met.
S6: project the item content using a illusion engine. The method is realized by the following substeps:
(6.1) referring to FIG. 4, all the phantom engine plug-ins SwitchBoard Listener in the connected projection system host are opened;
(6.2) open the switch board in the illusion engine and specify the nfisplay profile, click connect and start projection.
In summary, the invention firstly makes calibration items based on the support of nDisplay in the illusion engine to MPCDI projection protocol and UMG components in the illusion engine, and directly generates PFM files for projection mapping based on definition of PFM files in P1, P3 and MPCDI and affine transformation rules; similarly, the Alpha file for adjusting brightness is directly generated based on the definition and the fusion strategy of the Alpha file in P1, P3 and MPCDI, so that the multi-projector plane fusion projection correction based on the illusion engine is realized.
As shown in fig. 4, the multiple projector planar fusion projection correction system based on the illusion engine comprises: a switch, a projection system host, a projection system slave, a projector, a projection plane.
The switch refers to an ethernet switch for implementing network communication between the projection system master and all the projection system slaves.
The projection system host is responsible for opening the projection items and corresponding plug-ins of the illusion engine, sending projection information to each projection system slave, and calibrating the sub-projection areas of the corresponding projector.
The projection system slave machine is responsible for calibrating the sub-projection area of the corresponding projector, and starting the receiving end of the illusion engine projection plug-in unit to project.
The projector is connected with the corresponding projection system host and the corresponding projection system slave and displays projection contents, and preferably all the projectors are of the same model, so that the projection effect is better.
The projection plane is the plane of the projection display, and may be a curtain or other projectable plane.
In practical application, after obtaining a PFM file and an Alpha file, opening a fictitious engine project to be projected on a projection system host, opening an nDisplay editor therein, configuring a network address of a computer participating in projection in a local area network and a position of a projection screen corresponding to each projector in the fictitious engine project, importing corresponding PFM and Alpha files for each projection screen, and storing the content of the nDisplay editor as an asset file after the configuration is finished; opening a switch board in an item to be projected on a projection system host, importing an asset file stored in an nDisplay editor, and then opening a switch board list on the projection system host and each projection system slave to ensure that each computer receives projection information and can transmit the projection information to a corresponding projector through a connecting line; finally, clicking all connections on the switch board of the projection system host to start projection.
The invention develops a multi-projector plane fusion projection correction method and a projection system based on a phantom engine and multi-projector collaborative projection protocol MPCDI. Compared with the conventional general customized projection fusion system in the market, the invention does not need to use additional measuring instruments and hardware, such as an infrared distance measuring instrument, a customized adjusting bracket, customized single video source input multi-source output equipment and the like, and can fusion projection on a required plane position in a manual calibration mode by only needing one or more hosts and a plurality of projectors for configuring an NVIDIA display card installation windows system, and the projection fusion quality of the invention can be comparable to that of the customized plane projection fusion system. Based on the method, the hardware dependence of the planar fusion projection system is reduced to a great extent, and the projection cost is reduced.
It will be appreciated by persons skilled in the art that the foregoing description is a preferred embodiment of the invention, and is not intended to limit the invention, but rather to limit the invention to the specific embodiments described, and that modifications may be made to the technical solutions described in the foregoing embodiments, or equivalents may be substituted for elements thereof, for the purposes of those skilled in the art. Modifications, equivalents, and alternatives falling within the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (7)
1. The multi-projector plane fusion projection correction method based on the illusion engine is characterized by comprising the following steps of:
s1: dividing the whole projection plane by using an illusion engine, obtaining a plurality of sub-grid areas, arranging projectors in one-to-one correspondence with the sub-grid areas, obtaining the position P1 and the content of the sub-projection area corresponding to each projector in the whole projection plane, and storing the position P1 and the content;
s2: opening a calibration project by using an illusion engine, projecting the calibration interfaces to corresponding sub-projection areas by using a projector, determining the grid proportion used by each calibration interface, generating sub-projection areas to be calibrated one by using points to be calibrated, and storing the positions P2 of the calibration points in the calibration interfaces in each sub-projection area after calibration is finished;
s3: according to P1 and P2, obtaining absolute positions P3 of the calibration points of all the sub-projection areas in the whole projection plane;
s4: inputting P3 and P1 into a PFM format generator, and generating PFM files required by each projector according to an affine transformation mode; inputting P3 and P1 into an Alpha generator, and generating a transparency covering Alpha file required by projection according to the superposition area and the fusion strategy obtained by calculation of P1 and P3;
s5: inputting the PFM file and the Alpha file into an nDisplay editor of the illusion engine for configuration;
s6: project the item content using a illusion engine.
2. The method for correcting multi-projector planar fusion projection based on the illusion engine according to claim 1, wherein the step S1 is specifically implemented by the following substeps:
(1.1) creating a division item by using an illusion engine, dividing a projection plane with a length L and a width W into grids with m+1, (n+1) grid points, and Q i,j ＝(x i ,y j ) I=0, 1,2, …, m, j=0, 1,2, …, n; abscissa x of grid point i The range of the values of (1) is 0L/m, 2L/m, …, iL/m, …, L and y j The range of the values is 0, W/n,2W/n, …, jW/n, … and W;
(1.2) designating the kth block subgrid region to occupy m k *n k Grid of 0<m k <m，0<n k <n, moving the position of each sub-grid area in a dragging mode to enable the sub-grid area to beSpreading the whole projection plane, wherein each two adjacent sub-grid areas comprise a superposition area, namely reaching a designated position; the overlapping areas among the sub-grid areas are areas needing fusion projection; storing all grid point coordinates in all sub-grid areas and at the edges;
(1.3) arranging a plurality of projectors, wherein the projection areas of the projectors are in one-to-one correspondence with the sub-grid areas, the projection area corresponding to each projector is a sub-projection area, the sub-grid area is a part of the whole projection plane on the content, the sub-projection area is a part of the whole projection plane on the physical area, and the position of each sub-projection area in the whole projection plane is recorded as P1 and stored.
3. The method of multiple projector planar fusion projection correction based on phantom engine according to claim 1, wherein the step S2 is specifically implemented by the following sub-steps:
(2.1) manufacturing a calibration project by using an illusion engine, opening the calibration project, and projecting a calibration interface to a corresponding sub-projection area by using projectors, wherein each projector projects a self calibration interface;
initializing all calibration interfaces, determining the grid proportion used by each calibration interface, namely the grid proportion in each sub-grid area, generating grids covering the whole sub-projection area by each calibration interface according to the corresponding proportion, and generating movable points to be calibrated at the vertexes of each grid;
(2.3) manually clicking and dragging the point to be marked by using the left mouse button, so that the position of the point to be marked is greatly moved, then selecting the point to be marked by using the right mouse button, and finely adjusting the position of the point to be marked by using the direction key of the keyboard; the points to be calibrated of the overlapping areas among the sub-projection areas need to be completely overlapped, and grid blocks of the non-overlapping areas are adjusted to be uniformly distributed after the overlapping areas are calibrated;
and (2.4) after the positions of the calibration points are all adjusted, obtaining the calibration point of each sub-grid area, and outputting and storing the position P2 of the calibration point of the sub-grid area of each projector in the calibration interface.
4. The method for correcting the multi-projector planar fusion projection based on the illusion engine according to claim 1, wherein the step S3 is specifically: and P2 takes the calibration interface as a reference system, P1 takes the whole projection plane as a reference system, an offset vector of each sub-grid region reference system compared with the whole projection plane reference system is calculated according to P1 during calculation and transformation, and the offset vector is added to the P2 position to obtain the absolute position P3 of the calibration point.
5. The method for correcting the multi-projector flat fusion projection based on the illusion engine according to claim 1, wherein in the step S4, the PFM file is generated by the following steps:
(4.1) the PFM format generator reads in a file storing P1 and P3 information, divides each grid into two triangles at the upper right corner and the lower left corner according to diagonal lines, takes the two triangles as a basic unit T of affine transformation, and generates T3 according to P3 at a position corresponding to the T1 generated by P1 to obtain an affine matrix consisting of T1 and T3; calculating affine matrix for each pair of triangles, for one m 1 *n 1 Will result in 2*m for the sub-grid region of (c) 1 *n 1 A plurality of affine transformation matrixes A;
(4.2) calculating a transformation of the PFM file: in MPCDI protocol, the PFM format is defined as each pixel position P within the raster o (x o ,y o ) Corresponding projection content position P f (x p ,y p )，P o And affine transformation matrix A, P f The relationship of (2) is as follows:
P f ＝P o A
and (3) unfolding:
and obtaining information stored correspondingly for each point in the raster stored in the PFM, and generating the PFM file.
6. The method for correcting the multi-projector flat fusion projection based on the illusion engine according to claim 1, wherein in the step S4, the Alpha file is specifically generated by:
reading a file storing P1 and P3 information by an Alpha generator, wherein the Alpha value is an integer in the range of 0-255 and represents a brightness value; for the whole projection plane, the brightness of the non-projection area is adjusted to 0, and the projection effect is that part of the area is black; for the projection area, the brightness of the non-overlapping area is set to 255, and for the left sub-grid area, the right sub-grid area, the upper sub-grid area and the lower sub-grid area which form the overlapping area, a fusion strategy is used for adjusting the brightness, wherein the fusion strategy is specifically as follows:
for a horizontal overlapping region, assuming that the abscissa range of the horizontal overlapping region is [ a, b ], c is a point in the region, and normalizing the coordinate of the point c to obtain x:
x＝(c-a)/(b-a)
wherein x is more than or equal to 0 and less than or equal to 1;
for the left sub-grid region of the overlapping region, the brightness of the overlapping portion is calculated by adopting any one of the following four fusion algorithms:
linear fusion algorithm:
f(x)＝x
exponential fusion algorithm:
wherein, alpha is a variable parameter, and the fusion effect is adjusted by adjusting the alpha value;
square root fusion algorithm:
cosine fusion algorithm:
for the right sub-grid region of the overlapping region, the brightness of the overlapping portion is 1 (x);
for the overlapping area in the vertical direction, replacing the abscissa of the calculation process with the corresponding ordinate, replacing the left sub-grid area of the overlapping area with the upper sub-grid area of the overlapping area, and replacing the right sub-grid area of the overlapping area with the lower sub-grid area of the overlapping area, so as to finish the brightness calculation of the overlapping area in the vertical direction; and after the brightness calculation of the overlapping area in the horizontal direction and the vertical direction is completed, generating an Alpha file.
7. A multiple projector planar fusion projection correction system based on a illusive engine, which adopts the multiple projector planar fusion projection correction method based on the illusive engine as claimed in any one of claims 1 to 6, and is characterized by comprising: the system comprises a switch, a projection system host, a projection system slave, a projector and a projection plane;
the switch is an Ethernet switch and is used for realizing network communication between the projection system host and all the projection system slaves; the projection system host is responsible for opening projection items and corresponding plug-ins of the illusion engine, sending projection information to each projection system slave and calibrating sub-projection areas of the corresponding projector; the projection system slave machine is responsible for calibrating the sub-projection area of the corresponding projector and starting the receiving end of the illusion engine projection plug-in unit to project; the projector is connected with the corresponding projection system host and the corresponding projection system slave and displays projection content; the projection plane is the plane of projection display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310498868.8A CN116634112A (en) | 2023-05-06 | 2023-05-06 | Multi-projector plane fusion projection correction method and system based on illusion engine |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310498868.8A CN116634112A (en) | 2023-05-06 | 2023-05-06 | Multi-projector plane fusion projection correction method and system based on illusion engine |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116634112A true CN116634112A (en) | 2023-08-22 |
Family
ID=87590406
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310498868.8A Pending CN116634112A (en) | 2023-05-06 | 2023-05-06 | Multi-projector plane fusion projection correction method and system based on illusion engine |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116634112A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117424993A (en) * | 2023-12-15 | 2024-01-19 | 深圳市影冠科技有限公司 | Curved surface projection picture self-correction method and system |
-
2023
- 2023-05-06 CN CN202310498868.8A patent/CN116634112A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117424993A (en) * | 2023-12-15 | 2024-01-19 | 深圳市影冠科技有限公司 | Curved surface projection picture self-correction method and system |
| CN117424993B (en) * | 2023-12-15 | 2024-02-27 | 深圳市影冠科技有限公司 | Curved surface projection picture self-correction method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11269244B2 (en) | System and method for calibrating a display system using manual and semi-manual techniques | |
| US10701324B2 (en) | Gestural control of visual projectors | |
| Siegl et al. | Real-time pixel luminance optimization for dynamic multi-projection mapping | |
| WO2017179272A1 (en) | Information processing device, information processing method, and program | |
| Harville et al. | Practical methods for geometric and photometric correction of tiled projector | |
| US20150325044A1 (en) | Systems and methods for three-dimensional model texturing | |
| US11625861B2 (en) | Point cloud colorization system with real-time 3D visualization | |
| US9215455B2 (en) | System and method of calibrating a display system free of variation in system input resolution | |
| CN116634112A (en) | Multi-projector plane fusion projection correction method and system based on illusion engine | |
| JP6679966B2 (en) | Three-dimensional virtual space presentation system, three-dimensional virtual space presentation method and program | |
| WO2015016798A2 (en) | A system for an augmented reality application | |
| JP2001291116A (en) | Device and method for generating three-dimensional image and program providing medium | |
| WO2022141886A1 (en) | Home decoration material adjustment method and apparatus, and computer device and storage medium | |
| Park et al. | Projector compensation framework using differentiable rendering | |
| WO2024034437A1 (en) | Simulation device, simulation method, and computer program | |
| JP2005004201A (en) | Method and system for projecting image onto display surface | |
| Waldner et al. | Multi projector displays using a 3d compositing window manager | |
| Lee | Wand: 360∘ video projection mapping using a 360∘ camera | |
| JP2002312810A (en) | Device and method for generating composite moving image | |
| KR101389843B1 (en) | Method for displaying an image using multi-beam projector | |
| CN117252974A (en) | Mapping method and device for three-dimensional image, electronic equipment and storage medium | |
| Klose et al. | Automatic multi-projector calibration | |
| Shulgin et al. | Multiprojector image distortion correction scheme for curved screens on the example of the Cybersphere | |
| Teubl et al. | Analysis of a scalable multi-projector system for virtual reality environments | |
| Peikert et al. | Stereoscopic surround displays using interference filters |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |