CN104777700A - Multi-projector optimized deployment method realizing high-immersion projection - Google Patents

Multi-projector optimized deployment method realizing high-immersion projection Download PDF

Info

Publication number
CN104777700A
CN104777700A CN201510150531.3A CN201510150531A CN104777700A CN 104777700 A CN104777700 A CN 104777700A CN 201510150531 A CN201510150531 A CN 201510150531A CN 104777700 A CN104777700 A CN 104777700A
Authority
CN
China
Prior art keywords
projector
resolution
pose
projection
evaluation function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510150531.3A
Other languages
Chinese (zh)
Other versions
CN104777700B (en
Inventor
翁冬冬
李冬
赵璐
周立经
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Technology BIT
Original Assignee
Beijing Institute of Technology BIT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Technology BIT filed Critical Beijing Institute of Technology BIT
Priority to CN201510150531.3A priority Critical patent/CN104777700B/en
Publication of CN104777700A publication Critical patent/CN104777700A/en
Application granted granted Critical
Publication of CN104777700B publication Critical patent/CN104777700B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0012Optical design, e.g. procedures, algorithms, optimisation routines

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Projection Apparatus (AREA)

Abstract

The invention provides a multi-projector optimized deployment method realizing high-immersion projection. The method comprises specific steps as follows: step one, an initial pose of each projector is set, and a screen projection area is designated for each projector; step two, corresponding influence factors of each projector are calculated and comprise the projection resolution, the resolution difference and the projection distance difference; step three, a projection evaluation function is calculated according to the influence factors solved in the step two; step four, the pose of each projector is updated, the step two and the step three are repeated, the corresponding projection evaluation function of each pose is calculated, and the pose corresponding to the minimum projection evaluation function is determined as the pose of the projector. According to the method, the factors such as the projector resolution, the resolution difference rate, the projection distance difference and the like influencing the actual projection effect are taken as evaluation standards to build the evaluation function, the projector pose corresponding to the minimum evaluation function is selected as the optimized pose, the optimized deployment of the projectors is realized, and the optimal projection effect is achieved.

Description

Height immerses projection multi-projector Optimization deployment method
Technical field
The present invention relates to and a kind of highly immerse projection multi-projector Optimization deployment method, be applicable to height and immerse the technical fields such as display, digital to analog simulation, virtual reality.
Background technology
Due to the optical imaging apparatus that projector is not desirable, its actual drop shadow effect is subject to the impact of self performance and deployed position.Current projection correction's software mostly can only carry out splicing and merge under the condition of known projection machine riding position, and best projection machine riding position can only lean on the experience of operator to determine substantially, this is high to the requirement of operator, can not ensure can obtain optimal deployment scheme at every turn.
The relation of the resolution of document " Fast high-resolution appearance editing using superimposed projections. " ACM Transactions on Graphics (TOG) 31.2 (2012): 13. pairs of projectors, light efficiency itself and putting position is inquired into, but projector has been treated as perfect optics device by it, thus do not consider defocus blur that actual projector exists, Pixel Dimensions increase with distance and the factors such as increase to the infringement of projection quality.
Summary of the invention
In view of this, the object of the invention is optimum position in order to obtain multi-projector and towards, to obtain optimal display result, propose a kind ofly highly to immerse projection multi-projector Optimization deployment method.
Realize technical scheme of the present invention as follows:
One is high immerses projector's Optimization deployment method, and detailed process is:
Step one, set initial pose for Mei Tai projector, and be that it specifies screen prjection region;
Step 2, for each projector, calculate the influence factor of its correspondence, it is poor that described influence factor comprises projected resolution, differences in resolution and projector distance;
Step 3, the influence factor solved according to step 2, calculate projection evaluation function;
The pose of step 4, renewal Mei Tai projector, repeats step 2 and three, calculates the projection evaluation function corresponding to each pose, the pose of the minimum correspondence of projection evaluation function is defined as the pose of projector.
Projected resolution of the present invention watches point resolution by the best and absolute resolution forms;
Best viewing point resolution: selected best viewing point, if the volume coordinate of i-th projector's jth sampled point in territory, screen footprint is X ij, X ijcorresponding point in projector are x ij, x ijthere are four neighborhood point x ij1=x ij+ [-1 ,-1] t, x ij2=x ij+ [1 ,-1] t, x ij3=x ij+ [1,1] t, x ij4=x ij+ [-1,1] t, four field points correspond to four points on screen and are respectively X a, X b, X c, X d, in best viewing location place video camera photographs to X a, X b, X c, X dimage coordinate be x a, x b, x c, x d, will by x a, x b, x c, x d4 quadrilateral surface product representations surrounded are S abcd, the resolution A (x of best viewing point is calculated according to formula (3) i, X i);
A ( x i , X i ) = 1 N i Σ j = 1 N i A ( x i , X ij ) - - - ( 2 )
A ( x i , X ij ) = 1 2 S abcd
Wherein, N irepresent i-th total number of sample points be projected in territory, screen footprint;
Described absolute resolution: calculate absolute resolution B (x according to formula (5) i, X i);
B ( x i , X i ) = 1 N i Σ j = 1 N i B ( x i , X ij ) - - - ( 5 )
B ( x i , X ij ) = 1 2 S ABCD
Wherein, S aBCD=S aBC+ S aCD, S aBCrepresent by X a, X b, X cthe triangle area of 3 compositions, S aCDrepresent by X a, X c, X dthe triangle area of 3 compositions.
The present invention is according to formula (6) calculating resolution difference C (x i, X i),
C ( x i , X i ) = 1 N i Σ j = 1 N i C ( x i , X ij ) = 1 N i Σ j = 1 N i max ( B ( x i , X ij ) ) min ( B ( x i , X ij ) ) - - - ( 6 )
The present invention calculates projector distance difference D (x according to formula (7) i, X i),
D(x i,X i)=max(dist(x i,X i))-min(dist(x i,X i)) (7)
Wherein, dist (x i, X i) represent all sampled point X ito the distance of i-th projector's photocentre, X i = [ X i 1 , X i 2 , . . . X iN i ] .
Projection evaluation function of the present invention is:
f(x,X)=a 1A(x,X)+a 2B(x,X)+a 3C(x,X)+a 4D(x,X) (8)
Wherein, a=[a 1, a 2, a 3, a 4] be weight coefficient.
Beneficial effect
The present invention utilizes the factor such as projector's resolution, differences in resolution rate, projector distance difference affecting actual drop shadow effect to build evaluation function as evaluation criterion, choose evaluation function minimum time corresponding projector's pose be optimum pose, realize the Optimization deployment of projector, to obtain best projection effect.
Accompanying drawing explanation
Fig. 1 is the high process flow diagram immersing projector's Optimization deployment method of the present invention.
Tu2Shi projector pose initialization schematic diagram.
Fig. 3 is the calculating schematic diagram of projected resolution.
Fig. 4 is the schematic diagram of differences in resolution.
Fig. 5 is the schematic diagram of projector distance difference.
Fig. 6 is the projector's position view before 3 projectors optimize and after optimizing.
Embodiment
Below in conjunction with accompanying drawing and instantiation, the present invention is described in detail.
The present invention to project demand according to reality, propose the evaluation index judging drop shadow effect, under known projection machine quantity and projection screen face type condition, according to the Mei Tai projector overlay area of user's setting, utilize projector's resolution of the actual drop shadow effect of impact, differences in resolution rate, the factors such as projector distance difference are as evaluation criterion, under the condition of specifying view field of each projector, calculate the pose (position and towards) obtaining and make each projector that overall projected resolution is the highest and screen, to obtain optimal display result, also for the on-the-spot actual placement projector of user provides useful reference.
The present invention is high immerses projector's Optimization deployment method, and detailed process is:
As shown in Figure 1, (one), projector's pose initialization, for Mei Tai projector sets initial pose, and arrange the screen prjection region (namely no matter how projector moves, and it must cover the screen area of specifying) of specifying for it.As shown in Figure 2, for lenticular screen, when distributing appointment view field for Mei Tai projector, only several points of uniform sampling (figure hollow core circle) in appointment screen area, using this sampled point as the representative of screen area, in follow-up optimization, meet projector cover all sampled points.
(2), contemplated by the invention and utilize projected resolution, differences in resolution rate, projector distance to differ from three kinds because usually building drop shadow effect's evaluation function, therefore need in this step for each projector, calculate the projected resolution of its correspondence, differences in resolution and projector distance poor.
(1) projected resolution
Resolution has two kinds of definition modes, a kind of definition is best viewing point resolution, it is equivalent to place a measurement video camera in best viewing location, and the projector pixel number size arrived using this cameras view is as the resolution of optical projection system, and it is seen point location with the best and chooses difference and change; Another kind of definition is absolute resolution, and it carrys out descriptive system resolution with the projector pixel number comprised in projection screen unit area, and after projection screen and projector's deployment are determined, this resolution is also determined thereupon.
Best viewing point resolution: as shown in Figure 3, X ijrepresent the volume coordinate of i-th projector jth sampled point in territory, screen footprint, X ijat the Pixel Dimensions A (x of best viewing location i, X i) according to following formulae discovery, wherein x i=[r xi, r yi, r zi, t xi, t yi, t zi] t, represent the rotation [r of i-th projector xi, r yi, r zi] parameter and translation [t xi, t yi, t zi] parameter.
A ( x i , X ij ) = 1 2 S abcd - - - ( 1 )
A ( x i , X i ) = 1 N i Σ j = 1 N i A ( x i , X ij ) - - - ( 2 )
Wherein, X ijcorresponding point in projector are x ij, x ijthere are four neighborhood point x ij1=x ij+ [-1 ,-1] t, x ij2=x ij+ [1 ,-1] t, x ij3=x ij+ [1,1] t, x ij4=x ij+ [-1,1] t, four field points correspond to four points on screen and are respectively X a, X b, X c, X d, in best viewing location place video camera photographs to X a, X b, X c, X dimage coordinate be x a, x b, x c, x d, the quadrilateral area S that they surround abcdrepresent, then i-th projector corresponds to X ijthe best viewing location sampled point Pixel Dimensions at some place can represent with formula (3).
A ( x i , X i ) = 1 N i Σ j = 1 N i A ( x i , X ij ) - - - ( 3 )
Wherein, N irepresent i-th projector's sampled point number in territory, screen footprint.
Absolute resolution: the present invention uses absolute pixel size to describe absolute resolution, as shown in Figure 2, uses X a, X b, X c, X d4 calculate x ijthe absolute pixel chi at place.Because screen profile is on-plane surface, therefore X a, X b, X c, X d4 can not ensure coplanar, but because their are apart from very near, therefore can use S aBCD=S aBC+ S aCDcarry out 4, this space of approximate treatment quadrilateral space area surrounded.Now, the average absolute resolution B (x of i-th projector i, X i) available following formula description.
B ( x i , X ij ) = 1 2 S ABCD - - - ( 4 )
B ( x i , X i ) = 1 N i Σ j = 1 N i B ( x i , X ij ) - - - ( 5 )
(2) differences in resolution
As shown in Figure 4, in deployment on the left of it, the difference of same projector pixel size is large, and the deployment difference on right side is little, difference between this same projector interior pixels is called differences in resolution, the differences in resolution of i-th projector can use formula (6) to define, and its Zhi Yue little Ze drop shadow effect is better.
C ( x i , X i ) = 1 N i Σ j = 1 N i C ( x i , X ij ) = 1 N i Σ j = 1 N i max ( B ( x i , X ij ) ) min ( B ( x i , X ij ) ) - - - ( 6 )
(3) projector distance is poor
In actual use, there is a blur-free imaging plane in projector, far away apart from this plane, projected image will be fuzzyyer, therefore projector's deployment scheme should consider the impact of this factor on drop shadow effect, make projector overlay area as far as possible consistent to the distance of projector's photocentre, as shown in Figure 5, wherein the projector distance difference on right side is less than left side.The projector distance available formula of difference (7) definition of i-th projector, its value less then projected image sharpness is higher.Dist (x in formula i, X i) represent all sampled point X ito the distance of i-th projector's photocentre.
D(x i,X i)=max(dist(x i,X i))-min(dist(x i,X i)) (7)
(3) project evaluation function
Comprehensive above three kinds of influence factors, weighted sum thus new drop shadow effect evaluation function f (x, X) of structure one, as shown in formula (8).Wherein a=[a 1, a 2, a 3, a 4] be weight coefficient.X=[x 1; x 2; x m], represent the location parameter of all M projector.X=[X 1; X 2; X m], represent the sample point coordinate that each projector is corresponding.
f(x,X)=a 1A(x,X)+a 2B(x,X)+a 3C(x,X)+a 4D(x,X) (8)
(4), projector's pose optimization
Build optimization problem
min f(x,X)
It is separated x and is required optimum projector pose.
Namely upgrade the pose of Mei Tai projector, repeat step 2 and three, calculate the projection evaluation function corresponding to each pose, minimum for projection evaluation function corresponding pose is defined as the pose of projector.
Fig. 6 illustrates the projector position after optimizing front and optimization for 3 projectors, with the value optimizing the optimization object function that rear formula (8) represents before table 1 illustrates and optimizes.
Table 1 different initial value projector disposition optimization result
In sum, these are only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (5)

1. highly immerse projector's Optimization deployment method, it is characterized in that, detailed process is:
Step one, set initial pose for Mei Tai projector, and be that it specifies screen prjection region;
Step 2, for each projector, calculate the influence factor of its correspondence, it is poor that described influence factor comprises projected resolution, differences in resolution and projector distance;
Step 3, the influence factor solved according to step 2, calculate projection evaluation function;
The pose of step 4, renewal Mei Tai projector, repeats step 2 and three, calculates the projection evaluation function corresponding to each pose, the pose of the minimum correspondence of projection evaluation function is defined as the pose of projector.
2. highly according to claim 1 immerse projector's Optimization deployment method, it is characterized in that, described projected resolution watches point resolution by the best and absolute resolution forms;
Best viewing point resolution: selected best viewing point, if the volume coordinate of i-th projector's jth sampled point in territory, screen footprint is X ij, X ijcorresponding point in projector are x ij, x ijthere are four neighborhood point x ij1=x ij+ [-1 ,-1] t, x ij2=x ij+ [1 ,-1] t, x ij3=x ij+ [1,1] t, x ij4=x ij+ [-1,1] t, four field points correspond to four points on screen and are respectively X a, X b, X c, X d, in best viewing location place video camera photographs to X a, X b, X c, X dimage coordinate be x a, x b, x c, x d, will by x a, x b, x c, x d4 quadrilateral surface product representations surrounded are S abcd, the resolution A x of best viewing point is calculated according to formula (3) i, X i;
A ( x i , X i ) = 1 N i Σ j = 1 N i A ( x i , X ij ) - - - ( 2 )
A ( x i , X ij ) = 1 2 S abcd
Wherein, N irepresent i-th total number of sample points be projected in territory, screen footprint;
Described absolute resolution: calculate absolute resolution Bx according to formula (5) i, X i;
B ( x i , X i ) = 1 N i Σ j = 1 N i B ( x i , X ij ) - - - ( 5 )
B ( x i , X ij ) = 1 2 S ABCD
Wherein, S aBCD=S aBC+ S aCD, S aBCrepresent by X a, X b, X cthe triangle area of 3 compositions, S aCDrepresent by X a, X c, X dthe triangle area of 3 compositions.
3. highly according to claim 2 immerse projector's Optimization deployment method, it is characterized in that, according to formula (6) calculating resolution difference Cx i, X i,
C ( x i , X i ) = 1 N i Σ j = 1 N i C ( x i , X ij ) = 1 N i Σ j = 1 N i max ( B ( x i , X ij ) ) min ( B ( x i , X ij ) ) - - - ( 6 )
4. according to Claims 2 or 3, height immerses projector's Optimization deployment method, it is characterized in that, calculates projector distance difference D (x according to formula (7) i, X i),
D(x i,X i)=max(dist(x i,X i))-min(dist(x i,X i)) (7)
Wherein, dist (x i, X i) represent all sampled point X ito the distance of i-th projector's photocentre, X i=[X i1, X i2... X iNi].
5. highly according to claim 4 immerse projector's Optimization deployment method, it is characterized in that, described projection evaluation function is:
f(x,X)=a 1A(x,X)+a 2B(x,X)+a 3C(x,X)+a 4D(x,X) (8)
Wherein, a=[a 1, a 2, a 3, a 4] be weight coefficient.
CN201510150531.3A 2015-04-01 2015-04-01 Height immerses projection multi-projector Optimization deployment method Active CN104777700B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510150531.3A CN104777700B (en) 2015-04-01 2015-04-01 Height immerses projection multi-projector Optimization deployment method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510150531.3A CN104777700B (en) 2015-04-01 2015-04-01 Height immerses projection multi-projector Optimization deployment method

Publications (2)

Publication Number Publication Date
CN104777700A true CN104777700A (en) 2015-07-15
CN104777700B CN104777700B (en) 2016-08-24

Family

ID=53619251

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510150531.3A Active CN104777700B (en) 2015-04-01 2015-04-01 Height immerses projection multi-projector Optimization deployment method

Country Status (1)

Country Link
CN (1) CN104777700B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107452036A (en) * 2017-07-06 2017-12-08 北京理工大学 A kind of optical tracker pose computational methods of global optimum
CN108965855A (en) * 2018-07-12 2018-12-07 深圳超多维科技有限公司 A kind of stereoprojection method, apparatus, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101916175A (en) * 2010-08-20 2010-12-15 浙江大学 Intelligent projecting method capable of adapting to projection surface automatically
US20120327080A1 (en) * 2011-06-27 2012-12-27 Toshiba Medical Systems Corporation Image processing system, terminal device, and image processing method
CN103914874A (en) * 2014-04-08 2014-07-09 中山大学 Compact SFM three-dimensional reconstruction method without feature extraction
CN104036475A (en) * 2013-07-22 2014-09-10 成都智慧星球科技有限公司 High-robustness geometric correction method adapted to random projector group and projection screen
CN104093013A (en) * 2014-06-25 2014-10-08 中国科学院遥感与数字地球研究所 Method for automatically regulating image parallax in stereoscopic vision three-dimensional visualization system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101916175A (en) * 2010-08-20 2010-12-15 浙江大学 Intelligent projecting method capable of adapting to projection surface automatically
US20120327080A1 (en) * 2011-06-27 2012-12-27 Toshiba Medical Systems Corporation Image processing system, terminal device, and image processing method
CN104036475A (en) * 2013-07-22 2014-09-10 成都智慧星球科技有限公司 High-robustness geometric correction method adapted to random projector group and projection screen
CN103914874A (en) * 2014-04-08 2014-07-09 中山大学 Compact SFM three-dimensional reconstruction method without feature extraction
CN104093013A (en) * 2014-06-25 2014-10-08 中国科学院遥感与数字地球研究所 Method for automatically regulating image parallax in stereoscopic vision three-dimensional visualization system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李文龙: ""基于2D/3D数据融合的位姿测量方法研究"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107452036A (en) * 2017-07-06 2017-12-08 北京理工大学 A kind of optical tracker pose computational methods of global optimum
CN107452036B (en) * 2017-07-06 2019-11-29 北京理工大学 A kind of optical tracker pose calculation method of global optimum
CN108965855A (en) * 2018-07-12 2018-12-07 深圳超多维科技有限公司 A kind of stereoprojection method, apparatus, equipment and storage medium

Also Published As

Publication number Publication date
CN104777700B (en) 2016-08-24

Similar Documents

Publication Publication Date Title
US11269244B2 (en) System and method for calibrating a display system using manual and semi-manual techniques
EP3163535B1 (en) Wide-area image acquisition method and device
US10460459B2 (en) Stitching frames into a panoramic frame
CN104954769B (en) A kind of immersion ultra high-definition processing system for video and method
CN102053812B (en) Multi-projector combined display feedback brightness correction method
CN102801952B (en) Method and device for adjusting video conference system
CN105308503A (en) System and method for calibrating a display system using a short throw camera
CN102231099B (en) Method for correcting per-pixel response brightness in multi-projector auto-stereoscopic display
CN102055991B (en) Conversion method and conversion device for converting two-dimensional image into three-dimensional image
KR101941801B1 (en) Image processing method and device for led display screen
CN105898138A (en) Panoramic video play method and device
CN112118435B (en) Multi-projection fusion method and system for special-shaped metal screen
KR101515368B1 (en) Method for clustering projectors, management apparatus and system using the same
JP2015097350A (en) Image processing apparatus and multi-projection system
CN109361912A (en) Multilayer camera apparatus for 3 D visual image capture
CN106296789A (en) A kind of it is virtually implanted method and the terminal that object shuttles back and forth in outdoor scene
CN103702096A (en) Optimizing method, device and system for image fusion treatment
Ainsworth et al. Acquisition of stereo panoramas for display in VR environments
US9479747B2 (en) Guide image generation device and method using parameters
CN104952048B (en) A kind of focus storehouse picture synthesis method based on as volume reconstruction
CN104836953B (en) Multi-projector screen characteristics point automatic camera and denoising recognition methods
CN104869375B (en) Three-dimensional smooth surface color corrected system and method in a kind of image edge-blending
CN104777700A (en) Multi-projector optimized deployment method realizing high-immersion projection
CN105245784A (en) Shooting processing method and shooting processing device for projection region in multimedia classroom
CN111045286A (en) Projection method and system based on double-folding screen field and double-folding screen field

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant