CN104539921A - Illumination compensation method based on multi-projector system - Google Patents
Illumination compensation method based on multi-projector system Download PDFInfo
- Publication number
- CN104539921A CN104539921A CN201410696565.8A CN201410696565A CN104539921A CN 104539921 A CN104539921 A CN 104539921A CN 201410696565 A CN201410696565 A CN 201410696565A CN 104539921 A CN104539921 A CN 104539921A
- Authority
- CN
- China
- Prior art keywords
- projector
- camera
- brightness
- relation
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention provides an illumination compensation method based on multi-projector system. According to the method, a geometrical mapping relation is established by a camera-projector system, a luminance response system of a camera is recovered by a high dynamic range (HDR) method, and a relative brightness response relation of a projector is recovered. Through a projection pattern specially designed and a computing process, color coupling relations of different equipment are computed by the calibrated camera and projector, and energy of different projectors is allocated reasonably according to the included angle of the light of the projector and the projection surface. After acquisition of the parameters, adaptive adjustment is performed on a target image, so that the target image can be guaranteed in a compensation range provided by the system, and the brightness of the system is utilized to the maximum. After calibration, multiple projectors can cooperate so as to compensate the target image.
Description
Technical field
This technology belongs to projection display technique field, is specifically related to a kind of illumination compensation method based on many optical projection systems.
Background technology
Along with the continuous lifting of projector's performance and the development of computer graphic image technology, shadow casting technique is more applied to the fields such as display and demonstration, historical relic recovery, large-scale amusement.Adopt shadow casting technique, large resolution, large-size images that other display equipment can not provide can be built, create the display effect with impact more.Projection surface is generally ideal diffuse reflection surface, has unified reflectivity, and geometry is plane or simple surface.Along with the development of shadow casting technique, various daily surface is also used to projection, and in related application, the light that projector goes out is subject to the impact of surround lighting and projection surface, often causes the deviation of distortion geometrically and color aspect.Cause the factor of misalignment to comprise the reflectivity of projection surface, and crossed reflex, mirror-reflection, the optical effect such as reflect and defocus, the complexity of these factors determines deviation size.The object of illumination compensation is exactly eliminate the deviation of these geometry, color aspect, and system can be projected out close to the picture of target image on ideal surface.
The geometry that the factor such as geometry, reflectivity that color compensating technology based on many optical projection systems effectively can process projection surface is introduced and misalignment.Cause the factor of misalignment to comprise the reflectivity of projection surface, and crossed reflex, mirror-reflection, the optical effect such as reflect and defocus, the complexity of these factors determines deviation size.
Summary of the invention
The invention provides a kind of illumination compensation method based on many optical projection systems, can by analyzing the luminosity response relation of projector and camera, color coupled relation between projector and camera, to the self-adaptative adjustment of target image, then be stored in graphics pipeline by recover color parameter carry out real-Time Compensation.
Technical scheme of the present invention is as follows:
Based on an illumination compensation method for many optical projection systems, comprise the following steps:
Step one, ask for the geometric maps relation between camera and projector pixel according to different application scenarios;
Step 2, ask for the brightness response curve of camera;
Step 3, the camera luminosity response relation obtained according to step 2 solve the luminosity response relation of projector;
Step 4, respectively projection have the redness of certain brightness, green, blue image, corresponding to each input, use camera shooting multiple image, and take a projected image when width is input as black;
The image taken in step 5, the geometric maps relation obtained according to step one and step 4 asks for the coupled relation of different passage between camera from projector;
Step 6, backoff weight according to projector's incident angle projector different from the angle calcu-lation between surface normal;
Step 7, to calculate according to geometry, color coupled relation and the backoff weight in asking in step one, five, six corresponding projector's input value be 0 with 255 time corresponding target image brightness, as target image compensation range, search minimum value and the maximum of target image, be mapped in target compensation scope;
Step 8, by geometric maps relation, brightness response curve and the mutual color coupled relation of projector and camera are stored in three-dimensional rendering streamline in the mode of deflection graph, by real-time the compensating the target image through adjustment of the mode of one dimension or two-dimensional seek.
Wherein in step 2, a certain Color Channel of projector is projected from the image of 0-255 brightness, taken by camera, camera aperture is fixed, each multiple images of shooting under different exposure, ask for corresponding brightness region response in the camera according to geometric maps relation after level and smooth, finally use the Optimization Method of Debevec.
Wherein in step 3, certain passage of projector is exported different luminance picture successively, camera is chosen the suitable time for exposure and is taken this image, level and smooth and obtain after averaged and contrast angle value corresponding to this input, thus draw out the brightness response curve of projector.
Accompanying drawing explanation
Fig. 1 is the workflow diagram of the color correction that the present invention proposes.
Embodiment
A kind of color compensation method based on many optical projection systems comprises following step:
1, the geometric maps relation between camera and projector pixel is asked for according to different application scenarios.
2, the brightness response curve of camera is asked for.Method Recovering highdynamic range radiance maps from photographs [C] the .Proceedings of ACMSIGGRAPH.New York:ACM Press that usual employing Debevec proposes, 1997:369-378.Comprised the uncalibrated image of different brightness by projection, can be optimized this process.Specific practice is: allow a certain Color Channel projection of projector from the image of 0-255 brightness, taken by camera, camera aperture is fixed, each shooting five images under different exposure.Corresponding brightness region response is in the camera asked for according to geometric maps relation after level and smooth.Re-use the Optimization Method of Debevec.
3, use the camera luminosity response relation solved to solve the luminosity response relation of projector.Specific practice is: allow certain passage of projector export different luminance picture successively, camera is chosen the suitable time for exposure and taken this image, level and smooth and obtain after averaged and contrast angle value corresponding to this input.Thus draw out the brightness response curve of projector.
4, projection has the redness of certain brightness respectively, green, blue image.Corresponding to each input, camera is used to take 5 width images.Take a projected image when width is input as black in addition.
5, the coupled relation of different passage between camera and projector is asked for according to geometric maps relation and the demarcation pattern taken in step 4.
6, according to the backoff weight of projector's incident angle projector different from the angle calcu-lation between surface normal;
7, use in 1,5,6 geometry, color coupled relation and backoff weight in asking for calculate corresponding projector's input value be 0 with 255 time corresponding target image brightness, as target image compensation range, search minimum value and the maximum of target image, be mapped in target compensation scope.
8, by geometric maps relation, brightness response curve and the mutual color coupled relation of projector and camera are stored in three-dimensional rendering streamline in the mode of deflection graph, by real-time the compensating the target image through adjustment of the mode of one dimension or two-dimensional seek.
The present invention adopts following method in the specific implementation
(1) geometric correction module: for plane or almost plane, by projection gridiron pattern, acquisition homography matrix or bezier surface are to ask for geometric maps relation; For the curved surface that structure is relatively regular, by surface characteristics point matching bezier surface to ask for geometric maps relation; For the random surface of complex geometry, ask for geometric maps relation by structure light scan.
(2) camera recovers module from projector response curve: by the pattern of the different brightness that projects, projection pattern is taken under different exposure time, calculate different brightness value, relation between exposure value and camera output valve by optimal method, recover the luminosity response relation of each passage of camera.Use the projected image of the calibrated corresponding different input value of camera shooting, calculate the brightness response curve of each passage of projector with this.In order to ensure measurement accuracy, shorten Measuring Time simultaneously, for each Color Channel of Mei Tai projector, projection 16 width image altogether, every width image comprises four brightness, get the region close to projection centre part, ask for region averages after level and smooth to calculate corresponding to the relative brightness changing input value.
(3) the color coupling matrix of camera and projector asks for module: project 4-5 width target image, according to the input value of projector and the output valve of camera, seeks out each in color coupling matrix.
(4) projector's backoff weight computing module: according to the angle between projector's incident ray and projection surface, calculating each projector affects size to object table millet cake, and distributes the backoff weight of Mei Tai projector thus.
(5) target image self-adaptative adjustment and real-Time Compensation module: calculate target compensation scope by geometry, color and the weighted data asked for, target image is mapped in this scope.By geometric maps relation, brightness response curve and the mutual color coupled relation of projector and camera are stored in three-dimensional rendering streamline in the mode of deflection graph, by real-time the compensating target image of mode of one dimension or two-dimensional seek.
Although with reference to preferred embodiment, present invention is described; but the above example does not form the restriction of scope; any amendment in spirit of the present invention and principle, equivalently to replace and improvement etc., all should be included in claims of the present invention.
Claims (3)
1., based on an illumination compensation method for many optical projection systems, it is characterized in that, comprise the following steps:
Step one, ask for the geometric maps relation between camera and projector pixel according to different application scenarios;
Step 2, ask for the brightness response curve of camera;
Step 3, the camera luminosity response relation obtained according to step 2 solve the luminosity response relation of projector;
Step 4, respectively projection have the redness of certain brightness, green, blue image, corresponding to each input, use camera shooting multiple image, and take a projected image when width is input as black;
The image taken in step 5, the geometric maps relation obtained according to step one and step 4 asks for the coupled relation of different passage between camera from projector;
Step 6, backoff weight according to projector's incident angle projector different from the angle calcu-lation between surface normal;
Step 7, to calculate according to geometry, color coupled relation and the backoff weight in asking in step one, five, six corresponding projector's input value be 0 with 255 time corresponding target image brightness, as target image compensation range, search minimum value and the maximum of target image, be mapped in target compensation scope;
Step 8, by geometric maps relation, brightness response curve and the mutual color coupled relation of projector and camera are stored in three-dimensional rendering streamline in the mode of deflection graph, by real-time the compensating the target image through adjustment of the mode of one dimension or two-dimensional seek.
2. a kind of illumination compensation method based on many optical projection systems as claimed in claim 1, it is characterized in that, wherein in step 2, a certain Color Channel of projector is projected from the image of 0-255 brightness, taken by camera, camera aperture is fixed, under different exposure, each multiple images of shooting, ask for corresponding brightness region response in the camera according to geometric maps relation after level and smooth, finally use the Optimization Method of Debevec.
3. a kind of illumination compensation method based on many optical projection systems as claimed in claim 1 or 2, it is characterized in that, wherein in step 3, certain passage of projector is exported different luminance picture successively, camera is chosen the suitable time for exposure and is taken this image, level and smooth and obtain after averaged and contrast angle value corresponding to this input, thus draw out the brightness response curve of projector.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410696565.8A CN104539921B (en) | 2014-11-26 | 2014-11-26 | A kind of illumination compensation method based on many optical projection systems |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410696565.8A CN104539921B (en) | 2014-11-26 | 2014-11-26 | A kind of illumination compensation method based on many optical projection systems |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104539921A true CN104539921A (en) | 2015-04-22 |
| CN104539921B CN104539921B (en) | 2016-09-07 |
Family
ID=52855380
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410696565.8A Active CN104539921B (en) | 2014-11-26 | 2014-11-26 | A kind of illumination compensation method based on many optical projection systems |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104539921B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106504561A (en) * | 2015-09-03 | 2017-03-15 | 罗伯特·博世有限公司 | Method for recognizing the object on parking area |
| CN106504200A (en) * | 2016-09-14 | 2017-03-15 | 上海方奥通信技术有限公司 | The image irradiation compensation method mapped based on hue shift estimation and pointwise tone and system |
| CN107786816A (en) * | 2017-09-14 | 2018-03-09 | 天津大学 | Adaptive projecting method based on exposure compensating |
| CN108827184A (en) * | 2018-04-28 | 2018-11-16 | 南京航空航天大学 | A kind of structure light self-adaptation three-dimensional measurement method based on camera response curve |
| WO2019000119A1 (en) * | 2017-06-26 | 2019-01-03 | 深圳配天智能技术研究院有限公司 | Lighting correction method and apparatus |
| CN109900222A (en) * | 2019-04-18 | 2019-06-18 | 盎锐（上海）信息科技有限公司 | Model acquisition methods and device based on projection grating modeling |
| CN110708526A (en) * | 2019-10-15 | 2020-01-17 | 歌尔股份有限公司 | Illuminance measuring method, measuring device, computer equipment and storage medium |
| CN114040180A (en) * | 2020-08-26 | 2022-02-11 | 苏州中科全象智能科技有限公司 | 3D structured light camera projection brightness control method |
| CN114615478A (en) * | 2022-02-28 | 2022-06-10 | 青岛信芯微电子科技股份有限公司 | Projection picture correction method, projection picture correction system, projection device, and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101136192A (en) * | 2006-08-11 | 2008-03-05 | 奥普提克斯晶硅有限公司 | System and method for automated calibration and correction of display geometry and color |
| CN101860761A (en) * | 2010-04-16 | 2010-10-13 | 浙江大学 | Correction method of color distortion of projected display images |
| CN103200409A (en) * | 2013-04-10 | 2013-07-10 | 苏州展科光电科技有限公司 | Color correction method of multi-projector display system |
-
2014
- 2014-11-26 CN CN201410696565.8A patent/CN104539921B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101136192A (en) * | 2006-08-11 | 2008-03-05 | 奥普提克斯晶硅有限公司 | System and method for automated calibration and correction of display geometry and color |
| CN101860761A (en) * | 2010-04-16 | 2010-10-13 | 浙江大学 | Correction method of color distortion of projected display images |
| CN103200409A (en) * | 2013-04-10 | 2013-07-10 | 苏州展科光电科技有限公司 | Color correction method of multi-projector display system |
Non-Patent Citations (3)
| Title |
|---|
| NAYAR S K, ET AL.: "A projection system with radiometric compensation for screen imperfections", 《 HTTP://WWW.PROCAMS.ORG/PROCAMS2003/PROCAMS-ADVANCE-PROGRAM.HTML》 * |
| 王修晖等: "面向多投影显示墙的画面校正技术", 《软件学报》 * |
| 肖朝等: "多投影显示系统结构光几何校正算法", 《计算机辅助设计与图形学学报》 * |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106504561A (en) * | 2015-09-03 | 2017-03-15 | 罗伯特·博世有限公司 | Method for recognizing the object on parking area |
| CN106504200A (en) * | 2016-09-14 | 2017-03-15 | 上海方奥通信技术有限公司 | The image irradiation compensation method mapped based on hue shift estimation and pointwise tone and system |
| CN106504200B (en) * | 2016-09-14 | 2022-12-09 | 上海方奥通信技术有限公司 | Image illumination compensation method and system based on hue offset estimation and point-by-point hue mapping |
| CN109643444B (en) * | 2017-06-26 | 2022-11-22 | 深圳配天智能技术研究院有限公司 | Polishing correction method and device |
| WO2019000119A1 (en) * | 2017-06-26 | 2019-01-03 | 深圳配天智能技术研究院有限公司 | Lighting correction method and apparatus |
| CN109643444A (en) * | 2017-06-26 | 2019-04-16 | 深圳配天智能技术研究院有限公司 | Polishing bearing calibration and device |
| CN107786816A (en) * | 2017-09-14 | 2018-03-09 | 天津大学 | Adaptive projecting method based on exposure compensating |
| CN108827184B (en) * | 2018-04-28 | 2020-04-28 | 南京航空航天大学 | Structured light self-adaptive three-dimensional measurement method based on camera response curve |
| CN108827184A (en) * | 2018-04-28 | 2018-11-16 | 南京航空航天大学 | A kind of structure light self-adaptation three-dimensional measurement method based on camera response curve |
| CN109900222A (en) * | 2019-04-18 | 2019-06-18 | 盎锐（上海）信息科技有限公司 | Model acquisition methods and device based on projection grating modeling |
| CN109900222B (en) * | 2019-04-18 | 2021-07-02 | 盎锐（上海）信息科技有限公司 | Model obtaining method and device based on projection grating modeling |
| CN110708526A (en) * | 2019-10-15 | 2020-01-17 | 歌尔股份有限公司 | Illuminance measuring method, measuring device, computer equipment and storage medium |
| CN114040180A (en) * | 2020-08-26 | 2022-02-11 | 苏州中科全象智能科技有限公司 | 3D structured light camera projection brightness control method |
| CN114040180B (en) * | 2020-08-26 | 2023-07-25 | 苏州中科全象智能科技有限公司 | Projection brightness control method for 3D structured light camera |
| CN114615478A (en) * | 2022-02-28 | 2022-06-10 | 青岛信芯微电子科技股份有限公司 | Projection picture correction method, projection picture correction system, projection device, and storage medium |
| CN114615478B (en) * | 2022-02-28 | 2023-12-01 | 青岛信芯微电子科技股份有限公司 | Projection screen correction method, projection screen correction system, projection apparatus, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104539921B (en) | 2016-09-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104539921A (en) | Illumination compensation method based on multi-projector system | |
| CN104299218B (en) | Projector calibration method based on lens distortion rule | |
| CN101674443B (en) | Method for correcting colors of projector | |
| Brown et al. | Camera-based calibration techniques for seamless multiprojector displays | |
| CN103200409B (en) | Color correction method of multi-projector display system | |
| WO2017206497A1 (en) | Method of correcting projection image, and ultra-short-throw projection apparatus | |
| CN109978958A (en) | A kind of interactive projection system calibrated error compensation method | |
| CN100385198C (en) | Method for making calibrating plate on flat display screen | |
| CN107610183B (en) | Calibration method of fringe projection phase height conversion mapping model | |
| CA3001430C (en) | Image processing method and device for led display screen | |
| CN110099266A (en) | Projector's frame correction method, device and projector | |
| CN108776980A (en) | A kind of scaling method towards lenticule light-field camera | |
| JP2015060012A (en) | Image processing system, image processing device, image processing method and image processing program as well as display system | |
| CN109978960A (en) | Based on photogrammetric high-precision screen-camera pose scaling method | |
| CN108305294B (en) | Accurate calibration method for camera image curved surface with grid target | |
| CN104486603A (en) | Multi-projection color correcting method based on HDR (high dynamic range) imaging | |
| CN109916304A (en) | Mirror surface/class mirror surface three-dimensional measurement of objects system calibrating method | |
| CN112848281B (en) | Light compensation method for photocuring 3D printer | |
| CN102376292A (en) | Display unit brightness correcting method | |
| CN105051506A (en) | Brightness measurement method, brightness measurement device, and image quality adjustment technology using same | |
| JP2019012090A (en) | Image processing method and image display device | |
| CN114697623A (en) | Projection surface selection and projection image correction method and device, projector and medium | |
| CN104516482A (en) | Shadowless projection system and method | |
| Cao et al. | High-reflectivity surface measurement in structured-light technique by using a transparent screen | |
| CN104869375B (en) | Three-dimensional smooth surface color corrected system and method in a kind of image edge-blending |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |