CN104516482A - Shadowless projection system and method - Google Patents

Shadowless projection system and method Download PDF

Info

Publication number
CN104516482A
CN104516482A CN201310445246.5A CN201310445246A CN104516482A CN 104516482 A CN104516482 A CN 104516482A CN 201310445246 A CN201310445246 A CN 201310445246A CN 104516482 A CN104516482 A CN 104516482A
Authority
CN
China
Prior art keywords
projector
view field
picture
projected picture
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310445246.5A
Other languages
Chinese (zh)
Inventor
田学文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING TIANSHENGSHIJI TECHNOLOGY DEVELOPMENT Co Ltd
Original Assignee
BEIJING TIANSHENGSHIJI TECHNOLOGY DEVELOPMENT Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING TIANSHENGSHIJI TECHNOLOGY DEVELOPMENT Co Ltd filed Critical BEIJING TIANSHENGSHIJI TECHNOLOGY DEVELOPMENT Co Ltd
Priority to CN201310445246.5A priority Critical patent/CN104516482A/en
Publication of CN104516482A publication Critical patent/CN104516482A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof
    • H04N9/3147Multi-projection systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

The invention provides a shadowless projection system. The shadowless projection system comprises a camera, a computing device and a plurality of projectors; projecting areas pointed by the plurality of projectors are overlapped; the camera is used for capturing images displayed by the projectors; the computing device is used for extracting the projecting area of each projector and the overlapped projecting area of each projector according to the image shot by the camera; the overlapped projecting area of each projector is treated as the projecting area of the fusion projection image to be output; the mapping relations between the projecting areas of the fusion projection images to be output and the projecting area of each projector are respectively created; the fusion projection images to be output are received; then the image to be output by each projector can be obtained according to the mapping relations between the projecting areas of the fusion projection images to be output and the projecting area of each projector and then is output to the corresponding projector. The invention also provides a corresponding shadowless projection method. With the adoption of the system and method, the shadow can be inhibited, and thus the brightness of the projecting images can be increased.

Description

A kind of without shadow optical projection system and method
Technical field
The present invention relates to technical field of computer vision, specifically, the present invention relates to a kind of without shadow optical projection system and method.
Background technology
Current market exists a class ceiling mounting type interactive projection system.Ceiling mounting type interactive projection system comprises: projector, video camera, body sense equipment and computing machine.Computing machine is responsible for the deformation parameter controlling the display of projector, computing solves view field, the function such as data acquisition, body sense device data acquisition controlling video camera; Projector is responsible for the display of computer picture; Video camera is responsible for catching picture shown by projector; Body sense equipment is responsible for catching body sense interaction data.Be different from Rear projection, ceiling mounting type interaction often needs personnel to stand among projected picture, will produce shadow like this, causes part picture to be blocked.
Therefore, current in the urgent need to a kind of solution that can prevent shadow from producing in the application of ceiling mounting type interaction.
Summary of the invention
The object of this invention is to provide a kind of solution that can suppress shadow in the application of ceiling mounting type interaction.
For achieving the above object, the invention provides a kind of without shadow projecting method, comprise the following steps:
1) project to same target area with multiple stage projector;
2) take described target area with video camera, extract view field separately of each projector, and the region that the view field of each projector overlaps mutually;
3) mapping relations merging the view field of projected picture and the view field of each projector, as the view field of the fusion projected picture that will export, are set up respectively in the region of the view field of each projector being overlapped mutually;
4) receive the fusion projected picture that will export, for Mei Tai projector, based on the mapping relations merging the view field of projected picture and the view field of this projector, obtain the required picture exported of this projector;
5) Ge Tai projector exports respective picture respectively, obtains merging projected picture.
Wherein, in described step 1), there is in the projected picture of Mei Tai projector the specific gauge point forming grid;
Described step 2) in, utilize the gauge point of described formation grid to extract view field separately of each projector, and the region that the view field of each projector overlaps mutually;
In described step 3), utilize the gauge point of described formation grid, set up the mapping relations merging the view field of projected picture and the view field of each projector respectively.
Wherein, the distance between adjacent described projector is 30 ~ 40cm.
Wherein, described step 3) also comprises: the gauge point of the formation grid on the projected picture of being caught by video camera and picture, draw the mapping relations R in overlapping region and bounding box region, try to achieve the control information of the projected picture in bounding box region simultaneously, and then according to the mapping relations R in overlapping region and bounding box region, the control information of the projected picture in bounding box region is converted to the control information of projected picture of overlapping region;
Described step 4) also comprises: the control information utilizing the projected picture of overlapping region, corrects the projected picture of the picture exported needed for Mei Tai projector.
Wherein, described projector adopts ceiling mounting type projector.
Compared with prior art, the present invention has following technique effect:
1, the generation of shadow can be suppressed in interaction application.
2, the brightness of projected picture can be increased.
Accompanying drawing explanation
Fig. 1 shows the process flow diagram of the projecting method of one embodiment of the invention;
Fig. 2 shows the schematic diagram of the view field of one embodiment of the invention Zhong Liangtai projector;
Fig. 3 shows the actual effect of the projection of one embodiment of the invention;
Fig. 4 shows the schematic diagram of the view field of one embodiment of the invention Zhong Liangtai projector.
Embodiment
Below in conjunction with drawings and Examples the present invention done and describe further.
According to one embodiment of present invention, provide a kind of based on ceiling mounting type interactive projection system without shadow projecting method.Ceiling mounting type interactive projection system comprises multiple stage projector, video camera, body sense equipment and computing machine, and wherein video camera is responsible for catching picture shown by projector.
Fig. 1 shows the process flow diagram without shadow projecting method of this embodiment, and this comprises the following steps: without shadow projecting method
Step 101: multiple stage projector projects from different perspectives simultaneously, and region pointed by Ge Tai projector is roughly overlapping.Wherein, there is in the projected picture of Mei Tai projector the specific gauge point forming grid.These gauge points forming grid will be used for carrying out geometry correction to projected picture.In the present embodiment, the distance of adjacent Liang Ge projector remains between 30 ~ 40cm, and projected picture resolution is 1024 × 768, and projector hanger height is 3.5m ~ 4m.This projector arrangement, multiple stage projector adopts tight type distribution on the one hand, ensure that and obtains comparatively big bus view field, on the other hand, the heat radiation of projector can be made unaffected.
Step 102: with video camera photographic subjects region, extract view field separately of each projector, and the region that the view field of each projector overlaps mutually (being hereinafter called for short overlapping region).Fig. 2 show with Liang Tai projector carry out without shadow projection example.Wherein region A is the view field of A projector, and region B is the view field of B projector, and region C is the region that the view field of Liang Tai projector overlaps mutually.In this step, the coverage D of video camera shooting should contain the view field of all projectors, as shown in Figure 2.
Step 103: using the view field of overlapping region as the fusion projected picture that will export, sets up the mapping relations merging the view field of projected picture and the view field of each projector respectively.For Fig. 2, region C is exactly the view field of merging projected picture, the namely region of the output projected picture of whole optical projection system, set up the mapping relations merging the view field of projected picture and the view field of each projector, be exactly the output picture setting up picture and A projector in the C of region respectively, the mapping relations of the output picture of picture and B projector in the C of region.
Step 104: for Mei Tai projector, according to the mapping relations of the view field of overlapping region and this projector, calculates the required picture exported of this projector.For Fig. 2, the picture that whole optical projection system will be play is known, according to the output picture mapping relations of picture and A projector in the C of region, what can draw A projector needs to export what picture, such as, only use the pixel corresponding to region C to export the picture that will play in A projector, the pixel of remaining fringe region all exports the background colour with floor solid colour.In like manner, also only use the pixel corresponding to region C to export the picture that will play in B projector, the pixel of remaining fringe region all exports the background colour with floor solid colour.
In a preferred embodiment, step 104 also corrects the picture carrying out each projector.Under many circumstances, there is certain distortion in projected picture, now needs to compensate this distortion.In current distributed projection scheme, there are the control information computing method of multiple maturation.But current distributed projection scheme majority is that the picture splicing of multiple stage projector is become a large picture, the control information calculated is actually the control information in the bounding box region of multiple projected picture.Bounding box region is the minimum region with given shape comprising all projected pictures, and described given shape is generally rectangle, but also can select other shape.In the preferred embodiment shown, the picture of being caught by video camera and picture are formed the gauge point of grid, draw the mapping relations R in overlapping region and bounding box region.Utilize existing ripe algorithm (such as majumder algorithm, can with reference to Aditi Majumder, Rick Stevens, Perceptual Photometric Seamlessness in Projection-Based Tiled Displays, ACM Transactionson Graphics, Vol.24, No.1, January2005.) try to achieve the control information matrix M 1 of the projected picture in bounding box region, control information matrix M 1 is the control information matrix of the distortion compensating bounding box region projection picture.After obtaining control information matrix M 1, according to the mapping relations R in overlapping region and bounding box region, the control information of the projected picture in bounding box region is converted to the control information matrix M 2 of the projected picture of overlapping region, wherein M2=M1*R, this makes it possible to utilize the distortion of the projected picture of control information matrix M 2 pairs of overlapping regions to compensate.In specific implementation, can utilize control information matrix M 2 that original texture coordinate information is converted to new texture coordinate information, and then draw the required picture exported of Mei Tai projector, thus ensure that the Pixel Information of overlapping region is consistent.Further, the light energy of each projector of overlapping region can also be made smoothly to decay superposition.Level and smooth decay superposition allows the color saturation of overlapping region carry out the smoothing processing between 0 to 1 according to overlapping situation, to ensure that total saturation degree of each pixel of overlapping region is for 1, thus reaches perfect splicing effect.
Step 105: Ge Tai projector synchronism output picture separately, obtains merging projected picture at overlapping region.
In the present embodiment, merging projected picture (i.e. the picture of region C) is merged by the projection from different directions of multiple stage projector to form, and can desalinate shade (as shown in Figure 3) significantly.In addition, because merging projected picture is that multiple projected picture is superimposed, so the present embodiment has a significant picture brightening effect.At present, engineering projector lumen number is generally lower than 10000lm, higher to environmental requirement, under dark situation, only just can see even the image content that projector launches clearly, and the present embodiment can significantly improve the brightness of projected picture, reduce the environmental requirement that optical projection system uses.
Although above-described embodiment is described for Liang Tai projector, one of ordinary skill in the art will readily recognize that the present invention can use more projector.Fig. 4 just shows the example that three projectors carry out projecting without shadow.
Although above-described embodiment is described for ceiling mounting type interactive projection system, those skilled in the art's easy understand projecting method of the present invention also may be used for having multiple stage projector and other optical projection system for the video camera of taking view field.
Finally it should be noted that, above embodiment is only in order to describe technical scheme of the present invention instead of to limit this technical method, the present invention can extend in application other amendment, change, application and embodiment, and therefore think that all such amendments, change, application, embodiment are all in spirit of the present invention and teachings.

Claims (10)

1. without a shadow optical projection system, comprise video camera, computing equipment and multiple stage projector, the view field that described multiple stage projector points to is roughly overlapping, and described video camera is used for catching picture shown by projector;
Described computing equipment is used for extracting view field separately of each projector according to the picture of video camera shooting, and the region that the view field of each projector overlaps mutually; The mapping relations merging the view field of projected picture and the view field of each projector, as the view field of the fusion projected picture that will export, are set up respectively in the region of the view field of each projector being overlapped mutually; Receive the fusion projected picture that will export, for Mei Tai projector, based on the mapping relations merging the view field of projected picture and the view field of this projector, obtain the picture of the required output of this projector and output it to corresponding projector.
2. according to claim 1ly it is characterized in that without shadow projecting method, the distance between adjacent described projector is 30 ~ 40cm.
3. according to claim 1ly it is characterized in that without shadow projecting method, described projector is ceiling mounting type projector.
4. based on according to claim 1 without shadow optical projection system without a shadow projecting method, comprise the following steps:
1) project with multiple stage projector, the view field that described multiple stage projector points to is roughly overlapping simultaneously;
2) catch the view field of described multiple stage projector with video camera, extract view field separately of each projector, and the region that the view field of each projector overlaps mutually;
3) mapping relations merging the view field of projected picture and the view field of each projector, as the view field of the fusion projected picture that will export, are set up respectively in the region of the view field of each projector being overlapped mutually;
4) receive the fusion projected picture that will export, for Mei Tai projector, based on the mapping relations merging the view field of projected picture and the view field of this projector, obtain the required picture exported of this projector;
5) Ge Tai projector exports respective picture respectively, obtains merging projected picture.
5., in described step 1), there is in the projected picture of Mei Tai projector the specific gauge point forming grid is according to claim 4ly it is characterized in that without shadow projecting method;
Described step 2) in, utilize the gauge point of described formation grid to extract view field separately of each projector, and the region that the view field of each projector overlaps mutually;
In described step 3), utilize the gauge point of described formation grid, set up the mapping relations merging the view field of projected picture and the view field of each projector respectively.
6. according to claim 4ly it is characterized in that without shadow projecting method, described step 4) also comprises: the gauge point of the formation grid on the projected picture of being caught by video camera and picture is corrected the fusion projected picture that will export.
7. according to claim 6 without shadow projecting method, it is characterized in that, described step 4) also comprises: the gauge point of the formation grid on the projected picture of being caught by video camera and picture tries to achieve the control information of the projected picture in the bounding box region of each projector, then the control information of the projected picture in bounding box region is converted to the control information of the projected picture of overlapping region, the control information of the projected picture of recycling overlapping region corrects the fusion projected picture that will export.
8. according to claim 7 without shadow projecting method, it is characterized in that, described step 4) also comprises: the gauge point of the formation grid on the projected picture of being caught by video camera and picture, draw the mapping relations R in overlapping region and bounding box region, and then according to the mapping relations R in overlapping region and bounding box region, the control information of the projected picture in bounding box region is converted to the control information of projected picture of overlapping region.
9. according to claim 8 without shadow projecting method, it is characterized in that, the control information of the projected picture of described overlapping region is control information matrix M 2, utilize control information matrix M 2 that the original texture coordinate information of the fusion projected picture that will export is converted to new texture coordinate information, again based on the mapping relations merging the view field of projected picture and the view field of Mei Tai projector, obtain the required picture exported of Mei Tai projector.
10. according to claim 9ly to it is characterized in that without shadow projecting method, in described step 4), the light energy of each projector of overlapping region is smoothly decayed superposition.
CN201310445246.5A 2013-09-26 2013-09-26 Shadowless projection system and method Pending CN104516482A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310445246.5A CN104516482A (en) 2013-09-26 2013-09-26 Shadowless projection system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310445246.5A CN104516482A (en) 2013-09-26 2013-09-26 Shadowless projection system and method

Publications (1)

Publication Number Publication Date
CN104516482A true CN104516482A (en) 2015-04-15

Family

ID=52791934

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310445246.5A Pending CN104516482A (en) 2013-09-26 2013-09-26 Shadowless projection system and method

Country Status (1)

Country Link
CN (1) CN104516482A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105357506A (en) * 2015-12-15 2016-02-24 招商局重庆交通科研设计院有限公司 Building landscape image information interaction method and system
CN106791741A (en) * 2016-12-07 2017-05-31 重庆杰夫与友文化创意有限公司 Multi-screen marching method and device
CN108076332A (en) * 2016-11-11 2018-05-25 美国克里斯蒂数字系统公司 The system and method for digital black level mixing
WO2018196472A1 (en) * 2017-04-24 2018-11-01 中兴通讯股份有限公司 Projection method, apparatus and system, and storage medium
CN108828879A (en) * 2018-06-20 2018-11-16 苏州佳世达电通有限公司 The superposition optical projection system and method for brightness enhancing
CN111083457A (en) * 2019-12-27 2020-04-28 成都极米科技股份有限公司 Method and device for correcting projection images of multiple light machines and projection instrument of multiple light machines

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6219099B1 (en) * 1998-09-23 2001-04-17 Honeywell International Inc. Method and apparatus for calibrating a display using an array of cameras
CN1922544A (en) * 2004-02-19 2007-02-28 创新科技有限公司 Method and apparatus for providing a combined image
US20070132863A1 (en) * 2005-12-14 2007-06-14 Sony Corporation Image taking apparatus, image processing method, and image processing program
CN101556758A (en) * 2009-04-23 2009-10-14 杭州镭星科技有限公司 Method for realizing displaying of high dynamic luminance range images by a plurality of projecting cameras

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6219099B1 (en) * 1998-09-23 2001-04-17 Honeywell International Inc. Method and apparatus for calibrating a display using an array of cameras
CN1922544A (en) * 2004-02-19 2007-02-28 创新科技有限公司 Method and apparatus for providing a combined image
US20070132863A1 (en) * 2005-12-14 2007-06-14 Sony Corporation Image taking apparatus, image processing method, and image processing program
CN101556758A (en) * 2009-04-23 2009-10-14 杭州镭星科技有限公司 Method for realizing displaying of high dynamic luminance range images by a plurality of projecting cameras

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105357506A (en) * 2015-12-15 2016-02-24 招商局重庆交通科研设计院有限公司 Building landscape image information interaction method and system
CN108076332A (en) * 2016-11-11 2018-05-25 美国克里斯蒂数字系统公司 The system and method for digital black level mixing
CN108076332B (en) * 2016-11-11 2020-06-30 美国克里斯蒂数字系统公司 System and method for digital black level blending
CN106791741A (en) * 2016-12-07 2017-05-31 重庆杰夫与友文化创意有限公司 Multi-screen marching method and device
WO2018196472A1 (en) * 2017-04-24 2018-11-01 中兴通讯股份有限公司 Projection method, apparatus and system, and storage medium
CN108828879A (en) * 2018-06-20 2018-11-16 苏州佳世达电通有限公司 The superposition optical projection system and method for brightness enhancing
CN111083457A (en) * 2019-12-27 2020-04-28 成都极米科技股份有限公司 Method and device for correcting projection images of multiple light machines and projection instrument of multiple light machines

Similar Documents

Publication Publication Date Title
CN104516482A (en) Shadowless projection system and method
CN103037189B (en) A kind of method realizing multiple projections overall output large-size screen monitors frame video image
EP3163535B1 (en) Wide-area image acquisition method and device
CN107678722A (en) Multi-screen splices method, apparatus and multi-projection system giant-screen
JP2009124685A (en) Method and system for combining videos for display in real-time
CN105376540A (en) Projection display system and correction method of projection area
CN106534817B (en) Curved surface projection automatic geometric correction method based on image recognition
KR20150050450A (en) Method and apparatus for generating depth map of a scene
CN102809880B (en) System and method for superimposing multiple projectors on basis of spherical display
JP6513234B2 (en) Image processing method and apparatus used for LED display
US11488348B1 (en) Computing virtual screen imagery based on a stage environment, camera position, and/or camera settings
JP2013247601A (en) Image projection device and image processing method
CN101727880A (en) Projection fusion method of true seamless rear projection large screen display image
US20120113238A1 (en) Drawn image sharing apparatus, drawn image sharing system, and drawn image sharing method
JP6423650B2 (en) Projector clustering method, management apparatus and management system using the same
CN101888511A (en) Projection integration method for large screen display device
CN104539921A (en) Illumination compensation method based on multi-projector system
CN107358577A (en) A kind of quick joining method of cubic panorama
CN201919121U (en) Projection system for mosaicking of multiple projected images
CN114697623A (en) Projection surface selection and projection image correction method and device, projector and medium
US9479747B2 (en) Guide image generation device and method using parameters
CN208506731U (en) Image display systems
US20100321408A1 (en) Viewpoint Compensation for Curved Display Surfaces in Projector-Based Display Systems
CN104539922A (en) Processing method and device for projection fusion dark field
CN202841396U (en) Digital film optimization device and digital film projection system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150415

WD01 Invention patent application deemed withdrawn after publication