WO2013084559A1 - Système et procédé de projection - Google Patents

Système et procédé de projection Download PDF

Info

Publication number
WO2013084559A1
WO2013084559A1 PCT/JP2012/073458 JP2012073458W WO2013084559A1 WO 2013084559 A1 WO2013084559 A1 WO 2013084559A1 JP 2012073458 W JP2012073458 W JP 2012073458W WO 2013084559 A1 WO2013084559 A1 WO 2013084559A1
Authority
WO
WIPO (PCT)
Prior art keywords
image content
image
projector
screen
onto
Prior art date
Application number
PCT/JP2012/073458
Other languages
English (en)
Japanese (ja)
Inventor
哲也 秋葉
Original Assignee
Akiba Tetsuya
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Akiba Tetsuya filed Critical Akiba Tetsuya
Publication of WO2013084559A1 publication Critical patent/WO2013084559A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3185—Geometric adjustment, e.g. keystone or convergence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback

Definitions

  • the present invention relates to a projection system and method, and more particularly to a projection for projecting and displaying video and image content on a deformed three-dimensional (three-dimensional) screen such as a three-dimensional object such as a building, furniture, or a car.
  • the present invention relates to a system and method.
  • Projection mapping is known as a technique for projecting and displaying content such as images from a projector using a three-dimensional object such as a building as a screen. This is to realize various visual effects using the optical illusion.
  • the present inventor has proposed a video display method described in Patent Document 1.
  • the color or pattern of the display unit is made substantially the same as the surrounding color or pattern of the display unit, and a predetermined image is displayed on the display unit and an image in which the end of the image area is not conspicuous is displayed.
  • a projection system that matches the coordinate system defined in the measurement space with the coordinate system defined in the image space by the position measurement sensor by comparing the measured value of the reference point position with the position of the reference point in the image space.
  • a calibration device is disclosed. This eliminates the need for calibration using a calibration gauge of a three-dimensional position measurement sensor, which has been conventionally used, and makes it possible to project an image with no shift or distortion on a screen object.
  • Patent Document 3 discloses an apparatus for projecting an image onto a three-dimensional object, from one or a plurality of sets of a camera and a projector, and an image of the object photographed by the camera by projecting light from the projector onto the object.
  • Measuring means for measuring the three-dimensional shape of the object generating means for generating instruction data representing work instructions based on the measured shape data, and controlling the projector to project an image corresponding to the generated instruction data onto the object
  • a work support system including a control means.
  • Patent Documents 2 and 3 measure the shape and position of an object on which an image is projected, and then correct and correct the inclination and position of the image based on the measured three-dimensional data.
  • the image or video is corrected according to the distortion of the object that becomes the screen and projected onto the object. Therefore, the above prior art requires a large amount of calculation processing for correcting the tilt and position of the image based on the three-dimensional data of the object to be the screen. Furthermore, the more complicated the shape of the object that becomes the screen is, the more time is required for calculation for correcting the projected image, and the load increases. Furthermore, every time the projection position of the projector changes, calculation for three-dimensional correction must be performed, and the degree of freedom of installation of the projector is reduced.
  • the present invention is to realize a projection system and method that are inexpensive and do not require enormous calculation for correcting a projected image using three-dimensional data of a stereoscopic screen, which is conventionally required.
  • the present invention also provides a projection system capable of producing content as two-dimensional data including the shape and distortion of a stereoscopic screen and projecting the same onto a stereoscopic screen at the production stage of the image and video content to be projected onto the stereoscopic screen. And to implement the method.
  • Another object of the present invention is to easily correct the content of two-dimensional data images and video projected on a stereoscopic screen.
  • the projection system according to the present invention is preferably a projection system that projects image or video content (referred to as image content) onto an object to be a screen using a projector, and projects the image content onto the object to be a screen. And one or more of the image content projected on the object and arranged at one or a plurality of places (referred to as different places) different from the place where the projector is placed.
  • One or more cameras for obtaining a plurality of partial image contents referred to as partial image contents
  • Storage means for storing the acquired one or more partial image contents;
  • the projection system preferably includes a processing device that executes a program, and a projector that projects image or video content (referred to as image content) processed by the processing device onto an object serving as a screen.
  • the processing apparatus executes a computer graphics program to project an image content onto a virtual object serving as a screen, a virtual projector disposed at a certain place, a place where the virtual projector is disposed, Is one or a plurality of partial image contents (partial image contents) of the image content projected on the object using one or a plurality of virtual cameras arranged in one or a plurality of different places (referred to as different places) And so on)
  • Storage means for storing the generated one or more partial image contents;
  • the processing device performs a process of correcting distortion and misalignment of the partial image content, and generates a plurality of corrected partial image contents.
  • One or a plurality of the projectors are configured as the projection system that projects the corrected partial image content onto the screen.
  • the storage means is configured as the projection system which is a portable storage medium.
  • the projection method of the present invention is preferably a projection method for projecting an image or video content (referred to as image content) onto a screen using a projector.
  • One or a plurality of partial image contents of the image content projected on the object by a camera arranged in one or a plurality of places (referred to as different places) different from the place where the projector is arranged Obtaining a partial image content) Storing the acquired one or more partial image contents in a storage means;
  • the projection method is configured to project one or a plurality of the partial image contents stored in the storage unit onto the object using one or a plurality of projectors arranged in the one or a plurality of other places.
  • the projection method of the present invention preferably includes a processing device that executes a program, and a projector that projects image or video content (referred to as image content) processed by the processing device onto an object serving as a screen.
  • a projection method in which By executing a computer graphics program in the processing device, a virtual projector arranged at a certain location that projects image content onto a virtual object serving as a screen, and a location where the virtual projector is arranged One or a plurality of partial image contents (referred to as partial image contents) of the image content projected on the object by using one or a plurality of virtual cameras arranged in different one or a plurality of places (referred to as different places) ) Storing the generated one or more partial image contents in storage means; Projecting the one or more partial image contents stored in the storage means onto the object using one or more projectors located at the one or more other locations. Configured as a method.
  • the projection method of the present invention is preferably a projection method for projecting an image or video content (referred to as image content) onto a screen using a projector. Projecting image content onto a target object to be a screen by a third projector; A partial image content of the image content (first image) projected from the third projector onto the screen by a first camera located at a location different from the third projector relative to the screen.
  • the first partial image content and the second partial image content after correction are processed by performing processing for correcting distortion and misalignment of the first partial image content and the second partial image content.
  • the first projector and the second projector are configured as the projection method for projecting the corrected first partial image content and the corrected second partial image content onto the screen.
  • the projection method of the present invention preferably includes a processing device that executes a program, and a projector that projects image or video content (referred to as image content) processed by the processing device onto an object serving as a screen.
  • a method of projecting image content in By executing the program on the processing device, Projecting first image content with defined plane coordinates onto the object from a projector located at a location; Calculating a difference indicating a coordinate shift amount by comparing at least the distorted coordinates of the second image content acquired from the projected object with the coordinates of the original image content; Applying the calculated difference to the target coordinates of the first image content, changing the original coordinates in the reverse direction according to the difference, the third image content with the corrected coordinates is obtained.
  • a first image content having a planar shape with a defined coordinate on a plane is projected onto the object from a projector disposed at a certain location,
  • the projection method is configured to calculate the difference with respect to all the coordinates of the grid image content.
  • the projector is configured as the projection method for projecting the sixth image content onto the object.
  • a difference indicating a shift amount of coordinates is calculated by comparing at least the distortion-generated coordinates of the second image content acquired from the projected object with the coordinates of the original image content, and the first
  • the original coordinates are changed in the reverse direction according to the difference to obtain the third image content with corrected coordinates
  • the projection method is configured to store the obtained third image content in the storage means.
  • the present invention in order to make the projected image conform to the shape and distortion of the stereoscopic screen, which is necessary in the past, a huge calculation for correcting the projected image using the three-dimensional data of the stereoscopic screen becomes unnecessary. It is possible to greatly reduce the load of Further, in the process of producing the content of the image or video to be projected, the content can be produced as two-dimensional data including the shape and distortion of the stereoscopic screen and projected onto the stereoscopic screen. In addition, it is possible to easily correct the image and video content of the two-dimensional data projected on the stereoscopic screen.
  • FIG. 10 is a diagram illustrating a state of image error correction in the second embodiment.
  • FIG. 10 is a diagram illustrating a three-dimensional screen according to the second embodiment.
  • FIG. 10 is a diagram illustrating a state of image error correction in the second embodiment.
  • FIG. 10 is a diagram illustrating a change in a grid image projected on a stereoscopic screen according to the second embodiment.
  • FIG. 10 is a diagram illustrating a change in a grid image projected on a stereoscopic screen according to the second embodiment.
  • FIG. 10 is a diagram illustrating a state of image position correction in the second embodiment.
  • FIG. 10 is a diagram illustrating a state of an image after correction in the second embodiment.
  • FIG. 10 is a diagram illustrating a state of error correction of a decomposed image in the second embodiment.
  • FIG. 1 shows the overall configuration of the projection system.
  • This projection system is a system for projecting and displaying image and video content (hereinafter simply referred to as an image) on a three-dimensional object (hereinafter referred to as a stereoscopic screen) 9 serving as a screen from the projection control apparatus 1.
  • the projection control apparatus 1 includes a plurality (three in the figure) of cameras 61, 62, and 63 (generally indicated as 6) that acquire an image projected on the stereoscopic screen 9, and a plurality (for example, indicated as 6) that projects an image onto the stereoscopic screen 9.
  • Three projectors 71, 72, 73 (generally indicated as 7) are connected.
  • each camera and each projector are mechanically integrated.
  • the camera 61 is configured to be mounted on the projector 71.
  • the projection control apparatus 1 includes a processor (CPU) 11, a memory 12, a storage unit 13 such as a hard disk, an input unit 14, a display unit 15, a camera control unit 16 that controls the camera 6, and a projection that controls the projector 7.
  • a machine control unit 17 is provided.
  • the CPU 11 executes an application program and performs a process for projecting data of a plurality of divided images acquired from the camera 6 by the projector 7.
  • the memory 12 stores a program such as an application program and temporarily stores various data being processed.
  • the storage unit 13 stores data such as an image prepared for projection, an image acquired from the camera 6, and a corrected image.
  • the input device 14 is a keyboard, a mouse, a scanner, or the like, and inputs original image or original video content data by an operation of the operator. Further, an input operation is performed by an operator when the projection units 201 to 203 are arranged, an image is acquired, or is projected.
  • the display unit 15 displays an image input from the input unit 14 or an image acquired by the camera 6. Further, when producing an image to be properly (finally) projected, a necessary image at an intermediate stage is displayed.
  • the camera control unit 16 controls the plurality of cameras 6 and acquires image data.
  • the projector control unit 17 controls the plurality of projectors 7 to project an image on the three-dimensional screen 9.
  • FIG. 2 shows the positional relationship between the projector and the stereoscopic screen in this embodiment.
  • A shows a plan view
  • B shows a side view.
  • a unit in which the camera 61 and the projector 71, the camera 62 and the projector 72, and the camera 63 and the projector 73 are integrally configured will be referred to as projection units 201 to 203, respectively.
  • Three projection units 201 to 203 are arranged as shown in FIG. That is, the projection unit 202 is arranged at the center, the projection unit 201 is arranged on the left side, and the projection unit 203 is arranged on the right side with respect to the cubic three-dimensional screen 9 (see FIG. 3).
  • an original image (for example, the original image shown in FIG. 4) prepared and stored in advance in the storage unit 13 is projected onto the stereoscopic screen 9 by the projector 72 of the projection unit 202 and arranged on both sides.
  • the images projected on the stereoscopic screen 9 are read and acquired by the cameras 61 and 63 of the projection units 201 and 203.
  • the images acquired by the cameras 61 and 63 are a split image 1 and a split image 2 that are divided into two left and right, and these are files 1 and 2. It is stored in the storage unit 13.
  • the obtained decomposed image files 1 and 2 (sometimes simply referred to as divided files) are associated with the original image and stored, for example, in the same folder.
  • the image file acquired by the embodiment of the present invention is a two-dimensional image taken by a camera (for example, two cameras 61 and 63). Therefore, as compared with the projection of a three-dimensional image in the prior art, an image calculation process taking a stereoscopic screen into consideration is unnecessary, and the load on the CPU for that purpose can be reduced. In addition, the memory capacity for storing images can be reduced.
  • FIG. 6 shows an example of the projection system and the acquired file displayed on the display screen of the display unit 15.
  • the arrangement of the projection units 201 to 203 on the stereoscopic screen 9 (upper part of FIG. 6), and the file 1 and file 2 obtained by the two cameras 61 and 63 are disassembled.
  • An image (bottom of FIG. 6) is displayed on the display screen.
  • a plan view of the projection venue is acquired in advance and stored in the storage unit 13, and further on the plane of the projection unit arranged in the plan view.
  • the CPU 11 displays the input position with respect to the entire venue by the processing of the simulation program.
  • the operator can change the position where the projection unit is arranged while checking the arrangement of the projection unit and the images of the divided files 1 and 2 that can be acquired correspondingly displayed on the display screen.
  • acquisition of the decomposed image that is, production of an image projected by the projectors 71 and 73 is performed.
  • the operator operates the input unit 14 to input an image file specification to be projected and an image projection instruction.
  • the CPU 13 reads out the designated image file from the storage unit 13 and transfers it to the projector 72 of the projection unit 202.
  • the files 1 and 2 of the decomposed images 1 and 2 acquired by the cameras 61 and 63 under the control of the camera control unit 16 are temporarily stored in the storage unit 13.
  • the decomposed image files 1 and 2 are read from the storage unit 13 by the processing of the CPU 11, and the projectors 71 and 73 of the projection units 201 and 203 are controlled by the projector control unit 17.
  • Projectors 71 and 73 arranged on the left and right of the stereoscopic screen 9 project the received decomposed image files 1 and 2 from the left and right, respectively, to form an image on the stereoscopic screen 9 (composite image of the decomposed image). Can do.
  • a decomposed image is acquired using the cameras 61 and 63 of the two right and left projection units 201 and 203 arranged with respect to the stereoscopic screen, and the produced image is then transferred to the projector 71,
  • the projection is started from 73, the number and arrangement positions of the projection units can be variously changed.
  • the number of projectors that project the original image is not limited to one, and a plurality of projectors may be installed.
  • the number of projection units including a camera that acquires a decomposed image from an original image and a projector that projects the decomposed image is not limited to two, and three or more projection units can be installed as appropriate.
  • the surface may be uneven.
  • a shadow may be generated in a decomposed image acquired due to the uneven shape.
  • the number of projectors that project the original image is increased to a plurality of units, and a plurality of cameras that acquire the decomposed images are further installed, so that a plurality of decomposed images can be obtained from various directions such as left, right, up, and down. Can be acquired.
  • the content projected on the screen is a still image, but is not limited thereto, and may be a moving image or a video.
  • the cameras 61 and 63 of the two projection units 201 and 203 acquire moving images and videos from the start to the end of shooting.
  • the image finally projected on the screen is not necessarily read directly from the image stored in the storage unit 13 in FIG. 1 and projected from the projector.
  • an image (a plurality of decomposed images) to be finally projected is stored in a storage medium such as a DVD, the storage medium and the projector are transported to a desired location, and the storage medium set on the DVD at the location is used.
  • a projected image may be read out and projected onto a stereoscopic screen by a projector.
  • a plurality of decomposed images are created by using the computer graphics technique without actually using the camera 6 and the projector 7, and using the projection control apparatus 1 or PC (personal computer) in FIG. It can be realized using.
  • a computer graphics program is executed by the CPU 11 or the PC, and a figure imitating the arrangement of the 3D screen 9 and the projection entry units 201 to 203 in the actual projection venue as shown in FIGS. create.
  • These components are called a virtual stereoscopic screen, a virtual camera, and a virtual projector.
  • the original image is projected from the virtual projector 72 ′ onto the virtual stereoscopic screen 9 ′.
  • the decomposed images (FIG. 5) obtained by the two virtual cameras 61 ′ and 63 ′ are appropriately created.
  • the created decomposed image is stored in the storage unit 13.
  • the use of computer graphics technology eliminates the hassle of changing the arrangement of projection units one by one in an actual projection venue.
  • the operator operates the input unit 14 while viewing the layout of the virtual projection unit displayed on the display screen of the display unit 15 and the state of the generated decomposed image, so that the virtual projection unit is displayed on the computer.
  • the resulting decomposed image can be confirmed.
  • the first embodiment has the following advantages. Since the projectors 71 and 73 can project the respective decomposed images at an angle close to the projection target surface of the object to be the screen (that is, from the left and right sides), the deformation of the image is small, A high-quality, high-resolution image becomes a beautiful projected image or video. In addition, the projection resolution can be improved by dividing and acquiring the image to be projected into a plurality of projectors.
  • the installation location of the left and right projection units can be changed with an appropriate degree of freedom. That is, when there are spectator seats, obstacles, etc. at the installation locations of these projection units, the projection units can be installed avoiding them. As a result, the degree of freedom in distance and position with respect to the screen at the time of acquisition and projection of the decomposed image is improved.
  • the projectors 71 and 73 arranged on the left and right are used.
  • the projectors 71 and 73 arranged on the left and right are used.
  • no projector is arranged near the center of the hall, it is difficult for a viewer near the center of the hall to find a projection unit when viewing an image by the audience. Since the image is not projected by a single projector installed in the center as in the past, the problem of the shadow of the audience can be prevented, and this can attract viewers near the center of the venue, increasing the number of mobilization .
  • images and videos are acquired using a plurality of cameras (two left and right surfaces in this example) arranged at a plurality of viewpoints with respect to the screen, the images and videos finally projected on the screen are It can be acquired and handled as two-dimensional image and video data according to various shapes and distortions. Therefore, it is not necessary to adjust the projection image position for each screen, and both images can be adjusted together.
  • the image projection system of the present embodiment since the image and video acquired by the camera are already two-dimensional data including the shape and distortion of the screen, the shape of the screen is changed as in the prior art. Based on the reflected three-dimensional position data, a calculation process for correcting or calibrating the image to be projected becomes unnecessary, and the load on the CPU can be greatly reduced.
  • the decomposed images (files 1 and 2) acquired by the two right and left projection units 201 and 203 can be displayed and confirmed on the display screen as shown in FIG. Therefore, it is possible to image a decomposed image projected from the projection units 201 and 203 later.
  • the object to be projected has a complicated uneven shape
  • the projection units 201 and 203 can be changed as appropriate to try to acquire the decomposed image again, and finally the operator's satisfaction It is possible to obtain a decomposed image that can be obtained.
  • the error correction of the projected image will be described with reference to FIGS.
  • correction of image distortion and displacement when one image (not a decomposed image) is projected onto a stereoscopic screen by a projector will be described.
  • the projection unit shown in FIG. 7 includes one camera 62 and one projector 72, and correction of distortion and displacement of an image (an image to be finally projected) acquired by the camera 62 will be described.
  • the image projected onto the stereoscopic screen 9 by the projector 72 may be projected out of the stereoscopic screen 9 due to the aberration of the lens of the projector. In such a case, it is necessary to correct the distortion and position of each image.
  • the corrected image (B) of distortion and positional deviation is stored in the storage unit 13 as the corrected image file 20 in association with the original image file 10.
  • reference points X ⁇ b> 1 and X ⁇ b> 2 are set at at least two places on the stereoscopic screen 9.
  • the reference points X1 and X2 are preferably located as far as possible.
  • a grid-like image ⁇ projected from the projector 72 onto the stereoscopic screen 9 is stored in the storage unit 13 and prepared. The reason for projecting an eye-shaped image is to make it easier to measure the distortion of the originally projected image.
  • a grid-like image is projected from the same projector 72 onto the stereoscopic screen 9.
  • the first image ⁇ and the original image to be replaced later have the same aspect ratio and the same number of pixels.
  • the image is finally replaced with an image ⁇ to be projected as shown in FIG. This image ⁇ has been subjected to distortion correction.
  • the grid image ⁇ is projected from the projector 72 onto the stereoscopic screen 9.
  • the first image is assumed to have (m ⁇ n) intersections with respect to the two-dimensional coordinates PA (x, y).
  • PA (x 4 , y 2 ) is shown.
  • the first image ⁇ projected on the three-dimensional screen is desired to look like the image [A3] without distortion, which is the same as the original first image, but actually, due to the aberration of the lens of the projector, A2] is distorted and displayed.
  • the area from PA (x 4 , y 2 ) to PA (x 14 , y 7 ) appears to be distorted.
  • the first image projected on the stereoscopic screen is acquired by the camera 62, and all the coordinates (x i , y j ) within the distorted area of the acquired first image are obtained from the original [A2].
  • Each shift amount (difference) is calculated by comparing with the coordinates of the first image. If each coordinate is corrected by reflecting the difference of all the calculated coordinates in the original grid image [A3], the grid image is corrected by moving the difference in the direction opposite to the shift direction. This image is indicated by [image B to be projected].
  • This square image B is a corrected image, and the coordinates in the area appear to be distorted in the opposite direction compared to the original image ⁇ .
  • the square image ⁇ projected on the stereoscopic screen is displayed as an image with corrected distortion (without distortion) ([A2] in (b)). Is done. Each coordinate of the corrected image [A2] matches the coordinate of the original original image [A3].
  • the square image B (see (b) and (c)) obtained by correcting the original image thus obtained is temporarily stored in the storage unit 13 under the control of the CPU 11.
  • the above-described correction processing of the coordinates PA (x, y) of the first eye image is performed by causing the CPU 11 to execute a correction program. That is, the difference of each coordinate is calculated so that all the coordinates of the grid image of [A2] (at least all the coordinates in the area having the distortion of the coordinates) match the coordinates of the grid image of [A3]. . Thereafter, the calculated coordinate difference is reflected in the corresponding coordinate of the original eye image, and each coordinate is corrected so as to move in the opposite direction to the distortion.
  • the corrected first eye image obtained as a result is stored in the storage unit 13.
  • the operator operates the input device 14 to designate an image to be projected on the stereoscopic screen.
  • This image is, for example, [image ⁇ to be projected] shown in FIG. 10B and is stored in the storage unit 13 in advance.
  • the CPU 11 replaces the corrected eye image stored in the storage unit 13 with the projection image ⁇ under the execution of the program, and performs all the processing performed on the square image.
  • the correction of the coordinate difference is performed on all the coordinates of the image ⁇ .
  • the coordinates of the projection image ⁇ are corrected, and a corrected image as shown in (d) is obtained.
  • This corrected image ⁇ is stored in the storage unit 13.
  • the corrected image ⁇ is read from the storage unit 13 by the operation of the input unit 14 by the operator, transferred to the projector 72 via the projector control unit 17, and projected onto the stereoscopic screen 9.
  • the corrected image ⁇ is read from the storage unit 13 by the operation of the input unit 14 by the operator, transferred to the projector 72 via the projector control unit 17, and projected onto the stereoscopic screen 9.
  • the position of the projected image may be shifted due to the arrangement state of the projectors installed in the venue where the image is corrected.
  • correction of the positional deviation will be described.
  • FIGS. 11 to 13 image alignment after distortion correction will be described.
  • the distortion of the projected image is eliminated by the correction processing shown in FIGS. 10A and 10B (FIG. 11A).
  • FIG. 11B the positions of the reference points ⁇ 1 and ⁇ 2 of the image after distortion correction are shifted with respect to the reference points X1 and X2 of the stereoscopic screen. Therefore, in order to correct this displacement, the image ⁇ is projected onto the stereoscopic screen 9, and each reference point is measured from the image acquired by the camera.
  • the following processing is performed so that the position of the reference point ⁇ 1 of the image matches the reference point X1.
  • the reference points of both are matched while the projector is moved automatically or manually.
  • the state of FIG. 11A is displayed on the display screen of the display 15.
  • Other operators can instruct the movement of the projector while checking whether the reference point ⁇ 1 of the image coincides with the reference point X1 of the stereoscopic screen by looking at the display screen.
  • the projected image ⁇ is rotated and enlarged / reduced, and the projector is moved so that the reference point ⁇ 2 matches the reference point X2.
  • an image in which the reference points ⁇ 1 and ⁇ 2 coincide with the reference points X1 and X2 of the stereoscopic screen can be acquired by the camera.
  • the acquired image is stored in the storage unit 13.
  • the corrected image ⁇ stored in the storage unit 12 is used as the original image, or after the image ⁇ is replaced with the original content image, the image is projected from the projector onto the stereoscopic screen.
  • FIG. 12 shows the final projected image.
  • image alignment can be performed by processing of the CPU 11 using the display device 15 and the input device 14. That is, the image of FIG. 11A is displayed on the display screen of the display unit 15, and the operator operates the input unit 14 in this state, and the position of the reference point ⁇ 1 of the image of FIG. Is operated so as to coincide with the reference point X1.
  • the CPU 11 performs a process of matching the position of the reference point ⁇ 1 with the reference point X1.
  • the image ⁇ to be projected is rotated and enlarged / reduced from the reference point ⁇ 1 as a starting point, and processing is performed so that the reference point ⁇ 2 matches the reference point X2.
  • an image in which the reference points ⁇ 1 and ⁇ 2 coincide with the reference points X1 and X2 can be obtained.
  • the obtained image is stored in the storage unit 13. Thereafter, the corrected image ⁇ stored in the storage unit 12 is used as the original image, or after the image ⁇ is replaced with the original content image, the image is projected from the projector onto the stereoscopic screen.
  • the above embodiment is an example of correcting an image when one image is finally projected. Even when the projection image is composed of a plurality of decomposed images as in the first embodiment, the correction is performed in the same manner. Is possible.
  • FIG. 13 is an example of correction of two separated images (A1) and (B1) shown in the first embodiment.
  • the decomposed images acquired by the cameras 61 and 62 in the first embodiment and projected onto the stereoscopic screen 9 by the projectors 71 and 73 are caused by the aberration of the lens of the projector as shown in FIGS. 13A1 and 13B1.
  • the stereoscopic screen 9 may be projected with distortion and displacement.
  • FIGS. 13 (A2) and 13 (B2) the distortion and position of each decomposed image are corrected by the above-described processing. Project onto the screen.
  • an image (composite image) in which distortion and deviation are finally eliminated as shown in (C) can be displayed.
  • the corrected images (A2) and (B2) are stored in the storage unit 13 in association with the original divided image files 1 and 2 as corrected divided image files, respectively. As described above, even in the case of a decomposed image, the distortion and position of each decomposed image can be corrected by the processing with reference to FIGS.
  • the present invention is not limited to the above-described embodiment, and various modifications and applications can be implemented.
  • the grid image after the correction is replaced with the projection image ⁇ .
  • the difference between the coordinates of the projection image ⁇ for which the coordinates are defined from the beginning without using the first-eye image. Can be processed. Then, the projection image ⁇ ′ whose distortion is corrected in consideration of the difference can be projected on the screen.
  • Projection control device 11 Processor (CPU) 12: Memory 13: Storage unit 14: Input device 15: Display device 16: Camera control unit 61, 62, 63: Camera 17: Projector control unit 71, 72, 73: Projector 9: 3D screen

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Processing Or Creating Images (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Projection Apparatus (AREA)

Abstract

L'invention concerne un système et un procédé de projection bon marché qui ne nécessitent pas de calculs extensifs pour corriger une image projetée utilisant des données tridimensionnelles sur un écran tridimensionnel (3D). Un contenu d'image provenant d'un projecteur positionné à un emplacement donné est projeté sur un objet cible servant d'écran. A l'aide de caméras positionnées à un ou plusieurs emplacements (des emplacements séparés) différents de l'emplacement où le projecteur est positionné, sont acquises une ou plusieurs parties d'un contenu d'image (parties de contenu d'image) prises à partir du contenu d'image projeté sur l'objet cible, et la ou les parties de contenu d'image acquises sont sauvegardées dans un moyen de stockage. A l'aide d'un ou plusieurs projecteurs positionnés à des emplacements séparés, la ou les parties de contenu d'image partielles sauvegardées dans le moyen de stockage sont projetées sur un objet cible, permettant ainsi de former un contenu d'image synthétisé à partir des parties de contenu d'image partielles, sur l'objet cible.
PCT/JP2012/073458 2011-12-05 2012-09-13 Système et procédé de projection WO2013084559A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011266233A JP5465708B2 (ja) 2011-12-05 2011-12-05 投影システム及び方法
JP2011-266233 2011-12-05

Publications (1)

Publication Number Publication Date
WO2013084559A1 true WO2013084559A1 (fr) 2013-06-13

Family

ID=48573943

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/073458 WO2013084559A1 (fr) 2011-12-05 2012-09-13 Système et procédé de projection

Country Status (2)

Country Link
JP (1) JP5465708B2 (fr)
WO (1) WO2013084559A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5530022B1 (ja) * 2013-11-07 2014-06-25 株式会社東京ドーム 映像観覧システム及び映像表示方法
WO2015125403A1 (fr) * 2014-02-18 2015-08-27 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Système de projection et circuit intégré à semi-conducteur
CN112601069A (zh) * 2020-12-11 2021-04-02 深圳市创凯智能股份有限公司 三维场景投影设备、方法及可读存储介质
CN115474033A (zh) * 2022-09-19 2022-12-13 卓谨信息科技（常州）有限公司 智能识别用虚拟屏幕的实现方法

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3036602A4 (fr) 2013-08-22 2017-04-12 Hewlett-Packard Development Company, L.P. Système informatique à projection
WO2015145599A1 (fr) * 2014-03-26 2015-10-01 日立マクセル株式会社 Dispositif de vidéoprojection
JP2016144114A (ja) * 2015-02-04 2016-08-08 セイコーエプソン株式会社 プロジェクター、及び、プロジェクターの制御方法
EP3346699B1 (fr) 2015-09-01 2023-02-01 NEC Platforms, Ltd. Dispositif de projection, procédé de projection et programme de projection
JP6643858B2 (ja) * 2015-10-15 2020-02-12 株式会社コア 投影システム、投影方法、およびプログラム
US10771751B2 (en) 2016-02-02 2020-09-08 Panasonic Intellectual Property Management Co., Ltd. Projection image adjustment system and projection image adjustment method
JP6416805B2 (ja) * 2016-02-09 2018-10-31 株式会社ユニバーサルエンターテインメント 遊技機の製造方法
US10274739B2 (en) 2017-07-04 2019-04-30 Panasonic Intellectual Property Management Co., Ltd. Three-dimensional image display apparatus
CN112666703B (zh) * 2021-03-18 2021-06-04 光量信息科技(宁波)有限公司 基于多个激光振镜的空间曲线联合定位投影系统及其方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002176601A (ja) * 2000-12-07 2002-06-21 Sumitomo Heavy Ind Ltd プロジェクタ装置
JP2009216857A (ja) * 2008-03-10 2009-09-24 Seiko Epson Corp プロジェクタ、画像表示システム、及び画像補正方法
JP2011217326A (ja) * 2010-04-02 2011-10-27 Seiko Epson Corp 画像処理装置、プロジェクター、画像処理方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6219099B1 (en) * 1998-09-23 2001-04-17 Honeywell International Inc. Method and apparatus for calibrating a display using an array of cameras
US8870389B2 (en) * 2004-09-15 2014-10-28 Mitsubishi Electric Corporation Image Projection system and image geometric correction device
JP4986864B2 (ja) * 2005-12-22 2012-07-25 パナソニック株式会社 画像投射装置
JP2009206800A (ja) * 2008-02-27 2009-09-10 Seiko Epson Corp 画像処理装置、プロジェクタ、画像処理方法
JP5391564B2 (ja) * 2008-03-27 2014-01-15 富士ゼロックス株式会社 立体投影装置
JP5560771B2 (ja) * 2010-02-26 2014-07-30 セイコーエプソン株式会社 画像補正装置、画像表示システム、画像補正方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002176601A (ja) * 2000-12-07 2002-06-21 Sumitomo Heavy Ind Ltd プロジェクタ装置
JP2009216857A (ja) * 2008-03-10 2009-09-24 Seiko Epson Corp プロジェクタ、画像表示システム、及び画像補正方法
JP2011217326A (ja) * 2010-04-02 2011-10-27 Seiko Epson Corp 画像処理装置、プロジェクター、画像処理方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
NAOKI HASHIMOTO ET AL.: "Non-distorted Image Projection Method for a Multi-Projection Display with a Curved Screen", THE JOURNAL OF THE INSTITUTE OF IMAGE INFORMATION AND TELEVISION ENGINEERS, vol. 58, no. 4, 1 April 2004 (2004-04-01), pages 507 - 513 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5530022B1 (ja) * 2013-11-07 2014-06-25 株式会社東京ドーム 映像観覧システム及び映像表示方法
WO2015125403A1 (fr) * 2014-02-18 2015-08-27 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Système de projection et circuit intégré à semi-conducteur
US9554104B2 (en) 2014-02-18 2017-01-24 Panasonic Intellectual Property Corporation Of America Projection system and semiconductor integrated circuit
CN112601069A (zh) * 2020-12-11 2021-04-02 深圳市创凯智能股份有限公司 三维场景投影设备、方法及可读存储介质
CN112601069B (zh) * 2020-12-11 2022-07-12 深圳市创凯智能股份有限公司 三维场景投影设备、方法及可读存储介质
CN115474033A (zh) * 2022-09-19 2022-12-13 卓谨信息科技（常州）有限公司 智能识别用虚拟屏幕的实现方法

Also Published As

Publication number Publication date
JP2013118596A (ja) 2013-06-13
JP5465708B2 (ja) 2014-04-09

Similar Documents

Publication Publication Date Title
JP5465708B2 (ja) 投影システム及び方法
US11269244B2 (en) System and method for calibrating a display system using manual and semi-manual techniques
JP6377392B2 (ja) 画像投影システムおよび画像投影方法
JP5340952B2 (ja) 三次元投影ディスプレイ
KR20090007793A (ko) 프로젝터 어레이 정렬 방법 및 시스템
KR101793192B1 (ko) 다수의 프로젝터를 이용한 증강현실 구현장치 및 그 방법
JP2013247601A (ja) 画像投影装置および画像処理方法
JP2012142669A (ja) 投写制御装置、投写システム、テストチャート、投写領域判定方法
CN113424103A (zh) 具有自由形式折叠镜的背投模拟器
EP3322181B1 (fr) Procédé et système de correction d'écran
US20150229916A1 (en) Method for automatically correcting a video projection with the aid of inverse telecine
JP2019146155A (ja) 画像処理装置、画像処理方法およびプログラム
JP6561089B2 (ja) 厚み測定装置、および厚み測定プログラム
US20180213196A1 (en) Method of projection mapping
JP2011103534A (ja) 映像表示システム
JP6428694B2 (ja) 投影制御装置、プログラム、及び投影システム
EP4063935A1 (fr) Élément optique diffractif apte à être utilisé pour projeter une ligne oblique, appareil de projection et son procédé de conception
WO2019163449A1 (fr) Appareil de traitement d'image, procédé de traitement d'image et programme
EP3396948B1 (fr) Système et procédé permettant d'aligner des projecteurs empilés
JP2017153006A (ja) 立体像調整装置及び立体像調整方法
KR20180091794A (ko) 투사 맵핑 방법
Lee Wand: 360∘ video projection mapping using a 360∘ camera
JP2005091642A (ja) 複数画面画像表示システム、複数画像表示装置の相対位置調整方法、複数画像表示装置の相対位置調整プログラムおよび複数画像表示装置の相対位置調整プログラムを記録した記録媒体
JP6429414B2 (ja) プロジェクションマッピング方法
TWI621356B (zh) 光雕投影方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12854701

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12854701

Country of ref document: EP

Kind code of ref document: A1