JP2015154213A - Projector device and projection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To project a projection image by rightly correcting geometrical distortion caused by a projection plane shape correspondingly to various three-dimensional formats.SOLUTION: In the case where an inputted image is a three-dimensional image, a kind of a format of the three-dimensional image is analyzed by an analysis section. A generation section generates a distortion correction parameter for correcting distortion of the projection image caused by the projection plane shape of a projection target for projecting the three-dimensional image thereon and changes the distortion correction parameter into a parameter form corresponding to the analyzed kind of the format. A correction section applies distortion correction processing to the inputted three-dimensional image by using the distortion correction parameter changed to the parameter form corresponding to the projection plane shape and the kind of the format. A projection section then projects the three-dimensional image to which the distortion correction processing has been applied, on the projection plane of the projection target.

Description

  The present invention relates to a projector device and a projection method.

  2. Description of the Related Art Today, a projector apparatus that corrects geometric distortion of a projected image caused by a screen shape (projection surface shape) is known. In such a projector apparatus, in order to correct a moving image without delay (to correct in real time), dedicated hardware (distortion correction IC) for performing distortion correction is required. A distortion correction parameter is set in the distortion correction IC, and a projection image having a distortion opposite to the distortion generated on the screen is generated and projected on the screen. As a result, a normal projection image with corrected distortion can be obtained even on a screen with distortion.

  Also, in HDMI (registered trademark) Version 1.4, various three-dimensional (3D) formats such as a side-by-side method and a top-and-bottom method are defined, and a projector device that projects a 3D image corresponding to each 3D format is also available. Are known. HDMI (registered trademark) is an abbreviation for “High-Definition Multimedia Interface”.

  Patent Document 1 (Japanese Patent Laid-Open No. 2013-172444) discloses an image projection apparatus for correcting geometric distortion of a projection image caused by the shape of the projection surface. In the case of this image projection apparatus, a pattern image is projected and imaged on a screen, and distortion of the screen is detected from the captured image of the pattern image. Then, a projection image in which the geometric distortion is corrected is generated using the detected distortion of the screen, and is projected onto the screen. As a result, a normal projection image with corrected distortion can be obtained even on a screen with distortion.

  However, the conventional 3D projector apparatus has a problem in that when the distortion correction of the image signal of the 3D format such as the side-by-side is performed, the distortion cannot be corrected correctly and a projected image is generated with the distortion generated.

  The present invention has been made in view of the above-described problems, and it is an object of the present invention to provide a projector apparatus and a projection method capable of correctly correcting and projecting geometric distortion caused by the shape of the projection surface in correspondence with various 3D formats. To do.

  In order to solve the above-described problems and achieve the object, the present invention projects an analysis unit that analyzes the type of format of a three-dimensional image and a three-dimensional image when the input image is a three-dimensional image. A generation unit that generates distortion correction parameters for correcting distortion of the projection image caused by the shape of the projection surface of the projection object, and changes the distortion correction parameters to a parameter form corresponding to the type of the analyzed format; A correction unit that performs distortion correction processing on the input three-dimensional image using the distortion correction parameter changed to a parameter form corresponding to the shape and the format type; and a three-dimensional image that has been subjected to distortion correction processing is projected A projection unit that projects onto a projection plane of the object.

  According to the present invention, it is possible to perform projection while correctly correcting geometric distortion caused by the shape of the projection surface in correspondence with various 3D formats.

FIG. 1 is a block diagram of a DLP projector without a distortion correction function. FIG. 2 is a block diagram of the projector apparatus according to the embodiment having a distortion correction function. FIG. 3 is a diagram showing how to display an LR image in the frame sequential method. FIG. 4 is a diagram for explaining an operation when a side-by-side 3D image is input to the projector device according to the embodiment. FIG. 5 is a diagram for explaining the distortion generated in the projection image in accordance with the projection surface shape of the screen. FIG. 6 is a diagram illustrating a state in which the 2D image is subjected to distortion correction processing according to the projection surface shape of the screen, thereby correctly correcting and projecting the geometric distortion caused by the projection surface shape. FIG. 7 is a diagram illustrating a state in which the geometric distortion due to the projection plane shape is not correctly corrected even when the distortion correction process is performed on the 3D image according to the projection plane shape of the screen. FIG. 8 is a diagram showing a state in which the 3D image is subjected to distortion correction processing according to the projection surface shape of the screen and the format type of the 3D image, thereby correctly correcting and projecting the geometric distortion caused by the projection surface shape. is there. FIG. 9 is a flowchart showing a flow of distortion correction processing in the projector apparatus according to the embodiment.

  Hereinafter, as an example, a projector apparatus according to an embodiment to which the present invention is applied will be described in detail. First, FIG. 1 is a block diagram of a DLP projector without a distortion correction function. DLP is an abbreviation for “Digital Light Processing (registered trademark). In FIG. 1, a projector apparatus includes an image input unit 1, a projection processing unit 2, a micromirror element 3, a mirror 4, an optical lens unit 5, a lamp 6, And a color wheel 7.

  The image input unit 1 is connected to an image output device such as a personal computer device or an image player device. As the image player device, for example, an image player device such as a DVD or a Blu-ray Disc (registered trademark) can be used. DVD is an abbreviation for “Digital Versatile Disc”.

  The projection processing unit 2 uses a high-speed time-division drive that multiplies the input signal frame rate (for example, 60 frames / second), the number of color component divisions, and the number of display gradations, to achieve a spatial light modulation element (SOM). For example, the micromirror element 3 is driven to display. The projection processing unit 2 also performs lighting driving of the lamp 6 as a light source and rotation driving of the color wheel 7.

  The lamp 6 emits white light with high brightness. The white light emitted from the lamp 6 is colored in a primary color by time division through the color wheel 7, totally reflected by the mirror 4, and irradiated to the micromirror element 3. Thereby, an optical image is formed with the reflected light irradiated to the micromirror element 3. The formed optical image is projected and displayed on a screen (not shown) to be projected via the optical lens unit 5. The concept of “screen” is a concept that includes all projection target objects such as walls, buildings, smoke, and clouds in addition to a screen dedicated to projection.

  Next, FIG. 2 shows a block diagram of a projector apparatus according to an embodiment having a distortion correction function. The projector apparatus according to the embodiment includes a distortion correction unit 8 provided between the image input unit 1 and the projection processing unit 2 in addition to the image input unit 1 to the color wheel 7 described above. In addition, the projector device according to the embodiment supplies a distortion correction parameter calculation unit 9 that sets a distortion correction parameter to the distortion correction unit 8 and a distortion correction image such as a captured image of the screen to the distortion correction parameter calculation unit 9. And an image input unit 10 for distortion correction.

  The distortion correction parameter calculation unit 9 is an example of a generation unit. The image input unit 1 is an example of an analysis unit. The image input unit 1 and the projection processing unit 2 are examples of a control unit. The distortion correction unit 8 is an example of a correction unit. The projection processing unit 2 is an example of a projection unit.

  In the case of the projector device according to the embodiment, the image input unit 1 is an image input unit such as an HDMI (registered trademark) receiver that receives an input image, and determines (analyzes) the format of the received three-dimensional (3D) image. And notifies the projection processing unit 2 of the above. The projection processing unit 2 notifies the distortion correction parameter calculation unit 9 of the format of the 3D image determined by the image input unit 1.

  The distortion correction unit 8 deforms the input image (distortion correction) according to the distortion correction parameter set by the distortion correction parameter calculation unit 9 and outputs the image. A simple distortion such as vertical and horizontal trapezoidal correction can be corrected by the projection processing unit 2 formed by, for example, SoC (System On Chip). However, the geometric distortion resulting from the screen distortion is an irregular distortion in which the surface shape swells depending on the position in the projection plane. For this reason, it is a non-linear distortion that cannot be corrected by correcting the trapezoidal distortion of the entire screen.

  The projector apparatus according to the embodiment is provided as the distortion correction unit 8 in order to correct such complicated distortion. The distortion correction unit 8 may be realized by software, or may be realized by hardware dedicated for distortion correction. By providing a distortion correction integrated circuit (distortion correction IC), which is hardware dedicated to distortion correction, as the distortion correction unit 8, it is possible to correct a moving image without delay (in real time).

  As the distortion-corrected image input unit 10, an electronic still image imaging device (digital camera device) incorporated in or externally attached to the projector device can be used. In this case, the distortion correction image input unit 10 supplies a captured image (still image) obtained by imaging the screen to the distortion correction parameter calculation unit 9. Note that the distortion-corrected image input unit 10 may be a memory that stores a captured image obtained by capturing a screen in advance, or a memory that stores a captured image of a screen downloaded via a network or the like. In this case, the captured image of the screen is read from the memory and supplied to the distortion correction parameter calculation unit 9.

  The distortion correction parameter calculation unit 9 analyzes the screen shape (projection surface shape) from the captured image of the screen supplied from the distortion correction image input unit 10, generates a distortion correction parameter corresponding to the projection surface shape, and generates a distortion correction unit. 8 is supplied. Further, the distortion correction parameter calculation unit 9 transforms into distortion correction parameters so as to correspond to the 3D format detected by the image input unit 1 and instructed from the projection processing unit 2. The distortion correction unit 8 converts the input three-dimensional image into a three-dimensional image corresponding to the projection plane shape and 3D format using the distortion correction parameter, and supplies the converted three-dimensional image to the projection processing unit 2. Thereby, since a 3D image in a form corresponding to the projection surface shape and the 3D format can be projected onto the screen, a normal 3D image can be projected.

  Next, the 3D format will be described with reference to FIGS. 3 and 4. In recent years, various 3D formats such as a side-by-side method are defined in HDMI (registered trademark) (High-Definition Multimedia Interface Version 1.4a). In addition, a display method is known in which right-eye images and left-eye images (hereinafter collectively referred to as “LR images”) are alternately displayed at a high speed by a frame sequential method, and active shutter glasses are driven in synchronism for stereoscopic viewing. It has been.

  FIG. 3 shows how to display an LR image in the frame sequential method. The LR image is alternately switched at a frequency of 120 Hz, for example. The active shutter glasses alternately open the left and right fields of view in accordance with the LR images that are alternately switched. The user can stereoscopically view the LR image by alternately viewing the LR image that is switched alternately at a frequency of 120 Hz with the right eye and the left eye.

  Next, FIG. 4 is a diagram for explaining an operation when a side-by-side 3D image is input to the projector device according to the embodiment. The side-by-side format is a format in which each LR image is compressed in the horizontal direction and displayed on one screen. When the side-by-side 3D image shown in FIG. 4A is added to the image input unit 1, the projection processing unit 2 performs resizing processing. Then, the projection processing unit 2 converts the image into a frame sequential 3D image shown in FIG. 4B and supplies it to the micromirror element 3.

  Here, as shown in the diagram with the reference numeral (a) in FIG. 5, when an image is projected on a screen whose right half is distorted when viewed from the user without distortion correction, As shown in FIG. 5B, the right half of the projected image looks distorted.

  Therefore, in the projector device of the embodiment, the distortion correction image input unit 10 takes an image of a screen as shown in FIG. In addition, the distortion correction parameter calculation unit 9 analyzes the captured image of the screen to generate a distortion correction parameter corresponding to the shape of the screen as shown in the diagram with the symbol (b) in FIG. Then, the generated distortion correction parameter is set in the distortion correction unit 8. The distortion correction unit 8 transforms the image input to the image input unit 1 shown in the drawing with the reference numeral (c) in FIG. 6 using the distortion correction parameter, thereby changing the reference numeral (d) in FIG. An image having a shape opposite to the shape of the screen is generated as shown in the figure attached with and projected onto the screen via the micromirror element 3.

  Since the image projected on the screen has a distortion opposite to the distortion of the screen, the distortion of the screen is offset by the distortion of the screen and the distortion of the image. For this reason, even when an image is projected on a screen whose right half is distorted when viewed from the user, the projected image has been corrected for distortion by the distortion correction parameter, and therefore, a diagram with the symbol (e) in FIG. As shown in FIG. 2, a normal projection image without distortion can be obtained.

  Next, FIG. 7 shows a projected image when a side-by-side 3D image is subjected to distortion correction with a distortion correction parameter corresponding to the shape of the projection plane in a projector apparatus having a distortion correction function. In the case of this example, the screen is distorted in the right half as shown in the figure with the symbol (a) in FIG. As a distortion correction parameter, a distortion correction parameter for correcting the distortion of the right half of the screen is generated as shown in the drawing with the symbol (b) in FIG.

  When the distortion correction of the side-by-side 3D image shown in FIG. 7C is performed using the distortion correction parameter shown in FIG. 7B, the distortion correction parameter shown in FIG. ), Only the right-eye image (R) is corrected for distortion. That is, in this example, since the right half of the screen is distorted, distortion correction is performed only on the right-eye image (R) inserted in the right half of the side-by-side 3D image. . The side-by-side 3D image subjected to such distortion correction is resized to the right-eye image (R) and the left-eye image (L), as shown in the figure with the symbol (e) in FIG. Processed and alternately projected onto the screen according to a frame sequential method.

  However, in the case of a side-by-side 3D image, a right-eye image (R) and a left-eye image (L) are inserted into an input 1-frame 3D image. Then, the right-eye image (R) and the left-eye image (L) are separated at the time of projection, and are each resized and projected into an image of one frame. For this reason, even if distortion correction processing corresponding to the projection plane shape is performed on the 3D image before resizing that is an image of one frame, for example, distortion correction processing is performed only on the right-eye image (R). It is difficult to obtain an appropriate projection image.

  For this reason, in the projector apparatus according to the embodiment, the image input unit 1 shown in FIG. 2 detects the format of the input 3D image using, for example, an HDMI (registered trademark) receiver, and performs projection processing. Notify part 2. In addition, the projection processing unit 2 notifies the distortion correction parameter calculation unit 9 of the format of the detected 3D image. The distortion correction parameter calculation unit 9 changes the distortion correction parameter in accordance with the notified format type of the 3D image. The distortion correction unit 8 corrects the distortion of the input 3D image using a distortion correction parameter deformed according to the format type of the 3D image. Thereby, it is possible to generate a deformed 3D image corresponding to the shape of the screen and the format type of the 3D image.

  FIG. 8 is a schematic diagram showing a flow until a deformed 3D image is generated corresponding to the shape of the screen and the format type of the 3D image. In the case of this example, as shown in FIG. 8A, the right half of the screen is distorted. In addition, as shown in the diagram with the reference numeral (b) in FIG. 8, a side-by-side method in which a right-eye image R is inserted in the right half of one frame and a left-eye image L is inserted in the left half of one frame. A 3D image is input.

  The distortion correction image input unit 10 generates, from the captured image of the screen, a distortion correction parameter shown in the figure with the symbol (b) in FIG. 8 for correcting (cancelling) the distortion of the screen, and correcting the distortion. This is supplied to the parameter calculation unit 9. The distortion correction parameter calculation unit 9 is notified of the format type of the input 3D image. In this example, the input 3D image is a side-by-side 3D image. For this reason, the parameter calculation unit 9 performs distortion correction processing corresponding to the projection plane shape on each of the right half image and the left half image, as shown in the diagram with the reference numeral (c) in FIG. A distortion correction parameter to be applied is generated. In other words, the parameter calculation unit 9 changes (converts, converts) the distortion correction parameter corresponding to the projection surface shape into a parameter form corresponding to the notified 3D image format type (in this example, the side-by-side method). Deform.

  The distortion correction unit 8 illustrated in FIG. 2 performs distortion correction processing on the input side-by-side 3D image using the distortion correction parameter converted into the parameter form corresponding to the projection plane shape and the format type of the 3D image. Apply. As a result, as shown in FIG. 8E, the right half image (right-eye image R) of one frame and the left half image (left-eye image) of one frame in the side-by-side method. A distortion correction process corresponding to the shape of the projection plane can be separately performed on the image L).

  The projection processing unit 2 resizes the right half image and the left half image of one frame on which the distortion correction processing corresponding to the projection plane shape has been separately performed, thereby changing the sign of (f) in FIG. As shown in the attached drawing, an image R for the right eye of one frame and an image L for the left eye of one frame are generated. The image R for the right eye and the image L for the left eye are alternately projected on the screen according to a frame sequential method. Thereby, a 3D image is provided through, for example, active shutter glasses.

  The format of the 3D image is defined by HDMI (registered trademark) (High-Definition Multimedia Interface Version 1.4a). Therefore, the format of the input 3D image may be determined according to the definition of HDMI (registered trademark), and the distortion correction parameter may be modified according to the determination result. For example, the above-mentioned side-by-side format is a format in which the image R for the right eye and the image L for the left eye are compressed in the horizontal line direction and displayed on one screen (one frame). For this reason, the correction parameters compressed to 1/2 in the horizontal line direction may be arranged side by side to generate distortion correction parameters for one screen. In addition, when the format of the input 3D image is a top-and-bottom format, the correction parameters compressed to ½ in the vertical line direction orthogonal to the horizontal line direction are arranged vertically and distorted for one screen. A correction parameter may be generated and used. As described above, by deforming the distortion correction parameter corresponding to the shape of the projection surface according to the format of the 3D image, it is possible to obtain accurate 3D images corresponding to various 3D image formats.

  Finally, the flowchart of FIG. 9 shows the flow of 3D image distortion correction processing in the projector apparatus according to the embodiment. First, in step S1, when the image input unit 1 acquires an input image, in step S2, it is determined whether or not the input image is a 3D image. When it is determined that the input image is a two-dimensional image (2D image) (step S2: No), the process proceeds to step S5, and is generated by the distortion correction parameter calculation unit 9 corresponding to the projection surface shape. The distortion correction unit 8 performs distortion correction processing of the 2D image using the distortion correction parameter. Then, the projection processing unit 2 starts projecting the 2D image that has been subjected to the distortion correction processing according to the projection surface shape, and ends the process of the flowchart of FIG. Thereby, a normal 2D projection image in which distortion is corrected according to the projection surface shape can be obtained.

  On the other hand, when it is determined that the input image is a 3D image (step S2: Yes), the process proceeds to step S3, and the image input unit 1 is input according to the definition of HDMI (registered trademark). The format of the 3D image is analyzed, and the analysis result is notified to the projection processing unit 2. The projection processing unit 2 notifies the distortion correction parameter calculation unit 9 of the analysis result.

  Next, in step S4, the distortion correction parameter calculation unit 9 transforms (converts) the distortion correction parameter generated corresponding to the projection plane shape so as to correspond to the format of the 3D image notified by the analysis result. In step S5, the distortion correction unit 8 performs distortion correction processing on the input 3D image using the distortion correction parameters corresponding to the projection surface shape and 3D image format, and the projection processing unit 2 performs distortion correction. Project the processed 3D image onto a screen. Accordingly, it is possible to obtain a projection image in which geometric distortion caused by the shape of the projection surface is correctly corrected corresponding to various 3D formats.

  As is clear from the above description, in the projector device according to the embodiment, the distortion correction parameter calculation unit 9 acquires a captured image of a projection target such as a screen, and performs normal projection according to the shape of the projection target. A distortion correction parameter for obtaining an image is generated. In addition, the image input unit 1 determines whether the input image is a 2D image or a 3D image, and if it is a 3D image, analyzes the format of the 3D image and projects the analysis result. Notify part 2. The projection processing unit 2 notifies the distortion correction parameter calculation unit 9 of the analysis result. When the input image is a 3D image, the distortion correction parameter calculation unit 9 changes (converts) the distortion correction parameter generated corresponding to the shape of the projection target into a parameter form corresponding to the format of the 3D image. .

  When the input image is a 2D image, the distortion correction unit 8 performs distortion correction processing of the 2D image by using the distortion correction parameter generated corresponding to the projection surface shape by the distortion correction parameter calculation unit 9. Then, the projection processing unit 2 starts projecting a 2D image that has been subjected to distortion correction processing according to the shape of the projection surface. Thereby, a normal 2D projection image in which distortion is corrected according to the projection surface shape can be obtained.

  On the other hand, when the input image is a 3D image, the distortion correction unit 8 converts the distortion correction parameter generated by the distortion correction parameter calculation unit 9 in accordance with the projection surface shape into a 3D image format. 3D image distortion correction processing is performed using the distortion correction parameters deformed accordingly. Thereby, it is possible to obtain a normal 3D projection image whose distortion is corrected according to the shape of the projection surface and the format of the 3D image.

  In addition, by providing a distortion correction IC, which is hardware dedicated to distortion correction, as the distortion correction unit 8, a moving image can be corrected without delay (in real time).

  The above-described embodiments are presented as examples, and are not intended to limit the scope of the present invention. The novel embodiment can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. The embodiments and modifications of the embodiments are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 Image input part 2 Projection process part 3 Micromirror element 4 Mirror 5 Optical lens unit 6 Lamp 7 Color wheel 8 Distortion correction part 9 Distortion correction parameter calculation part 10 Distortion correction image input part

JP 2013-172444 A

Claims (5)

When the input image is a three-dimensional image, an analysis unit that analyzes the format type of the three-dimensional image;
A distortion correction parameter for correcting distortion of the projection image due to a projection surface shape of the projection object onto which the three-dimensional image is projected is generated, and the distortion correction parameter is set in a parameter form corresponding to the analyzed format type. A generator for changing
A correction unit that performs distortion correction processing on the input three-dimensional image using the distortion correction parameter changed to the parameter form corresponding to the projection plane shape and the format type;
And a projection unit that projects the distortion-corrected three-dimensional image onto a projection surface of the projection object. The projector device according to claim 1, wherein at least the correction unit is a distortion correction integrated circuit which is hardware dedicated to the distortion correction processing. When the format type of the 3D image is a side-by-side format, the generation unit arranges distortion correction parameters compressed in half in the horizontal line direction on the left and right in the horizontal line direction, and generates distortion for one screen. The projector according to claim 1, wherein a correction parameter is generated. When the format type of the three-dimensional image is a top-and-bottom method, the generation unit generates a distortion correction parameter compressed by ½ in the vertical line direction orthogonal to the horizontal line direction along the vertical line direction. The projector apparatus according to any one of claims 1 to 3, wherein distortion correction parameters for one screen are generated side by side. When the input image is a three-dimensional image, the analysis unit analyzes the format type of the three-dimensional image;
The generation unit generates a distortion correction parameter for correcting distortion of the projection image caused by the shape of the projection surface of the projection object onto which the three-dimensional image is projected, and in a parameter form corresponding to the analyzed format type, Generating to change the distortion correction parameter;
A correction step in which a correction unit performs a distortion correction process on the input three-dimensional image using the distortion correction parameter changed to a parameter form corresponding to the projection surface shape and the format type;
A projection method, wherein a projection unit projects the three-dimensional image subjected to distortion correction processing onto a projection surface of the projection target.

Images