JP2012010196A - Projection apparatus, projection method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily project a three-dimensional (3D) image using created images for both eyes by creating images for a right eye and a left eye while using an existent two-dimensional (2D) image.SOLUTION: A projection apparatus includes: an image memory 33 for storing a plurality of 2D images; an operating section 32 for selecting an image to be a background and a parts image to be combined on the image to be the background, respectively, from the image memory 33 and setting an enlargement scale of the selected parts image and its position in the background image; a CPU 29 and an image processing section 34 for calculating a distance to the parts image based on the set enlargement scale, calculating deviation amounts in a right-eye image and a left-eye image of the parts image based on the calculated distance, and creating the right-eye image and the left-eye image according to a preset 3D image format while using the background image and the parts image based on the calculated deviation amounts; and projection sections (12 to 18, 28) for projecting the created right-eye and left-eye images in accordance with the 3D image format.

Description

  The present invention relates to a projection apparatus, a projection method, and a program for projecting a stereoscopic image.

  As a projector device that projects a stereoscopic image, an optical shutter type projector device that realizes a stereoscopic image by opening and closing an optical shutter attached to the glasses in synchronization with blinking of the projected image is considered.

  In addition, by using two polarized light beams orthogonal to each other, projecting an image with left and right parallax on a screen or the like, and observing through glasses provided with polarizing plates in directions orthogonal to each other with the left and right eyes, a stereoscopic image There is a polarizing projector device that realizes the above. (For example, Patent Document 1)

JP-A-10-069012

  In either of the optical shutter type projector device and the polarization type projector device described above, in order to project a captured image in a three-dimensional manner, it is necessary to capture an image with two cameras for the left eye and the right eye in advance. It becomes. Therefore, a special camera dedicated to stereoscopic image shooting is necessary, and naturally a two-dimensional image captured by a general digital camera or the like cannot be stereoscopically viewed.

  The present invention has been made in view of the above circumstances, and the object of the present invention is to create right-eye and left-eye images using existing two-dimensional images, and to simplify the created images for both eyes. It is an object of the present invention to provide a projection apparatus, a projection method, and a program capable of projecting a stereoscopic image.

  The invention according to claim 1 is an image storage unit that stores a plurality of two-dimensional images, a background image selection unit that selects a background image from the image storage unit, and a part image that is combined on the background image A part image selection unit that selects the image from the image storage unit, a setting unit that sets a magnification ratio of the part image selected by the part image selection unit and a position in the background image, and a magnification ratio set by the setting unit. A distance calculation unit that calculates a distance to the part image based on the distance calculation unit; a shift amount calculation unit that calculates a shift amount in the right-eye image and the left-eye image of the part image based on the distance calculated by the distance calculation unit; Based on the shift amounts in the right-eye image and left-eye image of the part image calculated by the shift amount calculation unit, a stereoscopic image format set in advance using the background image and the part image is used. An image processing unit that creates a right-eye image and a left-eye image according to a mat, and a projection unit that projects the right-eye image and the left-eye image created by the image processing unit according to the stereoscopic image format. And

  According to a second aspect of the present invention, in the first aspect of the invention, the setting unit sets a magnification that matches a distance position of the background image of the part image selected by the part image selection unit. An enlargement factor and a second enlargement factor that sets an enlargement factor corresponding to the distance position of the background image based on the arrangement of the part images are set based on the first enlargement factor.

  According to a third aspect of the present invention, in the first aspect of the present invention, the part image selected by the part image selection unit is a moving image, and the setting unit is a part image positioned at the beginning of a time series of moving images. The distance calculation unit calculates the distance after calculating the enlargement ratio and position of each part image constituting the moving image from the enlargement ratio and position of the part image located at the head. It is characterized by doing.

  According to a fourth aspect of the present invention, in the first aspect of the present invention, the part image selected by the part image selection unit is a moving image, and the setting unit is a part image positioned at the beginning of a time series of moving images. The distance calculation unit sets the enlargement rate and position of the part image located at the head and the enlargement rate of the part image located at the end. In addition, the distance is calculated after calculating the enlargement ratio and the position for each part image constituting the moving image from the position.

  According to a fifth aspect of the present invention, an image storage step for storing a plurality of two-dimensional images, a background image selection step for selecting an image from the images stored in the image storage step, and a composition on the background image are combined. A part image selection step for selecting a part image from the images stored in the image storage step, a setting step for setting a magnification ratio of the part image selected in the part image selection step and a position in the background image, and the setting A distance calculating step for calculating a distance to the part image based on the magnification set in the step, and a shift amount in the right eye image and the left eye image of the part image based on the distance calculated in the distance calculating step. Based on each shift amount in the right-eye image and left-eye image of the part image calculated in the shift amount calculation step, the background image An image processing step for creating a right-eye image and a left-eye image in accordance with a preset stereoscopic image format using the images, and the right-eye image and the left-eye image created in the image processing step And a projecting step of projecting according to a format.

  According to a sixth aspect of the present invention, there is provided a program executed by a computer built in the projection apparatus, wherein the program stores an image from an image storage unit that stores a plurality of two-dimensional images and an image stored in the image storage unit. A background image selection unit to select, a part image selection unit to select a part image to be synthesized on the background image from the images stored in the image storage unit, an enlargement ratio of the part image selected by the part image selection unit, and A setting unit that sets a position in the background image, a distance calculation unit that calculates a distance to the part image based on an enlargement ratio set by the setting unit, and the part image that is calculated based on the distance calculated by the distance calculation unit A shift amount calculation unit for calculating each shift amount in the right eye image and the left eye image, and a right eye image and a left eye image of the part image calculated by the shift amount calculation unit An image processing unit that creates a right-eye image and a left-eye image according to a preset stereoscopic image format using the background image and the part image based on each shift amount in the image, and a right eye created by the image processing unit And functioning as a projection unit that projects the image for the left eye and the image for the left eye according to the stereoscopic image format.

  According to the present invention, it is possible to create a right-eye image and a left-eye image using an existing two-dimensional image, and easily project a stereoscopic image using the created images for both eyes.

1 is a block diagram showing a functional circuit configuration of a data projector device according to a first embodiment of the present invention. 3 is a flowchart showing processing details of stereoscopic image projection using two-dimensional still image data according to the embodiment. The figure which illustrates the two-dimensional background image which concerns on the same embodiment. The figure which illustrates the parts image which concerns on the same embodiment. The figure which illustrates the parts image after the expansion process which concerns on the same embodiment. The figure explaining the concept of the shift amount based on parallax for providing the perspective which concerns on the embodiment. The figure which illustrates the image for left eyes and the image for right eyes which concern on the embodiment. 6 is a timing chart showing projection timings in the liquid crystal shutter glasses method according to the embodiment. The flowchart which shows the processing content of the three-dimensional moving image projection using the two-dimensional still image data which concerns on the 2nd Embodiment of this invention.

(First embodiment)
A first embodiment in the case where the present invention is applied to a data projector apparatus of DLP (Digital Light Processing) (registered trademark) system that projects a stereoscopic image will be described below with reference to the drawings.

  As for the projection of the stereoscopic image, for example, an image of a liquid crystal shutter glasses type is created. This liquid crystal shutter glasses method is also called a field sequential method or an active stereo method and projects an image for one frame divided into two fields. The image for the left eye in the first field and the image for the right eye in the second field. Project an image.

  For example, infrared light outside the visible light range is projected on the image only in the first field. The user wears liquid crystal shutter glasses for this projection. On the liquid crystal shutter glasses side, the infrared light is detected by a sensor, and the right eye side is shuttered in the first field, and the left eye side is shuttered in the second field. Therefore, the user can see only the image for the left eye with the left eye and the image for the right eye separately with the right eye without being aware of it.

  It should be noted that liquid crystal shutter glasses used in the liquid crystal shutter glasses themselves can be used as they are for commercially available 3D television receivers, and in this embodiment, description of the configuration, operation, etc. is omitted.

FIG. 1 is a block diagram showing a schematic configuration of a functional circuit of a data projector device 10 according to the present embodiment.
Reference numeral 11 denotes an input unit. The input unit 11 includes, for example, a pin jack (RCA) type video input terminal, a D-sub 15 type RGB input terminal, an HDMI (High-Definition Multimedia Interface) standard image / audio input terminal, and a USB (Universal Serial Bus). An analog image signal and audio signal from an external device connected by wire are input via a connector, and digitized by performing A / D conversion and other predetermined processing as front-end processing.

  The image signals of various standards input and digitized by the input unit 11 are sent to the projection image processing unit 12 via the system bus SB.

  The projection image processing unit 12 unifies the input image signal into an image signal of a predetermined format suitable for projection, writes the image signal to the display video memory 13 as appropriate, and then writes the written image signal from the video memory 13. Read out and send to the projected image drive unit 14.

  At this time, symbol data indicating various operation states for OSD (On Screen Display) and character data such as a guide message are also superimposed on the image signal in the video memory 13 by the projection image processing unit 12 as necessary. The image signal is read and sent to the projection image drive unit 14.

  The projection image drive unit 14 multiplies a frame rate according to a predetermined format, for example, 120 [frames / second], the number of color component divisions, and the number of display gradations, in accordance with the transmitted image signal. The micromirror element 15 that is a spatial light modulation element (SLM) is driven to display by high-speed time-division driving.

  The micromirror element 15 performs display operation by individually turning on / off each tilt angle of a plurality of micromirrors arranged in an array, for example, XGA (horizontal 1024 pixels × vertical 768 pixels) at high speed. Then, an optical image is formed by the reflected light.

  On the other hand, R, G, B primary color lights are emitted cyclically from the light source unit 16 in a time-sharing manner. The primary color light from the light source unit 16 is totally reflected by the mirror 17 and applied to the micromirror element 15.

  Then, an optical image is formed by the reflected light from the micromirror element 15, and the formed optical image is projected and displayed on a screen (not shown) to be projected via the projection lens unit 18.

  The projection lens unit 18 includes a zoom lens and a focus lens therein, and the projection angle of view and the focus position can be changed by moving each lens.

  The light source unit 16 includes a light emitting diode (hereinafter referred to as “Ir-LED 19”) 19 that emits infrared light (Ir), a light emitting diode (hereinafter referred to as “R-LED”) 20 that emits red (R) light, green ( G) a light emitting diode (hereinafter referred to as “G-LED”) 21 that emits light, and a light emitting diode (hereinafter referred to as “B-LED”) 22 that emits blue (B) light.

  Unlike the other R-LED 20, G-LED 21, and B-LED 22, the Ir-LED 19 is driven to emit light by switching on / off in units of fields when projecting a stereoscopic image. Infrared light emitted from the Ir-LED 19 is transmitted through the dichroic mirror 23, converted into a luminous flux having a substantially uniform luminance distribution by the integrator 24, and then sent to the mirror 17.

  The red light emitted from the R-LED 20 is reflected by the dichroic mirror 25 and then by the dichroic mirror 23, and is sent to the mirror 17 after the luminance distribution is made substantially uniform by the integrator 24.

  The green light emitted from the G-LED 21 is reflected by the dichroic mirror 26, then passes through the dichroic mirror 25, is then reflected by the dichroic mirror 23, and is sent to the mirror 17 through the integrator 24.

The blue light emitted from the B-LED 22 is reflected by the mirror 27, passes through the dichroic mirrors 26 and 25, is then reflected by the dichroic mirror 23, and is sent to the mirror 17 through the integrator 24.
The dichroic mirror 23 transmits infrared light while reflecting red light, green light, and blue light. The dichroic mirror 25 reflects red light and transmits green light and blue light. The dichroic mirror 26 reflects green light while transmitting blue light.

  The projection light drive unit 28 controls the light emission timing of each of the LEDs 19 to 22 of the light source unit 16 and the waveform of the drive signal. The projection light drive unit 28 controls the light emission operations of the LEDs 19 to 22 according to the timing of the image data given from the projection image drive unit 14 and the control of the CPU 29 described later.

  The CPU 29 controls all the operations of the above circuits. The CPU 29 is directly connected to the main memory 30 and the program memory 31. The main memory 30 is composed of a DRAM and functions as a work memory for the CPU 29. The program memory 31 is composed of an electrically rewritable nonvolatile memory, and stores an operation program executed by the CPU 29, various fixed data, and the like.

  The CPU 29 controls the data projector device 10 by reading out the operation program and the standard data stored in the program memory 31, expanding and storing them in the main memory 30 and executing the program. Control.

The CPU 29 executes various projection operations in accordance with key operation signals from the operation unit 32.
The operation unit 32 includes a key operation unit provided in the main body of the data projector device 10 and a laser light receiving unit that receives infrared light from a remote controller (not shown) dedicated to the data projector device 10. The operation unit 32 directly outputs to the CPU 29 a key operation signal based on a key operated by a user with a key operation unit of the main body or a remote controller.

  Specifically, the power key, input switch key, focus up / down key, zoom up / down key, menu key, cursor ("↑" "↓") “←” “→”) key, set key, cancel key, keystone correction key, and the like.

The CPU 29 is further connected to the image memory 33, the image processing unit 34, and the sound processing unit 35 via the system bus SB.
The image memory 33 has a storage capacity capable of storing a plurality of various image data sent via the input unit 11. Under the control of the CPU 29, the image processing unit 34 performs image processing including image data generation for stereoscopic image projection on the image data stored in the image memory 33.

  The sound processing unit 35 includes a sound source circuit such as a PCM sound source, converts the sound data given during the projection operation into an analog signal, drives the speaker unit 36 to emit a loud sound, or generates a beep sound or the like as necessary.

Next, the operation of the above embodiment will be described.
As described above, the projection image processing unit 12 creates an image to be displayed on the micromirror element 15 using the video memory 13, and the projection image driving unit 14 displays the created image on the micromirror element 15. The projection light drive unit 28 drives the LEDs 19 to 22 to emit light in accordance with the display on the element 15.

The projection image processing unit 12, the video memory 13, the projection image driving unit 14, and the projection light driving unit 28 all operate under the control of the CPU 29. The CPU 29 reads out an operation program, fixed data, and the like stored in the program memory 31 including the following processing, loads them into the main memory 30, and executes control processing.
Various processes for converting the image data stored in the image memory 33 into stereoscopic image data are executed by the image processing unit 34 under the control of the CPU 29.

  FIG. 2 is a flowchart showing a series of processing contents when a stereoscopic image is projected using a plurality of two-dimensional still image data input from the input unit 11 and stored in the image memory 33.

  At the beginning of the process, it is accepted that the user selects image data as a background from among a plurality of still image data stored in the image memory 33 (step S101).

  In this case, for example, thumbnail images of all the still image data stored in the image memory 33 are created, and after creating a list image thereof, a guide message for selecting one of the thumbnail images is projected.

When the user operates the cursor key on the operation unit 32 with respect to the projection content, the position of the selected image in the list image is changed according to the operation content, and the image selected when the set key is operated is selected. Determine the background image.
FIG. 3 illustrates still image data BC1 that is the background selected in step S101.

  Next, it is accepted that the part image of the subject to be projected on the background image is selected from the plurality of still image data stored in the image memory 33 (step S102).

In this case, except for the image selected as the background image, thumbnail images of all the still image data stored in the image memory 33 are created, and a list image thereof is created, and one of them is selected. Project with a guide message.
When the user operates the cursor key on the operation unit 32 with respect to the projection content, the position of the selected image in the list image is changed according to the operation content, and the image selected when the set key is operated is selected. Decide on a part image.
FIG. 4 illustrates part image data OB1 of the subject selected in step S102. In the rectangle RT1 indicated by the broken line, only the image portion OB1 of “dinosaur” is valid, and the surrounding portion is invalid. At the time of subsequent image synthesis, the surrounding image data is used as the background.

  When the selection of the background image and the part image to be combined with the background image is completed in this way, first, in order to match the reference image size of the part image with the background image, a composite image in which the part image is superimposed on the center of the background image is projected. (Step S103), an operation for changing the size of the part image is accepted (Step S104).

  In this case, for example, when the user operates the zoom up / down key on the operation unit 32 with respect to the part image, the part image is enlarged / reduced in stages, and matches the background image when the set key is operated. The reference size of the part image is determined.

  It is determined whether or not there is a set key operation for determination (step S105). If there is no key operation, the processing from step S103 is repeated.

  In the process of repeating steps S103 to S105, the reference size of the part image that matches the background image is determined.

  When the set key is operated, it is determined in step S105, and then a composite image in which the part image is superimposed on the background image is projected to determine the position and size of the part image in the background image. After that (step S106), an operation for changing the position and size of the part image is accepted (step S107).

  In this case, for example, when the user operates the cursor key on the operation unit 32 with respect to the part image, the position of the part image in the background image moves up, down, left, and right. Also, by operating the zoom up / down key on the operation unit 32, the part image in the background image is enlarged / reduced in stages, and whether the part image is arranged closer or further away. Set.

  Further, it is determined whether or not there is a set key operation for determination (step S108). If there is no key operation, the processing from step S106 is repeated.

  In the process of repeating steps S106 to S108, the position of the part image in the background image and the size of the part image based on the degree of perspective are determined.

  FIG. 5 illustrates the part image data OB2 of the subject enlarged in the process of step S107. Here, a case where the original part image data OB1 shown in FIG.

  When the set key is operated, it is determined in step S108, and the size of the image part determined in step S108 is enlarged from the size of the reference part image determined in step S105. The ratio is calculated, and the distance to the part image is calculated from the enlargement ratio and the position of the part image (step S109).

  When the size of the object OB does not change, the distance to the object and the size of the object are inversely proportional. Therefore, the distance p to the object OB is calculated as s / r, where s is the assumed distance to the object when it is not enlarged and r is the enlargement factor.

Next, the shift amounts of the left and right eyes are calculated from the calculated distance p (step S110).
FIG. 6 illustrates an expression corresponding to the position of the object OB representing the part image when the position of the background image is the position of the screen SC to be projected.
FIG. 6A shows a representation of an object OB that is farther than the screen SC. FIG. 6B shows a representation of an object OB that is closer to the screen SC.

If the right-eye image is shifted to the right, the left-eye image shifted to the left is a positive value, the right-eye image is shifted to the left, and the left-eye image is shifted to the right, the shift amount is expressed by the following equation. Is done. That is,
w = d · (1− (s / p)) (1)
(W: Shift amount,
d: the distance between the center positions of the left and right eyes,
s: distance to the screen,
p: Distance to the object. )
In the above formula (1), the distance s to the screen may be set in advance as a representative value assumed in the use environment corresponding to the model of the data projector apparatus 10, and the projection lens unit 18 is configured. Among a plurality of optical lenses, the distance from the focus lens drive position at that time to the eyelid screen SC at the in-focus position is detected by a lens drive motor (not shown) and a rotary encoder that detects the rotation position It is also good.

  Based on each shift amount calculated in this way and the set enlargement ratio and position, an image for each eye is created (step S111).

  FIGS. 7A and 7B illustrate the left-eye image and the right-eye image created in this way. In the left-eye image shown in FIG. 7A, the enlarged part image OB2 with respect to the background image BT1 is shifted to the right from the set position, and conversely in the right-eye image shown in FIG. It can be seen that the enlarged part image OB2 with respect to the image BT1 is shifted to the left from the set position. In this case, due to the shift amount of the part image OB2, the part image OB2 is projected with respect to the background image BT1 so that the part image OB2 protrudes greatly to the near side where the user is positioned when the stereoscopic image is projected.

  The left-eye image and right-eye image created in this way are converted into image data by the image processing unit 34 according to the format defined by the liquid crystal shutter glasses method described above, and stored in the image memory 33 (step S112).

  Next, the projection of the stereoscopic image by the liquid crystal shutter glasses method is executed based on the image data of the left eye image and the right eye image stored in the image memory 33 (step S113), and the image selected from the selection of the image data as described above. A series of processes until the projection of the stereoscopic image based on the data is completed.

  FIG. 8 shows each projection timing in the liquid crystal shutter glasses method. As described above, in the liquid crystal shutter glasses method, an image for one frame is divided into two fields, and a left-eye image is projected in the first field and a right-eye image is projected in the second field.

  FIG. 8A shows a light emission drive waveform of the Ir-LED 19 that is lit only in the first field in two fields of one frame. The infrared light emitted from the Ir-LED 19 is superimposed on the image light and emitted from the projection lens unit 18, so that an infrared sensor provided on the liquid crystal shutter glasses (not shown) used by the user emits the infrared light. Then, switching between the left-eye image and the right-eye image is performed.

  The R-LED 20, the G-LED 21, and the B-LED 22 emit light sequentially in a time division manner in each field as shown in FIGS. 8B to 8D.

  In synchronization with the light emission of these primary color LEDs 20 to 22, the micromirror element 15 causes the red (R) image, green (G) image, and blue (B) image for the left eye in the first field as shown in FIG. In the second field, a red (R) image, a green (G) image, and a blue (B) image for the right eye are cyclically displayed, so that a light image is formed by each reflected light thereof, and the projection lens The image is projected on the screen SC by the unit 18.

  As described above in detail, according to the present embodiment, it is possible to create a right-eye image and a left-eye image using an existing two-dimensional image, and easily project a stereoscopic image using the created images for both eyes. .

  In addition, in the above-described embodiment, the size of the reference image of the part image with respect to the background image is once adjusted, and then the size of the part image equivalent to the background image is set again. It is possible to project the image by reflecting the perspective position of the image more accurately.

(Second Embodiment)
A second embodiment in the case where the present invention is applied to a DLP (registered trademark) type data projector apparatus that projects a stereoscopic image will be described below with reference to the drawings.

  Since the projection of the stereoscopic image is the same as in the first embodiment, a detailed description thereof is omitted.

  Further, the schematic configuration of the functional circuit of the data projector device 10 according to the present embodiment is basically the same as that described in FIG. Is omitted.

  Further, it is assumed that the image memory 33 stores still image data as a background image and moving image data as a part image.

Next, the operation of the above embodiment will be described.
FIG. 9 is a flowchart showing a series of processing contents when a stereoscopic image is projected using still image data and moving image data input from the input unit 11 and stored in the image memory 33.

  At the beginning of the process, it is accepted that the user selects image data as a background from among a plurality of still image data stored in the image memory 33 (step S201).

  In this case, for example, thumbnail images of all the still image data stored in the image memory 33 are created, and after creating a list image thereof, a guide message for selecting one of the thumbnail images is projected.

When the user operates the cursor key on the operation unit 32 with respect to the projection content, the position of the selected image in the list image is changed according to the operation content, and the image selected when the set key is operated is selected. Determine the background image.
Next, it is accepted that the part image of the subject to be projected on the background image is selected by the user from the plurality of moving image data stored in the image memory 33 (step S202).

In this case, a thumbnail image is created for each head image of all moving image data stored in the image memory 33, a list image is created, and a projection message is added with a guide message for selecting one of them. To do.
When the user operates the cursor key on the operation unit 32 with respect to the projection content, the position of the selected image in the list image is changed according to the operation content, and the moving image selected when the set key is operated Is determined as a part image.
When the selection of the background image and the part image to be combined with the background image is completed in this way, the position and size of the part image in the background image are used by using the first frame still image positioned at the head of the moving image to be the next part image. In order to determine the thickness, after projecting a composite image in which the part image is superimposed on the background image (step S203), an operation for changing the position and size of the part image is accepted (step S204).

  In this case, for example, when the user operates the cursor key with the operation unit 32 on the first part image, the position of the part image in the background image moves up, down, left, and right. Also, by operating the zoom up / down key on the operation unit 32, the part image in the background image is enlarged / reduced in stages, and whether the part image is arranged closer or further away. Set.

  Further, it is determined whether there is a set key operation for determination (step S205). If there is no key operation, the processing from step S203 is repeated.

  In the process of repeating steps S203 to S205, the position of the leading part image in the background image and the size of the part image based on the degree of perspective are determined.

  When the set key is operated, it is determined in step S205, and the position and size of the part image in the background image are determined using the still image of the frame located at the end of the moving image to be the next part image. In order to determine, a composite image in which the part image is superimposed on the background image is projected (step S206), and an operation for changing the position and size of the part image is accepted (step S207).

  Also in this case, for example, when the user operates the cursor key with the operation unit 32 on the last part image, the position of the part image in the background image moves up, down, left, and right. Also, by operating the zoom up / down key on the operation unit 32, the part image in the background image is enlarged / reduced in stages, and whether the part image is arranged closer or further away. Set.

  Further, it is determined whether or not there is a set key operation for determination (step S208). If there is no key operation, the processing from step S206 is repeated.

  In the process of repeating steps S206 to S208, the position of the last part image in the background image and the size of the part image based on the degree of perspective are determined.

  Then, when the set key is operated, it is determined in step S208, and the number of frames of the moving image constituting the next selected part image is set as a constant N (step S209), and the number of frames is counted. An initial value “1” is set in the variable i for this purpose (step S210).

  It is confirmed that the value of the variable i does not exceed the constant N (step S211). Then, the pasting position and size of the i-th part image in the video composed of N pieces of image data, based on the pasting position and size of each part image at the beginning and end of the moving image set in the processing of steps S203 to S208 above. The size is calculated (step S212).

  Next, an enlargement ratio is calculated based on the size of the calculated part image with reference to the original part image size, and a distance to the part image is calculated from the enlargement ratio and the position of the part image (step S213).

  When the size of the object (part image) does not change, the distance to the object and the visual size are inversely proportional. Therefore, the distance p to the object is calculated as s / r, where s is the assumed distance to the object when it is not enlarged and r is the enlargement factor.

Next, the shift amounts of the left and right eyes are calculated from the calculated distance p (step S214).
FIG. 6 illustrates an expression corresponding to the position of the object OB representing the part image when the position of the background image is the position of the screen SC to be projected.
FIG. 6A shows a representation of an object OB that is farther than the screen SC. FIG. 6B shows a representation of an object OB that is closer to the screen SC.

If the right-eye image is shifted to the right, the left-eye image is shifted to the left as a positive value, the right-eye image is shifted to the left, and the left-eye image is shifted to the right as a negative value, the shift amount is the first value. Similar to the embodiment, it is expressed by the following formula. That is,
w = d · (1− (s / p)) (1)
(W: Shift amount,
d: the distance between the center positions of the left and right eyes,
s: distance to the screen,
p: Distance to the object. )
Based on each shift amount calculated in this way and the set enlargement ratio and position, images for the left and right eyes are created (step S215).

  The left-eye image and right-eye image created in this way are stored in the image memory 33 (step S216).

  Next, after updating the value of the variable i by “+1” (step S217), the process returns to step S211.

  Thus, in the process of repeatedly executing the processes in steps S211 to S217, the value of the variable i is updated and set by “+1”, and the left-eye and right-eye stereoscopic images for each still image data constituting the selected part image. Data is created and stored in the image memory 33.

  Then, after the stereoscopic image data is created using the last image data constituting the part image of the moving image and stored in the image memory 33, the value of the variable i is updated and set to “+1” in step S217.

  In the subsequent step S211, it is determined that the value of the updated variable i has exceeded the total frame number N of the moving image, and the total number of frames N stored in the image memory 33 is determined as having finished the processing relating to the synthesis of the stereoscopic image. The three-dimensional image data is converted into moving image data by the image processing unit 34 in accordance with the format defined by the liquid crystal shutter glasses method, and is stored again in the image memory 33 (step S218).

  Next, for each still image data constituting the moving image data stored in the image memory 33, projection of a stereoscopic image at a predetermined frame rate by the liquid crystal shutter glasses method is executed based on the data of the left eye image and the right eye image. In step S219, a series of processing from the selection of the image data to the projection of the stereoscopic moving image based on the selected image data is completed.

  As described above in detail, according to the present embodiment, when a moving image data file is selected as a part image, the position and size with respect to the first image and the position and size with respect to the last image constituting the moving image are indicated. As a result, the position and size of the image located in the middle are automatically calculated to create individual 3D still images that make up the movie. Can be projected.

  Although not described in the above embodiment, for example, the position and size instructions for the last image constituting the moving image of the part image are omitted, and only the position and size side for the first image is designated. It is also conceivable that the position and size of images other than the top image are automatically set according to the motion of the moving image.

  In the case of such processing, it is possible to greatly simplify the instruction operation by the user, and it is possible to more easily realize the projection of a stereoscopic image by a moving image.

  In the first and second embodiments, the case where the liquid crystal shutter glasses method is adopted as the stereoscopic image projection method has been described. However, the present invention is not limited to this, and the dual stream format, side-by-side format, top-and-bottom format is used. The same applies to the case of projecting a stereoscopic image such as a format, a field sequential format, and an interlace format.

  Although the above embodiment has been described with respect to a case where the present invention is applied to a DLP (registered trademark) projector device, the present invention is not limited to the projection method, and a transmissive color liquid crystal panel is used. Various applications such as a monochrome liquid crystal panel in which light sources of a plurality of colors are driven in a time-sharing manner are applicable.

  In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

  DESCRIPTION OF SYMBOLS 10 ... Data projector apparatus, 11 ... Input part, 12 ... Projection image process part, 13 ... Video memory, 14 ... Projection image drive part, 15 ... Micromirror element, 16 ... Light source part, 17 ... Mirror, 18 ... Projection lens part , 19 ... Ir-LED, 20 ... R-LED, 21 ... G-LED, 22 ... B-LED, 23 ... Dichroic mirror, 24 ... Integrator, 25, 26 ... Dichroic mirror, 27 ... Mirror, 28 ... Projection light drive , 29 ... CPU, 30 ... main memory, 31 ... program memory, 32 ... operation unit, 33 ... image memory, 34 ... image processing unit, 35 ... audio processing unit, 36 ... speaker unit, SB ... system bus.

Claims (6)

An image storage unit for storing a plurality of two-dimensional images;
A background image selection unit for selecting an image as a background from the image storage unit;
A part image selection unit for selecting a part image to be synthesized on the background image from the image storage unit;
A setting unit for setting the magnification ratio of the part image selected in the part image selection unit and the position in the background image;
A distance calculation unit that calculates the distance to the part image based on the magnification set in the setting unit;
A shift amount calculation unit that calculates each shift amount in the right-eye image and the left-eye image of the part image based on the distance calculated by the distance calculation unit;
Based on the shift amounts in the right-eye image and the left-eye image of the part image calculated by the shift amount calculation unit, the right-eye image according to a preset stereoscopic image format using the background image and the part image, and An image processing unit for creating a left-eye image;
A projection apparatus comprising: a projection unit that projects the right-eye image and the left-eye image created by the image processing unit according to the stereoscopic image format.   The setting unit is configured to set a magnification ratio that matches a distance position of the background image of the part image selected by the part image selection unit, and a part image based on the first magnification ratio. The projection apparatus according to claim 1, wherein a second enlargement ratio that sets an enlargement ratio corresponding to the distance position of the background image by arrangement is set. The part image selected by the part image selection unit is a moving image,
The setting unit sets the magnification rate and position of the part image located at the beginning of the time series of the moving image,
The distance calculation unit calculates a distance after calculating an enlargement ratio and a position with respect to individual part images constituting a moving image from the enlargement ratio and position of the part image located at the head. The projection device described. The part image selected by the part image selection unit is a moving image,
The setting unit sets the magnification rate and position of the part image located at the beginning of the time series of the moving image and the magnification rate and position of the part image located at the end,
The distance calculation unit calculates the enlargement rate and position of each part image constituting the moving image from the enlargement rate and position of the part image located at the head and the enlargement rate and position of the part image located at the end. The projection apparatus according to claim 1, wherein the distance is calculated. An image storage step for storing a plurality of two-dimensional images;
A background image selection step of selecting an image from the images stored in the image storage step;
A part image selection step for selecting a part image to be synthesized on the background image from the images stored in the image storage step;
A setting step for setting the magnification ratio of the part image selected in the part image selection step and the position in the background image;
A distance calculating step for calculating a distance to the part image based on the magnification set in the setting step;
A shift amount calculating step of calculating each shift amount in the right-eye image and the left-eye image of the part image based on the distance calculated in the distance calculating step;
Based on the shift amount in the right-eye image and the left-eye image of the part image calculated in the shift amount calculation step, the right-eye image according to a preset stereoscopic image format using the background image and the part image, and An image processing step for creating an image for the left eye;
A projection step of projecting the right-eye image and the left-eye image created in the image processing step according to the stereoscopic image format. A program executed by a computer incorporated in the projection apparatus,
The program
An image storage unit for storing a plurality of two-dimensional images;
A background image selection unit for selecting an image from the images stored in the image storage unit,
A part image selection unit for selecting a part image to be synthesized on the background image from the images stored in the image storage unit;
A setting unit for setting the enlargement ratio of the part image selected by the part image selection unit and the position in the background image;
A distance calculation unit that calculates the distance to the part image based on the magnification set in the setting unit;
A shift amount calculation unit for calculating each shift amount in the right-eye image and the left-eye image of the part image based on the distance calculated by the distance calculation unit;
Based on the shift amounts in the right-eye image and the left-eye image of the part image calculated by the shift amount calculation unit, the right-eye image according to a preset stereoscopic image format using the background image and the part image, and An image processing unit for creating a left-eye image, and a program for causing the right-eye image and the left-eye image created by the image processing unit to function as a projection unit that projects according to the stereoscopic image format.

Images