JP2003006617A - Device and method for generating background image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To record a panoramic image as a background image and to observe the image in respect to a print to be produced on the basis of a parallax image stream composed of a plurality of parallax images. SOLUTION: A print producing device 1 is provided with an image generating part 20 for generating an image stream I composed of a plurality of images on the basis of a time space parameter TSP read from a storage server 100 or recording medium MD, an image converting part 30 for applying converting processing to the panoramic image to the image stream I generated by this image generating part 20 and an image processing part 40 for generating a viewpoint converted image stream PXI composed of a plurality of viewpoint converted images on the basis of a panoramic image PI generated by this image converting part 30. The image processing part 40 generates the viewpoint converted image stream PXI composed of a plurality of viewpoint converted images on the basis of the time space parameter TSP so that the panoramic image PI reproduced from a print P can be normally positioned within a prescribed distance from an observation viewpoint.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a background image generation device and a background image for generating an image to be recorded as a background on a printed matter manufactured based on a parallax image sequence including a plurality of parallax images including parallax information. Regarding the generation method.

[0002]

2. Description of the Related Art The recording of image information is generally planar recording intended for two-dimensional image information, but in recent years, a technique for recording a stereoscopic image such as a holographic stereogram has been established.

The holographic stereogram, for example, has a large number of images obtained by sequentially picking up an image of a subject from different observation points as original images, and these are recorded on a single hologram recording medium as strip-shaped or dot-shaped element holograms. It is produced by sequentially exposing and recording as.
In the holographic stereogram, when an observer sees it from one position with one eye, a group of image information recorded as a part of each element hologram is identified as a two-dimensional image. When viewed with one eye from another position different from the position, an aggregate of image information recorded as another part of each element hologram is identified as another two-dimensional image. Therefore, in the holographic stereogram, when the observer sees it with both eyes, the exposure recorded image is recognized as a three-dimensional image due to the parallax of the left and right eyes.

An application to which such a holographic stereogram is applied is, for example, "Akira Shirakura, Nobuhiro Kihara and Shigeyuki
Baba, “Instant holographic portrait printing sys
tem ”, Proceeding of SPIE, Vol. 3293, pp.246-253,
Jan. 1998 ”○“ Kihara, Shirakura, Baba: “High-speed hologram portrait printing system”, 3D image conference 199
8, July 1998 ”, a system for producing a printed material that can express parallax only in the lateral direction, and“ Yamaguchi, Honda, Oyama: “Using a Lippmann holographic stereogram. Holographic 3D Printer ", 20th Imaging Engineering Conference, 1989 1
February ”○“ Endo, Yamaguchi, Honda, Oyama: “Holographic 3”
As described in "High-Density Recording of D Printer", 23rd Image Engineering Conference, December 1992, there is a system for producing a printed matter capable of expressing parallax in both vertical and horizontal directions.

A system for producing a printed matter using such parallax images displays a plurality of still images like moving images, so that a plurality of images from different viewpoints are photographed by a dedicated photographing device. Alternatively, a printed matter can be manufactured by generating a plurality of images from different viewpoints by computer graphics (CG).

On the other hand, in recent years, devices that handle digital images, such as so-called digital still cameras and digital video camera recorders, have become widespread. With the spread of these devices, a so-called panoramic image is obtained by capturing a continuous image or a transverse image as image data and connecting these images to a device capable of performing image processing such as a computer. Images are also being generated.

As software for generating such a panoramic image, for example, "PictureGear Ve sold by" Sony Corporation "is released.
rsion4.0 (trademark) "and PictureGear Version5.0 (trademark) ○ Developed by" US Live Picture Inc. "," Reality Studio (trademark) "released by" Live Picture Japan Co., Ltd. " ) ○ "QuickTime VR Authoring Studio (trademark)" developed by "Apple Computer Inc. in the United States" and released by "Apple Computer Co., Ltd." ○ Sold by "Sanyo Electric Co., Ltd." Examples include "Panorama Boutique Light (TM)", "Panorama Boutique Pro (TM)" and "Tiling Boutique (TM)".

[0008]

By the way, when a parallax image sequence is photographed and obtained as in the above-described system for producing printed matter, the photographing field angle in the photographing device, the positional relationship between the photographing viewpoint and the subject are determined. There are various parameters such as the photographing distance shown, the moving distance of the photographing apparatus, and the photographing pitch. Further, when a holographic stereogram is produced and output as a printed matter, the printing apparatus also needs various parameters such as how much viewing angle exposure recording is performed and at what exposure pitch exposure recording is performed. And

Here, in the case of producing a printed matter such as a holographic stereogram using a parallax image sequence obtained by being photographed by the photographing device, it is necessary to match various parameters of the photographing device with those of the printing device. It is necessary to take this, and if this alignment cannot be obtained, a correct stereoscopic image cannot be obtained.

The parallax image sequence can also be generated as a computer image by CG or the like. In the case of producing a printed matter such as a holographic stereogram using the parallax image sequence generated by the CG or the like, similarly, various parameters at the time of image generation and various parameters in the printing device can be matched. This is an essential condition for obtaining a correct stereoscopic image.

Such conditions are the same for an image recorded as a background for a printed matter such as a holographic stereogram. As such a background image, a two-dimensional image such as a continuous image or a panoramic image generated by joining the transverse images can be considered. Normally, when capturing continuous images or cross-flow images, it is necessary to accurately capture the error in the direction of movement of the line of sight such as vertical movement of the camera, the error in the amount of movement of the line of sight due to the camera not being at a constant speed, and camera shake. Considering various obstructing factors, for example, as shown in FIG. 15 (A), as shown in FIG. 15 (A), a camera HCM that moves in the horizontal direction, which is a parallax direction, or a subject as shown in FIG. For the object OBJ, it is necessary to use a dedicated camera such as a camera RCM that rotates horizontally at a fixed position.

However, the setting of the above-mentioned various parameters in the continuous image or the horizontal flow image is performed at the time of photographing and / or CG generation and at the time of printing the panoramic image generated based on the continuous image or the horizontal flow image, respectively. Since it was done individually, the processing is complicated and time consuming,
Further, there is a problem that a correct background image cannot be obtained without knowing the parameter, and a correct panoramic image cannot be observed through a printed matter.

The present invention has been made in view of the above circumstances, and a large still image such as a panoramic image can be recorded as a background image for observation on a printed matter such as a holographic stereogram. It is an object of the present invention to provide a background image generation device and a background image generation method.

[0014]

A background image generating apparatus according to the present invention which achieves the above-mentioned object, a background image for a printed matter manufactured based on a parallax image sequence composed of a plurality of parallax images including parallax information. A background image generation apparatus for generating an image to be recorded as a photographing device or a virtual image based on a spatiotemporal parameter that is temporal and / or spatial information necessary for photographing or image generation read from the outside. Image generating means for generating a plurality of images by moving the viewpoint of the image capturing device, and an image for converting the plurality of images generated by the image generating means into a panoramic image to be recorded as a background The viewpoint conversion means includes a conversion means and a viewpoint conversion means for generating a plurality of viewpoint conversion images based on the panoramic image converted and generated by the image conversion means. , Reproduced image of the panoramic image reproduced from the printed matter to be produced so as to localize the observation viewpoint to a predetermined distance, based on the space-time parameter, is characterized by generating a plurality of viewpoint conversion image.

In such a background image generating apparatus according to the present invention, a plurality of images are generated by the image generating means based on the desired spatiotemporal parameters read from the outside, and the image converting means is based on the plurality of images. A panoramic image to be recorded as a background is generated by the viewpoint converting means based on the spatiotemporal parameters so that the panoramic image is localized at a predetermined distance from the observation viewpoint.

Further, according to the background image generating method of the present invention which achieves the above object, an image to be recorded as a background for a printed matter manufactured based on a parallax image sequence composed of a plurality of parallax images including parallax information. A viewpoint image of a photographing device or a virtual photographing device based on a spatiotemporal parameter that is a temporal and / or spatial information necessary for photographing or image generation read from the outside. And an image conversion step of performing shooting by generating a plurality of images, and an image conversion step of performing conversion processing of the plurality of images generated in this image generation step into a panoramic image to be recorded as a background. And a viewpoint conversion step of generating a plurality of viewpoint conversion images based on the panoramic image converted and generated in the image conversion step. As reproduced image of the panoramic image to be reproduced from the object is localized from the viewing perspective in a predetermined distance, based on the space-time parameter, it is characterized in that a plurality of viewpoint conversion image is generated.

In the background image generating method according to the present invention as described above, a plurality of images are generated based on desired spatiotemporal parameters read from the outside, and a panoramic image to be recorded as a background is recorded based on the plurality of images. A plurality of viewpoint conversion images are generated based on the spatiotemporal parameters so that this panoramic image is localized at a predetermined distance from the observation viewpoint.

[0018]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Specific embodiments to which the present invention is applied will be described in detail below with reference to the drawings.

This embodiment is a printed matter manufacturing system for providing a two-dimensional still image as a printed matter. This printed matter manufacturing system uses a parallax image photograph using a lenticular technique, or a parallax image printed matter such as a holographic stereogram, and is exposed based on a parallax image sequence including a plurality of parallax images including parallax information. By recording a large still image such as a so-called panoramic image as a background image of the exposure recorded image reproduced as a three-dimensional image by recording so as to be localized at a predetermined distance from the observation viewpoint, printed matter can be obtained. However, the present invention manufactures a printed matter that allows observation of all information of the image from a display surface that is physically smaller than the size of the image, such as viewer software, as well as the three-dimensional image.

Conceptually, for example, as shown in FIG. 1, the observer OB observes the reproduced image of the panoramic image PI, which is a still image, through the printed matter P manufactured by the printed matter manufacturing system. Here, the printed matter P is recorded such that the reproduced image of the panoramic image PI is localized at a predetermined distance behind the display surface of the printed matter P. Therefore, the observer OB can observe, through the printed matter P, the area of the panoramic image PI surrounded by the broken line in the figure. Then, the observer OB, as shown in FIG.
By printed matter P from the position of the observation, the area PI _A surrounded by the broken line in the drawing portion of the panoramic image PI can be observed through the printed material P, by observing the printed matter P from the position of B A region PI _B of the panoramic image PI surrounded by a broken line in the figure can be observed through the printed matter P. Therefore, the observer OB can observe all the information of the panoramic image PI from the display surface of the printed matter P that is physically smaller than the size of the panoramic image PI by observing the printed matter P from different observation viewpoints. .

The printed matter manufacturing system reproduces a three-dimensional image based on an image sequence obtained by photographing an object with a photographing device and / or an image sequence generated by computer graphics (CG). When a panoramic image as a background image of an exposure recorded image is generated, various parameters that are temporal and / or spatial information necessary for shooting and / or generation of image data are stored by a storage server that is a storage device. It is managed in a unified manner and / or managed by recording on a recording medium, and by using this spatiotemporal parameter, a plurality of images to be described later are arranged so that the reproduced image of the panoramic image is localized at a predetermined distance from the observation viewpoint. The viewpoint conversion image is generated.

Now, a printed matter manufacturing system capable of manufacturing such a printed matter P will be described. In addition,
In the following description, the printed matter manufacturing system will be described as a method of manufacturing, as the printed matter P, a holographic stereogram on which a holographic stereogram image is exposed and recorded.

As shown in FIG. 3, the printed matter manufacturing system uses the spatiotemporal parameter T stored in the storage server 100.
Spatio-temporal parameter T recorded in SP or recording medium MD
The printed matter P is manufactured by the printed matter manufacturing apparatus 1 using SP.

The printed matter manufacturing apparatus 1 manufactures a printed matter P based on an image processing computer 10 that performs image processing and a viewpoint-converted image sequence PXI composed of a plurality of viewpoint-converted images generated by the image-processing computer 10. And a printing unit 60.

The image processing computer 10 has an image generating unit 20 which is an image generating means for generating an image sequence I composed of a plurality of images, and an image sequence I composed of a plurality of images generated by the image generating unit 20. On the other hand, an image conversion unit 30 that is an image conversion unit that performs conversion processing into a panoramic image,
The image processing unit 40, which is a viewpoint conversion unit that generates a viewpoint conversion image sequence PXI composed of a plurality of viewpoint conversion images based on the panoramic image PI converted and generated by the image conversion unit 30, and the printing unit 60 are controlled. And a print control unit 50.

The image generating section 20 takes continuous images with a digital still camera (not shown),
An image sequence I composed of a plurality of images of at least two sheets is generated such that a transverse image is captured by a so-called video camera recorder. In addition, the image generation unit 20
Can also generate a continuous image and a lateral flow image by CG assuming a virtual imaging device. At this time, the image generation unit 20 may, for example, use a USB (Universal Serial Bu
s) (trademark), IEEE (The Institute of Electrical
and Electronics Engineers, Inc.) approved IEEE Std. 1394-1995 IEEE Standard for a High Per
formance serial Bus standard, SCSI (Small Computer)
System Interface) or RS-232C interface, and various spatiotemporal parameters stored in the storage server 100 connected via a network interface including Ethernet (registered trademark) or a telephone line, etc. Under the control of the control unit, the spatiotemporal parameter TSP necessary for photographing is read, and photographing or image generation by CG is performed based on this spatiotemporal parameter TSP.

Here, the spatiotemporal parameter TSP is the subject distance when the image is photographed or generated,
Viewing angle (angle of view) information such as resolution and / or focal length on the focal plane, model name information of the camera used for shooting, shooting time, moving distance, and / or shooting pitch, and the like,
It is composed of information indicating shooting conditions.

The image generating unit 20 is composed of a plurality of images under the control of a control unit (not shown) for photographing or image generation under the control of the spatiotemporal parameter TSP. The image sequence I is generated.

Further, the image generating section 20 includes, for example, a magnetic recording medium FD such as a so-called flexible disk or hard disk, a semiconductor recording medium MM such as a memory stick (trademark), a compact flash (registered trademark) or a smart medium (trademark), CD-ROM (Compact Disc-R
ead Only Memory), CD-R (Compact Disc-Record)
or a recording medium MD such as an optical recording medium such as a DVD (Digital Versatile Disc) or a magneto-optical recording medium OD such as an MO (Magneto Optical), and receiving distribution of a recording medium MD in which various spatiotemporal parameters are recorded, The spatiotemporal parameter TSP necessary for photographing or image generation is read out from various spatiotemporal parameters recorded by mounting the recording medium MD under the control of a control unit (not shown), and the spatiotemporal parameter TSP is set as the spatiotemporal parameter TSP. It is also possible to perform shooting or image generation based on this.

The image generation unit 20 uses the spatiotemporal parameter TSP used for photographing or image generation as, for example, the image file format standard Exif (Exif Version 2.1, the image file format standard for digital still cameras (Ex
if) Version 2.1, based on the recording format by Japan Electronic Industry Development Association, 1998), recording is performed on each image forming the generated image sequence I. This spatiotemporal parameter TSP
Is used by the image processing unit 40 as a spatiotemporal parameter required when the printed matter P is manufactured, such as what viewing angle is used for exposure recording and what exposure pitch is used for exposure recording.

The image sequence I composed of a plurality of images generated by the image generating unit 20 is supplied to the image converting unit 30.

The image conversion unit 30 connects the plurality of images forming the image sequence I to each other to form the panoramic image PI.
Convert to. At this time, the image conversion unit 30 generates the panoramic image PI using any existing method. For example,
The image conversion unit 30 obtains a geometrical positional relationship such as translation, rotation, enlargement, reduction, etc. by obtaining a spatial correlation of each image forming the image sequence I, and based on the obtained geometrical positional relationship. Then, spatial processing such as translation, rotation, enlargement, and reduction is applied, and then superposition and joining are performed. In addition, the image conversion unit 30 determines the area to be overlapped and adjusts the degree of superimposition of each image according to the spatial correlation of each image when performing superimposition and joining of the images. It is possible to generate the panoramic image PI with few seams or difficult to see.

If the viewing angle information as the spatiotemporal parameter TSP described above is recorded in each image forming the image sequence I, the printed matter manufacturing apparatus 1 and the viewing angle information and the geometry of each image. The viewing angle information of the combined panoramic image PI can be obtained based on the physical positional relationship. Further, when the above-mentioned model name information is recorded in each image forming the image sequence I instead of the view angle information, the printed matter manufacturing apparatus 1 uses the model name information to view the view angle of each image. You can also ask. These pieces of viewing angle information are used for mapping conversion processing in the image processing unit 40 described later.

Further, the image conversion section 30 uses the panoramic image P.
When I is generated, the spatial shape of the panoramic image PI can be arbitrarily determined such that the spatial shape is a flat surface, a cylindrical surface, or a spherical surface. For example, the fish-eye lens is for displaying a panoramic image to be projected on a spherical surface by projecting it on a plane, and the image conversion unit 30 is similar to the panoramic image observed through the fish-eye lens, but the panoramic image P is used.
The spatial shape of I can be calculated and generated. The image conversion unit 30 can additionally record, in the generated panoramic image PI, projection method information indicating what spatial shape the panoramic image PI is projected on. This projection method information is used for mapping conversion processing in the image processing unit 40 described later.

The panoramic image PI generated by the image conversion unit 30 is supplied to the image processing unit 40.

The image processing section 40 performs mapping conversion processing (viewpoint conversion processing) for locating the reproduced image of the panoramic image PI finally reproduced as a holographic stereogram image at a predetermined distance. Here, in the mapping conversion process, when the printed matter P is manufactured, the reconstruction image of the panoramic image PI reproduced as a holographic stereogram image is reconfigured so as to be localized at a predetermined distance from the observation viewpoint, and the viewpoint is converted. This is a process of generating a changed viewpoint conversion image. In this mapping conversion process, the distance information indicating the distance to which the reproduced image of the panoramic image PI reproduced in the finally manufactured printed matter P is localized is one of the parameters to be predetermined. When the image processing unit 40 knows the viewing angle information of the panoramic image PI, the image processing unit 40 can calculate the distance at which the reproduced image should be localized in association with the viewing angle information. Also,
When the image processing unit 40 knows the projection method information of the panoramic image PI, it uses this projection method information to
The viewpoint conversion image sequence PXI can be generated. The plurality of viewpoint-converted images forming the viewpoint-converted image sequence PXI generated by the image processing unit 40 are respectively displayed element units that are sequentially displayed on a transmissive liquid crystal display described later when exposure recording is performed as a holographic stereogram. Is supplied to the printing unit 60 as the element hologram image. The mapping conversion process will be described later in detail.

The print control section 50 controls each section of the printed matter manufacturing apparatus 1 in a centralized manner, and particularly controls the operation of the print section 60.

Under the control of the print control unit 50, the printing unit 60 manufactures the printed matter P based on the viewpoint-converted image sequence PXI composed of a plurality of viewpoint-converted images that are element hologram images. Specifically, the printing unit 60 has a predetermined optical system for producing a holographic stereogram, and uses a plurality of viewpoint conversion images forming the viewpoint conversion image sequence PXI as element hologram images on a hologram recording medium. A holographic stereogram is produced by exposing and recording, and a printed matter P is manufactured by subjecting the holographic stereogram to a predetermined fixing process. The configuration of the printing unit 60 will be described in detail later.

Such a printed matter manufacturing apparatus 1 generates a panoramic image PI based on an image sequence I composed of a plurality of images, and a reproduction image of the panoramic image PI is predetermined so as to be localized at a predetermined distance from an observation viewpoint. By performing the mapping conversion processing of No. 1 and exposing and recording each viewpoint conversion image forming the obtained viewpoint conversion image sequence PXI as an element hologram image on the hologram recording medium, a display physically smaller than the size of the panoramic image PI is displayed. It is possible to produce a printed matter P consisting of a holographic stereogram with a face. Therefore, as shown in FIG. 2, the printed matter manufacturing apparatus 1 has the printed matter P viewed from different observation viewpoints by the observer OB.
By observing, all information of the panoramic image PI can be observed.

In the printed matter manufacturing apparatus 1, when processing is performed using a digital image, the image generation unit 2
0, the image conversion unit 30, the image processing unit 40, and the printing unit control unit 50 can be implemented not only as hardware but also as image processing software operable by the image processing computer 10.

The configuration of the printing unit 60 described above will be described in detail below with reference to FIGS. 4 to 7. Here, first
Prior to the description of the configuration of the printing unit 60, the principle of exposure recording of element holograms on the hologram recording medium will be described.

As shown in FIG. 4, in the hologram recording medium 110, for example, a photopolymer layer 112 made of a photopolymerizable photopolymer is formed on a long base film 111, and the photopolymer layer 112 is formed. It is a so-called film coating type recording medium in which a cover film 113 is adhered and formed on.

Such a hologram recording medium 110
As shown in FIG. 5A, in the initial state, the photopolymerizable photopolymer forming the photopolymer layer 112 is in a state in which the monomers M are uniformly dispersed in the matrix polymer. Photopolymerizable photopolymer is 10 mJ / cm ²
To LA laser light having a power of ˜400 mJ / cm ²
As shown in FIG. 2B, the monomer M uniformly dispersed in the matrix polymer in the exposed portion is polymerized into a polymer by the irradiation of the light.

In the photopolymerization type photopolymer, the refractive index of the exposed portion and the unexposed portion is modulated due to the unevenness of the concentration of the monomer M caused by the movement of the monomer M from the surroundings as the polymer is polymerized. After that, the photopolymerizable photopolymer is irradiated with ultraviolet rays or visible light LB having a power of about 1000 mJ / cm ^{2 on the} entire surface, as shown in FIG. Is completed. In the hologram recording medium 110, since the photopolymerization type photopolymer forming the photopolymer layer 112 changes its refractive index according to the incident laser beam LA, the interference between the object beam and the reference beam causes interference. The resulting interference fringes are exposed and recorded as changes in the refractive index.

The printing unit 60 includes the hologram recording medium 11
By using a film coating type recording medium in which the photopolymer layer 112 is made of such a photopolymerizable photopolymer as 0, a step of performing a special development process on the hologram recording medium 110 after exposure is unnecessary. . Therefore, the printing unit 60 can simplify the configuration by eliminating the need for a developing device and the like, and can quickly manufacture the holographic stereogram.

Now, such a hologram recording medium 1
The holographic stereogram image is exposed and recorded to 10 to produce a holographic stereogram,
The printing unit 60 that manufactures the printed matter P has an optical system 70 for making a holographic stereogram, as shown in FIG. In the printing unit 60, although not shown, each member constituting the optical system 70 is disposed and supported on a support substrate (optical surface plate), and the support substrate is supported by the apparatus housing via a damper. . The optical system 70 is
Incident optical system 70A, object optical system 70B, and reference optical system 7
With 0C. Since the printing unit 60 uses the hologram recording medium 1 that is a photosensitive material in order to produce the holographic stereogram as the printed matter P,
The device housing has a structure in which at least the light blocking property of the optical system 70 is retained.

The incident optical system 70A includes a laser light source 71 for emitting laser light L1 having a predetermined wavelength, and the laser light source 7
The laser light L1 is arranged on the optical axis of the laser light L1 from
A shutter mechanism 72 for making the light incident on the rear stage or blocking it,
It has a half mirror 73 that splits the laser beam L1 into an object beam L2 and a reference beam L3.

The laser light source 71 is, for example, a semiconductor-excited YAG which emits laser light L1 having a single wavelength and good coherence.
It is composed of a laser device, a water-cooled argon ion laser device, a water-cooled krypton laser device, or the like.

The shutter mechanism 72 uses the viewpoint conversion image sequence PX.
The opening / closing operation is performed by the control signal output from the print control unit 50 corresponding to the output timing of the viewpoint conversion image which is the element hologram image forming I, and the laser light L
1 is made incident on the optical system at the subsequent stage, or laser light L1
The light is blocked from entering the optical system in the subsequent stage.

The half mirror 73 splits the incident laser light L1 into transmitted light and reflected light. The laser light L1 is
The transmitted light is used as the above-mentioned object light L2, while the reflected light is used as the reference light L3. These object light L
2 and the reference light L3 are incident on the object optical system 70B or the reference optical system 70C provided at the subsequent stage, respectively.

Although not shown, the incident optical system 70A can change the traveling direction of the laser light L1 as appropriate so that the object light L
A mirror or the like may be provided for the purpose of making the optical path lengths of 2 and the reference light L3 the same. In addition, the shutter mechanism 72
Is, for example, a device configured to mechanically drive a shutter piece, or an acousto-optic modulator (Acousto-Optic Modulati
on; AOM). That is, the shutter mechanism 72 only needs to be openable and closable so as to shield and transmit the laser light L1.

The object optical system 70B includes optical elements such as a mirror 74, a spatial filter 75, a collimator lens 76, a projection lens 77, a cylindrical lens 78, and a mask 79, as shown in FIGS. Each of these optical components is sequentially arranged from the input side along the optical axis.

The mirror 74 reflects the object light L2 transmitted through the half mirror 73. The object light L2 reflected by the mirror 74 is incident on the spatial filter 75.

The spatial filter 75 is constructed by combining, for example, a convex lens and a pinhole, and the object light L2 reflected by the mirror 74 corresponds to the display surface width of the transmissive liquid crystal display 80 which will be described later. Expand in a direction.

The collimator lens 76 collimates the object light L2 magnified by the spatial filter 75 and guides it to the transmissive liquid crystal display 80.

The projection lens 77 slightly diffuses the object light L2 and projects it onto the cylindrical lens 78. This projection lens 77 contributes to the improvement of the image quality of the holographic stereogram produced by slightly diffusing the object light L2.

The cylindrical lens 78 focuses the parallel object light L2 in the horizontal direction.

The mask 79 has a strip-shaped opening, and the object light L2 condensed by the cylindrical lens 78 that passes through the opening is made incident on the hologram recording medium 110.

In the object optical system 70B, a transmissive liquid crystal display 80 is arranged between the collimator lens 76 and the projection lens 77. Transmissive liquid crystal display 80
, The viewpoint conversion images are sequentially displayed as element hologram images based on the viewpoint conversion image sequence PXI supplied from the image processing unit 40 described above. In the printing unit 60, the control signal output from the print control unit 50 corresponding to the output timing of the viewpoint-converted image sequence PXI from the image processing unit 40 causes the recording medium feeding mechanism of the hologram recording medium 110 described later. When the hologram recording medium 110 is supplied to the control unit 84 and its operation is controlled, the feeding operation of the hologram recording medium 110 is controlled.

In such an object optical system 70B,
The object beam L2 in the form of a thin beam that is split and incident from the incident optical system 70A is expanded by the spatial filter 75 and is incident on the collimator lens 76 to be collimated. Furthermore, the object optical system 70B
, The object light L2 entering the transmissive liquid crystal display 80 via the collimator lens 76 is image-modulated according to the element hologram image displayed on the transmissive liquid crystal display 80, and the projection lens 77 It is incident on the cylindrical lens 78 via. Then, the object optical system 70B allows the image-modulated object light L2 to enter the hologram recording medium 110 through the opening of the mask 79 while the shutter mechanism 72 is being opened, and corresponds to the element hologram image. This is exposed and recorded.

The reference optical system 70C has a spatial filter 81, a collimator lens 82 and a mirror 83,
Each of these optical components is sequentially arranged from the input side along the optical axis.

The spatial filter 81 is different from the spatial filter 75 in the above-described object optical system 70B, and is constituted by combining, for example, a cylindrical lens and a slit, and the reference light L3 reflected and divided by the half mirror 73 is predetermined. The width is increased in the one-dimensional direction, specifically, the width of the display surface of the transmissive liquid crystal display 80.

The collimator lens 82 collimates the reference light L3 magnified by the spatial filter 81.

The mirror 83 reflects the reference light L3 and guides the reference light L3 to the rear side of the hologram recording medium 110 to make it enter.

The optical system 70 as described above includes the half mirror 7
The object optical system 70B, which is an optical system through which the object light L2 divided by 3 passes, and the reference optical system 70C, which is an optical system through which the reference light L3 passes, have substantially the same optical path length. Therefore, the optical system 70 can improve the coherence between the object light L2 and the reference light L3, and can manufacture a holographic stereogram in which a clearer reproduced image is obtained.

Further, the printing section 60 is provided with a recording medium feeding mechanism 84 for intermittently feeding the hologram recording medium 110 in the direction indicated by the arrow a in FIG. 6B by one element hologram. By 84, the hologram recording medium 110 is caused to run along the recording medium running system shown in FIG. Here, the hologram recording medium 110 is made of a long photosensitive film, as shown in FIG.
It is wound around a supply roll 91a that is rotatably provided inside the unit 1. When the film cartridge 91 is loaded into the printing section 60, the hologram recording medium 110 is
The recording medium feeding mechanism 84 is fed inside the printing unit 60.
The recording medium running system is driven by.

As shown in FIG. 7, the recording medium running system includes a supply roll 91a, a recording medium feeding mechanism 84, and
Heat roller 93 and a pair of discharge rollers 94a and 94b
And has a substantially S-shape by the cutter 95 and the like. An ultraviolet lamp 92 is arranged in the recording medium running system, between the recording medium feeding mechanism 84 and the heat roller 93.

The recording medium feeding mechanism 84 is used for recording the hologram recording medium 11 fed from the film cartridge 91.
It is configured by a drive roller 96 that holds 0 and travels, a pinch roller 97 that rotates by being driven by the drive roller 96, a stepping motor (not shown) that constitutes a drive source of the drive roller 96, and the like. Recording medium feeding mechanism 8
The drive roller 9 is driven by the drive roller 96, which is intermittently rotated by a stepping motor based on the control signal supplied from the print controller 50.
The hologram recording medium 110 sandwiched between 6 and the pinch roller 97 is intermittently driven to run.

The ultraviolet lamp 92 is arranged along the recording medium running system between the driving roller 96 and the heat roller 93 as described above. The ultraviolet lamp 92 is a hologram recording medium 1 on which a holographic stereogram formed by interference fringes of the object light L2 and the reference light L3 is exposed and recorded.
By irradiating 10 with ultraviolet LB having a power of about 1000 mJ / cm ² , polymerization of the monomer M is completed in the matrix polymer.

The heat roller 93 drives the hologram recording medium 110 around its outer periphery so that the hologram recording medium 110 runs at a winding angle of about half a circle. Further, the heat roller 93 has a heater 93a therein and is heated at a temperature of about 120 ° C. to heat the hologram recording medium 110 to increase the refractive index modulation degree of the photopolymer layer 112. Let

The discharge rollers 94a and 94b are intermittently driven in synchronization with the drive roller 96 by a stepping motor driven based on the control signal supplied from the print controller 50 described above. Discharge rollers 94a and 94b
Sends the hologram recording medium 110 intermittently corresponding to the one-element hologram every time the exposure recording for one-element hologram image is completed. Therefore, the hologram recording medium 110 travels in a state of being in close contact with the outer peripheral portion of the heat roller 93 without being bent by the discharge rollers 94a and 94b and the recording medium feeding mechanism 84 described above.

The cutter 95 is driven by a driving mechanism (not shown) driven based on the control signal supplied from the above-mentioned print control unit 50, and runs the hologram recording medium 110 of a certain length, that is, a holographic stereo. Cut every gram image.

The printing section 60 having such an optical system 70 and recording medium running system sends a control signal corresponding to the one-element hologram from the print control section 50 to the recording medium each time the exposure recording for one-element hologram image is completed. The object optical system 70B and the reference optical system 70 are supplied to the mechanism 84.
The hologram recording medium 1 is arranged so that the optical axes of C and C are orthogonal to the front and back surfaces of the hologram recording medium 110, respectively.
10 is driven to run along the running path by an amount corresponding to the one-element hologram, and the unexposed portion is made to correspond between the supply roll 91a and the drive roller 96 and stopped. The printing unit 60 is configured to quickly stop the vibration generated in the hologram recording medium 110 as the hologram recording medium 110 travels.

In this state, the printing section 60 has the shutter mechanism 7
2 is opened and image-modulated from the front and back surfaces of the hologram recording medium 110 from the object light L2 and the reference light L.
3 and 3 are made incident, and interference fringes corresponding to the element hologram image are exposed and recorded. When the exposure recording of the one-element image ends, the printing unit 60 causes the print control unit 50 to move the recording medium feeding mechanism 84.
Control signal is supplied to the hologram recording medium 1
10 is rapidly driven by a predetermined amount and stopped.

Further, the printing unit 60 includes the hologram recording medium 1 using the ultraviolet lamp 92 in the recording medium running system.
The holographic stereogram image exposed and recorded on the hologram recording medium 110 is subjected to a fixing process including irradiation processing of ultraviolet rays on the hologram recording medium 10 and heat treatment on the hologram recording medium 110 by the heat roller 93 at a predetermined temperature. Fix it. The printing unit 60 inserts the hologram recording medium 110, which has been subjected to the fixing process, into the cutter 9
Each holographic stereogram image is sequentially cut out by 5 to a predetermined size, and a mount or the like is attached if necessary, and the holographic stereogram is ejected to the outside as a printed matter P including one holographic stereogram.

The printing unit 60 successively performs this operation to produce a holographic stereogram,
The printed matter P is manufactured.

Now, hereinafter, the mapping conversion processing (viewpoint) in the image processing section 40 for generating the viewpoint conversion image sequence PXI as the element hologram image displayed on the transmission type liquid crystal display 80 in the printing section 60 will be described below. The conversion process) will be described in detail.

In the printed matter manufacturing apparatus 1, as described above, the image processing unit 40 performs the mapping conversion process on the panoramic image PI based on the spatiotemporal parameter TSP, and the printing unit 60 records the hologram recording medium 110 on the hologram recording medium 110. On the other hand, a viewpoint conversion image sequence PXI including a plurality of viewpoint conversion images to be exposed and recorded as element hologram images is generated. In the printed matter manufacturing apparatus 1, as shown in FIG. 8 by performing the mapping conversion processing, the display surface of the printed matter P, that is, the hologram surface SF, is separated from the observation viewpoint by the observer OB by a predetermined distance e. From this, it is possible to manufacture the printed matter P in which the panoramic image PI is reproduced as a holographic stereogram image at a position further separated by a predetermined distance f. Regarding the basic principle of this mapping conversion processing, two-dimensional image information such as character string information and image information is combined with a holographic stereogram image and exposed and recorded at an arbitrary depth position of the hologram recording medium. This is described in Japanese Patent Application Laid-Open No. 11-109839 previously filed by the applicant. First, regarding this basic principle,
A brief description will be given with reference to FIGS. 9 to 12.

The holographic stereogram can be produced by an optical system similar to the optical system 70 in the printing section 60, and the object light transmitted through the display means corresponding to the above-mentioned transmissive liquid crystal display 80 is shown in FIG. As shown in
It is condensed in the lateral direction by the optical component OP corresponding to the above-mentioned cylindrical lens 78, and is incident on the hologram recording medium.

Here, the image corresponding to the element hologram image which is exposed and recorded by the object light transmitted through the display means is called a projection image PJ, and the display surface to which the condensing point of the object light belongs is called a hologram surface SF. A surface at a depth position separated from the hologram surface SF on which an image is exposed and recorded by z is referred to as a screen surface SC. This screen surface SC
Is a virtual surface, and indicates that the image is projected in the area indicated by the hatched portion in FIG. This screen surface SC
The image projected on top is called the virtual projection image VP. This virtual projection image VP corresponds to the image actually exposed and recorded at the predetermined depth position z [mm].

Further, the length in the horizontal direction (parallax direction) of the projected image PJ is Ys [mm], and the vertical direction (non-parallax direction).
Is Xs [mm], and the number of pixels in the horizontal direction is Ysp [pixe
l], and the number of pixels in the vertical direction is Xsp [pixel]. Further, the length in the horizontal direction (parallax direction) of the virtual projection image VP is Yh [mm], and the length in the vertical direction (non-parallax direction) is Xh [m].
m], the number of pixels in the horizontal direction is Yhp [pixel], and the number of pixels in the vertical direction is Xhp [pixel]. The virtual projected image V
The vertical length Xh [mm] in P is equal to the vertical length Xs [mm] in the projection image PJ, and accordingly, the vertical pixel number Xhp [pixel] in the virtual projection image VP is
It is equal to the number of vertical pixels Xsp [pixel] in the projection image PJ. Further, it is desirable that the number of horizontal pixels Yhp [pixel] in the virtual projected image VP be the aspect ratio of the virtual projected image VP with respect to the number of vertical pixels Xsp [pixel] in the projected image PJ. That is, the virtual projected image VP
Regarding the number of pixels Yhp [pixel] in the horizontal direction in, it is desirable that Yhp = Xsp × (Yh / Xh) (1) as shown in the following equation (1).

Further, the optical component O for condensing the projection image PJ
As for P, if the focal length is f [mm] and the converging angle is θ [degree], as shown in the following equation (2), θ = tan ⁻¹ (Ys / f) (2) It will satisfy the relationship. Further, the distance from the observation viewpoint by the observer OB to the hologram surface SF is e [mm].

Under these conditions, on the hologram surface SF, as shown in FIG. 10A, the virtual projection image VP is projected in a region where the screen surface SC is seen from a certain point PP in the horizontal direction. To be done. Therefore, on the screen surface SC, of the number of pixels Yhp [pixel] in the horizontal direction in the virtual projection image VP, (Yhp × Yi / Yh) [pixel]
It suffices that the pixel extracted from is projected. However,
Yi is Yi = 2 × z × tan (θ / 2) (3) as shown in the following expression (3). As is clear from this principle, in the mapping conversion processing, when an image is exposed and recorded at a predetermined depth position z [mm] of the hologram recording medium, the distance e [mm from the observation viewpoint to the hologram surface SF ] Is not a limitation.

On the other hand, as shown in FIG. 6B, the image is exposed and recorded at a predetermined depth position z [mm] from the hologram surface SF, so that the projection image PJ is vertically aligned on the hologram surface SF. It must be scaled down by a factor of e / (e + z). In the projection image PJ, the length (Xs × e / (e + z)) [mm] in the vertical direction on the hologram surface SF is exposed and recorded as it is without being enlarged or reduced from the screen surface SC. Therefore, on the screen surface SC, the number of vertical pixels Xhp [pixel] in this virtual projection image VP.
Of these, it is sufficient to project the extracted pixels of (Xhp × e / (e + z)) [pixel].

Further, in the mapping conversion process,
It is necessary to consider the relationship between the moving pitch dy [mm] on the hologram surface SF and the center position of the cutout range on the screen surface SC. This relationship is (Yhp × dy / Yh) [pixe with respect to the original image when an image corresponding to the element hologram image to be displayed on the display means is generated.
It is sufficient to give the movement conditions of l].

FIG. 11 shows a summary of the relationship between the image corresponding to one element hologram image whose viewpoint has been converted by such mapping conversion processing and the reproduced image. The object light transmitted through the display means corresponding to the above-mentioned transmissive liquid crystal display 80 on which the image subjected to the mapping conversion processing is displayed is exposed and recorded at the depth position z [mm] of the hologram recording medium. In the projected image PJ, the length in the horizontal direction (parallax direction) is Yr [mm], the length in the vertical direction (non-parallax direction) is Xr [mm], and the number of pixels in the horizontal direction is Yrp.
Let [pixel] be the number of pixels in the vertical direction be Xrp [pixel].
The vertical resolution Mr [pixel] of the projected image PJ
/ mm] is expressed by the following expression (4): Mr = Xrs / Xr [pixel / mm] (4)

At this time, the reconstructed image E reconstructed with respect to the element hologram exposed and recorded by the projection image PJ.
PL is assumed to be located at a position virtually separated by a predetermined distance D [mm] from the observation point of view of the observer OB, and the distance from the observation point of view of the observer OB to the hologram surface SF is e [mm]. Then, the virtual distance from the hologram surface SF to the reproduced image EPL is k [mm], which is the difference between the distance D and the distance e.

In this case, regarding the size of the reproduced image EPL, assuming that the length in the horizontal direction (parallax direction) is Yt [mm] and the length in the vertical direction (non-parallax direction) is Xt [mm], respectively, As shown in the following equations (5) and (6), Yt = (Yr / z) × k = 2 × tan (θ / 2) × k (5) Xt = (Xr / e) × D = (Xr / e) × (e + k) (6) Further, the vertical resolution Mt [pixel / mm] in the reconstructed image EPL for the image corresponding to one element hologram image whose viewpoint is converted is expressed by the following equation (7): Mt = Mr × (Xr / Xt) = Mr × (e / D) (7)

Further, the relationship of the reproduced image with the size of the holographic stereogram finally produced is summarized as shown in FIG.

The size of the reproduced image PL reproduced from the entire produced holographic stereogram is determined by the intervals of the reproduced images EPL of the element holograms located at both ends thereof. That is, when the horizontal length in the holographic stereogram is Yu [mm] and the vertical length is Xu [mm], the interval between the element holograms located at both ends is Yu [mm]. Then, as shown in FIG. 11, the length in the lateral direction (parallax direction) of the reproduced image EPL reproduced for these element holograms is Yt [mm].
Since the length in the vertical direction (non-parallax direction) is Xt [mm], the size of the reproduced image PL is horizontal (parallax direction).
Is Yv [mm] and the length in the vertical direction (non-parallax direction) is Xv [mm], as shown in the following equations (8) and (9), Yv = Yu + Yt = Yu + (Yr / z) × k (8) Xv = Xt = (Xr / e) × D = (Xr / e) × (e + k) (9) The vertical resolution Mv [pixel / mm] in the reconstructed image PL for the image corresponding to one element hologram image whose viewpoint has been converted does not change, and Mv = Mt = Mr × (Xr / Xt) = Mr × (e / D) (10) Here, the vertical direction in the holographic stereogram is the non-parallax direction, and the projection image PJ incident by the object light is exposed and recorded as an element hologram at the same magnification in the vertical direction.
In the size relationship between J and the holographic stereogram, Xr = Xu.

In the printed matter manufacturing apparatus 1, while the panoramic image PI is generated by the image conversion unit 30 described above, the holographic stereogram is applied by the image processing unit 40 described above by applying the principle having such a relationship. Mapping conversion processing is performed so that the reproduced image of the panoramic image PI reproduced as an image is localized at a predetermined distance from the observation viewpoint. At this time, the image processing unit 40 uses one of the following three methods to generate the panoramic image PI.
A predetermined distance D from the observation viewpoint for locating the reproduced image of is determined. Here, as shown in FIG. 13, the six images I ₁ , I ₂ , generated by the image generation unit 20 described above,
A case will be described in which the mapping conversion process is performed on the panoramic image PI generated from the image sequence I including I ₃ , I ₄ , I ₅ , and I ₆ .

Here, each image I ₁ , which constitutes the image sequence I,
I ₂ , I ₃ , I ₄ , I ₅ , and I ₆ are respectively photographed by the image generation unit 20 at a horizontal angle of view (viewing angle) of 40 [degree] and a vertical angle of view (viewing angle) of 30 [degree]. And the number of pixels in (horizontal direction × vertical direction) is (1280 × 960) [pixel]
Shall be In this case, the image conversion unit 30 determines that the number of pixels in (horizontal direction × vertical direction) is (2880 × 1620) [pix
el], a panoramic image PI is generated,
The panoramic image PI is an image having a horizontal angle of view of 90 [degree] and a vertical angle of view of 50.625 [degree].

The image processing section 40 uses the following method for such a panoramic image PI as a panoramic image P.
A predetermined distance D from the observation viewpoint for locating the reproduced image of I is determined.

First, the first method is to set the spatial resolution in the reproduced image of the panoramic image PI. That is, in the first method, as shown in FIG. 14A, when the distance from the supposed observation viewpoint to the hologram surface SF of the printed material P is e [mm], the distance D [mm] from the observation viewpoint is used. ], The reproduced image of the panoramic image PI is localized at the resolution Mv [pixel / mm]. This will be specifically described by giving numerical values.

The panoramic image P in which the number of pixels in the above (horizontal direction × vertical direction) is (2880 × 1620) [pixel]
I has a length of (Yu in the horizontal direction × Xu in the vertical direction) of (40 × 3
0) [mm] holographic stereogram is displayed, and when the distance e [mm] from the assumed observation viewpoint to the hologram surface SF of the printed matter P is 50 [mm], the distance D from the observation viewpoint is D = It is assumed that the reproduced image of the panoramic image PI is localized at the position of 60 [mm] with the resolution Mv = 45 [pixel / mm]. It should be noted that a projection image PJ formed by a plurality of viewpoint-converted images forming a viewpoint-converted image sequence PXI in which the viewpoint has been converted by performing a mapping conversion process on the panoramic image PI is exposed and recorded at an angle of view θ = 90 [degree]. Shall be.

In this case, the size of the panoramic image PI to be printed has a length of (horizontal direction × longitudinal direction) (64 × 36) at the position of distance D = 60 [mm] from the observation viewpoint.
It becomes [mm].

On the other hand, when the distance e [mm] from the supposed observation viewpoint to the hologram surface SF of the printed matter P is 50 [mm], the length of (lateral direction Yu × longitudinal direction Xu) is (40
The image area that can be displayed at the position of distance D = 60 [mm] from the observation viewpoint by the holographic stereogram of (* 30) [mm] has a length of (60 in the horizontal direction × Xv in the vertical direction).
× 36) [mm]. That is, in the image area that can be displayed by this holographic stereogram, the number of pixels in (horizontal direction × vertical direction) is (2700 × 1620) [pixe
l].

Therefore, the image processing unit 40 has the above-described (horizontal direction × vertical direction) number of pixels of (2880 × 1620).
The peripheral area in the panorama image PI, which is [pixel], is cut off, and as shown by the area surrounded by the broken line in the figure,
The number of pixels in (horizontal direction × vertical direction) is (2700 × 1620)
A panoramic image PI ′ which is [pixel] is cut out and the entire area of this panoramic image PI ′ is used for mapping conversion processing to localize the reproduced image of the panoramic image PI ′ at a position of a distance D [mm] from the observation viewpoint. be able to. In the case of using the first method, the image processing unit 40 focuses on the position where the reproduced image is localized, regardless of the size of the holographic stereogram or the number of pixels of the panoramic image PI. The reproduced image can be localized in association with the spatial size of PI.

Next, the second method is the panoramic image PI.
This is because, by paying attention to the number of pixels, all the reproduced images of the panoramic image PI can be observed through the printed matter P including the holographic stereogram, as shown in FIG. This will be specifically described by giving numerical values.

The panoramic image P in which the number of pixels in the above (horizontal direction × vertical direction) is (2880 × 1620) [pixel]
I has a length of (Yu in the horizontal direction × Xu in the vertical direction) of (40 × 3
It is assumed that 0) [mm] holographic stereogram is displayed, and the distance e [mm] from the assumed observation viewpoint to the hologram surface SF of the printed matter P is 40 [mm]. It should be noted that a projection image PJ formed by a plurality of viewpoint-converted images forming a viewpoint-converted image sequence PXI in which the viewpoint has been converted by performing a mapping conversion process on the panoramic image PI is exposed and recorded at an angle of view θ = 90 [degree]. Shall be.

In this case, the size of the reproduced image reproduced from the entire holographic stereogram is the horizontal (parallax direction) length Yv [mm] and the vertical (non-parallax direction) length Xv [mm]. Are the following equations (11) and (12), respectively.
As shown in, Yv = Yu + Yt = Yu + (Yr / z) × k = 40 + 2 × k (15) Xv = (30/40) × (40 + k) (12)

Under this condition, the panoramic image PI is passed through the printed matter P composed of the holographic stereogram.
So that all of the reproduced images can be observed, that is, the number of pixels is (horizontal direction × vertical direction) = (2880 × 1620) [pixe
panoramic image PI which is l], and (horizontal direction × vertical direction) =
A virtual distance k [mm] from the hologram surface SF to the reproduced image is obtained so that the size of the reproduced image reproduced from the entire holographic stereogram represented by (Yv × Xv) [mm] matches. It becomes 20 [mm].

As a result, the size of the reproduced image reproduced from the entire holographic stereogram is (horizontal direction Y
v × vertical direction Xv) = (80 × 45) [mm], and (horizontal direction × vertical direction) = (2880 × 1620) [pixel] resolution Mv [pixel / m when the panoramic image PI is displayed
m] is 36 [pixel / mm].

Therefore, the image processing unit 40 has the above-described (horizontal direction × vertical direction) number of pixels of (2880 × 1620).
With respect to the panoramic image PI which is [pixel], the virtual distance k from the hologram surface SF to the reproduced image is k = 20.
By performing mapping conversion processing using [mm] and resolution Mv = 36 [pixel / mm], the distance D =
The panoramic image P at the position of e + k = 40 + 20 = 60 [mm]
The reproduced image of I can be localized. Image processing unit 40
If the second method is used, the panorama image P
Depending on the number of pixels of I and the aspect ratio thereof, the position where the reproduced image is localized and the spatial resolution at that position can be associated.

The third method is the panoramic image PI.
This is because, by paying attention to the viewing angle (field angle), the viewing angle is set to have the same or constant relationship with this viewing angle as shown in FIG. 14 (C). This will be specifically described by giving numerical values.

The number of pixels in the above (horizontal direction × vertical direction) is (2880 × 1620) [pixel], and the horizontal angle of view is 9
The panoramic image PI having a vertical angle of view of 0 [degree] and a vertical angle of view of 50.625 [degree] is (Y in the horizontal direction × Xu in the vertical direction).
Is displayed by a holographic stereogram having a length of (40 × 30) [mm], and the distance e from the assumed observation viewpoint to the hologram surface SF of the printed matter P
[mm] is set to 50 [mm]. Here, the angle of view Yu_ang [degre] in the lateral direction (parallax direction) when the holographic stereogram is observed with the front center portion as the observation viewpoint.
e] and the angle of view Xu_ang [degre] in the vertical direction (non-parallax direction)
e] is represented by the following equations (13) and (14), respectively: Yu_ang = 2 × tan ⁻¹ (Yu / (2 × e)) (13) Xu_ang = 2 × tan ^{− 1} (Xu / (2 × e)) (14), Yu_ang = 43.60 [degree], Xu
_Ang = 33.40 [degree].

A projection image PJ by a plurality of viewpoint-converted images forming a viewpoint-converted image sequence PXI in which the viewpoint is converted by performing a mapping conversion process on the panoramic image PI is exposed and recorded at an angle of view θ = 90 [degree]. Then, the size of the reproduced image reproduced from the entire holographic stereogram is such that the horizontal length Yv [mm] and the vertical length (non-parallax direction) Xv [mm] are As shown in the following equations (15) and (16), Yv = Yu + Yt = Yu + (Yr / z) × k = 40 + 2 × k (15) Xv = Xt = (Xr / e) × D = (Xr / e) × (e + k) = (30/50) × (50 + k) (16)

At this time, the angle of view Yv_ang [degree] in the horizontal direction (parallax direction) and the angle of view Xv_ang [degree] in the vertical direction (non-parallax direction) of the reproduced image reproduced from the entire holographic stereogram are respectively As shown in the following equations (17) and (18), Yv_ang = 2 × tan ⁻¹ (Yv / (2 × (50 + k))) (17) Xv_ang = 2 × tan ⁻¹ (Xv / (2 × (50 + k))) (18) Here, the angle of view X in the vertical direction (non-parallax direction)
v_ang [degree] is the above equation (16) and the above equation (18).
Xv_ang = 2 × tan ⁻¹ ((30/5
It becomes 0) / 2) = 33.40 [degree].

Under this condition, the distance D =
If the reproduced image of the panoramic image PI is localized at the position of 80 [mm], the virtual distance k from the hologram surface SF to the reproduced image is k = 30 [mm], and therefore the horizontal direction (parallax direction) The angle of view Yv_ang [degree] is Yv_ang = 64.01 [degree] using the above equation (17).

As a result, the distance e [mm] from the assumed observation viewpoint to the hologram surface SF of the printed matter P is 50.
When it is set to [mm], it can be displayed at a position of distance D = 80 [mm] from the observation point of view by a holographic stereogram having a length (Y in the horizontal direction × Xu in the vertical direction) of (40 × 30) [mm]. The number of pixels in the image area (horizontal x vertical) is (6
4.01 x 2880/90) x (33.40 x 1620
/50.625)=(2048.34×1068.7)
5) It becomes [pixel].

Therefore, the image processing section 40 has the above-mentioned (horizontal direction × vertical direction) pixel number of (2880 × 1620).
The peripheral area in the panorama image PI, which is [pixel], is cut off, and as shown by the area surrounded by the broken line in the figure,
The number of pixels in (horizontal direction × vertical direction) is (2048.34 × 10
68.75) [pixel] panoramic image PI ′ is cut out, and the entire area of this panoramic image PI ′ is used for the mapping conversion processing to obtain a given panoramic image P ′.
It is possible to display the panoramic image PI ′ at the same angle of view as the viewing angle of I. At this time, the angle of view Yu_ang [degree] in the lateral direction (parallax direction) is 4 when observing the front center part of the holographic stereogram as an observation viewpoint.
While it is 3.60 [degree], the horizontal direction (parallax direction) angle of view Yv_ang [degree] of the reproduced image reproduced from the entire holographic stereogram is 64.01 [deg].
ree]. Image processing unit 40
If this third method is used, the panorama image P
Depending on the number of pixels of I and the angle of view thereof, the position where the reproduced image is localized and the spatial resolution at that position can be associated.

Here, as a third method, the panoramic image PI ′ is cut out so as to have the same angle of view as the viewing angle of the given panoramic image PI, and the entire area of the cut out panoramic image PI ′ is cut. However, it is also possible to have a fixed relationship such as a proportional relationship without having to have the same angle of view.

For example, in the image processing unit 40, the number of pixels in the above (horizontal direction × vertical direction) is (2880 × 1620) [pix
el], the panorama image PI ′ that is cut out by cutting off the peripheral area in the panorama image PI is
The number of pixels in (horizontal direction × vertical direction) is multiplied by a predetermined number, for example, 1.25 times, and (1.25 × 64.01 × 2)
880/90) x (1.25 x 33.40 x 1620 /
50.625) = (2560.43 x 1335.94)
The panoramic image PI ′ having the number of pixels of [pixel] is cut out, and the entire area of this panoramic image PI ′ is used for the mapping conversion processing. It is possible to display a panoramic image having both the panoramic image effect due to the parallax image printed matter.

In this way, the image processing section 40: (1) a method of setting the spatial resolution of the reproduced image of the panoramic image PI, (3) so that the entire reproduced image of the panoramic image PI can be observed based on the number of pixels of the panoramic image PI. Method of setting the same as the viewing angle (angle of view) of the panoramic image PI or having a constant relationship,
It is possible to determine the predetermined distance D from the observation viewpoint for locating the reproduced image of the panoramic image PI. In the produced holographic stereogram, with respect to the parallax in the horizontal direction, the viewpoint position information is corrected by such mapping conversion processing, and in the vertical direction, the information of the panoramic image PI is stored as it is. As a result, when the observer observes the panoramic image PI through the printed matter P, the printed matter manufacturing apparatus 1 visually produces the printed matter P with little contradiction in the positional relationship and capable of highly realistic and high-quality display. It can be manufactured.

Further, in the printed matter P, the panoramic image PI is not localized in the vicinity of the hologram surface SF, and the hologram surface S
Since it is localized at a predetermined distance from F, the stripes of the recorded slit-shaped element hologram image are hard to be visually recognized. That is, in the holographic stereogram produced so that the holographic stereogram image is localized in the vicinity of the hologram surface SF, the number of element hologram images recorded is usually the resolution. Therefore, the holographic stereogram is
When the number of element hologram images is small, the stripes are likely to be visually recognized by an observer, and a holographic stereogram image with coarse resolution is reproduced. Print P
Since the panoramic image PI, which is a holographic stereogram image, is not localized in the vicinity of the hologram surface SF, the number of element holograms does not directly affect the resolution, and the streaks of the element hologram image are hard to be visually recognized by an observer. Becomes It should be noted that this effect is not limited to the case of recording the panoramic image PI, but also occurs when an arbitrary image is recorded.

The printed matter manufacturing apparatus 1 uses the panoramic image PI thus exposed and recorded as a background image, and another three-dimensional image is reproduced as a holographic stereogram in front of the panoramic image PI. P can be produced. That is, the printed matter manufacturing apparatus 1
The image processing unit 40 combines the viewpoint conversion image sequence PXI generated by performing the mapping conversion process on the panoramic image PI and the parallax image sequence including a plurality of parallax images including the parallax information, and this combination is performed. Printing unit 50 based on images
By performing the exposure recording by, it is possible to manufacture the printed matter P in which the two-dimensional panoramic image PI is reproduced as the background image of the three-dimensional image. The printed matter manufacturing apparatus 1
Also, it is desirable to perform viewpoint conversion processing on a parallax image sequence including a plurality of parallax images by using the above-described spatiotemporal parameter TSP so that, for example, a reproduced three-dimensional image is localized on the hologram surface SF. This viewpoint conversion processing is described in the above-mentioned JP-A-11-109839. The printed matter manufacturing apparatus 1 uses the spatio-temporal parameter used for the mapping conversion process on the panoramic image PI and the parallax composed of a plurality of parallax images when the viewpoint conversion image sequence PXI and the parallax image sequence composed of a plurality of parallax images are combined. Matching with the spatiotemporal parameters used in the viewpoint conversion process for the image sequence will be achieved.

As described above, in the printed matter manufacturing system shown as the embodiment of the present invention, the storage server 3 centrally manages the spatiotemporal parameters required for photographing and / or image generation, and / or Alternatively, the plurality of images are generated based on the spatiotemporal parameter TSP read from the storage server 100 or the recording medium MD by the image generating unit 20 in the printed matter manufacturing apparatus 1 that is managed by recording on the recording medium MD, and the image converting unit. 30 converts a plurality of images into a panoramic image PI, and the image processing unit 40 performs mapping conversion processing based on the spatiotemporal parameter TSP so that the panoramic image PI is localized at a predetermined distance to generate a viewpoint conversion image, By printing as a holographic stereogram by the printing unit 60, spatiotemporal parameters can be automatically calculated. , The viewpoint conversion image sequence PXI can be generated easily and in a short time, and the entire panorama image PI can be generated from the display surface SF that is physically smaller than the size of the panorama image PI even though it is a printed matter. It is possible to manufacture a printed matter P which is capable of observing information with high image quality and has excellent portability. Therefore, in the printed matter manufacturing system, it is possible to manufacture the printed matter P in which another panoramic image PI is used as a background image and other three-dimensional images are combined to be exposed and recorded, and it is possible for the observer to enjoy high entertainment and excellent. It can provide convenience.

Further, the printed matter manufacturing system produces a viewpoint-converted image by using the projection method information of the panoramic image PI when performing the mapping conversion processing by the image processing section 40, thereby manufacturing the printed matter P having a high sense of presence. can do.

The present invention is not limited to the above embodiment. For example, in the above-described embodiment, the printed matter manufacturing apparatus 1 exposes and records a plurality of strip-shaped element holograms on one hologram recording medium 110 to form a printed matter including a holographic stereogram having lateral parallax information. Although described as manufacturing P, the present invention performs viewpoint conversion in the vertical direction as well.
It is also possible to manufacture a printed matter P including a holographic stereogram having parallax information in the horizontal and vertical directions by exposing and recording a plurality of dot-shaped element holograms on one hologram recording medium 110.

Further, in the above-described embodiment, the printed matter manufacturing apparatus 1 is described as producing the printed matter P as a holographic stereogram, but the present invention is intended to produce the printed matter P as a lenticular sheet. Alternatively, the panoramic image can be displayed by following the method for localizing the panoramic image described above.

As described above, it goes without saying that the present invention can be appropriately modified without departing from the spirit thereof.

[0122]

As described in detail above, the background image generating apparatus according to the present invention records as a background a printed matter manufactured based on a parallax image sequence composed of a plurality of parallax images including parallax information. A background image generation device for generating an image to be captured, which is an imaging device or a virtual imaging device based on a spatiotemporal parameter that is temporal and / or spatial information necessary for imaging or image generation read from the outside. Image generating means for generating a plurality of images by moving the viewpoint of the image capturing means, and image converting means for converting the plurality of images generated by the image generating means into a panoramic image to be recorded as a background. And a viewpoint conversion unit that generates a plurality of viewpoint conversion images based on the panoramic image generated by being converted by the image conversion unit, and the viewpoint conversion unit is manufactured. That as the reproduced image of the panoramic image reproduced from the printed matter is localized from the viewing perspective in a predetermined distance, based on the space-time parameters to generate a plurality of viewpoint conversion image.

Therefore, the background image generating apparatus according to the present invention generates a plurality of images by the image generating means on the basis of the desired spatiotemporal parameters read from the outside, and the image converting means on the basis of the plurality of images. By generating a panoramic image to be recorded as a background and generating a plurality of viewpoint conversion images by the viewpoint converting means based on the spatiotemporal parameters so that the panoramic image is localized at a predetermined distance from the observation viewpoint, the spatiotemporal parameters are set. Manufacture of printed matter with excellent portability, which can be automatically set, can generate viewpoint conversion image sequence easily and in a short time, and can observe all information of panoramic image as background with high image quality Can contribute to. That is, the background image generation device according to the present invention can contribute to the manufacture of a printed matter in which another panoramic image is used as a background image and another three-dimensional image is combined and exposed and recorded, which is high for an observer. It can provide entertainment and excellent convenience.

Further, the background image generation method according to the present invention generates a background image for a printed matter manufactured based on a parallax image sequence composed of a plurality of parallax images including parallax information. The method is based on a spatio-temporal parameter that is the temporal and / or spatial information required for image capturing or image generation read from the outside, and the image capturing is performed by moving the viewpoint of the image capturing device or the virtual image capturing device. An image generating step of generating a plurality of images, an image converting step of converting the plurality of images generated in the image generating step into a panoramic image to be recorded as a background, and an image converting step. And a viewpoint conversion step of generating a plurality of viewpoint conversion images based on the panoramic image generated by the conversion. As playback image of Ma image is localized from the viewing perspective in a predetermined distance, based on the space-time parameter, a plurality of viewpoint conversion image is generated.

Therefore, the background image generating method according to the present invention generates a plurality of images based on desired spatiotemporal parameters read from the outside, and generates a panoramic image to be recorded as a background based on the plurality of images. However, by generating a plurality of viewpoint conversion images based on the spatiotemporal parameters so that the panoramic image is localized at a predetermined distance from the observation viewpoint, it becomes possible to automatically set the spatiotemporal parameters. The viewpoint-converted image sequence can be generated in a short time, and it is possible to contribute to the production of a printed matter that is excellent in portability and can observe all information of the panoramic image as a background with high image quality. In other words, the background image generation method according to the present invention can contribute to the manufacture of a printed matter in which another panoramic image is used as a background image and another three-dimensional image is combined and exposed and recorded, which is high for an observer. It becomes possible to provide entertainment and excellent convenience.

[Brief description of drawings]

FIG. 1 is a diagram illustrating a relationship between a panoramic image and a printed matter manufactured by a printed matter manufacturing system according to an embodiment of the present invention, in which an observer views a panoramic image that is a still image through the printed matter. FIG.

FIG. 2 is a diagram for explaining the relationship between a panoramic image and a printed matter, for conceptually explaining how an observer can observe all information of a panoramic image by observing the printed matter from different observation viewpoints. FIG.

FIG. 3 is a block diagram illustrating a configuration of the same printed matter manufacturing system.

FIG. 4 is a main-portion cross-sectional view illustrating a hologram recording medium used in the same printed matter manufacturing system.

FIG. 5 is a diagram illustrating a photosensitive process of the hologram recording medium, in which (A) shows an initial state and (B).
FIG. 6A is a diagram showing an exposure state, and FIG. 7C is a diagram showing a fixing state.

FIG. 6 is a diagram illustrating an optical system in a printing unit included in a printed matter manufacturing apparatus in the same printed matter manufacturing system,
(A) is a front view of the optical system, and (B) is a plan view of the optical system.

FIG. 7 is a diagram illustrating a configuration of a recording medium running system included in the printing unit.

FIG. 8 is a diagram illustrating an outline of mapping conversion processing by an image processing unit included in the same printed matter manufacturing apparatus, which is a holographic stereogram image when a printed matter as a holographic stereogram is manufactured by performing mapping conversion processing. It is a figure which shows the mode of a barrel panoramic image.

FIG. 9 is a diagram for explaining the basic principle of mapping conversion processing by the image processing unit and is a diagram for explaining the relationship between a projection image, a virtual projection image projected on the screen surface, and a hologram surface. .

FIG. 10 is a diagram illustrating a basic principle of mapping conversion processing by the image processing unit, in which (A) is a plan view showing a relationship between a projected image, a screen surface, and a hologram surface; B) is a side view showing these relationships.

FIG. 11 is a diagram for explaining the basic principle of mapping conversion processing by the image processing unit, showing an image corresponding to one element hologram image whose viewpoint has been converted by performing the mapping conversion processing and a reproduced image. It is a figure for explaining a relation.

FIG. 12 is a diagram for explaining the basic principle of mapping conversion processing by the image processing unit, and is a diagram for explaining the relationship of the reproduced image with respect to the size of the holographic stereogram finally produced.

FIG. 13 is a diagram illustrating a state of generating a panoramic image as an example.

FIG. 14 is a diagram illustrating the processing content in the image processing unit when determining a predetermined distance from the observation viewpoint for locating the reproduced image of the panoramic image, FIG. The first method by setting the spatial resolution is shown, and (B) focuses on the number of pixels of the panoramic image so that the entire reproduced image of the panoramic image can be observed through the printed matter P composed of the holographic stereogram. Shows the second method by setting, (C)
FIG. 9 is a diagram showing a third method by paying attention to a viewing angle (viewing angle) of a panoramic image and setting it so as to have the same or constant relationship with this viewing angle.

FIG. 15 is a diagram illustrating a normal shooting method by a dedicated camera for shooting continuous images and cross-flow images, (A)
FIG. 3B is a diagram showing a camera that moves horizontally with respect to a subject, and FIG. 6B is a diagram showing a camera that rotates horizontally with respect to the subject at a fixed position.

[Explanation of symbols]

1 printed matter manufacturing apparatus, 10 image processing computer, 20 image generation unit, 30 image conversion unit, 40
Image processing unit, 50 printing control unit, 60 printing unit,
100 storage server, 110 recording medium for hologram, I image sequence, MD recording medium, P printed matter,
PI panoramic image, PXI viewpoint conversion image sequence,
TSP spatiotemporal parameters

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Koji Ashizaki             6-735 Kita-Shinagawa, Shinagawa-ku, Tokyo Soni             -Inside the corporation F term (reference) 2K008 BB00 DD02 DD13 HH01 HH07                       HH18 HH26                 5B050 AA09 BA04 BA06 BA11 BA15                       DA07 EA07 EA19 EA27 FA03                       FA06                 5B057 AA11 BA02 BA19 CA13 CB13                       CD14 CE08 DA07 DA16 DB03                       DC30 DC36

Claims (22)

[Claims] 1. A background image generation device for generating an image to be recorded as a background for a printed matter manufactured based on a parallax image sequence composed of a plurality of parallax images including parallax information, the photographing being read from the outside. Alternatively, based on a spatiotemporal parameter which is temporal and / or spatial information necessary for image generation, the viewpoint of the photographing device or the virtual photographing device is moved to perform photographing to generate a plurality of images. Means, an image converting means for converting the plurality of images generated by the image generating means into a panoramic image to be recorded as the background, and the panoramic image generated by being converted by the image converting means. Viewpoint conversion means for generating a plurality of viewpoint conversion images based on the above-mentioned viewpoint conversion means, wherein the viewpoint conversion means reproduces the panoramic image reproduced from the printed matter to be manufactured. Of such localized from the reproduced image is observed viewpoint to a predetermined distance, based on the space-time parameters, the background image generating apparatus and generating the plurality of viewpoint conversion image. 2. The viewpoint conversion means sets the spatial resolution of a reproduced image of the panoramic image reproduced from the printed matter on the basis of the spatiotemporal parameter to thereby localize the reproduced image. The background image generation device according to claim 1, wherein the distance is determined. 3. The viewpoint conversion means, based on the number of pixels of the panoramic image converted and generated by the image conversion means, so that all the reproduced images of the panoramic image can be observed through the printed matter. The background image generation device according to claim 1, wherein the predetermined distance for localizing the reproduced image is determined. 4. The viewpoint conversion means is based on viewing angle information as the spatiotemporal parameter used when the image generating means generates each of the plurality of images, and / or based on the viewing angle information. 2. The background image generation device according to claim 1, wherein the predetermined distance for locating the reproduced image of the panoramic image reproduced from the printed matter is determined based on the obtained view angle information of the panoramic image. . 5. The viewpoint conversion means determines the predetermined distance for orienting the reproduced image so as to have the same or constant relationship with the viewing angle of the panoramic image. The background image generation device described. 6. The viewpoint conversion means generates the plurality of viewpoint conversion images using projection method information indicating a spatial shape on which the panoramic image is projected. Background image generation device. 7. A storage device that stores various spatio-temporal parameters is connected via a network, and the image generating means captures or generates an image from among the various spatio-temporal parameters stored in the storage device. 2. The background image generation device according to claim 1, wherein a desired spatiotemporal parameter required for the above is read out. 8. The image generation means reads out a desired spatiotemporal parameter required for photographing or image generation from various spatiotemporal parameters recorded in a mounted recording medium. Item 2. The background image generation device according to item 1. 9. The background image generation apparatus according to claim 1, wherein the spatiotemporal parameter is composed of information indicating a photographing condition of the photographing device or the virtual photographing device. 10. The background image according to claim 9, wherein the spatiotemporal parameters are subject distance, viewing angle information, model name information of the photographing device, photographing time, moving distance and / or photographing pitch. Generator. 11. The background image generation device according to claim 1, wherein the printed matter is composed of a lenticular sheet or a holographic stereogram. 12. A background image generation method for generating an image to be recorded as a background for a printed matter manufactured based on a parallax image sequence including a plurality of parallax images including parallax information, the photographing being read from the outside. Alternatively, based on a spatiotemporal parameter which is temporal and / or spatial information necessary for image generation, the viewpoint of the photographing device or the virtual photographing device is moved to perform photographing to generate a plurality of images. A step of converting the plurality of images generated in the image generating step into a panoramic image to be recorded as the background, and the image converted in the image converting step. And a viewpoint conversion step of generating a plurality of viewpoint conversion images based on the panoramic image. In the viewpoint conversion step, the panoramic image reproduced from the printed matter manufactured is manufactured. Namazo As is localized from the viewing perspective in a predetermined distance, based on the space-time parameters, the background image generation method, wherein a plurality of viewpoint conversion image is generated. 13. In the viewpoint conversion step, the spatial resolution of a reproduced image of the panoramic image reproduced from the printed matter is set on the basis of the spatiotemporal parameter, so that the predetermined position for localizing the reproduced image. 13. The background image generation method according to claim 12, wherein the distance is determined. 14. In the viewpoint converting step, based on the number of pixels of the panoramic image converted and generated in the image converting step, all reproduced images of the panoramic image can be observed through the printed matter, 13. The background image generating method according to claim 12, wherein the predetermined distance for localizing the reproduced image is determined. 15. The viewpoint conversion step is based on viewing angle information as the spatiotemporal parameter used when generating each of the plurality of images in the image generating step, and / or based on the viewing angle information. 13. The background image according to claim 12, wherein the predetermined distance for localizing the reproduced image of the panoramic image reproduced from the printed matter is determined based on the viewing angle information of the panoramic image obtained by the above. Generation method. 16. The predetermined distance in which the reproduced image is localized is determined in the viewpoint conversion step so as to have the same or constant relationship with the viewing angle of the panoramic image. 15. The background image generation method described in 15. 17. The viewpoint conversion step, wherein the plurality of viewpoint conversion images are generated using projection method information indicating a spatial shape on which the panoramic image is projected. Background image generation method. 18. In the image generating step, a desired spatiotemporal parameter required for photographing or image generation is selected from various spatiotemporal parameters stored in a storage device that stores various spatiotemporal parameters via a network. 13. The background image generation method according to claim 12, wherein the background image is read out. 19. In the image generating step, a desired spatiotemporal parameter required for photographing or image generation is read out from various spatiotemporal parameters recorded in a mounted recording medium. The background image generation method according to claim 12. 20. The background image generation method according to claim 12, wherein the spatiotemporal parameter is composed of information indicating a photographing condition of the photographing device or the virtual photographing device. 21. The background image according to claim 20, wherein the spatiotemporal parameters are subject distance, viewing angle information, model name information of the photographing device, photographing time, moving distance and / or photographing pitch. Generation method. 22. The background image generating method according to claim 12, wherein the printed matter comprises a lenticular sheet or a holographic stereogram.