JP2002372904A - Printed matter producing device and printed matter producing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To produce a printed matter making the panoramic image of a large size observable without the need of a physical size like printed matter or photo though it is being a printed matter. SOLUTION: A printed matter producing device 1 is provided with an image input part 20 inputting an image string I composed of a plurality of images, an image conversion part 30 executing a conversion processing to the panoramic image to the inputted image string II composed of a plurality of the images inputted by the image input part 20, an image processing part 40 generating a view point converted image string PXI composed of a plurality of view point converted images on the basis of the panoramic image PI converted and generated by the image conversion part 30 and a printing part 60 manufacturing the printed matter P on the basis of the view point converted image string PXI composed of a plurality of the view point converted images generated by the image processing part 40. The image processing part 40 generates the view point converted image string PXI composed of a plurality of the view point converted images so as to fix the panoramic image PI reproduced from the printed matter P in a prescribed distance from an observation view point.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a printed matter manufacturing apparatus and a printed matter manufacturing method for manufacturing a printed matter based on a parallax image.

[0002]

2. Description of the Related Art In recent years, for example, registered utility model No. 30147
A system that can provide a service from photographing a subject to printing a photographed result at the same place, such as a video print supply device described in Japanese Patent No. 33, has become widespread.

Recently, not only still images,
A system that captures and prints a moving image or a parallax image has been developed. By changing the viewing direction, a printed material in which the viewed image changes can be obtained.

As an example of developing such a business, there is a method of generating a parallax image photograph as a printed material using lenticular technology. "Konica Clear 3D (TM)" and its printing service ○ "Kodak Snap Kids 3D (TM)" with trinocular lens film by "Kodak Corporation" and its printing service * Developed by "Matsushita Electric Industrial Co., Ltd.""MIP (Motion Image
ge Print) card ”and a device that generates this card“ Ugoi Taro (trademark) ”○ This service is provided by“ Chikyuya Co., Ltd. ” Services accepted on the Internet ○ This is a sales order for commercial amusement equipment by “Matsushita Electric Industrial Co., Ltd.”, a video card that is provided as a single card that makes the subject appear to move according to the viewing angle of the continuous photographs taken. Examples include vending machines.

[0005] Further, as a similar system, there is a system that generates a printed material by using holographic technology. Examples of such a technology include: “Akira Shirakura, Nobuhiro Kihara and Shigeyuki
Baba, “Instant holographic portrait printing sys
tem ”, Proceeding of SPIE, Vol. 3293, pp.246-253,
Jan. 1998 "○" Kihara, Shirakura, Baba: "High-speed hologram portrait print system", 3D image conference 199
8, July 1998 ", in addition to a system for generating a printed matter capable of expressing parallax only in the horizontal direction," Yamaguchi, Honda, Oyama: "Using Lipman holographic stereogram Holographic 3D Printer ", 20th Conference on Image Engineering, January 1989
February "○" Endo, Yamaguchi, Honda, Oyama: "Holographic 3
As described in “-D Printer High-Density Recording”, 23rd Image Engineering Conference, December 1992 ”, a system for generating a printed material capable of expressing parallax in both vertical and horizontal directions may be mentioned.

A system for manufacturing a printed material using such a parallax image displays a plurality of still images like moving images, and captures a plurality of images from different viewpoints using a dedicated photographing device. Alternatively, a printed matter can be manufactured by generating a plurality of images from different viewpoints by computer graphics (CG).

On the other hand, in recent years, devices for handling digital images such as so-called digital still cameras and digital video camera recorders have become widespread. With the spread of these devices, for example, a device capable of performing image processing such as a computer, captures a continuous image or a side-by-side image as image data, and connects these images to form a so-called panoramic image. Generating images has also been performed.

[0008] Software for generating such a panoramic image includes, for example, “PictureGear Ve” sold by “Sony Corporation”.
rsion4.0 (trademark) and "PictureGear Version5.0 (trademark)" ○ "Reality Studio (trademark) developed by" US Live Picture Inc. "and sold by" Live Picture Japan Co., Ltd. " ) "○ Developed by" Apple Computer Inc., USA "and released by" Apple Computer Co., Ltd. "" QuickTime VR Authoring Studio (trademark) "○" Sanyo Electric Co., Ltd. " “Panorama Boutique Lite ™”, “Panorama Boutique Pro ™” and “Tiling Boutique ™”.

[0009]

By the way, an observer who observes a panoramic image can use a printer such as a sublimation printer or an ink jet printer.
By producing dimensional prints or photographs, panoramic images can be viewed.

[0010] However, such a two-dimensional printed matter or photograph needs to be large enough to display a panoramic image, for example, as shown in FIG. That is, the two-dimensional printed matter or photograph P has a size that depends on the size of the panoramic image PI, and has a physical size that is at least as large as the size of the panoramic image PI. This is not limited to the case of observing a panorama image physically manufactured as a printed matter or a photograph, but also the case of observing a panorama image displayed on a display device such as a cathode ray tube or a liquid crystal. The size of the screen depends on the size of the panoramic image to be displayed.
That is, the observer prepares, for example, a display device capable of displaying an image consisting of several hundred pixels × several hundred pixels or several thousand pixels × thousands of pixels, and converts a panoramic image into several hundred pixels × several hundred pixels or thousands of pixels × The image is displayed on a display device as one image composed of thousands of pixels and observed.

Further, an observer who observes a panoramic image,
By using dedicated viewer software,
A panoramic image can be observed. That is, for example, as shown in FIG. 17, the observer OB displays the window W displayed on the display device M via an input device such as a mouse or a keyboard using a computer COM or the like on which dedicated viewer software can operate. By moving a part of the panoramic image PI on the screen and displaying it on the display device M, the panoramic image PI can be observed.

[0012] Such viewer software is, for example, "LivePicture Plug-in Viewer" (trademark) which was developed by "Live Picture Inc. of the United States" and distributed free by "Live Picture Japan Co., Ltd." ) "○ Developed by" Apple Computer Inc., USA "and released" QuickTime 4.1.2 (trademark) "and" Apple Computer Inc. " “QuickTime Pr
o (trademark) ".

However, in order to observe a panoramic image using such viewer software, the observer needs a system that includes an input device such as a mouse and a keyboard and a display device and that can operate the viewer software. Will be. Therefore, there is a problem that the burden on the observer is increased due to the necessity of preparing these hardware and software.

The present invention has been made in view of such circumstances, and is a printed matter, which does not require a physical size like a two-dimensional printed matter or a photograph, and has a size like a panoramic image. It is an object of the present invention to provide a printed matter manufacturing apparatus and a printed matter manufacturing method capable of manufacturing a printed matter capable of observing a still image having a large size.

[0015]

According to the present invention, there is provided a printed matter producing apparatus for producing a printed matter based on a parallax image, comprising: an image input means for inputting a plurality of images; Image conversion means for converting a plurality of images input by the image input means into a panoramic image; and converting a plurality of viewpoint-converted images based on the panoramic image generated by conversion by the image conversion means. A viewpoint conversion unit for generating a printed matter based on the plurality of viewpoint conversion images generated by the viewpoint conversion unit, wherein the viewpoint conversion unit reproduces the printed matter printed and manufactured by the printing unit. A plurality of viewpoint-converted images are generated so that the reproduced image of the panoramic image to be localized is located at a predetermined distance from the observation viewpoint.

The printed matter manufacturing apparatus according to the present invention generates a panoramic image based on a plurality of images by the image converting means, and the panoramic image is converted by the viewpoint converting means so that the panoramic image is localized at a predetermined distance from the observation viewpoint. A plurality of viewpoint-converted images are generated, and a printed matter is manufactured by a printing unit based on the plurality of viewpoint-converted images.

According to another aspect of the present invention, there is provided a printed matter manufacturing method for manufacturing a printed matter based on a parallax image, comprising: an image inputting step of inputting a plurality of images; An image conversion step of converting a plurality of images input in the step into a panoramic image, and generating a plurality of viewpoint-converted images based on the panorama image generated by the conversion in the image conversion step A viewpoint conversion step, and a printing step of manufacturing a printed matter based on the plurality of viewpoint conversion images generated in the viewpoint conversion step. In the viewpoint conversion step, reproduction is performed from a printed matter printed and manufactured in the printing step. A plurality of viewpoint-converted images are generated so that the reproduced image of the panoramic image to be localized is located at a predetermined distance from the observation viewpoint.

In the method for producing a printed material according to the present invention, a panoramic image is generated based on a plurality of images, and a plurality of viewpoint-converted images are generated such that the panoramic image is located at a predetermined distance from the observation viewpoint. Then, a printed matter is manufactured based on the plurality of viewpoint converted images.

[0019]

Embodiments of the present invention will be described below in detail with reference to the drawings.

This embodiment is a printed matter manufacturing apparatus for providing a two-dimensional still image as a printed matter. This printed matter manufacturing apparatus uses a parallax image photograph using a lenticular technique or a parallax image print such as a hologram or a holographic stereogram, and converts a large still image such as a so-called panoramic image into an observation viewpoint. By recording at a predetermined distance from, it is possible to observe all information of the image from a display surface that is physically smaller than the size of the image, as if it were a printed matter, like viewer software It is for producing printed matter.

Conceptually, as shown in FIG. 1, for example, an observer OB observes a reproduced image of a panoramic image PI, which is a still image, through a printed matter P manufactured by a printed matter manufacturing apparatus. Here, the printed matter P is recorded such that the reproduced image of the panoramic image PI is localized at a predetermined distance in front or behind the display surface of the printed matter P. FIG. 3 shows an example in which a reproduced image of the panoramic image PI is recorded so as to be located at a predetermined distance deep from the observation viewpoint with respect to the display surface of the printed matter P. for that reason,
The observer OB can observe the region of the panoramic image PI surrounded by the broken line in FIG. Then, the observer OB observes the printed matter P from the position A as shown in FIG.
The area PI _A surrounded by the broken line in the drawing section of the I can be observed through the printed material P, the printed material P from the position B
The by observing can observe an area PI _B surrounded in the diagram of the panoramic image PI broken line through the printed material P. Therefore, the observer OB can observe all the information of the panoramic image PI from the display surface of the printed matter P that is physically smaller than the size of the panoramic image PI by observing the printed matter P from different observation viewpoints. .

Now, a printed matter manufacturing apparatus capable of manufacturing such a printed matter P will be described. In the following, a description will be given assuming that the printed matter manufacturing apparatus manufactures a holographic stereogram in which a holographic stereogram image is exposed and recorded as a printed matter P.

As shown in FIG. 3, the printed matter manufacturing apparatus 1 comprises:
An image processing computer 10 that performs image processing, and a printing unit 60 that is a printing unit that manufactures a printed matter P based on a viewpoint conversion image sequence PXI including a plurality of viewpoint conversion images generated by the image processing computer 10. Prepare.

The image processing computer 10 includes an image input unit 20 as image input means for inputting an image sequence I composed of a plurality of images, and an input image sequence composed of a plurality of images input by the image input unit 20. An image conversion unit 30 which is an image conversion unit for performing a conversion process on the II into a panoramic image, and a viewpoint conversion comprising a plurality of viewpoint converted images based on the panorama image PI generated by conversion by the image conversion unit 30. An image processing unit 40 is a viewpoint conversion unit that generates an image sequence PXI, and a print control unit 50 that controls a printing unit 60.

The image input unit 20 outputs an image sequence I composed of at least two or more images, such as a continuous image captured by the digital still camera 100 and a side-by-side image captured by a so-called video camera recorder (not shown). input. The image input unit 20 is, for example, a magnetic recording medium such as a so-called flexible disk or hard disk, or a CD-ROM (Compact Disc-Read).
Only Memory), CD-R (Compact Disc-Recordabl)
e) or an optical recording medium such as a DVD (Digital Versatile Disc), a magneto-optical recording medium such as an MO (Magneto Optical),
Semiconductor recording media such as Memory Stick (trademark), Compact Flash (trademark) or SmartMedia (trademark), USB (Universal Serial Bus) (trademark), IEEE
E (The Institute of Electrical and Electronics En
IEEE Std. 1394-19 approved by Gineers, Inc.)
95 IEEE Standard for a High Performance serial Bus
Standards, SCSI (Small Computer System Interface)
Alternatively, the image sequence I is input via an interface such as RS-232C and a network interface including Ethernet (trademark) and a telephone line.

Each image constituting the image sequence I includes viewing angle (angle of view) information such as a subject distance, a resolution on a focal plane and / or a focal length when the image is taken,
In addition, it is desirable that information such as the model name of the camera and the like used for shooting is additionally recorded. These various types of information are stored in, for example, the image file format standard Exif
(Exif Version 2.1, Image File Format Standard for Digital Still Cameras (Exif) Version 2.1, Japan Electronics Industry Development Association, 1998)
Recorded in each image.

The input image sequence II composed of a plurality of images input by the image input unit 20 is supplied to the image conversion unit 30.

The image converter 30 converts a plurality of images constituting the input image sequence II into a panoramic image PI by joining them. At this time, the image conversion unit 30 generates the panoramic image PI using any existing method.
For example, the image conversion unit 30 obtains a spatial positional correlation of each image constituting the input image sequence II, thereby obtaining a geometrical positional relationship such as translation, rotation, enlargement, reduction, and the like. Based on the positional relationship, after performing spatial processing such as translation, rotation, enlargement, and reduction, superimposition and joining are performed. Further, when performing the superimposition and joining of the images, the image conversion unit 30 determines the superimposition region and adjusts the degree of superimposition of the images according to the spatial correlation of the images. , It is possible to generate a panoramic image PI with few or no seams.

When the above-described viewing angle information is recorded in each image constituting the input image sequence II, the printed matter manufacturing apparatus 1 determines the relationship between the viewing angle information and the geometric positional relationship between the images. And the synthesized panoramic image PI
Viewing angle information can be obtained. In addition, when the model name information described above is recorded in each image constituting the input image sequence II instead of the viewing angle information, the printed matter manufacturing apparatus 1 determines the type of each image based on the model name information. The viewing angle can also be determined. These pieces of viewing angle information are used for mapping conversion processing in the image processing unit 40 described later.

The image conversion section 30 outputs the panoramic image P
When generating I, the spatial shape of the panoramic image PI can be arbitrarily determined such that the spatial shape is a plane, a cylindrical surface, or a spherical surface. For example, the fisheye lens projects a panoramic image to be projected on a spherical surface onto a plane and displays the panoramic image. The image conversion unit 30 outputs the panoramic image P similarly to the panoramic image observed through the fisheye lens.
The spatial shape of I can be calculated and generated. The image conversion unit 30 can additionally record projection method information indicating what spatial shape the panorama image PI is projected on in the generated panorama image PI. This projection method information is used for mapping conversion processing in the image processing unit 40 described later.

The panoramic image PI generated by the image conversion unit 30 is supplied to the image processing unit 40.

The image processing section 40 performs a mapping conversion process (viewpoint conversion process) for localizing a reproduced image of the panoramic image PI finally reproduced as a holographic stereogram image at a predetermined distance. Here, in the mapping conversion process, when the printed matter P is manufactured, the panoramic image PI reproduced as a holographic stereogram image is reconstructed such that the reproduced image is localized at a predetermined distance from the observation viewpoint, and the viewpoint is converted. This is the process of generating the converted viewpoint converted image. In this mapping conversion process, distance information indicating the distance at which the reproduced image of the panoramic image PI reproduced on the finally manufactured printed matter P is one of the parameters to be determined in advance. When grasping the viewing angle information of the panoramic image PI, the image processing unit 40 can calculate the distance at which the reproduced image should be localized in association with the viewing angle information. Also,
If the image processing unit 40 knows the projection method information of the panoramic image PI, it uses this projection method information to
The viewpoint conversion image sequence PXI can be generated. The plurality of viewpoint-converted images constituting the viewpoint-converted image sequence PXI generated by the image processing unit 40 are each a display element unit that is sequentially displayed on a transmissive liquid crystal display device described later when exposure recording is performed as a holographic stereogram. Is supplied to the printing unit 60 as an element hologram image. The mapping conversion processing will be described later in detail.

The print control unit 50 controls each unit of the printed matter manufacturing apparatus 1 in general, and particularly controls the operation of the printing unit 60.

Under the control of the print control unit 50, the printing unit 60 manufactures a printed material P based on a viewpoint-converted image sequence PXI composed of a plurality of viewpoint-converted images that are element hologram images. Specifically, the printing unit 60 has a predetermined optical system for producing a holographic stereogram, and converts a plurality of viewpoint-converted images constituting the viewpoint-converted image sequence PXI into a hologram recording medium as element hologram images. A holographic stereogram is produced by exposure recording, and a predetermined fixing process is performed on the holographic stereogram, thereby producing a printed matter P. The configuration of the printing unit 60 will be described later in detail.

The printed matter manufacturing apparatus 1 generates a panoramic image PI based on the image sequence I composed of a plurality of images, and determines the panoramic image PI so that the reproduced image is located at a predetermined distance from the observation viewpoint. By performing exposure mapping on the hologram recording medium as an element hologram image by performing each of the viewpoint conversion images constituting the obtained viewpoint conversion image sequence PXI by performing the mapping conversion processing described above, so that the display is physically smaller than the size of the panorama image PI. A printed matter P composed of a holographic stereogram having a surface can be manufactured. Therefore, as shown in FIG. 2 earlier, the printed matter manufacturing apparatus 1 allows the observer OB to change the printed matter P from different observation viewpoints.
By observing, all information of the panoramic image PI can be observed.

In the printed matter manufacturing apparatus 1, when processing is performed using digital images, the image input unit 2
0, the image conversion unit 30, the image processing unit 40, and the printing unit control unit 50 can be realized not only as hardware but also as image processing software operable by the image processing computer 10.

Hereinafter, the configuration of the printing unit 60 will be described in detail with reference to FIGS. Here, first,
Prior to the description of the configuration of the printing unit 60, the principle of exposing and recording an element hologram on a hologram recording medium will be described.

As shown in FIG. 4, in the hologram recording medium 110, a photopolymer layer 112 made of a photopolymerizable photopolymer is formed on a long base film 111, for example. Is a so-called film-coated recording medium on which a cover film 113 is adhered and formed.

Such a hologram recording medium 110
As shown in FIG. 5A, the photopolymerizable photopolymer constituting the photopolymer layer 112 is in a state in which monomers M are uniformly dispersed in a matrix polymer in an initial state. The photopolymerizable photopolymer is 10 mJ / cm ²
LA having a power of about 400 mJ / cm ²
Is irradiated, the monomer M uniformly dispersed in the matrix polymer in the exposed portion is polymerized and polymerized, as shown in FIG.

As the photopolymerizable photopolymer becomes polymerized, the refractive index is modulated between the exposed portion and the unexposed portion due to the non-uniform concentration of the monomer M due to the movement of the monomer M from the surroundings. Photopolymer After this, as shown in FIG. (C), by 1000 mJ / cm ² about ultraviolet or visible light LB power is irradiated on the entire surface, the polymerization of the monomers M in the matrix in the polymer Is completed. In the hologram recording medium 110, the refractive index of the photopolymerizable photopolymer constituting the photopolymer layer 112 changes according to the incident laser beam LA. The resulting interference fringes are exposed and recorded as a change in the refractive index.

The printing unit 60 includes the hologram recording medium 11.
By using a film-coated recording medium in which the photopolymer layer 112 is composed of such a photopolymerizable photopolymer, a step of performing a special development process on the hologram recording medium 110 after exposure is not required. . Accordingly, the configuration of the printing unit 60 can be simplified by eliminating the need for a developing device and the like, and the holographic stereogram can be quickly manufactured.

Now, such a hologram recording medium 1
Exposure recording of a holographic stereogram image for 10 to produce a holographic stereogram,
The printing unit 60 that manufactures the printed matter P has an optical system 70 for producing a holographic stereogram, as shown in FIG. In the printing unit 60, although not shown, the members constituting the optical system 70 are disposed and supported on a support substrate (optical surface plate), and the support substrate is supported on the apparatus housing via a damper. . The optical system 70 is
Incident optical system 70A, object optical system 70B, and reference optical system 7
It has 0C. The printing unit 60 uses the hologram recording medium 1 that is a photosensitive material to produce a holographic stereogram as the printed matter P.
The device housing has a structure in which at least the light-shielding property of the optical system 70 is maintained.

The incident optical system 70A includes a laser light source 71 for emitting a laser beam L1 having a predetermined wavelength,
1 on the optical axis of the laser light L1.
A shutter mechanism 72 for causing or blocking the light to the subsequent stage;
A half mirror 73 for splitting the laser beam L1 into an object beam L2 and a reference beam L3.

The laser light source 71 is, for example, a semiconductor-excited YAG that emits a laser beam L1 having a single wavelength and good coherence.
It comprises a laser device such as a laser device, a water-cooled argon ion laser device or a water-cooled krypton laser device.

The shutter mechanism 72 has a viewpoint-converted image sequence PX.
The laser beam L is opened and closed by the control signal output from the print control unit 50 in accordance with the output timing of the viewpoint conversion image serving as the element hologram image constituting I.
1 into a subsequent optical system or a laser beam L1
Is blocked from entering the subsequent optical system.

The half mirror 73 divides the incident laser light L1 into transmitted light and reflected light. The laser light L1 is
The transmitted light is used as the above-described object light L2, while the reflected light is used as the reference light L3. These object lights L
2 and the reference light L3 are respectively incident on the object optical system 70B or the reference optical system 70C provided at the subsequent stage.

Although not shown, the incident optical system 70A appropriately changes the traveling direction of the laser beam L1 and
A mirror or the like may be provided for the purpose of making the optical path lengths of the reference light L2 and the reference light L3 the same. Also, the shutter mechanism 72
Are, for example, those configured to mechanically drive a shutter piece or an acousto-optic modulator (Acousto-Optic Modulati
on; AOM). That is, the shutter mechanism 72 only needs to be openable and closable so as to shield and transmit the laser beam L1.

The object optical system 70B includes an optical system such as a mirror 74, a spatial filter 75, a collimator lens 76, a projection lens 77, a cylindrical lens 78, and a mask 79, as shown in FIGS. These optical components are sequentially arranged from the input side along the optical axis.

The mirror 74 reflects the object light L2 transmitted through the half mirror 73. The object light L2 reflected by the mirror 74 enters a spatial filter 75.

The spatial filter 75 is composed of, for example, a combination of a convex lens and a pinhole, and converts the object light L2 reflected by the mirror 74 in accordance with the display surface width of a transmission type liquid crystal display 80 described later. Enlarge in one direction.

The collimator lens 76 converts the object light L2 enlarged by the spatial filter 75 into parallel light, and guides the parallel light to the transmission type liquid crystal display 80.

The projection lens 77 slightly diffuses the object light L2 and projects it onto the cylindrical lens 78. This projection lens 77 contributes to the improvement of the image quality of the manufactured holographic stereogram by slightly diffusing the object light L2.

The cylindrical lens 78 converges the collimated object light L2 in the horizontal direction.

The mask 79 has a strip-shaped opening, and of the object light L2 condensed by the cylindrical lens 78, the one that has passed through the opening is made incident on the hologram recording medium 110.

In the object optical system 70B, a transmission type liquid crystal display 80 is disposed between the collimator lens 76 and the projection lens 77. Transmissive liquid crystal display 80
The viewpoint conversion images are sequentially displayed as element hologram images based on the viewpoint conversion image sequence PXI supplied from the image processing unit 40 described above. The printing unit 60 transmits a control signal output from the printing control unit 50 in accordance with the output timing of the viewpoint conversion image sequence PXI from the image processing unit 40 to a recording medium feeding mechanism of the hologram recording medium 110 described later. The feed operation of the hologram recording medium 110 is controlled by the operation of the hologram recording medium 110.

In such an object optical system 70B,
The object light L2 in the form of a thin beam split and incident from the incident optical system 70A is expanded by the spatial filter 75 and is incident on the collimator lens 76 to be converted into parallel light. Further, the object optical system 70B
In the above, the object light L2 incident on the transmission type liquid crystal display 80 via the collimator lens 76 is image-modulated according to the element hologram image displayed on the transmission type liquid crystal display 80, and the projection lens 77 is formed. Is incident on the cylindrical lens 78. Then, while the shutter mechanism 72 is in the opening operation, the object optical system 70B causes the image-modulated object light L2 to enter the hologram recording medium 110 through the opening of the mask 79, and corresponds to the element hologram image. This is recorded by exposure.

The reference optical system 70C has a spatial filter 81, a collimator lens 82, and a mirror 83,
These optical components are sequentially arranged from the input side along the optical axis.

The spatial filter 81 is different from the spatial filter 75 in the object optical system 70B described above, and is constituted by, for example, a combination of a cylindrical lens and a slit. The spatial filter 81 converts the reference light L3 reflected and divided by the half mirror 73 into a predetermined light. The width is expanded in the one-dimensional direction, specifically, corresponding to the width of the display surface of the transmissive liquid crystal display 80.

The collimator lens 82 converts the reference light L3 enlarged by the spatial filter 81 into parallel light.

The mirror 83 reflects the reference light L3, guides the reference light L3 to the rear of the hologram recording medium 110, and causes the light to enter.

The optical system 70 includes the half mirror 7
The optical path lengths of the object optical system 70B, which is an optical system through which the object light L2 divided by the optical path L3 passes, and the reference optical system 70C, which is an optical system through which the reference light L3 passes, are substantially the same. Therefore, the optical system 70 can manufacture a holographic stereogram in which the coherence between the object light L2 and the reference light L3 is improved, and a clearer reproduced image can be obtained.

The printing section 60 further includes a recording medium feeding mechanism 84 for intermittently feeding the hologram recording medium 110 by one element hologram in the direction indicated by the arrow a in FIG. 6B. The hologram recording medium 110 is caused to travel along the recording medium traveling system shown in FIG. Here, the hologram recording medium 110 is made of a long photosensitive film as shown in FIG.
1 is wound around a supply roll 91a rotatably provided in the inside of the unit 1. When the film cartridge 91 is loaded in the printing unit 60, the hologram recording medium 110
The recording medium feeding mechanism 84 is fed out into the printing section 60 and
Thus, the recording medium traveling system is driven to travel.

As shown in FIG. 7, the recording medium traveling system includes a supply roll 91a, a recording medium feeding mechanism 84,
A heat roller 93 and a pair of discharge rollers 94a and 94b;
And a cutter 95 or the like to form a substantially S-shape. In the recording medium traveling system, an ultraviolet lamp 92 is provided between the recording medium feeding mechanism 84 and the heat roller 93.

The recording medium feeding mechanism 84 is provided for the hologram recording medium 11 fed from the film cartridge 91.
The driving roller 96 is configured to include a driving roller 96 that travels while holding 0, a pinch roller 97 that rotates following the driving roller 96, and a stepping motor (not shown) that forms a driving source of the driving roller 96. Recording medium feed mechanism 8
Reference numeral 4 denotes a driving roller that is intermittently driven to rotate by a stepping motor based on a control signal supplied from the above-described printing control unit 50.
The hologram recording medium 110 sandwiched between the pinch roller 6 and the pinch roller 97 is intermittently driven to travel.

The ultraviolet lamp 92 is disposed along the recording medium running system between the driving roller 96 and the heat roller 93 as described above. The ultraviolet lamp 92 is used for recording the holographic recording medium 1 on which a holographic stereogram is exposed and recorded by interference fringes between the object light L2 and the reference light L3.
By irradiating ultraviolet light LB with a power of about 1000 mJ / cm ² to 10, polymerization of the monomer M in the matrix polymer is completed.

The heat roller 93 travels with the hologram recording medium 110 wound around the outer peripheral portion thereof at a winding angle of about half a circumference. The heat roller 93 is provided with a heater 93a therein, and is maintained at a temperature of about 120 ° C. to heat the hologram recording medium 110 to increase the refractive index modulation degree of the photopolymer layer 112. Let it.

The discharge rollers 94a and 94b are intermittently driven in synchronization with the drive roller 96 by a stepping motor driven based on the control signal supplied from the print control unit 50 described above. Discharge rollers 94a and 94b
Sends out the hologram recording medium 110 intermittently in correspondence with the one-element hologram every time exposure recording of one-element hologram image is completed. Therefore, the hologram recording medium 110 is run by the discharge rollers 94a and 94b and the recording medium feeding mechanism 84 in a state in which the hologram recording medium 110 is in close contact with the outer peripheral portion of the heat roller 93 without bending.

The cutter 95 is driven by a drive mechanism (not shown) driven based on the control signal supplied from the above-described print control unit 50, and moves the traveling hologram recording medium 110 to a fixed length, that is, a holographic stereo. Cut every gram image.

The printing unit 60 having such an optical system 70 and a recording medium traveling system transmits a control signal corresponding to one element hologram from the printing control unit 50 every time the exposure recording of one element hologram image is completed. The object optical system 70B and the reference optical system 70B are supplied to the mechanism 84.
The hologram recording medium 1 is set such that the optical axis of the hologram recording medium 110 is orthogonal to the front and back surfaces of the hologram recording medium 110, respectively.
10 is driven along the traveling path by an amount corresponding to one element hologram, and the unexposed portion is stopped between the supply roller 91a and the driving roller 96 in correspondence thereto. The printing unit 60 is configured such that the vibration generated in the hologram recording medium 110 due to the running operation of the hologram recording medium 110 is stopped immediately.

In this state, the printing unit 60 starts to operate the shutter mechanism 7.
2 is opened and the object light L2 and the reference light L image-modulated on the hologram recording medium 110 from the front and back surfaces thereof.
3 is incident, and an interference fringe corresponding to the element hologram image is exposed and recorded. When the exposure recording of the one-element image is completed, the printing unit 60 sends the recording medium feeding mechanism 84
Is supplied to the hologram recording medium 1
10 is immediately driven and stopped by a predetermined amount.

Further, the printing unit 60 is provided with a hologram recording medium 1 by an ultraviolet lamp 92 in the recording medium running system.
The holographic stereogram image exposed and recorded on the hologram recording medium 110 is formed by performing a fixing process including an ultraviolet irradiation process on the hologram recording medium 10 and a heating process on the hologram recording medium 110 by the heat roller 93 at a predetermined temperature. Fix it. The printing unit 60 transfers the hologram recording medium 110 having undergone the fixing process to the cutter 9.
5, the holographic stereogram image is sequentially cut out to a predetermined size for each holographic stereogram image, and if necessary, a mount is attached to the holographic stereogram image, and the holographic stereogram image is discharged to the outside as a printed matter P composed of one holographic stereogram.

The printing unit 60 produces a holographic stereogram by sequentially performing the above operations.
The printed matter P is manufactured.

In the following, the mapping conversion processing (viewing point) in the above-described image processing section 40 for generating a viewpoint conversion image sequence PXI as an element hologram image displayed on the transmission type liquid crystal display 80 in such a printing section 60 will be described. The conversion process will be described in detail. Here, for convenience of explanation, a case will be described in which the reproduced image of the panoramic image PI is recorded so as to be localized at a predetermined distance deep from the observation viewpoint with respect to the display surface of the printed matter P.

In the printed matter manufacturing apparatus 1, as described above, the image processing section 40 performs the mapping conversion process on the panoramic image PI, and the printing section 60 performs exposure recording on the hologram recording medium 110 as an element hologram image. A viewpoint conversion image sequence PXI including a plurality of viewpoint conversion images to be generated is generated. In the printed matter manufacturing apparatus 1, the display surface of the printed matter P separated by a predetermined distance e from the viewpoint of the observer OB, that is, the hologram surface SF, as schematically shown in FIG. Thus, it is possible to manufacture a printed matter P in which the panoramic image PI is reproduced as a holographic stereogram image at a position further separated by a predetermined distance f. As for the basic principle of the mapping conversion process, two-dimensional image information such as character string information and image information is combined with a holographic stereogram image and exposed and recorded at an arbitrary depth position on a hologram recording medium. For example, Japanese Patent Application Laid-Open No.
No. 109839. First, the basic principle will be briefly described with reference to FIGS.

The holographic stereogram can be produced by the same optical system as the optical system 70 in the printing unit 60, and the object light transmitted through the display means corresponding to the above-mentioned transmission type liquid crystal display 80 is shown in FIG. As shown in
The light is condensed in the lateral direction by the optical component OP corresponding to the cylindrical lens 78 described above, and is incident on the hologram recording medium.

Here, the image corresponding to the element hologram image exposed and recorded by the object light transmitted through the display means is called a projection image PJ, and the display surface to which the condensing point of the object light belongs is called a hologram surface SF. A surface at a depth position separated by z from the hologram surface SF on which an image is exposed and recorded is referred to as a screen surface SC. This screen surface SC
Is a virtual plane, and indicates that an image is projected on an area indicated by a hatched portion in FIG. This screen surface SC
The image projected above is referred to as a virtual projection image VP. This virtual projection image VP corresponds to an image that is actually exposed and recorded at a predetermined depth position z [mm].

Further, the length in the horizontal direction (parallax direction) of the projection image PJ is set to Ys [mm], and the length in the vertical direction (non-parallax direction) is set.
Is Xs [mm], and the number of pixels in the horizontal direction is Ysp [pixe
l], and the number of pixels in the vertical direction is Xsp [pixel]. The length in the horizontal direction (parallax direction) of the virtual projection image VP is Yh [mm], and the length in the vertical direction (non-parallax direction) is Xh [m
m], the number of pixels in the horizontal direction is Yhp [pixel], and the number of pixels in the vertical direction is Xhp [pixel]. Note that the virtual projection image V
The vertical length Xh [mm] in P is equal to the vertical length Xs [mm] in the projection image PJ.
Number of pixels Xhp [pixel] in virtual direction in virtual projection image VP
Is the number of pixels Xsp [pixe in the vertical direction in the projection image PJ.
l]. Also, regarding the number of pixels Yhp [pixel] in the horizontal direction in the virtual projection image VP, the virtual projection image VP is determined based on the number of pixels Xsp [pixel] in the vertical direction in the projection image PJ.
It is desirable to set the aspect ratio to That is, the number of horizontal pixels Yhp [pixel] in the virtual projection image VP is preferably set as follows: Yhp = Xsp × (Yh / Xh) (1)

The optical component O for condensing the projection image PJ
P is given by θ = tan ⁻¹ (Ys / f) (2) where f [mm] is the focal length and θ [degree] is the condensing angle, as shown in the following equation (2). It satisfies the relationship. Further, the distance from the observation viewpoint of the observer OB to the hologram surface SF is e [mm].

Now, under these conditions, a virtual projection image VP is projected on the hologram surface SF from the point PP in the horizontal direction to the area where the screen surface SC is viewed, as shown in FIG. Is done. Therefore, on the screen surface SC, (Yhp × Yi / Yh) [pixel] of the number of horizontal pixels Yhp [pixel] in the virtual projection image VP.
What is necessary is just to project what extracted the pixel of. However,
Yi is represented by the following equation (3): Yi = 2 × z × tan (θ / 2) (3) As is apparent from this principle, in the mapping conversion processing, when an image is exposed and recorded at a predetermined depth position z [mm] of the hologram recording medium, the distance e [mm] from the observation viewpoint to the hologram surface SF is obtained. ].

On the other hand, as shown in FIG. 9B, since the image is exposed and recorded at a predetermined depth position z [mm] from the hologram surface SF, the projected image PJ is shifted in the vertical direction on the hologram surface SF. It must be reduced by a factor of e / (e + z). In the projection image PJ, the length in the vertical direction (Xs × e / (e + z)) [mm] on the hologram surface SF is exposed and recorded as it is without being enlarged or reduced from the screen surface SC. Therefore, the number of pixels Xhp [pixel] in the vertical direction in the virtual projection image VP is displayed on the screen surface SC.
Of these, the extracted pixel of (Xhp × e / (e + z)) [pixel] may be projected.

Further, in the mapping conversion processing,
It is necessary to consider the relationship between the movement pitch dy [mm] on the hologram surface SF and the center position of the cutout area on the screen surface SC. This relationship is such that when an image corresponding to an element hologram image to be displayed on the display means is generated, the original image is (Yhp × dy / Yh) [pixe
l] may be given.

FIG. 11 summarizes the relationship between the image corresponding to one element hologram image whose viewpoint has been converted by performing such mapping conversion processing and the reproduced image. Using the object light transmitted through the display unit corresponding to the above-described transmission type liquid crystal display 80 on which the image subjected to the mapping conversion processing is displayed, the image is exposed and recorded at the depth position z [mm] of the hologram recording medium. In the projected image PJ, the length in the horizontal direction (parallax direction) is Yr [mm], the length in the vertical direction (non-parallax direction) is Xr [mm], and the number of pixels in the horizontal direction is Yrp.
[pixel], and the number of pixels in the vertical direction is Xrp [pixel].
Note that the vertical resolution Mr [pixel] in the projection image PJ
/ mm] is expressed as follows: Mr = Xrs / Xr [pixel / mm] (4) as shown in the following equation (4).

At this time, a reproduced image E reproduced from the element hologram exposed and recorded by the projection image PJ
PL is assumed to be located at a position virtually separated from the viewpoint by the observer OB by a predetermined distance D [mm], and the distance from the viewpoint by the observer OB to the hologram surface SF is e [mm]. ], The virtual distance from the hologram surface SF to the reproduced image EPL is k [mm], which is the difference between the distance D and the distance e.

In this case, as for the size of the reproduced image EPL, the length in the horizontal direction (parallax direction) is Yt [mm], and the length in the vertical direction (non-parallax direction) is Xt [mm]. As shown in the following equations (5) and (6), Yt = (Yr / z) × k = 2 × tan (θ / 2) × k (5) Xt = (Xr / e) × D = (Xr / e) × (e + k) (6) Further, the vertical resolution Mt [pixel / mm] in the reconstructed image EPL with respect to the image corresponding to one element hologram image whose viewpoint has been converted is represented by the following equation (7): Mt = Mr × (Xr / Xt) = Mr × (e / D) (7)

FIG. 12 shows the relationship between the size of the holographic stereogram finally produced and the reproduced image.

The size of the reproduced image PL reproduced from the entire holographic stereogram produced is determined by the interval between the reproduced images EPL of the element holograms located at both ends. That is, assuming that the horizontal length in the holographic stereogram is Yu [mm] and the vertical length is Xu [mm], the interval between the element holograms located at both ends is Yu [mm]. Then, as shown in FIG. 11, the length in the horizontal direction (parallax direction) of the reproduced image EPL reproduced for these element holograms is Yt [mm].
Since the length in the vertical direction (non-parallax direction) is Xt [mm], the size of the reproduced image PL is in the horizontal direction (parallax direction).
Is defined as Yv [mm] and the length in the vertical direction (non-parallax direction) is defined as Xv [mm]. As shown in the following equations (8) and (9), Yv = Yu + Yt = Yu + (Yr / z) × k (8) Xv = Xt = (Xr / e) × D = (Xr / e) × (e + k) (9) Note that the vertical resolution Mv [pixel / mm] in the reproduced image PL for an image corresponding to one element hologram image whose viewpoint has been converted remains unchanged, and as shown in the following equation (10), Mv = Mt = Mr × (Xr / Xt) = Mr × (e / D) (10) Here, the vertical direction in the holographic stereogram is the non-parallax direction, and the projected image PJ incident by the object light is exposed and recorded as an elementary hologram at the same magnification in the vertical direction.
In the relationship between J and the size of the holographic stereogram, Xr = Xu.

In the printed matter manufacturing apparatus 1, while the panorama image PI is generated by the above-described image conversion unit 30, the above-described principle is applied by the above-described image processing unit 40 to apply the holographic stereogram. The mapping conversion processing is performed so that the reproduced image of the panoramic image PI reproduced as an image is located at a predetermined distance from the observation viewpoint. At this time, the image processing unit 40 uses one of the following three methods to
A predetermined distance D from the observation viewpoint at which the reproduced image is localized is determined. Here, as shown in FIG. 13, six images II ₁ , II ₂ , II ₃ , and I obtained by photographing with the digital still camera 100 described above.
A case where a mapping conversion process is performed on a panoramic image PI generated from an input image sequence II including I ₄ , II ₅ , and II ₆ will be described.

Here, each image II ₁ , II ₂ , II ₃ , II ₄ , II ₅ , II constituting the input image sequence II
Reference numeral ₆ denotes an image captured by the digital still camera 100 at a horizontal viewing angle (viewing angle) of 40 [degree] and a vertical viewing angle (viewing angle) of 30 [degree], respectively (horizontal direction × vertical direction).
Is assumed to be (1280 × 960) [pixel]. In this case, assuming that the image conversion unit 30 generates a panoramic image PI in which the number of pixels in the (horizontal direction × vertical direction) is (2880 × 1620) [pixel], the panoramic image PI has a horizontal angle of view. The image is 90 [degree] and the vertical angle of view is equivalent to 50.625 [degree].

The image processing unit 40 applies the following method to such a panoramic image PI by using the following method.
A predetermined distance D from the observation viewpoint at which the reproduced image of I is localized is determined.

First, the first method is to set a spatial resolution in a reproduced image of the panoramic image PI. That is, in the first method, as shown in FIG. 14A, when the distance from the assumed observation viewpoint to the hologram surface SF in the printed matter P is e [mm], the distance D [mm] from the observation viewpoint is considered. ], The reproduced image of the panoramic image PI is localized at the resolution Mv [pixel / mm]. This will be specifically described by giving numerical values.

The above-described panoramic image P in which the number of pixels in the (horizontal direction × vertical direction) is (2880 × 1620) [pixels]
I is defined as (40 × 3) where the length of (horizontal direction Yu × vertical direction Xu) is
0) It is displayed by a holographic stereogram of [mm]. When the distance e [mm] from the assumed observation viewpoint to the hologram surface SF in the printed matter P is 50 [mm], the distance D from the observation viewpoint is D = It is assumed that the reproduced image of the panoramic image PI is localized at a position of 60 [mm] with a resolution Mv = 45 [pixel / mm]. A projection image PJ of a plurality of viewpoint-converted images constituting a viewpoint-converted image sequence PXI in which the viewpoint is converted by performing mapping conversion processing on the panoramic image PI is recorded by exposure at an angle of view θ = 90 [degree]. Shall be.

In this case, the size of the panoramic image PI to be printed has a length (horizontal direction × vertical direction) of (64 × 36) at a position D = 60 [mm] from the observation viewpoint.
[mm].

On the other hand, when the distance e [mm] from the assumed observation viewpoint to the hologram surface SF on the printed matter P is 50 [mm], the length of (horizontal direction Yu × vertical direction Xu) is (40).
× 30) The image area that can be displayed at a distance D = 60 [mm] from the observation viewpoint using the holographic stereogram of [mm] has a length of (60 × Yv × Xv) (60).
× 36) [mm]. That is, the image area that can be displayed by this holographic stereogram has a pixel number of (horizontal direction × vertical direction) of (2700 × 1620) [pixe
l].

Therefore, the image processing unit 40 determines that the number of pixels in the (horizontal direction × vertical direction) is (2880 × 1620)
The surrounding area of the panoramic image PI of [pixel] is cut off, and as shown by the area surrounded by the broken line in FIG.
The number of pixels in the (horizontal direction × vertical direction) is (2700 × 1620)
A panoramic image PI ′ of [pixel] is cut out, and the entire area of the panoramic image PI ′ is used for the mapping conversion processing, so that the reproduced image of the panoramic image PI ′ is located at a distance D [mm] from the observation viewpoint. be able to. When using the first method, if the image processing unit 40 focuses on the position at which the reproduced image is localized, the image processing unit 40 performs the panoramic image processing regardless of the size of the holographic stereogram or the number of pixels of the panoramic image PI. The reproduced image can be localized in association with the spatial size of the PI.

Next, in the second method, the panoramic image PI
Focusing on the number of pixels of the panoramic image PI, as shown in FIG. 14 (B), it is possible to observe all reproduced images of the panoramic image PI through the printed matter P composed of holographic stereograms. This will be specifically described by giving numerical values.

The above-described panoramic image P in which the number of pixels in the (horizontal direction × vertical direction) is (2880 × 1620) [pixels]
I is defined as (40 × 3) where the length of (horizontal direction Yu × vertical direction Xu) is
0) The holographic stereogram of [mm] is displayed, and the distance e [mm] from the assumed observation viewpoint to the hologram surface SF in the printed matter P is 40 [mm]. A projection image PJ of a plurality of viewpoint-converted images constituting a viewpoint-converted image sequence PXI in which the viewpoint is converted by performing mapping conversion processing on the panoramic image PI is recorded by exposure at an angle of view θ = 90 [degree]. Shall be.

In this case, the size of the reproduced image reproduced from the entire holographic stereogram is the length Yv [mm] in the horizontal direction (parallax direction) and the length Xv [mm] in the vertical direction (non-parallax direction). Are given by the following equations (11) and (12), respectively.
As shown in the following, Yv = Yu + Yt = Yu + (Yr / z) × k = 40 + 2 × k (15) Xv = (30/40) × (40 + k) (12)

Under these conditions, a panoramic image PI is printed through a printed matter P composed of a holographic stereogram.
, Ie, the number of pixels is (horizontal direction × vertical direction) = (2880 × 1620) [pixe
l] and (horizontal direction × vertical direction) =
A virtual distance k [mm] from the hologram surface SF to the reproduced image is determined so that the size of the reproduced image reproduced from the entire holographic stereogram represented by (Yv × Xv) [mm] matches. Is 20 [mm].

As a result, the size of the reproduced image reproduced from the entire holographic stereogram is (Y
v × vertical direction Xv) = (80 × 45) [mm], and the resolution Mv [pixel / m] when displaying the panoramic image PI in which (horizontal direction × vertical direction) = (2880 × 1620) [pixel]
m] is 36 [pixel / mm].

Therefore, the image processing unit 40 determines that the number of pixels in the above (horizontal direction × vertical direction) is (2880 × 1620)
For the panoramic image PI of [pixel], the virtual distance k from the hologram surface SF to the reproduced image is k = 20.
By performing mapping conversion processing using [mm] and the resolution Mv = 36 [pixel / mm], the distance D =
Panoramic image P at the position of e + k = 40 + 20 = 60 [mm]
The reproduced image of I can be localized. Image processing unit 40
Is, when this second method is used, the panoramic image P
According to the number of pixels of I and the aspect ratio thereof, the position at which the reproduced image is localized and the spatial resolution at that position can be associated.

Next, in the third method, the panoramic image PI
Paying attention to the viewing angle (angle of view), as shown in FIG. 14C, the setting is made so as to have the same or a fixed relationship with the viewing angle. This will be specifically described by giving numerical values.

The number of pixels in the (horizontal direction × vertical direction) is (2880 × 1620) [pixel], and the horizontal angle of view is 9
A panoramic image PI having 0 [degree] and a vertical angle of view equivalent to 50.625 [degree] is expressed by (horizontal direction Yu × vertical direction Xu).
Is a holographic stereogram having a length of (40 × 30) [mm], and a distance e from the assumed observation viewpoint to the hologram surface SF in the printed matter P.
[mm] is set to 50 [mm]. Here, the horizontal (parallax) angle of view Yu_ang [degre] when the holographic stereogram is observed with the front central portion as the observation viewpoint.
e] and the angle of view Xu_ang [degre] in the vertical direction (non-parallax direction).
e] is Yu_ang = 2 × tan ⁻¹ (Yu / (2 × e)) (13) Xu_ang = 2 × tan ⁻ as shown in the following equations (13) and (14), respectively. ¹ (Xu / (2 × e)) (14), Yu_ang = 43.60 [degree], Xu
_Ang = 33.40 [degree].

A projection image PJ composed of a plurality of viewpoint-converted images constituting a viewpoint-converted image sequence PXI in which the viewpoint is converted by performing mapping conversion processing on the panoramic image PI is exposed and recorded at an angle of view θ = 90 [degree]. Assuming that the size of the reproduced image reproduced from the entire holographic stereogram is such that the length Yv [mm] in the horizontal direction and the length Xv [mm] in the vertical direction (non-parallax direction) are respectively: As shown in the following equations (15) and (16), Yv = Yu + Yt = Yu + (Yr / z) × k = 40 + 2 × k (15) Xv = Xt = (Xr / e) × D = (Xr / e) × (e + k) = (30/50) × (50 + k) (16)

At this time, the angle of view Yv_ang [degree] in the horizontal direction (parallax direction) and the angle of view Xv_ang [degree] in the vertical direction (non-parallax direction) of the reproduced image reproduced from the entire holographic stereogram are respectively: As shown in the following equations (17) and (18), Yv_ang = 2 × tan ⁻¹ (Yv / (2 × (50 + k))) (17) Xv_ang = 2 × tan ⁻¹ (Xv / (2 × (50 + k))) (18) Here, the angle of view X in the vertical direction (non-parallax direction)
v_ang [degree] is obtained by the above equations (16) and (18)
Xv_ang = 2 × tan ⁻¹ ((30/5
0) / 2) = 33.40 [degree].

Under these conditions, the distance D =
Assuming that the reproduced image of the panoramic image PI is localized at the position of 80 [mm], the virtual distance k from the hologram surface SF to the reproduced image is k = 30 [mm]. Using the above equation (17), the angle of view Yv_ang [degree] is Yv_ang = 64.01 [degree].

Thus, the distance e [mm] from the assumed observation viewpoint to the hologram surface SF in the printed matter P is set to 50.
[mm], a (holographic stereogram) having a length of (40 × 30) [mm] (horizontal direction Yu × vertical direction Xu) can be displayed at a distance D = 80 [mm] from the observation viewpoint. In the image area, the number of pixels in the (horizontal direction × vertical direction) is (6
4.01 × 2880/90) × (33.40 × 1620)
/50.625)=(2048.34×1068.7)
5) It becomes [pixel].

Therefore, the image processing unit 40 determines that the number of pixels in the above (horizontal direction × vertical direction) is (2880 × 1620)
The surrounding area of the panoramic image PI of [pixel] is cut off, and as shown by the area surrounded by the broken line in FIG.
The number of pixels in the (horizontal direction × vertical direction) is (2048.34 × 10
68.75) The panoramic image PI ′ of [pixel] is cut out, and the entire area of the panoramic image PI ′ is used for the mapping conversion processing, thereby giving the given panoramic image P ′.
The panoramic image PI ′ can be displayed at the same angle of view as the viewing angle of I. At this time, when the front central part of the holographic stereogram is observed as the observation viewpoint, the angle of view Yu_ang [degree] in the horizontal direction (parallax direction) is 4
Whereas the angle of view Yv_ang [degree] in the horizontal direction (parallax direction) of the reproduced image reproduced from the entire holographic stereogram is 64.01 [deg], whereas the angle is 3.60 [degree].
ree]. Image processing unit 40
, The panoramic image P
In accordance with the number of pixels of I and the angle of view thereof, the position at which the reproduced image is localized and the spatial resolution at that position can be associated.

Here, as a third method, a panoramic image PI 'is cut out so as to have the same angle of view as the viewing angle of the given panoramic image PI, and the entire area of the cut out panoramic image PI' is Has been described as being used for the mapping conversion process, but may have a certain relationship such as a proportional relationship without having the same angle of view.

For example, the image processing unit 40 determines that the number of pixels in the above (horizontal direction × vertical direction) is (2880 × 1620) [pix
el] as a panoramic image PI ′ cut out by cutting off the surrounding area in the panoramic image PI,
It is assumed that the number of pixels in the (horizontal direction × vertical direction) is multiplied by a predetermined number, for example, 1.25 times, and (1.25 × 64.01 × 2)
880/90) × (1.25 × 33.40 × 1620 /
50.625) = (256.43 × 1335.94)
A panoramic image PI 'having the number of pixels of [pixel] is cut out, and the entire area of the panoramic image PI' is used for the mapping conversion processing, whereby a panoramic image effect of a method of reducing the angle of view and a holographic stereogram are obtained. It is possible to display a panoramic image having both the effect and the panoramic image effect of being a parallax image print.

As described above, the image processing section 40 performs a method of setting a spatial resolution in a reproduced image of the panoramic image PI. The image processing section 40 can observe all of the reproduced image of the panoramic image PI based on the number of pixels of the panoramic image PI. ○ A method of setting the panoramic image PI to have the same or a constant relationship with the viewing angle (angle of view) of the panoramic image PI, using a predetermined method from the observation viewpoint for localizing the reproduced image of the panoramic image PI The distance D can be determined. In the produced holographic stereogram, for the parallax in the horizontal direction, the viewpoint position information is corrected by such mapping conversion processing, and for the vertical direction, the information of the panoramic image PI is stored as it is. Accordingly, when the observer observes the panoramic image PI via the printed matter P, the printed matter manufacturing apparatus 1 generates the printed matter P that has little inconsistency in the positional relationship and can display a high sense of reality and high image quality. Can be manufactured.

The printed matter P has a panoramic image PI that is not located near the hologram surface SF, and the hologram surface S
Since it is localized at a predetermined distance deep from F, the stripes of the recorded slit-shaped element hologram image are less likely to be visually recognized. In other words, the resolution of a holographic stereogram produced so that the holographic stereogram image is localized near the hologram surface SF is usually the number of recorded element hologram images. Therefore, the holographic stereogram is
When the number of element hologram images is small, the streaks are easily recognized by an observer, and a holographic stereogram image with a coarse resolution is reproduced. Print P
Since the panoramic image PI, which is a holographic stereogram image, is not localized near the hologram surface SF, the number of element holograms does not directly affect the resolution, and the stripes of the element hologram image are difficult to be visually recognized by an observer. Becomes This effect is not limited to the case where the panoramic image PI is recorded, but also occurs when an arbitrary image is recorded.

As described above, the printed matter manufacturing apparatus 1 according to the embodiment of the present invention converts a plurality of images into a panoramic image PI by the image conversion unit 30 and converts the plurality of images into a predetermined panoramic image PI by the image processing unit 40. By performing a mapping conversion process so as to be localized at a distance to generate a viewpoint conversion image and printing it as a holographic stereogram by the printing unit 60, a display that is physically smaller than the size of the panoramic image PI is printed. Surface S
From F, it is possible to manufacture a printed matter P excellent in portability, in which all information of the panoramic image PI can be observed with high image quality. Therefore, the observer can observe a large still image such as a panoramic image without requiring a system capable of operating dedicated viewer software, and enjoy high entertainment and excellent convenience.

Further, the printed matter manufacturing apparatus 1 only has to input the image sequence I photographed by the existing digital still camera 100, video camera recorder or the like. In order to obtain the image sequence I, it is necessary to use a dedicated camera. Absent. Usually, when capturing a continuous image or a side-by-side image, it is necessary to perform accurate shooting such as errors in the direction of movement of the line of sight such as vertical movement of the camera, errors in the amount of movement of the line of sight due to the camera not being at a constant speed, and camera shake. In consideration of various obstructing factors, for example, as shown in FIG. 15A, a camera HCM that moves in the horizontal direction that is the parallax direction with respect to the subject OBJ, or as shown in FIG. , Subject OB
Camera RC that rotates horizontally in a fixed position with respect to J
A special camera such as M must be used. On the other hand, when using the printed matter manufacturing apparatus 1, the photographer does not need to consider all of these impediments, and may photograph the image sequence I with the existing digital still camera 100, video camera recorder, or the like.

Further, when performing the mapping conversion processing by the image processing unit 40, the printed matter manufacturing apparatus 1 generates a viewpoint-converted image using the projection method information of the panoramic image PI, so that the printed matter P having a high sense of reality can be obtained. Can be manufactured.

Note that the present invention is not limited to the above embodiment. For example, in the above-described embodiment, the printed matter manufacturing apparatus 1 exposes and records a plurality of strip-shaped element holograms to one hologram recording medium 110, thereby printing a holographic stereogram having parallax information in the horizontal direction. Although the description has been made assuming that P is manufactured, the present invention is to perform the viewpoint conversion in the vertical direction on the panoramic image PI and to expose and record a plurality of dot-shaped element holograms on one hologram recording medium 110. Thus, a printed matter P composed of a holographic stereogram having parallax information in the horizontal direction and the vertical direction may be manufactured.

Further, in the above-described embodiment, the printed matter manufacturing apparatus 1 has been described as manufacturing the printed matter P as a holographic stereogram, but the present invention is directed to an apparatus for manufacturing the printed matter P as a lenticular sheet or a hologram. The panorama image can be displayed by following the method for localizing the panorama image described above.

Furthermore, in the above-described embodiment, an example has been described centering on an example of manufacturing a printed matter P in which a panoramic image PI is recorded so as to be located at a predetermined distance behind the hologram surface SF. The present invention can be easily applied to a method for manufacturing a printed matter P in which a panoramic image PI is recorded so as to be located at a predetermined distance before the hologram surface SF. In this case, since the panorama image PI is not localized near the hologram surface SF in the manufactured printed matter P, it is needless to say that the streaks of the recorded element hologram image are hardly visually recognized. .

As described above, it goes without saying that the present invention can be appropriately changed without departing from the spirit of the present invention.

[0119]

As described above in detail, the printed matter manufacturing apparatus according to the present invention is a printed matter manufacturing apparatus for manufacturing a printed matter based on a parallax image, and includes image input means for inputting a plurality of images, and Image conversion means for converting a plurality of images input by the image input means into a panoramic image, and generating a plurality of viewpoint-converted images based on the panoramic image generated by conversion by the image conversion means A viewpoint conversion unit, and a printing unit that manufactures a printed matter based on the plurality of viewpoint conversion images generated by the viewpoint conversion unit. The viewpoint conversion unit is reproduced from the printed matter printed and manufactured by the printing unit. A plurality of viewpoint-converted images are generated such that the reproduced image of the panoramic image is located at a predetermined distance from the observation viewpoint.

Therefore, the printed matter manufacturing apparatus according to the present invention generates a panoramic image by the image conversion means based on the plurality of images, and generates the panoramic image by the viewpoint conversion means so that the panoramic image is localized at a predetermined distance from the observation viewpoint. By generating a viewpoint-converted image of the panorama image and manufacturing a printed matter by a printing unit based on the plurality of viewpoint-converted images, the entirety of the panorama image from a display surface that is physically smaller than the size of the panorama image is a printed matter. It is possible to manufacture a printed matter excellent in portability in which information can be observed with high image quality, and it is possible to provide an observer with high entertainment and excellent convenience.

Further, the method for producing a printed material according to the present invention comprises:
A printed matter manufacturing method for manufacturing a printed matter based on a parallax image, wherein an image inputting step of inputting a plurality of images and a process of converting the plurality of images input in the image inputting step into a panoramic image are performed. An image conversion step, a viewpoint conversion step of generating a plurality of viewpoint conversion images based on a panorama image generated by conversion in the image conversion step, and a plurality of viewpoint conversion images generated in the viewpoint conversion step. And a printing step of manufacturing a printed matter based on the viewpoint conversion step, so that a reproduced image of a panoramic image reproduced from the printed matter printed and manufactured in the printing step is located at a predetermined distance from the observation viewpoint, A plurality of viewpoint conversion images are generated.

Therefore, the printed matter manufacturing method according to the present invention generates a panoramic image based on a plurality of images, and generates a plurality of viewpoint-converted images such that the panoramic image is located at a predetermined distance from the observation viewpoint. By manufacturing a printed matter based on the plurality of viewpoint-converted images, it is possible to observe all information of the panoramic image with high image quality from a display surface that is physically smaller than the size of the panoramic image while being a printed matter. Thus, it is possible to produce a printed matter having excellent reproducibility, and it is possible to provide a viewer with high entertainment and excellent convenience.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a relationship between a panoramic image and a printed matter manufactured by a printed matter manufacturing apparatus according to an embodiment of the present invention, and illustrates a concept in which an observer observes a panoramic image as a still image through the printed matter. FIG.

FIG. 2 is a diagram for explaining a relationship between a panoramic image and a printed material, for conceptually explaining how an observer can observe all information of a panoramic image by observing the printed material from different observation viewpoints. FIG.

FIG. 3 is a block diagram illustrating a configuration of the printed matter manufacturing apparatus.

FIG. 4 is a sectional view of a principal part for explaining a hologram recording medium used in the printed matter manufacturing apparatus.

5A and 5B are diagrams illustrating a photosensitive process of the hologram recording medium, wherein FIG. 5A shows an initial state, and FIG.
FIG. 4 illustrates an exposure state, and FIG. 4C illustrates a fixing state.

6A and 6B are diagrams illustrating an optical system in a printing unit included in the printed matter manufacturing apparatus, wherein FIG. 6A is a front view of the optical system, and FIG. 6B is a plan view of the optical system. .

FIG. 7 is a diagram illustrating a configuration of a recording medium traveling system provided in the printing unit.

FIG. 8 is a view for explaining an outline of mapping conversion processing by an image processing unit provided in the printed matter manufacturing apparatus, and is a holographic stereogram image in a case where a printed matter as a holographic stereogram is manufactured by performing the mapping conversion processing. It is a figure showing a situation of a barrel panorama image.

FIG. 9 is a diagram for explaining a basic principle of mapping conversion processing by the image processing unit, and for explaining a relationship between a projection image, a virtual projection image projected on a screen surface, and a hologram surface. .

10A and 10B are diagrams for explaining the basic principle of mapping conversion processing by the image processing unit, wherein FIG. 10A is a plan view illustrating a relationship between a projection image, a screen surface, and a hologram surface; B) shows these relationships in a side view.

FIG. 11 is a diagram for explaining the basic principle of mapping conversion processing by the image processing unit, and is a diagram illustrating a relationship between an image corresponding to one element hologram image subjected to mapping conversion processing and a viewpoint converted and a reproduced image; It is a figure for explaining a relation.

FIG. 12 is a diagram for explaining a basic principle of mapping conversion processing by the image processing unit, and for explaining a relationship between a size of a holographic stereogram finally produced and a reproduced image.

FIG. 13 is a diagram for explaining how to generate a panoramic image as an example.

FIGS. 14A and 14B are diagrams illustrating processing contents in the image processing unit when determining a predetermined distance from an observation viewpoint for localizing a reproduced image of a panoramic image, wherein FIG. A first method by setting a spatial resolution is shown. (B) focuses on the number of pixels of a panoramic image so that all reproduced images of the panoramic image can be observed through a printed matter P composed of a holographic stereogram. (C) shows a second method by setting
FIG. 8 is a diagram showing a third method by focusing on a viewing angle (view angle) of a panoramic image and setting the viewing angle to have the same or a fixed relationship with the viewing angle.

15A and 15B are diagrams illustrating a normal photographing method using a dedicated camera for photographing a continuous image or a side-by-side image, and FIG.
FIG. 4A is a diagram illustrating a camera that moves in a horizontal direction with respect to a subject, and FIG. 4B is a diagram illustrating a camera that rotates in a horizontal direction at a fixed position with respect to the subject.

FIG. 16 is a diagram illustrating a conventional relationship between a panoramic image and a printed matter or a photograph.

FIG. 17 is a diagram illustrating a relationship between a conventional panoramic image and viewer software.

[Explanation of symbols]

REFERENCE SIGNS LIST 1 printed matter manufacturing apparatus, 10 image processing computer, 20 image input unit, 30 image conversion unit, 40
Image processing unit, 50 printing control unit, 60 printing unit,
110 hologram recording medium, I image sequence, I
I input image sequence, P print, PI panorama image, PXI viewpoint conversion image sequence

 ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Shigeyuki Baba 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Sony Corporation F-term (reference) 2H059 AB02 AC04 AC06 2K008 BB00 BB04 BB05 DD13 FF08 FF17 HH26 5B057 CA12 CA16 CB12 CB16 CD11 CE10 5C061 AA21

Claims (16)

[Claims] 1. A printed matter manufacturing apparatus for manufacturing a printed matter based on a parallax image, comprising: an image input unit for inputting a plurality of images; and a panorama image for the plurality of images input by the image input unit. Image conversion means for performing the conversion processing of: a viewpoint conversion means for generating a plurality of viewpoint conversion images based on the panoramic image generated by conversion by the image conversion means; and a plurality of the plurality of viewpoint conversion images generated by the viewpoint conversion means. A printing unit that manufactures a printed matter based on the viewpoint conversion image, wherein the viewpoint conversion unit determines a reproduction image of the panoramic image reproduced from the printed material printed and manufactured by the printing unit from an observation viewpoint. As if localized at a distance of
A printed matter manufacturing apparatus, wherein the plurality of viewpoint converted images are generated. 2. The method according to claim 1, wherein the viewpoint conversion means determines the predetermined distance at which the reproduced image is to be localized by setting a spatial resolution in a reproduced image of the panoramic image reproduced from the printed matter. The printed matter manufacturing apparatus according to claim 1. 3. The image processing apparatus according to claim 2, wherein the viewpoint conversion unit is configured to observe all the reproduced images of the panorama image through the printed matter based on the number of pixels of the panorama image generated by the conversion by the image conversion unit. 2. The printed matter manufacturing apparatus according to claim 1, wherein the predetermined distance at which the reproduced image is to be localized is determined. 4. The viewpoint conversion unit is obtained based on viewing angle information and / or viewing angle information recorded in association with each of the plurality of images input to the image input unit. 2. The printed matter manufacturing apparatus according to claim 1, wherein the predetermined distance at which the reproduced image of the panoramic image reproduced from the printed matter is to be localized based on the viewing angle information of the panoramic image. 5. The apparatus according to claim 4, wherein the viewpoint conversion means determines the predetermined distance at which the reproduced image is to be localized so as to have the same or a fixed relationship with the viewing angle of the panoramic image. The printed matter manufacturing apparatus according to the above. 6. The method according to claim 1, wherein the viewpoint conversion unit generates the plurality of viewpoint conversion images using projection method information indicating a spatial shape on which the panoramic image is projected. Print production equipment. 7. The viewpoint conversion means, such that a reproduced image of the panoramic image reproduced from the printed matter is localized at a predetermined distance in front or behind a display surface of the printed matter.
The printed matter manufacturing apparatus according to claim 1, wherein the plurality of viewpoint conversion images are generated. 8. The apparatus according to claim 1, wherein the printed matter is a lenticular sheet, a hologram, or a holographic stereogram. 9. A printed matter manufacturing method for manufacturing a printed matter based on a parallax image, comprising: an image inputting step of inputting a plurality of images; and a panoramic image for the plurality of images input in the image inputting step. An image conversion step of performing conversion processing to the image data; a viewpoint conversion step of generating a plurality of viewpoint conversion images based on the panorama image generated by conversion in the image conversion step; A printing step of manufacturing a printed matter based on the plurality of viewpoint converted images, wherein the reproduced image of the panoramic image reproduced from the printed matter printed and manufactured in the printing step is included in the viewpoint converting step. A printed matter manufacturing method, wherein the plurality of viewpoint converted images are generated so as to be localized at a predetermined distance from an observation viewpoint. 10. In the viewpoint conversion step, the predetermined distance at which the reproduced image is to be localized is determined by setting a spatial resolution of the reproduced image of the panoramic image reproduced from the printed matter. The method for producing a printed matter according to claim 9, wherein: 11. In the viewpoint conversion step, based on the number of pixels of the panorama image converted and generated in the image conversion step, all reproduction images of the panorama image can be observed through the printed matter. The method according to claim 9, wherein the predetermined distance at which the reproduced image is to be localized is determined. 12. The viewpoint conversion step, wherein the viewpoint conversion step is performed based on viewing angle information and / or viewing angle information recorded in association with each of the plurality of images input in the image input step. 10. The printed matter manufacturing method according to claim 9, wherein the predetermined distance at which a reproduced image of the panoramic image reproduced from the printed matter is to be localized based on the viewing angle information of the panoramic image. 13. In the viewpoint conversion step, the predetermined distance at which the reproduced image is to be localized is determined so as to have the same or a fixed relationship with the viewing angle of the panoramic image. 13. The method for producing printed matter according to item 12. 14. The viewpoint conversion step, wherein the plurality of viewpoint conversion images are generated using projection method information indicating a spatial shape on which the panorama image is projected. Printed matter manufacturing method. 15. In the viewpoint conversion step, the plurality of viewpoint conversions are performed such that a reproduced image of the panoramic image reproduced from the printed material is located at a predetermined distance in front or behind a display surface of the printed material. The method according to claim 9, wherein an image is generated. 16. The printed matter is a lenticular sheet,
The method for producing a printed matter according to claim 9, comprising a hologram or a holographic stereogram.