JP5719754B2 - Apparatus and method for capturing and displaying stereoscopic panoramic images - Google Patents

Description

  The present invention relates generally to the field of recording and creating images, and more particularly to creating, displaying and printing panoramic images in three dimensions. The present invention particularly provides a system and method for creating and displaying a stereoscopic panoramic image set. This stereoscopic panoramic image set includes at least two images of each scene, each image has a different viewing direction, and when the viewer views each with the left eye and the right eye simultaneously, It looks like an image.

  US Patent Application No. 09 / 396,248, dated September 16, 1999, in the name of Shmuel Peleg et al., “System and Method for Generating and Displaying Panoramic Images and Movies (System and Method for Generating) and Displaying Panoramic Images and Movies) (hereinafter referred to as “Pelegg Patent Application I”) is the applicant's application, which is incorporated herein by reference.

  US patent application Ser. No. 09 / 726,198 dated November 29, 2000, named by Shmuel Peleg et al., Entitled “stereo panoramic camera arrangement for recording panoramic images useful in stereo panoramic image pairs (Stereo Panoramic “Camera Arrangements For Recording Panoramic Images Useful In A Stereo Panoramic Image Pair” (hereinafter referred to as “Pelegg Patent Application II”) is the application of the present applicant, and is hereby incorporated by reference. Quote.

  US patent application Ser. No. 09 / 792,638, Feb. 24, 2001, named by Shumuel Peleg et al., Entitled “System And Method to Facilitate Display Adjustment in Stereo Panorama Image Pairs” “For Filtration The Adjustment Of Disparity In A Stereo Panoramic Image Pair” (hereinafter referred to as “Pelegg Patent Application III”) is the applicant's application, which is incorporated herein by reference. To do.

  A panoramic image is a scene image having an ultra-wide field of view of a maximum of 360 °. A panoramic image is recorded using a wide-angle lens, a mirror, or the like, and can provide a wide-angle visual field. A panoramic image with a wide-angle field of view can be done, for example, by recording multiple images around a particular point and creating a single mosaic image using conventional mosaic processing techniques. A panoramic image can also be created from a scene simulated using conventional computer graphic techniques. Stereoscopic panoramic images can also be created from many images using a wide variety of techniques known to those skilled in the art. One of the techniques, a paper by Joshua Gluckman et al. Published in 1998 at the DARPA Image Understanding Workshop, “Real-time Multidirectional and Panorama” In the method described in “Stereo (Real-Time Omnidirectional And Panoramic Stereo)”, a panoramic image of a surrounding scene is recorded using two multi-directional cameras arranged in a vertical direction along a common axis. Are spaced apart so that the pair of images recorded by these two cameras gives depth information about the subject in the scene around the camera, when considered in combination. Since location is vertical, the image recorded as described above, the human is unsuitable for visual as stereoscopic panorama.

  The present invention provides a new and improved system and method for creating and displaying stereoscopic panoramic image sets. This stereoscopic panoramic image set includes at least two panoramic images of a scene, each image has a different viewing direction, and if the viewer sees the left eye and the right eye at the same time, the viewer sees the scene. It looks like a stereoscopic image.

  Briefly summarized, the present invention provides a placement system for recording an image used to create and use an image that includes a set of stereoscopic images. The arrangement system includes at least one stereoscopic data recording / transmission device (stereo data source), at least one utilization device, and a distribution channel. The at least one stereoscopic data recording / transmitting apparatus records an image capable of creating a stereoscopic image set. The utilization device is provided to enable viewing and printing using a stereoscopic image set. The distribution channel enables information transmission between the stereoscopic data recording / transmitting apparatus and the using apparatus, and the information includes an image recorded by the stereoscopic data recording / transmitting apparatus or an obtained stereoscopic image set. Includes itself. When the stereoscopic image set is composed of a plurality of mosaic images, these mosaic images can be created using the stereoscopic data recording / transmitting device, the image using device, and / or the distribution channel.

  A large number of three-dimensional data recording / transmission apparatuses having various configurations, for example, fixed and movable mirrors, prisms, lenses, etc., are disclosed. Is.

1 is a schematic diagram of a stereoscopic panorama image creation system configured to record, create and display a stereoscopic panorama image according to the present invention. It is the schematic of the external appearance plane of the three-dimensional data recording / transmission apparatus used regarding the three-dimensional panoramic image production system shown by FIG. FIG. 3 is a functional block diagram of the three-dimensional data recording / transmission apparatus shown in FIG. 2. It is a functional block diagram of an example of the display apparatus shown by FIG. FIG. 2 is a diagram useful for understanding operations performed in the stereoscopic panorama image creation system shown in FIG. 1 with respect to creation of a stereoscopic panorama image set. It is a figure useful for understanding the system configuration which creates and displays a lenticular print. It is explanatory drawing of the example of the image recording part which can be used in relation to the three-dimensional data recording transmission apparatus described regarding FIG. 2 and FIG. It is explanatory drawing of the example of the image recording part which can be used in relation to the three-dimensional data recording transmission apparatus described regarding FIG. 2 and FIG. It is explanatory drawing of the example of the image recording part which can be used in relation to the three-dimensional data recording transmission apparatus described regarding FIG. 2 and FIG. It is explanatory drawing of the example of the image recording part which can be used in relation to the three-dimensional data recording transmission apparatus described regarding FIG. 2 and FIG. It is explanatory drawing of the example of the image recording part which can be used in relation to the three-dimensional data recording transmission apparatus described regarding FIG. 2 and FIG. It is explanatory drawing of the example of the image recording part which can be used in relation to the three-dimensional data recording transmission apparatus described regarding FIG. 2 and FIG. It is explanatory drawing of the example of the image recording part which can be used in relation to the three-dimensional data recording transmission apparatus described regarding FIG. 2 and FIG. It is explanatory drawing of the example of the image recording part which can be used in relation to the three-dimensional data recording transmission apparatus described regarding FIG. 2 and FIG.

  The present invention is as described in the claims. The content and further advantages of the present invention can be better understood with reference to the following description taken in conjunction with the accompanying drawings.

  FIG. 1 shows an outline of a stereoscopic panorama image creation system 10 configured to record, create and display a stereoscopic panorama image according to the present invention. Referring to FIG. 1, a stereoscopic panorama image creation system 10 includes one or more stereoscopic data recording / transmitting devices 11A to 11N (generally identified by reference numeral 11n) and one or more display devices 12A to 12N (generally). Identified by reference numeral 11m). In general, each three-dimensional data recording / transmission device 11n records an image and creates at least one set of three-dimensional panoramic image sets including one set of panoramic images. Each three-dimensional data recording / transmitting device 11n also transmits each generated stereoscopic panoramic image set to one or a plurality of display devices 12m via the distribution channel 13 for display or lenticular print (microscopic print). 3D printing with a convex lens film) or other treatment apparent to those skilled in the art.

  An example of the three-dimensional data recording / transmitting device 11n will be described below with reference to FIGS. In general, the three-dimensional data recording / transmission device 11n includes an image recording unit, an image processing unit, and a communication unit. The image recording unit records one or a plurality of images used to create a stereoscopic panoramic image set. The image recording unit may be the same as that described in Pelegg Patent Application I or Pelegg Patent Application II. The image recording unit is the same as that described in Pelegg Patent Application I or the one described in Pelegg Patent Application II, and is used to create a panoramic image by rotating and / or moving the image recording unit. If at least this image recording unit is rotated around an axis including the center of rotation, moved along a path, or moved in a combination of rotation and movement, Record images. The image recording unit, when rotated and / or moved, records a series of images from which the image processing unit is configured as described in Pelegg Patent Application I or as described below with respect to FIG. Thus, at least one set of panoramic images including a stereoscopic panoramic image set is created. Generally, in creating a stereoscopic panoramic image set, the image recording unit records a series of images. In order to acquire each panoramic image included in the stereoscopic panoramic image set, the image processing unit creates the panoramic image by mosaicing together image strips obtained from a series of images. The strips obtained from each image may all be equidistant from the center of each image, as described in Pereg patent application I, or from the center of the image as described in Pereg patent application III. It may be separated at different distances. Alternatively, as described above, creation of the panoramic image can be performed as described below with respect to FIG.

  Alternatively, the image recording unit may be similar to that described in Pelegg Patent Application II. Some of the image recording units described in Pelegg Patent Application II record a series of images by rotating and / or moving each image processing unit and mosaicing the strips obtained from these images together. A set of panoramic images constituting a stereoscopic panoramic image set can be created. On the other hand, in some other image recording units described in Pelegg Patent Application II, each image recording unit may include an omni camera. When this type is used, a panoramic image can be directly recorded, and a stereoscopic panoramic image set can be obtained without performing mosaic processing.

  The communication unit can transmit the stereoscopic panoramic image set to the distribution channel 13 and distribute it to one or a plurality of display devices 12m. In general, the information defining the stereoscopic panoramic image set transmitted by the communication unit is in a digital format, and the communication unit may be anything that can transmit digital data between two devices. . The two devices may be placed at the same place or at different places. The communication unit includes, for example, a direct connection such as a wire, cable, or optical fiber connection, a wireless connection, another that enables information to be transmitted in a digital format, or a combination thereof. Examples of the direct connection include a direct network connection, and examples of the indirect connection include a network via a computer and a public telephone network via an exchange. Examples of the wireless connection include a wireless connection, a cellular (mobile phone) connection, and an infrared connection.

  An example of a display device is described below with respect to FIG. In general, a display device includes a communication unit, an image storage unit, and a display, a printer, or other device that creates an image viewed by a person. The communication unit of the display device can receive a stereoscopic panoramic image set sent from the distribution channel 13. In general, information defining a stereoscopic panoramic image set received by the communication unit is in a digital format. Examples of the communication unit include a direct connection such as a wire, a cable or an optical fiber connection, and a wireless connection such as a cellular telephone connection. Connection or other devices that can convey information in digital form.

  The image storage unit stores digital information including the stereoscopic panorama image set received from the distribution channel 13 by the communication unit of the display device, and displays the digital information later. Depending on the amount of information that can be stored in the image storage unit and the amount of information that includes the stereoscopic panoramic image set, the image storage unit is capable of storing information that includes only one set of stereoscopic panoramic image sets. Or the ability to store information including multiple sets of stereoscopic panoramic image sets.

  If provided, the display displays at least a portion of one or more sets of images including the stereoscopic panoramic image set. As will be appreciated, when the display displays at least a portion of an image, the image is not stereoscopic when viewed. On the other hand, if the display displays at least a portion of two images using, for example, a lenticular lens, the image becomes three-dimensional when viewed, as described below with respect to FIG. Yes. If a printer is provided, the printer can make a hard copy of one or more sets of images including a stereoscopic panoramic image set, so that the printer is lenticular as described below with respect to FIG. You can create a print. This lenticular print can obtain a three-dimensional image of the scene indicated by the three-dimensional panoramic image when a viewer views using a lenticular lens.

  As will be understood, each of the three-dimensional data recording / transmitting device 11n and the display device 12m includes a control unit, and each operator can perform these controls. For example, when the three-dimensional data recording / transmission device 11n includes an image recording unit that must rotate and / or move, a controller that enables the image recording unit to rotate and / or move can be provided. Further, the stereoscopic data recording / transmitting device 11n allows the operator to activate the image recording unit and record the scene image, cause the image processing unit to create a stereoscopic panoramic image set of the scene, and then to connect the communication unit. Then, it is possible to provide a controller that allows the stereoscopic panoramic image set to be transmitted to the distribution channel 13 and the stereoscopic panoramic image set to be transmitted to one or a plurality of display devices.

  Similarly, each display device 12m may include a controller that allows a stereoscopic panoramic image set to be received from distribution channel 13 and stored in an image storage device. Further, each display device 12m selects a stereoscopic panoramic image set to be displayed, selects a display mode, receives the stereoscopic panoramic image set from the distribution channel 13, and selects a part of the stereoscopic panoramic image set to be displayed. A controller can be provided that makes it possible. The display device 12m can selectively display at least a part of the individual panoramic image of the stereoscopic panoramic image set as well as at least a part of the stereoscopic panoramic image set as each display mode, and can be selected by selecting the display mode. One set or a plurality of sets of three-dimensional images of the set of three-dimensional panoramic image sets can be displayed. Furthermore, the display device 12m can be provided with a controller that allows each part of the stereoscopic panorama image set to be displayed to be selected, or individual images obtained from the stereoscopic panorama image set to be displayed on the display device 12m. A portion of the image provides such a display mode.

  As described above, the display device 12m may display the stereoscopic panoramic image set with the lenticular lens instead of, or in addition to, the stereoscopic display set. A printer or similar device may be provided that produces a hard copy print of at least a portion of one or both of the constituent images, or a hard copy print of at least a portion of the stereoscopic panoramic image set. Such a hard copy can be viewed as a three-dimensional panorama when viewed through a lenticular lens. A display device 12m comprising a printer or similar device can comprise a controller that allows the creation of such hard copy prints.

  Against this background, an example of the three-dimensional data recording / transmission device 11n will be described with reference to FIGS. FIG. 2 is an external plan view of the exemplified stereoscopic data recording / transmission apparatus 11n, and FIG. 3 is a functional block diagram of the exemplified stereoscopic data recording / transmission apparatus. In general, the exemplified stereoscopic data recording / transmitting device 11n is a portable device that can be held by a hand or placed on a car, for example, and can record a series of images for creating a stereoscopic panoramic image set. Portable device that can rotate and / or move like In addition, the device transmits information including the stereoscopic panoramic image set over the cellular telephone communication link. Referring to FIG. 2, the illustrated three-dimensional data recording / transmission device 11 n includes a housing 20 that accommodates and supports a video camera 21, an operator control panel 22, a display 23, and an antenna 24. The video camera 21 constitutes the above-described image recording unit, and the operator control panel 22 includes a plurality of controllers that can activate the video camera 21 to perform a predetermined operation. These controllers can be incorporated using a number of methods. For example, a push button system in which each controller can be activated when the operator presses it.

  The operator can turn the video camera 21 in a specific direction after activating each controller on the operator control panel 22 to activate the three-dimensional data recording and transmitting apparatus 11n. The display 23 can display an image recorded by the video camera 21. An operator can activate the video camera 21 by activating a controller on the operator control panel 22. When the operator starts the image recording controller and rotates / moves the three-dimensional data recording / transmitting device 11n, the operator can record a series of images that can be used to create a three-dimensional panoramic image set using the video camera 21. When the operator releases the button of the image recording controller after the stereoscopic data recording / transmitting device 11n has recorded a series of images, the video camera 21 can stop recording the images.

  After the stereoscopic data recording / transmitting device 11n has recorded a series of images, the operator activates another controller on the operator control panel 22 and uses the stereoscopic data recording / transmitting device 11n to perform a panorama including a stereoscopic panoramic image set. Images can be created. After at least one of the panoramic images is created, the operator activates another controller on the operator control panel 22 and causes the stereoscopic data recording / transmission device 11n to display at least a part of the created panoramic image on the display 23. Can be displayed. This selection of portions can be made using the same or other controls on the operator control panel 22. Similarly, after at least two panoramic images of the stereoscopic panoramic image set are created, the operator activates another controller on the operator control panel 22 to perform the stereoscopic data recording / transmitting device 11n, so that these at least two sheets are displayed. The panoramic image can be displayed so that it can be viewed three-dimensionally. When the stereoscopic data recording / transmitting device 11n displays the stereoscopic panoramic image set, any one of many types of instruments necessary for enabling stereoscopic viewing may be used. Such instruments include, for example, lenticular lenses, glasses with polarized lenses, or glasses with different color lenses, and other instruments will be apparent to those skilled in the art. The stereoscopic data recording / transmitting device 11n displays a stereoscopic panoramic image set by a method corresponding to these instruments.

  Furthermore, the stereoscopic data recording / transmitting device 11n can send the image to the distribution channel and distribute it to each device of the display device 12m after the panoramic image including the stereoscopic panoramic image set has been created. As described above, the exemplified three-dimensional data recording / transmitting device 11n transmits information to the distribution channel 13 using a cellular telephone connection. Accordingly, the operator activates one or more other controllers on the operator control panel 22, and makes the three-dimensional data recording / transmission device 11n to distribute a cellular telephone call via a cellular provider (not shown). Can be done. In this case, the three-dimensional data recording / transmitting device 11n can be transmitted from the antenna 24 and connected to the cellular link.

  FIG. 3 shows a functional block diagram of the three-dimensional data recording and transmitting apparatus 11n described above with reference to FIG. Referring to FIG. 3, the three-dimensional data recording / transmitting apparatus 11 n includes an image pickup unit 30, a local memory unit 31, a processing unit 32, one or a plurality of local displays 33 A, as well as the operator control panel 22. 33B,. . . And a communication unit 34. The imaging unit 30, local memory unit 31, and processing unit 32 together form the video camera 21 described above with respect to FIG. 2, and the local display devices 33A, 33B,. . . Forms the display 23 described above with respect to FIG. The imaging unit 30 includes, for example, an image sensor, an aperture, a lens, and / or an equivalent thereof, and can capture or acquire each image. As the image sensor, any one of many conventional image sensors, for example, a CCD (Charge Coupled Device) or a film may be used.

  In general, after the operator activates each of the controllers on the operator control panel 22 to activate the three-dimensional data recording / transmission apparatus 11n, the processing unit 32 controls the imaging unit 30, in particular the image sensor, to receive an image. This is transmitted to a local display, for example, the local display 33A, and displayed to the operator. When the operator activates the image recording controller on the operator control panel 22, the processing unit 32 sends the image taken by the image sensor to the local display 33A, and sends the image to the local memory unit 31. Remember. Further, when the operator activates the stereoscopic panoramic image set creation controller on the operator control panel 22, the processing unit 32 creates a panoramic image including the stereoscopic panoramic image set, which is displayed on the local displays 33A, 33B,. . . Can be displayed.

  Further, when the operator activates the stereoscopic panorama image set transmission controller on the operator control panel 22, the processing unit 32 may transmit a panoramic image including the stereoscopic panorama image set to the distribution channel 13 via the communication unit 34. it can. In that operation, as described above, since the stereoscopic data recording / transmitting device 11n can transmit the stereoscopic panoramic image set to the distribution channel 13 using the cellular telephone link, the processing unit 32 makes a cellular telephone to the distribution channel 13. After the call starts and the distribution channel 13 responds, the stereoscopic panorama image set can be transmitted to the distribution channel 13 in cooperation with the distribution channel 13. The processing unit 32 can use a default telephone number when starting to call a cellular telephone or can use a telephone number provided by the operator via the operator control panel 22. Accordingly, the operator control panel 22 can include a numeric input keyboard that is used by the operator to provide a telephone number. It will be appreciated that the processing unit 32 may encode the information using a plurality of encoding or compression algorithms before transmitting the information including the stereoscopic panoramic image set. As such an algorithm, for example, there is a well-known JPEG or GIF algorithm, and when these are used, the time required for information transmission can be reduced.

  As described above, the display device selectively receives panoramic images including each of the stereoscopic panorama image sets created by the stereoscopic data recording / transmission device 11n and displays the panoramic images to the operator. FIG. 4 shows a functional block diagram of an example of a display device 12m constructed according to the present invention. Referring to FIG. 4, the illustrated display device 12 m includes a receiver 40, a decoder 41, a display unit 42, and a direction control unit 43. The receiver 40 is provided for receiving information defining a panoramic image including a stereoscopic panoramic image set transmitted from the distribution channel 13. The receiver 40 provides decoding information to the decoder 41. After the decoder 41 decodes the digital information, the decoder 41 can provide it to the display unit 42 for display to the operator. The display unit 42 may include a display itself that displays an image to a viewer, and at the same time, a memory sufficient to store a panoramic image including one or more sets of stereoscopic panoramic image sets. When the display unit 42 includes a memory sufficient to store a panoramic image including a plurality of sets of stereoscopic panoramic image sets, the display device 12m can control the stereoscopic panoramic image set for display by the operator. Can also be provided. When the display unit 42 cannot display the entire stereoscopic panorama image set at a time, the viewer can select a part of the stereoscopic panorama set to be displayed by using the direction control unit 43.

  The display unit 42 preferably displays the stereoscopic panoramic image set stereoscopically. In that case, the display unit 40 can display each image of the stereoscopic panoramic image set on separate left and right displays. In this case, the images displayed separately on the left and right can be viewed with the corresponding eyes of the viewer. By providing the binocular device, it is possible to display each image corresponding to each one eye of a person to be viewed, or a part thereof, in each one-eye portion. Alternatively, when the display unit 42 displays a panoramic image, the image looks three-dimensional when many types of instruments are used so as to enable stereoscopic viewing. Such instruments include, for example, lenticular lenses, glasses with polarized lenses, or glasses with different color lenses, and other instruments will be apparent to those skilled in the art.

As described above, as described with respect to the Pelegg patent applications I and II, two sets of panoramic images including a stereoscopic panoramic image set are obtained from image series cut out from each of a series of images recorded by the stereoscopic data recording / transmitting device 11n. It can be created using two pieces. Alternatively, a stereoscopic panoramic image set including a plurality of panoramic images can be created. In this case, when the panoramic images are viewed as one set, a stereoscopic image is obtained. This is described with respect to FIG. Referring to FIG. 5, FIG. 5 shows a series of permutations, images 50 (1), 50 (2),. . . , 50 (3) (generally identified by reference numeral 50 (i)), these images are transmitted by the three-dimensional data recording / transmission device 11n as the three-dimensional data recording / transmission device 11n is moved and / or rotated. It will be recorded. A plurality of panoramic images 51a, 51b,. . . Are each strip a ₁ , a ₂ ,. . . a ₃ , b ₁ , b ₂ ,. . . b ₃ ,. . . Created using The strips a ₁ , a ₂ ,. . . a ₃ are all horizontally separated from the center of each image 50 (i) by the same distance, and the strips b ₁ , b ₂ ,. . . b ₃ are all vertically separated from the center of each image 50 (i) by the same distance, and so on. As will be understood, when the images 51 (i) are viewed in pairs, a three-dimensional sense of depth is obtained. This is because these images are from substantially different viewing directions.

  Further, as described above, the displays 23, 33A and 33B (stereoscopic data recording / transmission device 11n) and the display 42 (display device 12m) can display panoramic images including a stereoscopic panoramic image set using a lenticular lens. The panoramic image can be seen as a stereoscopic image. This is described in connection with FIG. Referring to FIG. 6, the lenticular lens 61 includes a flat back surface and a curved front surface. The panoramic image obtained from the stereoscopic panoramic image set is projected in the form of a segment onto the flat back surface of the lenticular lens, and the viewer views the stereoscopic image by looking toward the front surface. In the lenticular lens 61 illustrated in FIG. 6, three lens segments 61 (1) to 61 (3) (generally identified by a reference numeral 61 (s)) are illustrated. A curved front surface is provided. Each lens segment 61 (s) has a reference numeral 62 (s) (A), 62 (s) (B), 62 (s) (C) (generally identified by reference numerals 62 (s) (p)). Each segment of each panoramic image identified by is printed. Here, the index “p” indicates each panoramic image. As shown in FIG. 6, when viewed through a lenticular lens from a certain direction, the viewer sees three images 63 (A), 63 (B), 63 (C) (generally the reference numeral 63). One of (identified in (p)) can be selectively viewed. Thus, for example, when a viewer views the lenticular lens 61 from the right side (from the bottom when shown in FIG. 6), an image including the segments 62 (s) and (C) can be viewed. On the other hand, when the viewer views the lenticular lens 61 from the left side (from the top when shown in FIG. 6), an image including the segment 62 (s) (A) can be viewed. Finally, when the viewer views the optical lens 61 directly from the front, an image including the segments 62 (s) and (B) can be viewed. If, for example, a viewer views the lenticular lens 61, the left eye looks at the lens from the right side and the right eye looks at the lens from the left side, and the segment 62 (s) (A) is used. If the panorama image to be displayed is the left panorama image of the stereoscopic panorama image set, and the panorama image used for the segments 62 (s) and (C) is the right panorama image of the same stereoscopic panorama image set, The image is viewed stereoscopically.

  As described above, the image recording unit includes the video camera 21 of the exemplified three-dimensional data recording / transmission device 11n, but may be the same as that described in Pelegg Patent Application I or II. As described in these patent applications, when rotating the camera recording an image to be used to create a panoramic image including a stereoscopic panoramic image set, the rotation center of the camera is the projection center of the camera. It is preferable that each panorama image necessary for the stereoscopic panorama image set can be created by following the above, and the strips obtained from each image come from different line-of-sight directions. However, it is understood that the image recording unit used in the three-dimensional data recording / transmitting device 11n may use any of many other formats. Some of these formats are shown schematically in FIGS. These figures can show that the effective projection center is in front of the camera. In those cases, since the effective projection center is in front of the camera, the rotation center of the camera can intersect the camera. 7 to 9 show the image recording units 100, 110, and 120 using a fixed mirror, a rotating mirror, or a mirror segment, and FIGS. 10 to 12 use a fixed prism, a rotating prism, or a prism segment, respectively. FIG. 13 shows an image recording unit 160 using a lens, and FIG. 14 shows an image recording unit 170 using a linear arrangement of a plurality of cameras. Each image recording unit 100, 110, 120, 130, 140, 150, 160 includes one camera 101, 111, 121, 131, 141, 151, 161. Each one of these cameras may be either a still camera or a video camera. The image recording unit 170 uses a plurality of cameras, but these cameras may be either a still camera or a video camera.

  Reference is now made to FIG. FIG. 1 schematically shows an image recording unit 100 including a camera 101 and a mirror 102. The mirror 102 is arranged at a fixed angle with respect to the camera axis 103. This selection of the angle is performed so that the light rays 104A to 104C can be reflected toward the image sensor 105 of the camera in a range between 0 ° and 90 °. As shown in FIG. 7, light rays 104A, 104B, and 104C (generally identified by reference numeral 104) guided from a scene (not shown) in the direction of the image recording unit are reflected by the mirror 102, and each of the regions 106A. , 106B, 106C, so that an image of the scene can be recorded. As shown in FIG. 7, the light beams 104A, 104B, and 104C each indicate the viewing direction. By using the image strip including each of the above regions, each image for the stereoscopic panorama image set can be created as described above. As shown in FIG. 7, the mirror 102 moves the apparent projection center of the light beam 104 from the point O of the optical system 107 of the camera 101 to a point O ′ long before the camera 101 and behind the mirror 102. Play a role. By doing so, the camera 101 can be rotated around the rotation center that passes through the camera 101 and that also passes through the projection center O of the camera.

  Please refer to FIG. The figure schematically shows an image recording unit 110 including a camera 111 and a mirror 112. The mirror 112 is arranged so as to form a plurality of arrangement angles with respect to the camera axis 113. These angles are selected in a range between 0 ° and 90 ° so that the light beams 114A and 114B can be reflected toward the center of the imaging sensor 115 of the camera. As shown in FIG. 8, light beams 114A and 114B (generally identified by reference numeral 114) guided from a scene (not shown) in the direction of the image recording unit are reflected by a mirror 112, and toward the center of the image sensor 115. To the same area. Images 116A, 116B,. . . Is recorded at a position corresponding to each arrangement angle. As shown in FIG. 8, the light beams 114A and 114B indicate respective viewing directions. The camera 111 can record each image corresponding to each arrangement angle where the mirror 112 is arranged, and can record each image of the scene. By using the image strip including each of the above regions, each image for the stereoscopic panorama image set can be created as described above. As shown in FIG. 8, the mirror 112 serves to move the apparent projection center of the light beam 114 from the O point of the optical system 117 of the camera 111 to the O ′ point that coincides with the rotation center of the mirror 112. As in the case of the camera 101, this makes it possible to rotate the camera 111 around the rotation center that passes through the camera 111 and that can also pass through the projection center O of the camera. Become.

  Please refer to FIG. The figure schematically shows an image recording unit 120 including a camera 121 and mirror segments 122A and 122B. The mirror segments 122A and 122B are arranged to face each other with respect to the camera axis 123, and are arranged at fixed angles that are complementary to each other with respect to the camera axis. The selection of this angle is performed so that the light rays 124A and 124B can be reflected toward the image sensor 125 of the camera in the range between 0 ° and 90 °. As shown in FIG. 9, rays 124A and 124B (generally identified by reference numeral 124) guided from a scene (not shown) in the direction of the image recording unit are reflected by mirror segments 122A and 122B, and regions 126A and 126B are reflected. The scene image can be recorded. If there is a gap between the mirror segments 122A and 122B, as is the case with the instrument arrangement 120, the ray 124B passing through the gap is directed to the region 126B between the regions 126A and 126C. As shown in FIG. 9, the light rays 124A, 124B, and 124C indicate respective visual field directions. By using the image strip including each of the above regions, each image for the stereoscopic panorama image set can be created as described above. As shown in FIG. 9, the mirrors 122A and 122B are linked so that the apparent projection center of the light ray 124 is from the point O of the optical system 127 of the camera 121 in front of the camera 121 and between the mirrors 122A and 122B. It plays the role of moving to the O 'point in between. By doing so, the camera 121 can be rotated around the rotation center that passes through the camera 121 and that can also pass through the projection center O of the camera.

  FIGS. 10 and 12 schematically illustrate an image recording device 130, 150 similar to each image recording device 100, 120 described above with respect to FIGS. However, the difference is that instead of using a mirror, each of the image recording units 130 and 150 includes a prism 132 (in the case of FIG. 10) or a prism segment 152 (in the case of FIG. 12). The prism 132 and the prism segments 152A and 152C are arranged at a fixed angle with respect to the camera axes 134 and 154. As in the case of the image recording unit 100, the image recording unit 130 refracts the light beams 134A, 134B, and 134C (generally identified by the reference numeral 134) guided from the scene (not shown) toward the image recording device by the prism 132. Each of the images for the stereoscopic panorama image set is created as described above by using the image strips including the above-described areas so that the scene images can be recorded by guiding them to the areas 136A, 136B, and 136C, respectively. can do. Similarly, as in the case of the image recording unit 120, the image recording unit 150 prisms light rays 154A, 154B, and 154C (generally identified by reference numeral 154) that are guided from a scene (not shown) toward the image recording unit. The light is refracted by the segments 152A and 152C and led to areas 156A and 156C, respectively, so that an image of the scene can be recorded. If so with arrangement 150, if there is a gap between prism segments 152A and 152C, ray 154B passing through the gap is directed to region 156B between regions 156A and 156C. As shown in FIGS. 10 and 12, the light beams 134A, 134B, and 134C (FIG. 10) and the light beams 154A, 154B, and 154C (FIG. 12) indicate respective visual field directions. The prism 132 and the prism segment 152 serve to move the apparent projection center of the light beams 134 and 154 from the point O of the optical systems 137 and 157 of the cameras 131 and 151 to the point O ′ that matches the projection center of each camera. . As in the case of the cameras 101 and 121, by doing this, the cameras 131 and 151 are placed around the rotation center that passes through the cameras 131 and 151 and that can also pass through the projection center O of the camera. It becomes possible to rotate.

  FIG. 11 schematically illustrates an image recording unit 140 similar to each image recording unit 110 described above with respect to FIG. However, the difference is that the image recording unit 140 includes a prism 142 instead of using a mirror. The prisms 142 are arranged at a plurality of angles with respect to the camera axis 144. As in the case of the image recording unit 110, in the image recording unit 140, light beams 144A, 144B,... Guided from a scene (not shown) toward the image recording unit. . . (Generally identified by reference numeral 144) is refracted by the prism 142 and led to a region in the center direction of the image sensor 145. The camera 141 records each image with respect to the position of the angle at which the prism 142 is arranged so that each image of the scene can be recorded. As shown in FIG. 11, the rays 144A, 144B,. . . Indicates each viewing direction. The prism 142 serves to move the apparent projection center of the light ray 144 from the O point of the optical system 147 of the camera 141 to the O ′ point that matches the projection center of each camera. As in the case of the camera 111, this makes it possible to rotate the camera 141 around the rotation center that passes through the camera 141 and that can also pass through the projection center O of the camera. Become.

  FIG. 13 schematically illustrates an image recording unit 160 similar to each image recording unit 120 and 150 described above with respect to FIGS. However, the difference is that the image recording unit 160 includes a lens 162 instead of using a mirror segment or a prism segment. As in the case of the image recording unit 100, the image recording unit 160 refracts light rays 164A, 164B, and 164C (generally identified by reference numeral 164) guided by a lens 162 from a scene (not shown) in the direction of the image recording unit. Each of the images for the stereoscopic panorama image set is created as described above by using the image strips including the respective regions so that the images of the scene can be recorded by guiding them to the regions 166A, 166B and 166C, respectively. Can do. As shown in FIG. 13, the light beams 164A, 164B, and 164C indicate respective visual field directions. The lens 162 serves to move the apparent projection center of the light ray 164 from the O point of the optical system 167 of the camera 161 to the O ′ point that coincides with the rotation center of the camera 161. As in the case of the cameras 121 and 151, this allows the camera 161 to rotate around the rotation center that passes through the camera 161 and that can also pass through the projection center O of the camera. It becomes possible.

It will be appreciated that each of the image recording units described above with respect to FIGS. 7-13 has different portions of the image as the image recording unit records an image of the scene using a single camera. Create different panoramic images for stereoscopic panoramic image sets so that they are from different viewing directions, and view the stereoscopic images when viewing the stereoscopic panoramic image set at the same time. . FIG. 14 shows a plurality of cameras 171A,. . . , 171K (generally identified by the reference numeral 171k) linearly attached to the platform 172. It will be understood that when the device 170 is pointed in a specific direction so that each image can be recorded by the camera 170k, the image recorded by the camera 171k is the “K” recorded by each camera. The “th” strips of each image have different viewing directions. When the device 170 is rotated around a rotation center or moved along a certain distance, the camera 171k can record a series of images as described above. When creating each panorama image for the stereoscopic panorama image set, each camera 171k ′, 171k ″,. . . Each strip of the series of images recorded at each can be mosaiced together to form each panoramic image. That is, for example, for camera 171k ′, “S” strips S ₁ ¹ , S ₁ ² ,. . . S ₁ ^S , S ₂ ¹ ,. . . S _I ^S (generally identified by the reference numeral S _i ^s ) is obtained and the images i = 1, 2, 3,. . . The “S-th” strips S ₁ ^S , S ₂ ^S , S ₃ ^S obtained from can be mosaiced together to form each panoramic image that can be used in a stereoscopic panoramic image set. Thus, it should be understood that the apparatus 170 can be used to create a stereoscopic panoramic image set including “S” × “K” panoramic images, which can be viewed, printed, etc. Can be used.

  There are many advantages to using the present invention. In particular, the present invention relates to a stereoscopic data recording / transmitting apparatus used to record a scene image to create a stereoscopic image, and to display a stereoscopic image set or create a print so that the scene can be viewed stereoscopically. And a display device.

  As will be appreciated, numerous modifications can be made to the devices described herein. For example, while the device of the present invention has been described as creating, displaying, and printing panoramic images, the device instead creates, displays, and prints ordinary “non-panoramic” images, etc. It will be understood that

  Furthermore, although the stereoscopic data recording / transmitting device has been described as creating a stereoscopic image set, the stereoscopic data recording / transmitting device can also record a series of images that are materials that can create a stereoscopic panoramic image set. Will be understood. After recording a series of images, the stereoscopic data recording / transmitting device can send these images to the distribution channel 13 and distribute them to one or more display devices. The distribution channel 13 or the display device itself can create an image that includes a stereoscopic panoramic image set. In that case, it will be appreciated that the distribution channel and / or one or more display devices comprise components for creating a stereoscopic panoramic image set. Such a function has already been described above as constituting a part of the stereoscopic data recording and transmitting apparatus.

  Furthermore, although a specific mechanism has been described that allows viewing images of at least a portion of a stereoscopic image set at approximately the same time, it will be understood that other mechanisms can be used instead or in combination. . For example, but not limited to, glasses with differently colored lenses and glasses with oppositely polarized lenses that display at least two images of a stereoscopic image set fast enough to provide a sense of depth Or other mechanisms understood by those skilled in the art can be used.

  Moreover, although the camera described above with respect to FIGS. 7-14 has been described as comprising a conventional still camera or video camera, it comprises a camera in which image recording elements are provided only on portions of each image plane. It will be understood that things may be used. Strips are obtained from this image plane and are used to create each image of the stereoscopic image set.

  Further, although the present invention has been described as each image segment from a stereoscopic panoramic image set is shown as viewed through a lenticular lens, it is instead shown as printed through a lenticular lens or lenticular lens. It will be appreciated by those skilled in the art that it is printed directly on the backside of the device or in other arrangements apparent to those skilled in the art. For example, when an image is printed on the back of a lenticular lens, it is understood that the lenticular forward curve may be formed before, during, or after image printing. Like.

  Moreover, in the above description relating to FIG. 5, the strips of each panoramic image of the stereoscopic panoramic image set are shown to be from images with the same horizontal distance in the sequentially arranged images. It will be appreciated that the horizontal distances may be different as described in application III. This may be useful in connection with adjusting asymmetric parity when it is desired to incorporate a three-dimensional depth.

  As will be appreciated, the system according to the present invention can be configured in whole or in part as special purpose hardware or a general purpose computer system, or a combination thereof, any of which can be controlled by a suitable program. Any program can form part of the system as a whole or part or be stored in the system in a conventional manner, or communicate information on the network or in a conventional manner as a whole or part The system can be fed over other mechanisms. It will further be appreciated that the system can be operated and / or controlled by information provided by an operator using an operator input device (not shown). The operator input device can be connected directly to the system or can supply information to the system over a network or other mechanism that conveys information in a conventional manner.

  The above description is limited to a specific embodiment of the present invention. It will be apparent, however, that a wide variety of variations and modifications can be made to the present invention while obtaining the advantages of the present invention in part or in whole. The purpose of the claims of the present invention is to cover these and other such variations and modifications as included within the true spirit and scope of the present invention.

  What claims to be new and would like to obtain a patent is set forth in the appended claims. The contents described below are also preferable aspects of the present invention.

  (Aspect 1) A stereoscopic image handling system including at least one stereoscopic data recording / transmission device, at least one utilization device, and a distribution channel interconnecting both, wherein the at least one stereoscopic data recording / transmission device is The stereoscopic image set can be recorded, the utilization device can be configured to use the stereoscopic image set, and the distribution channel is configured to connect the stereoscopic data recording / transmission device and the utilization device. The information includes the image recorded by the stereoscopic data recording / transmitting device or the stereoscopic image set, and the at least one stereoscopic data recording / transmitting device, distribution channel, or One of the utilization devices is configured to create the stereoscopic image set from images recorded by the stereoscopic data recording / transmitting device. Three-dimensional image handling system it is.

  (Aspect 2) The stereoscopic image handling system according to Aspect 1, wherein the stereoscopic image set is a stereoscopic panoramic image set, and the stereoscopic image set is created from an image recorded by the stereoscopic data recording / transmitting apparatus. One of the at least one stereoscopic data recording / transmission device, distribution channel, or utilization device is configured to create the stereoscopic image set as a stereoscopic panoramic image set. system.

  (Aspect 3) In the stereoscopic image handling system according to Aspect 1, the utilization device is configured to display the stereoscopic data set so that a user can feel a stereoscopic depth when viewed by a user. Stereoscopic image handling system.

  (Aspect 4) In the stereoscopic image handling system according to Aspect 3, the stereoscopic image set is composed of two images, and when the utilization apparatus displays each one of the images in each color, the corresponding color A stereoscopic image handling system characterized in that a stereoscopic depth can be felt by the displayed stereoscopic data set when viewed simultaneously through attached glasses.

  (Aspect 5) In the stereoscopic image handling system according to Aspect 3, the stereoscopic image set includes two images, and the utilization device displays each one of the images with each polarization, and corresponding polarized glasses. The stereoscopic image handling system is configured such that a depth with a stereoscopic effect can be felt by the displayed stereoscopic data set when viewed simultaneously.

  (Aspect 6) In the stereoscopic image handling system according to Aspect 1, the utilization device is configured to print the stereoscopic data set so that the user can feel a stereoscopic depth when viewed by the user. Stereoscopic image handling system.

  (Aspect 7) In the stereoscopic image handling system according to Aspect 6, the stereoscopic image set includes two images, and when the utilization device prints the image and views it through a lenticular lens, the printed image is viewed. A stereoscopic image handling system, characterized in that a stereoscopic depth is felt by a stereoscopic data set.

  (Aspect 8) In the stereoscopic image handling system according to Aspect 1, the stereoscopic data recording and transmitting apparatus includes: A camera comprising an image sensor and an optical system configured to selectively allow light to reach the image sensor; An optical device configured to guide light rays from a scene to the optical system so that the image sensor detects the light rays from different viewing directions of the scene. Stereoscopic image handling system characterized by

  (Aspect 9) The stereoscopic image handling system according to Aspect 8, wherein the optical system includes a lens and a shutter.

  (Aspect 10) The stereoscopic image handling system according to Aspect 8, wherein the optical device is a mirror.

  (Aspect 11) In the stereoscopic image handling system according to Aspect 10, the optical device is a mirror disposed at a fixed angle with respect to the image sensor, and light beams guided to different parts of the image sensor are: A stereoscopic image handling system characterized by being from different viewing directions of a scene.

  (Aspect 12) In the three-dimensional image handling system according to Aspect 10, the optical device is a mirror that can be selectively arranged at a plurality of arrangement angles with respect to the image sensor. A three-dimensional image handling system characterized in that the light beam guided to the part is from each viewing direction of the scene.

  (Aspect 13) The stereoscopic image handling system according to Aspect 8, wherein the optical device is a prism.

  (Aspect 14) In the stereoscopic image handling system according to Aspect 13, the optical device is a prism arranged at a fixed angle with respect to the image sensor, and light beams guided to different parts of the image sensor are: A stereoscopic image handling system characterized by being from different viewing directions of a scene.

  (Aspect 15) In the three-dimensional image handling system according to Aspect 13, the optical device is a prism that can be selectively arranged at a plurality of angles with respect to the image sensor, and the prism of each arrangement angle is arranged on the same part of the image sensor. A stereoscopic image handling system, characterized in that the guided light rays are from each viewing direction of the scene.

  (Aspect 16) In the stereoscopic image handling system according to Aspect 8, the optical device is a lens arranged at an angle with respect to the image sensor, and light beams guided to different parts of the image sensor are in a phase of a scene. A stereoscopic image handling system characterized by being from different viewing directions.

  (Aspect 17) When the image recording device is A. A camera comprising an image sensor and an optical system configured to selectively allow light to reach the image sensor; An optical device configured such that when the light from the scene is guided to the optical system and detected by the image sensor, the light guided to the image sensor is from a different viewing direction of the scene. An image recording device.

  (Aspect 18) The image recording device according to Aspect 17, wherein the optical system includes a lens and a shutter.

  (Aspect 19) The image recording device according to Aspect 17, wherein the optical device is a mirror.

  (Aspect 20) In the image recording device according to Aspect 19, the optical device is a mirror disposed at a fixed angle with respect to the image sensor, and light beams guided to different parts of the image sensor are An image recording device characterized by being from different viewing directions.

  (Aspect 21) In the image recording device according to Aspect 19, the optical device is a mirror that can be selectively arranged at a plurality of angles with respect to the image sensor, and the mirror at each arrangement angle is placed on the same part of the image sensor. An image recording device, characterized in that the guided light rays are from each viewing direction of the scene.

  (Aspect 22) The image recording device according to Aspect 17, wherein the optical device is a prism.

  (Aspect 23) The image recording device according to Aspect 22, wherein the optical device is a prism arranged at a fixed angle with respect to the image sensor, and light beams guided to different parts of the image sensor are An image recording device characterized by being from different viewing directions.

  (Aspect 24) In the image recording device according to Aspect 22, the optical apparatus is a prism that can be selectively arranged at a plurality of angles with respect to the image sensor, and the prisms at the respective arrangement angles are arranged on the same part of the image sensor. An image recording device, characterized in that the guided light rays are from each viewing direction of the scene.

  (Aspect 25) In the image recording device according to Aspect 17, the optical device is a lens disposed at an angle with respect to the image sensor, and light beams guided to different parts of the image sensor are different in a scene. An image recording device characterized by being from a viewing direction.

  (Aspect 26) A stereoscopic panorama image handling system comprising at least one stereoscopic data recording / transmission device, at least one stereoscopic panoramic image set utilization device, and a distribution channel for interconnecting both, The data recording and transmitting apparatus is configured to record an image capable of creating a stereoscopic image set, the stereoscopic panoramic image set using apparatus is configured to be able to use the stereoscopic image set, and the distribution channel is It is configured to selectively receive an image from a stereoscopic data recording / transmitting device, create a stereoscopic panoramic image set, and transmit the stereoscopic panoramic image set to the at least one stereoscopic panoramic image utilization device. 3D panorama image handling system.

  (Aspect 27) In the stereoscopic panorama image handling system according to Aspect 26, the at least one stereoscopic panorama image set utilization device uses the stereoscopic panoramic image set so that a depth with a stereoscopic effect can be felt when viewed by a user. A stereoscopic panorama image handling system characterized by being configured to display.

  (Aspect 28) In the stereoscopic image handling system according to Aspect 26, the stereoscopic panorama image utilization apparatus is configured to display the stereoscopic panorama image set so that a stereoscopic depth is felt when viewed by a user. 3D panoramic image handling system.

  (Aspect 29) In the stereoscopic panorama image handling system according to Aspect 28, the stereoscopic panorama image set is composed of two images, and the stereoscopic panorama image set using apparatus uses each one of the images in each color. A stereoscopic panorama image handling system configured to display a stereoscopic depth by the displayed stereoscopic panoramic image set when displayed and viewed simultaneously through corresponding colored glasses.

  (Aspect 30) In the stereoscopic panorama image handling system according to Aspect 28, the stereoscopic panorama image set includes two images, and the stereoscopic panorama image set utilization apparatus displays each one of the images with each polarization. A stereoscopic panorama image handling system is characterized in that a stereoscopic depth is felt by the displayed stereoscopic panoramic image set when viewed simultaneously through corresponding polarized glasses.

  (Aspect 31) In the stereoscopic panorama image handling system according to Aspect 26, the stereoscopic panorama image set utilization apparatus prints the stereoscopic panoramic image set so that a stereoscopic depth can be felt when viewed by the user. 3D panoramic image handling system.

  (Aspect 32) In the stereoscopic panorama image handling system according to Aspect 31, the stereoscopic panoramic image set includes two images, and the stereoscopic panoramic image set using apparatus prints the image and views it through a lenticular lens. And a stereoscopic panorama image handling system, wherein the stereoscopic panoramic image set printed and viewed allows the user to feel a stereoscopic depth.

  10 stereoscopic panoramic image creation system, 11 stereoscopic data recording / transmission device, 12 display device, 50 images, 51 panoramic image.

Claims (46)

An image forming apparatus,
At least one image forming unit that records each of a plurality of continuous optical images of a portion of the scene at each of a plurality of viewpoints, each image forming unit moving relative to the scene;
At least two panoramic images corresponding to different gaze directions by receiving the continuous images, selecting a plurality of strips from each image, and performing mosaic processing on the plurality of strips obtained from the continuous images A mosaic image generating unit that processes the continuous images so as to generate a stereoscopic panoramic image set including a plurality of mosaic images that are displayed to give a sense of depth to the scene,
Having
An image forming apparatus. The image forming apparatus according to claim 1.
A continuous strip of each image is used for successive mosaic images.
An image forming apparatus. The image forming apparatus according to claim 1, wherein
In the order in which multiple strips appear in each optical image, the first strip of the image is used for the first mosaic image, the subsequent second strip is used for the subsequent second mosaic image, and so on for the subsequent mosaic image, A continuous strip of each optical image is used for multiple consecutive mosaic images;
An image forming apparatus. The image forming apparatus according to any one of claims 1 to 3,
The sequential optical images include at least three consecutive multiple images;
An image forming apparatus. The image forming apparatus according to any one of claims 1 to 4,
The plurality of mosaic images includes at least three mosaic images;
An image forming apparatus. The image forming apparatus according to claim 1, further comprising:
A display for displaying the plurality of mosaic images so as to give a sense of depth to the scene;
An image forming apparatus comprising: The image forming apparatus according to claim 6.
The display is a lenticular print;
An image forming apparatus. The image forming apparatus according to claim 6 or 7,
The display displays the mosaic image so that both eyes of the viewer see different mosaic images;
An image forming apparatus. The image forming apparatus according to claim 6.
The display changes the display of a plurality of mosaic images so as to give a sense of depth to the scene.
An image forming apparatus. The image forming apparatus according to any one of claims 1 to 9,
Each mosaic image gives a different viewing direction of the scene,
An image forming apparatus. The image forming apparatus according to claim 1, further comprising:
A communication device that transmits image data from the image forming apparatus;
An image forming apparatus. The image forming apparatus according to claim 11.
The communication device is stored in a single housing that houses at least one image forming unit, an image generating unit, and a display.
An image forming apparatus. The image forming apparatus according to any one of claims 1 to 10,
A single housing contains at least one image forming unit, image generating unit and display;
An image forming apparatus. 14. The image forming apparatus according to claim 11, wherein:
The communication channel includes a mobile phone communication channel,
An image forming apparatus. An image forming apparatus,
At least one image forming unit that records each of a plurality of continuous optical images of a portion of the scene at each of a plurality of viewpoints, each image forming unit moving relative to the scene;
Receiving the continuous images, selecting a plurality of strips from each image, and mosaicing the continuous plurality of strips to generate a stereoscopic panoramic image set including a plurality of mosaic images; A mosaic image generator for processing continuous images;
With
A continuous strip of each image is used for successive mosaic images,
The plurality of mosaic images includes at least two panoramic images corresponding to different line-of-sight directions, and is displayed so as to give a sense of depth to the scene.
An image forming apparatus. The image forming apparatus according to claim 15.
A plurality of strips used for each mosaic image is acquired from a position that is horizontally shifted by substantially the same distance from the center of the continuous plurality of optical images.
An image forming apparatus. The image forming apparatus according to claim 15 or 16,
In the order in which multiple strips appear in each optical image, the first strip of the image is used for the first mosaic image, the subsequent second strip is used for the subsequent second mosaic image, and so on for the subsequent mosaic image, A continuous strip of each optical image is used for multiple consecutive mosaic images;
An image forming apparatus. The image forming apparatus according to any one of claims 15 to 17,
The sequential optical images include at least three consecutive multiple images;
An image forming apparatus. The image forming apparatus according to any one of claims 15 to 18,
The plurality of mosaic images includes at least three mosaic images;
An image forming apparatus. The image forming apparatus according to claim 19.
Single housing, for accommodating at least one image forming unit, an image generation unit及beauty de Isupurei,
An image forming apparatus. The image forming apparatus according to claim 20, wherein
The single housing also houses communication equipment;
An image forming apparatus. The image forming apparatus according to any one of claims 15 to 21, further comprising:
A communication device for transmitting image data from the image forming apparatus;
An image forming apparatus comprising: The image forming apparatus according to claim 22, wherein
The communication device uses a mobile phone communication channel for transmission;
An image forming apparatus. The image forming apparatus according to claim 20 , wherein
The display is a lenticular print;
An image forming apparatus. The image forming apparatus according to claim 20 , wherein
The display displays the mosaic image such that each eye of the viewer sees a separate mosaic image;
An image forming apparatus. The image forming apparatus according to claim 20 , wherein
The display changes the display of a plurality of mosaic images so as to give a sense of depth to the scene.
An image forming apparatus. The image forming apparatus according to any one of claims 15 to 25, wherein:
Each mosaic image gives a different viewing direction of the scene,
An image forming apparatus. A method of processing image data representing a portion of a scene acquired by at least one image forming unit moving relative to the scene so as to acquire a plurality of continuous optical images of the scene, At least two of the plurality of optical images are images viewed from different viewpoints, and the method includes:
Selecting multiple strips from each image;
Generating a stereoscopic panoramic image set including at least two mosaic images to give a depth feeling to the scene by performing mosaic processing on a plurality of strips obtained from the plurality of continuous optical images;
Including
The at least two mosaic images include at least two panoramic images corresponding to different gaze directions, are displayed to give a depth to the scene, and give the viewer a sense of depth of the scene;
A method characterized by that. The method of claim 28, wherein
Two consecutive strips of each image are used for two consecutive mosaic images.
A method characterized by that. The method of claim 28, wherein
Successive strips of each optical image are used for successive mosaic images in the order in which they appear in the optical image;
A method characterized by that. A method according to any one of claims 28 to 30, wherein
Generating the at least two mosaic images includes generating at least three mosaic images;
A method characterized by that. The method of claim 28, wherein
The displaying step includes displaying both eyes so as to see different mosaic images.
A method characterized by that. The method of claim 32, wherein
The displaying includes printing the plurality of mosaic images using lenticular printing;
A method characterized by that. 34. The method of claim 33, wherein
The lenticular lens has a flat back surface and a curved front surface, and the plurality of mosaic images are projected in the form of segments on the flat back surface, and a viewer sees toward the front surface. To view stereoscopic images,
A method characterized by that. A method according to any one of claims 32 to 34,
The displaying step changes the display of a plurality of mosaic images so as to give a sense of depth to the scene.
A method characterized by that. 36. A method according to any one of claims 28 to 35, further comprising:
Transmitting the image data over a communication channel. The method of claim 36, wherein
The communication channel is a mobile phone communication channel;
A method characterized by that. A method of processing image data representing a portion of a scene acquired by at least one image forming unit moving relative to the scene so as to acquire a plurality of continuous optical images of the scene, At least two of the plurality of optical images are images viewed from different viewpoints, and the method includes:
Selecting multiple strips from each image;
Generating a stereoscopic panoramic image set including at least two mosaic images by performing mosaic processing on a plurality of strips obtained from the plurality of continuous optical images;
Including
Two consecutive strips of each image are used for two consecutive mosaic images,
The at least two mosaic images include at least two panoramic images corresponding to different gaze directions, are displayed to give a depth to the scene, and give the viewer a sense of depth of the scene;
A method characterized by that. 40. The method of claim 38, wherein
A plurality of strips that have been mosaicked with each mosaic image are all obtained from a position that is horizontally displaced from the center of the plurality of optical images by substantially the same distance.
A method characterized by that. 40. The method of claim 38 or 39,
Successive strips of each optical image are used for successive mosaic images in the order in which they appear in the optical image;
A method characterized by that. 41. The method according to any one of claims 38 to 40, wherein:
Generating the at least two mosaic images includes generating at least three mosaic images;
A method characterized by that. 40. The method of claim 38, wherein
The displaying step includes displaying both eyes so as to see different mosaic images.
A method characterized by that. 43. The method of claim 42, wherein
The displaying includes printing the plurality of mosaic images using lenticular printing;
A method characterized by that. 44. The method of claim 43, wherein
The lenticular lens has a flat back surface and a curved front surface, and the plurality of mosaic images are projected onto the flat back surface in the form of segments, and a viewer views toward the front surface. To see stereoscopic images,
A method characterized by that. 40. The method of claim 38, wherein
The step of displaying includes changing the display of a plurality of mosaic images to give a sense of depth to the scene.
A method characterized by that. 46. A method according to any one of claims 38 to 45, further comprising:
Including transmitting image data using a cellular communication channel,
A method characterized by that.

Images