JP4377656B2 - Integral photography apparatus and integral photography display apparatus - Google Patents

Description

  The present invention relates to an imaging device and a display device of so-called Integral Photography, which is a stereoscopic video system using a lens group.

  Conventionally, devices that use lenticular plates have already been commercialized as 3D stereoscopic display technology that does not rely on polarized glasses, etc. Further, 3D stereoscopic images that wrap around from the top, bottom, left, and right, which were impossible with the lenticular method. Integral Photography (hereinafter referred to as “IP” where appropriate) is being put to practical use. As this IP system, a system using lens groups or pinhole groups arranged in a plane is known. Further, this IP method is used not only for still images but also for moving images.

  As shown in FIG. 15A, a stereoscopic image photographing apparatus (hereinafter referred to as “IP photographing apparatus”) 800 using the IP system 800 is a photographing lens group 802 including a plurality of convex lenses 801 arranged on the same plane. And a photographing means 803 disposed on the opposite side of the first subject P and the second subject Q when viewed from the photographing lens group 802. Here, the photographic lens group 802 is configured by arranging hundreds to thousands of small convex lenses 801 in the vertical and horizontal directions. However, in order to simplify the drawing, the photographing lens group 802 is illustrated as being configured by four convex lenses 801. Yes. When the first subject P is photographed by the IP photographing apparatus 800, the same number of element images P1, P1,... Of the first subject P as the convex lenses 801 constituting the photographing lens group 802 are photographed by the photographing means 803 (FIG. 15 (a), element images of four subjects).

  Further, when the element images P1, P1,... Photographed by the IP photographing device 800 are displayed as they are on the display means 903 of a stereoscopic image display device (hereinafter, appropriately referred to as “IP display device”) 900 using the IP method (FIG. 15). (Refer to (b)), a reverse view image in which the depth is reversed is generated. Therefore, in order to avoid the reverse view image, the first subject P imaged by the individual convex lenses 801 and photographed by the photographing unit 803 is used. The element images P1, P1,... Obtained by converting the element images P1, P1,... Into point symmetry about the intersection of the optical axis of the convex lens 801 and the photographing means 803 are displayed by the display means 903 of the IP display device 900. Displayed to viewers.

  As shown in FIG. 15B, the IP display device 900 is disposed on the opposite side of the viewer as viewed from the display lens group 902 and the display lens group 902 composed of a plurality of convex lenses 901 arranged on a plane. Display means 903. Further, the convex lens 901 of the IP display device 900 has the same focal length as the convex lens 801 of the IP photographing device 800. Further, the distance from the convex lens 901 of the IP display device 900 to the display unit 903 and the distance from the convex lens 801 of the IP imaging device 800 to the imaging unit 803 are configured to be the same. Here, the display lens group 902 is configured by arranging hundreds to thousands of small convex lenses in the vertical and horizontal directions. However, in order to simplify the drawing, the display lens group 902 is illustrated as including four convex lenses 901. .

  The element images P1, P1,... Of the first subject P photographed by the photographing means 803 of the IP photographing apparatus 800 are converted into the display element images P2, P2,. Since the way of light from the display element images P2, P2,... On the display means 903 is the same as the way of light of the first subject P, the viewer does not wear polarized glasses or the like. A reproduced image of the first subject P can be seen at the position where the subject P was present.

  In addition, since the convex lens 801 constituting the photographing lens group 802 has a focal length so as to focus on one subject, the other subject is separated from the first subject P focused on the convex lens 801. If so, an element image with a low resolution is taken for other subjects. For example, as shown in FIG. 15A, when the first subject P and the second subject Q are separated from each other, the convex lens 801 constituting the photographing lens group 802 is focused on the first subject P. If there is a distance, the photographing means 803 captures element images P1, P1,... Of the first subject P with high resolution and element images Q1, Q1,.

Then, the element images P1, P1,... For the first subject P converted into point symmetry about the intersection of the optical axis of the convex lens 801 and the photographing means 803, and the element images P1, P1,. The element images Q2, Q2,... For the second subject Q are converted into point symmetry about the intersection of the optical axis of the convex lens 801 and the photographing means 803, and the display element images Q2, Q2,. 900 is displayed on the display means 903, and the viewer sees a reproduced image of the first subject P having a high resolution and a reproduced image of the second subject Q having a low resolution.
For this reason, an IP photographing apparatus including a variable focal length lens between a photographing lens group and a subject has been developed so that a plurality of subjects are focused (for example, Patent Document 1). The IP imaging device described in Patent Document 1 captures element images of a subject with high resolution sequentially for a plurality of subjects by changing the focal length of a variable focal length lens.
JP 2001-238229 A (paragraphs 0014 to 0026)

However, the IP photographing apparatus described in Patent Document 1 requires a special lens called a variable focal length lens.
Further, since it is necessary to set a focal length for each of a plurality of subjects and shoot a plurality of times for the variable focal length lens, it takes a long time to shoot.
Furthermore, since it is necessary to set the focal length for each of a plurality of subjects and shoot a plurality of times for the variable focal length lens, it is not suitable for shooting a moving image.
The present invention was devised in view of the above problems, and without using a special lens such as a variable focal length lens, it is possible to obtain element images with high resolution for a plurality of subjects in one shooting. In addition, an object of the present invention is to provide an IP photographing apparatus and an IP display apparatus that are suitable for photographing moving images.

The invention according to claim 1 has an element lens group having a plurality of element lenses arranged on the same plane, having a focal length that focuses on any of a plurality of subjects arranged at different distances from each other , are arranged at a predetermined distance from this element lens group, and a integral photography imaging apparatus comprising an imaging means for photographing a photographic element image of the subject imaged by the element lenses, said photographing A frequency converting means for converting a photographing element image photographed by the means into a frequency component, a filtering means for enhancing a high frequency component higher than a preset value among the frequency components converted by the frequency converting means, and the filtering And an inverse conversion means for converting into an image in which high frequency components are emphasized by the means .

According to such a configuration, the integral photography photographing apparatus can perform one photographing when one element lens group includes, for example, two kinds of element lenses that focus on two subjects. Element images with high resolution that focus on each of the two subjects can be taken.
In addition, the integral photography imaging device emphasizes high frequency components higher than a preset value among the frequency components by the filtering means, so that the imaging element image that has improved the influence of the low frequency that causes the reduction in sharpness. Can be obtained.
Here, the element lens includes not only a single lens but also an optical system (lens system) having a lens action. Focusing means not only that the lens is focused on the subject but also that the subject is within the depth of field.

The invention according to claim 2 is arranged at a predetermined interval from the subject, and divides the optical path of the light emitted from the subject corresponding to the number of subjects to be focused, and the predetermined distance from the half mirror. A plurality of element lens groups having a plurality of element lenses arranged on the same plane and arranged in the optical path of the outgoing light divided by the half mirror, and a predetermined interval for each of the plurality of element lens groups And a plurality of photographing means for photographing a photographing element image of the subject formed by the element lens, and a frequency conversion means for converting the photographing element image photographed by the photographing means into a frequency component Filtering means for emphasizing high frequency components higher than a preset value among the frequency components converted by the frequency conversion means, and the filtering means A Integral Photography imaging apparatus comprising: a reverse conversion means for converting the image the high-frequency component is emphasized, the element lenses constituting each said element lens group, for each of the element lens group, different distances A focal length that focuses on any one of the plurality of subjects arranged in the frame.

According to this configuration, for example, when the integral photography imaging apparatus includes two types of element lens groups that focus on each of the two subjects, the integral photography imaging device can focus on one subject by one shooting. A high-resolution imaging element image that is in focus can be captured by one imaging unit, and a high-resolution imaging element image that is focused on the other subject can be captured by the other imaging unit.
In addition, the integral photography imaging device emphasizes high frequency components higher than a preset value among the frequency components by the filtering means, so that the imaging element image that has improved the influence of the low frequency that causes the reduction in sharpness. Can be obtained.

According to a third aspect of the present invention, there is provided display means for displaying a photographing element image of a subject photographed by the photographing means of the integral photography photographing apparatus according to claim 1 as a display element image, and display elements displayed on the display means. a integral photography display Ru and a plurality of groups of display lens element lens arranged on the same plane for reproducing the reproduction image of the object from the image, capturing elements of the object photographed in each of the imaging means Frequency converting means for converting an image into frequency components, filtering means for enhancing high frequency components higher than a preset value among frequency components converted by the frequency converting means, and high frequency components being emphasized by the filtering means And a reverse conversion means for converting into an image .

According to this configuration , for example, when two subjects are photographed by the stereoscopic image photographing device according to claim 1, the integral photography display device displays display element images with high resolution for each of the two subjects. It can be displayed on the display means.
Further, the integral photography display device emphasizes high frequency components higher than a preset value among the frequency components by the filtering means, so that the display element image in which the influence of the low frequency that causes the reduction in sharpness is improved is improved. Can be obtained.

The invention according to claim 4 corresponds to the number of the photographing means for displaying, as a display element image, a photographing element image of a subject photographed by each of the photographing means of the integral photography photographing apparatus according to claim 2. A display unit and a plurality of element lenses for reproducing a reproduction image of the plurality of subjects from the display element image displayed on the display unit are arranged on the same plane and correspond to the number of the display units. A display lens group to be arranged, and a reproduction image of a subject that is arranged in a light path of light emitted from the display lens group and is reproduced by the display lens group at a predetermined interval from the display lens group. Te and a half mirror to generate a reproduced stereoscopic image, and frequency conversion means for converting the captured element image of the object photographed in each of the imaging means into frequency components, in the frequency conversion means And emphasizing filtering means high high-frequency component than a predetermined value among the conversion frequency components, and configured to include an inverse conversion means for converting the image obtained by emphasizing the high frequency components in the filtering means.

According to this configuration , for example, when two subjects are photographed by the stereoscopic image photographing device according to claim 2, the integral photography display device displays one display element image with high resolution for one subject. Display element images with high resolution can be displayed on the other display means.
Further, the integral photography display device emphasizes high frequency components higher than a preset value among the frequency components by the filtering means, so that the display element image in which the influence of the low frequency that causes the reduction in sharpness is improved is improved. Can be obtained.

The invention according to claim 5 has an element lens group having a plurality of element lenses arranged on the same plane, having a focal length that focuses on any of a plurality of subjects arranged at different distances from each other ; An integral photography photographing apparatus comprising photographing means for photographing a photographing element image of the subject that is disposed at a predetermined interval from the element lens group and is imaged by the element lens, and is set in advance The spatial frequency filter for emphasizing high frequency components higher than the measured value is arranged in the optical path of the element lens and arranged at a focal distance of the element lens .

  According to such a configuration, the integral photography photographing apparatus can perform one photographing when one element lens group includes, for example, two kinds of element lenses that focus on two subjects. Element images with high resolution that focus on each of the two subjects can be taken.
  In addition, the integral photography imaging device emphasizes high frequency components higher than a preset value among the frequency components by the spatial frequency filter, so that the imaging element has improved the influence of the low frequency that causes the sharpness to be lowered. An image can be obtained.
  Here, the provision of the spatial frequency filter in the optical path of the element lens means that, when the element lens is a single lens, the provision of the spatial frequency filter in the optical path of the element lens, and the element lens includes a plurality of lenses. In such a case, a spatial frequency filter may be arranged not only between the element lens and the subject, between the element lens and the photographing means, but also between the single lens.

The invention according to claim 6 is arranged at a predetermined interval from the subject, and divides the optical path of the emitted light from the subject corresponding to the number of subjects to be focused, and the predetermined distance from the half mirror. A plurality of element lens groups having a plurality of element lenses arranged on the same plane and arranged in the optical path of the outgoing light divided by the half mirror, and a predetermined interval for each of the plurality of element lens groups And a plurality of photographing means for photographing a photographing element image of the subject imaged by the element lens, the integral photography photographing apparatus having a value higher than a preset value emphasizing the spatial frequency filter high frequency components to an optical path of the element lens is disposed apart from the focal length of the element lenses, each said element lens group Element lens formed has a structure having a focal length for focusing on one of the plurality of the object located at different distances from each other.

  According to this configuration, for example, when the integral photography imaging apparatus includes two types of element lens groups that focus on each of the two subjects, the integral photography imaging device can focus on one subject by one shooting. A high-resolution imaging element image that is in focus can be captured by one imaging unit, and a high-resolution imaging element image that is focused on the other subject can be captured by the other imaging unit.
  In addition, the integral photography imaging device emphasizes high frequency components higher than a preset value among the frequency components by the spatial frequency filter, so that the imaging element has improved the influence of the low frequency that causes the sharpness to be lowered. An image can be obtained.

According to a seventh aspect of the present invention, there is provided display means for displaying a photographing element image of a subject photographed by the photographing means of the integral photography photographing apparatus according to claim 1 as a display element image, and display elements displayed on the display means. a integral Photography display Ru and a display lens group arranged on the same plane a plurality of element lenses of reproducing the reproduction image of the subject from an image, highlighting a high high-frequency component than a predetermined value The spatial frequency filter is arranged on the optical path of the element lens, and is arranged at a focal distance of the element lens .

  According to this configuration, for example, when two subjects are photographed by the stereoscopic image photographing device according to claim 1, the integral photography display device displays display element images with high resolution for each of the two subjects. It can be displayed on the display means.
  Further, the integral photography display device emphasizes high frequency components higher than a preset value among the frequency components by the filtering means, so that the display element image in which the influence of the low frequency that causes the reduction in sharpness is improved is improved. Can be displayed on the display means.

The invention according to claim 8 corresponds to the number of the photographing means for displaying, as a display element image, a photographing element image of a subject photographed by each of the photographing means of the integral photography photographing apparatus according to claim 2. A display unit and a plurality of element lenses for reproducing a reproduction image of the plurality of subjects from the display element image displayed on the display unit are arranged on the same plane and correspond to the number of the display units. A display lens group to be arranged, and a reproduction image of a subject that is arranged in a light path of light emitted from the display lens group and is reproduced by the display lens group at a predetermined interval from the display lens group. Te a half mirror to generate a reproduced stereoscopic image, comprising a, a emphasizing spatial frequency filter higher high frequency component preset value an optical path of the element lenses, the element It has a configuration which is arranged at the focal length of the lens.

  According to this configuration, for example, when two subjects are photographed by the stereoscopic image photographing device according to claim 2, the integral photography display device displays one display element image with high resolution for one subject. Display element images with high resolution can be displayed on the other display means.
  Further, the integral photography display device emphasizes high frequency components higher than a preset value among the frequency components by the filtering means, so that the display element image in which the influence of the low frequency that causes the reduction in sharpness is improved is improved. Can be displayed on the display means.

According to the first to eighth aspects of the invention, since a plurality of element lenses are focused on each of a plurality of subjects, a special lens such as a variable focal length lens is used even for a plurality of subjects. Without any problem, it is possible to obtain a high-resolution three-dimensional image for each of a plurality of subjects in one shooting.
Further, not only a still image but also a moving image, a high-resolution stereoscopic image can be obtained for each of a plurality of subjects.

According to the first to fourth aspects of the present invention, since the high-frequency component is emphasized in the photographing element image photographed by the photographing means by the filtering means, a stereoscopic image with high sharpness can be obtained.

According to the inventions according to claims 5 to 8 , since the high frequency component is emphasized in the photographing element image photographed by the photographing means by the spatial frequency filter, a stereoscopic image with high sharpness can be obtained.

[First Embodiment]
Hereinafter, an IP photographing apparatus (stereoscopic image photographing apparatus) according to a first embodiment of the present invention will be described with reference to the drawings. FIG. 1A to be referred to is a schematic diagram showing an IP photographing apparatus according to the first embodiment of the present invention. In the present embodiment, a case where a still image is taken will be described.

  As shown in FIG. 1A, the IP photographing apparatus 10 includes a photographing lens group (element lens group) 12, a photographing unit 13, and an image data processing unit 14. The photographic lens group 12 includes a plurality of first convex lenses (element lenses) 11a having a focal length for focusing on the first subject A and a plurality of focal lengths for focusing on the second subject B arranged on the same plane. It consists of a second convex lens (element lens) 11b. Here, the photographing lens group 12 is configured by arranging hundreds to thousands of small first convex lenses 11a and second convex lenses 11b vertically and horizontally, but in order to simplify the drawing, two first convex lenses 11a and It is illustrated as being composed of two second convex lenses 11b. The photographing means 13 photographs element images A1, A2, B1, and B2 of the first subject A and the second subject B that are imaged by the first convex lens 11a and the second convex lens 11b. In this form, it is a CCD sensor (Charge Coupled Device).

The taking lens group 12 is arranged at a predetermined distance from the first subject A and the second subject B. Further, the photographing means 13 is arranged on the opposite side of the first subject A and the second subject B from the photographing lens group 12 with a predetermined distance from the photographing lens group 12. Here, a distance L ₁ from the first object A to the photographing lens 12, the relationship between the focal length f _a of the distance L ₂ and the first convex lens 11a from the photographic lens group 12 to the photographing unit 13, the formula (1) Meet. The relationship between the distance L ′ ₁ from the second subject B to the photographing lens group 12, the distance L ₂ from the photographing lens group 12 to the photographing means 13, and the focal length f _b of the second convex lens 11b is expressed by the equation (2). Meet. Even if the expressions (1) and (2) are not exactly satisfied, the photographing means 13 is disposed within the depth of focus, and the first subject A and the second subject B are disposed within the depth of field. Just do it.

_{1 / L 1 + 1 / L} 2 = 1 / f a ··· (1)
1 / L ′ ₁ + 1 / L ₂ = 1 / f _b (2)

  Next, the image data processing means 14 will be described with reference to the drawings. FIG. 2 to be referred to is a block diagram showing image data processing means. The image data processing unit 14 emphasizes a high frequency component in the elemental image of the subject photographed by the photographing unit 13, and includes a Fourier transform unit 14a, a filtering unit 14b, and an inverse Fourier transform unit 14c. The Fourier transform unit 14a performs Fourier transform on the digital image including the element images A1 and A2 of the first subject A and the element images B1 and B2 of the second subject B output from the photographing unit 13. Further, the filtering unit 14b emphasizes only high frequencies in the Fourier-transformed digital image. Further, the inverse Fourier transform means 14c performs inverse Fourier transform on the digital image that has been subjected to Fourier transform with the high-frequency component emphasized, and converts it into a processed digital image. The image data processing means 14 is a personal computer or the like.

  The image processing will be described below with reference to the drawings. 3A to be referred to is an explanation for explaining the pixel arrangement, FIG. 3B is an explanatory view to explain the spatial frequency component distribution, and FIG. 3C is a diagram for explaining shuffling. It is explanatory drawing for demonstrating. FIG. 4 is an explanatory diagram for explaining filtering.

  The following Fourier transform is performed on the digital image data f (m, n).

Here, W _x = exp (−j2π / M), W _y = exp (−j2π / N), and the number of pixels of the image f is M × N. k is an integer from 0 to M-1, and l is an integer from 0 to N-1.

  Next, shuffling is performed. When the pixel number in the image is Fourier-transformed from the upper left corner as shown in FIG. 3A, low frequency components are distributed at the four corners as shown in FIG. Present in the center. Since this is inconvenient when performing filter processing in the frequency domain, the four frequency planes are moved and rearranged as shown in FIG.

Next, as shown in FIG. 4, when the image is shuffled by Fourier transform, the center portion represents the low frequency component and the peripheral portion represents the high frequency component. Therefore, with the center as the origin, the peripheral part is emphasized, or the central part is suppressed by multiplying the central part by a numerical value close to 0 (filtering process).
The next inverse Fourier transform is performed to obtain processed digital image data f ′. Therefore, the element image A2 of the first subject A and the element image B2 of the second subject B with low resolution are suppressed.

  Next, the operation of the IP photographing apparatus according to the first embodiment of the present invention will be described. FIG. 5 is a flowchart showing the operation of the IP photographing apparatus according to the first embodiment of the present invention. As shown in FIG. 5, the first subject A and the second subject B are imaged by the photographing lens group 12, and the element images A1, A2, B1, B2 of the first subject A and the second subject B are photographed by the photographing means 13. (Step S1). The photographing means 13 includes an element image A1 of the first subject A having a high resolution, an element image A2 of the first subject A having a low resolution, an element image B1 of the second subject B having a high resolution, and a second subject B having a low resolution. Element image B2 is photographed. This is because the first convex lens 11a is focused on the first subject A, so when the first subject A is imaged by the first convex lens 11a, a high-resolution element image A1 is photographed by the photographing means 13, This is because when the second subject B is imaged by the first convex lens 11a, the element image B2 having a low resolution is photographed by the photographing means 13. Similarly, since the second convex lens 11b is focused on the second subject B, when the first subject A is imaged by the second convex lens 11b, a low-resolution element image A2 is photographed by the photographing means 13. This is because when the second subject B is imaged by the second convex lens 11b, the high-resolution element image B1 is photographed by the photographing means 13.

  Next, the Fourier transform unit 14a of the image data processing unit 14 Fourier-transforms the digital image f including the element images A1 and A2 of the first subject A and the element images B1 and B2 of the second subject B output from the photographing unit 13. Conversion is performed (step S2). Further, the Fourier transform means 14a shuffles the digital image f subjected to the Fourier transform (step S3).

  Further, the filtering means 14b filters the digital image f that has been shuffled and Fourier transformed, and extracts the digital image f that has been subjected to Fourier transformation at a high frequency (step S4). Then, the inverse Fourier transform means 14c performs inverse Fourier transform on the extracted digital image f that has been subjected to Fourier transform to convert it into processed digital image data f ′.

  Next, an IP display device according to a first embodiment of the present invention will be described with reference to the drawings. FIG. 1B to be referred to is a schematic diagram showing an IP display device according to the first embodiment of the present invention. As shown in FIG. 1B, the IP display device 20 includes a display lens group 22 and a display unit 23. The display lens group 22 includes a plurality of first convex lenses 21 a and a plurality of second convex lenses 21 b arranged on the same plane, and is disposed in the optical path of the emitted light from the display means 23. The focal length of the first convex lens 21a of the display lens group 22 is the same as the focal length of the first convex lens 11a of the photographic lens group 12, and the focal length of the second convex lens 21b of the display lens group 22 is that of the photographic lens group 12. This is the same as the focal length of the second convex lens 11b. Further, the distance from the display lens group 22 to the display means 23 and the distance from the photographing lens group 12 to the photographing means 13 are the same.

Here, the display lens group 22 is configured by arranging hundreds to thousands of small first convex lenses 21a and second convex lenses 21b vertically and horizontally, but in order to simplify the drawing, the two first convex lenses 21a and It is illustrated as being composed of two second convex lenses 21b. The display unit 2 3 is a liquid crystal display, a plasma display, CRT (Cathode Ray Tube) and the like.

Further, when the image shown by the processed digital image data f ′ captured by the IP imaging device 10 and emphasized by the image data processing means 14 is displayed on the display means 23 of the IP display device 20 as it is, the depth is inverted. In order to avoid this reverse image, the elements of the first subject A that are imaged by the individual first convex lenses 11a and photographed by the photographing means 13 and extracted by the filtering process are generated. A display element image of the first subject A (image of the first subject A having a high resolution) obtained by converting the image A1 into a point-symmetrical manner around the intersection of the optical axis of the first convex lens 11a and the photographing unit 13 by an image conversion processing unit (not shown). The display element image A3 is displayed on the display means 23 of the IP display device 20. Further, the element image B1 of the second subject B imaged by the individual second convex lenses 11b and photographed by the photographing means 13 and emphasized by the filtering process is converted into the optical axis of the second convex lens 11b by the image conversion processing means (not shown). Display element image B3 of the second subject B converted to point symmetry about the intersection of the image capturing means 13 and the photographing means 13 (display element image of the second subject B having high resolution) is displayed on the display means 23 of the IP display device 20. To do. The image conversion means is a personal computer or the like.

  Therefore, according to the IP photographing apparatus 10 according to the first embodiment, the first convex lens 11a and the second convex lens 11b having focal lengths that focus on the two subjects are imaged and photographed by the photographing means 13. Element images with high resolution can be obtained for two subjects. Further, since the high-frequency component is emphasized by the image data processing means 14, it is possible to obtain only element images with high sharpness for the two subjects that have improved the influence of the low-frequency component that causes the resolution to deteriorate.

  Further, the IP display device 20 uses the image conversion means (not shown) converted from the element image A1 of the first subject A photographed by the photographing means 13 to the display element image A3 and the element image B1 of the second subject B. When the converted display element image B3 is displayed on the display means 23 of the IP display device 20 by the image conversion means (not shown), the light travels from the display element image A3 of the display means 23 by the first subject A. Since the light travels from the display element image B3 on the display means 23 in the same way as the light travels, the light travels from the second subject B in the same way. The image can be reproduced.

  In the present embodiment, a case where a still image is captured has been described. However, even when a moving image is captured, a high-resolution stereoscopic image can be obtained for a plurality of subjects. In the present embodiment, the lenses constituting the photographing lens group 12 and the lenses constituting the display lens group 22 are convex lenses, but any optical element having a lens action may be used. Further, if the lens constituting the photographing lens group 12 is a refractive index distribution lens, a reverse-view image in which the depth is reversed does not occur, so that it is not necessary to convert it into point symmetry. Further, although the photographing means is a CCD sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, a photographic film, a video tape, or the like may be used.

  In the present embodiment, the number of subjects is two, but may be three or more. In the present embodiment, filtering is performed by Fourier transform, but other methods that can emphasize high-frequency components may be used. Further, in the present embodiment, the image data processing means 14 is provided in the IP photographing device 10, but it may be provided in the IP display device 20.

  Further, in the present embodiment, the IP display device 20 sets the focal length of the first convex lens 21a of the display lens group 22 and the focal length of the first convex lens 11a of the photographing lens group 12 to be the same. The focal length of the biconvex lens 21b and the focal length of the second convex lens 11b of the photographing lens group 12 are the same, and the distance from the display lens group 22 to the display means 23 and the distance from the photographing lens group 12 to the photographing means 13 are the same. However, the present invention is not limited to this, and the focal length of the first convex lens 21a of the display lens group 22 is different from the focal length of the first convex lens 11a of the photographic lens group 12, and the focal length of the second convex lens 21b of the display lens group 22 is different. The focal length of the second convex lens 11b of the photographic lens group 12 is different, the distance from the display lens group 22 to the display means 23, and the distance from the photographic lens group 12 to the photographic means 13. Are different from each other, the way the light travels from the element image A3 of the display means 23 is the same as the way the light travels from the first subject A, and the way the light travels from the element image B3 of the display means 23 It may be the same as the light traveling direction of the second subject B. Furthermore, in this embodiment, the image data processing means 14 and the image conversion means are separate personal computers, but they may be the same personal computer.

[Second Embodiment]
Hereinafter, an IP photographing apparatus according to a second embodiment of the present invention will be described with reference to the drawings. In addition, the same code | symbol is attached | subjected about the structure same as the IP imaging device which is 1st Embodiment, and the description is abbreviate | omitted.
FIG. 6A to be referred to is a schematic diagram showing an IP photographing apparatus according to the second embodiment of the present invention.

  As shown in FIG. 6A, the IP photographing apparatus 30 includes a photographing lens group 12, photographing means 13, image data processing means 14, and a conversion lens 35. The conversion lens 35 is disposed between the photographing lens group 12 and the photographing means 13 and is disposed in the optical path of the emitted light from the photographing lens group 12. In addition, the conversion lens 35 converts the element images (back-viewed images) A1, A2,... Of the first subject A whose depths are reversed and the element images (back-viewed images) B1, B2,. Further inversion is performed to eliminate the inversion of the depth and convert it into a normal image. The conversion lens 35 is a convex lens or the like.

Therefore, according to the IP imaging device 30 according to the second embodiment, the element images A1, A2,... B1, B2,... Are converted into a normal image by the conversion lens 35. Therefore, as in the first embodiment, the element image of the subject photographed by the photographing means is represented by the intersection of the optical axis of the convex lens and the photographing means. It is possible to eliminate the need for conversion to point symmetry at the center and that the photographic lens group is constituted by a refractive index distribution lens.

[Third Embodiment]
Hereinafter, an IP photographing apparatus according to a third embodiment of the present invention will be described with reference to the drawings. In addition, the same code | symbol is attached | subjected about the structure same as the IP imaging device which is 1st Embodiment, and the description is abbreviate | omitted. FIG. 7A to be referred to is a schematic diagram showing an IP photographing apparatus according to the third embodiment of the present invention. As shown in FIG. 7A, the IP photographing device 40 includes a first photographing lens group 42a, a second photographing lens group 42b, a half mirror 45, a first photographing means 43a, a second photographing means 43b, and an image data processing means. 14 is provided.

  The first photographing lens group 42a is composed of a plurality of first convex lenses 11a having a focal length that focuses on the first subject A arranged on the same plane. The second photographic lens group 42b is composed of a plurality of second convex lenses 11b having a focal length for focusing on the second subject B arranged on the same plane. Here, the first photographing lens group 42a is configured by arranging hundreds to thousands of small first convex lenses 11a vertically and horizontally, and the second photographing lens group 42b includes hundreds of small second convex lenses 11b vertically and horizontally. Although thousands are arranged side by side, in order to simplify the drawing, the first photographing lens group 42a is assumed to be composed of four first convex lenses 11a, and the second photographing lens group 42b has four pieces. It is illustrated as being configured by the second convex lens 11b.

  The half mirror 45 divides the optical path of the emitted light from the first subject A and the second subject B, and is between the first subject A (second subject B) and the second photographing lens group 42b. In addition, they are arranged in the optical path of the emitted light from the first subject A and the second subject B.

Here, the distance L ₃ from the first object A to the half mirror 45, the distance from the half mirror 45 to the first imaging lens 42a L _4, the distance L ₅ from the first imaging lens 42a to the first imaging means 43a and the relationship between the focal length f _a of the first convex lens 11a satisfies the formula (5). The distance L ₃ from the second object B to the half-mirror 45 a distance 'from the half mirror 45 a distance L ₄ to the second imaging lens 42b', the second imaging lens 42b to the second imaging means 43 b L The relationship between ₅ ′ and the focal length f _b of the first convex lens 11b satisfies the following expression (6). Even if the expressions (5) and (6) are not exactly satisfied, the first photographing means 43a and the second photographing means 43b are disposed within the focal depth, and the first subject A and the second subject B are covered. It only needs to be arranged within the depth of field.

_{1 / (L 3 + L 4} ) + 1 / L 5 = 1 / f a ··· (5)
1 / (L ₃ ′ + L ₄ ′) + 1 / L ₅ ′ = 1 / f _b (6)

  Next, an IP display device according to a third embodiment of the present invention will be described with reference to the drawings. In addition, the same code | symbol is attached | subjected about the structure same as the IP display apparatus which is 1st Embodiment, and the description is abbreviate | omitted. FIG. 7B to be referred to is a schematic diagram showing an IP display device according to the third embodiment of the present invention. As shown in FIG. 7B, the IP display device 50 includes a first display lens group 52a, a second display lens group 52b, a half mirror 55, a first display means 53a, and a second display means 53b.

  The first display means 53a is an elemental image photographed by the first photographing means 43a, and does not illustrate the element image indicated by the processed digital image data f ′ in which the high frequency component is emphasized by the image data processing means 14. The image conversion processing means converts it into point symmetry about the intersection of the optical axis of the first convex lens 11a and the first photographing means 43a and displays it as a display element image. The second display means 53b is an element image photographed by the second photographing means 43b, and the element image indicated by the processed digital image data f ′ in which the high frequency component is emphasized by the image data processing means 14, By an image conversion processing means (not shown), the image is converted into point symmetry around the intersection of the optical axis of the second convex lens 11b and the second photographing means 43b and displayed as a display element image.

  The first display lens group 52a includes a plurality of first convex lenses 21a arranged on the same plane and having the same focal length. The first display lens group 52a is disposed in the optical path of the emitted light from the first display means 53a. The second display lens group 52b is composed of a plurality of second convex lenses 21b having the same focal length arranged on the same plane. The second display lens group 52b is disposed in the optical path of the emitted light from the second display means 53b. The focal length of the first convex lens 21a of the first display lens group 52a is the same as the focal length of the first convex lens 11a of the first photographing lens group 42a, and the focal length of the second convex lens 21b of the second display lens group 52b. Is the same as the focal length of the second convex lens 11b of the second photographic lens group 42b.

  The distance from the first display lens group 52a to the first display means 53a is the same as the distance from the first photographing lens group 42a to the first photographing means 43a. The distance from the second display lens group 52b to the second display means 53b is the same as the distance from the second imaging lens group 42b to the second imaging means 43b. Here, the first display lens group 52a is configured by arranging hundreds to thousands of small first convex lenses 21a vertically and horizontally, and the second display lens group 52b includes hundreds of small second convex lenses 21b vertically and horizontally. Thousands are arranged side by side, but in order to simplify the drawing, the first display lens group 52a is assumed to be composed of four first convex lenses 21a, and the second display lens group 52b is It is illustrated as being composed of four second convex lenses 21b.

  The half mirror 55 combines the light emitted from the first display lens group 52a and the light emitted from the second display lens group 52b, and is the same as the half mirror 45 of the IP photographing device 40. The positional relationship between the half mirror 55 and the first display lens group 52a and the second display lens group 52b and the positional relationship between the half mirror 45 and the first shooting lens group 42a and the second shooting lens group 42b are the same.

  Therefore, according to the IP photographing apparatus 30 according to the third embodiment, the first subject A and the second subject B are imaged by the first convex lens 11a constituting the first photographing lens group 42a, and the first having high resolution. The element image A1 of the subject A and the element image B2 of the second subject B with low resolution are photographed by the first photographing means 43a, and the first subject A and the second subject B constitute the second photographing lens group 42b. The element image B1 of the second subject B having a high resolution and the element image A2 of the first subject A having a low resolution are photographed by the second photographing unit 43b. In addition, since the high frequency component is enhanced by suppressing the low frequency component that causes the resolution to be lowered by the image data processing means 14, only element images with high sharpness can be obtained for two subjects.

  Further, the IP display device 50 converts the element images A1, A1,... Of the first subject A photographed by the first photographing means 43a by the image conversion processing means (not shown) to display the element images for displaying the first subject A. (Element images for display of the first subject A with high resolution) A3, A3,... Are displayed on the first display means 53a of the IP display device 50, and the element images B1, B1,. Are displayed on the second display means 53b of the IP display device 50, the element images for display of the second subject B (display element images of the second subject B having high resolution) B3, B3,. The light emitted from the display element images A3, A3,... Of the first subject A and the light emitted from the display element images B3, B3,. The way the synthesized light travels Since proceeds how the light of the first object A and the same as the process proceeds the way of light of the second object B, and two subjects, it is possible to reproduce a high sharpness stereoscopic image.

  In this embodiment, two subjects are used, but three or more subjects may be used as shown in FIGS. 8A and 8B (in FIGS. 8A and 8B, there are three subjects). .) In such a case, in order to divide the optical path of the light emitted from the subject into the same number as the number of subjects, the number of half mirrors that is one less than the number of subjects is used, and the same number of subjects as the number of subjects is photographed. A lens group, a photographing unit, a display lens group, and a display unit may be used. FIG. 8A is a schematic diagram illustrating an IP imaging device when there are three subjects, and FIG. 8B is a schematic diagram illustrating an IP display device when there are three subjects.

Further, as in the second embodiment, if conversion lenses are arranged between the first photographing lens group 42a and the first photographing means 43a and between the second photographing lens group 42b and the second photographing means 43b, Even if the lenses constituting the first photographic lens group 42a and the second photographic lens group 42b are not refractive index distribution lenses, a reverse view image in which the depth is reversed does not occur, so that the element image is photographed with the optical axis of the convex lens. It is possible to eliminate the need for conversion to point symmetry about the intersection of means. Further, although the photographing means is a CCD sensor, it may be a CMOS sensor, a photographic film, a video tape or the like. Further, the half mirror 55 is the same as the half mirror 45, but it is sufficient that the light emitted from the first display means 53a and the second display means 53b can be synthesized.

[Fourth Embodiment]
Hereinafter, an IP photographing apparatus (stereoscopic image photographing apparatus) according to a fourth embodiment of the present invention will be described with reference to the drawings. FIG. 9 to be referred to is a schematic diagram showing an IP photographing apparatus according to the fourth embodiment of the present invention. FIG. 10A to be referred to is an explanatory diagram for explaining the positional relationship among the lens system, the spatial filter, and the photographing means. In addition, about the structure same as 1st Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

  As shown in FIGS. 9 and 10A, the IP photographing apparatus 60 includes a photographing lens system group (element lens group) 62, photographing means 13, and a spatial filter (spatial frequency filter) 210. The taking lens system group 62 has a plurality of first lens systems (element lenses) 61a having a focal length for focusing on the first subject A and a focal length for focusing on the second subject B arranged on the same plane. It comprises a plurality of second lens systems (element lenses) 61b. Here, the photographic lens system group 62 is configured by arranging hundreds to thousands of small first lens systems 61a and second lens systems 61b vertically and horizontally, but in order to simplify the drawing, the two first lens systems 61a and 61b are arranged. It is illustrated as being composed of a lens system 61a and two second lens systems 61b.

  The positional relationship among the photographing lens system group 62, the photographing means 13, the first subject A, and the second subject B is the same as that of the photographing lens group 12, the photographing means 13, and the first subject of the IP photographing apparatus 10 according to the first embodiment. The positional relationship between A and the second subject B is the same.

  The spatial filters 210 extract only high-frequency components from the element image, and are the same number as the first lens system 61a and the second lens system 61b. Hereinafter, the relationship between the first lens system 61a and the spatial filter 210 will be described with reference to FIG. Although the relationship between the first lens system 61a and the spatial filter 210 will be described here, the relationship between the second lens system 61b and the spatial filter 210 is the same.

As shown in FIG. 10A, the first lens system 61a includes a first convex lens 201, a second convex lens 202, a third convex lens 203, and a fourth convex lens 204. Further, the second convex lens 202 is disposed in the optical path of the first convex lens 201. The third convex lens 203 is an optical path of the second convex lens 202 and is disposed with a focal length f ₃ of the third convex lens 203 away from the second convex lens 202. The spatial filter 210 is an optical path of the third convex lens 203, and is arranged at a focal distance f ₃ of the third convex lens 203 from the third convex lens 203. The fourth convex lens 204 is an optical path of the spatial filter 210 and is disposed at a focal distance f ₄ of the fourth convex lens 204 from the spatial filter 210. The photographing means 13 is an optical path of the fourth convex lens, and is arranged with the focal length f ₄ of the fourth convex lens 204 away from the fourth convex lens 204.

The first convex lens 201 forms an element image A ′ of the first subject A on the second convex lens 202, and forms an element image B ′ of the second subject B on the second convex lens 202. is there. Further, the third convex lens 203 is arranged at a focal distance f ₃ of the third convex lens 203 from the element image A ′ of the first subject A and the element image B ′ of the second subject B, so that the element image of the first subject A is obtained. A ′ and the element image B ′ of the second subject B are Fourier-transformed, and the first Fourier transform image A (not shown) is located on the spatial filter 210 at a position separated from the third convex lens 203 by the focal length f _3. ″ And the second Fourier transform image B ″ are generated.

The spatial filter 210 filters the first Fourier transform image A ″ and the second Fourier transform image B ″ to emphasize the high frequency component. That is, the spatial filter 210 suppresses a Fourier transform image B ″ having a low resolution. The fourth lens 204 is located from the spatial filter 210 fourth convex lens 2 04 focal length f ₄ separated by of the first Fourier transform image A'', and inverse Fourier transform, high sharpness the element image A1 of the first object a, is intended to be focused on the imaging unit 1 3. The second convex lens 202 efficiently enters the light rays forming the subject A and the subject B into the third convex lens 203.

  According to the IP imaging device 60 according to the fourth embodiment, an image is formed by the first lens system 61a and the second lens system 61b having focal lengths focused on the two subjects, and the spatial filter 210 Since high element images are emphasized, element images with high sharpness can be obtained for two subjects.

  Further, a display element image obtained by converting the element image A1 of the first subject A and the element image B1 of the second subject B photographed by the IP photographing device 60 by an image conversion unit (not shown) is related to the first embodiment. When displayed on the display means 23 of the IP display device 20, a stereoscopic image with high sharpness can be obtained for two subjects as in the first embodiment.

  In the present embodiment, the first lens system 61a and the second lens system 61b constituting the photographing lens system group 62 may have a relationship between a lens and a spatial filter as shown in FIG. . Moreover, the relationship between a lens and a spatial filter as shown in FIG. Here, FIG. 10B is an explanatory diagram for explaining the positional relationship between the lens, the spatial filter, and the imaging means, and FIG. 10C is an explanatory diagram for explaining the positional relationship between the lens, the spatial filter, and the imaging means. It is.

As shown in FIG. 10B, a spatial filter 310 may be disposed in the opening of the convex lens 301. As shown in FIG. 10C, the optical path of the convex lens 401 is the focal point of the convex lens 401 from the convex lens 401. distance f ₅ may be disposed a spatial filter 410 separates.

  The spatial filter 210 may block a part of the Fourier transform image. The spatial filter 310 has a configuration in which the transmittance varies depending on a configuration that blocks a part of the opening of the convex lens or a region in the opening of the convex lens. The spatial filter 410 has a configuration in which a part of the image-side focal plane of the convex lens 401 is blocked or a transmittance that varies depending on a region in the image-side focal plane aperture.

  In the present embodiment, the lenses constituting the first lens system 61a and the second lens system 61b are convex lenses. However, any optical element having a lens function may be used in addition to the convex lens. Also, as shown in FIGS. 11A to 11C, if the first lens system 61a and the second lens system 61b constituting the photographing lens system group 62 are made of a refractive index distribution lens, the depth is reversed. Since a reverse vision image does not occur, it is not necessary to convert the optical axis of the first lens system 61a (second lens system 61b) into point symmetry about the intersection of the photographing unit 13. Here, FIGS. 11A to 11C are explanatory diagrams for explaining the positional relationship between the refractive index distribution lens and the spatial filter.

As shown in FIG. 11A, the first lens system 61a is composed of refractive index distribution lenses 501, 502, and 503, and a spatial filter 510 is disposed between the refractive index distribution lens 502 and the refractive index distribution lens 503. . According to such a configuration, the element image A ′ of the first subject A and the element image B ′ of the second subject B are imaged on the boundary between the refractive index distribution lens 501 and the refractive index distribution lens 502 by the refractive index distribution lens 501. . Further, the gradient index lens 502 allows the first Fourier transform image A ″ and the second Fourier transform image B ′, which are Fourier transform images of the element image A ′ of the first subject A and the element image B ′ of the second subject B. 'Is generated at the boundary between the gradient index lens 502 and the gradient index lens 503 (not shown in FIG. 11A). Here, the spatial filter 510 is disposed on a surface (between the refractive index distribution lens 502 and the refractive index distribution lens 503) on which the first Fourier transform image A ″ and the second Fourier transform image B ″ are generated. . The spatial filter 510, the high frequency component (Fourier transform image A'') is emphasized, by the refractive index distribution lens 5 03, re diffract the first Fourier transform image A'' behind graded index lens 5 02 Therefore, an element image with high sharpness (the image A1 of the first subject A in FIG. 11A) is photographed by the photographing means 13.

  Further, as shown in FIG. 11B, the opening of the gradient index lens 601 may be partially shielded by a spatial filter 610. Note that the spatial filter 610 may have a transmittance that varies depending on a region in the opening of the gradient index lens 601.

In addition, as shown in FIG. 11C, a spatial filter 710 may be disposed on a surface where parallel light is collected in the gradient index lens system 701. Further, the surface of the gradient index lens system 701 on which the parallel light is collected may be partially shielded by the spatial filter 710, and the transmittance may be different depending on the region within the surface on which the parallel light is collected. .
Further, as in the second embodiment, a conversion lens may be provided between the photographing lens system group 62 and the photographing means 13.

[Fifth Embodiment]
Hereinafter, an IP photographing apparatus according to a fifth embodiment of the present invention will be described with reference to the drawings. FIG. 12A to be referred to is a schematic diagram showing an IP photographing apparatus according to the fifth embodiment of the present invention. As shown in FIG. 12A, the IP photographing device 80 includes a photographing lens group 12 and photographing means 13. Accordingly, the configuration of the IP imaging apparatus 10 according to the first embodiment is the same as that of the IP imaging apparatus 10 except that the image data processing unit 14 is not provided, and thus the description of each configuration of the IP imaging apparatus 80 is omitted.

  Next, an IP display device according to a fifth embodiment of the present invention will be described. The same components as those of the IP display device according to the first embodiment are denoted by the same reference numerals, and the description thereof is omitted. FIG. 12B to be referred to is a schematic diagram showing an IP display device according to the fifth embodiment of the present invention.

  As shown in FIG. 12B, the IP display device 90 includes a display lens system group 92, display means 23, and a spatial filter 210 (see FIG. 10A). The display lens system group 92 includes a plurality of first lens systems 91 a and a plurality of second lens systems 91 b arranged on the same plane, and is disposed in the optical path of the emitted light from the display means 23. The focal length of the first lens system 91a of the display lens system group 92 is the same as the focal length of the first convex lens 11a of the IP photographing device 80, and the focal length of the second lens system 91b of the display lens system group 92 is The focal length of the second convex lens 11b of the IP photographing device 80 is the same. Further, the distance from the display lens group 22 to the display means 23 is the same as the distance from the photographing lens group 12 of the IP photographing apparatus 80 to the photographing means 13.

Here, the display lens system group 92 is configured by arranging hundreds to thousands of small first lens systems 91a and second lens systems 91b vertically and horizontally, but in order to simplify the drawing, the two first lens systems 91a and 91b are arranged. It is shown as being composed of a lens system 9 1a and two second lens system 9 1b.
Since the first lens system 91a, the second lens system 91b, and the spatial filter 210 are the same as the first lens system 61a, the second lens system 61b, and the spatial filter 210 of the IP photographing device 60 according to the fourth embodiment, Description is omitted.

Therefore, according to the IP display device 90 according to the fifth embodiment, the element image A1 of the first subject A having a high resolution and the element image B2 of the second subject B having a low resolution captured by the IP photographing device 80 are obtained. the image transformation means (not shown), around the intersection of the optical axis of the imaging unit 13 of the first convex lens 11a is converted into a point-symmetrical to the display element image A3, B4, the high resolution second object B component image the B1 and elements image A2 of the low resolution first object a, the image converting means (not shown), converts in point symmetry about the intersection of the optical axis of the imaging unit 13 of the second convex lens 11b, a display element Images B3 and A4 are displayed, and the converted display element images A3, A4, B3 and B4 are displayed on the display means 23. In such a case, it is possible to achieve the same light and light from the first object A and the second object B by the first lens system 91a and the second lenses system 91b of the display lens system group 92, the high frequency components by the spatial filter 210 Since only the element image A1 of the first subject A and the element image B1 of the second subject B that are emphasized are transmitted, a stereoscopic image with high sharpness can be reproduced for a plurality of subjects.

[Sixth Embodiment]
Hereinafter, an IP photographing apparatus according to a sixth embodiment of the present invention will be described with reference to the drawings. FIG. 13 to be referred to is a schematic diagram showing an IP photographing apparatus according to the sixth embodiment of the present invention. In addition, about the structure same as 3rd Embodiment and 4th Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

  As shown in FIG. 13, the IP photographing apparatus 100 includes a first photographing lens system group 102a, a second photographing lens system group 102b, a half mirror 45, a first photographing means 43a, a second photographing means 43b, and a spatial filter 210 (see FIG. 13). 10 (a)).

The first photographing lens system group 102a is composed of a plurality of first lens systems 61a having a focal length for focusing on the first subject A arranged on the same plane. The second photographing lens system group 102b is composed of a plurality of second lens systems 61b having a focal length that focuses on the second subject B arranged on the same plane. Here, the first photographing lens system group 102a is configured by arranging hundreds to thousands of small first lens systems 61a vertically and horizontally, and the second photographing lens system group 102b comprises small second lens systems 61b vertically and horizontally. Although several hundreds to thousands are arranged side by side, in order to simplify the drawing, the first photographing lens system group 102a is assumed to be composed of four first lens systems 61a. The system group 102b is illustrated as being composed of four second lens systems 61b.

  Here, the positional relationship among the first subject A, the first photographing lens system group 102a, the half mirror 45, and the first photographing means 43a is the first subject A, the first photographing of the IP photographing apparatus 40 according to the third embodiment. This is the same as the positional relationship of the lens group 42a, the half mirror 45, and the first photographing means 43a. The positional relationship among the second subject B, the second photographing lens system group 102b, the half mirror 45, and the second photographing means 43b is the second subject B and the second photographing lens of the IP photographing device 40 according to the third embodiment. The positional relationship among the group 42b, the half mirror 45, and the second photographing means 43b is the same.

  According to the IP imaging device 100 according to the sixth embodiment, the high-frequency component of the element image is enhanced by the spatial filter 210 or the like by the imaging lens system having a focal length focused on each of the two subjects. Element images with high sharpness can be obtained for two subjects.

Further, an element image A1 of the first object A taken by IP imaging apparatus 100, the optical axis and the point symmetry about the intersecting point of the first photographing means 43a of the first lenses system 61a by the image conversion means (not shown) converts and a display element image, the element image B1 of the second object B, and converts the optical axis and the point symmetry about the intersection of the second imaging means 43b of the second lenses system 61b by the image conversion means (not shown) When a display element image is displayed and displayed on the first display unit 53a and the second display unit 53b of the IP display device 50 according to the third embodiment, as in the third embodiment, 2 is displayed. A three-dimensional image with high sharpness can be obtained for two subjects.

[Seventh Embodiment]
Hereinafter, an IP imaging apparatus according to a seventh embodiment of the present invention will be described with reference to the drawings. FIG. 14A to be referred to is a schematic diagram showing an IP photographing apparatus according to the seventh embodiment of the present invention. As shown in FIG. 14A, the IP photographing apparatus 120 includes a first photographing lens group 42a, a second photographing lens group 42b, a half mirror 45, a first photographing means 43a, and a second photographing means 43b. Accordingly, the configuration of the IP imaging apparatus 120 according to the third embodiment is the same as that of the IP imaging apparatus 40 except that the image data processing unit 14 is not provided, and thus the description of each configuration of the IP imaging apparatus 120 is omitted.

  Hereinafter, an IP display device according to a seventh embodiment of the present invention will be described with reference to the drawings. FIG. 14B to be referred to is a schematic diagram showing an IP display device according to the seventh embodiment of the present invention. In addition, about the structure same as 3rd Embodiment and 5th Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted. As shown in FIG. 14B, the IP display device 130 includes a first display lens system group 132a, a second display lens system group 132b, a half mirror 55, a first display means 53a, a second display means 53b, and a spatial filter. 210 (see FIG. 10A).

The first display lens system group 132a includes a plurality of first lens systems 91a arranged on the same plane and having the same focal length. The first display lens system group 132a is disposed in the optical path of the emitted light from the first display means 53a. The second display lens system group 132b is composed of a plurality of second lens systems 91b having the same focal length arranged on the same plane. The second display lens system group 132b is disposed in the optical path of the emitted light from the second display means 53b. The focal length of the first lenses system 91a of the first display lens system unit 132a is the same as the focal length of the first convex lens 11a of the first imaging lens 42a of the IP capturing device 120, a second display lens system group The focal length of the second lens system 91b of 132b is the same as the focal length of the second convex lens 11b of the second imaging lens group 42b of the IP imaging device 120.

The positional relationship between the first display lens system group 132a, the first display unit 53a, and the half mirror 55 is the same as the positional relationship between the first shooting lens group 42a, the first shooting unit 43a, and the half mirror 45 of the IP imaging device 120. . Further, the positional relationship between the second display lens system group 132b, the second display unit 53b, and the half mirror 55 is the same as the positional relationship between the second imaging lens group 42b, the second imaging unit 43b, and the half mirror 45 of the IP imaging unit 120. It is.

  Here, the first display lens system group 132a is configured by arranging hundreds to thousands of small first lens systems 91a vertically and horizontally, and the second display lens system group 132b includes small second lens systems 91b vertically and horizontally. Although several hundred to several thousands are arranged side by side, in order to simplify the drawing, the first display lens system group 132a is assumed to be composed of four first lens systems 91a. The display lens system group 132b is illustrated as being composed of four second lens systems 91b.

  Therefore, according to the IP display device 130 according to the seventh embodiment, the element image A1 of the first subject A having a high resolution and the element image B2 of the second subject B having a low resolution captured by the IP photographing device 120 are obtained. The image conversion means (not shown) converts it into point symmetry around the intersection of the optical axis of the first convex lens 11a and the first photographing means 43a to obtain a display element image, which is displayed on the first display means 53a. The element image A2 of the first subject A having a low resolution and the element image B1 of the second subject B having a high resolution are centered on the intersection of the optical axis of the second convex lens 11b and the second photographing unit 43b by an image conversion unit (not shown). The image is converted into point symmetry to form a display element image, which is displayed on the second display means 53b. In this case, the first lens system 91a of the first display lens system group 132a and the second display lens system 91b of the second display lens system group 132b emit the same light as the light from the first subject A and the second subject B. In addition, since the element image A1 of the first subject A and the element image B1 of the second subject B in which high frequency components are emphasized by the spatial filter 210 or the like are transmitted, a three-dimensional image with high sharpness is reproduced for the two subjects. be able to.

(A) is the schematic which shows the IP imaging device which is 1st Embodiment which concerns on this invention. (B) is the schematic which shows the IP display apparatus which is 1st Embodiment based on this invention. It is a block diagram which shows an image data processing means. (A) is an explanation for explaining an image arrangement. (B) is explanatory drawing in order to demonstrate spatial frequency component distribution. (C) is explanatory drawing for demonstrating shuffling. It is explanatory drawing for demonstrating filtering. It is a flowchart which shows operation | movement of the IP imaging device which is 1st Embodiment based on this invention. It is the schematic which shows the IP imaging device which is the 2nd Embodiment concerning this invention. (A) is the schematic which shows the IP imaging device which is the 3rd Embodiment concerning this invention. (B) is the schematic which shows the IP display apparatus which is 3rd Embodiment which concerns on this invention. (A) is the schematic which shows an IP imaging device in case a to-be-photographed object is three. (B) is a schematic diagram showing an IP display device when there are three subjects. It is the schematic which shows the IP imaging device which is the 4th Embodiment concerning this invention. (A) is explanatory drawing explaining the positional relationship of a lens system, a spatial filter, and an imaging means. (B), (c) is explanatory drawing explaining the positional relationship of a lens, a spatial filter, and an imaging | photography means. (A)-(c) is explanatory drawing for demonstrating the positional relationship of a refractive index distribution lens and a spatial filter. (A) is the schematic which shows the IP imaging device which is 5th Embodiment which concerns on this invention. (B) is the schematic which shows the IP display apparatus which is the 5th Embodiment which concerns on this invention. It is the schematic which shows the IP imaging device which is the 6th Embodiment concerning this invention. (A) is the schematic which shows the IP imaging device which is the 7th Embodiment concerning this invention. (B) is the schematic which shows the IP display apparatus which is the 7th Embodiment concerning this invention. (A) is the schematic which shows the conventional IP imaging device. (B) is the schematic which shows the conventional IP display apparatus.

Explanation of symbols

10, 30, 40, 60, 80, 100, 120, 800 IP photographing apparatus 11a, 21a First convex lens 11b, 21b Second convex lens 12, 802 Photographing lens group 13 Photographing means 14 Image data processing means 20, 50, 90, 130, 900 IP display device 22 Display lens group 23 Display means 42a First photographing lens group 42b Second photographing lens group 43a First photographing means 43b Second photographing means 45, 55 Half mirror 52a First display lens group 52b Second display Lens group 53a First display means 53b Second display means 61a, 91a First lens system 61b, 91b Second lens system 62 Shooting lens system group 92 Display lens system group 102a First shooting lens system group 102b Second shooting lens system group 132a First display lens system group 132b Second display lens system group 210, 31 0, 410, 510, 610, 710 Spatial filter A 1st subject B 2nd subject

Claims (8)

An element lens group having a focal length for focusing on any of a plurality of subjects arranged at different distances and having a plurality of element lenses arranged on the same plane, and a predetermined interval from the element lens group An integral photography photographing apparatus comprising photographing means for photographing a photographing element image of the subject which is arranged at a distance and is imaged by the element lens,
A frequency converting means for converting a photographing element image photographed by the photographing means into a frequency component;
Filtering means for emphasizing high frequency components higher than a preset value among the frequency components converted by the frequency conversion means;
Inverse conversion means for converting into an image in which high frequency components are emphasized by this filtering means,
An integral photography apparatus comprising: A half mirror that is arranged at a predetermined interval from the subject and divides the optical path of the light emitted from the subject in accordance with the number of subjects to be focused;
A plurality of element lens groups having a plurality of element lenses arranged on the same plane at a predetermined interval from the half mirror, arranged in the optical path of the emitted light divided by the half mirror, and
A plurality of photographing means for photographing a photographing element image of the subject that is arranged at a predetermined interval with respect to each of the plurality of element lens groups and is imaged by the element lens;
A frequency converting means for converting a photographing element image photographed by the photographing means into a frequency component;
Filtering means for emphasizing high frequency components higher than a preset value among the frequency components converted by the frequency conversion means;
Inverse conversion means for converting into an image in which high frequency components are emphasized by this filtering means,
An integral photography apparatus comprising:
Integral photography , wherein the element lenses constituting each of the element lens groups have focal lengths for focusing on any of the plurality of subjects arranged at different distances for each of the element lens groups. Shooting device. A display means for displaying a photographing element image of a subject photographed by a photographing means of the integral photography photographing apparatus according to claim 1 as a display element image, and a reproduced image of the subject from the display element image displayed on the display means. a integral Photography display Ru and a display lens group arranged on the same plane a plurality of element lenses to be reproduced,
A frequency conversion means for converting a photographing element image of a subject photographed by each of the photographing means into a frequency component;
Filtering means for emphasizing high frequency components higher than a preset value among the frequency components converted by the frequency conversion means;
Inverse conversion means for converting into an image in which high frequency components are emphasized by this filtering means,
An integral photography display device comprising: Display means corresponding to the number of photographing means for displaying, as a display element image, a photographing element image of a subject photographed by each of the photographing means of the integral photography photographing apparatus according to claim 2;
A plurality of element lenses for reproducing the reproduced images of the plurality of subjects from the display element images displayed on the display means are arranged on the same plane and arranged in correspondence with the number of the display means A lens group;
A half that generates a reproduced stereoscopic image by synthesizing a reproduced image of a subject that is arranged in the optical path of the emitted light from the display lens group at a predetermined interval from the display lens group and reproduced by the display lens group. Mirror,
A frequency conversion means for converting a photographing element image of a subject photographed by each of the photographing means into a frequency component;
Filtering means for emphasizing high frequency components higher than a preset value among the frequency components converted by the frequency conversion means;
Inverse conversion means for converting into an image in which high frequency components are emphasized by this filtering means,
An integral photography display device comprising: An element lens group having a focal length for focusing on any of a plurality of subjects arranged at different distances and having a plurality of element lenses arranged on the same plane, and a predetermined interval from the element lens group An integral photography photographing apparatus comprising photographing means for photographing a photographing element image of the subject which is arranged at a distance and is imaged by the element lens,
An integral photography apparatus characterized in that a spatial frequency filter for emphasizing a high frequency component higher than a preset value is disposed on the optical path of the element lens at a focal distance of the element lens. A half mirror that is arranged at a predetermined interval from the subject and divides the optical path of the light emitted from the subject in accordance with the number of subjects to be focused;
A plurality of element lens groups having a plurality of element lenses arranged on the same plane at a predetermined interval from the half mirror, arranged in the optical path of the emitted light divided by the half mirror, and
A plurality of photographing means for photographing a photographing element image of the subject that is arranged at a predetermined interval with respect to each of the plurality of element lens groups and is imaged by the element lens;
An integral photography apparatus comprising:
A spatial frequency filter that emphasizes a high frequency component higher than a preset value is an optical path of the element lens, and is arranged at a focal distance of the element lens,
2. An integral photography apparatus according to claim 1, wherein each of the element lenses constituting each of the element lens groups has a focal length for focusing on any of the plurality of subjects arranged at different distances . A display means for displaying a photographing element image of a subject photographed by a photographing means of the integral photography photographing apparatus according to claim 1 as a display element image, and a reproduced image of the subject from the display element image displayed on the display means. a integral Photography display Ru and a display lens group arranged on the same plane a plurality of element lenses to be reproduced,
An integral photography display device characterized in that a spatial frequency filter for emphasizing a high frequency component higher than a preset value is disposed in the optical path of the element lens and separated from the focal length of the element lens. Display means corresponding to the number of photographing means for displaying, as a display element image, a photographing element image of a subject photographed by each of the photographing means of the integral photography photographing apparatus according to claim 2;
A plurality of element lenses for reproducing the reproduced images of the plurality of subjects from the display element images displayed on the display means are arranged on the same plane and arranged in correspondence with the number of the display means A lens group;
A half that generates a reproduced stereoscopic image by synthesizing a reproduced image of a subject that is arranged in the optical path of the emitted light from the display lens group at a predetermined interval from the display lens group and reproduced by the display lens group. includes a mirror, the,
An integral photography display device characterized in that a spatial frequency filter for emphasizing a high frequency component higher than a preset value is disposed in the optical path of the element lens and separated from the focal length of the element lens.

Images