JPS62292141A - Method and apparatus for forming three-dimensional image - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

Detailed Description of the Invention 6. Detailed Description of the Invention (Background of the Invention) The present invention utilizes a single image detector and multiple energy sources to obtain different information to form a three-dimensional image. The present invention relates to a method and apparatus for imaging an object using a source. Three-dimensional images, both static and dynamic images, have been well known for many years. Early attempts at three-dimensional imaging using a stereoscope to view a pair of images or photographs of the same object were made using two cameras, or a single camera with many split or spatially separated lenses. camera was used. In such two-camera systems, the lenses were placed at a substantial eye-to-eye distance. A pair of separated pictures are formed.

The images were observed using a stereoscopic mirror in which each eye corresponded to an image. After that, anaglyph
) A stereoscope was developed, according to which.

The right and left images were colored and coded by complementary color filters viewed through the corresponding glasses to separate the different images required for the three-dimensional effect. anaglyph
) An improved stereoscope was developed using a single lens system. For example.

Songer, U.S. Pat. No. 4,312,199 and Belser, U.S. Pat. No. 4,290,675.
It is stated in the specification of the No. For Songet,
Recent attempts to create three-dimensional photographic systems for both still photography and film are exemplified, both of which require a camera for three-dimensional effects or for two-dimensional photographic effects. It is intended to form different information in three dimensions that fit so that it can be observed either without glasses or by. That system and other similar systems are expected to separate into different image golden spectra of cameras or image detectors by filters to simulate multi-lens systems, and the multi-lens systems mentioned above.

It was required to have a right and left eye separation ek with a suitable filter or the like. Moreover, such systems suffer from fatigue resulting from, for example, image distortion, blurring, image recording problems, viewer discomfort, and foreground and background focusing problems.

It had many problems, including cumbersome fittings, expensive parts, and other related difficulties.

The most recent attempt to create a three-dimensional dynamic video system was published in June 1983.
The title in “r Mechanics” is “6-D”
Partially described in ``TV is Here''.In this article, a description of a system for making three-dimensional TV movies and slides is specified,
The system consists of non-discriminatory glasses, cameras, projectors, and T.
V upper set is clearly required. The system described creates a monocular depth effect by the use of 1. conventional video equipment and encoding equipment; 2.
This creates a continuous time display of images captured from two different perspectives. This system obtains pictures of the object from two locations spatially separated by the distance between the eyes, and displays these different pictures on a single image projector, such as a TV. It is displayed continuously for one hour. Ordinary 3D images and the aforementioned anaglyph
This system of stereoscopic display has a number of limitations that preclude general commercial acceptance and other purposes. These limitations present significant difficulties in determining the decoupling of depth information from video flicker and in providing an unobstructed movie or photograph that does not cause viewer fatigue.

US patent specification 1, 672,645; 1,
595°295; 2,235,743; 2,360,3
22; 2.568,327; 2,751,826
;3.039,358;3.731,606;3,
810,215;3.990,087;4.009,
951;4,189,210;

shall not be temporarily accepted to form three-dimensional images that may be used for dynamic or static display in photographs, television, videotape, or other means of graphic display of images; .

OBJECT AND SUMMARY OF THE INVENTION The present invention provides an improved method and apparatus for simulating three-dimensional static or dynamic binocular images. % of the present invention.

An improved method and method for simulating two-dimensional still photographs, movies, videotapes, medical images such as X-rays, TV images, robots and other distance sensing devices such as those used in night vision displays. The equipment is to provide money.

Another object of the present invention is to provide an improved method and apparatus for viewing three-dimensional simulations of still photographs or other images, wherein the other images can be viewed by an observer using a viewing device. Use three-dimensional simulation, or two-dimensional simulation without the aid of equipment or obvious distortion of the two-dimensional image to selectively observe gold.

Another object of the present invention is to provide an improved method and apparatus for performing two-dimensional or three-dimensional video simulations, which include still photographs, movie cameras, X-ray cameras, video cameras, video cameras, etc. Conventional video detectors and recording means such as those included in tapes, TV left cameras and the like are used, and the three-dimensional video simulation is an auxiliary system that is easy to manufacture and operate and is relatively cheap. It is carried out by

Yet another object of the invention is to provide an improved method and apparatus for simulating three-dimensional images, which in one implementation eliminate the need for viewing devices such as glasses. The three-dimensional image can be displayed on a conventional video display device such as a movie projector, videotape projector, or TV.

Yet another object and advantage of the present invention is to provide an improved method and apparatus for displaying dynamic or cinematic three-dimensional images, the majority of which are unblurred and fully The colors are vivid, there are no jumps in the screen, and the images are smooth and do not cause anxiety or fatigue to the viewer's eyes.

Yet another object of the present invention is to provide an improved method and apparatus for simulating three-dimensional images, whereby a viewer can view a three-dimensional object as viewed through glasses.

Alternatively, when not using glasses, one can selectively choose to observe the object as a two-dimensional object, and both the two-dimensional and three-dimensional images are fully compatible with each other.

Display on the same CRT or projector is possible.

Yet another object of the invention is to provide an improved method and overall apparatus which allows the application of existing apparatuses of conventional design for two-dimensional photographic imaging, which apparatuses include, for example: This is a regular 35mm film for creating photographic images, which can be selectively viewed as either a two-dimensional or three-dimensional picture.

It is further an object of the present invention to enable the viewer to choose between two-dimensional or three-dimensional viewing without the need for modification or adaptation of conventional TV, videotape, movie or other viewing systems. In a method, T
V. Videotape.

An object of the present invention is to provide an improved method and apparatus for forming images for projection onto motion picture film.

Yet another object of the invention is to provide a method and apparatus for detecting the relative distance of an object from a robotic device, such that the robotic device allows selection operations that depend on the relative distance of the object. That's true. It is a further object of the present invention to provide an improved method and apparatus for simulating the depth of a formed image. Such methods and apparatus have particular utility and benefit in a variety of computer-driven devices, such as computer games and computer-driven flight simulators.

A further object of the present invention is to provide an improved method and apparatus for making medical images, which in combination with a conventional fundus camera can be used in a relatively simple manner and with the apparatus. An object of the present invention is to provide a method for three-dimensional observation using an apparatus and the apparatus. Such a system is intended as an improved method and apparatus for retinal testing.

Another use of the principles of the present invention is in connection with medical imaging using ultrasound frequencies, where they are used to create depth perception effects for monographics and the like.

In the present invention, depth perception results from multi-projection of images of an object using multiple energy sources to form multiple images with different shading. This is accomplished by using multiple energy sources to illuminate the object sequentially or simultaneously, thereby revealing its image. A single detector records images of objects revealed by multiple energy sources. In more detail, a single energy detector, such as a photographic or TV left camera, continuously detects and records images of an object, which has multiple energy sources, such as multiple light sources. Continuously revealed for recording by source. For example, a camera is used to photograph an object at spatially separated locations and with the object illuminated by a light source for successive frames. When the system is used to reveal dynamic images in still photographs, the multi-photographs of the image have many shadings encoding different information. If the photograph is viewed in a stereoscope, a three-dimensional image results. A similar system is designed in which a single photograph uses a number of different light sources, one for example a first light source with a red filter and a second light source with a blue filter. You, the combination of the two filtered light sources allows you to visually measure the spectrum of white light. The resulting pictures are single and clearer to the naked eye.

To display a relatively sharp picture of a blurred image with limited shadows. However, if the picture.

If viewed through glasses with one red and one blue lens, the image has a three-dimensional phenomenon.

In a refinement of the invention applied to discrimination for use in dynamic systems, depth perception is achieved without the use of glasses or with the aid of other viewing means. In such a system a video detector, such as a movie camera or a TV left camera, is used which is capable of taking successive frames of pictures in normal mode. In this system, multiple regularly spaced energy sources are synchronized with the camera and successive frames of exposed film are illuminated by these different light sources. A projected film such as a movie, videotape, or TV.

When displayed in a frame continuously illustrating an object,
The film is illuminated by different regularly spaced light sources in successive frames. When viewed, the image has a three-dimensional effect or a pseudo-stereoscopic effect that is not a true three-dimensional image but is a dynamic silhouette with the illusion of substantial depth.

It is a principal object of the present invention to provide a method for forming a three-dimensional image of an object, which involves irradiating an object with radiant energy from a number of energy sources and thereby forming an image formed by the radiant energy. A single detector, such as a single lens camera that detects and records optically,
Images with different asthmatic shadings are recorded, and the shadings are
It relies on a special energy source used for exceptional images. Apparatus is also provided for separating separately defined shadow portions corresponding to the energy source and for viewing the shadow portion with each eye of an observer to view different shades of the image. Ru.

(Example) The present invention provides a pseudo three-dimensional display that irradiates energy from an energy source to an object from different angles and utilizes the shadows formed thereby to form a plurality of images having different shadows. This is what we do. This system is useful in 1 normal single-lens 3D photography, 3D medical imaging such as fundus cameras and X-ray cameras, 3D TV, movie videotapes, ultrasound and similar, and similar dynamic displays. It is also useful for distance detection and night vision devices in robots, as well as computer images for computer games and flight simulators. The method of the invention can be best understood by referring to FIG. The three-dimensional image of object 1 is
It is formed in the configuration shown in FIG. Object 1il-11
, , is placed in front of an energy reflective background. The energy sources 6 and 4 are separated by a selected distance 5. An image detector or recorder 6 is optically aligned with the object 1 at IJ. The schematic diagram of FIG. 1 represents one different system.

For example, FIG. 1 depicts a method for creating three-dimensional still photographs. In this system.

The background 2 must be a bright reflective material, such as a white screen on which shadows are formed.

Energy sources 6 and 4 may be conventional light sources such as those used for illuminating still photographs.

In such a case, it is sufficient that the light sources 6 and 4 result in a projected shadow with the shadow 6A formed by the light source 6 and the shadow 4A formed by the light source 4. Therefore, the resulting image or images can be seen as an image observed with one eye or as one image formed by light source 6 and another image formed by light source 4 that appears separately. additional means are required for proper separation of those images when viewed.

Several methods are used to separate images formed by different light sources. If you line up.

If a stereoscopic device is used, the two pictures.

The object 1 is taken intermittently while it is still. The resulting pair of separated three-dimensional images can be viewed through conventional stereoscopic equipment for forming three-dimensional images.

The system shown in FIG. 1 is used to form a three-dimensional image through the use of different color filters, for example a blue/green filter 7 and an orange/red filter 8. Camera 6 using light sources 6 and 4 and corresponding filters 7 and 8
The photograph taken by , forms a single image of different shades superimposed in different colors at the same time. When viewed through a monocular system with lenses that are normally color-coded of the type often used for three-dimensional viewing, blue/green on the one hand and orange/red on the other, the resulting image exhibits a three-dimensional effect. It is something that we have. Therefore, the image is obtained without moving the camera 6 and the three-dimensional effect is produced with the single lens camera 6 by the two light sources 6 and 4. What is the composite photo when viewed without a lens?

3-D encoded information and composite images result in a phenomenon similar to a normal two-dimensional picture, with blur limited to overlap and shading, and can be seen without the aid of glasses or substantial blur or distortion. .

As shown in the implementation column of FIG. 1, depth information is encoded in different shadings.

In photography, it is formed by multiple energy sources, such as light sources. It is clear that similar systems can be used for other than normal visible light, such as infrared photography. What is that system?

Fundus cameras, ultrasound, and three-dimensional X-ray images are still used for medical imaging. In X-ray applications, an X-ray plate is used instead of the background element 2 and the camera 6, as well as the image detector and recorder.

When the system is used so that images are recorded regularly, it is important to stabilize the detector. The detector 6 must then be fixed in relation to the object 1 and the background 2 during fixation of the image. Such a fix is 1
It is less important when two images separated into two spectral bands, for example by a dichromatic filter, are recorded on the camera at the same time.

In the row of FIG. 1, the distance 5 between the two light sources 6 and 4 is
The distances may be changed separately to reduce the difference. Preferably, the light source should be placed at a distance somewhat greater than the distance between the eyes. However, increasing the distance too much will distort the depth perception that occurs. The placement of the energy source on the same side as the image detector 6 minimizes flicker and distortion.

The system shown in FIG. 1 detects the relative distances of several objects from a robotic device in order to enable the robotic device to selectively manipulate distance-dependent objects. used for. For example, this system is used to enable selection by a robot arm of the most distant of some objects. In such a system, several objects each have different projected shadows depending on their relative distance from the light source. These comparison distances are detected by the video detector 6, which in this case may be the TV right camera. The size or amount of the comparative shadow is measured and detected by a suitable comparator, and
The obtained information is used as a control input signal for the robot device. Such a system provides a more accurate determination of relative distances, thereby minimizing the errors expected from the use of the system without resorting to depth perception effects.

It should be noted that similar systems are used to provide depth perception effects in medical images. For example, the system of FIG. 1 may be used to impart depth perception to a monograph. The typical power source of the light source in such systems is in the ultrasonic frequency range. The reflected energy is used to form a depth image in an image detector suitable for such purposes.

The depth perception effect of a system such as that shown in FIG. 1 can be enhanced by using more than two point sources of energy. This configuration is best shown in FIG. In this arrangement, the object 10 is located in front of the energy reflective screen 11. The detector is aligned with the object 10 and suitably connected to a plurality of energy sources 13 to 18 via suitable controllers 19. The schematic diagram in Figure 2 shows still images such as still photographs, movies, and TV.

Applies to dynamic images such as videotape or similar. And the video detector and recorder 12 may be a still camera, a TV left camera video camera or the like.

In such cases, energy sources 13-18 are light sources and will be in the visible spectrum. The light sources 13-18 are connected to an electrical time controller 19.

The electrical time controller 19 is adapted to be electrically connected to the camera 12 by one conventional means.

Therefore, the time-by-time photographs are taken by the camera 12 of the object 10.
The light sources 13 to 18 are triggered one after another, and all but the triggered ones are turned off. For example, in a movie film, six consecutive images of object 10 are:
The light sources 13 to 18 will be used one after another. -Rikitsutsu 2
In the example shown in the figure.

Six light sources, uniformly spaced apart and symmetrically placed with respect to the camera 12, are clearly shown; other variations in space and time combinations are possible. Additional light sources are used to further enhance the depth information of the three-dimensional image. This system.

When used with color-separated images.

Half of the light sources 13-18 are filtered by one color filter and the other half by the other color filter. These filters 13A to 18A are red/orange,
Divided into blue/green and/or weighted filters, 6 of each are selected appropriately. These images represent a normal phenomenon when viewed without filtered glasses. But when viewed with glasses where one lens is red/orange and the other lens is evening/green.

Three-dimensional effects are recognized or detected by devices that serve a discriminative purpose.

The embodiment of FIG. 2 can also be used without filters 13A-18A to provide a three-dimensional monocular display. In this configuration, monocular depth information is formed by the sequential display of picture frames captured at a rate of several 71/- frames per second. Each successive frame corresponds to a successive light source 13-18. The object 10 is a single
Since it is recorded by source 12, there is no obvious flicker or object motion as would occur with the use of a monocular lens system. Depth information is generated through the use of shading, and some accidental flicker or blur motion is limited by the shading rather than the motion of the image.

The use of more than two light sources contributes shadow information over a shorter range of distances and provides a smoother phenomenon for depth perception effects.

Referring to FIGS. 3A and 6B, another system for forming three-dimensional images is schematically illustrated utilizing a single energy source and a single image recorder. In this arrangement, the object 20 is.

It is located in front of a reflective background 21. A single video detector and recorder 22, such as a movie camera, is aligned with the object 20. Energy source 2 like a light beam
3 is aligned with an energy reflecting device 24 suitably supported on a mirror or pivot 25 , said pivot being electrically connected to a controller 26 for camera 22 . The controller 26 is designed to move the mirror from the angle shown in FIG. 3A to the angle shown in FIG. 3B with the progression of frames of recording film in the camera 22. In operation, the mirror 24 is moved with successive frames of the picture from the position shown in Figure 6A to the position shown in Figure 6B, and then returned to the rest position.

The models shown in Figures 3A and 6B operate on similar principles as shown in Figure 1. But the first
By using a single light source 26 and oscillating mirror 24, rather than the two light sources 6 and 4 shown in the figure, the problem of matching the emission states of different light sources is avoided. In the embodiment of FIG. 1, the use of light sources 6 and 4 separated by one
Care was required in matching the emissions of these light sources to minimize flicker. A similar system as shown in FIG. 1 is used where the common electrical gs device connected to the light sources 6 and 4 is provided with a feedback system with a single detector. Such a feedback system controls the intensity of the light sources 6 and 4 to ensure uniform lighting conditions from each of the light sources 6 and 4.

This invention is intended for use in devices such as computer games and flight simulators to create traps, synthetic images with three-dimensional phenomena. In a computer for forming such images, a procedure has been developed for forming two images of the requested object with each image simulating the object as viewed from the same location. . However, the two images are combined as if each were illuminated by light sources from different positions.

The images thus formed have shades in which some are qualitatively different from others. These separated images are observed as static or dynamic images.

If viewed as static images, the two images are displayed stereoscopically in the usual way. If color is used, the analytical system is used to form a shaded image with a glaze signature in one color in the above method;
Therefore, mutually discriminating color filters, such as red and blue, are used for viewers to simultaneously view images through one blue lens and one red lens.

The monocular lens is used when dynamic display is performed.

In this case, the image is only displayed consecutively at least several times per second, in order to form a motion phenomenon in a form similar to a cinema TV system.

However, with another simulated light source, a continuous image is displayed.

[Brief explanation of the drawing]

FIG. 1 is a diagram schematically illustrating an embodiment of the proposed form of the invention, and when considered together with the drawings appended thereto, it will be understood that the object of the invention described above is and the benefits are clearly understood. FIG. 2 schematically shows an improved form of the invention. , 11A and 6B are diagrams schematically showing two box-based embodiments of the present invention. 1.10.20...Object 2.21...Energy reflection background 3.4.26...Energy source, 5A, 4A...Shadow 5...Distance 6.22...Video detection Device (camera) 7...Blue/green filter 8...Orange/red filter 11...Energy reflecting screen 12...Recorder (camera) 13-18...Energy source 13A-18A... Color filter 19...Time controller 24...Energy reflector (mirror) 25...Pivot 26...Controller 28.29...Shading. (4 others) Procedural amendment (method) 21 Name of the invention Method and device for forming three-dimensional images 3 Relationship with the person making the amendment Applicant Address Name Antonio Medina 4, Agent Address: Room 206, Room 5, Shin-Otemachi Building, 2-2-1 Otemachi, Ishirota-ku, Ishirota-ku, Tokyo Date of amendment order: August 26, 1985 (Date of dispatch) 6: Subject of amendment: Typed details 7: Amendment contents of

Claims (1)

[Claims] 1. An image element of the object is formed by image elements having shadows generated by energy sources irradiated from different positions on the object, and the shadow is formed from a first direction. a first shaded area formed from a second direction, and a second shaded area formed from a second direction, and the first and second shaded areas are visually separable from each other, and the observer's 1st in one eye
At the same time, the viewer's other eye separates the first shadow portion formed from the direction and the second shadow portion formed from the second direction with the viewer's other eye, and at the same time observes the image element to determine the depth perception effect. A method for forming a three-dimensional image characterized by enhancing the . 2. The image element is formed by at least a series of steps and consists of images each having a different shade from the others,
A method for forming a three-dimensional image according to claim 1, characterized in that said separation is achieved by alternating display in a dynamic display of said image. 3. It has an energy source means for irradiating energy onto the object from a plurality of points separated from each other, and forms an image of the object having shadows caused by the energy irradiated from the plurality of points. means for detecting reflected energy that is energy from another one of the plurality of points defining a separable shadow with respect to the formation of the image; an apparatus for forming a three-dimensional image, comprising: optical separation means for separately observing the separable shadows of the detected image by each eye of an observer; 4. The energy source means comprises a plurality of light sources, whereby the light sources are reflected to form a plurality of images, the images being differentiated from each other as determined by the spatial separation of the energy sources. The apparatus for forming a three-dimensional image according to claim 3, characterized in that the apparatus has a shadow. 5. An apparatus for forming a three-dimensional image according to claim 4, characterized in that said light sources are mutually exclusive of visible light spectral frequencies, at least to some extent. 6. The apparatus for forming a three-dimensional image according to claim 5, wherein the light source includes color filters that complement each other. 7. An apparatus for forming a three-dimensional image according to claim 3, characterized in that the means for detecting the image comprises a camera having a lens that allows reflected energy to pass therethrough. 8. The apparatus includes means for recording a display that is an image on a film, the image on the film being an image formed by reflected energy from different light sources recorded on different segments of the film. An apparatus for forming a three-dimensional image according to claim 7, characterized in that: 9. The recording means is a camera, the camera being designed to record the motion of the object, and the motion and depth perception being displayed in successive segments by the recording means. Claims characterized in that the image formed on adjacent segments of the film is formed by shadows from different light sources. 8th
Apparatus for forming a three-dimensional image as described in Section 3. 10. The apparatus for forming a three-dimensional image according to claim 9, wherein the camera is a movie camera. 11. The apparatus for forming a three-dimensional image according to claim 9, wherein the camera is a TV camera. 12. The apparatus for forming a three-dimensional image according to claim 9, wherein the camera is a videotape camera. 13. The camera is designed to record the motion of the object, and the camera is designed to record images illuminated by a plurality of spatially separated light sources and different shadows cast on the object. When observed on the same segment of the film, light sources qualitatively different from each other in a way that is known to be an object by motion and depth perception are detected and recorded on the film and freely forming a three-dimensional image according to claim 8, which has a meaning when observing the image in order to see only one selected one of qualitatively different shades for each eye; equipment for 14. An apparatus for forming a three-dimensional image according to claim 6, characterized in that the energy source means irradiates energy onto the object at a frequency in the ultrasonic frequency range. 15. means for comparing shadows formed by a plurality of images; and means for determining a relative distance of the object from the comparison with the shadows; The apparatus for forming a three-dimensional image according to claim 3, characterized in that it is used to detect the relative distance of an object.