JP2002152722A - Image projector and its method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image projector and an image projection method, by which a viewer can view an image in an entire range while recognizing a foreground and a background. SOLUTION: The image projector divides an image signal obtained by photographing a full range of an object from a foreground to a background at a wide angle into a foreground part and a background part, projects them as upper and lower section parts on a screen and processes the foreground and background parts in a way that they have continuity in terms of the image in cross-reference with each other at the respective borders on the screen.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image projection apparatus and method for projecting a foreground to a background of an image on a screen.

[0002]

2. Description of the Related Art Images in the entire range from the foreground to the background can be obtained, for example, by photographing with a camera having a fisheye lens. Such an image can recognize the entire range at a glance.

[0003]

However, when the image is projected on the screen, the observer cannot determine the foreground and the background or the direction of the scene. In particular, when the observer moves, the image changes, and it becomes more difficult to determine the direction. The same applies to the case where the image moves. Thus, providing the entire range of images was of little utility. SUMMARY OF THE INVENTION It is an object of the present invention to provide an image projection apparatus and an image projection method that enable an observer to observe an entire range of an image while recognizing a foreground and a background.

[0004]

Means for Solving the Problems In order to solve the above-mentioned problems and to achieve the above-mentioned object, the present invention has the following features.
Capturing means for capturing an image of the entire range from the foreground to the foreground around the observer as an image signal, and bisecting the image signal into a foreground part and a foreground part, in front of the observer The foreground portion and the foreground portion are arranged vertically on the arranged screen, and the right edge of the foreground portion, the right edge of the foreground portion, the left edge of the foreground portion, and the left edge of the foreground portion on the screen. The present invention relates to an image projection apparatus comprising: processing means for projecting the right and left ends of the foreground portion in correspondence with the foreground portion so that the image has continuity.

It is preferable that the processing means is configured to set the foreground portion and the foreground portion in a range of about 180 degrees, which is a half of the entire range.

According to a third aspect of the present invention, an image obtained by capturing the entire range from the foreground to the background with the observer as the center is captured, and the image signal is divided into a foreground part and a background part. Distributing the foreground portion and the foreground portion up and down on a screen arranged in front of the observer, and on the screen, the right end of the foreground portion, the right end of the foreground portion, and the left end of the foreground portion. The present invention relates to an image projection method for performing processing such that the right and left ends of the foreground portion are projected on the foreground portion so that the image has continuity with the left end of the foreground portion.

[0007] It is desirable that the foreground portion and the foreground portion are set to a range of about 180 degrees, which is obtained by bisecting the entire range.

The foreground portion and the foreground portion divide the entire range into two parts, but independently capture images in a range of 180 ° or more, and double-project images at each end of the foreground portion and the foreground portion. It is desirable that the treatment be performed smoothly.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, an embodiment of the present invention will be described with reference to FIGS.

FIG. 1 is a block diagram showing an image projection apparatus according to a first embodiment of the present invention. 1 is a fisheye lens, 2
Is a movie camera, and 3 is an image signal capture which constitutes a capturing means. An image photographed at a wide angle by the camera 2 with the fisheye lens 1 is converted into an image signal S1 digitized by the image signal chapter 3. An image signal buffer 4 stores the image signal S1. Reference numeral 5 denotes a microcomputer, which forms a processing circuit 6 for processing the image signal S1 using the image signal buffer 4. Reference numeral 7 denotes a setting circuit which forms setting means for setting processing conditions in the processing circuit 6 in advance. 8 is a signal driver connected to the output side of the processing circuit 6, 9 is an image monitor connected to the output side of the signal driver 8, 10 is its screen, and the processed image signal S2 processed by the processing circuit 6 is The signal is scanned by a signal driver 8 and projected on a screen 10 of a monitor 9. The processing circuit 6 generates the image signal S1.
Is distributed on the screen by distributing the upper half to the foreground part, the lower half to the foreground part, and the right end of the foreground part, the right end of the foreground part, the left end of the foreground part, and the left end of the foreground part for one frame. This is to obtain a processed signal S2 having characteristics.

The details of the processing circuit 6 will be described. FIG. 2 shows an input image V taken by the movie camera 2.
Although 1 is shown, this is an image of 360 degrees around the point T. Accordingly, the point T is the position of the movie camera 2 and, at the same time, is a screen that is overhead for the observer. For observer, lower half is foreground part 1
1. The upper half corresponds to the background. The lower center point PF of the lower half is the line-of-sight position when the observer observes the foreground portion 11, that is, the foreground viewpoint, and the lower center point PB of the upper half is when the background portion is observed. It is a background view. As shown in FIG. 3, the input image V1 is digitized by the image capture 3 and stored as an image signal S1 in the memory 41 of the image signal buffer 4 in the processing unit 6. However, in FIG. 3, the input image V <b> 1 itself is shown in the memory 41 for convenience of explanation. The image signal S1 stored in the memory 41 is converted by the microcomputer 5 and stored in the memory 42 provided in the image signal buffer 4 as the processed image signal S2. Although the processed image signal S2 is not yet visible, if it is visible, the foreground part 11 is projected on the upper half of the screen 10 and the background part 12 is projected on the lower half of the screen 10, as shown in FIG. The output image is V2. The output image V2 is processed so that continuity of the image is maintained at each end.
In FIG. 3, for convenience of explanation, the output image V2 itself is shown in the figure of the memory 42.

The setting circuit 7 previously stores the foreground viewpoint PF
Corresponding to the processed image signal S2, that is, the center of the lower half of the upper half of the output image V2. When the foreground viewpoint PF is determined, the foreground viewpoint PB is automatically set by the microcomputer 5 so as to correspond to the center of the lower side of the output image V2. Also, the output image V2
Horizontal axis X of. The vertical axis Y and the horizontal axis x and the vertical axis y of the input image V1 are set to correspond to each other. Further, the output image V2
And the left end point f in the lower half of the lower half of the input image V1 that is in contact with the upper and lower lines Q.
1 is made to correspond. At the same time, the upper left point B1 in the lower half of the output image V2 and the left end point b1 in the upper half of the input image V1 that are in contact with the line Q are associated with each other. These points F
1, B1, f1, and b1 are the foreground viewpoint PF and the background viewpoint P, respectively.
It is determined by the direction cosine seen from B. The setting of the setting conditions is performed by monitoring the input image V1.

Next, a configuration for converting the input image V1 into an output image V2 will be described. The processing circuit 6 samples the color information signal using the point f1 of the image signal S1 stored in the memory 41 as a sampling point, and transcribes the point F1 of the memory 42 as a display point. After the transfer, the color information signal is sampled using the point f2 adjacent to the point f1 as the sampling point, and the point F2 in the memory 42 is transcribed as the display point. Thereafter, the transcribing is continuously performed in the horizontal direction in order, and if the point fn of the memory 41 is set as a sampling point, the color information signal is collected, and the transcription is performed using the point Fn of the memory 42 as a display point. . Then, the entire foreground portion 11 is transcribed. Thereafter, the point b1 stored in the memory 41 of the foreground part 12 is used as a sampling point, and the color information signal is collected.
The point B1 in the memory 42 is transcribed as a display point. After the transfer, the color information signal is collected using the point b2 adjacent to the point b1 as a sampling point, and the point B2 of the memory 42 is transcribed as a display point. Less than,
The transfer is continued in the horizontal direction in order, and the color information signal is collected using the point bn of the memory 41 as a sampling point, and the transfer is performed using the point B2 of the memory 42 as a display point. When the transfer of one frame is completed, the processed image signal S2 of one frame is displayed on the display monitor 9 via the display driver 8.
To be projected on the screen 10 as an output image V2. In this frame, foreground part 11
, The right end of the foreground part 12, the left end of the foreground part 11, and the left end of the foreground part 12 are processed so as to have continuity in the image.

Reference numeral 13 denotes a filter provided between the memory 41 and the memory 42 for obtaining a processed image signal S2 from which noise components have been removed.

As described above, when one frame is transcribed, the next one frame is transcribed, and so on. Therefore, a moving image is continuously projected on the screen 10.

The processing method in the first embodiment of the present invention will be described with reference to FIG. First, in step 20, the setting circuit 7 sets processing conditions such as the foreground viewpoint PF and sampling point described above in the processing circuit 6. Here, the foreground viewpoint PB is the foreground viewpoint PB as described above.
When F is determined, the microcomputer 5 automatically sets it at a predetermined position. Next, in step 21, the input image signal V1 is fetched. Next, at step 22, sampling points f1, f of the image signal S1 by the processing circuit 6 are obtained.
2,... Fn..., B1, b2,.
.., B1, B2,... Bn,..., And a processed image signal S2 is obtained. In step 23, the processed image signal S2 is projected on the screen 10 of the image monitor 9 for each frame. The input image V1 is processed in the following order and the screen 1 is processed.
0 is projected as a continuous image.

According to the first embodiment of the present invention described above,
The input image V1 in which the car overtakes the right side of the observer is projected while the car continuously moves from the right end of the foreground part 11 to the right end of the foreground part 11. Therefore, it is possible to observe the moving state without overlooking without discomfort.

FIGS. 6 and 7 show a second embodiment of the present invention.
It will be described based on. As shown in FIG. 6, the output signal V2 overlaps the image at each end of the foreground portion 11 and the background portion 12, respectively. This overlap reduces the likelihood of the observer overlooking the movement of the image at the end of the field of view. The method is such that the display point F1 whose setting by the setting circuit 7 corresponds to the upper left end of the foreground part 11 in the output image V2 is set to the position above the line Q and the sampling point f1 to the left of the background part 12 in the input image V1. Make it correspond. On the other hand, a display point Fz corresponding to the upper right end of the foreground portion 11 in the output image V2 is set to the foreground portion 12 in the input image V1.
At the right end of the line above the line Q, corresponding to the sampling point fz.
Hereinafter, similarly, the sampling point is set for the background portion 12 of the output image V2 over the line Q. In this manner, in one frame, the edges of the foreground portion 11 and the background portion 12 are overlapped images that are double-collected and displayed. Of course, the output image V2 is slightly reduced in the horizontal direction as compared with the case of the first embodiment of the present invention described above, but this is not a problem in practical use.

Therefore, according to the second embodiment of the present invention,
As shown in the output image V2 of FIG. 7, for example, the foreground of the automobile 15 is projected at each end. Therefore, there is an advantage that the observer does not overlook.

[0020]

[Modification] As a first modification of the present invention, as shown in FIG.
A movie camera 2 with a mark is attached, and a monitor 9 is mounted on the driver's seat.
The driver can recognize the foreground portion 11 and the background portion 12 on the monitor 9 at a glance. As described above, the overtaking car 15 can be continuously recognized from the foreground portion 12 to the foreground portion 11 without blind spots. In particular, car 1
In the case of a military armored vehicle, not limited to 6, and running at a low height, if only the camera 2 is provided to protrude upward, there is an advantage that everything from the front to the back can be recognized at a glance on the monitor 9 in the vehicle. . Also, as shown in FIG.
Alternatively, an image without blind spots may be obtained on the entire circumference of the automobile 16 using the hyperboloid mirror 17.

The second modification of the present invention is suitably applied to a remotely operated robot device used for handling dangerous materials, civil engineering work and the like. Conventionally, the user has to change the direction of the camera to photograph and observe a necessary part. However, the operator, who is the observer, simultaneously projects the input image V1 captured by the camera 2 with the fisheye lens 1 provided on the robot on the screen 10 by dividing the foreground portion 11 and the background portion 12 into upper and lower portions. You can glance. Therefore, the work can be performed while always observing the surrounding work environment, so that it is possible to immediately respond to a sudden change in the situation. Therefore, the operation of the robot device can be quickly and easily performed.

As a third modification of the present invention, the image may be a still image instead of a moving image. Examples of this application include:
By projecting the foreground and the background seen from the house on the screen at the time of sale of the house, etc., the information can be provided to the customer.

As a fourth modification of the present invention, the foreground portion 11 may be projected downward and the background portion 12 may be projected upward on the screen 10. The projection means may be a method of directly displaying the image on a display using a cathode ray tube, a liquid crystal, or the like, or a method of projecting and displaying the image on a screen by a projector.

[0024]

According to the present invention, according to the first and third aspects, the observer projects the foreground portion and the background portion on a single screen arranged in front, so that the entire range can be obtained by observing only the front. Can be observed. Then, since the continuity of the foreground portion and the foreground portion is maintained, it is possible to provide an image projection apparatus and method capable of actually grasping a positional relationship with a moving object, for example, when there is a moving object.

According to claims 2 and 4, the present invention relates to a device comprising:
Since the foreground portion and the foreground portion are switched in the range of 0 degrees, the image projection device and method can provide an image recognition that is close to the actual one because it corresponds to a field of view close to 180 degrees of the observer.

According to the fifth aspect of the present invention, since the image is projected twice at each end of the foreground portion and the background portion, an image which is not overlooked at the end of the field of view of the observer is provided. A projection method can be provided.

[0027]

[Brief description of the drawings]

FIG. 1 is a block diagram showing a first embodiment of an image projection apparatus according to the present invention.

FIG. 2 is an explanatory diagram showing an input image in the first embodiment of the image projection device of the present invention.

FIG. 3 is an explanatory diagram showing details of a processing circuit in the first embodiment of the image projection apparatus of the present invention.

FIG. 4 is an explanatory diagram showing an output image in the first embodiment of the image projection device of the present invention.

FIG. 5 is a flowchart showing an image projection method in the first embodiment of the image projection apparatus of the present invention.

FIG. 6 is an explanatory diagram showing an input image in a second embodiment of the image projection method of the present invention.

FIG. 7 is an explanatory diagram showing an output image in a second embodiment of the image projection method of the present invention.

FIG. 8 is an explanatory diagram showing a first modified example of the present invention.

FIG. 9 is an explanatory view showing a second modified example of the present invention.

[Explanation of symbols]

REFERENCE SIGNS LIST 1 fisheye lens 2 movie camera 3 image signal capture forming capture means 4 image signal buffer 5 microcomputer 6 processing circuit forming processing means 7 setting circuit forming setting means 8 display driver 9 image monitor 10 screen 11 foreground part 12 Foreground part 41 Memory 42 Memory S1 Image signal S2 Processed image signal V1 Input image V2 Output image PF Foreground viewpoint PB Foreground viewpoint F1, F2, Fn Display point f1, f2, fn Sampling point

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C022 AA04 AB68 AC01 AC69 5C054 AA01 CC00 CH01 EA01 EA05 FA00 FE18 HA30 5C082 AA12 BA20 BA42 CA21 CA54 CA55 MM10

Claims (5)

[Claims] An image signal for capturing an image of the entire range from the foreground to the background with an observer as a center; and dividing the image signal into a foreground part and a background part. The foreground part and the foreground part are arranged vertically on a screen arranged in front of the user, and the right end of the foreground part, the right end of the foreground part, the left end of the foreground part and the foreground on the screen Image processing means for processing the left and right ends of the foreground portion so as to correspond to the foreground portion so that the image has continuity with the left end of the portion. apparatus. 2. The image projection apparatus according to claim 1, wherein said processing means is configured to set the foreground portion and the foreground portion in a range of about 180 degrees, which is a half of the entire range. apparatus. 3. An image obtained by photographing the entire range from the foreground to the foreground around the observer as an image signal, dividing the image signal into a foreground portion and a foreground portion, and arranging the image signal in front of the observer. The foreground part and the foreground part are vertically distributed on the screen, and the right end of the foreground part, the right end of the foreground part, the left end of the foreground part, and the left end of the foreground part on the screen. An image projection method, wherein processing is performed such that the right and left ends of the foreground portion correspond to the foreground portion so that the image has continuity. 4. The image projection method according to claim 3, wherein the foreground portion and the foreground portion are set to a range of about 180 degrees obtained by bisecting the entire range. 5. The foreground part and the foreground part divide the entire range into two, but independently capture images in a range of 180 ° or more, respectively.
4. The image processing method according to claim 3, wherein processing is performed such that an image is double projected at each end of the foreground part and the background part.