JP2004012477A - Whole circumference video forming and displaying system and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a whole circumference video forming and displaying system which has a simple constitution, the entirety of which can be small-sized, and which can easily and three-dimensionally display a display object by whole circumference display on a tubular surface or the like, and to provide a method thereof. <P>SOLUTION: The whole circumference video image displaying system 1 for displaying the display video of an object on a 360 degree type screen 9 having an arbitrary rotating body shape comprises a video conversion section 3 for conversion from a two-dimensional development on an inputted display video displayed on the 360 degree type screen at a previously set conversion rate to a two-dimensional intermediate video which becomes the origin of the display video, a video projection section 4 which projects the two-dimensional intermediate image obtained in the video conversion section as projection light on the 360 degree type screen side, a catoptric system 5 which reflects the projected light from the video projection section in such a way as to guide the light into the 360 degree type screen, and a display optical system 6 which projects the projected light from the catoptric system on the surface of the 360 degree type screen and displays it as the above display video. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a full-circle image drawing apparatus and method capable of displaying a three-dimensional image on a full-circle screen arranged over 360 degrees.
[0002]
[Prior art]
Conventionally, as a method of displaying an object three-dimensionally over 360 degrees, the object reflected by applying laser light or the like to the object using interference or diffraction is recorded on a film in the form of interference fringes, and Holography that can reproduce a three-dimensional image by illuminating a recorded film with light is known. Further, there is known an advertising electronic bulletin board for displaying on a cylindrical display instead of a flat display.
[0003]
This advertising light board has a vertically arranged light emitting LED, a rotating mechanism for rotating the light emitting LED, a control mechanism for controlling and changing the light of the light emitting LED with respect to the rotation speed of the rotating mechanism. By rotating the light at high speed by a rotating mechanism while changing the color of the light of the light-emitting LED by a control mechanism, an image is drawn on a cylindrical display using an afterimage of a human eye.
[0004]
[Problems to be solved by the invention]
However, in the conventional stereoscopic video display means, further improvements as described below have been desired.
In holography for generating a three-dimensional image, a device is complicated and large, and a viewpoint for viewing an object is limited. Therefore, a configuration in which the restriction on the viewpoint is eased has been desired.
[0005]
In addition, in the above-described advertising electronic bulletin board, the size of the light-emitting LED is large when one pixel of the projector is used, and furthermore, since the row of light-emitting LEDs is physically rotated at a high speed, the device as a whole is large. Therefore, a device having a configuration that can be used on a desk or the like because of a device of a meter order has been desired.
[0006]
The present invention has been made in view of the above-described problems, and has a simple configuration and can be miniaturized as a whole. Further, a three-dimensional representation of a display object can be easily performed by displaying the entire circumference of a cylindrical surface or the like. It is an object of the present invention to provide an all-around image rendering apparatus and a method therefor.
[0007]
[Means for Solving the Problems]
The omnidirectional image drawing apparatus according to the present invention has the following configuration to achieve the above object. That is, an all-around image rendering apparatus for displaying a display image of an object on an all-around screen having an arbitrary rotating body shape, and a two-dimensional development view of the input display image displayed on the all-around screen A video conversion unit that converts the display video into a two-dimensional intermediate image that is the basis of the display video according to a preset conversion rate; and the two-dimensional intermediate image obtained by the video conversion unit An image projection unit that projects the projection light of the image projection unit, and a reflection optical system that reflects the projection light of the image projection unit so as to be guided into the full-circle screen, and reflects the reflected light from the reflection optical system onto the full-circle screen surface. A display optical system for projecting and displaying the display image.
[0008]
With this configuration, the full-circle video drawing device inputs a two-dimensional development view of a display video to be displayed on the full-circle screen by the input unit, and the video conversion unit sets the conversion formula set in advance. Thus, the display image is converted into a two-dimensional intermediate image for display. Therefore, when the image projection unit projects projection light for displaying an image based on the image data sent from the image conversion unit, the image projection unit emits a screen image through the reflection optical system and the display optical system. It is possible to display the display image on the screen. The conversion equation set in advance is obtained, for example, by measuring in advance how the image of the projected light projected from the video projection unit is on the full-circumferential screen, and determining the position of the original point. The formula is set using a value that represents the positional relationship between points and points on the entire screen by a ratio.
[0009]
In the omnidirectional image drawing apparatus, the display optical system may be a rotating body reflecting mirror formed of a rotating body about the optical axis of the projection light of the image projection unit, and the display optical system Is a rotator lens composed of a rotator about the optical axis of the projection light of the video projection unit.
[0010]
With this configuration, in the omnidirectional image drawing device, when the display optical system is a rotating body reflecting mirror, the reflected light reflected from the reflecting optical system toward the inside of the omnidirectional screen is omnidirectional. The rotating body reflecting mirror is arranged at a position where it can be displayed as a display image on the inner surface of the screen.
In the case of a rotating lens, a rotating lens is installed immediately above a reflection optical system that enters the entire screen, and a display image is displayed on the entire screen by projection light transmitted through the rotating lens. In the case of a rotating lens, it is convenient to use a fisheye lens. The orientation of the rotating lens mirror or the rotating lens is such that the reflecting surface or the irradiation surface is perpendicular to the reflected light from the reflecting optical system.
[0011]
Further, in the full-circle image drawing apparatus, the full-circle screen is formed by cutting a cylindrical body and a sphere at a horizontal plane which is a device installation surface, as the rotating body shape around the optical axis of the projection light of the image projection unit. Traversing spherical rotator, horizontal elliptical rotator formed by cutting in the horizontal direction with the straight line connecting the two focal points of the ellipse as the vertical direction, and hyperboloid rotator having the convex surface inside or outside , A paraboloid of revolution, or a conical rotator.
[0012]
With this configuration, the omnidirectional image drawing apparatus can be configured such that the omnidirectional screen has an arbitrary rotator shape, in particular, a cylindrical body, a transverse sphere rotator, a transverse ellipsoidal rotator, a hyperboloid rotator, In the case of one of the object-surface rotator and the conical-surface rotator, the display surface has no shadow, and it is easy to focus.
[0013]
Further, an all-around image rendering method according to the present invention is an all-around image rendering method for displaying a display image of an object on an all-around screen having an arbitrary rotating body shape, and is displayed on the all-around screen. A step of inputting a two-dimensional development view of the display video, and a step of converting the input two-dimensional development view into a two-dimensional intermediate image that is a source of the display video by a predetermined conversion formula. Projecting the obtained two-dimensional intermediate image as projection light on the peripheral screen, reflecting the projected light into the peripheral screen, and displaying the projected light on the peripheral screen. And displaying the image as a video.
[0014]
In this way, in the full-circle image drawing method, first, a two-dimensional development diagram for the display image displayed on the full-circle screen is input, and the display image of the full-circle screen is obtained from the two-dimensional development diagram. The two-dimensional intermediate image is obtained by conversion using a predetermined conversion equation. Then, the obtained two-dimensional intermediate image is sent to a video projection unit as a video signal, and based on the video signal, the video projection unit projects a display video on an all-around screen via a reflection optical system and a display optical system. it's shown.
[0015]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. The present invention is not limited by this embodiment.
FIG. 1 is a block diagram schematically showing the entire omnidirectional image drawing device, FIG. 2A is a plan view showing a two-dimensional development diagram showing an example used in the omnidirectional image drawing device, and FIG. (a) is a plan view showing a two-dimensional intermediate image, (c) is a plan view showing a two-dimensional intermediate image in a state in which the aspect ratio of one pixel of a liquid crystal in a liquid crystal projector of a video projector is further taken into account from (b), FIG. 3 is a flowchart showing each process of the full-circle image drawing apparatus. FIGS. 4 (a) to 4 (d) are a perspective view and a plan view showing a two-dimensional intermediate image projected on the full-circle screen and a corresponding display image. .
[0016]
As shown in FIG. 1, an omnidirectional image drawing device 1 includes an input unit 2 for inputting a two-dimensional developed view, and an image to be converted from the two-dimensional developed view input by the input unit 2 into a two-dimensional intermediate image. A conversion unit 3; a video projection unit 4 for projecting projection light based on image data sent from the video conversion unit 3; A reflecting mirror 5 as a reflecting optical system, a rotating reflecting mirror 6 as a display optical system for irradiating projection light reflected from the reflecting mirror 5 to the inner surface of the entire screen 9, and a rotating reflecting mirror And a peripheral screen 9 for displaying a display image by the reflected light from the light source 6.
[0017]
As shown in FIGS. 1 and 2, the input unit 2 is a color scanner device or an omnidirectional photographing camera capable of inputting an image such as a two-dimensional developed view M1, a moving image, and colors. Here, a two-dimensional development diagram is generated by software capable of generating or handling images and moving images input from a personal computer. Note that the input unit 2 may have a configuration in which it is not possible to particularly recognize colors.
[0018]
The video converting unit 3 converts the two-dimensional developed image M1 from the input unit 2 into a two-dimensional intermediate image M3 to be displayed as a display video on the full-circle screen 9 by using a predetermined conversion formula and generates the converted image. It is for doing.
[0019]
Here, as a preset conversion formula, here, the positional relationship of the image of the projection light projected from the video projection unit 4 on the full-circle screen 9 is measured in advance, and the proportional relationship is obtained. Formula is used. More specifically, as shown in FIG. 2A, in the state of the two-dimensional development M1, points A1, A2... An are displayed at a specific position with a set of points as a dotted line A, and each point A1 is displayed. , A2... An are projected on the full-circle screen 9 and converted by a conversion formula using a value expressed by a ratio to show how much each point a1, a2. A two-dimensional intermediate image M2 is obtained.
[0020]
The smaller the number of the dotted lines A1, A2,... An used here, the faster the conversion can be realized, and the more the number of the points, the more accurate the drawing. As shown in FIG. 2B, the converted two-dimensional intermediate image M2 shows the position of the center circle C1 and the position of the outermost circle C2 as non-display portions.
[0021]
Here, as shown in FIG. 2C, when the aspect ratio displayed by one pixel of the liquid crystal projector as the image projection unit 4 is different, the conversion formula is used so that the aspect ratio of the one pixel also corresponds. The two-dimensional developed image M1 is converted into a two-dimensional intermediate image M3 in a state where the two-dimensional image M1 is reflected and adjusted.
[0022]
As shown in FIGS. 2 (a) to 2 (c), since only a two-dimensional intermediate image M3 is converted from a two-dimensional development diagram M1 by a conversion formula set in advance, not only a still image, but also a moving image, one frame This conversion can be performed every time to display. The video conversion unit 3 can perform an operation to reverse the direction of the two-dimensional intermediate image M3. When the two-dimensional intermediate image M3 is generated by converting the measured position of each point using the conversion formula used, the two-dimensional intermediate image M3 is generated using a known linear interpolation method, image warping, or texture mapping. It is possible to do.
[0023]
The video projection unit 4 irradiates projection light corresponding to the two-dimensional intermediate image M3 with the image data sent from the video conversion unit 3, and here, the screen displayed on the personal computer is used as it is. A liquid crystal projector or the like that can project on the entire screen 9 is used. The image projection unit 4 is provided with a lens 4a for shortening the focal length, and is set so as to connect an image on a cylindrical surface in accordance with the size of the entire screen 9 by the lens 4a. I have. Further, it is preferable that the image projection unit 4 is set so as to use many pixels on an LCD surface (not shown).
[0024]
The reflection mirror 5 serving as a reflection optical system reflects the projection light projected from the image projection unit 4 from the center of the entire screen 9 to a rotating body reflection mirror 6 serving as a display optical system. Using a reflector. The shape of the reflection mirror 5 is not particularly limited, and may be a half mirror capable of transmitting infrared light of a predetermined wavelength in consideration of heat.
[0025]
The rotating body reflecting mirror 6 as a display optical system is for projecting (reflecting) the reflected light reflected from the reflecting mirror 5 so that a display image is displayed on the inner surface of the entire screen 9. The rotating body reflecting mirror 6 is installed at a position opposite to the reflecting mirror 5 arranged on one opening side in the vertical direction of the entire peripheral screen 9, and the projection light is projected over a wide area of the entire peripheral screen 9. Is reflected so that the display image is displayed on the entire circumference of the full-screen 9. The rotating body reflecting mirror 6 is formed as a rotating body about the optical axis of the projection light of the image projection unit 4, and the convex surface of the rotating body reflecting mirror 6 is arranged to face downward. It is formed as a shape of a transverse spherical rotator having a shape cut in the direction.
[0026]
The shape of the rotating body reflecting mirror 6 is not particularly limited as long as the rotating body is a rotating body centered on the optical axis of the projection light of the image projection unit 4, and for example, FIGS. 7A and 7B. (C), a transversal ellipsoidal rotator 6A and a conical rotator 6B (cone, truncated cone) formed by cutting from the horizontal direction with the linear direction connecting the two focal points of the ellipse as the vertical direction. The object surface rotator 6C or a hyperboloid rotator (not shown) may be used. The shape or size of the rotating body reflecting mirror 6 and the size of the entire screen 9 are set so that the display images MH1 and MH2 (see FIG. 4) can be appropriately displayed.
[0027]
The entire-circumference screen 9 is formed in an arbitrary rotating body shape, and is here formed in a cylindrical shape as the rotating body shape. The full-circumference screen 9 is configured as an inner transmission rear screen on which the display images MH1 and MH2 (see FIG. 4) can be recognized from the outside by the projection light from the rotating body reflection mirror 6 on the inner surface side. One of the formed portions is formed in an open cylindrical shape. In FIG. 1, the full-circle screen 9 is installed so as to introduce the projection light from directly below through the reflection mirror 5, but to introduce the incident light directly below through the reflection mirror 5 from above. It may be installed.
[0028]
As shown in FIG. 4, a support band 9 a for arranging a band-like surface is provided below the entire peripheral screen 9, and a lid 9 b for arranging a band-like surface on the side above the entire peripheral screen 9 is provided. It is good also as composition. An opening (not shown) is provided at a predetermined position of the support band 9a so that the projection light from the image projection unit 4 can enter the entire peripheral screen 9, and a reflection mirror is provided on the support band 9a. 5 may be supported, and the rotating body reflecting mirror 6 may be supported on the lid 9b.
[0029]
The shape of the entire-circumference screen 9 is not particularly limited as long as it has an arbitrary rotating body shape. For example, FIGS. 6 (a), (b), (c), (d), (e) ), The sphere is formed into a transverse spherical rotator 9A formed by cutting the sphere in the horizontal direction, or is formed by cutting the sphere in the horizontal direction with the linear direction connecting both the focal points of the ellipse being the vertical direction. A cross ellipsoidal rotator 9B, or a hyperboloidal rotator 9C with a convex curved surface inside (or outside) on the side surface, or a convex surface with a convex curved surface outside (or inside) on the side surface The object surface rotating body 9D may be used, or the conical surface rotating body 9E (cone, truncated cone) may be used.
[0030]
Further, as long as the entire peripheral screen 9 can be used as a transmission screen, for example, it can be formed of a material giving a simple impression such as Japanese paper. Further, the peripheral screen 9 may be made of a material such as glass or resin. If the peripheral screen 9 can be formed by fusing the material, mass production can be performed with high accuracy and is convenient.
[0031]
Next, the operation of the all-around image drawing apparatus 1 will be described.
In the omnidirectional image drawing apparatus 1, the omnidirectional screen 9 is installed on an installation table (not shown) having an opening, and the reflection mirror 5 is installed below the omnidirectional screen 9. Note that the rotating body reflecting mirror 5 is attached to the ceiling of the entire screen 9 in advance. The image projection unit 4 is installed at a position where the projection light can be projected on the reflection mirror 5 of the entire screen 9. Note that the entire-circumference image drawing apparatus 1 can be configured to have a size of 50 cm to 60 cm in total including the image projection unit 4.
[0032]
When the omnidirectional image drawing device 1 is installed, a two-dimensional development diagram M1 is input from the input unit 2 as shown in FIGS. 2A and 3 (S1). When the two-dimensional development M1 is input, image data is sent to the video conversion unit 3, and the two-dimensional intermediate image M2 shown in FIG. And further converted into a two-dimensional intermediate image M3 corresponding to the aspect ratio of one pixel displayed by the video projection unit 4 used (S2).
[0033]
When the two-dimensional intermediate image M3 is generated by the video conversion unit 3, the image data based on the two-dimensional intermediate image M3 is sent to the video projection unit 4 and projected as projection light in the omnidirectional video drawing device 1 ( S3) The display image MH1 (see FIG. 4A (see FIG. 4A)) is displayed on the entire screen 9 via the lens 4a, the reflection mirror 5, and the rotating body reflection mirror 6 (S4).
[0034]
As shown in FIG. 4A, in the full-circle image drawing device 1, when viewed from the front, the display image MH 1 displayed on the full-circle screen 9 is an image in front of the display image MH 1 (from the front of the puppy). When viewed from behind, a video from behind the display video MH1 (video from the tail of the puppy) can be recognized.
[0035]
In addition, the all-around video drawing device 1 can display not only a still image but also a moving image. For example, as shown in FIGS. 4A and 4B, in the omnidirectional image drawing device 1, two-dimensional intermediate images M3 and M4 continuously converted from the image conversion unit 3 are sent to the image projection unit 4, and By continuously projecting the projection light from the image projection unit 4, the display images MH1 and MH2 are continuously displayed on the entire-circumference screen 9, so that the images can be displayed as a moving image.
[0036]
Note that, as shown in FIG. 1, the omnidirectional image drawing apparatus 1 has been described as an example in which the rotating body reflection mirror 6 is used as the display optical system. However, as shown in FIG. 5, the rotating body lens 6 </ b> A is used as the display optical system. The configuration of may be adopted.
[0037]
That is, as shown in FIG. 5, the full-circle image rendering device 11 includes an input unit 2 for inputting a two-dimensional developed view, and a video conversion for converting the input two-dimensional developed view M1 to a two-dimensional intermediate image M3. Unit 3, a video projection unit 4 for projecting projection light based on the image data sent from the video conversion unit 3, and a projection unit 4 for reflecting the projection light from the video projection unit 4 into the full screen 9. A reflection mirror 5 as a reflection optical system, a rotator lens 6A as a display optical system for irradiating projection light reflected from the reflection mirror 5 onto a display surface (inner surface) of the entire-circumference screen 9, and a rotator And a full-screen 9 for displaying a display image by the projection light from the lens 6A. Here, as the rotating body lens 6A used in the all-around image rendering device 11, a fish-eye lens which is a rotating body about the optical axis of the projection light of the image projection unit 4 is used here.
[0038]
Then, in the omnidirectional image drawing device 11, the projection light from the image projection unit 4 is transmitted to the side of the omnidirectional screen 9 via the rotating lens 6 </ b> A by the image data sent from the input unit 2 via the image conversion unit 3. The image is appropriately projected on the inner surface, and the display images MH1 and MH2 are displayed on the entire peripheral screen 9. Of course, this all-around video drawing device 11 can display not only a still image but also a moving image as a display video. The image data sent from the video conversion unit 3 is different from the case shown in FIG. 1 and the image data in which the top and bottom are inverted is sent to the video projection unit 4 and projected as projection light.
[0039]
In addition, the full-circle image rendering devices 1 and 11 may have a configuration in which the full-circle screens 9A to 9E of each shape shown in FIG. 6 and the rotating body reflecting mirrors 6A to 6C of each shape shown in FIG. Can be installed. When appropriately combined, optical design items such as an optical path are adjusted so that the projected light is focused on the entire peripheral screen 9. Further, as long as the entire screen 9 and the rotating body reflection mirror 6 are rotating bodies, they may have other shapes than those shown in FIGS. Of course, the display image to be displayed is not particularly limited.
[0040]
【The invention's effect】
As described above, the omnidirectional image rendering apparatus according to the present invention has the following excellent effects.
The full-circle image drawing device can convert a two-dimensional development view into a two-dimensional intermediate image according to a predetermined conversion formula, and display a display image on a full-circle screen via a reflection optical system and a display optical system. It becomes possible. Therefore, it is possible to stereoscopically display a display image on a full-circumferential screen together with a moving image or a still image. The all-around image rendering apparatus can display a three-dimensional original image in a state of being reduced by 50% or more as compared with a conventional meter-order apparatus. Therefore, this all-around image rendering device is a device that displays a facial expression such as the face of an indoor robot, or a device that displays a three-dimensional image such as a three-dimensional movie as a display device for a virtual product or artwork. It can also be used as
[0041]
In the omnidirectional image drawing apparatus, the display optical system may be a rotating body reflecting mirror or may be a rotating body lens, and can flexibly cope with the setting of the optical path of the projection light.
[0042]
The full-circle image rendering device displays when the entire screen is one of a cylindrical body, a transverse spherical rotator, a transverse ellipsoidal rotator, a hyperboloid rotator, a paraboloid rotator, and a conical rotator. Adjustment of the focus of the image is facilitated, which is convenient.
[0043]
Further, in the full-circle image drawing method, the two-dimensional development view is converted into a two-dimensional intermediate image by a predetermined conversion formula, and the display image is displayed on the full-circle screen via the reflection optical system and the display optical system. Therefore, an image input from the input unit in advance can be displayed on a compact full-screen screen regardless of whether it is a moving image or a still image.
FIG. 1 is a block diagram schematically showing the entire omnidirectional image drawing apparatus according to the present invention.
FIG. 2A is a two-dimensional development view showing an example used in the omnidirectional image rendering apparatus according to the present invention, FIG. 2B is a plan view showing the two-dimensional intermediate image of FIG. 2A, and FIG. FIG. 4B is a plan view showing a two-dimensional intermediate image in a state in which the aspect ratio of one pixel of a liquid crystal in a liquid crystal projector of a video projection device is further taken into account from FIG.
FIG. 3 is a flowchart showing each process of an all-around image rendering apparatus according to the present invention.
FIGS. 4 (a), (b), (c), and (d) are a perspective view and a plan view showing a two-dimensional intermediate image projected on an all-round screen according to the present invention and a corresponding display image.
FIG. 5 is a block diagram schematically showing the whole of another embodiment of the all-round video rendering apparatus according to the present invention.
FIGS. 6 (a), (b), (c), (d), and (e) are perspective views showing another embodiment of the full-screen according to the present invention.
FIGS. 7 (a)), (b) and (c) are perspective views showing another embodiment of the reflection optical system according to the present invention.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Full-circle image drawing apparatus 2 Input part 3 Image conversion part 4 Image projection part 4a Lens 5 Reflection mirror (reflection optical system)
6. Rotating body reflection mirror (display optical system)
6A Rotating lens (display optical system)
9 All-around screen 9a Support band 9b Lid

Claims (5)

An all-around image rendering device for displaying a display image of an object on an all-around screen having an arbitrary rotating body shape,
A video conversion unit configured to convert a two-dimensional development view of the input display video displayed on the full-circle screen into a two-dimensional intermediate image that is a source of the display video by a predetermined conversion formula;
A video projection unit that projects the two-dimensional intermediate image obtained by the video conversion unit onto the entire screen as projection light;
A reflection optical system that reflects the projection light of the video projection unit so as to guide the projection light into the entire screen,
A display optical system for projecting the reflected light from the reflection optical system onto the entire screen surface to display the display image as the display image. 2. The apparatus according to claim 1, wherein the display optical system is a rotating body reflecting mirror formed of a rotating body about the optical axis of the projection light of the image projection unit. 3. 2. The apparatus according to claim 1, wherein the display optical system is a rotator lens including a rotator about an optical axis of light projected by the image projection unit. 3. The full-circle screen is a transverse spherical rotator formed by cutting a cylindrical body or a sphere at a horizontal plane that is a device installation surface, as the rotator shape when the optical axis of the projection light of the image projection unit is the center. , A cross-sectional ellipsoidal rotator formed by cutting in a horizontal direction with a linear direction connecting the two focal points of an ellipse as a vertical direction, a hyperboloid rotator having a convex surface inside or outside, a paraboloid rotator, and The full-circle image rendering apparatus according to any one of claims 1 to 3, wherein the apparatus is one of a conical surface rotator. An all-around image drawing method for displaying a display image of an object on an all-around screen having an arbitrary rotating body shape,
A step of inputting a two-dimensional development view of the display image displayed on the full-circle screen; and a two-dimensional intermediate image serving as a source of the display image based on the input two-dimensional development view by a conversion formula set in advance. Converting the image into an image, projecting the obtained two-dimensional intermediate image as projection light on the full-screen, and reflecting the projection light so as to guide the projection light into the full-screen. Displaying the display image on the entire screen surface as the display image.

Images