JP2002140715A - Multi-screen composition system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a multi-screen composition system for a virtual reality technology applying device provided with a function for easily and effectively processing the joint part of partial projected videos. SOLUTION: The system is provided with a plurality of VR video generating/ plotting devices 10 for generating VR videos which are to be projected on a common screen for every allocated part and outputting them as video signals, a plotting instructing part 40 for supplying camera position information with a synchronizing signal, a VR space data storing part 30 for supplying modeling data of a three-dimensional object, and projectors 20 whose number is similar to that of the VR video generating/plotting devices. The VR video generating/ plotting device 10 holds virtual object data for suppressing the joint. At the time of operating and generating a VR image, it is operated by including virtual object data. Thus, one VR video is obtained so that a difference in level due to the difference of luminance between adjacent partial picture videos when the video is projected on the common screen does not become conspicuous.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a high-resolution digital three-dimensional computer graphic image that is divided and projected onto a common large screen by using a plurality of projectors, and as a whole, one projection image is obtained. The present invention relates to a multi-screen combining system that can easily suppress a step of a joint between projection images with respect to a system that presents two images. Such a system is considered to be used in various fields as a large-sized display system using virtual reality technology.

[0002]

2. Description of the Related Art In such a multi-screen synthesizing system, each partial projection image is projected such that an adjacent partial projection image and an edge portion overlap, but in this overlapping portion, luminance is suppressed and uncomfortable feeling is obtained. Instead, it is necessary to display the image as a single image. Conventionally, a dedicated device for adjusting the luminance of an overlapping portion has been provided in a projector device for displaying individual divided images, and a step at an electrically or optically connected portion has been suppressed.

[0003]

In the case of the above-mentioned method, since it is a dedicated device, it is very expensive. In addition, there is a problem that it is large, poor in portability, and requires a long adjustment time. The present invention has been made in view of such a problem, and has a multi-screen synthesis system for a virtual reality technology application apparatus having a function of easily and effectively processing a joint portion of a partial projection image. The task is to provide

[0004]

Accordingly, a first aspect of the present invention is a plurality of VRs for generating a virtual reality image to be projected on one large common screen for each assigned part and outputting the generated VR signal as a video signal. An image generation / drawing apparatus, a drawing instruction unit that generates camera position information in response to an input from an operator, and supplies camera position information together with a synchronization signal to the VR image generation / drawing apparatus; A VR space data storage unit that supplies modeling data of a three-dimensional object, and a video signal output from one of the VR video generation / drawing apparatuses is input, and is adjacent to the allocated portion of the common screen as a partial screen video. Project with overlapping with other partial screen images,
In a virtual reality video multi-screen synthesis system configured by the same number of projectors as the VR video generation / drawing device, each of the VR video generation / drawing devices holds virtual object data for joint suppression, By calculating the virtual reality image by including this virtual object data at the time of calculation and generation, one step is prevented so that a step due to a difference in luminance between adjacent partial screen images when projected on a common screen is inconspicuous. A multi-screen synthesis system characterized in that a virtual reality video can be obtained. The above-mentioned problem is solved by the multi-screen synthesis system.

In a more preferred aspect of the present invention, the virtual object data for joint suppression is a plurality of rectangular object data covering a portion where the partial screen video overlaps, and is close to the center of the corresponding partial screen area. The first aspect in which the object has a distribution of transmittance that continuously changes from 1.0 to 0.0 from a portion to an edge portion and is defined as an object having a color defined by R = G = B = 0 uniformly 2 is a multi-screen synthesis system.

In another preferred aspect of the present invention, the virtual object data for joint suppression is rectangular object data having the same size as one partial screen area and does not overlap with another partial screen area. The transmittance of the portion is 1.0, and the portion overlapping with the other partial screen area has a transmittance distribution that continuously changes from 1.0 near the center to the edge from the portion near the center, and R = G uniformly The multi-screen combining system according to the first aspect, wherein the object is defined as an object having a color defined by = B = 0.

[0007]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is an overall configuration diagram of a multi-screen synthesis system according to an embodiment of the present invention. 5
0 is a screen. The plurality of projectors 20 project partial images respectively assigned to the screen 50.
The projector 20 uses a commercially available liquid crystal projector that emits a projected image to be projected on a screen according to an input image signal. The projectors 20 are required by the number of divisions of the entire screen. Reference numeral 10 denotes a VR video generation / drawing apparatus. One VR image generation / drawing apparatus 10 for one projector 20
Supplies a video signal. The VR video generation / drawing apparatus 10
A VR space rendering unit 101 that calculates a three-dimensional image viewed from a camera position based on VR space data, a joint suppression data arrangement unit 102, and a camera division information storage unit 103 are provided. Reference numeral 30 denotes a VR space data storage unit. VR
Model data of various objects in the space are stored, and the VR video generation / drawing apparatus 10 extracts data necessary for calculating a three-dimensional image from the VR space data storage unit 30.

Reference numeral 40 denotes a drawing instruction unit that supplies camera position information to the VR video generation / drawing apparatus 10. The signal obtained from the camera movement information input unit 41 is converted into camera position information and supplied to each VR video generation / drawing device 10. Reference numeral 42 denotes a camera initial position setting unit. The camera initial position setting unit 42
As shown in FIG. 2, camera initial information (camera viewpoint, camera gazing point, view angle <CX / CY>, view angle) at the time of startup is set. The camera movement information input unit 41 generates a signal for calculating camera movement information (camera viewpoint movement amount, camera fixation point movement amount). Actually, the drawing instruction unit 40, the camera movement information input unit 41, and the camera initial position setting unit 42 can be configured by a computer main body, a mouse, a joystick, a keyboard, and the like. The drawing instruction unit 40 is realized by activating a control program provided in the computer main body.

This control program reads the camera movement signal obtained from the camera movement information input section 41 at a predetermined time interval, and reads this signal and the camera initial position setting section 42.
The current camera position information is repeatedly calculated from the initial camera position information set in (1), and the camera position information is transmitted to each VR video generation / drawing apparatus 10 together with a synchronization signal. The VR space drawing unit 101 of each VR video generation / drawing apparatus 10 performs a rendering calculation of a three-dimensional image based on the current camera position information in accordance with the synchronization signal.

[0010] The camera division information storage unit 103 stores camera division information (upper left <LX,
TY>, lower right <RX, BY> position) are stored. FIG. 3 shows this state. The upper left <LX, TY> and lower right <RX, BY> positions of the drawing area are provided so that the entire display area can be divided by a plurality of VR video generation / drawing units. FIG. 4A shows an example in which one screen is divided into nine partial projection images. In the drawing, VR1, VR2,... Indicate partial areas assigned to the respective VR video generation / drawing apparatuses VR1, VR2,. FIG. 4B shows an overlap region according to this division example.

[0011] The camera division information includes a position to be divided and displayed, and
It depends on the overlap width of the seam, the resolution (number of pixels) that each screen projection unit can display, and the resolution that is finally displayed,
It is calculated by the following equation, Equation 1.

[Equation 1] LX = (Ex-Ox) x (Xcount? 1) However, if LX <0, LX = 0 RX = (Ex-Ox) x (Xcount? 1) + Ex? 1 However, when RX> = CX, RX = CX-1 TY = (Ey-Oy) x (Ycount? 1) However, when TY <0, TY = 0 BY = (Ey-Oy) x (Ycount? 1) + Ey? 1 However, if BY> = CY, BY = CY-1 where Ex: X size that each screen projection unit can display Xcount: Position in the X direction that this screen projection unit covers (number from left) CX: X direction Display resolution Ox: Overlap width in X direction Ycount: Position in Y direction (number from the top) covered by this screen projection unit CY: Display resolution in X direction Oy: Overlap width in Y direction Ey: Displayed by each screen projection unit Possible Y size

The sizes Ox and Oy of the overlapping portions of the joints
Is calculated by the following equation, Expression 2.

Ox = (Ex x Xs-CX) / (Xs-1) Oy = (Ey x Ys-CY) / (Ys-1) where Xs: number of divisions in X direction Ys: number of divisions in Y direction

The joint suppressing data arranging unit 102 stores the size, position information, and transparency of a plate shape arranged at the front end of the camera in order to suppress joints of the divided images. For example, as shown in FIG.
As shown in FIG. 5, four plate shapes are arranged along the four sides of the VR image generation / drawing apparatus 10 (VR5) among the projection surfaces. In addition, the VR video generation / drawing apparatus 10
As for (VR9), as shown in FIG. 6, two plate shapes are arranged on the left and upper sides. In addition, the brightness (color) of the plate shape for suppressing the joint is usually set to R = 0, G = 0, B = 0, and the transmittance is usually set from 1.0 to 0.0 from the inside to the outside as shown in FIG. Set to be the value of.

The VR space drawing unit 101 includes a drawing instruction unit 40
From the VR space data storage unit 30, the VR space data and camera division information from the camera division information storage unit 103, and the camera with the transparency stored in the joint suppression data arrangement unit 102. The board shape data is read, and a VR image is drawn in a form accompanied by the joint suppression processing. 8 and 9 are diagrams illustrating the effect of the joint suppression processing. FIG. 9 shows a case in which the joint suppression processing is not performed. FIG. 8 shows an image projected from the projector 20 in charge of the partial image of the VR5 in FIG. It is shown that the end portion is gradually darkened by the joint suppression processing. As shown in FIG. 8, the brightness decreases to 0 as the seam goes outward.
Since the adjacent part is synthesized on the display unit described later, the joint part is displayed as a result with no step.

The VR space data storage section 30 stores shape data, texture data, and write data for defining a VR space. FIG. 10 is a diagram illustrating shape data of one object (cube). The shape data is composed of a vertex table that defines the coordinates of the vertices and a surface table that describes the relationship between the surface and the vertices, and gives a graphic definition of the object in the VR space. The texture data is an attribute value of a color of each surface in the shape data, and is an environment color:
Ra, Ga, Ba, diffuse color: Rd, Gd, Bd, specular color: Rs, Gs, Bs, specular coefficient: S. The light data includes the three-dimensional position (X, Y, Z) and direction (NX, NY, N) of the light source placed in the VR space.
Z), intensity, and color (R, G, B). VR space data storage unit 3
In 0, the shape data and texture data of all the objects constituting the virtual space and the light data of all the light sources arranged in the virtual space are stored.

The screen 50 displays an image projected from the screen projection unit. FIG. 11 shows the output states of the screen projection units of VR4, VR5, and VR6 in FIG. 4, and FIG. 12 shows the luminance state of the projection result on the screen 50.

FIG. 13 is a flowchart for explaining the processing flow of the present multi-screen composition system. The flow of processing will be described with reference to FIG. 13 by taking as an example a case where a high resolution VR video of 3600 pixels × 2832 pixels is divided and displayed by nine VR video generation / drawing apparatuses capable of displaying 1280 pixels × 1024 pixels.

First, nine projectors (such as projectors) are arranged in each of the areas divided into three in the X direction and three in the Y direction, and the display unit is arranged such that the joints overlap as shown in FIG. (S10). Next, a camera initial position is set as described below (S13). Camera viewpoint = <0.0,0.0,100.0>, camera fixation point = <0.0,0.0,
0.0> Angle of view = <3600/2832>, Viewing angle = 60 °

Next, the camera position division information of each of the nine screen projection units is calculated by Equations 1 and 2, and stored in the camera division information storage unit (S16). In this example, three VR image generation / drawing units having a resolution of 1280 pixels × 1024 pixels are used in the X direction and three units in the Y direction, a total of nine units, and a VR image of 3600 pixels × 2832 pixels is displayed. Is stored in the camera division information storage unit in each VR video generation / drawing unit.

The arrangement positions of the joint suppressing plate shapes in the nine screen projection units are set (S19). The arrangement position of the suppression plate shape is set as shown in FIG. 16 based on FIG. In the table of FIG. 16, sx and sy are the coordinates (sx, sy) of the upper left vertex of the plate shape, and ex and ey are the coordinates of the lower right vertex of the plate shape.
(ex, ey).

Next, based on an instruction from the drawing instruction unit 40, V
The R space data, the camera division information, and the joint suppression information are read, and the VR video from the current camera position is drawn by each of the VR space drawing devices VR1 to VR9 (S22). Here, the VR space drawing unit 101 of each VR space drawing device 10 uses the current camera position information sent from the drawing instruction unit 40 as shown in FIG.
5, each VR space drawing device 1
After conversion into virtual camera position information corresponding to 0, three-dimensional image rendering calculation is performed. Note that the drawing instruction unit 4
The drawing of the VR space based on the instruction of 0 is performed in order to operate the nine VR space drawing devices in synchronization.

At the timing of the next synchronizing signal, the drawing instruction unit 40 sends a camera viewpoint,
The movement amount of the fixation point is captured (S25). Drawing instruction unit 40
Calculates a new camera position based on the amount of movement of the viewpoint and gazing point of the camera captured in step S25 (S2
8).

The drawing instruction section 40 sends new camera position information to each VR space drawing apparatus 10 together with a synchronization signal. Each VR space drawing unit 101 of the nine VR video generation / drawing apparatuses 10 draws a new VR video (S31). In accordance with the cycle of the synchronization signal, the above steps S25 to S3
Step 1 is repeated. Note that the synchronization signal is a start signal for performing a VR image drawing process from the instructed camera position. When the VR image generation / drawing apparatus 10 receives the synchronization signal, the VR image generation / drawing apparatus 10 converts the VR image from the instructed camera position into the VR image. Start drawing processing.

The operation of the multi-screen composition system 1 has been described above. In the flow of FIG. 13, steps S22 and S31
By including the virtual plate-shaped object shown in FIGS. 5 to 7 in the rendering calculation, the maximum luminance level of the overlapping portion is equal to the maximum luminance level of the non-overlapping portion as shown in FIG. And the effect of making the difference between the maximum luminances of the adjacent projected images gentle at the overlapping portion is obtained, and as a result, it is possible to project the screen 50 so that the steps are not conspicuous. this is,
At any point e on the overlapped portion, the sum of the transmissivities for the two partial screen images (VR4 and VR5 in FIG. 12) is always approximately 1, and the luminance at this point e is
At the boundary of the overlapped portion (each point of a, b, c, and d in FIG. 12), the transmittance for the partial screen image including the boundary is 1.0, so that the brightness of each point of a, b, c, and d matches. Because you do. As a virtual object for suppressing joints, a virtual object other than such a plate-shaped object can be used.

FIG. 14 is a view for explaining a case where a rectangular shape having the same size as the partial projection image is used on the front of the camera as a virtual object for joint suppression. FIG.
(A) shows that the color of this rectangular shape is R = 0, G = 0, B = 0 on one side, and FIG. 14 (B) shows the specification of the transmittance of the rectangular shape for VR5. ing. The transmittance of the rectangular shape is specified as 1.0 at the center and 0.0 toward the four sides.
However, the edges that do not overlap with other partial projection images have a transmittance of 1.
Set to 0. Therefore, the setting of the transmittance varies depending on the position of the assigned partial projection image. When the rectangular shape in FIG. 14 is used, the joint arrangement data arrangement data matches the camera division information. The effect when using this virtual object is the same as the effect obtained when using the plate shape.

[0026]

According to the prior art, it is necessary to attach a dedicated device for adjusting the brightness of an electrically or optically mechanically overlapping portion to each of the projectors 20, and to adjust each of them individually. On the other hand, in the multi-screen composition system 1, it is possible to easily obtain an image in which the luminance of the overlapping portion is adjusted only by setting appropriate data in the computer constituting the VR image generation / drawing apparatus 10. Moreover, since the multi-screen synthesis system 1 can be configured by a plurality of personal computers and a normal projector, it is possible to construct an inexpensive and portable virtual reality display system.

The display system for virtual reality is
Various applications are expected in the future, such as presentation systems for product introduction and sales support, computer games, archive data display systems in museums, etc., and visual product design systems. It is expected to greatly contribute to the realization of the system.

[Brief description of the drawings]

FIG. 1 is an overall configuration diagram of a multi-screen composition system 1 according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram of camera information.

FIG. 3 is an explanatory diagram of camera information.

FIG. 4 is an explanatory diagram of a partial screen area.

FIG. 5 is an explanatory diagram of plate shape data for joint suppression.

FIG. 6 is an explanatory diagram of plate shape data for joint suppression.

FIG. 7 is a diagram for explaining setting of transparency of plate shape data.

FIG. 8 is an example of a partial screen image that has undergone joint suppression processing.

FIG. 9 is an example of a partial screen image when no joint suppression processing is performed.

FIG. 10 is an explanatory diagram of shape data of an object.

FIG. 11 is a graph of the luminance level of each video signal of the partial video VR4, VR5, VR6.

FIG. 12 is a graph showing luminance on a screen when partial images VR4, VR5, and VR6 are combined and displayed.

FIG. 13 is an operation flowchart of the multi-screen composition system 1.

FIG. 14 is an explanatory diagram of partial screen shape data for joint suppression.

FIG. 15 is an explanatory diagram of camera position division information.

FIG. 16 is an arrangement position definition table of plate shape data for joint suppression.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Multi-screen synthesis system 10 VR image generation / drawing apparatus 20 Projector 30 VR space data storage unit 40 Drawing instruction unit 41 Camera movement information input unit 42 Camera initial position setting unit 50 Screen 101 VR space drawing unit 102 Data arrangement for joint suppression Unit 103 Camera division information storage unit

Claims (3)

[Claims] 1. A plurality of VR image generation / drawing apparatuses for generating a virtual reality image to be projected on one large common screen for each assigned portion and outputting the generated image as a video signal, and a camera receiving an input from an operator A drawing instruction unit that generates position information and supplies camera position information together with a synchronization signal to the VR video generation / drawing device; and a VR space data storage unit that supplies modeling data of a three-dimensional object to the VR video generation / drawing device And inputting a video signal output from one of the VR video generating / drawing apparatuses, and projecting the allocated portion of the common screen as a partial screen image so as to overlap with another adjacent partial screen image. , A VR image generation / drawing device and the same number of projectors Each of the VR image generation / drawing apparatuses holds virtual object data for joint suppression, and performs calculation including the virtual object data when calculating and generating a virtual reality image. A multi-screen synthesis system characterized in that a single virtual reality image can be obtained so that a step due to a difference in luminance between adjacent partial screen images when projected on a virtual reality screen is inconspicuous. 2. A method according to claim 1, wherein the joint object suppression virtual object data is a plurality of rectangular object data covering a portion where the partial screen video overlaps, and is directed from a portion near the center of the corresponding partial screen region to an edge portion. 1.0 to 0.0
2. The multi-screen composition system according to claim 1, wherein the multi-screen composition system is defined as an object having a transmittance that gradually changes and having a color defined uniformly by R = G = B = 0. 3. The virtual object data for seam suppression is rectangular object data of the same size as one partial screen area, and the transparency of a part that does not overlap with another partial screen area is 1.0. The part that overlaps with the partial screen area is 1.0% from the part near the center to the edge part.
2. The multi-screen composition system according to claim 1, wherein the object is defined as an object having a color distribution defined by R = G = B = 0 and having a distribution of transmittance that gradually changes from 0 to 0.0.