JP4492632B2 - Display device and image information generation method in display device - Google Patents

Description

The present invention relates to a display device that generates a high-luminance and high-resolution image using a plurality of projection-type image display devices, and an image information generation method in the display device.

In recent years, projection image display devices such as projectors have attracted attention. This projection type image display device is characterized by a very high degree of freedom in display, such as the size of the display screen, the brightness of the display screen, and the display on a curved surface. For example, it is possible to superimpose the projected images projected from the respective projection type image display devices on a screen by using a plurality of projection type image display devices, so that a larger screen and a higher definition image can be obtained. Can be produced.

Techniques for superimposing images on a screen using a plurality of projection-type image display devices can be roughly classified into three types: “tiling projection”, “stack projection”, and combinations thereof.
Tiling projection has the major feature of being able to produce high-brightness and high-resolution images on a large screen, almost in proportion to the number of projection-type image display devices used, but the image quality due to the conspicuous joints. There are also some problems such as color degradation due to deterioration of the image quality, color unevenness caused by individual differences in projectors used, and difficulty in displaying an image in time synchronization with high accuracy.

In addition, stack projection has the great feature of being able to produce high-brightness images, but it is difficult to produce high-resolution images and requires precise position control. Similar to ring projection, there is a problem that it is difficult to display an image in time synchronization with high accuracy.

A combination of tiling projection and stack projection also has the characteristics and problems described above. The combination of the tiling projection and the stack projection is not used so much as the tiling projection alone or the stack projection alone. However, for example, Patent Document 1 is one of them. is there.

FIG. 20 is a diagram showing a schematic configuration of Patent Document 1. A plurality of high-brightness and high-resolution projection type image display devices PJa, PJb, and PJc that handle each projection area and a low-brightness The projection type image display device PJd has a low resolution.

JP 2000-184317 A

By the way, these tiling projections, stack projections and combinations thereof are also
In principle, the shape of the projection area on the screen of each projection-type image display apparatus is a rectangle. This is because most of the currently used projection-type image display apparatuses have a rectangular projection area.

When creating one screen by combining such projection image display devices having a rectangular projection area, the projection area shape of the projection image display device is the original projection area shape of the projection image display device. It is desirable to project in a certain rectangle or a state close thereto.

For this reason, in most conventional projection forms using tiling projection, stack projection, or a combination thereof, the projection area projected from each projection type image display device as a component is generally rectangular. Also in Patent Document 1 described above, the projection area on the screen of each projection type image display apparatus is rectangular.

In this way, by setting the projection area projected from each projection image display apparatus to a rectangle that is the projection area shape inherent to each projection image display apparatus, each projection image display apparatus can determine which projection area each pixel has. There is an advantage that it is easy to calculate whether such a value should be allocated, but as a price, there is a problem that moire (interference fringes) is likely to occur particularly in the overlapping portion.

This moire is the original projected shape of a rectangular projection area,
Since the size and period of the pixels arranged in a square lattice are the same, due to interference between the pixels,
Moire is likely to occur.

The present invention makes it difficult for moire to occur in the overlapped portion when generating a single screen by superimposing projected images projected from each using a plurality of projection type image display devices on the screen,
An object of the present invention is to provide a display device capable of improving the quality of a projected image and an image information generation method in the display device.

(1) A display device of the present invention is a display device that displays a single screen using a plurality of projection type image display devices, and is provided on a screen of the plurality of projection type image display devices constituting the display device. The plurality of projection-type image display devices are arranged so that there is at most one projector whose projection shape is the original projection shape among the plurality of projection-type image display devices.

As a result, when so-called stack projection is performed, in which projection areas from the respective projection image display devices are overlapped on the screen, the size and period of the pixels on the screen of each projection image display device are made different. Therefore, the occurrence of moire can be suppressed by making it difficult to cause interference between pixels, thereby improving the quality of the projected image.

(2) In the display device according to (1), the projection shape inherent to each projection image display device is a rectangle, and there is at most one projector whose projection shape is a rectangle. In order to avoid this, it is preferable to arrange the plurality of projection type image display devices.

In this way, by originally distorting the original rectangular projection shape to a shape different from the rectangular shape, as described above, for example, when performing stack projection, each projection image display device The size and period of the pixels on the screen can be varied. As a result, it is difficult to cause interference between pixels, and the occurrence of moire can be suppressed.

(3) In the display device according to (1) or (2), each of the projection type image display devices may be configured so that a ratio between a maximum value and a minimum value of the luminance on the screen is a predetermined value or more. It is preferable to arrange the projection type image display apparatus with respect to the screen.

In this way, by arranging the ratio of the maximum value and the minimum value of the luminance on the screen of each projection type image display apparatus to be a predetermined value or more, interference between pixels is less likely to occur and moire is reduced. The effect which suppresses generation | occurrence | production can be acquired. The maximum and minimum luminance values on the screen are projected on the screen by giving the maximum luminance value that can be output to all pixels on the display device (liquid crystal panel, etc.) in each projection image display apparatus. The maximum value and the minimum value of the luminance obtained from the luminance distribution at the time of the above are indicated.

(4) In the display device according to (3), it is preferable that the ratio between the maximum value and the minimum value of the luminance is approximately twice or more the minimum value of the maximum luminance value.
As a result, it is possible to make the effect of suppressing the occurrence of moiré more unlikely to cause interference between pixels.

(5) In the display device according to any one of (1) to (4), a ratio between a maximum value and a minimum value of a projection area on the screen of pixels of each projection type image display device is a predetermined value. It is preferable to arrange the plurality of projection type image display devices so as to achieve the above.
As described above, even when the difference between the maximum value and the minimum value of the projection area on the screen of the pixels of each projection-type image display device is a predetermined value or more, interference between the pixels is less likely to occur. Thus, the effect of suppressing the generation of moire can be obtained.

(6) In the display device according to (5), the ratio between the maximum value and the minimum value of the projection area on the screen of the pixels of each projection-type image display device is such that the maximum value of the projection area is the minimum value. It is preferably approximately twice or more.
Also by this, the effect of suppressing the occurrence of moire by making it difficult to cause interference between pixels can be made more reliable.

(7) The display device of the present invention is a display device that displays one screen on a screen using at least the first and second projection type image display devices, and the first and second projection type image displays. The projection area on the screen of the apparatus is included in the overlapping area,
The pixel of the first projection type image display device corresponding to the position of the specific screen coordinate Ps is P1.
The pixel of the second projection type image display device corresponding to the position of the screen coordinate Ps is P2, the pixel P1 of the first projection type image display device, and at least one pixel P1 ′ adjacent to the pixel P1. The difference vector ΔP1 = (P1′−P1) on the screen is the difference vector ΔP2 on the screen between the pixel P2 of the first projection type image display device and the pixel P2 ′ adjacent to the pixel P2. = (P2'-P2), the projection type image display devices are arranged with respect to the screen.
According to this, the effect similar to the display apparatus as described in (1) is acquired. Further, according to (7), it is possible to provide an arrangement method capable of suppressing the occurrence of moire regardless of the original projection shape of the projector. The display device described in (7) also preferably has the characteristics of the display devices described in (3) to (6).

(8) The image information generation method in the display device of the present invention generates pixel information to be given to each projection type image display device constituting a display device that generates one screen on a screen using a plurality of projection type image display devices. A method of generating image information in a display device, the step of dividing the screen to generate a plurality of small areas, and for each small area obtained by the division, each projection type image display in the small area In order from the step of acquiring the resolution of the apparatus, and the projection type image display apparatus in which the resolution is low in each of the small areas,
Assigning a pixel value to a pixel of each projection type image display device corresponding to the small area.
Thereby, when realizing the display device described in (1), an optimal pixel value can be given to each pixel of each projection type image display device constituting the display device.

(9) In the image information generation method in the display device according to (8), the step of assigning the pixel value corresponds to the small area of the projection type image display device in which the resolution is low in each of the small areas. For each pixel to be given, a pixel value equal to or less than the pixel value of the pixel having the minimum pixel value among the desired pixel values to be displayed among the pixels on the screen in the small region is given, For each pixel corresponding to the small area of another projection type image display device, the difference between the pixel value given by the projection type image display device whose resolution is low and the desired pixel value It is preferable to provide a pixel value.

As a result, when stack projection is performed by a plurality of projection type image display devices, the pixel values for the pixels of the overlapping portion of each projection type image display device can be appropriately given, and the desired value to be displayed on the screen. Can be obtained.

(10) In the image information generation method in the display device according to (8) or (9), it is preferable that the pixel value is a luminance value.
Thereby, an appropriate luminance value can be given to each pixel of each projection type image display device.

(11) An image information generation method in a display device according to the present invention generates pixel information to be provided to each projection image display device constituting a display device that generates one screen on a screen using a plurality of projection image display devices. An image information generation method for a display device, wherein each pixel of each projection-type image display device at each coordinate on the screen can project an area that can be projected on the screen and a pixel value that can be output. An acquirable table is created, and based on the table, the pixel value of each pixel of each projection type image display device is obtained from image information to be displayed.
According to this, since an appropriate pixel value to be given to each pixel of each projection type image display device can be obtained by referring to the table, if the table is created, each projection type image display device can be overlaid. The pixel values for the partial pixels can be acquired appropriately and at high speed. This is particularly suitable for stack projection by a large number of projection type image display devices.

(12) In the image information generation method in the display device according to (11), the process of acquiring the pixel value of each pixel of each projection image display device from the image information to be displayed based on the table When the pixel value of a certain projection-type image display device obtained by the table does not satisfy a desired pixel value, the projection type has a pixel with a larger pixel value located in the periphery of the table. It is preferable to give a pixel value that satisfies the desired pixel value to the image display device.
Thus, when stack projection is performed by a plurality of projection type image display devices, pixel values for pixels in the overlapping portion of each projection type image display device can be appropriately given, and desired pixels on the screen. A value can be obtained.

(13) In the image information generation method in the display device according to (12), a pixel value given to a projection type image display device having pixels having a larger pixel value is the pixel value to be displayed. It is preferable that the pixel value is the difference between the pixel value given by the projection type image display apparatus for which the above has not been obtained and the desired pixel value.
Thereby, the image information generating method in the display device of (12) can be realized. In the image information generation method in the display device of any one of (11) to (13), the pixel value is preferably a luminance value.

Embodiments of the present invention will be described below. First, the concept of the present invention will be described.
FIG. 1 is a diagram for explaining a display device according to an embodiment of the present invention, and shows a screen SC.
A plurality of (two in the example of FIG. 1) projection image display devices PJ1, P for R
J2 (hereinafter referred to as projectors PJ1 and PJ2) is installed on both the left and right sides at a predetermined angle.

These projectors PJ1 and PJ2 are general projectors that form a rectangular projection area on the screen SCR when projected from a position facing the screen SCR, and the rectangular projection area is the projector. It is assumed that the shape is the original projection area of PJ1 and PJ2. The shape of the rectangular projection area is referred to as “original projection shape” in the present invention.

Thus, when the projectors PJ1 and PJ2 whose original projection shape is a rectangle are projected onto the screen SCR from the positions shown in FIG. 1, the projectors PJ1 and PJ2 are respectively projected.
The projection area is distorted and has a shape different from a rectangle.

The present invention has occurred in the past when performing projection by superposition by arranging a plurality of projectors such that the shape of the projection area formed on the screen SCR is different from the original projection shape. Moire is less likely to occur.

That is, in the projection mode such as stack projection in which a plurality of projectors are superimposed and projected, as described above, if rectangular projection areas that are the original projection shapes are superimposed as they are, a square lattice is respectively displayed in the projection image from the projector. Since the size and period of the pixels arranged in the same shape are the same, moire is likely to occur due to interference between the pixels.
On the other hand, when the original projection shape is distorted and overlapped, the size and periodicity of the pixels in the overlapped portion are different, so that interference between the pixels hardly occurs and the occurrence of moire can be suppressed.

2 and 3 show the arrangement of the projector PJ1 relative to the screen SCR and the luminance distribution (theoretical) on the screen SCR when the projector (projector PJ1) is arranged at a predetermined angle (θ = 20 °) with respect to the screen SCR. Value). This shows a luminance distribution when a maximum luminance value that can be output is given to all pixels of coordinates (referred to as projector coordinates) on a display device (liquid crystal panel or the like) in the projector PJ1 and projected onto the screen SCR. .

When the projector PJ1 is disposed so as to face the screen SCR, if the luminance value on the screen SCR orthogonal to the optical axis from the projection lens of the projector PJ1 is 100%, the projector PJ1 on the screen SCR In general, the luminance value is about 80% at both ends of the projection area.

2 and 3, the width of the screen SCR in the horizontal direction is 1 m, and the screen S
An example in which projector PJ1 is arranged at an angle of θ = 20 ° with respect to CR (FIG. 2 (
a)) and an example (see FIG. 3A) arranged so as to have an angle of θ = 70 °.
At this time, from the projector PJ1 (projection lens of the projector PJ1) to the screen S
The distance to the middle point m of the horizontal width of the CR is assumed to be 1 m. Therefore, since the distance from the projector PJ1 to the midpoint m of the screen SCR is constant, the luminance at the midpoint m of the screen SCR is constant even when θ changes.

Here, at each angle (θ = 20 ° and θ = 70 °), the screen SCR
FIG. 2B and FIG. 3B show the brightness at other positions on the screen SCR when the brightness of the middle point m is 50% of the maximum brightness value. is there. FIG.
) And FIG. 3B, the vertical axis indicates the change in luminance (1 indicates 100%), and the horizontal axis indicates the position of the screen SCR (0 is the middle point m, 1 is the right end, and -1 is the left end). Represents.

As is clear from FIGS. 2B and 3B, as the distance from the projector PJ1 to the screen SCR increases, the luminance decreases, and as the angle θ increases, the luminance on the screen SCR increases. The difference increases. For example, the angle θ = 70 °
In this case, as can be seen from FIG. 3B, the luminance is different by about 50% at both ends of the screen SCR.

4 shows the projector PJ1 with respect to each position on the screen SCR when the projector PJ1 is arranged at a predetermined angle from the position facing the screen SCR (in this example, by 10 °) with respect to the screen SCR (FIG. 4A). It is a figure which shows luminance distribution (FIG.4 (b)). FIG.
), When the projector PJ1 is shifted to the position indicated by the broken line, the curve C in FIG.
The luminance distribution is as shown by 1.

As is apparent from FIG. 4, the angle θ of the projector PJ1 with respect to the screen SCR
The larger the is, the larger the luminance difference on the screen SCR in the projection area projected by the projector PJ1. In the case of FIG. 4, the horizontal width of the screen SCR is 1 m,
Assume that the distance from the projector PJ1 (projection lens of the projector PJ1) to the middle point m of the horizontal width of the screen SCR is held at 1 m.

In the present invention, it is desirable that the luminance difference on the screen SCR in the projection area projected by a certain projector has a certain size. Accordingly, each projector is arranged with respect to the screen SCR so that a predetermined luminance difference is obtained in the screen SCR.

In the present invention, preferably, the projector screen S is set so that the brightness on the screen SCR of each projector is at least twice the minimum value (the ratio between the maximum value and the minimum value is 2 to 1 or more).
Set the angle to CR. Note that the maximum and minimum luminance values in the screen SCR are given on the screen SCR by giving a maximum luminance value that can be output to all pixels on the display device (liquid crystal panel, etc.) in each projector. The maximum value and the minimum value of the luminance obtained from the luminance distribution at the time of the above are indicated.

Here, since the luminance is inversely proportional to the area of each image on the screen SCR, the higher the luminance, the higher the resolution (the smaller the area covered by one pixel of the projector on the screen SCR), and the lower the luminance. The resolution is low (the area that one pixel of the projector covers on the screen SCR is wide). In addition, it is desirable that the projection area of the pixels of a certain projector on the screen SCR also has a maximum value that is twice or more the minimum value (the ratio between the maximum value and the minimum value is 2 to 1 or more).

FIG. 5 is a diagram showing respective projection areas on the screen SCR when two projectors PJ1, PJ2 are arranged at a predetermined angle with respect to the screen SCR (for example, arranged as shown in FIG. 6). 5A shows a projection area on the screen SCR of the projector PJ1, and FIG. 5B shows a projection area on the screen SCR of the projector PJ2.
In this case, the projection area of the projector PJ1 has a higher resolution on the right side of the projection area than the left side, and the projection area of the projector PJ2 has a higher resolution on the left side of the projection area than the right side.

FIG. 6 shows an arrangement example of the projectors PJ1 and PJ2 with respect to the screen when stack projection is performed with two projectors PJ1 and PJ2 arranged at a predetermined angle with respect to the screen SCR, and respective projection areas on the screen SCR at that time. FIG. In FIG. 6, the projection area of the projector PJ1 is indicated by a thick line, and the projection area of the projector PJ2 is indicated by a thin line. In such a projection mode, a common part of both projection areas is mainly used as a display area for an image (content) to be displayed.

As described above, the projectors PJ1 and PJ2 are projected obliquely with respect to the screen SCR so that the shapes of the projection areas are different from the original projection shapes, thereby overlapping the projection areas of the projectors PJ1 and PJ2. In the case of matching, the pixel size, luminance value, and pixel periodicity in the overlapped portion can be varied. Thereby, it becomes difficult to produce interference between pixels, and generation | occurrence | production of a moire can be suppressed.

In the above example, an example of stack projection using two projectors has been described.
More than one projector may be used. In this way, by projecting a large number of projectors obliquely with respect to the screen SCR so that the shape of each projection area is different from the original projection shape, pixels of various sizes are variously displayed on the screen SCR. It is arranged on the screen SCR in a state that is not a square lattice with a large luminance value. Thereby, the pixel size, the luminance value, and the pixel periodicity in the overlapping portion can be made different.

Next, in a display device installed on the screen SCR such that projection areas from a plurality of projectors have shapes different from the original projection shapes on the screen SCR,
Two examples of a method of generating pixel information (pixel value) given to each projector will be described.

One of the two image information generation methods shown below is referred to as “image information generation method 1”, and the other is referred to as “image information generation method 2”.
Also in these “image information generation method 1” and “image information generation method 2”, in this embodiment, there are two projectors (projectors PJ1, PJ2) and a screen SC.
For R, for example, it is assumed that stack projection is performed in an arrangement as shown in FIG. Further, it is assumed that the image information (pixel value) generated in the image information generation method 1 and the image information generation method 2 is a luminance value.

[Image information generation method 1]
In image information generation method 1, the screen is divided into small areas, and processing is performed for each of the divided small areas. Note that the process of dividing the screen into small areas is actually performed on a memory such as a computer and can be said to be a virtual screen division process.
Also, as a premise for performing this processing, coordinates (screen coordinates) indicating each pixel position on the screen SCR and coordinates (projector coordinates) indicating each pixel position on a display device such as a liquid crystal panel of each projector PJ1, PJ2. It is assumed that the correspondence with is known. That is, it is assumed that it is known in advance at what position and at what resolution each projector PJ1, PJ2 projects on the screen SCR. This is made possible by existing techniques using imaging means and the like.

First, as procedure (1), the screen SCR is divided to obtain a plurality of small areas.
FIG. 7 is a diagram showing an example in which the screen SCR is divided into small areas. In FIG. 7, each quadrangle divided into a lattice shape represents a small region. It is assumed that the resolutions of the projectors PJ1 and PJ2 do not change so much in the small area obtained by dividing the screen SCR. Conversely, small area division is performed so that the resolution hardly changes in each small area.

Next, as procedure (2), for each small area, each projector PJ1 in that small area.
, PJ2 resolution (number of pixels) is acquired. It is assumed that a small area is divided in a certain same small area so that a clear difference appears between the resolution (number of pixels) of the projector PJ1 and the resolution (number of pixels) of the projector PJ2.

As a result of obtaining the resolution (number of pixels) of each projector PJ1, PJ2 for each small area,
The smaller the acquired resolution (the smaller the number of acquired pixels), the larger the number of pixels on the screen SCR covered by one pixel of the projector and the maximum luminance value in the small area. It turns out that it is low.

Next, as a procedure (3), luminance values as pixel information (pixel values) are allocated in order from the projector having a low resolution in the small area. This is done for all small areas. Hereinafter, in each small area, a process of assigning luminance values to the pixels of each projector that covers the small area will be described.

FIG. 8 is a diagram showing one small area Z1 on the screen SCR, and this small area Z1 is an area corresponding to a position near P1 in FIG. The small area Z1 shown in FIG. 8 is a case where the screen SCR is divided very finely for easy understanding, and does not necessarily match the small area division example shown in FIG. Further, the small area Z1 shown in FIG. 8 is an example composed of 16 pixels of 4 pixels × 4 pixels. The black dot in the small area Z1 represents a pixel on the screen SCR of the content to be displayed.

FIG. 9 is a diagram showing how each pixel of the projector PJ1 covers one small area Z1 on the screen SCR shown in FIG. Since the projector PJ1 is far from P1 in FIG. 6, each pixel of the projector PJ1 corresponding to the position P1 covers a wide range.

In the example of FIG. 9, the 16 pixels in the small area Z1 on the screen SCR are the projector P
It is covered with approximately nine pixels of J1. Here, the four pixels A, B,
Focusing on C and D, these four pixels A, B, C, and D are the ones with the projector PJ1.
It is covered by one pixel (this is represented by pixel a and indicated by a bold frame).

FIG. 10 is a diagram showing how each pixel of the projector PJ2 covers one small area Z1 on the screen SCR shown in FIG. Since the projector PJ2 is at a position close to P1 in FIG. 6, each pixel of the projector PJ2 corresponding to the position P1 covers a narrow range.

In the example of FIG. 10, the small area Z1 on the screen SCR is approximately 16 of the projector PJ2.
Covered by pixels. Here, when attention is paid to the four pixels A, B, C, and D in the small area Z1, the four pixels A, B, C, and D are the four pixels (the pixels a, b, and c) of the projector PJ2. , D and indicated by a bold frame). That is, in the example of FIG. 10, in the small area Z1, each pixel on the screen SCR is a projector PJ.
2 corresponds to each pixel.

As shown in FIG. 9 and FIG. 10, each projector PJ1, P in a certain small area.
The resolution (number of pixels) of J2 can be acquired. In the example of FIGS. 9 and 10, the small area Z
The resolution (number of pixels) of the projector PJ1 in 1 is 9, and the resolution (number of pixels) of the projector PJ2 is 16. Thus, it can be seen that in the small area Z1, the projector PJ2 has higher resolution and higher luminance.

When the resolution is acquired in this way, luminance values are assigned in order from the projector with the lower resolution as the process of step (3). In this example, in the small area Z1, since the projector PJ1 has a lower resolution than the projector PJ2, the brightness value is allocated from the projector PJ1.

FIG. 11 is a diagram for explaining allocation of luminance values. Originally, luminance values are allocated to the pixels of the projectors PJ1 and PJ2 corresponding to all the pixels in the small area Z1, but here, in order to make the explanation easy to understand, the pixels A, B, C, D
Only that will be described. FIG. 11A shows desired luminance values to be displayed for the pixels A, B, C, and D. FIG.

Here, first, the projector PJ corresponding to the pixels A, B, C, and D in the small area Z1.
A luminance value is assigned to one pixel (the pixel a of the projector PJ1 shown in FIG. 9). The luminance value assigned to the pixel a of the projector PJ1 is the luminance value of L1 in FIG. This luminance value L1 is the minimum luminance value Lmin among the pixels to be displayed in the small area.
The following brightness value is set. However, in this embodiment, for the purpose of black float countermeasures,
A slight margin is taken with respect to the minimum luminance value Lmin, and the value is slightly smaller than the luminance value Lmin.

Since the example of FIG. 11 focuses on only the pixels A, B, C, and D in the small area Z1, in this case, the pixel A has the minimum luminance value Lmin among the pixels to be displayed. To do. Therefore,
In this embodiment, the luminance value assigned to the pixel a of the projector PJ1 is a luminance value L1 that is slightly smaller than the luminance value Lmin of the pixel A.

In this way, when the assignment of the luminance value to the low-resolution projector PJ1 in the target small area Z1 is finished, the luminance value is assigned to the high-resolution projector PJ2 for the target small area Z1. . This high resolution projector PJ2
The luminance value is assigned to the low-resolution projector PJ1 and the remaining luminance value of the desired luminance value to be displayed (see FIG. 11A).

In the example of FIG. 11B, each of the pixels A, B, C, and D is a projector PJ2.
Corresponding to each of the pixels a, b, c, and d, pixel values are individually assigned to these pixels A, B, C, and D. In FIG. 11B, gray portions indicate pixel values assigned to the pixels a, b, c, and d of the projector PJ2.

Such luminance value allocation processing is performed for all the small regions obtained by the region division, and is performed for each color component (for example, red, green, and blue), which is not explicitly described in the above description.

FIG. 12 shows the processing procedure of image information generation method 1 in the form of a PAD (Problem Analysis Diagram) diagram. Note that the individual processing (for example, processing such as pixel value assignment) shown in FIG. 12 has already been described, and thus detailed description thereof is omitted in FIG.

In FIG. 12, first, a virtual screen division process, that is, a process of dividing a screen into small areas (process S1) is performed, and only the number of screen divisions (the number of small areas obtained by division) (repetition condition R1) and the following Process. In this process, first, a small region to be processed (referred to as a small region of interest) is acquired (processing S11), and the number of small regions obtained by the number of projectors (repetition condition R2) for the small region of interest. The resolution is acquired (process S21), and the acquired resolution is stored (process S22). This is performed for all projectors, and when the processing is completed for all projectors, rearrangement is performed in the order of resolution (processing S31).

Based on the result sorted in the resolution order, the number of effective projectors (repetition condition R
For 3), the following processing is performed. This process assigns a pixel value to each pixel for the number of pixels in the small area of interest (repetition condition R4) (process S41), and stores the assigned pixel value (process S42). The processes S41 and S42 are performed for all the pixels in the target small area. This is performed for all effective projectors. The number of effective projectors here refers to a projector that projects a small area of interest. Therefore, other projectors are not processed.
Then, the same processing is performed for the next small region, and when the processing is completed for all the small regions, the display based on the given pixel value is performed for the number of projectors (repetition condition R5) constituting the display device (processing). S51).

FIG. 13 is a diagram showing a configuration of an image information generating apparatus used in the image information generating method 1. In the image information generation method 1 described so far, the projector has 2
Although it is set as a stand, in this FIG. 13, it is set as the structure which showed that two or more sets might be provided.

In FIG. 13, the image information generation device 1 is a projection information acquisition unit 11 that acquires projection information based on imaging information obtained by imaging the screen SCR by the imaging device 2, and the projection acquired by the projection information acquisition unit 11. Projection information storage unit 12 for storing information, projectors PJ1, P
A projection image acquisition unit 13 that acquires a projection image to be projected at J2,..., A projection image conversion unit 14 that converts the projection information and the projection image of the image to be projected by each projector based on the projection information and the projection image, A projection image output unit 15 that outputs an image to be projected to the projectors PJ1, PJ2,..., These projection information generation unit 11, projection image acquisition unit 12, and projection information storage unit 1
3. The configuration includes a control unit 16 that controls the projection image conversion unit 14, the projection image output unit 15, and the like.

Projection information stored in the projection information storage unit 13 includes projectors PJ1, PJ2,.
Projector coordinates indicating the position of each pixel on the display device, screen coordinates indicating the position of the projector SCR on the screen SCR, each projector PJ1, PJ
2,..., The area covered by the screen SCR, the maximum luminance value that the pixel can output, and the like. As an example of this projection information, for example, the contents shown in FIGS. 14A and 14B used in the description of the image information generation method 2 described later are used.
Further, the luminance conversion (e.g., luminance allocation to each pixel) performed by the projection image conversion unit 14 is as described above.

According to the image information generation method 1 described above, each pixel of each projector installed with respect to the screen SCR has a projection area from a plurality of projectors having a shape different from the original projection shape on the screen SCR. The given pixel information (luminance value) can be generated with high accuracy.

[Image information generation method 2]
The image information generation method 2 specifies the projector coordinates of each projector corresponding to the screen coordinates, the pixel size at the projector coordinates (the area that can be projected on the screen SCR), the maximum luminance value that can be output, and the projector. Is created in advance and a pixel value (luminance value) to be displayed on the screen SCR is set for each pixel on the projector coordinate in each projector based on the table. It is possible.

FIG. 14 is a diagram showing the contents of the table used in the image information generation method 2.
FIG. 14A is a table in which data relating to the projector PJ1 is described, and FIG. 14B is a table in which data relating to the projector PJ2 is described.

In the table in which data relating to each of the projectors PJ1 and PJ2 is described, the projector coordinates indicating the position of each pixel on the display device of each projector PJ1 and PJ2, and the screen coordinates indicating which position on the screen SCR the projector coordinates are. The area that each pixel of each projector PJ1, PJ2 covers on the screen SCR, the maximum luminance value that can be output by the pixel, and the like are described as data.

FIG. 14C is a table in which the tables shown in FIGS. 14A and 14B are combined into one table based on the screen coordinates. FIG. 14C is a table obtained by merging and sorting the contents of FIGS. 14A and 14B to form a table based on the screen coordinates. The projector coordinates corresponding to the screen coordinates, The area of the pixel of the projector coordinates, the maximum luminance value that can be output, and the projector number can be acquired.

In order to display the pixel located at a certain screen coordinate with a certain luminance value, it is possible to determine what luminance value should be given to the corresponding pixel of each projector by the table shown in FIG. it can.

Specifically, when a pixel located at a certain screen coordinate is to be displayed with a certain luminance value, for example, from FIG. 14C, a pixel having a position close to the screen coordinate corresponds to the projector coordinate “of the projector PJ1. If the pixel is located at “0000,0000”, the luminance value “80” of the pixel located at the projector coordinate “0000,0000” of the projector PJ1 is acquired.

Here, when the acquired luminance value “80” is a value that is less than the desired luminance value to be displayed on the screen SCR, it is close to the pixel (in the table of FIG. 14C). A predetermined luminance value is given to a pixel of another projector having a pixel at a position.

In the example of FIG. 14C, the projector coordinates “0000,00” of the projector PJ1.
As a position close to “00”, the projector coordinates “0000,0000” of the projector PJ2
The pixel of the projector coordinate “0000,0000” of the projector PJ2 has a larger luminance value “320”. Therefore, the luminance value of the difference between the luminance value of the pixel located at the projector coordinate “0000,0000” of the projector PJ1 and the desired luminance value to be displayed is set as the projector coordinate “0000,0000” of the projector PJ2.
To all pixels.

Thereby, in this example, the pixel to be displayed on the screen SCR is the projector P.
By assigning the luminance value “80” by the corresponding pixel of J1, assigning the remaining luminance value to the projector PJ2, and projecting the two projectors PJ1 and PJ2 on top of each other, display with the desired luminance value is possible. Become.

If a pixel located at a certain screen coordinate is to be displayed with a certain luminance value, the pixel located at the projector coordinate of a certain projector having a position close to that screen coordinate is displayed from FIG. If it has a luminance value that can sufficiently satisfy the desired luminance value, the luminance value necessary for display is given to the pixel of the projector, and the display on the projector is performed. Further, the setting of the luminance value for each projector by referring to the table described above is performed for each color (for example, red, green, and blue).

FIG. 15 is a diagram showing a configuration of an image information generating apparatus used in the image information generating method 2. Also in FIG. 15, the projector is configured to indicate that two or more projectors may be provided.

15 includes a projection information storage unit 12 that stores projection information, and a projection image acquisition unit 13 that acquires projection images to be projected by the projectors PJ1, PJ2,.
, Projection image conversion unit 14 for converting the projection shape and brightness of the image to be projected by each projector PJ1, PJ2,... Based on the projection information and the projection image, and each projector PJ1, PJ2.
,..., A projection image output unit 15 that outputs an image to be projected, a projection information storage unit 12, a projection image acquisition unit 13, a projection image conversion unit 14, and a control unit 16 that controls the projection image output unit 15. It has the composition which has.

The projection information stored in the projection information storage unit 13 is, for example, FIGS. 14 (a) and 14 (b).
, (C), and the data can be created in advance. Then, for example, the created projection information can be stored in the projection information storage unit 13 when the display device is shipped. It should be noted that only FIG. 14C in which the contents of FIGS. 14A and 14B are merged and sorted may be stored.
Further, the luminance conversion (e.g., luminance allocation to each pixel) performed by the projection image conversion unit 14 is as described above.

As described above, according to the image information generation method 2, each projector coordinate corresponding to the screen coordinates, the pixel size at the projector coordinates (area that can be projected on the screen SCR), and the maximum luminance that can be output A table capable of acquiring a value and a number for specifying a projector (projector number) is created in advance, and a luminance value to be displayed on the screen SCR can be set for each projector based on the table.
Thus, it is possible to set which pixel of which projector should be displayed with which luminance value for each pixel on the screen SCR by simply referring to the table.

Therefore, even with this image information generation method 2, the screen SCR is designed so that the projection area from the plurality of projectors has a shape different from the original projection shape on the screen SCR.
It is possible to set the pixel information given to each projector installed on the projector with high accuracy.

In addition, since the image information generation method 2 can set pixel information given to each projector with reference to a table with high accuracy, stack projection using a large number of projectors as shown in FIG. It is suitable for.
FIG. 16 is a diagram showing an example in which stack projection is performed using a large number of projectors PJ1, PJ2,..., And FIG. 16 shows an example using six projectors PJ1 to PJ6.

In such a case, for each of the projectors PJ1 to PJ6, FIG.
A table as shown in b) is created for each projector. Then, based on the contents of each created table, a table as shown in FIG. 14C, that is, each projector coordinate corresponding to the screen coordinates, the area of the pixel at the projector coordinates, the maximum luminance value that can be output, A table capable of acquiring a number for identifying a projector (projector number) is created in advance. By referring to this table, for each pixel on the screen SCR, it is possible to set what luminance value should be displayed for which pixel of which projector among many projectors.

The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention. For example, the present invention can of course be applied to a rear display device.

FIG. 17 is a diagram illustrating an example of a rear display device. FIG. 17 shows an example in which projection light from a plurality of projectors (for example, two projectors PJ1 and PJ2) is projected onto the screen SCR by being reflected by the corresponding mirrors MR1 and MR2.

In the description so far, the projection shape on the screen of each projector constituting the display device is different from the original projection shape of the projector.
Although an example in which projectors are arranged with respect to a screen has been described, it is not necessary to arrange all projectors in such an arrangement. That is, for the purpose of suppressing moire, it is only necessary to arrange a plurality of projectors so that only one projector having the original projection shape exists among the plurality of projectors constituting the display device. Become.

In addition, for example, when tiling projection or stack projection is performed using a large number of projectors, a plurality of projectors having projection areas that overlap only between several projectors having projection areas that overlap each other on the screen. Among them, it is only necessary to arrange each projector so that there is at most one projector having an original projection shape.

In the description so far, among the plurality of projectors constituting the display device,
A plurality of projectors are arranged so that there is at most one projector having an original projection shape. However, in consideration of the fact that the original projection shape is not necessarily rectangular, as shown below. It is also possible to arrange each projector with a simple idea.

FIG. 18 shows a plurality of projectors (also two projectors PJ1 and PJ2 here)
It is a figure explaining the other example of how to arrange | position with respect to a screen.
In FIG. 18, the coordinates (projector coordinates) of the pixels on the display devices 31 and 32 in the projectors PJ1 and PJ2 corresponding to the coordinates (screen coordinates Ps) of a certain pixel on the screen SCR are the projector coordinates P1 in the projector PJ1. In the projector PJ2, it is assumed that the projector coordinates are P2. Each projector PJ
The coordinates of the display devices 31 and 32 of 1, PJ2 are x
The downward direction is represented by y.

FIG. 19 is an enlarged view of the vicinity of the screen coordinate Ps of the screen SCR. FIG.
As can be seen from FIG. 9 (a), in the screen coordinate Ps portion, the projector PJ1
, PJ2 has a superimposed portion in each pixel (indicated by a bold frame).
Here, an x-direction pixel (referred to as a pixel P1x) and a y-direction pixel (referred to as a pixel P1y) adjacent to a pixel (referred to as a pixel P1) located at the projector coordinate P1 on the projector PJ1 side. ) On each screen (in this case, the difference vector from the center of each pixel to the center) and the pixel P on the projector PJ2 side
2 pixel adjacent to 2 (referred to as pixel P2x) and y pixel (pixel P2y)
Let us consider the difference vector on each screen (also referred to as the difference vector from the center to the center of each pixel).

As shown in FIG. 19B, if the difference vector in the x direction on the screen SCR in the projector PJ1 is represented by ΔP1_x, ΔP1_x can be represented by ΔP1_x = P1x−P1, and the difference vector in the y direction. Is expressed as ΔP1_y, ΔP1_y is expressed as ΔP1
1_y = P1y−P1.
Similarly, as shown in FIG. 19C, x on the screen of the projector PJ2
If the difference vector in the direction is expressed as ΔP2_x, ΔP2_x can be expressed as ΔP2_x = P2x−P2, and if the difference vector in the y direction is expressed as ΔP2_y, ΔP2_y is expressed as Δ
P2_y = P2y−P2.

The difference vectors ΔP1_x and ΔP1_y between the pixel P1x in the x direction adjacent to the pixel P1 on the projector PJ1 side and the pixel P1y in the y direction, and the pixels P2x in the x direction adjacent to the pixel P2 on the projector PJ2 side and the y direction When considering the respective difference vectors ΔP2_x and ΔP2_y of the pixel P2y, the difference vector ΔP1_x becomes the difference vector ΔP2_
The projectors PJ1 and PJ2 are arranged with respect to the screen SCR so as to be different from x and so that the difference vector ΔP1_y is different from the difference vector ΔP2_y.

By arranging the projectors PJ1 and PJ2 in this way, the screen SCR
In the above, pixels of various sizes are arranged on the screen SCR with various luminance values in a state that is not a square lattice. Thereby, the pixel size, the luminance value, and the pixel periodicity in the overlapping portion can be made different. Moreover, it can be set as the arrangement | positioning method which can suppress generation | occurrence | production of a moire whatever shape the original projection shape of a projector is.

Also in this case, the ratio between the maximum value and the maximum value of the maximum luminance on the screen of each pixel in each projector PJ1, PJ2 is set so that the maximum value of the luminance is almost twice or more the minimum value. It is preferable. In addition, it is preferable that the ratio between the maximum value and the minimum value of the projection area of each pixel on the screen in each projector PJ1, PJ2 is approximately twice or more.

Arranging the projectors PJ1 and PJ2 with respect to the screen SCR so that the difference vector ΔP1_x is different from the difference vector ΔP2_x and the difference vector ΔP1_y is different from the difference vector ΔP2_y provides a greater moire suppression effect. But,
The arrangement may be such that only the difference vector ΔP1_x and the difference vector ΔP2_x are different, or the arrangement may be such that the difference vector ΔP1_y differs only in the difference vector ΔP2_y.

Further, the present invention can create a processing program for realizing the present invention described above, and record it on a recording medium such as a floppy disk, an optical disk, or a hard disk. Therefore, the present invention includes a recording medium on which the processing program is recorded. Further, the processing program may be obtained from a network.

FIG. 6 illustrates a display device according to an embodiment of the present invention. The figure which shows the arrangement | positioning of the projector with respect to a screen, and the luminance distribution on a screen at the time of arrange | positioning a projector at a predetermined angle ((theta) = 20 degrees) with respect to the screen. The figure which shows the arrangement | positioning of the projector with respect to a screen, and the luminance distribution on a screen at the time of arrange | positioning a projector at a predetermined angle ((theta) = 20 degrees) with respect to a screen. The figure which shows the luminance distribution with respect to each position on a screen at the time of arrange | positioning the projector by shifting with respect to the screen SCR by a predetermined angle from the position facing the screen. The figure which shows each projection area | region in a screen when two projectors are arrange | positioned with respect to the screen at a predetermined angle. The figure which shows the example of arrangement | positioning with two projectors at a predetermined angle with respect to a screen, and each projection area | region in the screen at that time. The figure which shows the example which divided | segmented the screen into small areas. The figure which shows a certain small area | region on a screen. The figure which shows how each pixel of the projector PJ1 covers one small area on the screen shown in FIG. The figure which shows how each pixel of the projector PJ2 covers one small area on the screen shown in FIG. The figure for demonstrating allocation of a luminance value. The figure which shows the process sequence of the image information generation method the 1 in the format of a PAD figure. The figure which shows the structure of the image information generation apparatus used in the image information generation method 1. The figure which shows the content of the table used with the image information generation method 2nd. The figure which shows the structure of the image information generation apparatus used in the image information generation method 1. The figure which shows the example which performs stack projection using many projectors PJ1, PJ2, .... The figure which shows an example which made the display apparatus of this invention a rear type. The figure explaining the other example of the method of arrangement | positioning with respect to the screen of a some projector. It is a figure which expands and shows the screen coordinate Ps vicinity in FIG. The figure which shows schematic structure of the conventional multi-screen display apparatus.

Explanation of symbols

PJ1, PJ2 ... projector (projection type image display device), SCR ... screen, Z1 ...
Small area, A, B, C, D ... Pixels on the screen, a, b, c, d ... Projector pixels.

Claims (6)

A that generates image information to be output to a plurality of projection type image display apparatus constituting the de Isupurei device images information generation method,
Obtaining region information relating to a plurality of regions obtained by virtually dividing a screen used for projection of the plurality of projection-type image display devices ;
A step of acquiring the resolution of the respective areas of the plurality of projection type image display device that projects in each area based on the area information,
Based on the acquired resolution, said among the plurality of projection type image display device that projects to the respective regions, in each of the regions, in order from the resolution low has the projection type image display device, to correspond to the respective areas a step of allocating pixel values to the image element that,
A method for generating image information, comprising: The image information generation method according to claim 1 ,
In the step of allocating said pixel values,
Wherein among the plurality of projection type image display device that projects the respective regions, wherein for the picture element that corresponds to the region of the lowest first projection type image display device resolution in each region, the region for display all can image allocate minimum pixel value below the pixel values in the pixel value, the field containing the corresponding to the area of the first projection type image display apparatus other than the projection type image display device in A method of generating image information, comprising: allocating pixel values based on a difference between a pixel value allocated to a pixel of the first projection type image display device and a pixel value to be displayed. The image information generation method according to claim 2,
  A pixel value smaller than the minimum pixel value among the pixel values to be displayed in the region is assigned to the pixel corresponding to the region of the first projection image display apparatus.
  An image information generation method characterized by the above. The image information generation method according to any one of claims 1 to 3 ,
A method of generating image information, wherein a luminance value is used as the pixel value.   In the image information generation method according to any one of claims 1 to 4,
  The maximum value of the maximum luminance among the pixels of the projection image projected on the screen from at least one of the plurality of projection type image display devices constituting the display device is the maximum Arranging the plurality of projection type image display devices so as to be approximately twice or more the minimum value of luminance
  A method for generating image information, comprising:   In the image information generation method according to any one of claims 1 to 4,
  The maximum value of the area among the pixels of the projection image projected on the screen from at least one of the plurality of projection type image display apparatuses constituting the display apparatus is the area. Arranging the plurality of projection-type image display devices so as to be approximately twice or more of a minimum value;
  A method for generating image information, comprising: