JP2010224221A - Image display system, image processor, projector, and image processing method in the image display system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display system capable of transmitting control information for controlling each of a plurality of projectors constituting the image display system to the projectors through an image data cable. <P>SOLUTION: The image display system is provided with a plurality of projectors for projecting each partial image to form a superimposed region between adjacent partial images and an image processor having a function for generating partial image data corresponding to each partial image. The image processor PC has a control information writing part 180 for rewriting a non-visually confirmed pixel data having a value of luminance not visually confirmed as image among pixel data writing regions corresponding to each pixel included in the superimposed region of each partial image having adjusted luminance. Each of the projectors PJ1, PJ2, ... has a control information acquiring part 320 for acquiring the control information from the partial image data and an operation control part 350 for controlling operation based on the control information. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image display system, an image processing apparatus, a projector, and an image processing method in the image display system.

  An image display system that realizes display of a high-definition large-screen image by displaying images (referred to as partial images) projected from a plurality of projectors side by side on a screen is known.

  FIG. 7 is a diagram showing an external configuration of the image display system. The image display system shown in FIG. 7 has a total of 16 projectors PJ1 to PJ16 (4 in each of the horizontal and vertical directions) and partial images to be projected by the projectors PJ1 to PJ16 with respect to the projectors PJ1 to PJ16. And an image processing apparatus (which is a personal computer) PC that distributes the corresponding partial image data via the image data cable 10.

  In the image display system shown in FIG. 7, the projectors PJ <b> 1 to PJ <b> 1 are provided such that overlapping regions (see FIG. 8) are provided between adjacent partial images of the partial images projected by the projectors PJ <b> 1 to PJ <b> 16. PJ16 is installed. In FIG. 8, the display area of the partial images of the projectors PJ1, PJ2, PJ5, and PJ6 is enlarged, and the area shown in gray in FIG.

  The image display system shown in FIG. 7 is a case where a superimposed region is provided between adjacent partial images, but there is also an image display system that does not provide a superimposed region. In any case, this type of image display system can display a higher-definition large-screen image as the number of projectors increases, but there is also a problem that power consumption increases.

  In order to cope with such a problem, an image display system capable of displaying a high-definition large-screen image without increasing the number of projectors has been proposed (for example, see Patent Document 1).

  In the technique disclosed in Patent Document 1 (referred to as the first conventional technique), the number of projectors constituting the image display system is kept as it is, and more projectors are provided in a region where the amount of information per unit area of the display image is large. And the projection area of each projector is changed so that a small number of projectors are allocated to an area with a small amount of information per unit area of the display image. By performing such processing, it is possible to display a high-definition image visually without increasing the number of projectors. Although not mentioned in the first prior art, since the number of projectors does not increase while enabling high-definition image display, it is considered that the increase in power consumption can be suppressed as compared with the case where the number of projectors is increased. .

On the other hand, many techniques for suppressing power consumption have been proposed in an image display apparatus capable of displaying a high-definition large-screen image (see, for example, Patent Document 2).
The technology disclosed in Patent Document 2 (referred to as the second conventional technology) is a single image display device different from the image display system, and further assumes a direct-view type image display device. It is possible to suppress this. That is, the second prior art is capable of suppressing power consumption by controlling the light source according to the displayed content or scene.

  Specifically, the second prior art corresponds to the display size switching means for switching the display size to two levels (large screen size and small screen size) according to the content, the scene, etc., and each of the two display sizes. In the case of performing display with a large screen size, the light source corresponding to the large screen size is turned on, and in the case of performing display with a small screen size, the small screen is provided. By controlling the light source corresponding to the size to be turned on, power consumption can be reduced.

JP 2007-243712 A JP 2008-301167 A

  Since the first conventional technology described above enables high definition without increasing the number of projectors, the number of projectors increases as compared with an image display system that increases the number of projectors to achieve high definition. However, the increase in power consumption can be suppressed, but the effect of actively reducing power consumption when the number of projectors is the same cannot be obtained.

  On the other hand, since the second prior art is for controlling the number of light sources to be lit, it is considered that an effect of reducing power consumption can be obtained. However, when a technique for controlling a light source according to content, scene, or the like as in the second conventional technique is applied to an image display system, the following problems occur.

  In many image display systems, an external image processing apparatus PC (see FIG. 7) such as a personal computer is used to cut out a partial image to be projected by each projector, and the brightness of the overlapping region (see FIG. 8) is other region. In general, various types of image data processing such as luminance adjustment processing for suppressing the increase of the image data are performed. For this reason, it is necessary to transmit each partial image data to each projector by the image data cable 10 (see FIG. 7) after performing various image data processing by the image processing apparatus PC.

  In such an image display system, when the light source control as shown in the second prior art is performed, the light source control information for controlling the light source provided in each projector is sent to the corresponding projector. Must be sent individually.

  Since the second prior art is a single image display device, the light source is controlled in accordance with the content, the scene, etc., but one large screen image is formed by a plurality of partial images as in the image display system. As in the case of the second prior art, the brightness of the display image is controlled according to the content and the scene as well as each area of the display screen (partial image projected from each projector). It is also possible to control the brightness. In either case, it is necessary to control the light source for each projector.

Thus, when controlling the light source for each projector, the light source control information for controlling the light source of each projector is generated for each projector on the image processing apparatus PC side, and the generated light source for each projector is generated. It is necessary to transmit control information to the corresponding projector. In this case, there is a problem that a dedicated interface or a dedicated transmission cable for transmitting the light source control information to the projector is required. This is not limited to the case where the output of the light source of each projector is controlled, but the same can be said for the case where a control signal for performing some control is transmitted to each projector.

  Therefore, the present invention provides an image display system that can transmit control information for controlling a plurality of projectors constituting the image display system for each projector to a corresponding projector by an image data cable for transmitting image data. An object is to provide an image processing method in an image processing apparatus, a projector, and an image display system.

  The image display system of the present invention generates a plurality of projectors that project each partial image so that a superimposed region is formed between adjacent partial images, and generates partial image data corresponding to each of the partial images. An image display system comprising: an image processing device that transmits to a projector, wherein the image processing device adjusts the luminance of pixel data corresponding to the superimposed region in each partial image data; A control information writing unit that rewrites non-visible pixel data having a luminance value that is not visually recognized as an image among the pixel data adjusted by the superimposing region luminance adjusting unit, to control information for controlling the projector, and The projector includes a control information acquisition unit that acquires the control information from the partial image data, and the control information And having an operation control unit for controlling the operation.

  As described above, in the image display system of the present invention, on the image processing apparatus side, pixel data having a luminance value that is not visually recognized as an image out of pixel data corresponding to each pixel included in the overlapping region of each partial image (non-image). (Visual pixel data) is rewritten to control information for controlling each projector. Thereby, control information for controlling each projector can be handled in the same manner as image data. Therefore, the control information can be transmitted to the projector through the image data cable, and an interface for transmitting the control information and a dedicated transmission cable can be eliminated. Thereby, the configuration of the image display system can be simplified, and the image display system can be constructed at low cost.

  Further, on the projector side, it is possible to acquire the control information of the projector transmitted as image data from the image processing apparatus and perform an operation based on the acquired control information.

In the image display system of the present invention, it is preferable that the superimposition area luminance adjustment unit suppresses that the luminance of pixel data corresponding to the superimposition area is higher than that of other areas.
This makes it difficult to visually recognize the presence of the superimposed region on the screen, and the display image can have high image quality.

  In the image display system of the present invention, it is preferable that the non-viewable pixel data corresponds to a pixel whose luminance value is adjusted to zero in the overlapping region of the partial images.

  As described above, the area whose luminance value has been adjusted to zero is an area that has no meaning as an image when the partial image is displayed on the screen (an area that is not visually recognized as an image). The pixel data corresponding to each adjusted pixel can be rewritten as information other than luminance information, for example, control information for controlling the projector.

  In the image display system of the present invention, the projector further includes an image data processing unit that rewrites the control information of the non-visible pixel data to a luminance value that is not visually recognized as the image after the control information is acquired. Is preferred.

  As described above, after acquiring the control information, the control information is rewritten to the original luminance information (luminance value that is not visually recognized as an image in the overlapping region of each partial image). As a result, the pixel data is rewritten to the original luminance information, so that the partial image in which the luminance adjustment of the superimposition region is made can be projected from the projector.

  In the image display system of the present invention, the control information for controlling the projector is light source control information for controlling an output of a light source provided in the projector, and the operation control unit is based on the light source control information. It is preferable to control the output of the light source.

  Thus, the output of the light source of each projector can be controlled by using the control information as the light source control information for controlling the output of the light source. By making it possible to control the output of the light source of each projector, the brightness can be adjusted for each of a plurality of display areas (partial images projected by each projector) of a large-screen image displayed in the image display system.

  Specifically, the output of the light source of the projector is controlled according to the luminance (brightness) of each partial image projected by each projector. For example, in a display area where the brightness can be suppressed, the light source output is reduced. By controlling the output of the light source, the power consumption of the image display system is reduced. can do. From the viewpoint of the power consumption reduction effect, the power consumption reduction effect becomes more remarkable as the number of projectors constituting the image display system increases.

  In the image display system of the present invention, a luminance representative value calculation unit that calculates a luminance representative value representing the luminance of each partial image for each partial image, and a smaller luminance representative value calculated for each partial image, A luminance adjustment information acquisition unit that acquires luminance adjustment information that increases the luminance of the partial image, and a partial image luminance adjustment unit that adjusts the luminance of the partial image based on the luminance adjustment information acquired by the luminance adjustment information acquisition unit And a light source control information acquisition unit that acquires light source control information that decreases the output of the light source of the projector that projects the partial image as the luminance representative value calculated for each partial image decreases, It is preferable that the area luminance adjustment unit adjusts the luminance of the superimposed area with respect to the partial image data whose luminance is adjusted by the partial image luminance adjustment unit.

  The luminance adjustment unit performs processing for changing the luminance for each partial image according to the luminance representative value calculated in each partial image. Specifically, the luminance representative value calculated in the partial image The luminance adjustment is performed such that the smaller the value is, the higher the luminance of the partial image is.

  The light source control information acquisition unit performs processing for acquiring light source control information for controlling the output of the light source of the projector that projects the partial image according to the luminance representative value calculated in each partial image. Specifically, the light source control information is acquired so that the lower the luminance representative value calculated in the partial image, the lower the output of the light source of the projector that displays the partial image.

  In this way, by performing luminance adjustment such that the luminance of the partial image is increased as the representative luminance value calculated in the partial image is smaller, the output of the light source is output on the projector side that projects the partial image. Even if the light source output control is performed so as to decrease, the change in the apparent brightness can be suppressed.

In the image display system of the present invention, when the luminance representative value is equal to or greater than a predetermined value, the luminance adjustment information acquisition unit acquires luminance adjustment information that does not change the luminance of the entire partial image, and the luminance representative information When the value is less than the predetermined value, it is preferable to acquire brightness adjustment information that increases the brightness of the entire partial image as the brightness representative value decreases.

  As a result, the luminance that increases the luminance of the partial image only when the representative luminance value of the partial image is less than the predetermined value, that is, when the brightness of the entire partial image is less than the predetermined brightness. Adjustment information (luminance adjustment information corresponding to the luminance representative value of the partial image) can be acquired.

  In the image display system of the present invention, the light source control information acquisition unit acquires light source control information that does not change an output of a light source of a projector that projects the partial image when the luminance representative value is equal to or greater than a predetermined value. When the luminance representative value is less than the predetermined value, it is preferable to acquire light source control information that decreases the output of the light source of the projector as the luminance representative value is smaller.

  Thereby, only when the luminance representative value of the partial image is less than the predetermined value, that is, when the brightness of the entire partial image is less than the predetermined brightness, the output of the light source of the projector that projects the partial image is output. Light source control information that can be reduced (light source control information corresponding to the luminance representative value of the partial image) can be acquired.

In the image display system of the present invention, it is preferable that the luminance representative value of the partial image is a value obtained by averaging the luminance of each pixel included in the partial image.
Thus, by representing the luminance representative value in the partial image as a value (average luminance) obtained by averaging the luminances of the pixels included in the partial image, the luminance (brightness) of the entire partial image is appropriately represented. Can do.

  The image processing apparatus of the present invention generates a plurality of projectors that project each partial image so that a superimposed region is formed between adjacent partial images, and generates partial image data corresponding to each partial image. An image processing apparatus in an image display system including an image processing apparatus that transmits to a projector, the superimposing region brightness adjusting unit that adjusts the brightness of pixel data corresponding to the superimposing region in each partial image data, and A control information writing unit that rewrites non-viewing pixel data having a luminance value that is not visually recognized as an image among pixel data adjusted by the superimposing region luminance adjustment unit, to control information for controlling the projector. To do.

  As described above, the image processing apparatus of the present invention rewrites non-visible pixel data to control information for controlling each projector among pixel data corresponding to each pixel included in the overlapping region of each partial image. Yes. For this reason, the effects described in the image display system of the present invention can be obtained by applying the image processing apparatus of the present invention to the image display system. Note that the image processing apparatus of the present invention preferably has the characteristics of the image display system of the present invention.

  The projector of the present invention generates a plurality of projectors that project each partial image so that a superimposed region is formed between adjacent partial images, and generates partial image data corresponding to each of the partial images. A non-viewable pixel data having a luminance value that is not visually recognized as an image is rewritten by the image processing apparatus to control information for controlling the projector. And a control information acquisition unit that acquires the control information from the partial image data, and an operation control unit that performs operation control based on the control information.

According to the projector of the present invention, it is possible to acquire the control information of the projector transmitted as image data from the image processing apparatus, and perform an operation based on the acquired control information. Note that the projector of the present invention preferably has the characteristics of the image display system of the present invention.

  The image processing method in the image display system of the present invention generates a plurality of projectors that project each partial image so that a superimposed region is formed between adjacent partial images, and partial image data corresponding to each partial image. An image processing method in an image display system comprising an image processing device that transmits to the plurality of projectors, wherein the image processing device adjusts the luminance of pixel data corresponding to the overlapped region in each partial image data Superimposing area brightness adjustment step, and non-viewing pixel data in which a brightness value that is not visually recognized as an image is written out of the pixel data adjusted in the superimposing area brightness adjustment step is rewritten to control information for controlling the projector An information writing step, wherein the projector includes the partial image data. And having a control information acquisition step of acquiring et the control information, and an operation control step of performing an operation control based on the control information.

  The effects described in the image display system of the present invention can be obtained by the image processing apparatus and the projector constituting the image display system performing such processing. Note that the image processing method in the image display system of the present invention preferably has the characteristics of the image display system of the present invention.

The functional block diagram which shows the structure of the image display system which concerns on embodiment. 6 is a flowchart for explaining an image processing procedure performed by the image processing apparatus PC. The figure explaining the acquisition process of the brightness adjustment information by the brightness adjustment information acquisition part 140. FIG. The figure explaining the acquisition process of the light source control information by the light source control information acquisition part 160. FIG. The figure explaining the brightness adjustment of a superimposition area | region. The figure explaining the process which writes light source control information in the superimposition area | region of partial image data. The figure which shows the external appearance structure of an image display system. The figure explaining the superimposition area | region provided between adjacent projection images.

  Hereinafter, embodiments of the present invention will be described. In the image display system according to the embodiment, it is assumed that the control information for controlling each projector is light source control information for controlling the output of the light source provided in each projector.

  FIG. 1 is a functional block diagram illustrating a configuration of an image display system according to the embodiment. As shown in FIG. 1, the image display system according to the embodiment includes an image processing apparatus PC such as a personal computer and a plurality of projectors PJ1, PJ2,. Note that, for example, 16 projectors PJ1, PJ2,... Are provided as shown in FIG. Further, it is assumed that the partial images from the individual projectors are displayed on the screen SCR so that an overlapping area (see FIG. 8) is provided between adjacent partial images.

The image processing apparatus PC includes an image data input unit 110 for inputting image data corresponding to an image to be projected, and a partial image corresponding to a partial image to be projected by each projector from the image data input to the image data input unit 110. A partial image data generation unit 120 that generates data and a luminance representative value calculation unit 130 that calculates a luminance representative value representing the luminance (brightness) of each partial image based on each partial image data for each partial image. is doing. Note that the luminance representative value representing the luminance of each partial image is an average value of luminance of pixels included in the partial image (hereinafter referred to as average luminance).

  In addition, the image processing apparatus PC includes a luminance adjustment information acquisition unit 140 that acquires luminance adjustment information that increases the luminance of the partial image as the average luminance calculated for each partial image is smaller, and the luminance adjustment information acquisition unit 140. The partial image luminance adjustment unit 150 that adjusts the luminance of the partial image based on the luminance adjustment information acquired by the output of the light source of the projector that projects the partial image as the average luminance calculated for each partial image is smaller A light source control information acquisition unit 160 that acquires light source control information for reducing the light source control information.

  A specific example of the luminance adjustment information acquisition process by the luminance adjustment information acquisition unit 140 and a specific example of the light source control information acquisition process by the light source control information acquisition unit 160 will be described later.

  Further, the image processing apparatus PC uses the superimposition area luminance adjustment unit 170 that adjusts the luminance of the pixel data corresponding to the superimposition area in each partial image data, and the light source control information acquired by the light source control information acquisition unit 160 as the partial image data. A control information writing unit 180 that performs processing to write data to the projector, and an image data transmission unit 190 that transmits partial image data corresponding to each projector to the corresponding projector via each image data cable 10. The brightness adjustment unit 170 suppresses that the brightness of the pixel data corresponding to the overlapping area is higher than that of the other areas, and adjusts the brightness to be the same as the brightness of the other areas.

  On the other hand, the projectors PJ1, PJ2,... Have an image data receiving unit 310 that receives partial image data transmitted from the image data transmitting unit 190 of the image processing apparatus PC, and light source control information from the received partial image data. Control information acquisition unit 320 that acquires the image data, an image data processing unit 330 that performs various image data processing on the partial image data after the light source control information is acquired by the control information acquisition unit 320, and a control information acquisition unit 320 The operation control unit (referred to as a light source control unit) 350 that controls the output of the light source 340 based on the light source control information acquired by the above, and the light modulation element (not shown) based on the image data processed by the image data processing unit 330 Light modulation element control unit 360 for controlling the light and various optical system elements, and combining the color light output from the light modulation element with the image light And an image projecting section 370 for projecting onto the screen SCR (refer to FIG. 7) Te.

  The image data processing unit 330 performs various types of image data processing. As image data processing according to the embodiment of the present invention, the image data processing unit 330 applies partial image data after the light source control information is acquired by the control information acquisition unit 320. On the other hand, the pixel data in which the light source control information is written is rewritten to the original luminance information (luminance value = 0).

  Note that the image projection unit 370 includes a light modulation element and various optical elements, but the configuration thereof is a well-known configuration included in a general projector, and thus illustration thereof is omitted. 1 shows only the projector PJ1, the other projectors PJ2,... Have the same configuration.

  FIG. 2 is a flowchart illustrating an image processing procedure performed by the image processing apparatus PC. An image processing procedure in the image display system according to the embodiment will be described with reference to the flowchart shown in FIG. 2 and the configuration diagram of FIG.

First, the partial image data generation unit 120 generates partial image data corresponding to the partial image to be projected by each projector PJ1, PJ2,... From the image data input to the image data input unit 110 (step S1). Next, the average luminance for each partial image is calculated by the luminance representative value calculating unit 130 based on the generated partial image data (step S2). It is assumed that the average luminance for each partial image is the average value of the luminance Y of the pixels included in each partial image. The luminance Y of the pixels included in each partial image is, for example, a known conversion formula obtained by multiplying {RGB} and a predetermined 3 × 3 determinant when the input image data is image data in the RGB color space. {XYZ} Y obtained from the above can be used.

  Based on the average brightness of each partial image calculated in this way, the brightness adjustment information acquisition unit 140 acquires brightness adjustment information for performing brightness adjustment (step S3), and each brightness adjustment information is acquired based on the acquired brightness adjustment information. The partial image brightness adjustment unit 150 adjusts the brightness of the partial image (step S4).

  Then, when the luminance adjustment of each partial image is performed by the partial image luminance adjustment unit 150, the luminance adjustment of the superimposition region is performed by the superimposition region luminance adjustment unit 170 on the partial image subjected to the luminance adjustment processing (Step S5). This brightness adjustment of the overlap area is a process for suppressing the brightness of the overlap area from becoming higher than that of other areas. By performing such brightness adjustment, the presence of the overlap area is visually recognized on the screen. It becomes difficult to be done. When the luminance adjustment of the superimposition region is performed, the light source control information acquisition unit 160 acquires light source control information for controlling the output (brightness) of the light source of the projector based on the average luminance calculated in step S2. (Step S6).

  Subsequently, the control information writing unit 180 performs a process of writing the light source control information acquired in step S6 in the overlapping region of the partial image (step S7). The control information writing unit 180 out of pixel data corresponding to each pixel included in the overlapping area of each partial image, pixel data having a luminance value (luminance value = 0) that is not visually recognized as an image (referred to as non-visual pixel data). The light source control information is rewritten, and a specific example thereof will be described later.

  The light source control information can be written only in the partial image data corresponding to the partial image for which the output control of the light source is to be performed. However, in the image display system according to the embodiment, the output control of the light source is performed. Information that does not change the output of the light source is written as light source control information even for partial images that need not be performed.

  As described above, when the light source control information is written in the partial image data corresponding to each partial image, the partial image data in which the light source control information is written is transmitted from the image data transmission unit 190 to each image data cable 10. Each is sent to the corresponding projector.

  FIG. 3 is a diagram for explaining the luminance adjustment information acquisition processing by the luminance adjustment information acquisition unit 140. Note that the luminance adjustment information is a coefficient (referred to as a luminance adjustment coefficient) for changing the value of the luminance Y of each pixel. FIG. 3 shows a function (referred to as a function for acquiring a luminance adjustment coefficient) that can acquire a luminance adjustment coefficient (represented by a) corresponding to the average luminance (Ym) calculated in each partial image. The function for obtaining the adjustment coefficient is g (Ym). The function g (Ym) for obtaining the luminance adjustment coefficient is set based on experiments.

  According to the function g (Ym) for obtaining the luminance adjustment coefficient shown in FIG. 3, when the average luminance Ym is calculated in each partial image, the portion is calculated based on the calculated average luminance (referred to as calculated average luminance Ym). The brightness adjustment coefficient a of the image can be calculated. That is, according to the luminance adjustment coefficient acquisition function g (Ym) shown in FIG. 3, when the calculated average luminance Ym is equal to or greater than a predetermined value (threshold Yth), the luminance adjustment coefficient a is a constant value (a When the calculated average luminance Ym is less than the threshold value Yth, the luminance adjustment coefficient a is a> 1, and the smaller the calculated average luminance Ym, the larger the value.

  Thus, in the image display system according to the embodiment, the luminance adjustment information acquisition unit 140 calculates the luminance adjustment coefficient a using the function g (Ym) for acquiring the luminance adjustment coefficient as shown in FIG. I have to. Instead of calculating the brightness adjustment coefficient using the function g (Ym) for acquiring the brightness adjustment coefficient, for example, a table capable of acquiring the brightness adjustment coefficient a from the calculated average brightness Ym (brightness adjustment coefficient acquisition table) The brightness adjustment coefficient a may be acquired by referring to the brightness adjustment coefficient acquisition table.

  By the way, the luminance adjustment coefficient a increases the luminance as its value increases. That is, the luminance adjustment coefficient a is multiplied (a × Y) by the luminance Y obtained for each pixel of the partial image. For this reason, the higher the luminance adjustment coefficient a is, the higher the luminance of each pixel is, and the overall luminance of each pixel of the partial image is increased. If the luminance of each pixel of the partial image increases as a whole, the average luminance of the partial image increases. That is, the brightness of the partial image is increased.

  As described above, the partial image luminance adjustment unit 140 shown in FIG. 1 performs luminance adjustment such that the average luminance of the partial image is larger for the partial image whose calculated average luminance Ym is less than the threshold Yth, For a partial image whose calculated average luminance Ym is equal to or greater than the threshold Yth, the luminance of the partial image is kept as it is.

  FIG. 4 is a diagram for explaining the light source control information acquisition process by the light source control information acquisition unit 160. It is assumed that the light source control information is a coefficient (referred to as a light source output control coefficient) for changing the output (represented by L) of the light source. FIG. 4 shows a function (referred to as a light source output control coefficient acquisition function) capable of acquiring a light source output control coefficient (denoted by b) corresponding to the average luminance (Ym) calculated in each partial image. Suppose that the function for obtaining the light source output control coefficient is f (Ym).

  The light source output control coefficient acquisition function f (Ym) is set so that f (Ym) × g (Ym) = 1, and as shown in FIG. It is expressed as the reciprocal of the brightness adjustment coefficient a. That is, the light source output control coefficient b is represented by b = 1 / a. Therefore, according to the light source output control coefficient acquisition function f (Ym) shown in FIG. 5, when the calculated average luminance Ym is equal to or greater than a predetermined value (threshold Yth), the light source output control coefficient b is a constant value. (B = 1), and when the calculated average luminance Ym is less than the threshold Yth, the light source output control coefficient b is 0 <b <1, and the smaller the calculated average luminance Ym, the light source output control coefficient b is A smaller value.

  As described above, in the image display system according to the embodiment, the light source control information acquisition unit 160 uses the light source output control coefficient acquisition function f (Ym) as illustrated in FIG. b is calculated. The light source output control coefficient b is not calculated using the light source output control coefficient acquisition function f (Ym), but, for example, a table (light source output) capable of acquiring the light source output control coefficient b from the calculated average luminance Ym. The light source output control coefficient b may be acquired by creating a control coefficient acquisition table in advance and referring to the light source output control coefficient acquisition table.

  Incidentally, the light source output control coefficient b is multiplied (b × L) by the output L of the light source. When b = 1, the output L of the light source does not change, but 0 <b <1. In some cases, the smaller the value, the smaller the output L of the light source relative to the original output. That is, the light source is more dimmed.

In the flowchart of FIG. 2, the light source control information acquisition process (FIG. 2) shown in FIG.
Step S6) is performed after the brightness adjustment of the superimposition area (step S5), but the light source control information acquisition process is not limited to this, but rather than the brightness adjustment of the superposition area (step S5). You may make it perform as a process of the previous step.

FIG. 5 is a diagram for explaining the luminance adjustment of the overlapping region. In FIG. 5, for simplification of explanation, as shown in FIG. 5A, as shown in FIG. 5A, overlapping regions (gray in FIG. 5) provided in two partial images G1 and G2 (referred to as partial images of projectors PJ1 and PJ2). Will be described. FIG. 5B shows the partial images G1 and G2 in FIG. 5A individually taken and enlarged.

  As shown in FIG. 5B, with respect to the overlapping region 21 of the partial image G1, as it goes from the start position Ps of the overlapping region 21 to the end position (right end portion of the partial image G1) Pe of the overlapping region. A luminance weight w (hereinafter referred to as a weight w) that continuously decreases the luminance is set. Specifically, the weight w = 1 at the start position Ps (position x = 0) of the overlapping area 21 in the partial image G1, and the weight w is continuously decreased toward the end position Pe of the overlapping area, A luminance weight function is set such that the weight w = 0 at the end position Pe of the overlapping area.

  Similarly, with respect to the overlapping region 22 of the partial image G2, the luminance is continuously decreased from the start position Ps of the overlapping region 20 toward the end position (left end portion of the partial image G2) Pe of the overlapping region. A weight w is set. Specifically, the weight w = 1 at the start position Ps (position x = 0) of the overlapping area 20 in the partial image G2, and the weight w is continuously decreased toward the end position Pe of the overlapping area, A luminance weight function is set such that the weight w = 0 at the end position Pe of the overlapping area.

  FIG. 6 is a diagram for explaining the process of writing the light source control information in the overlapping area of the partial image data. In FIG. 6, only the overlapping areas 21 and 22 formed in two partial images G1 and G2 (referred to as partial images of the projectors PJ1 and PJ2) are considered for simplification of description.

  FIG. 6A is a diagram for explaining an example of writing light source control information in the overlapping area 21 of the partial image G1 in the projector PJ1, and FIG. 6B is a diagram illustrating light source control information in the overlapping area 22 of the partial image G2 in the projector PJ2. It is a figure explaining the example which writes.

  In FIG. 6A, the luminance weight w in the overlapping region 21 is weight w = 1 at the start position Ps of the overlapping region 21 and goes toward the end position Pe of the overlapping region 21 as described in FIG. 5. Accordingly, the weight w is continuously decreased, and the weight w = 0 at the end position Pe of the overlapping region 21.

  Therefore, in FIG. 6A, each pixel in the pixel column in the vertical direction (vertical direction) of the pixel corresponding to the terminal position Pe of the overlapping region 21 (the pixel column shown in gray in FIG. 6A) A luminance value (luminance value = 0) that is not visually recognized as an image is written. For this reason, the pixel data of the pixel column has no meaning as image data. Therefore, among the pixel data corresponding to each pixel included in the superposition region 21, the non-viewable pixel data is rewritten with the light source control information.

  In FIG. 6B, the luminance weight w in the overlapping region 22 is weight w = 1 at the start position Ps of the overlapping region 22 as described in FIG. The weight w is continuously reduced as it goes to, and the weight w = 0 at the end position Pe of the overlapping region 22.

  Accordingly, in FIG. 6B, each pixel in the pixel column in the vertical direction (vertical direction) of the pixel corresponding to the end position Pe of the overlapping region 22 (the pixel column shown in gray in FIG. 6B) A luminance value (luminance value = 0) that is not visually recognized as an image is written. For this reason, the pixel data of the pixel column has no meaning as image data. Therefore, among the pixel data corresponding to each pixel included in the superimposition region 22, the non-visible pixel data is rewritten to the light source control information.

  Note that the light source control information that is actually written in the overlapping area needs to be information understandable on the projector side. For example, based on the light source output control coefficient b acquired in FIG. 4, a voltage for driving the light source (light source driving voltage) is obtained on the image processing apparatus PC side, and the obtained light source driving voltage is used as light source control information in the overlapping region. An example is to write to.

  Specifically, in FIG. 4, for example, if the calculated average luminance Ym of a certain partial image is equal to or greater than the threshold value Yth in FIG. 4, the acquired light source output control coefficient b is b = 1. Since it is a coefficient that does not change the light source output, data representing the light source driving voltage set from the beginning in the projector is written as light source control information. In FIG. 4, for example, if the calculated average luminance Ym of a partial image is a predetermined value less than the threshold Yth in FIG. 4, the light source based on the light source output control coefficient b acquired from the calculated average luminance Ym. A drive voltage is obtained, and data representing the obtained light source drive voltage is used as light source control information. Such processing can be performed on the image processing apparatus PC side. The projector acquires data representing the light source driving voltage as the light source control information, and drives the light source based on the acquired data.

  Further, if the projector can control the light source output based on the light source output control coefficient b described with reference to FIG. 4, it is possible to write the light source output control coefficient b as light source control information in the overlapping area. In this case, the projector performs an operation of acquiring the light source output control coefficient b written in the partial image data and controlling the output L of the light source based on the acquired light source output control coefficient b.

  In FIG. 6, the overlapping area formed in each of the partial images G1 and G2 projected by the projectors PJ1 and PJ2 has been described. However, the adjacent images among the partial images projected by other projectors constituting the image display system are described. The same applies to the overlapping region formed between the partial images.

  As described above, when the light source control information is written in the overlapping area of each partial image, the partial image data in which the light source control information is written corresponds to the image data cable 10 from the image data transmission unit 190 of the image processing apparatus PC. To the projectors PJ1, PJ2,. The partial image data transmitted from the image processing apparatus PC to the projectors PJ1, PJ2,... Is partial image data that has been adjusted for luminance in the superimposition area, and predetermined pixels (luminance values) in the superimposition area. The pixel data corresponding to “= 0” is rewritten to light source control information.

  On the other hand, in each projector PJ1, PJ2,..., The image data receiving unit 310 receives the partial image data transmitted from the image processing apparatus PC. Then, the control information acquisition unit 320 acquires the light source control information written in the overlapping area, and gives the acquired light source control information to the light source control unit 350. Accordingly, the light source control unit 350 performs light source output control based on the light source control information. For example, if the light source control information is data representing the light source driving voltage as described above, the light source is driven based on the data representing the light source driving voltage.

  When the light source control information is acquired by the control information acquisition unit 320, the image data processing unit 330 then rewrites the pixel data rewritten to the light source control information to the original pixel information (luminance value = 0). Then, the partial image data is given to the light modulation element control unit 360. In this way, by performing the process of rewriting the pixel data rewritten to the light source control information to the original pixel information (brightness value = 0), the projector can display a partial image in which the luminance adjustment of the superimposed region has been performed. Can project.

  As described above, the image display system according to the embodiment rewrites the non-visible pixel data to the light source control information among the pixel data corresponding to each pixel included in the overlapping region of each partial image. Thereby, the light source control information for controlling the output of the light source of each projector can be handled in the same manner as the image data. Therefore, the control information can be transmitted to the projector through the image data cable, and a dedicated interface and a dedicated transmission cable for transmitting the control information can be eliminated. Thereby, the configuration of the image display system can be simplified, and the image display system can be constructed at low cost.

  Further, after calculating the average luminance of each partial image and adjusting the luminance of each partial image with the luminance adjustment coefficient (see FIG. 3) according to the calculated average luminance, the light source output that is the reciprocal of the luminance adjustment coefficient The light source is driven by a control coefficient (see FIG. 4). Thereby, even if it is a case where it controls so that the output of a light source may be reduced, the change of the apparent brightness can be suppressed. In addition, since there is a projector that is controlled so that the output of the light source is reduced by making it possible to control the output of the light source of each projector, an effect of reducing the power consumption of the entire image display system can be obtained.

  The present invention is not limited to the above embodiment, and various modifications can be made without departing from the scope of the present invention. For example, the following modifications (1) to (3) are possible.

  (1) In the above embodiment, the output control of the light source of each projector is performed for each partial display area (partial image projected by each projector) of the image displayed on the screen. Instead of the output control of the light source, the output control of the light source of each projector may be performed according to the content or the scene.

  (2) In the above embodiment, the control information to be written in the overlapping area is the light source control information for controlling the output of the light source of the projector. However, the control information is not limited to the light source control information and can be processed by each projector. Other control information may be used as long as the information is correct. For example, power control information for turning on / off individual projectors, trapezoidal distortion correction information for correcting keystone distortion in individual projectors, and color correction for performing color correction of individual projectors in individual projectors Information can be exemplified.

  (3) The light source of the projector may be a lamp or a light emitting diode (LED). When the light source is an LED and an LED that emits R (red) color light, an LED that emits G (green) color light, and an LED that emits B (blue) R color light are provided, the respective colors are changed. It is also possible to generate light source control information for the LED that emits light.

DESCRIPTION OF SYMBOLS 10 ... Image data cable, 21, 22 ... Superimposition area | region, 120 ... Partial image data generation part, 130 ... Luminance representative value calculation part, 140 ... Luminance adjustment information acquisition part, 150 ... Partial image brightness adjustment unit, 160 ... light source control information acquisition unit, 170 ... superimposed area brightness adjustment unit, 180 ... control information writing unit, 190 ... image data transmission unit, 310
..Image data receiving unit 320... Control information obtaining unit 330... Image data processing unit 350... Operation control unit (light source control unit) 340. Partial image, PC ... Image processing device, PJ1, PJ2 ... Projector, SCR ... Screen

Claims (12)

A plurality of projectors that project each partial image so that a superimposed region is formed between adjacent partial images; an image processing device that generates partial image data corresponding to each partial image and transmits the partial image data to the plurality of projectors; An image display system comprising:
The image processing apparatus includes:
A superimposition area luminance adjustment unit that adjusts the luminance of pixel data corresponding to the superimposition area in each partial image data;
A control information writing unit that rewrites non-visible pixel data having a luminance value that is not visually recognized as an image among the pixel data adjusted by the superimposing region luminance adjustment unit, to control information for controlling the projector;
Have
The projector is
A control information acquisition unit that acquires the control information from the partial image data;
An operation control unit for performing operation control based on the control information;
An image display system comprising: The image display system according to claim 1,
The superimposing area luminance adjusting unit suppresses that the luminance of pixel data corresponding to the superimposing area is higher than that of other areas. The image display system according to claim 1 or 2,
The non-viewable pixel data corresponds to a pixel whose luminance value is adjusted to zero in the overlapping region of the partial images. The image display system according to any one of claims 1 to 3,
The projector further includes an image data processing unit that rewrites the control information of the non-viewable pixel data to a luminance value that is not visually recognized as the image after the control information is acquired. The image display system according to any one of claims 1 to 4,
Control information for controlling the projector is light source control information for controlling an output of a light source provided in the projector, and the operation control unit performs output control of the light source based on the light source control information. A featured image display system. The image display system according to claim 5,
A luminance representative value calculating unit that calculates a luminance representative value representing the luminance of each partial image for each partial image;
A luminance adjustment information acquisition unit that acquires luminance adjustment information for increasing the luminance of the partial image as the luminance representative value calculated for each partial image is smaller;
A partial image luminance adjustment unit that performs luminance adjustment of the partial image based on the luminance adjustment information acquired by the luminance adjustment information acquisition unit;
A light source control information acquisition unit that acquires light source control information that decreases the output of the light source of the projector that projects the partial image as the luminance representative value calculated for each partial image decreases;
The superimposing area luminance adjustment unit adjusts the luminance of the superimposing area with respect to partial image data whose luminance has been adjusted by the partial image luminance adjusting unit. The image display system according to claim 6,
The luminance adjustment information acquisition unit acquires luminance adjustment information that does not change the luminance of the entire partial image when the luminance representative value is equal to or greater than a predetermined value, and when the luminance representative value is less than the predetermined value. Is an image display system for acquiring brightness adjustment information for increasing the brightness of the entire partial image as the brightness representative value is smaller. The image display system according to claim 6 or 7,
The light source control information acquisition unit acquires light source control information that does not change an output of a light source of a projector that projects the partial image when the luminance representative value is a predetermined value or more, and the luminance representative value is a predetermined value. If the brightness representative value is smaller, the light source control information that decreases the output of the light source of the projector is obtained. The image display system according to any one of claims 6 to 8,
The luminance representative value is a value obtained by averaging the luminance of each pixel included in the partial image. A plurality of projectors that project each partial image so that a superimposed region is formed between adjacent partial images; an image processing device that generates partial image data corresponding to each partial image and transmits the partial image data to the plurality of projectors; The image processing apparatus in an image display system comprising:
A superimposition area luminance adjustment unit that adjusts the luminance of pixel data corresponding to the superimposition area in each partial image data;
A control information writing unit that rewrites non-visible pixel data having a luminance value that is not visually recognized as an image among the pixel data adjusted by the superimposing region luminance adjustment unit, to control information for controlling the projector;
An image processing apparatus comprising: A plurality of projectors that project each partial image so that a superimposed region is formed between adjacent partial images; an image processing device that generates partial image data corresponding to each partial image and transmits the partial image data to the plurality of projectors; A projector in an image display system comprising:
A control information acquisition unit that acquires the control information from the partial image data in which non-visible pixel data having a luminance value that is not visually recognized as an image is rewritten by the image processing device to control information for controlling the projector;
An operation control unit for performing operation control based on the control information;
A projector comprising: A plurality of projectors that project each partial image so that a superimposed region is formed between adjacent partial images; an image processing device that generates partial image data corresponding to each partial image and transmits the partial image data to the plurality of projectors; An image processing method in an image display system comprising:
The image processing apparatus includes:
A superimposing region brightness adjustment step of adjusting the brightness of pixel data corresponding to the superimposing region in each partial image data;
A control information writing step of rewriting non-viewing pixel data in which a luminance value that is not visually recognized as an image is written out of the pixel data adjusted in the superimposing area luminance adjustment step, to control information for controlling the projector;
Have
The projector is
A control information acquisition step of acquiring the control information from the partial image data;
An operation control step for performing operation control based on the control information;
An image processing method in an image display system characterized by comprising: