JP5585117B2 - Multi-display system, multi-display adjustment method and program - Google Patents

Description

  The present invention relates to a technique for correcting visibility deterioration in a multi-display system that combines a plurality of displays and realizes a large combined display.

In this type of multi-display system that combines multiple displays to achieve a large combined display, a fixed viewing point is determined during initial installation and maintenance, and only the viewing adjustment at this viewing point is optimized. For this reason, the viewing characteristics are deteriorated due to differences in viewing points during operation.
In addition, it has been unavoidable that viewing characteristics deteriorate and change due to operational aging and environmental changes.
As a method for improving and resolving these problems, only readjustment was carried out by maintenance work such as once a year.

  FIG. 9 shows an example of a multi-display system in which 3 × 3 (3 horizontal x 3 vertical) projection displays are combined. The viewing angle dependence characteristics of the display are greatly influenced by the characteristics of the entire optical system such as the optical control characteristics of the projector screen, the viewing characteristics (screen gain, condenser lens, diffuser, etc.) and the lens characteristics of the projector optical engine. This characteristic causes display characteristic deterioration due to the viewing position. In general, when optimization adjustment is performed from the initial setting location (front position) shown in FIG. 9A, the upper left part may reduce brightness and reduce contrast when viewed from the position moved to the right shown in FIG. 9B. It is common. In addition, it is general that the upper right part lowers the brightness and reduces the contrast when visually recognizing from the position moved to the left shown in FIG.

  In addition, display time difference occurs between each display when a fast moving video is displayed due to display unit processing time difference at the time of enlarged display across each unit in a multi-display display device by combining displays with multiple signal processing functions・ It may be drawn.

  FIG. 10 shows an example of an enlarged display on a multi-display system. When a "patent" character displays high-speed moving (scrolling) video images from the right to the left of the screen, the screen 101, 103, 104, 106, 107, 109 is delayed from displaying 102, 105, 108 (xx mSec delay) This is an example of the occurrence of Since the image scrolls from right to left, when a delay occurs, the screen image shifts to the right (hereinafter, this phenomenon is referred to as “body-cut image”).

  As a related technique, there is disclosed a technique capable of calculating display characteristic correction data related to the entire image even when shooting data obtained by shooting a test pattern does not normally include all the images related to the test pattern data. . The configuration is such that test pattern data is generated, a test pattern is displayed on the image display device based on the test pattern data, photographing data is obtained by photographing the test pattern, and display characteristics of the image display device are obtained from the photographing data. Correction data is calculated. At this time, if the shooting data does not normally include the entire image, the non-normal region is set as a complement target region, and the complement target region is complemented from a region other than the supplement target region. Then, correction data relating to the entire image related to the test pattern data is calculated (see, for example, Patent Document 1).

JP 2005-20314 A

However, in the related technologies described above, adjustments are made with the viewing point fixed, so when there is a change in the viewing layout (viewing point changes), or when the viewing peripheral environment (lighting environment / time due to natural light obtained from sunlight) It is inevitable that the viewing characteristics deteriorate due to changes in lighting conditions and changes in the light-shielding environment depending on the season, and the visibility deteriorates due to a decrease in contrast.
In addition, when displaying an enlarged display video that spans multiple displays, the frame synchronization of the displayed video cannot be ensured due to the difference or delay in the signal processing time on each display, and the drawing phase between the screens is shifted. Visibility degradation may occur.

  An object of the present invention is to provide a multi-display system, a multi-display adjustment method, and a program that can correct visibility degradation.

The multi-display system of the present invention is a multi-display system in which a plurality of displays are combined, and variations in display brightness as a viewing angle characteristic deterioration of each display depending on the viewing location using the shooting data of the portable camera terminal as a test pattern Is controlled to be corrected.

Further, the multi-display adjustment method of the present invention is a multi-display multi-display adjustment method in which a plurality of displays are combined, the step of acquiring photographing data of a portable camera terminal as a test pattern, and each display depending on the viewing location And a step of correcting and controlling variations in display luminance as the viewing angle characteristic degradation of the display.

In addition, the program of the present invention provides a multi-display system combining a plurality of displays, a process of acquiring photographing data of a portable camera terminal as a test pattern, and display brightness as a viewing angle characteristic deterioration of each display depending on a viewing location. And a process of correcting and controlling the variation of the image.

  According to the present invention, it is possible to correct the degradation of visibility and to optimize and adjust the viewing characteristics.

It is a system projector signal processing block diagram according to the first embodiment of the present invention. It is a figure which shows the camera example of a signal detection and taking-in operation. It is a figure which shows the mode of visual = brightness | luminance level deterioration from a video image image | photographed with the camera, and an example of luminance analysis data. It is a figure which shows the operation example regarding an analysis and correction | amendment calculation element from a camera imaging | photography / video image. It is a signal processing block diagram explaining the visibility (luminance) deterioration operation. It is a figure which shows the operation image after visibility correction implementation = correction | amendment and correction. It is a system projector signal processing block diagram which concerns on 2nd embodiment of this invention. It is a figure which shows the mode of frame delay deterioration, and the operation | movement image of correction | amendment visual recognition. It is a figure which shows the brightness | luminance (contrast) degradation by viewing angle dependence. It is a figure which shows the display delay generation | occurrence | production by the signal processing delay factor in a system apparatus.

  Embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a functional block diagram showing a multi-display system in the first embodiment (luminance correction) of the present invention.

  The projector screen 100 and the projector optical engine 110 in FIG. 1 are the heart of display drawing that displays an image. The frame delay control unit 200, the image adjustment engine 300, and the video input processor (Select, Format Convert) 400 are parameters for conversion to a signal format required by the optical engine and adjustment for image adjustment parameter setting and user requested image quality.

  Further, a test pattern signal generator 504 serving as a characteristic function block of the present invention, an analysis improvement result parameter calculation application unit 501 (correction engine), a camera shot image demodulation / analysis unit 502 (analysis engine), and a camera shot file storage unit 503 (file folder). A control controller 500 (not shown) is also provided.

As shown in FIG. 2, in the present embodiment, a test pattern video signal (Calibration) suitable for detecting / determining deterioration of the projector screen from the test pattern signal generator 504 is displayed during multi-display daily operation, and arbitrary visual recognition is performed. Take a picture of the situation projected from the position on the screen. This is transferred and stored in the designated file folder 503. In this case, any transfer / save method is not specified and any method may be applied.
That is, the subject video is shot by the portable camera terminal from the viewing point desired by the user. In the case of the first embodiment (brightness correction), a still image (camera shot still image format / compression method / non-compression compatible, general file (BMP, JPEG, etc.)) may be used. In the case of the second embodiment (correction of torso video), it is necessary to shoot a moving image (compatible with the video format / compression method taken by the camera, and a general-purpose file (WMV, M-JPEG, etc.)) It is. Each photographed data file is copied to a file folder 503 designated by the multi-projector signal processing circuit.

FIG. 3 shows an example of the above-described deterioration in visibility (decrease in luminance). The upper right side of the screen is degraded due to the field of view from the left position. The camera-captured video demodulation / analysis unit 502 (analysis engine) decodes and reproduces the camera-captured file using Bitmap Picture. The screen brightness is detected from the reproduced video. In the example of Fig. 5, the brightness at the upper right side of BRTcur (Bright Right Top current) is low, and the lower left side of BLBcur (Bright Left Bottom current) is the highest. An analysis improvement result parameter calculation application unit 501 (correction engine) calculates and outputs data that complements the luminance difference.
The calculation coefficient is the brightness of the optical engine that is projected on the screen 107 and the contrast value, the Adjust Sample value is given, Max Bright (maximum brightness) and Min Bright (minimum brightness) are recorded, and the variable range of brightness adjustment is stored at the same time. By comparing with the data, the optimized brightness adjustment value (Target Point) can be calculated.

Current brightness at the top left: BLTcur: Bright Left Top current,
Brightness at the top right: BRTcur: Bright Right Top current,
Central brightness: BCNcur: Bright Center current,
Lower left brightness: BLBcur: Bright Left Bottom current,
Brightness at the top right: BRBcur: Bright Right Bottom current,
BLTmax: Bright Left Top max: Maximum brightness at the top left,
BLTmin: Bright Left Top min: Minimum brightness at the top left,

That is, the integrated luminance information is calculated from the test pattern screen image information stored in the file folder 503 folder. As a representative example, luminance information of the screen center portion, upper right portion, lower right portion, upper left portion, and lower left portion is compared and calculated to obtain luminance deterioration = luminance variation on the screen surface.
The calculation of the integrated luminance value can obtain accurate luminance difference information by adding a deterioration coefficient due to the camera photographing lens-to-screen distance. The distance calculation method can be calculated from incidental information of the camera (EXTF: focal length, aperture value, shutter speed, lens characteristics (viewing angle), etc.). The distance coefficient can also be obtained from the integration target area ratio of the test pattern. Interpolation correction for visibility and resolution degradation depending on viewing distance.

  FIG. 4 shows an example in which the data acquired above is graphed. The brightest part of the current luminance data is BLBcur (lower left luminance). It is necessary to reduce the luminance by 20% in the luminance correction calculation. The darkest is BRTcur (brightness at the upper right). This is a 50% increase in brightness, indicating that correction is required in each display area. In the present embodiment, the luminance detection areas are five places on the upper left and right, the center, and the lower left and right. However, by increasing the number of detection points, more detailed correction adjustment images can be made.

In addition, since there are many luminance increase control parts in the correction operation, the power consumption increases due to the increase in lamp power accompanying the increase in luminance. When calculation is performed in the power consumption priority mode, the luminance correction target is calculated with a weight set to decrease adjustment. As a result, the brightness of the screen decreases, but the control operation can be performed with less variation in the brightness of each projector screen.

  FIG. 5 is a diagram in which the above operations are collectively rewritten into functional blocks. The brightness adjustment of the projector optical engines 100 to 10n is applied via the respective image adjustment engines 300 to 30n. Control brightness increase / decrease. The brightness control targets are the contrast, brightness, and offset of Lamp Power and projector optical engine.

FIG. 6 is a diagram showing an operation image in which the brightness correction value is applied to each projector screen. In the case of vision from the left position of the screen shown in FIG. 6-3, the luminance in the upper right part is greatly deteriorated. However, an example in which the luminance is adjusted appropriately is shown in FIG. 6-4. In this operation example, 101 screens have no luminance change, and 103 → −20%, 105 → + 30%, 107 → + 50%, and 109 → + 25% are correction values. In this case, the screen 102 which was not the detection target is obtained as a smoothing correction value from the three surrounding correction values and set to + 3%. By specifying and correcting 104 → + 27%, 106 → + 12%, and 108 → + 35%, luminance variations are reduced.

According to the present embodiment, the luminance integration value is calculated from the camera-captured video (Pixel information), the screen luminance reduction / contrast at the viewing point is calculated, and the luminance degradation is compensated by complementing the luminance to cope with this reduction. Corrections can be realized. In addition, it detects the influence of external light entering the screen surface (natural light entering from the window, reflection on the screen by switching the lighting device) by capturing the change in luminance in the low luminance area of the captured image, and against contrast degradation due to this Can also be improved and corrected by implementing the above solution process.
In addition, it is possible to detect, improve, and correct characteristic deterioration such as performance deterioration of projection equipment (decrease in lamp brightness) and contamination of the screen optical system due to long-time equipment operation.
In addition, in a viewing device environment where the viewing environment is sufficiently light and contrast due to light shielding and indoor lighting reduction, if it is determined that more than necessary contrast (bright part is too bright) can be obtained, the amount of projection light is suppressed ( By reducing the lamp power, it is also possible to expect functions and effects for reducing and reducing power consumption.

  FIG. 7 is a functional block diagram showing a multi-display system in the second embodiment (correction of a torso image) of the present invention.

  FIG. 11 is a functional block for detecting a display video phase shift between the displays and applying a correction value when the screen image of the multi-display system shown in FIG.

As in the first embodiment (luminance correction), the specific test pattern signal generator 504, the video input processor 400, the image adjustment engine 300, the frame delay control unit 200, and the projector optical engine 110 project the image. The enlarged image is displayed on the projector screen 100. Take this with the camera. Shooting data is transferred and stored in the camera shooting file storage unit 503 (file folder).
In addition, a delay time correction / calculation engine 601 (Delaytime correction engine), camera video decoding, contour extraction, and linearity detection / analysis unit 602 (analysis engine) are provided.

  FIG. 8 is a diagram for explaining an example of a test signal intended to detect a display image phase shift. As for the outline of the test signal, it is assumed that the inclination angle is 45 degrees, the stripe width is 10 dots (height is 10 dots), the high contrast color scheme (generally Black & White), the horizontal or vertical scroll video, the moving speed is 300 dots / sec, 60 fps. . The test signal is not limited to this.

  The photographing data is reproduced by the analysis engine 602, the contour of the test signal is extracted from the photographed video, and the linear discontinuity portion of the contour line is detected. If the contour line is a straight line, it is determined that there is no delay between the displays. When a discontinuous portion is detected, a display delay has occurred at the projector screen boundary. The delay time is obtained by analyzing the image of discontinuous points. In this case, if the width of the discontinuous point is 10 dots which is the same as the stripe width (height) of the test signal, it can be diagnosed as 33.3 mSec, and if 1/2 of the stripe width = 5 dots, it can be diagnosed as 16.7 mSec. That is, in the case of the condition test signal 60 fps, if one frame is delayed by 5 dots and delayed by 10 dots, a delay of 2 frames occurs.

In the case of FIG. 8, the screens 101, 102, 103, 104, 106, 107, 108 have no delay, and the display on the screen 105 generates a delay of 1 frame (16.7 mSec) based on this. The screen 109 is determined to have a delay of 2 frames (33.3 mSec).
In order to correct this, synchronization adjustment control is executed from the Delaytime correction engine 601 to the frame delay control units 200 to 20n. The frame delay control units 201, 202, 203, 204, 206, 207 and 208 add a 33.3 mSec (2 frame) delay. The frame delay control unit 205 adds 16.7 mSec (1 frame) delay control. By performing these corrections, the projector optical engines 110 to 11n and the projector screens 100 to 10n display images that are synchronously corrected.

According to the present embodiment described above, it is possible to improve the delay between the projectors (ie, a torso image).
In a multi-display system, each display may be operated asynchronously. In this case, it can be seen that there is a phase difference of the display image between the screens 100 to 10n. As a measure to improve this, vertical and horizontal bar scroll video is generated from the test pattern video, and the video is shot with a camera movie. This is because the delay time between the screen images is calculated by the analysis engine for this frame image, and the display time adjustment is performed by each frame delay control unit for the preceding projector based on this delay time.

  Until now, adjustments could not be applied to the movement of viewing points and changes in the surrounding environment of viewing, which forced them to operate in a degraded visibility state. According to each of the above embodiments, the test pattern is photographed by the camera photographing device before operation, and the photographing data is stored in the designated folder of the system, so that the viewing characteristic can be optimized and adjusted.

Each of the above-described embodiments is a preferred embodiment of the present invention, and various modifications can be made without departing from the scope of the present invention. For example, a process for realizing the functions of the system may be performed by causing the system to read and execute a program for realizing the functions of the multi-display system. Further, the program is transmitted to another computer system by a transmission wave via a computer-readable recording medium such as a CD-ROM or a magneto-optical disk, or via a transmission medium such as the Internet or a telephone line. Also good. In addition, it is also within the scope of the present invention that the functions of each device are realized by other devices collectively or the functions are distributed by additional devices.
INDUSTRIAL APPLICABILITY The present invention can be applied to a maintenance application that compensates for visual optimization in operation management of a large display device configured by a multi-display from a plurality of display devices and deterioration due to long-time operation.

  A part or all of the above embodiment can be described as in the following supplementary notes, but is not limited thereto.

(Appendix 1) A multi-display system combining a plurality of displays,
A multi-display system characterized by correcting and controlling variations in display luminance as a deterioration in viewing angle characteristics of each display depending on a viewing location using photographing data of a portable camera terminal as a test pattern.

  (Supplementary note 2) The multi-display system according to supplementary note 1, wherein the display luminance is suppressed and the power consumption is actively reduced.

  (Supplementary note 3) The multi-display system according to Supplementary note 1 or 2, wherein a change / difference in at least one of deterioration with time and viewing environment is detected, and the deterioration of the viewing characteristic due to the change / difference is corrected and controlled.

  (Supplementary note 4) The multi-display according to any one of supplementary notes 1 to 3, wherein the correction is controlled by detecting an out-of-body image which is a display of different display images due to occurrence of a time difference such as a video signal processing delay. system.

  (Supplementary note 5) The multi-display system according to any one of supplementary notes 1 to 4, wherein correction control is performed for deterioration in visibility and resolution depending on viewing distance.

(Appendix 6) A multi-display adjustment method of a multi-display combining a plurality of displays,
Acquiring the shooting data of the portable camera terminal as a test pattern;
And a step of correcting and controlling variations in display luminance as a deterioration in viewing angle characteristics of each display depending on the viewing location.

  (Supplementary note 7) The multi-display adjustment method according to supplementary note 6, wherein the display luminance is suppressed and the power consumption is actively reduced.

  (Supplementary note 8) The multi-display adjustment method according to supplementary note 6 or 7, wherein a change / difference in at least one of deterioration with time and viewing environment is detected, and the deterioration of the viewing characteristic due to the change / difference is corrected and controlled.

  (Supplementary note 9) The multi-display adjustment method according to any one of supplementary notes 6 to 8, wherein a correction is controlled by detecting an out-of-body image that is displayed as a different display image due to occurrence of a time difference such as a video signal processing delay. .

  (Supplementary note 10) The multi-display adjustment method according to any one of supplementary notes 6 to 9, wherein correction control is performed for deterioration in visibility and resolution depending on viewing distance.

(Appendix 11) In a multi-display system that combines multiple displays,
A process of acquiring the shooting data of the mobile camera terminal as a test pattern
A program for executing a process of correcting and controlling variations in display luminance as a deterioration in viewing angle characteristics of each display depending on a viewing location.

  (Additional remark 12) The program of Additional remark 11 characterized by suppressing display brightness and actively reducing power consumption.

  (Additional remark 13) The program of Additional remark 11 or 12 characterized by detecting a change / difference of at least one of deterioration with time and viewing environment, and correcting and controlling the deterioration of viewing characteristics due to the change / difference.

  (Supplementary note 14) The program according to any one of supplementary notes 11 to 13, wherein the program is detected and corrected by detecting a cut-out image that is displayed as a different display image due to occurrence of a time difference such as a video signal processing delay.

  (Supplementary note 15) The program according to any one of Supplementary notes 11 to 14, wherein correction control is performed for deterioration in visibility and resolution depending on viewing distance.

100 to 10n Projector screen 110 to 11n Projector optical engine 200 to 20n Frame delay control unit 300 to 30n Image adjustment engine 400 to 40n Video input processor 500 Control controller 501 Analysis improvement result parameter calculation application unit 502 Demodulation / analysis unit 503 Camera photography File storage unit 504 Test pattern signal generator 601 Delaytime correction engine 602 Demodulation / analysis unit

Claims (6)

A multi-display system that combines multiple displays,
Display means for displaying a moving image across each display as a test pattern;
Capturing means for capturing a moving image obtained by photographing the test pattern;
A delay caused between display images of each display based on the detected width of the discontinuous portion detected from the discontinuous portion image in the moving image captured by the capturing means. A delay time calculating means for calculating time;
And a control means for performing display control for delaying a display timing of a display in which no delay occurs based on the delay time .   The multi-display system according to claim 1, wherein the control unit corrects and controls variations in display brightness among the plurality of displays and suppresses brightness of the plurality of displays.   3. The control unit according to claim 1, wherein the control unit detects at least one of a change in a display image due to deterioration with time of each display and a change in a display image due to a viewing environment, and corrects and controls deterioration in viewing characteristics due to the change. Multi-display system.   The multi-display system according to any one of claims 1 to 3, wherein the control unit corrects and controls visibility / resolution deterioration depending on a viewing distance. A display adjustment method for a multi-display combining a plurality of displays,
A display step for displaying a moving image across each display as a test pattern;
Capturing a moving image obtained by photographing the test pattern;
The discontinuity between the displays is detected from the discontinuous image in the moving image captured in the capturing step, and the delay caused between the display images on each display based on the detected width of the discontinuity A delay time calculating step for calculating time;
And a control step of performing display control for delaying display timing of a display in which no delay occurs based on the delay time . In a multi-display system that combines multiple displays,
Processing to display moving images across each display as a test pattern;
Processing to capture a moving image obtained by photographing the test pattern;
A discontinuous portion between the displays is detected from an image of the discontinuous portion in the captured moving image, and a delay time generated between display images of the respective displays is calculated based on the detected width of the discontinuous portion. Processing,
A program for performing display control for delaying a display timing of a display in which no delay occurs based on the delay time .

Images