JP2011077825A - Display device, display system, display method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve sharper image display by correcting a variation in display state caused by aging or the like. <P>SOLUTION: In a display system 100, a display device 1 and an imaging apparatus 2 are connected over a predetermined communication network N. The display device includes: a display control part 101b for displaying a display adjustment image on an organic EL display panel 101a; an image capturing part 103a for capturing an adjustment capture image generated by capturing the display adjustment image through the imaging apparatus; an image comparing part 103c for comparing the adjustment capture image captured by the image capturing part with the display adjustment image; and a display adjusting part 101c for adjusting a display state of a display part based on a result of comparison by the image comparing part. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a display device, a display system, a display method, and a program that display an image captured by an imaging device.

Conventionally, there has been known an image display device that has a built-in illuminance sensor and displays the color to be displayed more optimally by adjusting the luminance and color tone according to the illuminance of outside light, thereby improving the visibility of the image ( For example, see Patent Document 1).
There is also known a pixel defect compensation device that identifies a defective pixel of a display device at a product shipment stage and transmits a video signal partially compensated for the defective pixel (see, for example, Patent Document 2). .

JP 2006-267144 A Japanese Patent Laid-Open No. 6-195048

  However, in the case of Patent Document 2, defective pixels are compensated at the time of product shipment, and there is no effective correction means for pixels that have caused unevenness in brightness or burn-in due to secular change or the like. . In addition, there is a problem that conventional screen savers and burn-in prevention means such as a method of dispersing high luminance cannot cope with luminance unevenness or pixels that cause burn-in.

  Therefore, an object of the present invention is to provide a display device, a display system, a display method, and a program that can correct a change in display state due to a secular change or the like and can realize a clearer image display. .

In order to solve the above-described problem, a display device according to claim 1 is provided.
Display control means for displaying a display adjustment image on the display means, acquisition means for acquiring an adjustment captured image generated by the display adjustment image being captured by the imaging means, and acquired by the acquisition means Comparing means for comparing the picked-up image for adjustment and the display adjusting image, and display adjusting means for adjusting the display state of the display means based on the comparison result by the comparing means. .

The invention according to claim 2 is the display device according to claim 1,
The apparatus further includes a displacement correction unit that corrects a displacement between the captured image for adjustment acquired by the acquisition unit and the display adjustment image, and the comparison unit corrects the displacement by the displacement correction unit. The adjustment-captured image and the display adjustment image are compared.

The invention described in claim 3 is the display device according to claim 1 or 2,
The imaging means captures a mirror image of the display adjustment image displayed on the display means, and generates the adjustment captured image by mirroring the mirror image of the display adjustment image captured by the imaging means. It is characterized by further comprising a generating means.

Invention of Claim 4 is a display apparatus as described in any one of Claims 1-3,
The display means includes a plurality of self-luminous pixels, and the comparison means is configured to select another pixel from the plurality of pixels based on a comparison result between the adjustment-use captured image and the display adjustment image. And a pixel specifying unit for specifying a pixel having a difference in light emission state, and the display adjusting unit adjusts the display state of the display unit based on the light emission state of the pixel specified by the pixel specifying unit. It is characterized by that.

The invention according to claim 5 is the display device according to claim 4,
The display adjustment means adjusts the display state of the display means by correcting the light emission state of the peripheral pixels of the pixel specified by the pixel specifying means so that the light emission states of the plurality of pixels are substantially equal. It is a feature.

The invention according to claim 6 is the display device according to claim 4 or 5,
The plurality of pixels are provided corresponding to a plurality of color components, and the pixel specifying means is a pixel related to the plurality of color components based on a comparison result between the adjustment captured image and the display adjustment image. The pixel relating to any one of the color components and the pixel relating to the color component in which the light emission state is different are identified, and the display adjustment means causes the light emission states of the pixels relating to the plurality of color components to be substantially equal. As described above, the display state of the display unit is adjusted by correcting the light emission state of pixels of color components other than the pixel relating to the color component specified by the pixel specifying unit.

The invention according to claim 7 is the display device according to any one of claims 1 to 3,
The display means includes a plurality of reflective non-light emitting pixels provided corresponding to a plurality of color components, and the comparison means compares the captured image for adjustment and the display adjustment image. A color component specifying means for specifying a color component that is colored more strongly than other color components among the plurality of color components,
The display adjusting means adjusts the display state of the display means based on the color development state of the color component specified by the color component specifying means.

The invention according to claim 8 is the display device according to claim 7,
The display adjusting unit adjusts the color state of the color component specified by the color component specifying unit so as to make the color state of the pixels related to the plurality of color components substantially equal, and adjusts the display state of the display unit It is characterized by doing.

The display system of the invention according to claim 9 is,
A display system including a display control unit that displays a display adjustment image on a display unit and an imaging device connected via a predetermined communication line, the imaging device being displayed on the display unit An imaging unit that captures the display adjustment image to generate an adjustment captured image, and a transmission unit that transmits the adjustment captured image generated by the imaging unit to the display device via the predetermined communication line And the display device receives the adjustment captured image transmitted from the transmission unit via the predetermined communication line, and acquires the adjustment captured image received by the reception unit. Acquiring means, comparing means for comparing the captured image for adjustment acquired by the acquiring means and the display adjustment image, and based on the comparison result by the comparing means, It is characterized by comprising a display adjusting means for adjusting a display state, the.

The display method of the invention according to claim 10 is:
A display method using a display device, a process of displaying a display adjustment image on the display device, and a process of obtaining an adjustment captured image generated by capturing the display adjustment image by an imaging unit A process of comparing the acquired captured image for adjustment with the display adjustment image and a process of adjusting the display state of the display unit based on the comparison result are performed.

The program of the invention described in claim 11 is
Display control means for displaying a display adjustment image on a display means on a computer of a display device, acquisition means for acquiring a picked-up image for adjustment generated by picking up the display adjustment image by the image pickup means, and this acquisition means And a display adjusting unit that adjusts a display state of the display unit based on a comparison result by the comparing unit. It is a feature.

  According to the present invention, it is possible to correct a change in display state due to a secular change or the like, and it is possible to realize a clearer image display.

It is a figure which shows typically schematic structure of the display system of one Embodiment to which this invention is applied. It is a block diagram which shows schematic structure of the display apparatus which comprises the display system of FIG. It is a figure which shows typically an example of the image for display adjustments concerning the display apparatus of FIG. It is a block diagram which shows schematic structure of the imaging device which comprises the display system of FIG. 3 is a flowchart illustrating an example of an operation related to display adjustment processing by the display system of FIG. 1. FIG. 11 is a block diagram illustrating a schematic configuration of a display device that constitutes a display system according to a first modification. It is a flowchart which shows an example of the operation | movement which concerns on the display adjustment process by the display system of FIG. FIG. 10 is a block diagram illustrating a schematic configuration of a display device according to a second modification.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.
FIG. 1 is a diagram schematically showing a schematic configuration of a display system 100 according to an embodiment to which the present invention is applied.

  As shown in FIG. 1, the display system 100 according to the present embodiment is a system in which a display device 1 and an imaging device 2 are connected via a predetermined communication network N (see FIG. 2 and the like). The display device 1 acquires the adjustment-use captured image generated by the display-adjustment image displayed on the display unit 101 being captured by the image-capturing unit 201 of the imaging device 2, and displays the adjustment-captured image and the display image. The adjustment image is compared, and the display state of the display unit 101 is adjusted based on the comparison result.

First, the display device 1 will be described with reference to FIGS.
FIG. 2 is a block diagram illustrating a schematic configuration of the display device 1. FIG. 3 is a front view of the display device 1 and schematically shows an example of a test pattern image.
As shown in FIG. 2, the display device 1 includes a display unit 101, a test image storage unit 102, an image processing unit 103, a memory 104, a recording medium 105, a communication control unit 106, and an operation input unit 107. The central control unit 108 is provided. Further, the display device 1 is configured to be able to communicate with the imaging device 2 connected to the communication network N.

The display unit 101 includes an organic EL display panel 101a and a display control unit 101b.
In the organic EL display panel 101a, a plurality of self-luminous organic EL (Electro Luminescence) elements are arranged in a matrix corresponding to color components of R (red), G (green), and B (blue).

The display control unit 101b performs control to read image data for display and display it on the organic EL display panel 101a. That is, the display control unit 101b reads display image data stored in the recording medium 105 or the test image storage unit 102, converts a drive signal (voltage signal) corresponding to the input image signal into a current signal, and drives the display image data. By supplying current to the organic EL element, an image is displayed on the organic EL display panel 101a.
Specifically, the display control unit 101b reads the display adjustment image data d1 stored in the test image storage unit 102, and specifies each color solid image when specifying the luminance deteriorated pixel among the plurality of pixels. A grid-like test pattern image (display adjustment image) is displayed on the organic EL display panel 101a. Further, the display control unit 101b reads the display adjustment image data d1 stored in the test image storage unit 102, and turns on all the pixels when detecting the luminance level difference between the R, G, and B pixels. Then, a solid display (white display) display adjustment image is displayed on the organic EL display panel 101a.
Here, the display control unit 101b constitutes display control means for displaying an image for display adjustment on the organic EL display panel (display means) 101a.

The display control unit 101b also includes a display adjustment unit 101c that adjusts the display state of the organic EL display panel 101a based on the comparison result between the display adjustment image data d1 and the adjustment captured image data d2 by the image comparison unit 103c. It has.
Specifically, the display adjustment unit 101c is based on the light emission state of a luminance-degraded pixel that has a difference in light emission state from other pixels among the plurality of pixels specified by the pixel specifying unit 103d of the image comparison unit 103c. Thus, the display state of the organic EL display panel 101a is adjusted by correcting the light emission state of the peripheral pixels of the luminance deteriorated pixel so that the light emission states of the plurality of pixels become substantially equal.
In addition, the display adjustment unit 101c has a difference in light emission state from pixels of other color components among the pixels related to the R, G, and B color components specified by the pixel specifying unit 103d of the image comparison unit 103c. Based on the light emission state of the luminance deteriorated color component pixel related to the color component, light emission of pixels of color components other than the luminance deteriorated color component pixel so that the light emission states of the pixels related to the R, G, B color components become substantially equal. Correct the condition. That is, the display adjustment unit 101c performs correction so as to match the maximum value of the luminance of the pixels of the other color components in accordance with the minimum value of the luminance of the pixels of the color component in which the luminance deterioration has advanced among R, G, and B. As a result, the display state of the organic EL display panel 101a is adjusted.
Here, the display adjustment unit 101c constitutes a display adjustment unit that adjusts the display state of the organic EL display panel 101a based on the comparison result by the image comparison unit 103c.

The test image storage unit 102 stores display adjustment image data d1 for adjusting the display state of the organic EL display panel 101a.
The display adjustment image data d1 is, for example, a solid test pattern image (see FIG. 3) of each color for specifying the luminance-degraded pixels, or a solid display for detecting the luminance level difference between the R, G, and B pixels. (White display) Data relating to an image.

  The image processing unit 103 includes an image acquisition unit 103a, a shift correction unit 103b, and an image comparison unit 103c.

The image acquisition unit 103 a acquires the YUV data of the adjustment captured image received by the communication control unit 106. That is, the image acquisition unit 103a captures a display adjustment image displayed on the display unit 101 of the display device 1 by an imaging unit 201 (described later) of the imaging device 2 and generates the image adjustment unit 202a (described later). YUV data of the adjustment-use captured image is acquired.
Here, the image acquisition unit 103a constitutes an acquisition unit that acquires the adjustment-purpose captured image generated by the display adjustment image being captured by the imaging device 2.

The shift correction unit 103b corrects a positional shift between the adjustment-purpose captured image data d2 acquired by the image acquisition unit 103a and the display adjustment-use image data d1 as a shift correction unit.
Here, the adjustment captured image is an image including a substantially rectangular outer frame panel portion of the display device 1 in the periphery in addition to the display adjustment image portion displayed on the organic EL display panel 101a. The misalignment correction unit 103b corrects the inclination (distortion) of the XYZ axes when the adjusted captured image is captured with reference to the four corners of the outer frame panel, that is, the adjusted captured image is used for display adjustment. A coordinate conversion formula (projection conversion matrix) of each pixel is calculated so as to have a substantially rectangular shape similar to the image. Then, the shift correction unit 103b performs projective conversion on each pixel of the adjustment captured image according to the calculated coordinate conversion formula, and then displays the display adjustment image portion and the display adjustment image of the adjustment captured image after the projective conversion. By adjusting the size so as to be substantially equal, the positional deviation between the adjustment-use captured image and the display adjustment image is corrected.
Note that the adjustment captured image may be an image of only the display adjustment image portion displayed on the organic EL display panel 101a. In this case, at least four pixels (for example, arranged at a predetermined interval) (for example, By coloring the four corner pixels) so as to be distinguishable from other pixels, the four pixels are used to correct the inclination of the XYZ axes when the adjustment image is captured. . Further, when the adjustment captured image is a lattice-shaped test pattern image, distortion of any lattice may be used.
Here, the deviation correction unit 103b constitutes a deviation correction unit that corrects a positional deviation between the adjustment-purpose captured image data d2 acquired by the image acquisition unit 103a and the display adjustment-use image data d1.

The image comparison unit 103c compares the adjustment-captured image data d2 whose positional deviation is corrected by the deviation correction unit 103b and the display adjustment image data d1.
Specifically, the image comparison unit 103c matches the corresponding pixels of the display adjustment image portion of the adjustment-purpose captured image with the display adjustment image, and compares these pixels. Then, the pixel specifying unit (pixel specifying unit) 103d of the image comparison unit 103c causes luminance degradation due to long-time emission based on the comparison result, and other pixels are selected from the plurality of pixels of the organic EL display panel 101a. A luminance-degraded pixel that has a difference in light emission state or a color that has a difference in light emission state from pixels of other color components among pixels relating to the R, G, and B color components of the organic EL display panel 101a An abnormal pixel such as a luminance degradation color component pixel related to the component is specified.
Here, the image comparison unit 103c constitutes a comparison unit that compares the adjustment captured image data d2 acquired by the image acquisition unit 103a with the display adjustment image data d1.

  The memory 104 is constituted by, for example, a DRAM or the like, and temporarily stores data or the like processed by the central control unit 108 or the like.

  The recording medium 105 is constituted by, for example, a nonvolatile memory (flash memory). The recording medium 105 stores still images and moving images displayed on the display unit 101, and records still image data encoded in a predetermined compression format and moving image data including a plurality of image frames. To do.

The communication control unit 106 includes, for example, a communication antenna, a communication circuit (not shown), and the like, and the imaging device 2 connected via the communication network N according to a predetermined communication standard such as a wireless local area network (LAN). Control communication of information between.
Specifically, the communication control unit 106 receives YUV data of the adjustment-use captured image transmitted from the imaging device 2 via the communication network N as a reception unit.

  The communication network N is, for example, a communication network N constructed using a dedicated line or an existing general public line, and has various line forms such as a LAN (Local Area Network) and a WAN (Wide Area Network). It is possible to apply. The communication network N includes, for example, various communication line networks such as a telephone line network, an ISDN line network, a dedicated line, a mobile communication network, a communication satellite line, and a CATV line network, and an Internet service provider that connects them. included.

  The operation input unit 107 includes an operation unit configured by, for example, data input keys for inputting numerical values, characters, and the like, up / down / left / right movement keys for performing data selection, feed operation, and various function keys. A predetermined operation signal is output to the central control unit 108 according to the operation of these operation units.

  The central control unit 108 controls each unit of the display device 1. Specifically, the central control unit 108 includes a CPU, a RAM, and a ROM (all not shown), and performs various control operations according to various processing programs (not shown) for the display device 1.

Next, the imaging device 2 will be described with reference to FIG.
FIG. 4 is a block diagram illustrating a schematic configuration of the imaging apparatus 2.
As illustrated in FIG. 4, the imaging device 2 includes an imaging unit 201, an image data generation unit 202, a memory 203, a display control unit 204, a display unit 205, a recording medium 206, a communication control unit 207, An operation input unit 208 and a central control unit 209 are provided. The imaging device 2 is configured to be able to communicate with the display device 1 connected to the communication network N.

The imaging unit 201 captures a subject and generates an image frame. Specifically, the imaging unit 201 is not illustrated, but includes a lens unit including a plurality of lenses such as a zoom lens and a focus lens, a diaphragm for adjusting the amount of light passing through the lens unit, and a CCD ( The image sensor includes an electronic image pickup unit that includes an image sensor such as a charge coupled device (CMOS) or a complementary metal-oxide semiconductor (CMOS), and converts an optical image that has passed through various lenses of the lens unit into a two-dimensional image signal.
In addition, the imaging unit 201 includes an imaging control unit including a timing generator, a driver, and the like, although not illustrated. Then, the imaging control unit scans and drives the electronic imaging unit with a timing generator and a driver, converts the optical image into a two-dimensional image signal with the electronic imaging unit every predetermined cycle, and starts from the imaging region of the electronic imaging unit. Image frames are read for each screen and output to the image data generation unit 202.
The imaging control unit performs AE (automatic exposure processing), AF (automatic focusing processing), AWB (automatic white balance), and the like as adjustment control of imaging conditions.

The image data generation unit 202 appropriately adjusts the gain for each of the RGB color components with respect to the analog value signal of the image data transferred from the electronic imaging unit, and then samples and holds it by a sample hold circuit (not shown). The digital data is converted into digital data by a D converter (not shown), and color processing including pixel interpolation processing and γ correction processing is performed by a color process circuit (not shown), and then a luminance signal Y and a color difference signal Cb, Cr (image data in YUV color space) is generated.
The luminance signal Y and the color difference signals Cb and Cr output from the color process circuit are DMA-transferred to a memory 203 used as a buffer memory via a DMA controller (not shown).

The imaging unit 201 captures the display adjustment image displayed on the display unit 101 of the display device 1 and includes the display adjustment image (including the outer frame panel portion of the display device 1) that has passed through the various lenses of the lens unit. ) Is converted into a two-dimensional image signal by the electronic imaging unit. The image data generation unit 202 generates YUV data of a digital value adjustment image-captured image based on the analog value image data of the display adjustment image transferred from the electronic imaging unit.
Here, the imaging unit 201 and the image data generation unit 202 constitute an imaging unit that captures a display adjustment image displayed on the display unit 101 of the display device 1 and generates an adjustment captured image.

  The memory 203 is composed of, for example, a DRAM or the like, and temporarily stores data processed by the central control unit 209 or the like.

The display control unit 204 performs control for reading display image data temporarily stored in the memory 203 and displaying the read image data on the display unit 205.
Specifically, the display control unit 204 includes a VRAM, a VRAM controller, a digital video encoder, and the like. The digital video encoder reads the luminance signal Y and the color difference signals Cb and Cr read from the memory 203 and stored in the VRAM (not shown) under the control of the central control unit 209 via the VRAM controller. Are periodically read out, and a video signal is generated based on these data and output to the display unit 205.

  The display unit 205 is, for example, a liquid crystal display device, and displays an image captured by the electronic imaging unit based on a video signal from the display control unit 204 on a display screen. Specifically, the display unit 205 updates the live view image while sequentially updating a plurality of image frames generated by imaging the subject by the imaging unit 201 in the still image capturing mode or the moving image capturing mode. indicate. The display unit 205 displays an image recorded as a still image (rec view image) or an image being recorded as a moving image.

  The recording medium 206 is composed of, for example, a non-volatile memory (flash memory) or the like, and records still image data for recording encoded in a predetermined compression format and moving image data including a plurality of image frames.

The communication control unit 207 includes, for example, a communication antenna, a communication circuit (not shown), and the like, and the display device 1 connected via the communication network N according to a predetermined communication standard such as a wireless LAN (Local Area Network). Control communication of information between.
Specifically, the communication control unit 207 transmits YUV data of the adjustment captured image generated by the image data generation unit 202 to the display device 1 via the communication network N as a transmission unit.

  The operation input unit 208 is for performing a predetermined operation of the imaging apparatus 2. Specifically, the operation input unit 208 includes a shutter button related to an instruction to shoot a subject, a selection determination button related to an instruction to select an imaging mode, a function, etc., a zoom button related to an instruction to adjust the zoom amount, and the like (all shown) Abbreviation), a predetermined operation signal is output to the central control unit 209 in accordance with the operation of these buttons.

  The central control unit 209 controls each unit of the imaging device 2. Specifically, the central control unit 209 includes a CPU, a RAM, and a ROM (all not shown), and performs various control operations according to various processing programs and data (not shown) for the imaging device 2.

Next, display adjustment processing by the display system 100 of the present embodiment will be described with reference to FIG.
FIG. 5 is a flowchart illustrating an example of an operation related to the display adjustment process.

As shown in FIG. 5, the display control unit 101b of the display device 1 reads the display adjustment image data d1 stored in the test image storage unit 102, and performs a predetermined display adjustment image (for example, a test pattern image or the like). ) Is displayed on the organic EL display panel 101a (step S1).
Subsequently, the communication control unit 106 of the display device 1 transmits an imaging instruction for the display adjustment image to the imaging device 2 via the communication network N (step S2).

When the communication control unit 207 of the imaging device 2 receives an imaging instruction transmitted from the display device 1 via the communication network N (step S3), the central control unit 209 determines a predetermined shutter button of the operation input unit 208 by the user. It is determined whether an imaging instruction has been input based on the operation (step S4).
If it is determined that an imaging instruction has been input (step S4; YES), the imaging unit 201 uses an electronic imaging unit to display an optical image of the display adjustment image displayed on the display device 1 under a predetermined exposure condition. After image capturing, the image data generation unit 202 generates YUV data of the digital value adjustment image based on the analog value image data of the display adjustment image transferred from the electronic image capturing unit (step S5).
Subsequently, the communication control unit 207 of the imaging device 2 transmits the YUV data of the adjustment-purpose captured image generated by the image data generation unit 202 to the display device 1 via the communication network N (step S6).

  When the communication control unit 106 of the display device 1 receives the YUV data of the adjustment-use captured image transmitted from the imaging device 2 via the communication network N (step S7), the image acquisition unit 103a of the image processing unit 103 performs communication. After acquiring the YUV data of the adjustment-use captured image received by the control unit 106, the deviation correction unit 103b is positioned between the adjustment-use captured image data d2 and the display adjustment-use image data d1 acquired by the image acquisition unit 103a. The deviation is corrected (step S8). Specifically, the shift correction unit 103b corrects the inclination (distortion) of the XYZ axes when the adjustment-purpose captured image is captured, that is, the adjustment-captured image has a similar shape to the display adjustment image. A coordinate conversion formula (projection conversion matrix) of each pixel is calculated so as to have a rectangular shape. Then, the shift correction unit 103b performs projective conversion on each pixel of the adjustment captured image according to the calculated coordinate conversion formula, and then displays the display adjustment image portion and the display adjustment image of the adjustment captured image after the projective conversion. By adjusting the size so as to be substantially equal, the positional deviation between the adjustment-use captured image and the display adjustment image is corrected.

Next, the image comparison unit 103c of the image processing unit 103 compares the adjustment-captured image data d2 whose positional deviation is corrected by the deviation correction unit 103b with the display adjustment-use image data d1 (step S9). Specifically, the image comparison unit 103c matches the corresponding pixels of the display adjustment image portion of the adjustment-purpose captured image with the display adjustment image, and compares these pixels.
Then, the pixel specifying unit 103d of the image comparison unit 103c determines whether there is an abnormal pixel, that is, a plurality of pixels, based on the comparison result between the adjustment-captured image data d2 in which the positional deviation is corrected and the display adjustment image data d1. In other words, the luminance-degraded pixels having a difference in light emission state from other pixels, and the color components having a difference in light emission state from pixels of other color components among the pixels related to the R, G, B color components. The luminance deterioration color component pixel is specified (step S10).

Next, the display adjustment unit 101c of the display device 1 adjusts the display state of the organic EL display panel 101a based on the comparison result between the display adjustment image data d1 and the adjustment captured image data d2 by the image comparison unit 103c. (Step S11). Specifically, the display adjustment unit 101c includes a plurality of pixels based on the light emission state of the luminance deteriorated pixel in which the light emission state is different from the other pixels among the plurality of pixels specified by the pixel specifying unit 103d. The light emission states of the peripheral pixels of the luminance-degraded pixel are corrected so that the light emission states of the pixels are substantially equal, or the other color components of the pixels related to the R, G, and B color components specified by the pixel specifying unit 103d are corrected. Based on the light emission state of the luminance deteriorated color component pixel relating to the color component in which the difference between the pixel and the light emission state occurs, the luminance deteriorated color is set so that the light emission state of the pixel relating to the R, G, B color component is substantially equal. The light emission state of the pixel of the color component other than the component pixel is corrected.
Thereby, the display adjustment process is terminated.

  As described above, according to the display system 100 of the present embodiment, the display device 1 uses the adjustment generated by the display adjustment image displayed on the display unit 101 being imaged by the imaging unit 201 of the imaging device 2. Image is acquired, the adjustment image is compared with the display adjustment image, and the display state of the display unit 101 is adjusted based on the comparison result. Even if the display state varies, the variation can be corrected. In other words, even when a specific pixel of the organic EL display panel 101a emits light for a long time, the luminance of only the pixel is deteriorated, the change in the display state can be corrected, and even if it changes over time, it becomes clearer. Image display can be realized, and the product life can be extended.

Further, based on the comparison result between the adjustment captured image and the display adjustment image, a difference in light emission state from other pixels among the plurality of pixels of the organic EL display panel 101a in which luminance degradation has occurred due to light emission for a long time. Therefore, the display state of the organic EL display panel 101a is adjusted by correcting the light emission state of the peripheral pixels of the luminance deterioration pixel so that the light emission state of the plurality of pixels becomes substantially equal. Even when the pixel has a half-life that is earlier than that of the other pixels due to long-time light emission of the specific pixel, the change in the display state of the organic EL display panel 101a can be appropriately corrected.
In addition, among the pixels related to the R, G, and B color components of the organic EL display panel 101a that have undergone luminance degradation due to long-time emission based on the comparison result between the adjustment captured image and the display adjustment image. The luminance-degraded color component pixel relating to the color component having a difference in the light emission state from the other color component pixels is specified, and the luminance is set so that the light emission states of the pixels relating to the R, G, and B color components are substantially equal. Since the display state of the organic EL display panel 101a is adjusted by correcting the light emission state of the color component pixels other than the deteriorated color component pixels, the organic EL display panel 101a can be used even when the half-life differs for each color component. The display state fluctuations can be corrected appropriately.

  In addition, since the misalignment between the adjustment captured image and the display adjustment image is corrected, even when the display adjustment image displayed on the display device 1 is captured by the handheld image capturing device 2, the misalignment is corrected. The comparison captured image and the display adjustment image can be appropriately compared, and the display state of the display unit 101 can be appropriately adjusted based on the comparison result.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
Below, the modification of the display system 100 is demonstrated.

<Modification 1>
FIG. 6 is a block diagram illustrating a schematic configuration of the display device 1 included in the display system 100 of the first modification.
The display system 100 according to the first modification includes a plurality of color components related to each pixel of the reflective liquid crystal display panel 301a based on the comparison result between the adjustment captured image displayed on the liquid crystal display panel 301a and the display adjustment image. Among them, an abnormal color component that is colored more strongly than the other color components is specified, and the display state of the liquid crystal display panel 301a is adjusted based on the color development state of the pixels related to the abnormal color component.
Note that the display system 100 of Modification 1 has substantially the same configuration as the display system 100 of the above embodiment except for the points described below, and a description thereof will be omitted.

As shown in FIG. 6, the display unit 301 of the display device 1 includes a liquid crystal display panel 301a.
The liquid crystal display panel 301a includes a plurality of reflective non-light emitting pixels arranged in a matrix corresponding to color components of R (red), G (green), and B (blue).

The display control unit 301b performs control to read out display image data stored in the recording medium 105 or the test image storage unit 102 and display it on the liquid crystal display panel 301a.
Further, the display adjustment unit 301c of the display control unit 301b is abnormally colored more strongly than the other color components among the R, G, and B color components specified by the color component specifying unit 303d of the image comparison unit 303c. The display state of the liquid crystal display panel 301a is adjusted based on the color development state of the color component. That is, the display adjustment unit 301c averages and attenuates the color development state in which the abnormal color component is strengthened so that the color development states of the pixels related to the R, G, and B color components of the liquid crystal display panel 301a are substantially equal. Specifically, the display adjustment unit 301c uses a complementary color relationship such as R: C, G: M, and B: Y, for example, for a solid display (white display) image as a display adjustment image. When there are many (strong) yellow (Y) components in the adjustment imaged image data d2, the distribution of each color component is increased so that the blue (B) component, which is a complementary color, is increased with respect to the other color components (R, G). Is corrected to adjust the display state of the liquid crystal display panel 301a.

The image comparison unit 303c is a color component specifying unit (color) that specifies an abnormal color component that is colored more strongly than other color components among the R, G, and B color components of the plurality of pixels of the liquid crystal display panel 301a. Component specifying means) 303d.
Specifically, the color component specifying unit 303d, based on a comparison result between the adjustment captured image data d2 in which the positional deviation is corrected and the display adjustment image d1, out of the plurality of color components of the liquid crystal display panel 301a. An abnormal color component that is colored more strongly than other color components due to the influence of external light is identified.

Next, display adjustment processing by the display system 100 of the present embodiment will be described with reference to FIG.
FIG. 7 is a flowchart illustrating an example of an operation related to the display adjustment process.

As shown in FIG. 7, the display control unit 301b of the display device 1 reads the display adjustment image data d1 stored in the test image storage unit 102, and performs a predetermined display adjustment image (for example, a solid display image). ) Is displayed on the liquid crystal display panel 301a (step S1).
Subsequently, similarly to the display adjustment process of the above-described embodiment, the communication control unit 106 of the display device 1 transmits an instruction to capture an image for display adjustment to the imaging device 2 via the communication network N (step S2).

  Similar to the display adjustment process of the above-described embodiment, the imaging device 2 receives the imaging instruction (step S3), determines the input of the imaging instruction (step S4), generates the adjusted captured image data d2 (step S5), The adjusted captured image data d2 is transmitted (step S6).

  When the communication control unit 106 of the display device 1 receives the YUV data of the adjustment-use captured image transmitted from the imaging device 2 via the communication network N, similarly to the display adjustment process of the above-described embodiment (step S7), the image is displayed. After the image acquisition unit 103a of the processing unit 103 acquires the YUV data of the adjustment-use captured image received by the communication control unit 106, the deviation correction unit 103b includes the adjustment-use captured image data d2 acquired by the image acquisition unit 103a. The positional deviation from the display adjustment image data d1 is corrected (step S8).

  Next, the image comparison unit 303c of the image processing unit 103, as in the display adjustment process of the above-described embodiment, the adjustment captured image data d2 and the display adjustment image data d1 whose positional deviation is corrected by the deviation correction unit 103b. Are compared (step S9). Then, the color component specifying unit 303d of the image comparison unit 303c determines the abnormal color component, that is, the liquid crystal display panel based on the comparison result between the adjustment-captured image data d2 in which the positional deviation is corrected and the display adjustment image data d1. Among the R, G, and B color components related to the plurality of pixels 301a, an abnormal color component that is colored more strongly than the other color components is identified (step S110).

Next, the display adjustment unit 301c of the display device 1 adjusts the display state of the liquid crystal display panel 301a based on the comparison result between the display adjustment image data d1 and the adjustment captured image data d2 by the image comparison unit 303c ( Step S111). Specifically, the display adjustment unit 301c is based on the coloring state of abnormal color components that are colored more strongly than other color components among the R, G, and B color components specified by the color component specifying unit 303d. Thus, the display state of the liquid crystal display panel 301a is adjusted by averaging and attenuating the color development state in which the abnormal color component is strengthened so that the color development states of the pixels related to the R, G, and B color components are substantially equal. .
Thereby, the display adjustment process is terminated.

  Therefore, according to the display system 100 of the first modification, based on the comparison result between the adjustment captured image displayed on the liquid crystal display panel 301a and the display adjustment image, each pixel of the reflective liquid crystal display panel 301a is related. Among the R, G, and B color components, an abnormal color component that is colored more strongly than the other color components is specified, and the display of the liquid crystal display panel 301a is performed based on the color development state of the pixels related to the abnormal color component. Since the state is adjusted, one of the R, G, and B color components related to each pixel of the reflective liquid crystal display panel 301a is affected by the external light and is colored more strongly than the other color components. Even if it is applied, the liquid crystal display panel can be obtained by averaging and attenuating the colored state in which the abnormal color component is strengthened so that the colored state of the pixels relating to the R, G, and B color components is substantially equal. Change of display state of 301a Can be corrected, it can be realized a clearer image displayed by aging.

  In the above-described embodiment and Modification 1, the display device 1 and the imaging device 2 are exemplified to be configured to be capable of information communication via a predetermined communication network N. However, the configuration of the display system 100 is as follows. However, the present invention is not limited to this. For example, the display device 1 replaces the recording medium for recording the adjustment-use captured image data d2 generated by imaging the display adjustment image by the imaging device 2, and the display device 1 uses the recording medium. The adjustment-captured image data d2 may be read out and acquired.

In the embodiment and the modification 1, the correction of the inclination (distortion) of the XYZ axes of the adjustment-purpose captured image is performed on the display device 1 side, but may be performed on the imaging device 2 side. good. That is, for example, the imaging device 2 uses a function of correcting a business card or white board as if it was taken from the front without taking a picture from the front, so that the outer frame panel of the display device 1 can be obtained from the adjustment-use captured image data d2. The contour part (outer shape) of the organic EL display panel 101a and the contour part of the organic EL display panel 101a are detected and deformed so that the contour part has a substantially rectangular shape, thereby correcting the inclination of the XYZ axes of the adjustment-purpose captured image.
Further, display adjustment image data d1 is stored in the image pickup apparatus 2, and the correction of the positional deviation between corresponding pixels of the display adjustment image data d1 and the shape adjustment deformed image pickup image data d2 is performed. It may be performed on the second side.

<Modification 2>
FIG. 8 is a block diagram illustrating a schematic configuration of a display device 401 according to the second modification.
The display device 401 according to the second modification uses the imaging unit 411 to capture a mirror image of the display adjustment image displayed on the display unit 101, and generates an adjustment captured image by mirroring the mirror image of the display adjustment image. . The display device 401 compares the adjustment captured image with the display adjustment image, and adjusts the display state of the display unit 101 based on the comparison result.
Note that the display device 401 according to the second modification has substantially the same configuration as the display device 1 of the display system 100 according to the above-described embodiment except for the points described below, and the description thereof is omitted.

As illustrated in FIG. 8, the display device 401 includes an imaging unit 411 and an image data generation unit 412.
The imaging unit 411 has substantially the same configuration as the imaging unit 201 of the imaging device 2 of the above embodiment. That is, the imaging unit 411 captures a subject and generates an image frame. Specifically, the imaging unit 411 is not illustrated, but includes a lens unit including a plurality of lenses such as a zoom lens and a focus lens, a diaphragm for adjusting the amount of light passing through the lens unit, and a CCD ( The image sensor includes an electronic image pickup unit that includes an image sensor such as a charge coupled device (CMOS) or a complementary metal-oxide semiconductor (CMOS), and converts an optical image that has passed through various lenses of the lens unit into a two-dimensional image signal.
The imaging unit 411 includes an imaging control unit that includes a timing generator, a driver, and the like, although not shown. Then, the imaging control unit scans and drives the electronic imaging unit with a timing generator and a driver, converts the optical image into a two-dimensional image signal with the electronic imaging unit every predetermined cycle, and starts from the imaging region of the electronic imaging unit. Image frames are read out for each screen and output to the image data generation unit 412.
The imaging control unit performs AE (automatic exposure processing), AF (automatic focusing processing), AWB (automatic white balance), and the like as adjustment control of imaging conditions.

  Then, when an imaging instruction is input as an imaging unit based on a predetermined operation of a shutter button (not shown) of the operation input unit 107 by the user, the imaging unit 411 displays the display adjustment image displayed on the display unit 101. A mirror image is captured, and an optical image of a mirror image (including the outer frame panel portion of the display device 401) of the display adjustment image that has passed through the various lenses of the lens unit is converted into a two-dimensional image signal by the electronic imaging unit.

The image data generation unit 412 has substantially the same configuration as the image data generation unit 202 of the imaging device 2 of the above embodiment. That is, the image data generation unit 412 appropriately adjusts the gain for each color component of RGB with respect to the analog value signal of the image data transferred from the electronic imaging unit, and then performs sample holding by a sample hold circuit (not shown). The digital data is converted into digital data by an A / D converter (not shown), color processing including pixel interpolation processing and γ correction processing is performed by a color process circuit (not shown), and then a digital luminance signal Y and color difference signal Cb, Cr (YUV color space image data) is generated.
The luminance signal Y and the color difference signals Cb and Cr output from the color process circuit are DMA-transferred to a memory 104 used as a buffer memory via a DMA controller (not shown).

Then, the image data generation unit 412 captures the mirror image of the display adjustment image by the imaging unit 411, based on the image data of the analog value of the mirror image of the display adjustment image transferred from the electronic imaging unit. After the mirror image is mirrored, YUV data of the digital value adjustment captured image is generated.
Here, the image data generation unit 412 constitutes a generation unit that generates a captured image for adjustment by mirroring a mirror image of the display adjustment image.

In addition, the image processing unit 103 acquires YUV data of the adjustment captured image generated by the image data generation unit 412 by the image acquisition unit 103a. Then, the image processing unit 103 uses the image comparison unit 103c to compare the adjustment captured image data d2 and the display adjustment image data d1 whose positional deviation has been corrected by the deviation correction unit 103b.
Thereafter, the display adjustment unit 101c of the display unit 101 adjusts the display state of the organic EL display panel 101a based on the comparison result between the display adjustment image data d1 and the adjustment captured image data d2 by the image comparison unit 103c.

  Therefore, according to the display device 401 of the second modification, the mirror image of the display adjustment image displayed on the display unit 101 is picked up by the image pickup unit 411, and the mirror image of the display adjustment image is mirror-operated to pick up the adjustment image. Since the image is generated by the image data generation unit 412, the use of a mirror eliminates the need for an imaging device as an external device, and the display device 1 has a simpler configuration to cope with correction of display state variation due to secular change or the like. be able to.

  In the second modification, the configuration in which the display unit 101 includes the organic EL display panel 101a is illustrated, but the configuration in which the liquid crystal display panel 301a is provided as in the first modification may be employed.

In the above-described embodiment, the adjustment-captured image data d2 and the display-adjustment image data d1 in which the positional deviation is corrected are compared by the image comparison units 103c and 303c of the display devices 1 and 401. Whether or not to correct the misalignment can be arbitrarily changed as appropriate.
In addition, the imaging device 2 may perform camera shake correction when the display adjustment image is captured, whereby a clearer captured image for adjustment can be obtained. The display state adjustment process can be more suitably performed.

  Furthermore, in the above embodiment, the display adjustment image is captured when an imaging instruction is input based on a predetermined operation of the operation input unit 208 (107) by the user. In this case, a display adjustment image may be automatically captured. That is, for example, when an angle detection unit such as a level is mounted on the imaging device 2 or the display device 401 and the imaging device 2 or the display device 401 has a predetermined angle (tilt), the display is automatically adjusted. An image may be taken.

In addition, in the above embodiment, the functions of the display control unit, the acquisition unit, the comparison unit, and the display adjustment unit are controlled by the central control unit 108 under the control of the display control unit 101b (301b), the image acquisition unit. 103a, the image comparison unit 103c (303c), and the display adjustment unit 101c (301c) are driven. However, the present invention is not limited to this, and a predetermined program or the like is executed by the CPU of the central control unit 108. It is good also as a structure implement | achieved by performing.
That is, a program including a display control processing routine, an acquisition processing routine, a comparison processing routine, and a display adjustment processing routine is stored in a program memory (not shown) that stores the program. Then, the CPU of the central control unit 108 may function as a display control unit that causes the display unit to display a display adjustment image by a display control processing routine. Further, the CPU of the central control unit 108 may function as an acquisition unit that acquires an adjustment captured image generated by the display adjustment image being captured by the imaging unit by the acquisition process routine. Further, the CPU of the central control unit 108 may function as a comparison unit that compares the captured image for adjustment acquired by the acquisition unit and the display adjustment image by a comparison processing routine. Further, the CPU of the central control unit 108 may function as a display adjustment unit that adjusts the display state of the display unit based on the comparison result by the comparison unit by the display adjustment processing routine.

DESCRIPTION OF SYMBOLS 100 Display system 1 Display apparatus 101 Display part 101a Organic EL display panel 101b, 301b Display control part 101c, 301c Display adjustment part 103a Image acquisition part 103b Deviation correction part 103c, 303c Image comparison part 103d Pixel specific part 106 Communication control part 2 Imaging Device 201, 411 Imaging unit 202, 412 Image data generation unit 207 Communication control unit 301a Liquid crystal display panel 303d Color component identification unit N Communication network

Claims (11)

Display control means for displaying a display adjustment image on the display means;
An acquisition means for acquiring an adjustment captured image generated by the display adjustment image being captured by the imaging means;
A comparison unit that compares the captured image for adjustment acquired by the acquisition unit with the display adjustment image;
Display adjustment means for adjusting the display state of the display means based on the comparison result by the comparison means;
A display device comprising: A deviation correction unit that corrects a positional deviation between the adjustment-purpose captured image acquired by the acquisition unit and the display adjustment image;
The comparison means includes
The display device according to claim 1, wherein the adjustment captured image in which the positional deviation is corrected by the deviation correction unit is compared with the display adjustment image. The imaging means captures a mirror image of the display adjustment image displayed on the display means,
3. The display device according to claim 1, further comprising a generation unit configured to generate a mirror image of the display adjustment image captured by the imaging unit by performing a mirror operation on the mirror image of the display adjustment image. The display means has a plurality of self-luminous pixels.
The comparison means includes
Based on a comparison result between the adjustment-use captured image and the display adjustment image, a pixel specifying unit that specifies a pixel having a difference in light emission state from another pixel among the plurality of pixels,
The display adjusting means includes
The display device according to claim 1, wherein the display state of the display unit is adjusted based on a light emission state of the pixel specified by the pixel specifying unit. The display adjusting means includes
5. The display state of the display unit is adjusted by correcting the light emission state of peripheral pixels of the pixel specified by the pixel specifying unit so that the light emission states of the plurality of pixels become substantially equal. The display device described in 1. The plurality of pixels are provided corresponding to a plurality of color components,
The pixel specifying means includes
Based on a comparison result between the adjustment image and the display adjustment image, a color component having a difference in light emission state from a pixel related to any one of the plurality of color components is generated. Identify the pixel concerned,
The display adjusting means includes
The display state of the display means is corrected by correcting the light emission state of pixels of color components other than the pixel related to the color component specified by the pixel specifying means so that the light emission states of the pixels related to the plurality of color components are substantially equal. The display device according to claim 4, wherein the display device is adjusted. The display means includes a plurality of reflective non-light emitting pixels provided corresponding to a plurality of color components,
The comparison means includes
Based on a comparison result between the adjustment image and the display adjustment image, color component specifying means for specifying a color component that is colored more strongly than other color components among the plurality of color components,
The display adjusting means includes
The display device according to claim 1, wherein the display state of the display unit is adjusted based on a color development state of the color component specified by the color component specifying unit. The display adjusting means includes
The display unit of the display unit is adjusted by correcting the color generation state of the color component specified by the color component specifying unit so that the color generation state of the pixels related to the plurality of color components is substantially equal. The display device according to claim 7. A display system comprising a display control means for displaying a display adjustment image on a display means, and an imaging device connected via a predetermined communication line,
The imaging device
Imaging means for capturing the display adjustment image displayed on the display means to generate an adjustment captured image;
Transmission means for transmitting the adjustment-purpose captured image generated by the imaging means to the display device via the predetermined communication line,
The display device
Receiving means for receiving the adjustment-use captured image transmitted from the transmitting means via the predetermined communication line;
Obtaining means for obtaining the adjustment-purpose captured image received by the receiving means;
A comparison unit that compares the captured image for adjustment acquired by the acquisition unit with the display adjustment image;
Display adjustment means for adjusting the display state of the display means based on the comparison result by the comparison means;
A display system comprising: A display method using a display device,
Processing for displaying a display adjustment image on a display device;
Processing for acquiring an adjustment-purpose captured image generated by the display adjustment image being captured by an imaging unit;
A process of comparing the acquired captured image for adjustment and the display adjustment image;
Based on this comparison result, a process of adjusting the display state of the display means;
The display method characterized by performing. Display computer,
Display control means for displaying a display adjustment image on the display means;
An acquisition unit for acquiring an adjustment-purpose captured image generated by the display adjustment image being captured by the imaging unit;
A comparison unit that compares the captured image for adjustment acquired by the acquisition unit with the display adjustment image;
Display adjustment means for adjusting the display state of the display means based on the comparison result by the comparison means;
A program characterized by functioning as

Images