JP7326742B2 - Colorimetric method, image display method, colorimetric device, image display device and image display system - Google Patents

Description

The present invention relates to a colorimetry method, an image display method, a colorimetry device, an image display device, and an image display system.

2. Description of the Related Art Conventionally, there has been known a technique of capturing a displayed image and correcting the image based on the captured result. For example, in the correction data acquisition method disclosed in Patent Document 1, an offset image with a black signal level, a primary color image with an arbitrary signal level, and a gradation image with a different signal level for each primary color are sequentially displayed on an image display unit. . Then, a calibration camera equipped with filters of bands corresponding to the respective primary colors of red, green, and blue is used, and images are taken while switching the bands. Offset correction data is calculated based on photographed data.

Japanese Unexamined Patent Application Publication No. 2005-20581

However, even with a camera capable of capturing images in multiple bands, there is a problem that a high colorimetric result cannot be obtained.

One aspect of solving the above problems is a colorimetry method for performing colorimetry using a spectral imaging device including an imaging element and a spectroscopic element, wherein a displayed image is measured in a wavelength range set based on the image, and the an imaging step of capturing an image with the spectroscopic imaging device while changing the spectral wavelength of the spectroscopic element at each first wavelength interval to generate imaging data; the imaging data generated by the imaging step; a calculating step of calculating an estimated value of a spectrum for each second wavelength interval shorter than the first wavelength interval based on a matrix; and a generation step of generating a correction parameter for correcting image data such that:

In the colorimetric method described above, the estimated matrix may be calculated based on the imaging data captured by the spectral imaging device.

In the above colorimetry method, the estimation matrix minimizes the square error between measurement data obtained by measuring the displayed image at each second wavelength interval with a dedicated measurement device and the estimated value of the spectrum. It may be a configuration that is a determinant of

In the above-described colorimetry method, the imaging step changes the spectral wavelength of the spectroscopic element by changing the distance between a pair of reflecting films facing each other provided in the spectroscopic element, and the imaging is performed for each of the first wavelength intervals. It may be configured to output data.

In the above colorimetric method, the calculating step may calculate the estimated value based on the estimated matrix and the imaging data corrected with correction data for correcting the sensitivity distribution occurring in the imaging element.

Another aspect of solving the above problem is a display step of displaying an image; an imaging step of generating imaging data by imaging with the spectral imaging unit while changing the spectral wavelength of the spectroscopic element for each first wavelength interval in a wavelength range set based on a calculating step of calculating an estimated value of a spectrum for each second wavelength interval, which is shorter than the first wavelength interval, based on the imaging data and an estimation matrix used for estimating the spectrum; and the spectrum calculated by the calculating step. a generation step of generating a correction parameter for correcting the image data that is the basis of the image to be displayed in the display step based on the estimated value of; and a correction step of correcting with a correction parameter, wherein the display step displays an image based on the image data corrected by the correction step.

Another aspect of solving the above problems is a spectral imaging unit that includes an imaging device and a spectroscopic device, and captures a displayed image and outputs spectral imaging data; A control unit that sets spectral wavelengths for each first wavelength interval within a wavelength range set based on an image and causes the spectral imaging unit to generate imaging data, and a storage unit that stores an estimation matrix used for estimating the spectrum. and an estimated value calculation unit that calculates an estimated value of the spectrum for each second wavelength interval shorter than the first wavelength interval based on the imaging data output from the spectral imaging unit and the estimated matrix. and a generator that generates a correction parameter for correcting image data based on the estimated value calculated by the estimated value calculator.

Another aspect of solving the above problems is a display unit that displays an image, an imaging element and a spectral element, and a spectral imaging unit that captures the image and outputs spectral imaging data, and spectral wavelengths of the spectral element. are set for each first wavelength interval within the wavelength range set based on the image, and the spectral imaging unit generates imaging data; and a storage unit that stores an estimation matrix used for estimating the spectrum. and an estimated value calculation unit that calculates an estimated value of the spectrum for each second wavelength interval shorter than the first wavelength interval based on the imaging data output from the spectral imaging unit and the estimated matrix. a generating unit for generating a correction parameter for correcting image data based on the estimated value calculated by the estimated value calculating unit; an image processing unit for correcting the image data using the correction parameter generated by the generating unit; An image display device comprising

Another aspect for solving the above problem is provided with a display device that displays an image, and a colorimetric device that measures the color of the image, the colorimetric device includes an imaging device and a spectroscopic device, and captures the image. a spectral imaging unit for outputting spectral imaging data as a spectral image; and spectral wavelengths of the spectroscopic element are set for each first wavelength interval within a wavelength range set based on the image, and the spectral imaging unit outputs the spectral imaging data. a storage unit for storing an estimated matrix used for estimating a spectrum; an interval shorter than the first wavelength interval based on the imaging data output by the spectral imaging unit and the estimated matrix an estimated value calculator that calculates an estimated value of the spectrum for each second wavelength interval; and a generator that generates a correction parameter for correcting image data based on the estimated value calculated by the estimated value calculator, It is an image display system.

Another aspect for solving the above problem is provided with a first display unit that displays an image, a first imaging element, and a first spectroscopic element, and capturing the image displayed by the first display unit to obtain spectroscopic imaging data. and the spectral wavelengths of the first spectral element are set for each first wavelength interval within a wavelength range set based on the image displayed by the first display unit, a first control unit that causes the first spectral imaging unit to generate imaging data; a first storage unit that stores an estimated matrix used for spectrum estimation; imaging data output by the first spectral imaging unit; a first estimated value calculation unit that calculates an estimated value of a spectrum for each second wavelength interval shorter than the first wavelength interval based on the above; and a second display device that displays an image. a display unit, a second imaging element, and a second spectroscopic element, the second spectral imaging unit capturing the image displayed by the second display unit and outputting spectral imaging data; A second control unit for setting a wavelength for each first wavelength interval within a wavelength range set based on the image displayed by the second display unit, and causing the second spectral imaging unit to generate imaging data. and a second storage unit that stores an estimation matrix used for estimating the spectrum, the imaging data output from the second spectral imaging unit, and the estimated value of the spectrum for each of the second wavelength intervals based on the estimation matrix. and a second display device including a second estimated value calculation unit that calculates the estimated value of the spectrum calculated by the first estimated value calculation unit, and the second Based on the estimated value of the spectrum calculated by the estimated value calculation unit, a first correction parameter for correcting the image data that is the basis of the image displayed by the first display device is generated, and the second display device displays the first correction parameter. An image display system that generates a second correction parameter for correcting image data that is the source of an image.

FIG. 2 is a block configuration diagram showing the configuration of a projector; FIG. 2 is a schematic configuration diagram of a spectral imaging unit; FIG. 4 is a diagram showing display conditions and measurement conditions for an adjustment image; 4 is a flowchart showing the operation of the projector according to the first embodiment; FIG. 4 is a diagram showing light intensity for each spectral frequency obtained from spectral imaging data; FIG. 10 is a diagram showing estimated values of spectrum for each second wavelength interval; The figure which shows the system configuration|structure of a display system. 4 is a flowchart showing the operation of the projector of the master device; 4 is a flowchart showing the operation of the projector of the slave device; The system block diagram of 3rd Embodiment. FIG. 2 is a block diagram showing the configuration of a colorimetric device; 9 is a flow chart showing the operation of the projector according to the third embodiment; 4 is a flowchart showing the operation of the colorimetric device; The system block diagram of 4th Embodiment.

[First embodiment]
Embodiments will be described below with reference to the accompanying drawings.
FIG. 1 is a block configuration diagram showing the configuration of the projector 100. As shown in FIG. The projector 100 corresponds to an example of the "image display device" of the invention. The projector 100 includes an image projection system that generates image light and projects it onto the screen SC, an image processing system that electrically processes image data that is the source of an optical image, and a projection image that is displayed on the screen SC. A spectral imaging unit 137 and a control unit 150 that controls these units are provided as main components.

[Image projection system]
The image projection system includes a projection section 110 and a drive section 120 . Projection unit 110 corresponds to an example of the “display unit” of the present invention. The projection section 110 includes a light source 111 , an optical modulator 113 and an optical unit 117 . The drive unit 120 includes a light source drive circuit 121 and an optical modulator drive circuit 123 . The light source drive circuit 121 and the light modulation device drive circuit 123 are connected to the bus 101 and perform data communication with other components of the projector 100 also connected to the bus 101 via the bus 101 . Other components correspond to, for example, the control unit 150 and the image processing unit 143 shown in FIG.

A solid-state light source such as an LED (Light Emitting Diode) or a laser light source is used as the light source 111 . Further, as the light source 111, it is also possible to use a lamp such as a halogen lamp, a xenon lamp, or an ultra-high pressure mercury lamp.

A light source driving circuit 121 is connected to the light source 111 . The light source driving circuit 121 supplies a driving current or pulses to the light source 111 to turn on the light source 111 and stops the supplied driving current or pulses to turn off the light source 111 .

The light modulation device 113 includes a light modulation element that modulates the light emitted by the light source 111 to generate image light. For example, a transmissive or reflective liquid crystal panel, a digital mirror device, or the like can be used as the light modulation element. In this embodiment, an example in which the light modulation device 113 includes a transmissive liquid crystal panel 115 as a light modulation element will be described. The light modulation device 113 has three liquid crystal panels 115 corresponding to the three primary colors of red, green and blue. The light modulated by the liquid crystal panel 115 is incident on the optical unit 117 as image light. Below, red is described as "R", green as "G", and blue as "B".

An optical modulator drive circuit 123 is connected to the optical modulator 113 . The light modulator driving circuit 123 drives the light modulator 113 to draw an image on the liquid crystal panel 115 in units of frames.

The optical unit 117 includes optical elements such as lenses and mirrors, and projects the image light modulated by the light modulator 113 onto the screen SC. An image based on the image light projected by the optical unit 117 is formed on the screen SC. An image formed on the screen SC by the image light projected by the projection unit 110 is called a projection image.

[Operation input system]
The projector 100 has an operation panel 131 , a remote control light receiving section 133 and an input interface 135 . The input interface 135 is connected to the bus 101 and performs mutual data communication with the control unit 150 and the like via the bus 101 .

The operation panel 131 is arranged, for example, in the housing of the projector 100 and has various switches. When a switch on operation panel 131 is operated, input interface 135 outputs an operation signal corresponding to the operated switch to control unit 150 .

Remote control light receiving section 133 receives an infrared signal transmitted from a remote control. Remote control light receiving section 133 outputs an operation signal corresponding to the received infrared signal. Input interface 135 outputs the input operation signal to control unit 150 . This operation signal is a signal corresponding to the operated remote control switch.

[Spectral imaging unit]
The spectral imaging unit 137 captures the projection image displayed on the screen SC by the projection unit 110 and outputs spectral imaging data.

FIG. 2 is a schematic configuration diagram of the spectral imaging unit 137. As shown in FIG. The spectral imaging unit 137 corresponds to an example of the "spectral imaging device" of the present invention. The spectral imaging unit 137 includes an incident optical system 301 into which external light is incident, a spectroscopic element 302 that disperses the incident light, and an imaging element 303 that captures the light separated by the spectroscopic element 302 .

The incident optical system 301 is composed of, for example, a telecentric optical system or the like, and guides incident light to the spectral element 302 and the imaging element 303 so that the optical axis and the principal ray are parallel or substantially parallel. The spectral element 302 is a variable wavelength interference filter including a pair of reflective films 304 and 305 facing each other and a gap changer 306 capable of changing the distance between these reflective films 304 and 305 . The gap changer 306 is configured by, for example, an electrostatic actuator. A tunable interference filter is also called an etalon.

The spectroscopic element 302 changes the voltage applied to the gap changing section 306 under the control of the control section 150 to change the spectral wavelength λi (i=1, 2, .multidot. , N) can be changed. The imaging element 303 is a device for imaging light transmitted through the spectroscopic element 302, and is configured by, for example, a CCD, a CMOS, or the like. The spectral imaging unit 137 sequentially switches the wavelengths of the light dispersed by the spectroscopic element 302 under the control of the control unit 150, images the light transmitted through the spectral element 302 with the imaging element 303, and outputs spectral imaging data. The spectral imaging data output from the spectral imaging section 137 is input to the control section 150 . The spectral imaging data is data output for each pixel that configures the image sensor 303, and is data that indicates the intensity of light received by the pixel, that is, the amount of light. Note that the spectral imaging unit 137 may be a stereo camera or a monocular camera.

[Communication]
As shown in FIG. 1 , the projector 100 has a communication section 139 . Communication unit 139 is connected to bus 101 . The communication unit 139 functions as an interface when a plurality of projectors 100 are connected and mutual data communication is performed between the projectors 100, as shown in FIG. 7 to be described later. The communication unit 139 of the present embodiment is a wired interface for connecting a cable, but may be a wireless communication interface for performing wireless communication such as wireless LAN or Bluetooth. "Bluetooth" is a registered trademark.

[Image processing system]
Next, an image processing system of the projector 100 will be described.
As shown in FIG. 1, the projector 100 includes an image interface 141, an image processing section 143, and a frame memory 145 as an image processing system. The image processing unit 143 is connected to the bus 101 and performs data communication with the control unit 150 and the like via the bus 101 .

The image interface 141 is an interface that receives image signals, and includes a connector to which the cable 3 is connected and an interface circuit that receives image signals via the cable 3 . The image interface 141 extracts image data and synchronization signals from the received image signal, and outputs the extracted image data and synchronization signals to the image processing section 143 . Also, the image interface 141 outputs a synchronization signal to the control section 150 . The control unit 150 controls other components of the projector 100 in synchronization with the synchronization signal. The image processing unit 143 performs image processing on the image data in synchronization with the synchronization signal.

The image supply device 200 is connected to the image interface 141 via the cable 3 . The image supply device 200 can be, for example, a notebook PC (Personal Computer), a desktop PC, a tablet terminal, a smart phone, or a PDA (Personal Digital Assistant). Also, the image supply device 200 may be a video playback device, a DVD player, a Blu-ray disc player, or the like. Further, the image signal input to the image interface 141 may be a moving image or a still image, and the data format is arbitrary.

The image processing unit 143 and the frame memory 145 are configured by integrated circuits, for example. Integrated circuits include LSI (Large-Scale Integrated Circuit), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), FPGA (Field-Programmable Gate Array), SO C (System-on-a-chip) etc. included. Also, an analog circuit may be included as part of the configuration of the integrated circuit.

The image processing section 143 is connected to the frame memory 145 . The image processing unit 143 develops the image data input from the image interface 141 in the frame memory 145 and performs image processing on the developed image data.

The image processing unit 143 executes various types of processing including, for example, geometric correction processing for correcting trapezoidal distortion of the projection image, OSD processing for superimposing an OSD (On Screen Display) image, and the like. The image processing unit 143 also performs image processing such as image adjustment processing for adjusting the brightness and color tone of image data, resolution conversion processing for adjusting the aspect ratio and resolution of image data in accordance with the light modulation device 113, and frame rate conversion. to run.

The image processing unit 143 outputs image data for which image processing has been completed to the light modulation device driving circuit 123 . The light modulator drive circuit 123 generates a drive signal for each of red, green, and blue based on image data input from the image processing section 143 . The light modulator drive circuit 123 drives the liquid crystal panel 115 of the corresponding color of the light modulator 113 based on the generated drive signal of each color, and draws an image on the liquid crystal panel 115 of each color. Light emitted from the light source 111 passes through the liquid crystal panel 115 to generate image light corresponding to the image of the image data.

[Control unit/storage unit]
The control unit 150 has a storage unit 160 and a processor 170 .
The storage unit 160 is configured by, for example, a non-volatile semiconductor memory such as flash memory or EEPROM, or an SSD (Solid State Drive) using flash memory. In this embodiment, a case where the control unit 150 includes the storage unit 160 will be described. The storage unit 160 stores a control program 161 , image data such as adjustment image data 162 and pattern image data 163 , setting data 164 , parameters 165 and calibration data 167 . The control unit 150 and the spectral imaging unit 137 correspond to an example of the "colorimetric device" of the present invention.

The control program 161 is an OS (Operating System) executed by the processor 170 and programs such as application programs.

The setting data 164 is data in which processing conditions for various processes executed by the processor 170 are set. The parameter 165 is, for example, a parameter of image processing to be executed by the image processing unit 143 .

The image data stored in the storage unit 160 is data that forms the basis of the image displayed on the screen SC by the projector 100, and includes pattern image data 163 and adjustment image data 162, for example. The pattern image data 163 is image data used when generating a projective transformation matrix 167b, which will be described later, and is image data in which marks of a predetermined shape are arranged at the four corners of the pattern image data 163 . The adjustment image data 162 is R, G, and B monochromatic image data. The storage unit 160 stores adjustment image data 162 of a plurality of different gradations. The adjustment image data 162 for each color of R, G, and B are prepared with the same gradation. Further, black and white adjustment image data 162 may be prepared as the adjustment image data 162 . In this case, the white adjustment image data 162 is prepared in the same gradation as the R, G, and B adjustment image data 162, and the black adjustment image data 162 is prepared in 1 gradation.

The calibration data 167 includes correction data 167a, a projective transformation matrix 167b and an estimated matrix M.
The correction data 167a is data for correcting the sensitivity distribution of the imaging device 303 and correcting the spectral imaging data so that the output of the imaging device 303 becomes uniform.
In the imaging device 303, the output of each pixel constituting the imaging device 303 is not uniform due to the influence of lens aberration of the lens included in the incident optical system 301, and varies depending on the position of the pixel. In other words, the image sensor 303 has a sensitivity distribution. In this sensitivity distribution, the output is lower in the peripheral portion than in the center of the image sensor 303 . For this reason, when correcting the hue, brightness, etc. of an image based on the spectral imaging data captured by the spectral imaging unit 137, there are cases where accurate correction cannot be performed due to the influence of errors. Also, the sensitivity distribution of the spectral imaging unit 137 is affected by an optical filter that cuts ultraviolet rays and infrared rays coated on the lens surface. That is, the output of the spectral imaging section 137 also differs depending on the color of the image captured by the spectral imaging section 137 .

The correction data 167a is generated when the projector 100 is manufactured, and is generated for each pixel of the imaging element 303. FIG. A plurality of pieces of correction data 167 a are generated corresponding to each of the R, G, and B light beams projected by the projection unit 110 and the spectral wavelength λi set in the spectral imaging unit 137 . By generating a plurality of pieces of correction data 167a for each color light and for each spectral wavelength set in the spectral imaging unit 137, the correction accuracy of the spectral sensitivity of the spectral imaging unit 137 can be improved.

Furthermore, a plurality of pieces of correction data 167 a are generated corresponding to the focal length of the incident optical system 301 of the spectroscopic imaging section 137 . By generating the correction data 167a corresponding to the focal length of the incident optical system 301, even if the incident optical system 301 of the spectral imaging unit 137 is changed and the focal length is changed, correction corresponding to the changed focal length can be performed. The data 167a can be used to correct the spectral imaging data.

The projective transformation matrix 167b is a transformation matrix that transforms the coordinates set in the liquid crystal panel 115 of the light modulation device 113 into the coordinates set in the spectral imaging data. The liquid crystal panel 115 has a configuration in which a plurality of pixels are arranged in a matrix. The coordinates set on the liquid crystal panel 115 are coordinates for specifying each pixel arranged in this matrix. The coordinates set on the liquid crystal panel 115 are hereinafter referred to as panel coordinates. Also, the coordinates set in the spectral imaging data are coordinates for specifying each of the pixels forming the imaging element 303 . The coordinates set in the spectral imaging data are hereinafter referred to as imaging coordinates.

The estimation matrix M is a matrix used for spectrum estimation. Estimated matrix M is generated when projector 100 is manufactured, and is stored in storage unit 160 as part of calibration data 167 . The estimated matrix M is generated based on spectral imaging data captured by the spectral imaging unit 137 . Optical parts are mounted on the optical unit 117 , and optical parts are also used for the parts that guide the light emitted from the light source 111 to the liquid crystal panel 115 of the light modulator 113 . Further, in the liquid crystal panel 115 as an optical component, each pixel forming the liquid crystal panel 115 has a spectral characteristic, and an error occurs in the wavelength of image light transmitted by each pixel. Due to the optical characteristics of these optical components, an error occurs in the value of the spectral imaging data generated by the spectral imaging unit 137, and the colorimetric accuracy is lowered. Therefore, by calculating the estimated matrix M based on the spectral imaging data generated by the spectral imaging unit 137 and the spectral colorimetric data measured by the spectral measurement device, it is possible to obtain a determinant capable of correcting the optical characteristics. can. The spectrum measurement device is a device dedicated to spectrum measurement, and is an external device different from the projector 100 . A procedure for calculating the estimated matrix M is shown below.

[Control unit/storage unit/procedure for calculating estimated matrix M]
First, an adjustment image is displayed on the screen SC. The control unit 150 reads out the adjustment image data 162 from the storage unit 160 and outputs it to the image processing unit 143 . Further, the control unit 150 controls the image processing unit 143 and the driving unit 120 to cause the projection unit 110 to project image light and display an adjustment image on the screen SC.

Next, the displayed adjustment image is captured by the spectral imaging unit 137 to generate spectral imaging data, and the spectrum of the adjustment image is measured by the spectrum measurement device to generate spectral colorimetric data. The spectrum measurement device is a device dedicated to spectrum measurement and is an external device different from the projector 100 . The spectral colorimetric data is composed of the spectrum of each pixel that constitutes this spectral colorimetric data, or a representative spectrum. The representative spectrum may be, for example, a spectrum of preset pixels or an average value of spectra of a plurality of selected pixels.

Next, the controller 150 is caused to change the color and gradation of the image for adjustment displayed on the screen SC, and the displayed image for adjustment is imaged by the spectral imaging unit 137 and measured by the spectrum measuring device. This processing is performed for all colors and all gradations of the image data for adjustment 162 stored in the storage unit 160, and the spectral imaging data and spectral measurement data are converted to the colors and gradations of the image data for adjustment 162 prepared in advance. Get to each in tune.

Next, the spectral imaging data output by the spectral imaging unit 137 is compared with the spectral measurement data measured by the spectral measurement device to generate an estimation matrix M for calculating spectral estimation data from the spectral imaging data. Here, the spectral imaging data to be compared and the spectral estimation data are data obtained by imaging or measuring colored light of the same color and the same gradation.

The estimated matrix M is calculated by the method of least squares. The spectrum measurement data measured by the spectrum measuring device is denoted as "Y", and the N×16 spectrum obtained from the spectral imaging data of the spectral imaging unit 137 is denoted as "X". Also, "N" indicates the number of learning. For example, when three colors of R, G, and B are displayed as images for adjustment, and images with seven gradations for each color are displayed, and measurement is performed by the spectral imaging unit 137 and the spectrum measurement device, the learning number “N” is 3× 7 makes 21. The square error Δ between the spectrum estimation value “XM” obtained by multiplying the N×16 spectrum obtained from the spectral imaging data of the spectral imaging unit 137 by the estimation matrix M and the spectral measurement data “Y” is minimized. to determine the value of the estimated matrix M. A formula for calculating the squared error Δ is shown in formula (1a). Also, an equation obtained by partially differentiating both sides of equation (1a) with "M" as a variable is shown in (1b).

Assuming that the minimum value of the squared error Δ in the above equation (1b) is "0", the following equation (2) holds.
^XT Y= ^XT XM (2)
“X ^T ” shown in equations (1b) and (2) is the transposed matrix of X.
Also, the value of the estimated matrix M is given by the following equation (3) according to the equation (2).
M=(X ^T X) ⁻¹ X ^T Y (3)

In addition, when the value of the number of learning "N" described above is small, the spectrum estimation functions only with learning data. Specifically, the absolute values of the elements of the estimated matrix M become very large, resulting in an excessive response to noise. Therefore, when the value of the learning number "N" is small, the regularization term "β" is introduced into the calculation formula of the squared error Δ shown in the above formula (1a). A value chosen by experiment is used for the regularization term “β”. The squared error Δ introduced by the regularization term “β” is shown in equation (4a). Also, an equation (4b) is obtained by partially differentiating both sides of the equation (4a) with "M" as a variable.

Assuming that the minimum value of the squared error Δ in the above equation (4b) is "0", the following equation (5) holds.
^XT Y=XT ^XM -βM (5)
Therefore, the value of the estimated matrix M is given by the following equation (6) according to the equation (5).
M=(X ^T X−βI) ⁻¹ X ^T Y (6)
“I” in Equation (6) indicates a unit matrix.

[control unit/processor]
The processor 170 is an arithmetic processing unit including, for example, a CPU (Central Processing Unit), a DSP (Digital Signal Processor), a microcomputer, and the like. The processor 170 may be composed of a single processor, or may be composed of a combination of multiple processors.

In the control unit 150, the processor 170 executes arithmetic processing according to the control program 161 to realize various functions. FIG. 1 shows functional blocks corresponding to each of a plurality of functions that the control unit 150 has. The control unit 150 includes a projection control unit 171, an imaging control unit 173, an estimated value calculation unit 175, and a generation unit 177 as functional blocks.

[control unit/processor/projection control unit]
The projection control unit 171 adjusts the color tone, brightness, etc. of the image displayed on the screen SC by the projection unit 110 . Specifically, the projection control unit 171 controls the image processing unit 143 to perform image processing on the image data input from the image interface 141 . At this time, the projection control section 171 may read out the parameters 165 necessary for the processing of the image processing section 143 from the storage section 160 and output them to the image processing section 143 .
The projection control unit 171 also controls the light source drive circuit 121 to turn on or off the light source 111 and adjust the brightness of the light source 111 .

Further, when the projection control unit 171 starts image quality adjustment processing, which will be described later, the pattern image data 163 and the adjustment image data 162 are read out from the storage unit 160, and the image processing unit 143 executes the processing. The projection control unit 171 also controls the image processing unit 143 and the driving unit 120 to display a pattern image corresponding to the pattern image data 163 and an adjustment image corresponding to the adjustment image data 162 on the screen SC.

Furthermore, when displaying the adjustment image data 162 on the screen SC, the projection control unit 171 selects the color and gradation of the adjustment image to be projected on the projection unit 110, and displays the adjustment image in the selected color and gradation. The data 162 is read from the storage unit 160 and processed by the image processing unit 143 .
For example, assume that three colors of R, G, and B are stored in the storage unit 160 as the adjustment image data 162 . Further, it is assumed that the adjustment image data 162 for each color is prepared with seven gradation values. In addition, it is assumed that the order of R, G, and B is set as the display order of the adjustment images, and that the adjustment images are set to be displayed in ascending order of gradation value.
The projection control unit 171 first reads the adjustment image data 162 having the smallest gradation value among the R adjustment image data 162 from the storage unit 160, controls the image processing unit 143 and the driving unit 120, and reads out the adjustment image data 162. The adjustment image corresponding to the adjustment image data 162 is displayed on the screen SC.

When the displayed adjustment image is captured by the spectral imaging unit 137 and the spectral imaging data is stored in the storage unit 160, the projection control unit 171 changes the gradation value of the R adjustment image displayed on the screen SC. do. The projection control unit 171 reads the adjustment image data 162 of R, which has the second smallest gradation value, from the storage unit 160, controls the image processing unit 143 and the driving unit 120, and responds to the read adjustment image data 162. The adjusted image for adjustment is displayed on the screen SC. After that, the projection control unit 171 repeats the same processing, and displays the R adjustment image on the screen SC with all seven gradation values prepared in advance.

When the R adjustment image is displayed on the screen SC in all seven gradations, the projection control unit 171 changes the color of the adjustment image displayed on the screen SC from R to G. The projection control unit 171 reads the adjustment image data 162 having the smallest gradation value among the G adjustment image data 162 from the storage unit 160, controls the image processing unit 143 and the driving unit 120, and performs the read adjustment. The image for adjustment corresponding to the image data 162 for adjustment is displayed on the screen SC. When the displayed adjustment image is captured by the spectral imaging unit 137 and the spectral imaging data is stored in the storage unit 160, the projection control unit 171 changes the gradation value of the G adjustment image to be displayed on the screen SC. do. The projection control unit 171 reads the adjustment image data 162 of G, which has the second smallest gradation value, from the storage unit 160, controls the image processing unit 143 and the driving unit 120, and responds to the read adjustment image data 162. The adjusted image for adjustment is displayed on the screen SC. After that, the projection control unit 171 repeats the same processing, and displays the G adjustment image on the screen SC with all seven gradation values prepared in advance.

The projection control unit 171 similarly processes the B adjustment image.

[Control unit/processor/imaging control unit]
The imaging control unit 173 causes the spectral imaging unit 137 to perform imaging. The spectral imaging unit 137 performs imaging under the control of the imaging control unit 173 and outputs spectral imaging data.
Further, the imaging control unit 173 sets the wavelength range in which the spectral imaging unit 137 performs imaging when causing the spectral imaging unit 137 to capture the adjustment image displayed on the screen SC. When causing the spectral imaging unit 137 to capture an R adjustment image, the imaging control unit 173 sets, for example, a range of 620 nm or more and 750 nm or less as the wavelength range for imaging. When the spectral imaging unit 137 captures the G adjustment image, the imaging control unit 173 sets, for example, a wavelength range of 495 nm or more and 570 nm or less as the imaging wavelength range. When the imaging control unit 173 causes the spectral imaging unit 137 to capture the B adjustment image, the imaging control unit 173 sets, for example, a wavelength range of 450 nm or more and 495 nm or less as the imaging wavelength range.

Furthermore, the imaging control unit 173 changes the voltage applied to the gap changing unit 306 to change the spectral wavelength λi of the spectroscopic element 302 . Thereby, the spectral imaging unit 137 performs imaging while changing the spectral wavelength λi for each preset first wavelength interval. In this embodiment, a case will be described in which the spectral imaging unit 137 performs imaging at wavelength intervals of 20 nm. "20 nm" corresponds to an example of the "first wavelength interval" of the present invention. For example, when imaging a red adjustment image, the imaging control unit 173 causes the spectral imaging unit 137 to perform imaging within the wavelength range of 620 nm or more and 750 nm or less at intervals of 20 nm. The imaging control unit 173 receives spectral imaging data output from the spectral imaging unit 137 and temporarily stores the input spectral imaging data in the storage unit 160 .

In this embodiment, the projector 100 changes the color and gradation of the adjustment image displayed on the screen SC by the projection unit 110, and sets the measurement conditions corresponding to the color of the adjustment image in the spectral imaging unit 137. , can generate spectral imaging data. Light intensity can be measured for each first wavelength interval at a plurality of different colors. Therefore, the projector 100 can improve the accuracy of colorimetry and efficiently correct the image projected by the projector 100 .
In order to improve the accuracy of colorimetry, it is necessary to project many color and gradation adjustment images and measure the adjustment images in a wide range and detailed range, which takes time and deteriorates efficiency. Also, if a dedicated length measuring machine is used, the control becomes complicated and the efficiency deteriorates.

The projector 100 of the present embodiment includes a projection unit 110 and a spectral imaging unit 137. The projection unit 110 sets the colors of the adjustment image to three colors, R, G, and B, for example. An adjustment image of one gradation is projected, and an image is captured in a measurement wavelength range corresponding to the adjustment image projected on the spectral imaging unit 137 .

FIG. 3 is a diagram showing display conditions and measurement conditions for adjustment images.
In this embodiment, as shown in FIG. 3 and (A) to (C) below, adjustment image data 162 for each color is prepared with seven gradation values, and an adjustment image is displayed. The order of R, G, and B is set in order, and the adjustment images are displayed in ascending order of gradation value, and are measured under measurement conditions corresponding to the projected adjustment image. In this embodiment, an image with a small gradation value is a dark image and an image with a large gradation value is a bright image, but an image with a small gradation value may be a bright image and an image with a large gradation value may be a dark image. . Further, each gradation may be the same gradation value between each color.

(A) First, the color of the adjustment image is set to R, and (1) an all-red image IR1 with gradation TR1 is projected, and the wavelength range corresponding to red is 620 nm or more and 750 nm or less. Measure in Further, (2) an all-red image IR2 having a gradation TR2 is projected, and the measurement is performed in the wavelength range of 620 nm or more and 750 nm or less, which is the wavelength range corresponding to red. In addition, (3) an all-red image IR3 having a gradation TR3 is projected and measured in the wavelength range of 620 nm or more and 750 nm or less, which is the wavelength range corresponding to red. In addition, (4) an all-red image IR4 having a gradation of gradation TR4 is projected and measured in the wavelength range of 620 nm or more and 750 nm or less, which is the wavelength range corresponding to red. In addition, (5) an all-red image IR5 having a gradation of gradation TR5 is projected and measured in the wavelength range of 620 nm or more and 750 nm or less, which is the wavelength range corresponding to red. In addition, (6) an all-red image IR6 having a gradation TR6 is projected, and measurement is performed in the wavelength range of 620 nm or more and 750 nm or less, which is the wavelength range corresponding to red. Further, (7) an all-red image IR7 having a gradation TR7 is projected, and the measurement is performed in the wavelength range of 620 nm or more and 750 nm or less, which is the wavelength range corresponding to red.
Here, the gradation values have a relationship of TR1<TR2<TR3<TR4<TR5<TR6<TR7, and the image brightness has a relationship of IR1<IR2<IR3<IR4<IR5<IR6<IR7.

(B) Setting the color of the adjustment image to G, (1) projecting an all-green image IG1 with the gradation TG1, and measuring in the range of 495 nm or more and 570 nm or less, which is the wavelength range corresponding to green. do. Further, (2) an all-green image IG2 having a gradation TG2 is projected, and the measurement is performed in the wavelength range of 495 nm or more and 570 nm or less, which is the wavelength range corresponding to green. Further, (3) an all-green image IG3 having a gradation TG3 is projected, and the measurement is performed in the wavelength range of 495 nm or more and 570 nm or less, which is the wavelength range corresponding to green. Further, (4) an all-green image IG4 having a gradation TG4 is projected, and the measurement is performed in the wavelength range of 495 nm or more and 570 nm or less, which is the wavelength range corresponding to green. In addition, (5) an all-green image IG5 having a gradation TG5 is projected, and the wavelength range corresponding to green, ie, 495 nm or more and 570 nm or less, is measured. Further, (6) an all-green image IG6 having a gradation TG6 is projected, and the measurement is performed in the wavelength range of 495 nm or more and 570 nm or less, which is the wavelength range corresponding to green. Further, (7) an all-green image IG7 having a gradation TG7 is projected, and the measurement is performed in the wavelength range of 495 nm or more and 570 nm or less, which is the wavelength range corresponding to green.
Here, the gradation values have a relationship of TG1<TG2<TG3<TG4<TG5<TG6<TG7, and the image brightness has a relationship of IG1<IG2<IG3<IG4<IG5<IG6<IG7.

(C) Setting the color of the image for adjustment to B, (1) Projecting an all-blue image IB1 with gradation TB1, and measuring in the wavelength range of 450 nm or more and 495 nm or less, which is the wavelength range corresponding to blue. do. Further, (2) an all-blue image IB2 having a gradation TB2 is projected, and measured in a wavelength range of 450 nm or more and 495 nm or less, which is the wavelength range corresponding to blue. In addition, (3) an all-blue image IB3 having a gradation TB3 is projected and measured in the wavelength range of 450 nm or more and 495 nm or less, which is the wavelength range corresponding to blue. In addition, (4) an all-blue image IB4 having a gradation TB4 is projected, and measured in the wavelength range of 450 nm or more and 495 nm or less, which is the wavelength range corresponding to blue. Further, (5) an all-blue image IB5 having a gradation TB5 is projected and measured in the wavelength range of 450 nm or more and 495 nm or less, which is the wavelength range corresponding to blue. Further, (6) an all-blue image IB6 having a gradation TB6 is projected and measured in the wavelength range of 450 nm or more and 495 nm or less, which is the wavelength range corresponding to blue. In addition, (7) an all-blue image IB7 having a gradation TB7 is projected, and the wavelength range corresponding to blue, ie, 450 nm or more and 495 nm or less, is measured.
Here, the gradation values have a relationship of TB1<TB2<TB3<TB4<TB5<TB6<TB7, and the image brightness has a relationship of IB1<IB2<IB3<IB4<IB5<IB6<IB7.

[control unit/processor/estimated value calculation unit]
The estimated value calculation unit 175 reads the spectral imaging data and the estimated matrix M from the storage unit 160, and based on the read spectral imaging data and the estimated matrix M, calculates the spectrum for each second wavelength interval shorter than the first wavelength interval. Calculate an estimate of The estimated value calculator 175 multiplies the intensity I of the wavelength λ component obtained from the spectral imaging data by the estimated matrix M to calculate the estimated value of the spectrum for each second wavelength interval.

[controller/processor/generator]
The generation unit 177 generates correction parameters that the image processing unit 143 uses for image processing, based on the estimated values of the spectrum calculated by the estimated value calculation unit 175 . This correction parameter is used when the image processing unit 143 processes the image data input from the image interface 141 . A specific method of generating correction parameters will be described with reference to the flowchart shown in FIG. 4 below.

[Projector operation]
FIG. 4 is a flow chart showing the operation of the projector 100 of the first embodiment.
The operation of the projector 100 will be described with reference to the flowchart of FIG.
The control unit 150 first determines whether or not an operation for selecting image quality adjustment has been received (step S1). Control unit 150 determines whether or not an operation for selecting image quality adjustment has been received based on an operation signal input from input interface 135 (step S1). If the operation to select image quality adjustment has not been received (step S1/NO), the control unit 150 waits to start the operation until the operation is received. Further, when receiving an operation instructing execution of another process, the control unit 150 executes an operation corresponding to the received operation, and returns to the determination of step S1.

The image quality adjustment is an adjustment to correct deterioration of the image quality of the projected image displayed on the screen SC and restore the image quality at the time of manufacture of the projector 100 . For example, the characteristics of the light source 111 change due to changes in temperature and deterioration over time, so it is necessary to correct the amount of light so as to obtain desired image brightness. Further, the image quality adjustment of the projector 100 includes adjustment for correcting the color tone of the screen SC and environmental illumination to correct the color tone of the projected image to a preset color tone, and adjusting the projected image displayed by the plurality of projectors 100 . There is an adjustment etc. to match the color tone of Correction data 167a can also be generated for these image quality adjustments by the same procedure described below.

When receiving an operation to select image quality adjustment (step S1/YES), control unit 150 first calculates projective transformation matrix 167b. The projective transformation matrix 167b is a matrix that transforms the panel coordinates of the liquid crystal panel 115 into the imaging coordinates of the spectral imaging data generated by the spectral imaging unit 137 . The control unit 150 reads the pattern image data 163 from the storage unit 160 and controls the image processing unit 143 and the driving unit 120 to display the pattern image corresponding to the pattern image data 163 on the screen SC (step S2).

Next, the control unit 150 controls the spectral imaging unit 137 to image the screen SC on which the pattern image is displayed. Here, the imaging data captured by the spectral imaging unit 137 is preferably data captured in a state in which the spectral element 302 does not separate the wavelengths of light. The spectral imaging unit 137 generates imaging data (step S<b>3 ) and outputs the generated imaging data to the control unit 150 . The control unit 150 causes the storage unit 160 to store the input imaging data.

Next, the control unit 150 associates the imaging coordinates with the panel coordinates (step S4). The control unit 150 reads the imaging data from the storage unit 160, analyzes the read imaging data, and detects a mark having a predetermined shape. When the mark is detected from the imaging data, the control unit 150 associates the pixel at the detection position of the mark with the pixel of the liquid crystal panel 115 where the mark is drawn. That is, control unit 150 associates the pixel coordinates of the mark detection position with the pixel coordinates of liquid crystal panel 115 on which the mark is drawn. Further, when the control unit 150 detects four marks from the imaging data, the control unit 150 converts the panel coordinates of the liquid crystal panel 115 into imaging coordinates based on the associated imaging coordinates and panel coordinates of the four marks. 167b.

In this flowchart, a case will be described in which the process of obtaining the projective transformation matrix 167b is performed before displaying the adjustment image on the screen SC. There may be. Also, in this flowchart, the case of associating the imaging coordinates with the panel coordinates has been described, but the imaging coordinates may be associated with the coordinates set in the pixels of the frame memory 145 .

Next, the control unit 150 determines the focal length of the spectral imaging unit 137 based on the angle-of-view information of the imaging data captured in step S3 (step S5). After determining the focal length, the control unit 150 adjusts the lens position and zoom magnification of the incident optical system 301 of the spectral imaging unit 137 based on the determined focal length. Moreover, when the spectral imaging unit 137 includes a plurality of single focus lenses, the control unit 150 selects one of the single focus lenses based on the determined focal length.

Next, the control section 150 selects the color and gradation of the image for adjustment, and reads the adjustment image data 162 of the selected color and gradation from the storage section 160 . After reading the adjustment data from the storage unit 160, the control unit 150 controls the image processing unit 143 and the driving unit 120 to display an adjustment image corresponding to the adjustment image data 162 on the screen SC (step S6). Step S6 corresponds to an example of the "display step" of the present invention. Here, it is preferable that the light used for generating the image light from which the adjustment image is based is uniform light whose wavelength is made uniform by, for example, an integrating sphere or the like. The accuracy of image quality adjustment can be improved by projecting light with a uniform wavelength onto the screen SC.

Next, the control unit 150 determines the wavelength range in which the spectral imaging unit 137 performs imaging based on the color of the adjustment image displayed in step S6 (step S7). After determining the wavelength range, the control unit 150 sets the set spectral wavelength λi to be set in the spectral element 302 to the minimum value within the determined wavelength range, and causes the spectral imaging unit 420 to perform imaging and generate spectral imaging data. (Step S8). Step S8 corresponds to an example of the "imaging step" of the present invention.

Next, the control unit 150 changes the value of the set spectral wavelength λi to a value larger by a preset value (step S9), and determines whether or not the set spectral wavelength λi exceeds the wavelength range (step S10). ). If the set spectral wavelength λi does not exceed the wavelength range (step S10/NO), the control unit 150 sets the set spectral wavelength λi to the spectroscopic element 302, causes the spectral imaging unit 137 to perform imaging, and obtains spectral imaging data. generated (step S8).

Further, when the set spectral wavelength λi exceeds the wavelength range (step S10/YES), the control unit 430 causes the screen SC to display adjustment images of all colors in all gradations, and the spectral imaging unit 137 It is determined whether or not an image has been captured (step S11). If there is an image for adjustment of gradation or color that has not been captured by the spectral imaging unit 137 (step S11/NO), the control unit 150 determines the color and gradation of the image for adjustment to be displayed next (step S12). ). The control unit 150 changes at least one of the color and gradation of the adjustment image, and determines the changed color and gradation as the color and gradation of the adjustment image to be displayed next. The control unit 150 reads the determined color and tone adjustment image data 162 from the storage unit 160, controls the image processing unit 143 and the driving unit 120, and displays an adjustment image corresponding to the adjustment image data 162 on the screen. Display on SC.

Further, when the control unit 150 displays the adjustment images of all the colors with all the gradations and generates the spectral imaging data (step S11/YES), it determines that the colorimetric processing is completed. The control unit 150 reads the spectral imaging data from the storage unit 160 and corrects the read spectral imaging data (step S13). First, the control unit 150 selects one of the panel coordinates and obtains imaging coordinates corresponding to the selected panel coordinates. The control unit 150 transforms the selected panel coordinates into imaging coordinates using the projective transformation matrix 167b generated in step S4. The selected panel coordinates are denoted as (xp, yp), and the imaging coordinates are denoted as (xc, yc). Also, the projection transformation matrix 167b is written as "Φ". The control unit 150 calculates the imaging coordinates according to Equation (7) shown below.
(xc, yc)=Φ·(xp, yp) (7)

Next, the control unit 150 reads the correction data 167a associated with the calculated imaging coordinates from the storage unit 160, and corrects the spectral imaging data using the read correction data 167a (step S13). A formula for correcting the spectral imaging data using the correction data 167a is shown in the following formula (8).
post(xc, yc, r, λ, I)=pre(xc, yc, r, λ, I)·k(xc, yc, r, λ, coeff) (8)

In Expression (8), "post(xc, yc, r, λ, I)" is the intensity I of the wavelength λ component captured in the spectral imaging data, and indicates the value after correction using the correction data 167a.
"pre(xc, yc, r, λ, I)" is the intensity I of the wavelength λ component at the imaging coordinates (xc, yc) of the spectral imaging data obtained by imaging the R-light adjustment image.
Further, "k(xc, yc, r, λ, coeff)" is correction data 167a for correcting the wavelength λ component of the spectral imaging data obtained by imaging the R light at the imaging coordinates (xc, yc).

Equation (8) shows the case of correcting the intensity I of the wavelength λ component of the spectral imaging data obtained by imaging the adjustment image of R light. is corrected by the correction data 167a at all wavelengths λi.

Next, the control unit 150 multiplies the spectral imaging data corrected by the correction data 167a by the estimation matrix M to estimate the spectrum for each second wavelength interval (step S14). The formula for obtaining the estimated value of the spectrum for each second wavelength interval is shown in (9) below. Step S14 corresponds to an example of the "calculation step" of the present invention.
Spectral(xc, yc, λ)=Mpost(xc, yc, λ) (9)

In Equation (9), Spectral(xc, yc, λ) indicates the estimated value of the spectrum at coordinates (xc, yc). By multiplying post(xc, yc, λ) by the estimated matrix M, an estimated value of the light intensity I can be obtained at wavelength intervals of 1 nm, for example.

FIG. 5 is a diagram showing light intensity for each spectral frequency obtained from spectral imaging data. The horizontal axis of FIG. 5 indicates the wavelength nm, and the vertical axis indicates the light intensity I. In FIG. The black circles shown in FIG. 5 indicate the values obtained from the spectral imaging data. FIG. 5 shows the light intensity obtained from the spectral imaging data captured at the spectral wavelength interval of 20 nm.
FIG. 6 is a diagram showing estimated values of the spectrum calculated by the control unit 150. As shown in FIG. The horizontal axis of FIG. 6 indicates the wavelength nm, and the vertical axis indicates the light intensity I. In FIG. FIG. 6 shows spectral estimates obtained at wavelength intervals of 1 nm.

Next, the control unit 150 converts the estimated spectrum value to the tristimulus value X , Y, Z (step S15). Conversion formulas to tristimulus values X, Y, Z are shown as formulas (10a), (10b), and (10c).

In formulas (10a), (10b) and (10c), X (xp, yp), Y (xp, yp), and Z (xp, yp) are panel coordinates associated with imaging coordinates (xc, yc). Stimulus values at coordinates (xp, yp) are shown. The control unit 150 causes the storage unit 160 to store the calculated tristimulus values X(xp, yp), Y(xp, yp), and Z(xp, yp). Hereinafter, X(xp, yp), Y(xp, yp) and Z(xp, yp) are collectively referred to as Fin_XYZ(xp, yp).

Next, control unit 150 determines whether tristimulus values Fin_XYZ(xp, yp) have been calculated for all panel coordinates of liquid crystal panel 115 (step S16). If the tristimulus values Fin_XYZ(xp, yp) have not been calculated for all the panel coordinates (step S16/NO), the control unit 150 returns to step S13 to select panel coordinates, and performs correction corresponding to the selected panel coordinates. The spectral imaging data is corrected by the data 167a.

Further, when the tristimulus values Fin_XYZ(xp, yp) are calculated for all panel coordinates (step S16/YES), the control unit 150 acquires the target value for image quality adjustment from the storage unit 160 (step S17). Here, a case will be described in which the tristimulus values obtained by converting the spectral colorimetric data measured by the spectrum measuring device by the above-described equations (10a), (10b) and (10c) are used as the target values. Alternatively, the adjustment image may be corrected using the correction parameters obtained in the previous image quality adjustment, and the tristimulus values obtained based on the corrected adjustment image may be set as the image quality adjustment target values. That is, the gradation value of the image for adjustment is corrected by the correction parameter obtained in the previous image quality adjustment, the image for adjustment with the corrected gradation value is displayed on the screen SC, and the spectral imaging unit 137 performs imaging. Generate data. After that, tristimulus values Fin_XYZ(xp, yp) are obtained according to the procedure of steps S13 to S15 described above, and the obtained tristimulus values are set as target values for image quality adjustment.

Next, the control unit 150 obtains an inverse function of the tristimulus values Fin_XYZ(xp, yp) calculated in step S15. Further, the control unit 150 multiplies the obtained inverse function with the target value obtained in step S17 to calculate the adjustment ratio for each color of R, G, and B. FIG. The target value obtained in step S17 is denoted as Target_XYZ. A formula for calculating the correction parameter is shown in the following formula (11).
Coef_RGB(xp, yp)=Fin_XYZ(xp, yp) ^{-1.Target_XYZ} (11)

Next, the control unit 150 obtains the correction data 167a for correcting the gradation value of the image data by referring to the gamma correction table. The gamma correction table is a table stored in storage unit 160, in which gradation values of image data and transmittance of liquid crystal panel 115 are associated and registered. The control unit 150 refers to the gamma correction table and acquires the gradation value of the image data corresponding to the transmittance of the liquid crystal panel 115 when the adjustment image is displayed on the screen SC in step S6. Further, the control unit 150 refers to the gamma correction table to acquire the gradation value of the image data corresponding to the transmittance of the liquid crystal panel 115 after adjustment based on the calculated adjustment ratio. The control unit 150 calculates the difference in tone value of the acquired image data as a correction parameter for correcting the image data (step S18). The correction parameter is a parameter for correcting the RGB ratio of each pixel forming the image data. Step S18 corresponds to an example of the "generating step" of the present invention.

The control unit 150 may generate a correction parameter with a pixel constituting the liquid crystal panel 115 as one unit, or may generate a correction parameter with a plurality of pixels as one unit. When generating correction parameters with a plurality of pixels as one unit, correction parameters for pixels for which correction parameters have not been generated may be obtained by, for example, interpolation calculation based on linear interpolation.

Next, the control unit 150 determines whether or not the calculated correction parameter is valid data (step S19). For example, the control unit 150 calculates the difference between the correction parameter calculated in the previous image quality adjustment and the correction parameter calculated this time, and calculates the difference between the calculated values as a first threshold value prepared in advance and Compare with a second threshold. If the difference between the calculated values is greater than the first threshold value, control unit 150 determines that the correction parameter calculated this time is invalid. Also, when the difference between the calculated values is smaller than the second threshold value, the control unit 150 determines that the correction parameter calculated this time is invalid. Note that the second threshold is a threshold smaller in value than the first threshold.

If the calculated correction parameter is valid data, the control unit 150 stores the calculated correction parameter in the storage unit 160 (step S20). Further, if the calculated correction parameter is not valid data, the control unit 150 may repeat the process from step S2 or S6.

When the image supply device 200 starts to supply the image signal, the control unit 150 reads the correction parameters from the storage unit 160 and outputs them to the image processing unit 143 . When the image interface 141 starts receiving image signals and image data is input from the image interface 141 , the image processing unit 143 develops the input image data in the frame memory 145 . The image processing unit 143 corrects the image data using the correction parameters input from the control unit 150 (step S21). Step S21 corresponds to an example of the "correction step" of the present invention.

The image processing unit 143 outputs image data for which image processing has been completed to the light modulation device driving circuit 123 . The light modulator drive circuit 123 generates a drive signal based on the image data input from the image processing unit 143, drives the liquid crystal panel 115 based on the generated drive signal, and draws an image on the liquid crystal panel 115. Light emitted from the light source 111 passes through the liquid crystal panel 115 to generate image light corresponding to the image of the image data, and the generated image light is projected onto the screen SC by the optical unit 117 (step S22). .

As described above, the projector 100 according to the first embodiment performs colorimetry using the spectral imaging unit 137 including the imaging element 303 and the spectral element 302 .
The projector 100 executes each step of an imaging step, a calculation step, and a generation step.
In the imaging step, the image for adjustment displayed on the screen SC by the projection unit 110 is changed within the wavelength range set based on the image for adjustment, and the spectral wavelength λi of the spectroscopic element 302 is changed for each first wavelength interval. The spectral imaging unit 137 performs imaging to generate spectral imaging data.
The calculating step calculates an estimated spectrum value for each second wavelength interval, which is shorter than the first wavelength interval, based on the spectral imaging data generated by the imaging step and the estimation matrix M used for estimating the spectrum.
The generation step generates a correction parameter for correcting the image data that is the basis of the image to be displayed, based on the estimated spectrum value calculated in the calculation step.
Therefore, it is possible to calculate the estimated value of the spectrum for each second wavelength interval, which is shorter than the first wavelength interval captured by the spectral imaging unit 137, so that the colorimetry of the image can be performed with high accuracy. In addition, since the spectral imaging unit 137 can perform imaging at the first wavelength interval, which is longer than the second wavelength interval, the time required to generate the spectral imaging data can be shortened. Further, by calculating a correction parameter for correcting the image data based on the calculated estimated value of the spectrum, the image can be corrected with high accuracy.

The estimated matrix M is calculated based on spectral imaging data captured by the spectral imaging unit 137 . The spectral imaging data generated by the spectral imaging unit 137 includes errors due to the optical characteristics of optical components included in the projector 100. By calculating the estimated matrix M based on the color data, it is possible to correct the optical characteristics and obtain an accurate spectral estimate.

In addition, the estimated matrix M is the measurement data obtained by measuring the adjustment image displayed on the screen SC at every second wavelength interval with the spectrum measurement device, and the estimated value of the spectrum obtained based on the spectral imaging data. is the determinant that minimizes the squared error of
Therefore, it is possible to suppress errors occurring in the spectral imaging data generated by the spectral imaging unit 137 and to calculate an accurate spectrum estimate value.

In the imaging step, the spectroscopic imaging unit 137 changes the distance between the pair of reflective films 304 and 305 facing each other included in the spectroscopic element 302 to change the spectral wavelength of the spectroscopic element 302, thereby performing spectroscopic imaging for each first wavelength interval. Output imaging data.
Therefore, the setting accuracy of the spectral wavelength of the spectral element 302 can be improved.

The calculation step calculates an estimated value based on the estimated matrix M and the spectral imaging data corrected by the correction data 167a for correcting the sensitivity distribution occurring in the image sensor 303 .
Therefore, the sensitivity distribution occurring in the image sensor 303 can be reduced.

[Second embodiment]
A second embodiment will be described with reference to the accompanying drawings.
The second embodiment is an embodiment of an image display system 1 in which a plurality of projectors 100 are connected by cables 3 and data communication is performed between the projectors 100 . In the second embodiment, data communication is performed between a plurality of projectors 100, and colors of images displayed by each projector 100 are matched. In the second embodiment, a case where a plurality of projectors 100 are connected by wire will be described, but the connection between the projectors 100 may be wireless.

FIG. 7 is a system configuration diagram of the image display system 1. As shown in FIG.
The image display system 1 includes two projectors 100 . The projector 100 that displays an image on the left side of the screen SC as viewed from the direction facing the screen SC is referred to as a projector 100A, and the projector 100 that displays an image on the right side of the screen SC is referred to as a projector 100B. Although FIG. 7 shows a configuration in which the image display system 1 includes two projectors 100, the number of projectors 100 to be connected is not limited to two, and n projectors 100 can be connected. Note that "n" is a natural number of 2 or more.

Since the configurations of the projector 100A and the projector 100B are substantially the same as the configuration of the projector 100 shown in FIG. 1, the description of the configuration of the projector 100A and the projector 100B is omitted. Further, among the constituent elements of the projector 100 shown in the block diagram of FIG. 1, the constituent elements of the projector 100A are denoted by "A", and the constituent elements of the projector 100B are denoted by "B". For example, the controller 150 of the projector 100A will be referred to as "controller 150A", and the controller 150 of the projector 100B will be referred to as "controller 150B". The projector 100A and the projector 100B are each connected to the image supply device 200 via the cable 3, and display an image based on the image signal supplied from the image supply device 200 on the screen SC.

The projector 100A operates as a master device, and the projector 100B operates as a slave device. That is, the projector 100B operates under the control of the projector 100A. The projector 100A, which is the master device, instructs the projector 100B to calculate the tristimulus values described in the first embodiment, generates correction parameters, and transmits them to the projector 100B.

A region where the projector 100A projects the image light is called a projection region 10, and a region where the projector 100B projects the image light is called a projection region 20. FIG. The projection area 10 and the projection area 20 partially overlap each other.

In the second embodiment, the projector 100A corresponds to an example of the "first display device" of the invention, and the projector 100B corresponds to an example of the "second display device" of the invention. Also, the projection section 110A corresponds to an example of the "first display section" of the present invention, and the projection section 110B corresponds to an example of the "second display section" of the present invention. The spectral imaging section 137A corresponds to an example of the "first spectral imaging section" of the present invention, and the spectral imaging section 137B corresponds to an example of the "second spectral imaging section" of the present invention. The imaging element 303A corresponds to an example of the "first imaging element" of the present invention, and the imaging element 303B corresponds to an example of the "second imaging element" of the present invention. The spectral element 302A corresponds to the "first spectral element" of the invention, and the spectral element 302B corresponds to the "second spectral element" of the invention. Also, the control unit 150A corresponds to an example of the "first control unit" of the present invention, and the control unit 150B corresponds to an example of the "second control unit" of the present invention. Estimated value calculator 175A corresponds to an example of the "first estimated value calculator" of the present invention, and estimated value calculator 175B corresponds to an example of the "second estimated value calculator" of the present invention. Further, the storage section 160A corresponds to an example of the "first storage section" of the present invention, and the storage section 160B corresponds to an example of the "second storage section" of the present invention.

FIG. 8 is a flow chart showing the operation of the projector 100A.
The operation of the projector 100A will be described with reference to the flowchart shown in FIG.
The control unit 150A determines whether or not an operation for selecting color matching has been received (step T1). The control unit 150A determines whether or not an operation for selecting color matching has been received based on an operation signal input from the input interface 135A (step S1). If the operation to select color matching has not been received (step S1/NO), the control unit 150A waits to start the operation until the operation is received. Further, when receiving an operation instructing execution of another process, control unit 150A performs an operation corresponding to the received operation, and returns to the determination of step S1.

When receiving an operation to select color matching (step S1/YES), control unit 150A executes the processes of steps S2 to S16 shown in FIG. 4, and calculates tristimulus values at all panel coordinates of liquid crystal panel 115A. (step T2).

Next, the control unit 150A transmits a signal instructing calculation of tristimulus values to the projector 100B to instruct the projector 100B to calculate tristimulus values (step T3). When instructing the calculation of the tristimulus values to the projector 100B, the control unit 150A determines whether or not a signal notifying completion of calculation of the tristimulus values has been received from the projector 100B (step T4). If the control unit 150A has not received a signal notifying completion (step T4/NO), it waits until a signal is received.

Further, when the control unit 150A receives a signal notifying completion from the projector 100B (step T4/YES), the control unit 150A transmits an acquisition request for the calculated tristimulus values to the projector 100B (step T5). The control unit 150A determines whether or not tristimulus values have been received from the projector 100B (step T6). If the control unit 150A has not received the tristimulus values from the projector 100B (step T6/NO), it waits until the tristimulus values are received.

Further, upon receiving the tristimulus values from the projector 100B, the control unit 150A causes the storage unit 160A to store the received tristimulus values. Next, the controller 150A sets target values for color matching (step T7). The control unit 150A compares the tristimulus values received from the projector 100B and the tristimulus values generated by the control unit 150A to identify the panel coordinates with the lowest brightness. For example, the control unit 150A may compare the Y values having luminance information among the tristimulus values, and identify the panel coordinates associated with the smallest Y value. Also, if there are a plurality of panel coordinates with the lowest brightness, the panel coordinates with the lowest brightness may be specified by comparing other stimulus values such as the X value and the Z value.

After identifying the panel coordinates with the lowest luminance, the control unit 150A sets the tristimulus values of the identified panel coordinates with the lowest luminance as target values. The control unit 150A uses Target_XYZ as the set target value and calculates correction parameters for correcting the tristimulus values of other panel coordinates using the above-described formula (11) (step T8). Similarly, the control unit 150A generates a correction parameter using Equation (11) for the tristimulus values associated with each of the panel coordinates of the projector 100B received from the projector 100B (step T8).

Control unit 150A generates correction parameters for each of the panel coordinates of projector 100A, and stores the generated correction parameters in storage unit 160A (step T9). The correction parameter generated here corresponds to an example of the "first correction parameter" of the present invention. The control unit 150A also generates correction parameters for each of the panel coordinates of the projector 100B, and transmits the generated correction parameters to the projector 100B (step T10). The correction parameter generated here corresponds to an example of the "second correction parameter" of the present invention.

Thereafter, when the image supply device 200 starts to supply the image signal, the control section 150A causes the image processing section 143A to correct the image data using the generated correction parameter (step T11). Then, the control unit 150A causes the projection unit 110A to project image light based on the corrected image data onto the screen SC. As a result, an image based on the image data whose tint has been corrected by the correction parameters is displayed on the screen SC (step T12).

FIG. 9 is a flow chart showing the operation of the projector 100B.
The operation of the projector 100B will be described with reference to the flowchart shown in FIG.
The control unit 150B determines whether or not a signal instructing calculation of tristimulus values has been received from the projector 100A (step U1). If the control unit 150B has not received the signal instructing the calculation (step U1/NO), the control unit 150B waits to start the process until the signal is received.

Further, when the control unit 150B receives a signal instructing calculation of tristimulus values from the projector 100A (step U1/YES), the control unit 150B executes the processes of steps S2 to S16 shown in FIG. Tristimulus values are calculated at the coordinates (step U2). When the calculation of the tristimulus values is completed, the control section 150B transmits a signal notifying the completion of the calculation to the projector 100A (step U3).

Next, the control unit 150B determines whether or not a tristimulus acquisition request has been received from the projector 100A (step U4). If the control unit 150B has not received a tristimulus acquisition request (step U4/NO), it waits until an acquisition request is received.

When the control unit 150B receives the tristimulus value acquisition request (step U4/YES), the control unit 150B transmits the tristimulus values calculated for each panel coordinate to the projector 100A (step U5). After that, the control unit 150B determines whether or not the correction parameters have been received from the projector 100A (step U6). If the control unit 150B has not received the correction parameters (step U6/NO), it waits until the correction parameters are received.

Upon receiving the correction parameters from projector 100A (step U6), control unit 150B causes storage unit 160B to store the received correction parameters (step U7). Thereafter, when the image supply device 200 starts to supply the image signal, the control section 150B causes the image processing section 143B to correct the image data using the generated correction parameter (step U8). Then, the control section 150B causes the projection section 110B to project image light based on the corrected image data onto the screen SC. As a result, an image based on the image data whose tint has been corrected by the correction parameters is displayed on the screen SC (step U9).

As described above, the image display system 1 of the second embodiment includes the projector 100A and the projector 100B.
The projector 100A includes a projection section 110A, a spectral imaging section 137A, a control section 150A, a storage section 160A, and an estimated value calculation section 175A.
The projection unit 110A projects image light onto the screen SC to display an adjustment image on the screen SC.
The spectral imaging unit 137A includes an imaging device 303A and a spectral device 302A, captures an adjustment image, and outputs spectral imaging data.
The control unit 150A sets the spectral wavelength of the spectroscopic element 302A for each first wavelength interval within the wavelength range set based on the adjustment image, and causes the spectral imaging unit 137A to generate imaging data.
Storage unit 160A stores an estimation matrix M used for spectrum estimation.
Based on the spectral imaging data output from the spectral imaging section 137A and the estimated matrix M, the estimated value calculator 175A calculates an estimated value of the spectrum for each second wavelength interval shorter than the first wavelength interval.

The projector 100B includes a projection section 110B, a spectral imaging section 137B, a control section 150B, a storage section 160B, and an estimated value calculation section 175B.
The projection unit 110B projects the image light onto the screen SC to display the adjustment image on the screen SC.
The spectral imaging unit 137B includes an imaging device 303B and a spectral device 302B, captures an adjustment image, and outputs spectral imaging data.
The control unit 150B sets the spectral wavelength of the spectral element 302B for each first wavelength interval within the wavelength range set based on the adjustment image, and causes the spectral imaging unit 137B to generate imaging data.
The storage unit 160B stores an estimation matrix M used for spectrum estimation.
Based on the spectral imaging data output from the spectral imaging section 137B and the estimated matrix M, the estimated value calculator 175B calculates an estimated value of the spectrum for each second wavelength interval shorter than the first wavelength interval.

In addition, control unit 150A generates image data based on which the image displayed by projector 100A is based on the estimated spectrum value calculated by estimated value calculation unit 175A and the estimated spectrum value calculated by estimated value calculation unit 175B. Generate correction parameters for correction. Further, the control unit 150A generates correction data 167a for correcting image data that is the source of the image displayed by the projector 100B.

Therefore, it is possible to perform color matching between the image displayed by the projector 100A and the image displayed by the projector 100B.

[Third embodiment]
FIG. 10 is a diagram showing the system configuration of the third embodiment.
In the above-described first embodiment, the method of correcting the hue of an image using the spectral imaging unit 137 mounted on the projector 100 has been described. In the third embodiment, the configuration of an image display system 1A in which a colorimetric device 400 having a spectral imaging section 420 is provided separately from a projector 100C will be described.
The projector 100C displays an adjustment image on the screen SC, and the colorimetry device 400 captures the displayed adjustment image with the spectral imaging unit 420 to generate spectral imaging data. The correction parameters may be generated by the projector 100C or by the colorimetry device 400. FIG. The colorimetry device 400 may transmit the generated spectral imaging data to the projector 100C, or may generate correction parameters based on the spectral imaging data and transmit the generated correction parameters to the projector 100C. In this embodiment, a case will be described in which the colorimetry device 400 generates correction parameters and transmits them to the projector 100C.

FIG. 11 is a block diagram showing the configuration of the colorimetric device 400. As shown in FIG.
The colorimetry device 400 includes a communication unit 410 , a spectral imaging unit 420 and a control unit 430 .
The communication unit 410 is connected to the projector 100C via the cable 3 and performs mutual data communication with the projector 100C. FIG. 11 shows the case where the colorimetry device 400 and the projector 100C are connected by the cable 3, but the connection between the colorimetry device 400 and the projector 100C may be wireless.

The spectral imaging section 420 has the same configuration as the spectral imaging section 137 of the projector 100 shown in FIGS. A detailed description of the configuration of the spectral imaging unit 420 is omitted. The spectral imaging unit 420 captures an adjustment image while changing the spectral wavelength λi under the control of the control unit 430, and outputs spectral imaging data. The colorimetric device 400 is installed at a position capable of capturing an image of a range including the screen SC.

The controller 430 includes a memory 440 and a processor 450 . The storage unit 440 stores a control program 441 and calibration data 443 . The calibration data 443 are the same as the calibration data 167 of the first embodiment.
The processor 450 also executes the control program 441 and functions as an imaging control unit 451 , an estimated value calculation unit 453 and a generation unit 455 .

The imaging control unit 451 controls the spectral imaging unit 420 and causes the spectral imaging unit 420 to generate imaging data. The imaging control unit 451 also receives color information indicating the color of the adjustment image projected on the screen SC from the projector 100C , and determines the wavelength range to be imaged by the spectral imaging unit 137 based on the received color information. After determining the wavelength range, the imaging control unit 451 causes the spectral imaging unit 420 to perform imaging while changing the spectral wavelength λi at the first wavelength interval within the determined wavelength range.

The estimated value calculator 453 calculates the estimated value of the spectrum for each second wavelength interval, similarly to the estimated value calculator 175 of the first embodiment, and the generator 455 is similar to the generator 177 of the first embodiment. , generate the correction parameters. The generation unit 455 transmits the generated correction parameters to the projector 100C through the communication unit 410. FIG.

The configuration of the projector 100C is substantially the same as the configuration of the projector 100 of the first embodiment shown in FIG. 1, and the description of the configuration is omitted. The projector 100</b>C does not have to include the spectral imaging section 137 .

FIG. 12 is a flow chart showing the operation of the projector 100C of the third embodiment.
The control unit 150 first determines whether or not an operation for selecting image quality adjustment has been received (step V1). When receiving an operation to select image quality adjustment (step V1/YES), the control unit 150 notifies the colorimetry device 400 of the start of image quality adjustment (step V2).

In this flowchart, description of the procedure for calculating the projective transformation matrix 167b described in the flowchart of FIG. 3 is omitted. That is, it is assumed that the projective transformation matrix 167b is calculated in advance and stored in the storage unit 440 of the colorimetric device 400. FIG.

Next, the control section 150 determines the color and gradation of the adjustment image to be displayed on the screen SC (step V3). After determining the color and gradation of the image for adjustment, the control section 150 reads the adjustment image data 162 of the determined color and gradation from the storage section 160 . The control unit 150 causes the image processing unit 143 to process the read adjustment image data 162, controls the driving unit 120 and the projection unit 110, and displays an adjustment image corresponding to the adjustment image data 162 on the screen SC. (Step V4).

Next, the control unit 150 transmits the color and gradation information of the displayed adjustment image to the colorimetry device 400 (step V5). After transmitting the color and gradation information of the adjustment image to the colorimetry device 400, the control unit 150 waits until the colorimetry device 400 notifies the end of imaging (step V6). When the control unit 150 receives the imaging end notification from the colorimetry device 400 (step V6/YES), it determines whether or not the adjustment images of all colors have been displayed in all gradations (step V7). If the control unit 150 has not displayed the adjustment images of all colors with all gradations (step V7/NO), it returns to step V3 and selects the color and gradation of the adjustment image to be displayed on the screen SC. (Step V3).

Further, when the adjustment images of all colors are displayed in all gradations (step V7/YES), the control unit 150 transmits a colorimetry completion notification to the colorimetry device 400 (step V8). After transmitting the colorimetry completion notification to the colorimetry device 400, the control unit 150 determines whether or not correction parameters have been received from the colorimetry device 400 (step V9). If the correction parameters have not been received (step V9/NO), the control section 150 waits until the correction parameters are received. Further, when the correction parameter is received (step V9/YES), the control unit 150 stores the received correction parameter in the storage unit 160 (step V10).

After that, when the supply of the image signal from the image supply device 200 is started, the control unit 150 causes the image processing unit 143 to correct the image data using the generated correction parameters (step V11). The image light based on the image is projected onto the screen SC by the projection unit 110 . As a result, an image based on the image data whose tint has been corrected by the correction parameters is displayed on the screen SC (step V12).

FIG. 13 is a flow chart showing the operation of the colorimetry device 400. As shown in FIG.
The control unit 430 first determines whether or not an image quality adjustment start notification has been received from the projector 100C (step W1). If the control unit 430 has not received the notification of starting the image quality adjustment (step W1/NO), the control unit 430 waits to start the process until receiving the notification of starting the image quality adjustment.

When the control unit 430 receives the image quality adjustment start notification (step W1/YES), the control unit 430 determines whether or not information about the color and gradation of the adjustment image displayed on the screen SC has been received from the projector 100C ( step W2). If the control unit 430 has not received information about the color and gradation of the image for adjustment from the projector 100C (step W2/NO), the process proceeds to the determination of step W8.

Further, when the control unit 430 receives information about the color and gradation of the image for adjustment from the projector 100C (step W2/YES), the control unit 430 causes the spectral imaging unit 420 to capture an image based on the received information about the color of the image for adjustment. A wavelength range is determined (step W3). After determining the wavelength range, the control unit 430 sets the set spectral wavelength λi to be set in the spectroscopic element 302 to the minimum value within the wavelength range, and causes the spectral imaging unit 420 to perform imaging and generate spectral imaging data (step W4).

Next, the control unit 430 changes the value of the set spectral wavelength λi set in the spectral imaging unit 420 to a value larger by a preset value (step W5), and determines whether the set spectral wavelength λi exceeds the wavelength range. (step W6). If the set spectral wavelength λi does not exceed the wavelength range (step W6/NO), the control unit 430 sets the set spectral wavelength λi to the spectroscopic element 302, causes the spectral imaging unit 420 to perform imaging, and obtains spectral imaging data. generated (step W4).

Further, when the set spectral wavelength λi exceeds the wavelength range (step W6/YES), the control unit 430 transmits an imaging end notification to the projector 100C (step W7). Thereafter, control unit 430 returns to the determination of step W2.

Further, when the determination in step W2 is negative (step W2/NO), the control unit 430 determines whether or not a colorimetry completion notification has been received from the projector 100C (step W8). If the controller 430 has not received a colorimetry completion notification from the projector 100C (step W8/NO), the process returns to step W2. Further, when the controller 430 receives a colorimetry completion notification from the projector 100 (step W8/YES), the controller 430 calculates a correction parameter (step W9). The procedure for calculating the correction parameters has already been explained with reference to FIG. 4, so the explanation will be omitted. After calculating the correction parameters, the controller 430 transmits the calculated correction parameters to the projector 100C (step W10).

Also in the third embodiment, the same effect as in the first embodiment can be obtained.

[Fourth embodiment]
FIG. 14 is a diagram showing the system configuration of the fourth embodiment.
In the second embodiment described above, the method of correcting the hue of an image using the spectral imaging units 137A and 137B mounted on the projectors 100A and 100B has been described. In this fourth embodiment, a configuration in which a colorimetric device 400 having a spectral imaging unit 420 is provided separately from the projectors 100D and 100E will be described. The colorimetric device 400 and the projectors 100D and 100E are connected by a cable 3, and the image display system 1B performs data communication between the colorimetric device 400 and the projectors 100D and 100E. In the second embodiment, data communication is performed between a plurality of projectors 100, and colors of images displayed by each projector 100 are matched. In the fourth embodiment, a wired connection between the colorimetric device 400 and the projectors 100D and 100E will be described, but the colorimetric device 400 and the projectors 100D and 100E may be connected wirelessly.

The projector 100D and the projector 100E are each connected to the image supply device 200 via the cable 3, and display an image based on the image signal supplied from the image supply device 200 on the screen SC.

The projector 100D operates as a master device, and the projector 100E operates as a slave device. That is, the projector 100E operates under the control of the projector 100D . The projector 100D , which is the master device, instructs the projector 100E to calculate the tristimulus values described in the first embodiment, generates correction parameters, and transmits them to the projector 100E .

A region where the projector 100D projects the image light is called a projection region 10D, and a region where the projector 100E projects the image light is called a projection region 20E. The projection area 10D and the projection area 20E partially overlap each other.

The projectors 100D and 100E display an adjustment image on the screen SC, and the colorimetry device 400 captures the displayed adjustment image with the spectral imaging unit 420 to generate spectral imaging data. The correction parameters may be generated by the projectors 100D and 100E, or by the colorimetry device 400. FIG. The colorimetry device 400 may transmit the generated spectral imaging data to the projectors 100D and 100E, or may generate correction parameters based on the spectral imaging data and transmit the generated correction parameters to the projectors 100D and 100E. good.
The colorimetric device 400 is installed at a position capable of capturing an image of a range including the screen SC. The colorimetry device 400 images the projection area 10D when the projector 100D projects the adjustment image, and images the projection area 20E when the projector 100E projects the adjustment image.

The embodiments described above are preferred embodiments of the present invention. However, the present invention is not limited to this, and various modifications can be made without departing from the scope of the present invention.
For example, in the above-described embodiment, the case of displaying monochromatic images of each color of R, G, and B as an adjustment image has been described as an example. and B may be included.

Further, in the above-described embodiment, the configuration using three transmissive liquid crystal panels corresponding to each color of RGB as the light modulation device 113 that modulates the light emitted from the light source has been described as an example. The invention is not limited to this. For example, a configuration using three reflective liquid crystal panels may be used, or a system in which one liquid crystal panel and a color wheel are combined may be used. Alternatively, a system using three digital mirror devices (DMD), a DMD system combining one digital mirror device and a color wheel, or the like may be used. If only one liquid crystal panel or DMD is used as the light modulator, a member corresponding to a combining optical system such as a cross dichroic prism is unnecessary. In addition to liquid crystal panels and DMDs, any light modulation device capable of modulating light emitted from a light source can be employed without any problem.

4, 8, 9, 12, and 13 are divided according to the main processing contents for easy understanding of the processing. The present invention is not limited by the manner or name of the above. Depending on the processing content, it may be divided into more processing units, or one processing unit may be divided so as to include more processing. Moreover, the order of the processing may be appropriately changed within the scope of the present invention.

Moreover, each functional unit shown in FIGS. 1 and 11 shows a functional configuration, and a specific implementation form is not particularly limited. In other words, it is not always necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to adopt a configuration in which one processor executes a program to realize the functions of a plurality of functional units. Further, part of the functions implemented by software in the above-described embodiments may be implemented by hardware, or part of the functions implemented by hardware may be implemented by software. In addition, the specific detailed configurations of other units of the projector 100 and the colorimetric device 400 can be arbitrarily changed without departing from the gist of the present invention.

Further, when the colorimetry method and image display method of the present invention are realized by a computer, it is possible to configure the program to be executed by the computer in the form of a recording medium or a transmission medium for transmitting the program. A magnetic or optical recording medium or a semiconductor memory device can be used as the recording medium. Specifically, recording media include flexible disks, HDDs (Hard Disk Drives), CD-ROMs (Compact Disk Read Only Memory), DVDs (Digital Versatile Disks), Blu-ray (registered trademark) Discs, and magneto-optical discs. is mentioned. As recording media, portable or fixed recording media such as flash memories and card-type recording media can also be used. Further, the recording medium may be a non-volatile storage device such as a RAM (Random Access Memory), a ROM (Read Only Memory), an HDD, etc., which are internal storage devices provided in the display device.

3 Cable 10, 20 Projection area 100, 100A, 100B Projector 101 Bus 110, 110A, 110B Projection unit 111 Light source 113 Optical modulator 115, 115A, 115B Liquid crystal panel 117 optical unit 120, 120A, 120B drive unit 121, 121A, 121B light source drive circuit 123, 123A, 123B light modulator drive circuit 131, 131A, 131B operation panel 133, 133A, 133B... Remote control light receiving part 135, 135A, 135B... Input interface 137, 137A, 137B... Spectral imaging part 139, 139A, 139B... Communication part 141, 141A, 141B... Image interface 143, 143A, 143B... Image Processing unit 145, 145A, 145B Frame memory 150, 150A, 150B Control unit 160, 160A, 160B Storage unit 161 Control program 162 Adjustment image data 163 Pattern image data 164 Setting data 165 Parameter 167 Calibration data 167a Correction data 167b Projective transformation matrix 170 Processor 171 Projection control unit 173 Imaging control unit 175 Estimated value calculation unit 177 Generation unit , 200... Image supply device 301... Incidence optical system 302... Spectral element 303... Imaging element 304... Reflective film 305... Reflective film 306... Gap changing unit 400... Color measuring device 410... Communication unit 420... spectral imaging unit, 430... control unit, 440... storage unit, 441... control program, 443... calibration data, 450... processor, 451... imaging control unit, 453... estimated value calculation unit, 455... generation unit.

Claims (8)

A colorimetry method for performing colorimetry with a spectral imaging device having an imaging element and a spectroscopic element,
an imaging step of imaging the displayed image with the spectral imaging device while changing the spectral wavelength of the spectroscopic element for each first wavelength interval in a wavelength range set based on the image, and generating imaging data; ,
a calculating step of calculating an estimated value of the spectrum for each second wavelength interval shorter than the first wavelength interval based on the imaging data generated by the imaging step and an estimation matrix used for estimating the spectrum;
a generation step of generating a correction parameter for correcting a gradation value for each color of image data on which an image to be displayed is based, based on the estimated value of the spectrum calculated by the calculation step;
with
The estimated matrix is calculated based on the imaging data captured by the spectral imaging device,
The estimated matrix is a determinant that minimizes the square error between the measured data obtained by measuring the displayed image at each second wavelength interval with a dedicated measuring device and the estimated value of the spectrum. ,
Colorimetric method. In the imaging step, the spectral wavelength of the spectroscopic element is changed by changing the distance between a pair of reflecting films facing each other provided in the spectroscopic element, and the imaging data is output for each of the first wavelength intervals.
The colorimetric method according to claim 1 . In the calculating step, the estimated value is calculated based on the imaging data corrected by correction data for correcting the sensitivity distribution on the plane of the imaging element and the estimated matrix.
The colorimetric method according to claim 1 or 2 . a display step of displaying an image;
a step of capturing the displayed image by a spectral imaging unit including an imaging element and a spectroscopic element, wherein the spectroscopic wavelength of the spectroscopic element is set to a first wavelength within a wavelength range set based on the displayed image; an imaging step of imaging with the spectral imaging unit while changing every interval to generate imaging data;
a calculating step of calculating an estimated value of the spectrum for each second wavelength interval shorter than the first wavelength interval based on the imaging data generated by the imaging step and an estimation matrix used for estimating the spectrum;
a generation step of generating a correction parameter for correcting a gradation value for each color of image data on which an image to be displayed in the display step is based, based on the estimated value of the spectrum calculated in the calculation step;
a correction step of correcting the gradation value for each color of the image data that is the basis of the image to be displayed in the display step, using the generated correction parameter;
causing the displaying step to display an image based on the image data corrected by the correcting step ;
The estimated matrix is calculated based on the imaging data captured by the spectral imaging unit,
The estimated matrix is a determinant that minimizes the square error between the measured data obtained by measuring the displayed image at each second wavelength interval with a dedicated measuring device and the estimated value of the spectrum. ,
Image display method. a spectral imaging unit that includes an imaging element and a spectroscopic element and captures a displayed image and outputs spectral imaging data;
a control unit that sets the spectral wavelengths of the spectroscopic element to spectral wavelengths for each first wavelength interval within a wavelength range that is set based on the displayed image, and causes the spectral imaging unit to generate spectral imaging data; , a storage unit that stores an estimation matrix used for estimating the spectrum;
an estimated value calculation unit that calculates an estimated value of a spectrum for each second wavelength interval, which is shorter than the first wavelength interval, based on the spectral imaging data output by the spectral imaging unit and the estimation matrix;
a generating unit that generates a correction parameter for correcting a gradation value for each color of image data based on the estimated value calculated by the estimated value calculating unit;
with
The estimated matrix is calculated based on the spectral imaging data captured by the spectral imaging unit,
The estimated matrix is a determinant that minimizes the square error between the measured data obtained by measuring the displayed image at each second wavelength interval with a dedicated measuring device and the estimated value of the spectrum. ,
colorimetric device. a display unit for displaying an image;
a spectral imaging unit that includes an imaging element and a spectroscopic element and captures the image and outputs spectral imaging data;
a control unit that sets the spectral wavelength of the spectral element for each first wavelength interval within the wavelength range that is set based on the image, and causes the spectral imaging unit to generate spectral imaging data;
a storage unit that stores an estimation matrix used for spectrum estimation;
an estimated value calculation unit that calculates an estimated value of a spectrum for each second wavelength interval, which is shorter than the first wavelength interval, based on the spectral imaging data output by the spectral imaging unit and the estimation matrix;
a generating unit that generates a correction parameter for correcting a gradation value for each color of image data based on the estimated value calculated by the estimated value calculating unit;
an image processing unit that corrects the gradation value for each color of the image data using the correction parameter generated by the generation unit;
The estimated matrix is calculated based on the spectral imaging data captured by the spectral imaging unit,
The estimation matrix minimizes the square error between measurement data obtained by measuring the image displayed on the display unit at each second wavelength interval with a dedicated measurement device and the estimated value of the spectrum. is a determinant,
Image display device. A display device for displaying an image and a colorimetric device for measuring the color of the image,
The colorimetric device is
a spectral imaging unit that includes an imaging element and a spectroscopic element and captures the image and outputs spectral imaging data;
a control unit that sets the spectral wavelength of the spectral element for each first wavelength interval within the wavelength range that is set based on the image, and causes the spectral imaging unit to generate spectral imaging data;
a storage unit that stores an estimation matrix used for spectrum estimation;
an estimated value calculation unit that calculates an estimated value of a spectrum for each second wavelength interval, which is shorter than the first wavelength interval, based on the spectral imaging data output by the spectral imaging unit and the estimation matrix;
a generation unit that generates a correction parameter for correcting the gradation value of each color of the image data based on the estimated value calculated by the estimated value calculation unit;
The estimated matrix is calculated based on the spectral imaging data captured by the spectral imaging unit,
The estimation matrix minimizes the square error between measurement data obtained by measuring the image displayed on the display device at each second wavelength interval with a dedicated measurement device and the estimated value of the spectrum. is a determinant,
Image display system. a first display unit that displays an image;
a first spectral imaging unit including a first imaging element and a first spectral element, which captures the image displayed by the first display unit and outputs spectral imaging data;
The spectral wavelength of the first spectroscopic element is set for each first wavelength interval within a wavelength range set based on the image displayed by the first display unit, and the spectral imaging data is transmitted to the first spectral imaging unit. a first control unit that generates
a first storage unit that stores an estimation matrix used for spectrum estimation;
A first estimated value for calculating an estimated value of a spectrum for each second wavelength interval, which is shorter than the first wavelength interval, based on the spectral imaging data output by the first spectral imaging unit and the estimation matrix. a first display device comprising a calculation unit;
a second display unit that displays an image;
a second spectral imaging unit including a second imaging element and a second spectral element, which captures the image displayed by the second display unit and outputs spectral imaging data;
The spectral wavelength of the second spectroscopic element is set for each first wavelength interval within a wavelength range set based on the image displayed by the second display unit, and spectral imaging is performed by the second spectral imaging unit. a second control unit for generating data;
a second storage unit that stores an estimation matrix used for estimating the spectrum;
A second display comprising: a second estimated value calculation unit that calculates an estimated value of the spectrum for each of the second wavelength intervals based on the spectral imaging data output by the second spectral imaging unit and the estimation matrix. a device;
The first control unit causes the first display device to display based on the estimated value of the spectrum calculated by the first estimated value calculation unit and the estimated value of the spectrum calculated by the second estimated value calculation unit. generating a first correction parameter for correcting the gradation value for each color of the image data that is the source of the image to be displayed, and correcting the gradation value for each color of the image data that is the source of the image to be displayed by the second display device; Generate a second correction parameter that
The estimated matrix stored in the first storage unit is calculated based on the spectral imaging data captured by the first spectral imaging unit,
The estimated matrix stored in the second storage unit is calculated based on the spectral imaging data captured by the second spectral imaging unit,
The estimated matrix stored in the first storage unit includes measurement data obtained by measuring the image displayed on the first display unit at each second wavelength interval with a dedicated measurement device, and the spectrum. is the determinant that minimizes the squared error with the estimated value,
The estimated matrix stored in the second storage unit includes measurement data obtained by measuring the image displayed on the second display unit at each second wavelength interval using a dedicated measurement device, and the spectrum. is the determinant that minimizes the squared error with the estimated value,
Image display system.

Images