JP6617537B2 - Two-dimensional colorimeter, method, program, and display system - Google Patents

Description

  The present invention relates to a two-dimensional colorimeter that measures a measurement object in two dimensions, a two-dimensional color measurement method, a two-dimensional color measurement program, and a display system that includes the two-dimensional colorimeter and a display device.

  2. Description of the Related Art Conventionally, two-dimensional colorimeters that measure a measurement object in two dimensions are known. Regarding this two-dimensional colorimeter, for example, there is an apparatus disclosed in Patent Document 1. The apparatus disclosed in Patent Document 1 relates to an imaging unit that captures an image of a display surface of a liquid crystal display panel to be inspected to acquire image data, and radiance based on the image data acquired by the imaging unit. Data generating means for generating two-dimensional spectroscopic data. The apparatus disclosed in Patent Document 1 corrects shading by generating approximate data using the least square method based on the two-dimensional spectral data (for example, paragraph [0020] in Patent Document 1). [0021] paragraph, [0087] paragraph, etc.).

JP 2012-185030 A

  By the way, in a two-dimensional colorimeter including a single focal point optical system (so-called single focal point lens) having a fixed focal length as in the apparatus disclosed in Patent Document 1, the size (size) of a measurement target is measured. Depending on the distance between the measurement object and the two-dimensional colorimeter and the focal length of the single focus lens, the image data may include an image of another object (eg, background) other than the measurement object. On the contrary, only a part of the image of the measurement object is captured. Therefore, it is desirable to adopt a variable magnification optical system (so-called zoom lens) in which the focal length can be varied within a predetermined range, in other words, the magnification (view angle) can be varied within a predetermined range, instead of the single focus lens. It is. However, in the variable magnification optical system, when the magnification is changed from the wide-angle end to the telephoto end, generally, the chromatic aberration also changes as the magnification is changed, resulting in an error in the measurement value of the two-dimensional colorimeter. .

  Although the apparatus disclosed in Patent Document 1 corrects shading, only the correction of shading in a single focus lens is considered. That is, in the said patent document 1, only when the chromatic aberration is a fixed value is considered.

  The present invention has been made in view of the above-described circumstances, and an object of the present invention is to provide a two-dimensional colorimeter, a two-dimensional color measurement method, and a two-dimensional color measurement that include a variable magnification optical system and can further reduce measurement errors. A program and a display system including the two-dimensional colorimeter and a display device are provided.

As a result of various studies, the present inventor has found that the above object is achieved by the present invention described below. That is, the two-dimensional colorimeter according to one aspect of the present invention is caused by a variable power optical system capable of changing a focal length within a predetermined range and predetermined optical characteristics depending on the focal length in the variable power optical system. Correction information storage unit for storing correction information for correcting measurement errors generated in association with the focal length, and receiving an optical image to be measured via the zoom optical system, and each of a plurality of color components A two-dimensional photometric unit that measures a plurality of two-dimensional light quantity distributions corresponding to the above, and a focal length acquisition that acquires a focal length of the variable magnification optical system when the two-dimensional photometric units measure the plurality of two-dimensional light quantity distributions And the plurality of two-dimensional light quantity distributions measured by the two-dimensional photometry unit, and the correction information stored in the correction information storage unit and corresponding to the focal length acquired by the focal length acquisition unit, Secondary to be measured And a two-dimensional colorimetric calculation unit for obtaining the color distribution, the optical properties are spectral transmittance, the correction information storage unit, said as the correction information, the focal length and the image height, respectively of the zoom lens system and A plurality of spectral transmittances depending on the memory are stored . Preferably, in the above-described two-dimensional colorimeter, the correction information is a predetermined optical characteristic depending on the focal length in the variable magnification optical system. Preferably, in the above-described two-dimensional colorimeter, the two-dimensional photometric unit receives an optical image to be measured via the variable magnification optical system, and three types of two-dimensional light amounts corresponding to the respective three primary color components. The distribution is measured, and the two-dimensional colorimetric calculation unit is stored in the three types of two-dimensional light amount distributions measured by the two-dimensional photometry unit and the correction information storage unit, and acquired by the focal length acquisition unit. Based on the correction information corresponding to the focal length, a two-dimensional distribution of the tristimulus values X, Y, and Z of the measurement target is obtained. Preferably, in the above-described two-dimensional colorimeter, the two-dimensional colorimetric calculation unit further includes an international lighting committee (based on the obtained two-dimensional distribution of the tristimulus values X, Y, and Z of the measurement target. Luminance Y and chromaticity xy defined by CIE) are obtained.

Since such a two-dimensional colorimeter includes a variable magnification optical system, the variable magnification optical system depends on the size (size) of the measurement target and the distance between the measurement target and the two-dimensional colorimeter. By changing the focal length, in other words, the magnification, it is possible to generate data that captures an image of the entire measurement object and removes as much as possible the image of other objects (for example, the background) excluding the measurement object. The two-dimensional colorimeter includes a correction information storage unit that associates correction information for correcting a measurement error caused by a predetermined optical characteristic depending on a focal length in the variable magnification optical system with the focal length. The two-dimensional color distribution of the measurement object based on a plurality of two-dimensional light quantity distributions corresponding to the measured plurality of color components and correction information corresponding to the focal length of the variable magnification optical system at that time Therefore, the measurement error associated with the focal length (in other words, magnification) of the variable magnification optical system can be further reduced. Therefore, the two-dimensional colorimeter includes a variable power optical system and can further reduce measurement errors. Further, it is possible to reduce a measurement error due to the spectral transmittance that changes according to the change in the focal length of the variable magnification optical system.

  Note that the magnification (zoom magnification) is based on the size of the image on the image plane imaged at a predetermined focal length (for example, the focal length at the wide-angle end, 35 mm, etc.). This is a numerical value representing how many times the size of the image is (magnification = (size of the image on the image plane copied at a certain focal length) / (on the image plane copied at a predetermined focal length) Image size)).

  According to another aspect, in the above-described two-dimensional colorimeter, the two-dimensional colorimetry calculation unit uses the plurality of two-dimensional light amount distributions measured by the two-dimensional photometry unit as the two-dimensional color of the measurement target. A two-dimensional color distribution of the measurement object is obtained from the plurality of two-dimensional light quantity distributions measured by the two-dimensional photometry unit by using a conversion matrix for conversion into a distribution, and the correction information storage unit includes the correction information as the correction information. A transformation matrix is stored, and each matrix component of the transformation matrix is a value based on the predetermined optical characteristic depending on the focal length in the variable magnification optical system.

  By obtaining a conversion matrix that takes into account the influence of measurement errors associated with the focal length of the variable magnification optical system, the two-dimensional colorimeter can change the magnification from a plurality of two-dimensional light quantity distributions measured by the two-dimensional photometric unit. It is possible to easily obtain a two-dimensional color distribution of a measurement object in which a measurement error associated with the focal length of the optical system is further reduced.

The two-dimensional colorimetric method according to another aspect of the present invention is caused by a variable magnification optical system capable of changing a focal length within a predetermined range, and predetermined optical characteristics depending on the focal length in the variable magnification optical system. A two-dimensional colorimetric method for a two-dimensional colorimeter, comprising a correction information storage unit that stores correction information for correcting measurement errors that occur in association with the focal length. A two-dimensional photometric process for measuring a plurality of two-dimensional light quantity distributions corresponding to each of a plurality of color components, and measuring the plurality of two-dimensional light quantity distributions in the two-dimensional photometric process. The focal length acquisition step of acquiring the focal length of the variable magnification optical system at the time, the plurality of two-dimensional light quantity distributions measured in the two-dimensional photometry step, and the correction information storage unit, and the focal length acquisition Focal length acquired in the process Based on the correction information corresponding to the a 2-dimensional colorimetric calculation step of obtaining a two-dimensional color distribution of the measurement target, the optical properties are spectral transmittance, the correction information storage unit, the correction information As described above, a plurality of spectral transmittances depending on the focal length and the image height of the variable magnification optical system are stored .

The two-dimensional colorimetry program according to another aspect of the present invention is caused by a variable magnification optical system capable of changing a focal length within a predetermined range and predetermined optical characteristics depending on the focal length in the variable magnification optical system. A two-dimensional colorimetric program that is executed by a two-dimensional colorimeter comprising a correction information storage unit that stores correction information for correcting measurement errors that occur in association with the focal length. A two-dimensional photometric process for receiving an optical image through the zoom optical system and measuring a plurality of two-dimensional light quantity distributions corresponding to a plurality of color components, and the plurality of two-dimensional light quantity distributions in the two-dimensional photometric process. Is stored in the correction information storage unit, the focal length acquisition step of acquiring the focal length of the variable magnification optical system at the time of measuring, the plurality of two-dimensional light quantity distribution measured in the two-dimensional photometry step, Focal length Based on the obtained corresponding to the focal length correction information step, and a 2-dimensional colorimetric calculation step of obtaining a two-dimensional color distribution of the measurement target, the optical properties are spectral transmittance, the correction information storage The unit stores a plurality of spectral transmittances depending on the focal length and the image height of the variable magnification optical system as the correction information .

Such a two-dimensional color measurement method and two-dimensional color measurement program include a variable magnification optical system and can further reduce measurement errors. Further, it is possible to reduce a measurement error due to the spectral transmittance that changes according to the change in the focal length of the variable magnification optical system.

  A display system according to another aspect of the present invention is a display system including any one of the above-described two-dimensional colorimeters and a display device that performs a predetermined display, and the display device is provided on a display surface. A display unit that performs display, a position detection unit that detects a user's location relative to the display surface, and a two-dimensional colorimeter that measures the display surface in two dimensions from each of a plurality of colorimetric positions relative to the display surface. Stored in the colorimetric information storage unit that stores the colorimetric information in which the plurality of colorimetric positions are associated with the plurality of colorimetric results, the location detected by the position detection unit, and the colorimetric information storage unit. Based on the colorimetric information, a display adjustment unit that adjusts the display state of the display unit so that a preset target appearance is obtained when the display surface is viewed from the location of the user. And characterized by comprising That.

Since such a display system includes any one of the above-described two-dimensional colorimeters, the display system includes a variable magnification optical system and can further reduce measurement errors. Further, it is possible to reduce a measurement error due to the spectral transmittance that changes according to the change in the focal length of the variable magnification optical system. Therefore, the display device can store colorimetric information with further reduced measurement errors. On the other hand, the display device may look different depending on the viewing angle of the user's display surface with respect to the normal direction of the display surface passing through the center position of the display surface. However, the display device includes the display adjustment unit, and when the display adjustment unit looks at the display surface from the user's location based on the user's location and the colorimetric information, Since the display state of the display unit is adjusted so that the set target can be seen, the display state (display output) can be more appropriately adjusted according to the location of the user.

  According to another aspect, in the display system described above, the two-dimensional colorimeter further includes 2 of the display surface obtained by the two-dimensional colorimetric calculation unit using the display surface of the display device as the measurement target. A colorimetric interface unit that outputs a dimensional color distribution to the display device as the colorimetric result; and the display device further outputs the colorimetry output from the colorimetric interface unit of the two-dimensional colorimeter. A display-side interface unit that acquires a result; and a colorimetric information storage processing unit that stores the colorimetric result acquired by the display-side interface unit as the colorimetric information in the colorimetric information storage unit. To do.

  In the display system having such a configuration, the two-dimensional colorimeter further includes the color measurement side interface unit, and the display device further includes the display side interface unit and the color measurement information storage processing unit. The color measurement result measured by the dimensional colorimeter can be automatically stored in the color measurement information storage unit of the display device as the color measurement information.

  In another aspect, in the above-described display systems, the display adjustment unit is based on the location position detected by the position detection unit and the color measurement information stored in the color measurement information storage unit. The display state of the display unit is adjusted with an adjustment value according to the position on the display surface so that the target looks in advance when the display surface is viewed from the location of the user. It is characterized by that. Preferably, in the above-described display system, the colorimetric information (two-dimensional color distribution of the display surface) includes a plurality of measurement values for each of a plurality of regions obtained by dividing the display surface into a plurality of areas, and the display adjustment unit includes: The color measurement result corresponding to the location detected by the position detection unit is extracted from the color measurement information stored in the color measurement information storage unit, and the extracted color measurement result for each pixel in the display unit and By generating an adjustment value according to the position on the display surface so as to compensate for the difference from the appearance of the target, and adjusting the output of each pixel in the display unit by the generated adjustment value, The display state of the display unit is adjusted.

  Since the user looks at each position on the display surface at each angle corresponding to each position, the user can see each position according to each position. In such a display system, the display device adjusts the display state of the display unit with an adjustment value corresponding to the position on the display surface, so that each appearance according to each position can be individually adjusted. .

  A two-dimensional colorimeter, a two-dimensional color measurement method, a two-dimensional color measurement program, and a display system according to the present invention include a variable magnification optical system and can further reduce measurement errors.

It is a figure which shows the structure of the display system in embodiment. It is a block diagram which shows the structure of the two-dimensional colorimeter in the display system of embodiment. It is a block diagram which shows the structure of the two-dimensional measuring part of the two-dimensional colorimeter shown in FIG. It is a figure which shows the structure of the optical characteristic information table memorize | stored in the correction information storage part of the two-dimensional colorimeter shown in FIG. It is a figure which shows an example of the spectral transmittance according to image height as an example of an optical characteristic. It is a block diagram which shows the structure of the display apparatus in the display system of embodiment. It is a figure for demonstrating each colorimetry position in the one two-dimensional colorimeter which measures the display surface of a display apparatus in two dimensions. It is a figure for demonstrating each colorimetric position in the some two-dimensional colorimeter which measures the display surface of a display apparatus in two dimensions. It is a figure which shows an example of the 1st color measurement result memorized by the 1st color measurement position PM1 shown in FIG. 7 memorize | stored as colorimetric information in a display apparatus. It is a figure which shows an example of the 2nd color measurement result memorized by the 2nd color measurement position PM2 shown in FIG. 7 memorize | stored as colorimetric information in a display apparatus. It is a figure which shows an example of the 3rd color measurement result memorize | stored in 3rd color measurement position PM3 shown in FIG. 7 memorize | stored as colorimetric information in a display apparatus. It is a figure which shows an example of the 4th color measurement result measured in the 4th color measurement position PM4 shown in FIG. 7 memorize | stored as colorimetric information in a display apparatus. It is a figure which shows an example of the 5th color measurement result memorized by the 5th color measurement position PM5 shown in FIG. 7 memorize | stored as colorimetric information in a display apparatus. It is a figure for demonstrating the relationship between the distance between a display apparatus and a two-dimensional colorimeter, and an angle of view (focal length, magnification). It is a figure for demonstrating the influence of the magnification which gives to the output of an image sensor. It is a figure for demonstrating an example of the screen displayed on the display part of the display apparatus in the display system of embodiment, when acquiring colorimetric information. It is a figure for demonstrating the relationship between the pixel position of an image sensor, and image height. It is a figure for demonstrating the relationship between the coordinate value of a two-dimensional colorimeter, and the coordinate value of the display surface of a display apparatus in a color measurement result. It is a flowchart which shows the operation | movement regarding adjustment of the display state of the display apparatus in the display system of embodiment.

  Hereinafter, an embodiment according to the present invention will be described with reference to the drawings. In addition, the structure which attached | subjected the same code | symbol in each figure shows that it is the same structure, The description is abbreviate | omitted suitably. In this specification, when referring generically, it shows with the reference symbol which abbreviate | omitted the suffix, and when referring to an individual structure, it shows with the reference symbol which attached the suffix.

(Constitution)
FIG. 1 is a diagram illustrating a configuration of a display system according to an embodiment. FIG. 2 is a block diagram illustrating a configuration of a two-dimensional colorimeter in the display system of the embodiment. FIG. 3 is a block diagram showing the configuration of the two-dimensional measuring unit of the two-dimensional colorimeter shown in FIG. FIG. 3A shows the configuration of the first mode in the two-dimensional measurement unit, and FIG. 3B shows the configuration of the first mode in the two-dimensional measurement unit. FIG. 4 is a diagram showing a configuration of an optical characteristic information table stored in the correction information storage unit of the two-dimensional colorimeter shown in FIG. FIG. 5 is a diagram illustrating an example of spectral transmittance by image height as an example of optical characteristics. 5A shows the spectral transmittance at the position of the optical axis (image height r = 0 mm), and FIG. 5B shows the spectral transmittance at a position 8 mm away from the optical axis (image height r = 8 mm). FIG. 5C shows the spectral transmittance at a position 12 mm away from the optical axis (image height r = 12 mm), and FIG. 5D shows the position 8 mm away from the optical axis. The spectral transmittance at (image height r = 14.4 mm) is shown. The horizontal axis in FIG. 5 is the wavelength (Wavelength) expressed in nm units, and the vertical axis is the transmittance normalized with the maximum transmittance (Transmittance (au)). FIG. 6 is a block diagram illustrating a configuration of a display device in the display system of the embodiment. FIG. 7 is a diagram for explaining each colorimetric position in one two-dimensional colorimeter that measures the display surface of the display device in two dimensions. FIG. 8 is a diagram for explaining each color measurement position in a plurality of two-dimensional colorimeters that measure the display surface of the display device in two dimensions. FIG. 9 is a diagram showing an example of the first color measurement result measured at the first color measurement position PM1 shown in FIG. 7 (FIG. 8) stored as color measurement information in the display device. FIG. 10 is a diagram showing an example of the second color measurement result measured at the second color measurement position PM2 shown in FIG. 7 (FIG. 8) stored as color measurement information in the display device. FIG. 11 is a diagram showing an example of a third color measurement result measured at the third color measurement position PM3 shown in FIG. 7 (FIG. 8) and stored as color measurement information in the display device. FIG. 12 is a diagram showing an example of the fourth color measurement result measured at the fourth color measurement position PM4 shown in FIG. 7 (FIG. 8) stored as color measurement information in the display device. FIG. 13 is a diagram showing an example of a fifth color measurement result measured at the fifth color measurement position PM5 shown in FIG. 7 (FIG. 8) and stored as color measurement information in the display device.

  For example, as shown in FIG. 1, the display system DS in the embodiment includes a two-dimensional colorimeter MD that measures a measurement target in two dimensions and a display device DP that performs display.

  The two-dimensional colorimeter MD is a device that measures a measurement object in two dimensions. In the display system DS, the two-dimensional colorimeter MD is used to analyze the appearance of the display device DP at the user's location (Ux, Uy, Uz). Such a two-dimensional colorimeter MD includes, for example, as shown in FIG. 2, a two-dimensional measurement unit 21, a color measurement side control processing unit (MD control processing unit) 22, and a color measurement side interface unit (MDIF unit). ) 23 and a colorimetric storage unit (MD storage unit) 24.

  The two-dimensional measuring unit 21 is an apparatus that is connected to the MD control processing unit 22 and measures each color component to be measured in a two-dimensional manner through the variable magnification optical system under the control of the MD control processing unit 22. When the two-dimensional colorimeter MD is a two-dimensional colorimeter, for example, the two-dimensional measurement unit 21 uses three primary colors (red (R), green (G), blue ( Each two-dimensional light quantity distribution corresponding to each color component of RGB corresponding to the color to be measured, comprising the variable magnification optical system, optical filter, area image sensor, etc. for measuring each component of B)) in two dimensions (Each image) is output to the MD control processing unit 22.

  More specifically, such a two-dimensional measuring unit 21 is, for example, an apparatus having the configuration of the first aspect shown in FIG. 3A or an apparatus having the configuration of the second aspect shown in FIG. Etc.

  The two-dimensional measurement unit 21 a having the configuration of the first aspect includes a variable magnification optical system 211, an optical filter unit 212, an area image sensor 213, and a focal length acquisition unit 214.

  The zoom optical system 211 is an optical system that can change the focal length within a predetermined range, and is a so-called zoom lens. The variable magnification optical system 211 includes a plurality of lens groups, and in other words, moves one or more of the plurality of lens groups along the optical axis direction, so that the focal length is within a predetermined range. For example, the magnification is varied within a predetermined range. The lens group includes one or more lenses.

  The optical filter unit 212 is disposed on the exit side of the variable magnification optical system 211, and includes light in the wavelength range of the red component of the incident light, light in the wavelength range of the green component of the incident light, and the incident light. Is an apparatus that selectively emits one of the light components in the wavelength range of the blue component. More specifically, the optical filter unit 212 includes a first bandpass filter 212-X that emits light in the wavelength range of the red component of the incident light, and light in the wavelength range of the green component of the incident light. A second band-pass filter 212-Y that emits light, a third band-pass filter 212-Z that emits light in the wavelength range of the blue component of the incident light, a disk member rotatable around the center, A drive mechanism for rotating the disk member. First to third through openings are formed in the disk member at a predetermined interval in the circumferential direction, and a first band pass filter 212-X is fitted into the first through opening, and a second through hole is formed. The second band pass filter 212-Y is fitted into the opening, and the third band pass filter 212-Z is fitted into the third through opening. The optical filter unit 212 configured as described above rotates the disk member around the center by the drive mechanism so that the optical axis of the first bandpass filter 212-X is aligned with the optical axis of the variable magnification optical system 211. Thus, light in the wavelength range of the red component of the incident light (emitted light emitted from the variable magnification optical system 211) is emitted, and the light of the second bandpass filter 212-Y is incident on the optical axis of the variable magnification optical system 211. The disk member is rotated around the center by the drive mechanism so that the axes are aligned, thereby emitting light in the wavelength range of the green component of the incident light, and the third optical axis of the variable power optical system 211. By rotating the disk member around the center by the driving mechanism so as to match the optical axis of the bandpass filter 212-Z, light in the wavelength range of the blue component of the incident light is emitted.

  The area image sensor 213 is connected to the MD control processing unit 22 and includes a plurality of photoelectric conversion elements (pixels of an image sensor) arranged in a two-dimensional array and peripheral circuits thereof, and receives an optical image to be measured. This is a device that generates the data of the two-dimensional light quantity distribution according to the control of the MD control processing unit 22. The area image sensor 213 has an optical filter so that its center (intersection of diagonal lines) matches the optical axis of the variable magnification optical system 211 and its light receiving surface coincides with the image plane formed by the variable magnification optical system 211. It is arranged on the exit side of the variable magnification optical system 211 via the unit 212 (that is, on the exit side of the optical filter unit 212). The area image sensor 213 outputs the generated two-dimensional light amount distribution data to the MD control processing unit 22.

  The optical filter unit 212 and the area image sensor 213 receive an optical image to be measured via a variable magnification optical system, and measure a plurality of two-dimensional light amount distributions corresponding to a plurality of color components, respectively. It is an example. Then, the two-dimensional photometry unit 21a of the present embodiment configured to include the optical filter unit 212 and the area image sensor 213 receives an optical image to be measured via the variable magnification optical system 211, and converts each optical component into each color component. Three corresponding two-dimensional light quantity distributions are measured.

  The focal length acquisition unit 214 is connected to the MD control processing unit 22 and acquires the focal length of the variable magnification optical system 214 according to the control of the MD control processing unit 22 when the two-dimensional light amount distribution is measured by the area image sensor 213. It is. The focal length acquisition unit 214 outputs the acquired focal length of the variable magnification optical system 214 to the MD control processing unit 22. In the present embodiment, the focal length is represented by a magnification β based on the wide angle end (Wide). Such a focal length acquisition unit 214 can employ a known configuration disclosed in, for example, Japanese Patent Laid-Open Nos. 7-199021 and 11-352384. The device disclosed in Japanese Patent Laid-Open No. 7-199021 includes a rotation angle indicator portion and an absolute angle indicator portion provided on the inner peripheral surface of an operation ring for changing (setting) the focal length, and a fixed lens mirror. A light emitting unit that irradiates light to each index unit and an index reading unit that reads each reflected light from each index unit, and the operation based on each signal read by the index reading unit The amount of rotation of the ring, in other words, the focal length can be obtained. The rotation angle indicator portion includes white portions with high reflectance and black portions with low reflectance that are alternately arranged in parallel at equal intervals, and the absolute angle indicator portion is formed in the white portion. It has a black portion with a wedge shape (long and narrow triangle shape). The apparatus disclosed in Japanese Patent Laid-Open No. 11-352384 includes a plurality of slits provided at equal intervals in the circumferential direction on the inner peripheral surface of an operation ring for changing (setting) the focal length, and the slits. Two photo interrupters arranged so that the phases of the pulses are shifted by 90 ° from each other, and an up / down counter, and each pulse generated by the two photo interrupters is counted by the up / down counter including the rotation direction. Thus, the rotation amount of the operation ring, in other words, the focal length can be obtained. Another device disclosed in Japanese Patent Application Laid-Open No. 11-352384 is provided on the inner circumferential surface of the operation ring for changing (setting) the focal length at equal intervals in the circumferential direction. And an MR (Magnetic Resistance) sensor composed of a magnetoresistive element arranged so as to face the inner peripheral surface, and is detected by the MR sensor. The rotation amount of the operation ring, in other words, the focal length can be obtained based on the change of the magnetic poles of the S pole and the N pole.

  In the two-dimensional measuring unit 21a having such a configuration, when the operation ring (zoom magnification operation ring) for changing (setting) the focal length in the variable magnification optical system 211 is operated, the rotation amount is detected. The focal length is acquired by the focal length acquisition unit 214, and the focal length (magnification β in this embodiment) acquired by the focal length acquisition unit 214 is output to the MD control processing unit 22. On the other hand, by using the first band pass filter 212-X, the optical image to be measured is received by the area image sensor 213 via the variable magnification optical system 211 and the first band pass filter 212-X, and the X component of the X component is received. The two-dimensional light amount distribution is measured, and the measured two-dimensional light amount distribution of the X component is output to the MD control processing unit 22, and the second bandpass filter 212 -Y is used, so that the optical image of the measurement target is Light is received by the area image sensor 213 via the variable magnification optical system 211 and the second band pass filter 212-Y, and the two-dimensional light amount distribution of the Y component is measured. The two-dimensional light amount distribution of the measured Y component is MD controlled. Using the third band pass filter 212-Z, the optical image of the measurement object is output to the variable magnification optical system 211 and the second optical filter 211-Z. Is received by the area image sensor 213 via the bandpass filter 212-Z, 2-dimensional light intensity distribution of the Z component is measured, two-dimensional light intensity distribution of the measured Z component is output to the MD control unit 22.

  The two-dimensional measuring unit 21b having the configuration of the second mode includes a variable magnification optical system 211, first to third bandpass filters 212-X, 212-Y, 212-Z, and first to third areas. Image sensors 213-1, 213-2, 213-3, a focal length acquisition unit 214, and a light distribution unit 215 are provided. As described above, the two-dimensional measuring unit 21a according to the first aspect switches the first to third band pass filters 212-X, 212-Y, and 212-Z sequentially and alternatively, 2 of each color component. Although the two-dimensional light quantity distribution is measured by one area image sensor 213, the two-dimensional measurement unit 21b in the second mode distributes the optical image of the measurement target via the variable magnification optical system 211 into three by the light distribution unit 215. Then, each of the three optical images distributed to the three is passed through the first to third band pass filters 212-X, 212-Y, 212-Z, respectively, and the three first to third area image sensors 213-1. 213-2 and 213-3 receive the light, and the two-dimensional light quantity distribution of each color component is converted into three first to third area image sensors 213-1, 213-2, and 213-3. In the measurement at the same time. For this reason, the variable magnification optical system 211 and the focal length acquisition unit 214 in the two-dimensional measurement unit 21b of the second aspect are respectively the same as the variable magnification optical system 211 and the focal length acquisition unit 214 in the two-dimensional measurement unit 21a of the first aspect. Since it is the same, the description is abbreviate | omitted.

  The light distribution unit 215 is an optical element that is disposed on the exit side of the variable magnification optical system 211 and that distributes incident light into a plurality of light beams and emits a plurality of light beams. In the present embodiment, since the two-dimensional light amount distribution of each color component of the three primary colors is simultaneously measured, the light distribution unit 215 distributes the incident light into three. More specifically, the light distribution unit 215 includes a plurality of bundled optical fibers, and the plurality of optical fibers are divided into three substantially equal parts at the intermediate portion thereof. With this configuration, the light distribution unit 215 includes one incident surface 215A and three first to third exit surfaces 215B1, 215B2, and 215B3. The light distribution unit 215 is arranged on the exit side of the variable magnification optical system 211 so that the optical axis thereof matches the optical axis of the variable magnification optical system 215.

  The first to third band pass filters 212-X, 212-Y, and 212-Z in the two-dimensional measurement unit 21b of the second aspect are each the two-dimensional measurement unit 21a of the first aspect, except for the arrangement mode. The same as the first to third band pass filters 212-X, 212-Y, 212-Z in FIG. The first bandpass filter 212-X is disposed on the first exit surface 215B1 side of the light distribution unit 215, and the second bandpass filter 212-Y is disposed on the second exit surface 215B2 side of the light distribution unit 215, The third band pass filter 212-Z is disposed on the third exit surface 215B3 side of the light distribution unit 215.

  The first to third area image sensors 213-1, 213-2, and 213-3 are the same as the area image sensor 213 in the two-dimensional measurement unit 21 a of the first aspect, except for the arrangement aspect. The first area image sensor 213-1 has its center (intersection of diagonal lines) aligned with the optical axis of the first exit surface 215B1 in the light distributor 215, and its light receiving surface is imaged by the variable magnification optical system 211. It is arranged on the exit side of the variable magnification optical system 211 via the light distributor 215 and the first band pass filter 212-X (that is, the exit side of the first band pass filter 212-X) so as to coincide with the surface. . The first area image sensor 213-1 outputs the generated two-dimensional light quantity distribution data of the red component to the MD control processing unit 22. The second area image sensor 213-2 has its center (intersection of diagonal lines) aligned with the optical axis of the second exit surface 215B2 in the light distributor 215, and its light receiving surface is imaged by the variable magnification optical system 211. It is arranged on the exit side of the variable magnification optical system 211 via the light distributor 215 and the second bandpass filter 212-Y (that is, the exit side of the second bandpass filter 212-Y) so as to coincide with the surface. . The second area image sensor 213-2 outputs the generated green component two-dimensional light quantity distribution data to the MD control processing unit 22. The third area image sensor 213-3 has its center (intersection of diagonal lines) aligned with the optical axis of the third exit surface 215B3 in the light distributor 215, and its light receiving surface is imaged by the variable magnification optical system 211. It is arranged on the exit side of the variable magnification optical system 211 via the light distributor 215 and the third band pass filter 212-Z (that is, the exit side of the third band pass filter 212-Z) so as to coincide with the surface. . The third area image sensor 213-3 outputs the generated blue component two-dimensional light quantity distribution data to the MD control processing unit 22.

  The variable magnification optical system 211 and the light distribution unit 215 are arranged so as to constitute a so-called telecentric optical system. As shown by a broken line in FIG. 3B, the first exit surface 215B1 and the first bandpass filter 212 are arranged. -X is a first optical system that forms an optical image of the measurement object emitted from the first emission surface 215B1 on the first area image sensor 213-1 via the first bandpass filter 212-X. 216-1 is further provided between the second exit surface 215B2 and the second bandpass filter 212-Y, and the optical image of the measurement object emitted from the second exit surface 215B2 is provided between the second exit surface 215B2 and the second bandpass filter 212-Y. -Y further includes a second optical system 216-2 that forms an image on the second area image sensor 213-2, and a third exit surface 215B3 and a third band pass filter. 212-Z, the third optical image of the measurement object emitted from the third emission surface 215B3 is formed on the third area image sensor 213-3 via the third bandpass filter 212-Z. An optical system 216-3 may be further provided.

  The light distribution unit 215, the first to third band pass filters 212-X, 212-Y, 212-Z and the first to third area image sensors 213-1, 213-2, 213-3 are measured objects. This is another example of a two-dimensional photometry unit that receives an optical image via a variable magnification optical system and measures a plurality of two-dimensional light quantity distributions corresponding to a plurality of color components. Then, the two-dimensional photometry unit 21b of the present embodiment receives the optical image to be measured via the variable magnification optical system 211, and measures three types of two-dimensional light quantity distributions corresponding to the respective color components.

  In the two-dimensional measuring unit 21b having such a configuration, when the operation ring (zoom magnification operation ring) for changing (setting) the focal length in the variable magnification optical system 211 is operated, the rotation amount is detected. The focal length is acquired by the focal length acquisition unit 214, and the focal length (magnification β in this embodiment) acquired by the focal length acquisition unit 214 is output to the MD control processing unit 22. On the other hand, the optical image to be measured is incident on the variable magnification optical system 211 and is changed in magnification. The scaled optical image of the measurement target is incident on the light distribution unit 215 from its incident surface 215A and is distributed into three. One of the three optical images is emitted from the first exit surface 215B1, received by the first area image sensor 213-1 via the first bandpass filter 212-X, and X The two-dimensional light amount distribution of the component is measured, and the measured two-dimensional light amount distribution of the X component is output to the MD control processing unit 22. The other one of the three optical images distributed is emitted from the second exit surface 215B2 and received by the second area image sensor 213-2 via the second bandpass filter 212-Y. Then, the two-dimensional light amount distribution of the Y component is measured, and the measured two-dimensional light amount distribution of the Y component is output to the MD control processing unit 22. The remaining one of the three optical images is emitted from the third exit surface 215B3, and is passed through the third bandpass filter 212-Z to the third area image sensor 213-3. The two-dimensional light quantity distribution of the Z component is measured, and the measured two-dimensional light quantity distribution of the Z component is output to the MD control processing unit 22.

  In the two-dimensional measuring units 21a and 21b of the first and second modes described above, the first bandpass filter 212-X is preferably an X filter that approximates the color matching function X defined by the CIE. The second band pass filter 212-Y is preferably a Y filter approximating the color matching function Y defined by CIE, and the third band pass filter 212-Z is preferably defined by CIE. The Z filter approximates the color matching function Z.

  Returning to FIG. 2, the MDIF unit 23 is connected to the MD control processing unit 22 in order to output the measurement result to an external device, and inputs / outputs data to / from the external device according to the control of the MD control processing unit 22. For example, an interface circuit using the RS-485 standard, an interface circuit using the USB (Universal Serial Bus) standard, and the like.

  The MD storage unit 24 is a circuit that is connected to the MD control processing unit 22 and stores various predetermined programs and various predetermined data in accordance with the control of the MD control processing unit 22. Examples of the various predetermined programs include an MD control program for controlling each part of the two-dimensional colorimeter MD according to the function of each part, and a plurality of measurements performed by the two-dimensional measuring unit 21 (21a, 21b). Based on the two-dimensional light amount distribution and the correction information stored in the correction information storage unit 241 (described later) and acquired by the focal length acquisition unit 214 of the two-dimensional measurement unit 21, the two-dimensional color distribution of the measurement target The position of the two-dimensional colorimeter MD displayed on the display device DP is acquired as a colorimetric position described later, and the acquired position of the two-dimensional colorimeter MD is associated with the acquired two-dimensional colorimeter calculation program. A control processing program such as a colorimetric position acquisition output program for outputting the two-dimensional color distribution (color measurement result of the two-dimensional colorimeter MD) from the MDIF unit 23 is included. The various kinds of predetermined data include data necessary for executing each program such as the correction information. The MD storage unit 24 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, and the like. The MD storage unit 24 includes a RAM (Random Access Memory) that serves as a working memory of the so-called MD control processing unit 22 that stores data generated during execution of the predetermined program. The MD storage unit 15 functionally includes an optical property information storage unit 241 in order to store the optical property.

  The correction information storage unit 241 stores the correction information. This correction information is information for correcting a measurement error caused by a predetermined optical characteristic depending on the focal length (in other words, magnification) in the variable magnification optical system 211 of the two-dimensional measurement unit 21. In the present embodiment, the correction information is a predetermined optical characteristic depending on a focal length (in other words, a magnification) in the variable magnification optical system 211 of the two-dimensional measurement unit 21, and the predetermined optical characteristic is, for example, variable. This is the spectral transmittance To (Transmittance optics) of the entire variable power optical system 211 that depends on the focal length (in other words, magnification) in the double optical system 211. In this embodiment, the spectral transmittance To is not only the focal length (in other words, the magnification β) in the variable magnification optical system 211, but also from the optical axis center of the variable magnification optical system 211 in the radial direction. (That is, the image height of the zoom optical system 211) depends on r (To (β, r, λ), λ is a wavelength).

  In this embodiment, the plurality of spectral transmittances To (β, r, λ) depending on the magnification β and the image height r are stored in the correction information storage unit 241 in a table format. More specifically, each spectral transmittance To (β, r, λ) is, for example, as shown in FIG. 4 in a two-dimensional matrix shape in which the vertical direction is each magnification β and the horizontal direction is each image height r. Are registered in the optical characteristic information table TT. In the example shown in FIG. 4, the optical characteristic information table TT registers the spectral transmittance To (1.0, r, λ) at the magnification β = 1.0 (for example, the wide angle end (Wide)) in the vertical direction. First row 2411-1, spectral transmittance To (1.2, r, λ) in the case of magnification β = 1.2 is registered Second row 2411-2, spectral in the case of magnification β = 1.5 Third row 2411-3 for registering transmittance To (1.5, r, λ), fourth row for registering spectral transmittance To (2.0, r, λ) when magnification β = 2.0 2411-4, fifth row 2411-3 for registering spectral transmittance To (2.5, r, λ) when magnification β = 2.5, and when magnification β = 3.0 (for example, telephoto end) (Tele)) includes a sixth row 2411-6 for registering the spectral transmittance To (3.0, r, λ) in the horizontal direction. First column 2412-1 for registering spectral transmittance To (β, 0, λ) when image height r = 0 mm, and registering spectral transmittance To (β, 3, λ) when image height r = 3 mm The second column 2412-2, the third column 2412-3 for registering the spectral transmittance To (β, 7, λ) when the image height r = 7 mm, and the spectral transmittance To ( a fourth column 2412-4 for registering β, 10, λ), and a fifth column 2412-5 for registering the spectral transmittance To (β, 14, λ) when the image height r = 14 mm. For example, in FIG. 4, the spectral transmittance To (1.5, 3, λ) is registered in the column of 3 rows and 2 columns. In each column of the optical characteristic information table TT, data of the spectral transmittance To (β, r, λ) itself may be registered, and a data file of the spectral transmittance To (β, r, λ) is stored. A name may be registered. From this file name, the MD control processing unit 22 can read the spectral transmittance To (β, r, λ) data from the MD storage unit 24.

  An example of the spectral transmittance To (β, r, λ) of the variable magnification optical system 211 stored in the optical characteristic information storage unit 241 is shown in FIG. FIG. 5A shows the spectral transmittance To (β, 0, λ) when the image height r = 0 mm, and FIG. 5B shows the spectral transmittance when the image height r = 8 mm. The transmittance To (β, 8, λ) is shown, and FIG. 5C shows the spectral transmittance To (β, 12, λ) when the image height r = 12 mm, and FIG. 5D shows the spectral transmittance To (β, 14.4, λ) when the image height r = 14.4 mm. In each figure, the solid line is the spectral transmittance To (β, r, λ) at the wide-angle end, and the broken line is the spectral transmittance To (β, r, λ) at the telephoto end. In FIG. 5, it can be seen from the comparison between the spectral transmittance To at the solid line (wide-angle end) and the spectral transmittance To at the broken line (telephoto end) that the spectral transmittance To depends on the magnification. Moreover, it can be seen from the comparison of the spectral transmittance To in each figure (each image height r) that the spectral transmittance To depends on the image height r.

  Returning to FIG. 2, the MD control processing unit 22 is a circuit for controlling each part of the two-dimensional colorimeter MD according to the function of each part and measuring the measurement object in two dimensions. The MD control processing unit 22 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. The MD control processing unit 22 functionally operates the color measurement side control unit (MD control unit) 221, the two-dimensional color measurement calculation unit 222, and the color measurement position acquisition output processing unit 223 by executing the control processing program. Prepare.

  The MD control unit 221 controls each part of the two-dimensional colorimeter MD according to the function of each part, and governs overall control of the two-dimensional colorimeter MD.

  The two-dimensional colorimetric calculation unit 222 is stored in a plurality of two-dimensional light amount distributions measured by the two-dimensional measurement unit 21 (21a, 21b) and the correction information storage unit 241, and the focal length acquisition unit of the two-dimensional measurement unit 21 Based on the correction information corresponding to the focal length acquired in 214, the two-dimensional color distribution of the measurement target is obtained. More specifically, in the present embodiment, since the two-dimensional measurement unit 21 measures the two-dimensional light amount distribution of the three primary color components, the two-dimensional colorimetric calculation unit 222 measures the two-dimensional color measurement unit 21. Three types of two-dimensional light quantity distributions of red, green, and blue, and the focal length (magnification β in this embodiment) stored in the correction information storage unit 241 and acquired by the focal length acquisition unit 214 of the two-dimensional measurement unit 21. Based on the corresponding correction information, a two-dimensional distribution of the tristimulus values X, Y, and Z to be measured is obtained. In the present embodiment, the two-dimensional colorimetric calculation unit 222 is further prescribed by the International Commission on Illumination (CIE) based on the obtained two-dimensional distribution of the tristimulus values X, Y, and Z of the measurement target. Luminance Y and chromaticity xy are obtained. More specifically, the two-dimensional colorimetric calculation unit 222 uses a conversion matrix that converts a plurality of two-dimensional light quantity distributions measured by the two-dimensional measurement unit 21 into a two-dimensional color distribution to be measured, thereby allowing the two-dimensional measurement unit 21 to perform conversion. The two-dimensional color distribution of the measurement object is obtained from the plurality of two-dimensional light quantity distributions measured in step (1). Here, the transformation matrix is obtained as described later from the predetermined optical characteristic (spectral transmittance To (β, r, λ) in the present embodiment) as the correction information, and each matrix component of the transformation matrix. Is a value based on a predetermined optical characteristic (spectral transmittance To (β, r, λ) in the present embodiment) that depends on the focal length (magnification β in the present embodiment) in the variable magnification optical system 211.

  The colorimetric position acquisition output processing unit 223 acquires the position of the two-dimensional colorimeter MD displayed on the display device DP as a colorimetric position, associates the acquired position of the two-dimensional colorimeter MD with the 2 A dimensional color distribution (color measurement result of the two-dimensional colorimeter MD) is output from the MDIF unit 23. More specifically, the colorimetric position acquisition / output processing unit 223 is a two-dimensional colorimeter displayed on the display device DP from the image of the display device DP acquired by the two-dimensional measurement unit 21 by a known character recognition technique. The position of MD is acquired as the colorimetric position, and the colorimetric result is output from the MDIF unit 23 by associating the acquired position of the two-dimensional colorimeter MD. Since the two-dimensional measuring unit 21 normally includes the area image sensor 213 as described above, the image of the display device DP can be acquired.

  On the other hand, as shown in FIG. 6, for example, the display device DP in the display system DS includes a stereo camera 11, a display unit 12, a display side control processing unit (DP control processing unit) 14, and a display side storage unit ( DP storage unit) 15, antenna 16, and display side interface unit (DPIF unit) 17.

  The stereo camera 11 is an apparatus that is connected to the DP control processing unit 14 and generates a pair of images (image data) by imaging a predetermined imaging target in accordance with the control of the DP control processing unit 14. As will be described later, in the present embodiment, the user's location (Ux, Uy, Uz) is detected based on a pair of images generated by the stereo camera 11, so that the predetermined imaging target is the display unit 12. This is the area in front of the display surface. The stereo camera 11 includes, for example, a pair of cameras that are spaced apart by a predetermined distance (baseline length) so that the shooting directions are substantially parallel to each other. The stereo camera 11 outputs the generated pair of images to the DP control processing unit 14. The stereo camera 11 constitutes an example of a position detection unit that detects a user's location relative to the display surface of the display unit 12 by combining with the position processing unit 143 described later.

  The display unit 12 is a device that is connected to the DP control processing unit 14 and performs a predetermined display on the display surface according to the control of the DP control processing unit 14. The display unit 12 drives the display panel according to the control of the DP control processing unit so as to display, for example, a content such as a still image or a moving image as the predetermined display on the display panel and the display surface of the display panel. The drive circuit etc. which comprise are comprised. The display panel is, for example, a liquid crystal display panel, an organic EL panel, a plasma panel, or the like.

  The antenna 16 is connected to the DP control processing unit 14, receives a radio wave, generates a reception signal, and outputs the generated reception signal to the DP control processing unit 14.

  The DPIF unit 17 is a circuit that is connected to the DP control processing unit 14 and inputs / outputs data to / from an external device according to the control of the DP control processing unit 14. For example, an interface circuit using the RS-485 standard, An interface circuit using the USB standard, an interface circuit using the High-Definition Multimedia Interface (registered trademark) standard, an interface circuit using the IEEE 1394 standard, and the like.

  The DP storage unit 15 is a circuit that is connected to the DP control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the DP control processing unit 14. The various predetermined programs include, for example, a DP control program for controlling each part of the display device DP according to the function of each part, or a received signal obtained by the antenna 16 is converted into a video signal. The position of the user (Ux, Uy, Uz) based on a video signal generation program for controlling the display unit 12 or a pair of images generated by the stereo camera 11 so that the video image is displayed on the display surface of the display unit 12 When the image is displayed on the display surface of the display unit 12 by the position processing program for calculating the position, the user's location (Ux, Uy, Uz) determined by the position processing program and the measurement described later. Based on the color information, when the display surface is viewed from the user's location (Ux, Uy, Uz), a preset target appearance is obtained. The display adjustment program for adjusting the display state of the display unit 12 or the color measurement result (two-dimensional color distribution on the display surface) of the two-dimensional colorimeter MD is acquired from the two-dimensional colorimeter MD via the DPIF unit 17. A colorimetric information storage processing program for storing the acquired colorimetric result as the colorimetric information in the DP storage unit 15 or when displaying a predetermined color on the display surface of the display unit 12 to obtain the colorimetric result In addition, a control processing program such as a position display processing program for displaying the position PM (MDx, MDy, MDz) of the two-dimensional colorimeter MD obtained based on a pair of images generated by the stereo camera 11 is included. The various kinds of predetermined data include data necessary for executing each program such as the colorimetric information. The DP storage unit 15 includes, for example, a ROM, an EEPROM, a RAM, and the like. The DP storage unit 15 functionally includes a colorimetric information storage unit 151 for storing the colorimetric information.

  The color measurement information storage unit 151 stores the color measurement information. The colorimetric information is stored in advance in the colorimetric information storage unit 151 by a producer or the like before the user uses the display device DP, for example, at the manufacturing stage or the shipping stage. The colorimetric information includes a plurality of colorimetric positions in a plurality of colorimetric results obtained by measuring the display surface two-dimensionally from a plurality of colorimetric positions (MDx, MDy, MDz) with respect to the display surface of the display unit 12. (MDx, MDy, MDz) is information associated with each other. Since the color measurement result is measured in two dimensions, it has position coordinate values and color measurement values (for example, a horizontal coordinate value DPx on the display surface, a vertical coordinate value DPy on the display surface, and a luminance value Y). , Chromaticity values x, y, etc.). In the measurement (colorimetry) for obtaining the colorimetric information, a preset predetermined image (chromaticity / luminance correction image (colorimetric information acquisition image)) suitable for adjusting the display state of the display unit 12 is obtained. A two-dimensional colorimeter MD is displayed on the display unit 12 and arranged at the colorimetric positions (MDx, MDy, MDz), and the display surface of the display unit 12 is measured in two dimensions. Such color measurement is performed at each of the plurality of color measurement positions (MDx, MDy, MDz). For example, as shown in FIG. 7, the measurement may be performed by sequentially arranging one two-dimensional colorimeter MD at the plurality of colorimetric positions (MDx, MDy, MDz). For example, as shown in FIG. 8, the measurement may be performed by simultaneously arranging a plurality of two-dimensional colorimeters MD at each of the plurality of colorimetric positions (MDx, MDy, MDz).

More specifically, as shown in FIG. 7 and FIG. 8 respectively, the center of the display surface in the display unit 12 (for example, the intersection position of diagonal lines when the display surface is rectangular) When an MDxMDyMDz orthogonal coordinate system is set in which the normal line is the MDz axis, and the horizontal and vertical lines perpendicular to the MDz axis and perpendicular to each other are respectively the MDx axis and the MDy axis. For the colorimetric information, one two-dimensional colorimeter MD is sequentially arranged at five first to fifth colorimetric positions PM1 to PM5, or five first to fifth colorimetric positions PM1 to PM5. The five two-dimensional colorimeters MD-1 to MD-5 are arranged at the same time in each PM5, and the display surface of the display unit 12 is two-dimensionally colorimetrically generated. During the measurement, white, primary colors, and intermediate colors are displayed on the entire display surface as the chromaticity / luminance correction image (colorimetric information acquisition image). Therefore, in this embodiment, the colorimetric information is measured by displaying white, primary colors, and intermediate colors on the entire display surface at the colorimetric positions (MDx, MDy, MDz) of the plurality of display units 12, respectively. Includes colored colorimetric results. The primary colors include red (R), green (G), and blue (B) (that is, the colorimetric information is the entire surface of the display surface at each of the plurality of colorimetric positions (MDx, MDy, MDz)). Color measurement results measured with red, green, and blue being displayed on the In the example shown in each of FIGS. 7 and 8, the first colorimetric position PM1 is in coordinates (0, 0, 1000) in millimeters (mm), and the second colorimetric position PM2 is in coordinates (−700, 0, 1000), the third colorimetric position PM3 is coordinates (700, 0, 1500), the fourth colorimetric position PM4 is coordinates (−350, −500, 2000), and The five colorimetric positions PM5 are coordinates (350, 500, 2000). As described above, the color measurement information includes a plurality of color measurement results obtained at a plurality of different color measurement positions in the horizontal direction and the vertical direction at different distances from the display surface. At each of the first to fifth colorimetric positions PM1 to PM5, the display surface of the display unit 12 is measured two-dimensionally by a two-dimensional colorimeter MD at a predetermined temperature (for example, room temperature 25 ° C.). Examples of colored first to fifth colorimetric results are shown in FIGS. 9 to 13, respectively. 9 to 13, on the display surface of the display unit 12, the center position of the display surface in the display unit 12 (for example, the position of the intersection of diagonal lines when the display surface is rectangular) is set as the coordinate origin and orthogonal to each other. When a DPxDPy Cartesian coordinate system with the horizontal and vertical lines to be set as the DPx axis and DPy axis is set, each colorimetric result is a two-dimensional matrix with the horizontal direction as the DPx value and the vertical direction as the DPy value. Registered in the table. Each DPx value is assigned for each first interval (horizontal) composed of a plurality of pixels, and each DPy value is assigned for each second interval (vertical) composed of a plurality of pixels. For example, when the display resolution of the display unit 12 is 1920 × 1080, the first interval is 62 pixels, each DPx is assigned every 62 pixels, the second interval is 72 pixels, DPy is assigned every 72 pixels. Therefore, in the example shown in FIGS. 9 to 13, the two-dimensional distribution on the display surface of the display unit 12 is measured using the principle 62 × 72 as a unit region (the periphery is 61 × 72). Therefore, the color measurement result includes a plurality of measurement values for each of a plurality of unit regions obtained by dividing the display surface of the display unit 12 into a plurality of units. In each column of the table, the luminance value Y is registered in the upper row, the chromaticity x in the xy chromaticity diagram is registered in the middle row, and the chromaticity y in the xy chromaticity diagram is registered in the lower row. Has been. In the state of white display (red R = 255 / green G = 255 / blue B = 255), for example, in FIG. 9, the color measurement result at the position (−7, −15) on the display surface is luminance Y Is 40 cd / m ² , the chromaticity x is 0.330, the chromaticity y is 0.345, and the colorimetric result at the position (0, 0) on the display surface is a luminance Y of 100 cd. / M ² , chromaticity x is 0.3127, chromaticity y is 0.3290, and the colorimetric result at the position (−7, 15) on the display surface is a luminance Y of 44 cd / m ² , the chromaticity x is 0.329, the chromaticity y is 0.345, and the colorimetric result at the position (7, −15) on the display surface is a luminance Y of 39 cd. / M ² , the chromaticity x is 0.333, and the chromaticity y is 0.348. The luminance Y is obtained based on a color measurement result obtained by displaying white on the entire surface of the display surface, and chromaticities x and y are red (R = 255 / G = 0 / B = 0), green (R = 0 / G = 255 / B = 0), and blue (R = 0 / G = 0 / B = 255) are displayed, and the colorimetric results are measured. Obtained on the basis. Further, even in white, neutral color display with gradation changed, for example, (R = 128 / G = 128 / B = 128), (R = 64 / G = 64 / B = 64, (R = 32 / G = 32 / B = 32) and the like are displayed, and measurement results corresponding to FIGS.9 to 13 are obtained, and cyan (R = 0 / G = 255 / B = 255), magenta (R = 255 / G = 0). / B = 255), yellow (R = 255 / G = 255 / B = 0), etc., are displayed to obtain measurement results corresponding to those shown in FIGS. Intermediate colors such as orange (R = 255 / G = 140 / B = 0), light pink (R = 255 / G = 182 / B = 193) are displayed, and measurement results corresponding to FIGS. 9 to 13 are obtained. Then, based on this, it is reflected in the colorimetric information as in the case of a single color. In the MDxMDyMDz orthogonal coordinate system and the DPxDPy orthogonal coordinate system set as described above, the MDx axis and the DPx axis coincide with each other, and the MDy axis and the DPy axis coincide with each other (MDx = DPx, MDy = DPy).

  The colorimetric information storage unit 151 stores each table in which each colorimetric result is registered in association with the colorimetric position (MDx, MDy, MDz).

  In the above description, the number of colorimetric positions is five, but is not limited to this. For example, the number of colorimetric positions is set to an appropriate number according to the viewing angle of the display unit 12, the specifications of the display device DP, and the like. . Further, in the above description, the number of areas in the colorimetry of the display unit 12 is 465, in which the display surface of the display unit 12 is divided into 31 in the horizontal direction and 15 in the vertical direction (31 × 15 divisions). The number of regions is not limited to this, and is set to an appropriate number according to, for example, the viewing angle of the display unit 12 or the specifications of the display device DP.

  Returning to FIG. 6, the DP control processing unit 14 controls each part of the display device DP according to the function of each part, and performs the predetermined display on the display surface of the display unit 12. It is a circuit that adjusts the display state of the display unit 12 so that a preset target is seen when the display surface is viewed from (Ux, Uy, Uz). The DP control processing unit 14 includes, for example, a CPU (or an FPGA (Field Programmable Gate Array)) and its peripheral circuits. The DP control processing unit 14 executes a display processing program (DP control unit) 141, a video signal generation unit 142, a position processing unit 143, a display adjustment unit 144, and a colorimetric information storage process by executing the control processing program. Unit 145 and position display processing unit 146 are functionally provided.

  The DP control unit 141 controls each unit of the display device DP according to the function of each unit, and controls the entire display device DP.

  The video signal generation unit 142 converts the received signal obtained by the antenna 16 into a video signal, and controls the display unit 12 so that the video of the video signal is displayed on the display surface of the display unit 12. The video signal generation unit 142 displays the content downloaded from the network, the content read from the recording medium, the content stored in the DP storage unit 15, and the like on the display surface of the display unit 12. The unit 12 may be controlled.

  The position processing unit 143 obtains the location of the user based on a pair of images generated by the stereo camera 11. More specifically, the position processing unit 143 uses, for example, a pattern of a human model prepared in advance from an image obtained by one of the stereo cameras 11 or a neural network learned for human detection. (Image area showing a user) is detected, the direction (Ux, Uy) of a predetermined point in the detected person area is obtained, and the predetermined point in the person area is obtained from a pair of images obtained by the stereo camera 11 The distance (Uz) to the person area is obtained from the obtained parallax by the principle of triangulation, and thereby the user's location (Ux, Uy, Uz) is detected. The predetermined point may be a point at an arbitrary position within the person area, for example, the center of gravity of the person area, for example, the center of gravity of the head portion in the person area. For example, it may be an intersection of diagonal lines in a rectangle circumscribing the person area.

  Based on the user's location (Ux, Uy, Uz) obtained by the position processor 143 and the colorimetric information stored in the colorimetric information storage unit 151, the display adjustment unit 144 determines the user's location (Ux , Uy, Uz), the display state (display output) of the display unit 12 is adjusted so that the target is set in advance when the display surface of the display unit 12 is viewed. The display state (display output) is at least one of luminance and chromaticity. In the present embodiment, since the colorimetric information includes luminance Y and chromaticity x, y, the display state (display output) is both luminance and chromaticity (that is, luminance Y and chromaticity x). , Y are adjusted), and when the colorimetric information is only luminance Y, the display state (display output) may be only luminance Y (that is, only luminance Y is adjusted). In addition, when the colorimetric information is only chromaticity x and y, the display state (display output) may be only chromaticity x and y (that is, only chromaticity x and y are Adjusted).

  The target appearance may be a predetermined predetermined appearance. Preferably, the target appearance is the display from the normal line of the display surface passing through the center position of the display surface in the display unit 12. It may be how it looks when the central position of the surface is viewed (normal appearance). In the present embodiment, the target is viewed in a predetermined area including the normal of the display surface passing through the user's location (Ux, Uy, Uz) on the display surface of the display unit 12 (for example, This is a view when the FOV (Field of View) within 5 ° with respect to the normal direction is viewed from above the normal (the view at the user's location).

More specifically, the display adjustment unit 144 is a color measurement result corresponding to the user's location (Ux, Uy, Uz) obtained by the position processing unit 143 from the color measurement information stored in the color measurement information storage unit 151. The display state of the display unit 12 is adjusted by adjusting the output of each pixel in the display unit 12 so as to compensate for the difference between the color measurement result thus taken out and the appearance of the target. For example, when the UxUyUz orthogonal coordinate system and the MDxMDyMDz orthogonal coordinate system of the location position (Ux, Uy, Uz) match each other, the display adjustment unit 144 calculates the position from the color measurement information stored in the color measurement information storage unit 151. A color measurement result (a color measurement result of MDx = Ux, MDy = Uy, MDz = Uz) in which the user's location (Ux, Uy, Uz) obtained by the processing unit 143 is a measurement position (MDx, MDy, MDz). Take out. In the example shown in FIGS. 9 to 13, each value of luminance Y and chromaticity x, y is a value corresponding to a position on the display surface in the display unit 12, and therefore, the color measurement result taken out and the target The difference from the appearance (adjustment value) is a value corresponding to the position on the display surface of the display unit 12, and the display adjustment unit 144 is an adjustment value corresponding to the position of the display unit 12 on the display surface. The display state of the unit 12 is adjusted. More specifically, the display adjustment unit 144 responds to the position on the display surface for each pixel in the display unit 12 so as to compensate for the difference between the extracted color measurement result and the target appearance. Each adjustment value is generated, and the display state of the display unit 12 is adjusted by adjusting the output of each pixel in the display unit 12 with each generated adjustment value. For example, in the example shown in FIG. 9, when the user is located at the coordinates (0, 0, 1000), the measurement result of the coordinates (0, 0) (luminance Y = 100 cd / m ² , chromaticity x = 0. 3127, chromaticity y = 0.290) is the target appearance, and each measurement result of each area of the display surface of the display unit 12 and the target appearance (luminance Y = 100 cd / m ² , chromaticity x = 0) .3127, chromaticity y = 0.3290), and the display state of the display unit 12 is adjusted using each difference as an adjustment value for each region. For example, in the region of coordinates (−7, −15), the measurement result (luminance Y = 40 cd / m ² , chromaticity x = 0.330, chromaticity y = 0.345) and the target appearance (luminance Y) = 100 cd / m ² , chromaticity x = 0.3127, chromaticity y = 0.3290), and the display state of the display unit 12 is adjusted using this difference as an adjustment value (for example, luminance Y is increased to compensate for the difference of 60 cd / m ² (ie, luminance Y is multiplied by 2.5).

  The display adjustment unit 144 determines that the color measurement information stored in the color measurement information storage unit 151 does not include a color measurement result corresponding to the user's location (Ux, Uy, Uz) obtained by the position processing unit 143. A plurality of color measurement positions corresponding to a plurality of color measurement positions (for example, four or twelve) selected from the color measurement information stored in the color measurement information storage unit 151 in the order closest to the user's location (Ux, Uy, Uz). Based on the color measurement result, the color measurement result corresponding to the location (Ux, Uy, Uz) of the user may be generated by interpolation (for example, linear interpolation, spline interpolation, Lagrange interpolation, etc.). Since the number of colorimetric positions selected for the interpolation is two-dimensional, it is at least four at the top, bottom, left, and right, and is 12 when the outside is used. Preferably, when the outside is also used, the selection number is about 100.

  The color measurement information storage processing unit 145 stores the color measurement result acquired by the DPIF unit 17 from the two-dimensional colorimeter MD in the color measurement information storage unit 151 as the color measurement information. The color measurement results measured by the two-dimensional colorimeter MD may be input to the display device DP from a keyboard (not shown) and stored in the color measurement information storage unit 151, for example, and recorded in a USB memory or the like. It is stored in a medium, and may be input from the recording medium to the display device DP via the DPIF unit 17 and stored in the colorimetric information storage unit 151. For example, it may be stored in a PROM (Programmable ROM) or EPROM (Erasable Programmable ROM). The colorimetric information storage unit 151 may store the data using a ROM writer for writing data.

  The position display processing unit 146 measures the position of the two-dimensional colorimeter MD as the colorimetric position based on a pair of images generated by the stereo camera 11, and obtains a predetermined color on the display surface to obtain the colorimetric result. When displaying the color, the measured position of the two-dimensional colorimeter MD is displayed. More specifically, the position display processing unit 146 detects the two-dimensional colorimeter MD from one of the pair of images generated by the stereo camera 11 by, for example, edge detection, and the detected two-dimensional colorimeter. The MD direction (MDx, MDy) is obtained, the parallax relating to the two-dimensional colorimeter MD is obtained from a pair of images obtained by the stereo camera 11, and the two-dimensional colorimeter is calculated from the obtained parallax by the principle of triangulation. A distance (MDz) to the MD is obtained, and thereby a position PM (MDx, MDy, MDz) of the two-dimensional colorimeter MD is detected. The position display processing unit 146 displays the measured position PM (MDx, MDy, MDz) of the two-dimensional colorimeter MD when displaying a predetermined color on the display surface in order to obtain the color measurement result. indicate.

(Operation)
Next, the operation of this embodiment will be described. FIG. 14 is a diagram for explaining the relationship between the distance between the display device and the two-dimensional colorimeter and the angle of view (focal length, magnification). FIG. 14A shows a case where the two-dimensional colorimeter MD is disposed at a position relatively close to the display surface of the display device DP (when the distance between the display device and the two-dimensional colorimeter is relatively short). FIG. 14B shows a case where the two-dimensional colorimeter MD is disposed at a position relatively far from the display surface of the display device DP (when the distance between the display device and the two-dimensional colorimeter is relatively long). ). FIG. 15 is a diagram for explaining the influence of the magnification on the output of the image sensor. FIG. 15A shows a color matching function defined by CIE, where the horizontal axis is a wavelength (Wavelength) expressed in nm units, and the vertical axis is a relative spectral response. The solid line is the color matching function X (x (λ)), the broken line is the color matching function Y (y (λ)), and the alternate long and short dash line is the color matching function Z (z (λ)). FIG. 15B shows the spectral transmittance of the lens (optical system), the horizontal axis is the wavelength (Wavelength) expressed in nm units, and the vertical axis is the relative spectral transmittance (Transmittance (au). )). The solid line is the spectral transmittance (Wide) at the wide-angle end, and the broken line is the spectral transmittance (Tele) at the telephoto end. As shown in FIG. 15B, the spectral transmittance changes depending on the optical magnification β. Since the light incident on the area image sensor 213 of the two-dimensional colorimeter MD passes through such a lens, it is necessary to consider the characteristics depending on the optical magnification β. FIG. 16 is a diagram for describing an example of a screen displayed on the display unit of the display device in the display system according to the embodiment when acquiring colorimetric information. FIG. 17 is a diagram for explaining the relationship between the pixel position of the area image sensor and the image height. The horizontal axis in FIG. 17 indicates the horizontal pixel position (pixel number) in the image sensor, and the vertical axis indicates the vertical pixel position (pixel number) in the area image sensor. The pixel position i in the horizontal direction is represented by a pixel number i counted rightward from the leftmost and uppermost pixel in the area image sensor 213, and the pixel position j in the vertical direction is the area image sensor 213. Is represented by a pixel number j counted in the right direction from the leftmost and uppermost pixel. FIG. 18 is a diagram for explaining the relationship between the coordinate value of the two-dimensional colorimeter and the coordinate value of the display surface of the display device in the color measurement result. FIG. 19 is a flowchart illustrating an operation related to adjustment of the display state of the display device in the display system of the embodiment.

  In the display system DS in the present embodiment, the display device DP adjusts the display state (display output) of the display unit 12 according to the user's location (Ux, Uy, Uz). For this purpose, before the display device DP is used by the user, the appearance of the display device DP at the user's location (Ux, Uy, Uz) is analyzed by the two-dimensional colorimeter MD, and the measurement result (display device) It is necessary to store the two-dimensional color distribution on the display surface of the DP in the DP storage unit 15 as colorimetric information. In order to analyze the appearance of the display device DP at the user's location (Ux, Uy, Uz), for example, the two-dimensional colorimeter MD is connected to the display device DP as shown in FIGS. Arranged at various positions. In such various positions, in order to effectively use the entire light receiving surface of the area image sensor 213, the angle of view of the variable magnification optical system 211 matches the size of the display surface of the display device DP as much as possible. It is desirable. That is, when the two-dimensional colorimeter MD is disposed at a position relatively close to the display device DP, as shown in FIG. 14A, the variable magnification optical system 211 has a wide angle of view, that is, a wide angle. It is desirable to set it closer to the end (Wide). On the other hand, when the two-dimensional colorimeter MD is arranged at a position relatively far from the display device DP, as shown in FIG. 14B, the variable magnification optical system 211 has a narrow field angle, that is, a telephoto position. It is desirable to set it closer to the end (Tele).

  By the way, the signal S (Sx, Sy, Sz) output from the area image sensor 213 is generated by being received by the area image sensor 213 via the variable magnification optical system 211 and the band pass filter 212. It is influenced by the spectral transmittance To of the double optical system 211 and the total spectral sensitivity So (Sox, Soy, Soz) of the bandpass filter 212 and the area image sensor 213. Here, assuming that the total spectral sensitivity So of the bandpass filter 212 and the area image sensor 213 is the color matching function X shown in FIG. 15, the signal Sx of the X component has the color matching function X at the wide angle end. The solid line graph x (λ) (= Sox) and the solid line Wide (= To (wide-angle end)) representing the spectral transmittance To at the wide-angle end (Sx (wide-angle end) ) = Sox * To (wide angle end)), while at the telephoto end, a solid line graph x (λ) (= Sox) representing the color matching function X and a broken line Tele representing the spectral transmittance To at the telephoto end. It is a value (Sx (telephoto end) = Sox * To (telephoto end)) corresponding to the area of the overlapping portion with (= To (telephoto end)). When the spectral transmittance To of the variable magnification optical system 211 is the same from the wide-angle end to the telephoto end (To (wide-angle end) = To (telephoto end)), the X-component value at the wide-angle end and the X-component at the telephoto end Is a value that coincides with each other (Sx (wide-angle end) = Sx (telephoto end)). However, as shown in FIG. 15 and FIG. 5 described above, the spectral transmittance To of the variable magnification optical system 211 is not always the same from the wide-angle end to the telephoto end (usually, To (wide-angle end) ≠ To ( (Telephoto end)), the value of the X component at the wide angle end and the value of the X component at the telephoto end are not always the same value (usually, Sx (wide angle end) ≠ Sx (telephoto end)). The same applies to each of the Y component and the Z component. For this reason, the two-dimensional colorimeter MD in the present embodiment obtains a measurement value by compensating for the change in the spectral transmittance To of the variable magnification optical system 211 accompanying the change in the focal length as follows, and measures the measurement value thereby. The error is further reduced. Further, as shown in FIG. 5 described above, since the spectral transmittance To of the variable magnification optical system 211 also depends on the image height r, in another example, the color due to the chromatic aberration of magnification occurring between the wide-angle end and the telephoto end. When the chromaticity errors Δx and Δy are obtained for each image height r, the values shown in Table 1 are obtained, and the chromaticity of the periphery (r = 14.4) is more than the true value of the chromaticity (−0. (0056, -0.0075) is an incorrect value, and exceeds about ± 0.005, which is a general chromaticity accuracy, so that the error needs to be corrected. The two-dimensional colorimeter MD in the present embodiment obtains a measurement value by compensating for the change in the spectral transmittance To of the variable magnification optical system 211 accompanying the change in the image height r as follows.

  Hereinafter, display of a chromaticity / luminance correction image (colorimetric information acquisition image) on the display device DP, measurement of the display device DP compensated for changes in the spectral transmittance To by the two-dimensional colorimeter MD, and display device Each will be described in the order of adjustment of the display state (display output) according to the user's location (Ux, Uy, Uz) in the DP.

(Display of chromaticity / luminance correction image on display device DP)
In the display system DS in the present embodiment, when a power switch (not shown) in the display device DP is turned on, the DP control processing unit 14 performs initialization of each necessary unit, and executes DP control by executing the control processing program. The processing unit 14 includes a DP control unit 141, a video signal generation unit 142, a position processing unit 143, a display adjustment unit 144, a colorimetric information storage processing unit 145, and a position display processing unit 146. Similarly, when a power switch (not shown) in the two-dimensional colorimeter MD is turned on, necessary parts are initialized, and the MD control processing unit 22 receives the MD control unit 221 by executing the control processing program. A two-dimensional colorimetric calculation unit 222 and a colorimetric position acquisition output processing unit 223 are functionally configured.

  First, for example, as shown in FIG. 7, the two-dimensional colorimeter MD is arranged at the first colorimetric position PM1. Next, the display device DP displays the position (MDx, MDy, MDz) of the two-dimensional colorimeter MD based on the pair of images generated by the stereo camera 11 by the position display processing unit 146 of the DP control processing unit 14. Measure as the colorimetric position. Then, when the display device DP displays the chromaticity / luminance correction image on the display surface of the display unit 12 by the position display processing unit 146 of the DP control processing unit 14, for example, as shown in FIG. The position (MDx, MDy, MDz) of the two-dimensional colorimeter MD is displayed. In the example illustrated in FIG. 16, MDx = 0, MDy = 0, and MDz = 1000 are displayed on the display unit 12 as the position PM of the two-dimensional colorimeter MD. In FIG. 16, the shadow of the two-dimensional colorimeter MD when the two-dimensional colorimeter MD is orthogonally projected on the display surface of the display unit 12 is indicated by a broken line.

(Measurement of display device DP by two-dimensional colorimeter MD)
While the display device DP displays the chromaticity / luminance correction image on the display unit 12, an operator such as a producer first sets the angle of view of the variable magnification optical system 211 to the size of the display surface of the display unit 12. The focal length, in other words, the magnification (field angle) is adjusted and set so as to match as much as possible. Then, the operator operates, for example, a measurement start switch (not shown), and causes the two-dimensional colorimeter MD to start measurement by this operation.

  When the measurement is started, the two-dimensional colorimeter MD receives the optical image of the display unit 12 as a measurement target via the variable magnification optical system 211 by the two-dimensional measurement unit 21 and corresponds to each of a plurality of color components. A plurality of two-dimensional light quantity distributions (images on the display unit 12) are measured, and the focal length of the variable magnification optical system 211 at the time of this measurement is acquired. More specifically, in the present embodiment, when the two-dimensional measuring unit 21 is the two-dimensional measuring unit 21a of the first aspect, the first to third band pal filters 212-X, 212-Y, 212- By alternately switching Z, the two-dimensional measurement unit 21a passes the optical image to be measured via the variable magnification optical system 211 and the bandpass filter 212 (212-X, 212-Y, 212-Z). Then, the area image sensor 213 receives light, measures three types of two-dimensional light amount distributions corresponding to the three primary color components, and outputs these three types of two-dimensional light amount distributions to the MD control processing unit 22. Then, the two-dimensional measurement unit 21 a acquires the focal length of the variable magnification optical system 211 by the focal length acquisition unit 214 and outputs the magnification β corresponding to the acquired focal length to the MD control processing unit 22. Further, when the two-dimensional measuring unit 21 is the two-dimensional measuring unit 21b of the second aspect, in the present embodiment, the two-dimensional measuring unit 21b converts the optical image to be measured into the variable power optical system 211, the light distributing unit. 315 and first to third band-pass filters 212-X, 212-Y, 212-Z, respectively, and received by the first to third area image sensors 213-1, 213-2, and 213-3, respectively, and the three primary colors Three types of two-dimensional light quantity distributions corresponding to the respective color components are measured, and these three kinds of two-dimensional light quantity distributions are output to the MD control processing unit 22. Then, the two-dimensional measurement unit 21 a acquires the focal length of the variable magnification optical system 211 by the focal length acquisition unit 214 and outputs the magnification β corresponding to the acquired focal length to the MD control processing unit 22.

  The two-dimensional colorimeter MD is a two-dimensional light amount distribution measured by the two-dimensional measuring unit 21 by the colorimetric position acquisition / output processing unit 223 of the MD control processing unit 22, in other words, the display unit 12 that is a measurement target. From the image, the position (MDx, MDy, MDz) of the two-dimensional colorimeter MD displayed on the display surface of the display unit 12 is obtained as the colorimetric position by a known character recognition technique such as OCR (shown in FIG. 11). In the example, MDx = 0, MDy = 0, MDz = 1000).

  Further, the two-dimensional colorimeter MD includes a plurality of two-dimensional light quantity distributions measured by the two-dimensional measuring unit 21 (21a, 21b) by the two-dimensional colorimetric calculating unit 222 of the MD control processing unit 22, and correction information storage. Based on the correction information stored in the unit 241 and corresponding to the focal length acquired by the focal length acquisition unit 214 of the two-dimensional measurement unit 21, the two-dimensional color distribution of the measurement target is obtained. More specifically, in this embodiment, the two-dimensional colorimetric calculation unit 222 stores the three types of two-dimensional light quantity distributions of red, green, and blue measured by the two-dimensional measurement unit 21 and the correction information storage unit 241. In the chromaticity / luminance correction image displayed on the display unit 12 based on the correction information (β) stored and stored in the focal length acquisition unit 214 of the two-dimensional measurement unit 21 corresponding to the magnification β. A two-dimensional distribution of tristimulus values X, Y, and Z is obtained, and based on the obtained two-dimensional distribution of tristimulus values X, Y, and Z, luminance Y and chromaticity defined by the International Commission on Illumination (CIE) Find xy. Here, the two-dimensional colorimetric calculation unit 222 uses the conversion matrix that converts a plurality of two-dimensional light quantity distributions measured by the two-dimensional measurement unit 21 into a two-dimensional color distribution to be measured. The two-dimensional color distribution of the measurement object is obtained from the measured two-dimensional light amount distributions, and the conversion matrix is obtained from the spectral transmittance To (β, r, λ) as the correction information. More specifically, the two-dimensional colorimetric calculation unit 222 obtains the two-dimensional color distribution of the measurement target from the plurality of two-dimensional light amount distributions using the conversion matrix as the correction information as follows. .

  In the area image sensor 213, the pixel number in the horizontal direction (horizontal direction) is i, the pixel number in the vertical direction (vertical direction) is j, and the photometric quantity of each color output from the pixels at the pixel positions i and j is Xs ( i, j), Ys (i, j), Zs (i, j), and C (i, j) as the transformation matrix used in the pixel at pixel position i, j, the pixel at pixel position i, j The tristimulus values X (i, j), Y (i, j), and Z (i, j) in are obtained by the following equation (1).

  The transformation matrix C (i, j) is obtained by the following procedure. First, a spectroradiometer is prepared in advance as a reference measuring instrument for calibration. Next, white is displayed on the display device DP, and at the same position, the white display is sequentially measured by the spectroradiometer and the two-dimensional colorimeter MD. As a result, the measurement results Xw (i, j), Yw (i, j) and Zw (i, j) of the spectroradiometer are obtained, and the measurement results Xsw (i, j), Ysw ( i, j) and Zsw (i, j) are obtained. Each of the measurement results Xw (i, j), Yw (i, j) and Zw (i, j) of the spectroradiometer is two-dimensional, for example, via the MDIF unit 23 or via an input unit (not shown). Input to the colorimeter MD. The measurement results Xw (i, j), Yw (i, j) and Zw (i, j) of the spectroradiometer are respectively expressed as X (i, j), Y (i, j), Z in the above formula (1). By setting (i, j), the following equation (1-W) is obtained.

  Similarly, each color of red, green and blue is sequentially displayed on the display device DP, and the display of each color is displayed on the spectroradiometer and the two-dimensional colorimeter MD at the same position with respect to each display of each color. It measures sequentially and following Formula (1-R), Formula (1-G), and Formula (1-B) are obtained.

  Here, Xr (i, j), Yr (i, j) and Zr (i, j) are the measurement results of the spectroradiometer when the red display is measured, and Xsr (i, j), Ysr (I, j) and Zsr (i, j) are measurement results of the two-dimensional colorimeter MD when a red display is measured at the same position. Xg (i, j), Yg (i, j) and Zg (i, j) are the measurement results of the spectroradiometer when the green display is measured, and Xsg (i, j), Ysg (i, j) and Zsg (i, j) are measurement results of the two-dimensional colorimeter MD when a green display is measured at the same position. Xb (i, j), Yb (i, j) and Zb (i, j) are the measurement results of the spectroradiometer when the blue display is measured, and Xsb (i, j), Ysb (i, j) and Zsb (i, j) are measurement results of the two-dimensional colorimeter MD when a blue display is measured at the same position.

  The transformation matrix C (i, j) is obtained by solving these equations (1-W), (1-R), (1-G), and (1-B) simultaneously. That is, each component c11 (i, j) to c13 (i, j), c21 (i, j) to c23 (i, j), c31 (i, j) to c33 () of the transformation matrix C (i, j). i, j) are determined.

Here, when measurement is performed for all the pixels (i, j) at each magnification β, a relatively large amount of measurement data is required, and the measurement of the spectroradiometer that measures at spots (points) takes time. As a result, measurement takes time. For example, when measuring each of 32 × 18 pixels, 32 × 18 = 576 pieces of data are required, and the measurement takes time. For this reason, in this embodiment, by using the spectral transmittance To (β, r, λ) of the variable magnification optical system 211, a specific one pixel position s, t (for example, the center of the display surface in the display device DP). Spectral radiometer measurement results X (s, t), Y (s, t), and Z (s, t) for a pixel at a position etc.). X (i, j), Y (i, j), and Z (i, j) are obtained by the following equations (2-1) to (2-3). As a result, it is sufficient to measure the pixel at one pixel position s and t.
X (i, j) = X (s, t) * ∫ {Sx (β, i, j, λ) / Sx (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-1)
Y (i, j) = Y (s, t) * ∫ {Sy (β, i, j, λ) / Sy (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-2)
Z (i, j) = Z (s, t) * ∫ {Sz (β, i, j, λ) / Sz (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-3)
Here, L (β, s, t, λ) is the spectral radiance of the display device DP corresponding to the specific pixel positions s, t.

That is, in the white display, when the spectral radiance of the display device DP corresponding to the specific pixel positions s and t in the white display is Lw (β, s, t, λ), the pixels at arbitrary pixel positions i and j The measurement results Xw (i, j), Yw (i, j), and Zw (i, j) of the spectroradiometer are calculated by the following equations (2-1-W) to (2-3-W). Can do.
Xw (i, j) = Xw (s, t) * ∫ {Sx (β, i, j, λ) / Sx (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-1-W)
Yw (i, j) = Yw (s, t) * ∫ {Sy (β, i, j, λ) / Sy (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-2W)
Zw (i, j) = Zw (s, t) * ∫ {Sz (β, i, j, λ) / Sz (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-3-W)

In the red display, when the spectral radiance of the display device DP corresponding to the pixel positions s and t in the red display is Lr (β, s, t, λ), the spectral radiometer for the pixels at arbitrary pixel positions i and j The measurement results Xr (i, j), Yr (i, j), and Zr (i, j) can be obtained by the following equations (2-1-R) to (2-3-R).
Xr (i, j) = Xr (s, t) * ∫ {Sx (β, i, j, λ) / Sx (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-1-R)
Yr (i, j) = Yr (s, t) * ∫ {Sy (β, i, j, λ) / Sy (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-2R)
Zr (i, j) = Zr (s, t) * ∫ {Sz (β, i, j, λ) / Sz (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-3-R)

In the green display, when the spectral radiance of the display device DP corresponding to the pixel positions s and t in the green display is Lg (β, s, t, λ), the spectral radiometer for the pixels at arbitrary pixel positions i and j The measurement results Xg (i, j), Yg (i, j), and Zg (i, j) can be obtained by the following equations (2-1-G) to (2-3-G).
Xg (i, j) = Xg (s, t) * ∫ {Sx (β, i, j, λ) / Sx (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-1-G)
Yg (i, j) = Yg (s, t) * ∫ {Sy (β, i, j, λ) / Sy (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-2G)
Zg (i, j) = Zg (s, t) * ∫ {Sz (β, i, j, λ) / Sz (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-3-G)

In the blue display, if the spectral radiance of the display device DP corresponding to the pixel positions s and t in the blue display is Lb (β, s, t, λ), the spectral radiometer for the pixels at arbitrary pixel positions i and j Measurement results Xb (i, j), Yb (i, j), and Zb (i, j) can be obtained by the following equations (2-1-B) to (2-3-B).
Xb (i, j) = Xb (s, t) * ∫ {Sx (β, i, j, λ) / Sx (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-1-B)
Yb (i, j) = Yb (s, t) * ∫ {Sy (β, i, j, λ) / Sy (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-2B)
Zb (i, j) = Zb (s, t) * ∫ {Sz (β, i, j, λ) / Sz (β, s, t, λ)} * L (β, s, t, λ) dλ ... (2-3-B)

Sx (β, i, j, λ), Sy (β, i, j, λ) and Sz (β, i, j, λ) are expressed by the following equations (1) as described with reference to FIG. 3-1) to (3-3). Here, the image height of the pixel positions i and j is r (i, j), and the spectral transmittance To (β, r (i, j), λ) is the optical stored in the correction information storage unit 241. This is data corresponding to the focal length (in other words, magnification β) acquired by the focal length acquisition unit 214 from the characteristic information table TT. The optical characteristic information table TT stored in the correction information storage unit 241 does not have the spectral transmittance To (β, r (i, j), λ) corresponding to the magnification β acquired by the focal length acquisition unit 214. In this case, for example, linear interpolation or Lagrange interpolation is used from a plurality of spectral transmittances To (β, r (i, j), λ) close to the magnification β acquired by the focal length acquisition unit 214. For example, when the magnification β acquired by the focal length acquisition unit 214 is 1.7, the spectrum of magnification β = 1.5 registered in the optical property information table TT stored in the correction information storage unit 241. It is obtained by interpolation from the transmittance To (1.7, r (i, j), λ) and the spectral transmittance To (2.0, r (i, j), λ) with a magnification β = 2.0.
Sx (β, i, j, λ) = Sox (β, i, j, λ) * To (β, r (i, j), λ) (3-1)
Sy (β, i, j, λ) = Soy (β, i, j, λ) * To (β, r (i, j), λ) (3-2)
Sz (β, i, j, λ) = Soz (β, i, j, λ) * To (β, r (i, j), λ) (3-3)

Here, the image height r (i, j) can be obtained as follows. Since the area image sensor 213 is arranged so that its center (intersection of diagonal lines) matches the optical axis of the variable magnification optical system 211, the image height r is the center of the light receiving surface of the area image sensor 213 (intersection of diagonal lines). Given by the distance from. Therefore, the image height r (i, j) at the pixel at the pixel position i, j can be obtained by the following equation (4) from FIG.
r (i, j) = Lp * ((i−Oh) ² + (j−Ov) ² ) ^1/2 (4)

Here, Lp is the size of the pixel (the length of one side when the pixel is a square), and (Oh, Ov) is the center (intersection of diagonal lines) of the area image sensor 213 represented by the pixel number. . For example, when the area image sensor 213 has 32 pixels in the horizontal direction and 18 pixels in the vertical direction, and one pixel size is 780 μm * 780 μm, Oh = 16.5, Ov = 9.5 Thus, the image height r (29, 4) at the pixel positions 29, 4 is approximately 10.7 mm from the equation (4) (r (29, 4) = 780 * ((29-16.5) ² + (4-9.5) ² ) ^1/2 ).

  The conversion matrix C (i, j) is obtained by the above procedure by using the predetermined optical characteristics depending on the focal length in the variable magnification optical system 211 (in this embodiment, the spectral transmittance To (β, r, λ)). As a value based on

Then, the two-dimensional colorimetric calculation unit 222 calculates the following equation (5) from the tristimulus values X (i, j), Y (i, j), Z (i, j) obtained using the equation (1). The luminance Y and the chromaticity xy defined by the International Commission on Illumination (CIE) are obtained by using the formulas (-1) to (5-3).
Chromaticity x (i, j) = X (i, j) / (X (i, j) + Y (i, j) + Z (i, j)) (5-1)
Chromaticity y (i, j) = Y (i, j) / (X (i, j) + Y (i, j) + Z (i, j)) (5-2)
Luminance Y (i, j) = Y (i, j) (5-3)

  When the luminance Y and the chromaticity xy are obtained in this way, the two-dimensional colorimeter MD determines the position (MDx, MDy, MDz) of the two-dimensional colorimeter MD in the colorimetric result of the obtained luminance Y and chromaticity xy. Are associated with each other and output from the MDIF unit 23 to the display device DP.

  Here, in the above description, the luminance Y (i, j), chromaticity x (i, j), and x (i, j) are represented by the pixel positions i and j of the two-dimensional colorimeter MD. On the other hand, the display device DP requires luminance Y (k, m) and chromaticity x (k, m), x (k, m) represented by the pixel positions k and m of the display device DP. Therefore, before the two-dimensional colorimeter MD outputs the luminance Y (i, j) and chromaticity x (i, j), x (i, j) obtained as described above to the display device DP, It is necessary to convert pixel positions i and j in the two-dimensional colorimeter MD into pixel positions k and m in the display device DP. This conversion can be executed if it is known in which area the display surface of the display unit 12 of the display device DP is received by the area image sensor 213 of the two-dimensional colorimeter MD. More specifically, this conversion is performed as follows, for example.

First, a predetermined color is displayed on the entire display surface of the display unit 12 of the display device DP. Next, the two-dimensional colorimeter MD measures the display unit 12 of the display device DP by the two-dimensional measurement unit 21 to generate a two-dimensional light amount distribution and discriminates the predetermined color from the two-dimensional light amount distribution. By using this discrimination threshold, the area of the display unit 12 in the area image sensor 213 is specified. The pixel positions i and j of the area image sensor 213 corresponding to the four vertices of the area of the display unit 12 in the specified area image sensor 213 correspond to the pixel positions k and m of the four vertices of the display unit 12, respectively. Therefore, from this correspondence, the two-dimensional colorimeter MD converts the pixel positions i and j on the two-dimensional colorimeter MD into pixel positions k and m on the display device DP by the MD control processing unit 22. . For example, a white chromaticity / luminance correction image is used as the display of the predetermined color by the display device DP. The two-dimensional light quantity distribution is generated by the two-dimensional colorimeter MD, and an example of the result is shown in FIG. Here, if the discrimination threshold is 100 cd / m ² , the area AR shown in FIG. 18 is specified as the area of the display unit 12. The pixel positions i and j of the area image sensor 213 corresponding to the four vertices of the area AR are (3, 3), (29, 3), (3, 15) and (29, 15), respectively. When the display unit 12 has 1920 pixels in the horizontal direction and 1080 pixels in the vertical direction, the pixels (3, 3), (29, 3), (3, 15) at the four vertices of the area AR and (29, 15) are the pixel positions k and m of the display device DP, respectively, and the pixels (1, 1), (1920, 1), (1, 1080) and (1920, 108). Each pixel between the four vertices (1, 1), (1920, 1), (1, 1080) and (1920, 108) of the display unit 12 is a two-dimensional colorimeter by linear interpolation. It can be associated with a pixel in the MD. As a result, the pixels at the pixel positions k and m in the display device DP are associated with the pixels in the two-dimensional colorimeter MD, and the luminance Y (k, m) represented by the pixel positions k and m of the display device DP ), Chromaticity x (k, m), x (k, m).

  In the above description, the two-dimensional colorimeter MD performs coordinate conversion, and the two-dimensional colorimeter MD has the luminance Y (k, m) and chromaticity x (represented by the pixel positions k and m of the display device DP. k, m), and x (k, m) are output to the display device DP, but the two-dimensional colorimeter MD includes information on correspondence between the four vertices necessary for the coordinate conversion, and a two-dimensional colorimeter. The luminance Y (i, j) and chromaticity x (i, j), x (i, j) represented by the MD pixel positions i and j are output to the display device DP, and the display device DP performs the coordinate conversion. You can go.

  Then, the display device DP uses the colorimetric information storage processing unit 145 of the DP control processing unit 14 to display the colorimetric result with the position of the two-dimensional colorimeter MD acquired by the DPIF unit 17 from the two-dimensional colorimeter MD. The colorimetric information is stored in the colorimetric information storage unit 151 as colorimetric information. The two-dimensional colorimeter MD and the display device DP may be connected wirelessly or may be connected to each other via the cable C.

  The above-described processes performed at the first colorimetric position PM1 are sequentially performed at the second to fifth colorimetric positions PM2 to PM5, respectively, and are related to the first to fifth colorimetric positions PM1 to PM5. Colorimetric information is stored in the colorimetric information storage unit 151.

  Further, in order to shorten the time in the colorimetric processing and to reduce the labor thereof, for example, as shown in FIG. 8, five 2 in each of the five first to fifth colorimetric positions PM1 to PM5. The dimensional colorimeters MD-1 to MD-5 may be simultaneously arranged and the above-described processes may be performed. In this case, the two-dimensional colorimeter MD specifies a colorimeter identifier (colorimeter ID) that is an identifier for identifying the own device and identifying it from the other two-dimensional colorimeter MD. In the DP storage unit 15 of the display device DP, the approximate position of the two-dimensional colorimeter MD and the colorimeter ID are stored in advance in association with each other. For example, the position detection range in the display device DP is divided into a plurality of areas, and the colorimeter ID is assigned to the corresponding area and stored in advance. The display device DP detects the position of the two-dimensional colorimeter MD, selects a colorimeter ID corresponding to the detected position, and detects the position of the detected two-dimensional colorimeter MD and the selected measurement. The colorimeter ID is displayed, and when the two-dimensional colorimeter MD acquires the position of the two-dimensional colorimeter MD displayed on the display surface of the display unit 12 as the colorimetric position, the two-dimensional colorimeter MD The position of the two-dimensional colorimeter MD corresponding to the meter ID is acquired.

  The display device DP is shipped after such colorimetric processing is performed.

(Adjustment of display state (display output) in display device DP)
Next, an operation related to adjustment of the display state of the display device DP will be described. The display system DS and the display device DP in the present embodiment relate to adjustment of the display state when displaying content such as a still image or a moving image on the display unit 12, for example, when displaying the still image, Further, when the moving image is displayed, the operation is performed as follows every frame or every several frames. Note that the stereo camera 11 and the position processing unit 143 always operate and monitor after the start.

  In FIG. 19, first, the DP control processing unit 14 generates a pair of images by the stereo camera 11, and obtains and detects the user's location (Ux, Ud, Uz) by the position processing unit 143 (S <b> 21).

  Next, the DP control processing unit 14 uses the display adjustment unit 144 to obtain a color measurement result corresponding to the user's location (Ux, Uy, Uz) from the color measurement information stored in the color measurement information storage unit 151. Select and take out. The display adjustment unit 144 may execute the above-described interpolation process.

  For example, when the user's location (Ux, Uy, Uz) is coordinates (−700, 0, 1000), the display adjustment unit 144 uses the color measurement information stored in the color measurement information storage unit 151 to calculate Ux. The color measurement results shown in FIG. 10 measured by the two-dimensional colorimeter MD arranged at the coordinate positions of = MDx = −700, Uy = MDy = 0, Uz = MDz = 1000 are selected and taken out. Further, for example, when the user's location (Ux, Uy, Uz) is coordinates (−350, 0, 1000), the display adjustment unit 144 determines from the color measurement information stored in the color measurement information storage unit 151. Each color measurement result shown in FIG. 9 and FIG. 10 measured by a two-dimensional colorimeter MD arranged at a position close to the coordinate position of Ux = MDx = −350, Uy = MDy = 0, Uz = MDz = 1000. Is selected, and based on the color measurement results shown in FIGS. 9 and 10, a color measurement result corresponding to the coordinates (−350, 0, 1000) is generated by interpolation.

  Next, the DP control processing unit 14 causes the display adjustment unit 144 to compensate the difference between the color measurement result thus taken out and the target appearance on the display surface for each pixel in the display unit 12. Each adjustment value corresponding to the position is generated (S23).

  Then, the DP control processing unit 14 performs display using each adjustment value obtained in step S23 (S24), and ends the process. For example, in the display of the still image, the DP control processing unit 14 adjusts each pixel value of the still image using each adjustment value obtained in step S23 and displays the still image on the display unit 12. Further, for example, in the display of the moving image, the DP control processing unit 14 adjusts each pixel value of the frame in the moving image using each adjustment value obtained in step S <b> 3 and displays the frame of the moving image on the display unit 12. .

As an example, when the user's location (Ux, Uy, Uz) is coordinates (−700, 0, 1000), the measurement result (luminance Y = 100 cd / m ² ) in the area of coordinates (−15, 0), Chromaticity x = 0.3127, chromaticity y = 0.3290) is the target appearance, and the measurement result of each area of the display surface in the display unit 12 and the target appearance (luminance Y = 100 cd / m ^2). , Chromaticity x = 0.3127, chromaticity y = 0.3290), and the display state of each pixel in each region is adjusted using each difference as an adjustment value for each region. For example, in the area of coordinates (14, 0), the measurement result (luminance Y = 50 cd / m ² , chromaticity x = 0.336, chromaticity y = 0.355) and the target appearance (luminance Y = 100 cd) / M ² , chromaticity x = 0.3127, chromaticity y = 0.3290), and the display state of each pixel in the area of coordinates (14, 0) is adjusted using this difference as an adjustment value. (For example, the luminance Y of each pixel is increased to compensate for the difference of 50 cd / m ² , ie, the luminance Y of each pixel is doubled).

  As described above, the two-dimensional colorimeter MD according to the present embodiment, the two-dimensional colorimetry method implemented in the two-dimensional colorimeter, and the display system DS using the same include the variable magnification optical system 211. By changing the focal length of the variable magnification optical system 211 according to the distance (size) and the distance between the measurement object and the two-dimensional colorimeter MD, in other words, the magnification, the entire measurement object is copied, In addition, it is possible to generate data excluding images of other objects (for example, the background) excluding the measurement target as much as possible. The two-dimensional colorimeter MD, the two-dimensional colorimetry method, and the display system DS are correction information for correcting measurement errors caused by predetermined optical characteristics depending on the focal length in the variable magnification optical system 211. Is stored in advance in the correction information storage unit 241 in association with the focal length, according to the plurality of two-dimensional light quantity distributions corresponding to the measured plurality of color components and the focal length of the variable magnification optical system 211 at that time. Since the two-dimensional color distribution of the measurement target is obtained based on the correction information, the measurement error associated with the focal length (in other words, magnification) of the variable magnification optical system 211 can be further reduced. Therefore, the two-dimensional colorimeter MD, the two-dimensional colorimetry method, and the display system DS include the variable magnification optical system 211 and can further reduce measurement errors.

  In this embodiment, since the optical characteristic is the spectral transmittance To, the two-dimensional colorimeter MD, the two-dimensional colorimetry method, and the display system DS change according to the change in the focal length of the variable magnification optical system 211. The measurement error accompanying the spectral transmittance can be reduced.

  In the display system DS, the two-dimensional colorimeter MD includes the MDIF unit 23, and the display device DP includes the DPIF unit 17 and the colorimetric information storage processing unit 145. The color result can be automatically stored in the color measurement information storage unit 145 of the display device DP as the color measurement information.

  Since the user looks at each position on the display surface of the display unit 12 of the display device DP at each angle corresponding to each position, the user can see each position according to each position. In the display system DS, the display device DP adjusts the display state of the display unit 12 with an adjustment value corresponding to the position on the display surface, so that each appearance according to each position can be individually adjusted.

  In the above-described embodiment, the correction information storage unit 241 stores the optical characteristic information table TT as correction information. However, as described above, the two-dimensional colorimeter MD is measured by the two-dimensional measurement unit 21. By using the conversion matrix C (i, j) for converting the plurality of two-dimensional light quantity distributions into the two-dimensional color distribution of the measurement object, the measurement object is obtained from the plurality of two-dimensional light quantity distributions measured by the two-dimensional measurement unit 21. Therefore, the correction information storage unit 241 changes the above-described conversion matrix C (i, j) (= C (r)) as the correction information instead of the optical characteristic information table TT. The focal length (magnification β in this embodiment) and the pixel position (i, j) (or image height r) of the magnification optical system 211 may be stored in association with each other. For example, the correction information storage unit 241 stores a first conversion matrix (β = 1.0) corresponding to the case where the magnification β = 1.0 and a second conversion matrix (β corresponding to the case where the magnification β = 1.2. = 1.2), a third transformation matrix (β = 1.5) corresponding to the case of magnification β = 1.5, and a fourth transformation matrix (β = 2.0) corresponding to the case of magnification β = 2.0. ), A fifth transformation matrix (β = 2.5) corresponding to a magnification β = 2.5, and a sixth transformation matrix (β = 3.0) corresponding to a magnification β = 3.0, respectively. Are stored in association with all pixel positions (i, j) or in correspondence with pixel positions (i, j) at predetermined intervals. Such a two-dimensional colorimeter MD, a two-dimensional colorimetry method, and a display system DS are obtained by obtaining a conversion matrix C in consideration of the influence of a measurement error associated with the focal length of the variable magnification optical system 211. From the plurality of two-dimensional light quantity distributions measured by the measuring unit 21, the two-dimensional color distribution of the measurement target can be easily obtained, in which the measurement error associated with the focal length of the variable magnification optical system 211 is further reduced.

In the above-described embodiment, the luminance Y and the chromaticity xy are obtained from the tristimulus values XYZ, but values in other color systems may be obtained. For example, u′v ′ of the Lu′v ′ color system may be obtained from the tristimulus values XYZ by the following equations (6-1) and (6-2).
u ′ (i, j) = 4 * X (i, j) / (X (i, j) + 15 * Y (i, j) + 3 * Z (i, j)) (6-1)
v ′ (i, j) = 9 * Y (i, j) / (X (i, j) + 15 * Y (i, j) + 3 * Z (i, j)) (6-1)

  In the above-described embodiment, the position detection unit that detects the user's location (Ux, Uy, Uz) with respect to the display surface of the display unit 12 includes the stereo camera 11 and the position processing unit 143. However, the present invention is not limited to this. For example, the position detection unit includes a plurality of pyroelectric elements, a distance meter, an information processing circuit, and the like arranged in a two-dimensional array with a predetermined interval, and the information processing circuit includes a plurality of focusing circuits. By detecting the direction (Ux, Uy) where the user is located from each output in the electric element and measuring the distance (Uz) to the user with the distance meter in the detected direction (Ux, Uy), the location of the user The position (Ux, Uy, Uz) may be detected. The distance meter is, for example, a TOF type distance meter that transmits and receives pulses of ultrasonic waves and laser light and obtains a distance from the TOF (Time Of Flight) to a measurement target (user). In addition, for example, the position detection unit uses a LIDAR (Laser Imaging Detection and Ranging) technique to form a distance image (Ux, Uy, Uz) composed of a plurality of pixels expressed by information representing the distance to the subject. A distance image sensor, an information processing circuit, and the like. The information processing circuit is configured by, for example, pattern matching of a human model prepared in advance from a distance image, or by a neural network learned for human detection A person area may be detected, and the position of a predetermined point in the detected person area may be detected as the user's location (Ux, Uy, Uz).

  In order to express the present invention, the present invention has been properly and fully described through the embodiments with reference to the drawings. However, those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that this is possible. Accordingly, unless the modifications or improvements implemented by those skilled in the art are at a level that departs from the scope of the claims recited in the claims, the modifications or improvements are not covered by the claims. It is interpreted that it is included in

DS display system MD two-dimensional colorimeter DP display device 11 stereo camera 12 display unit 14 display side control processing unit (DP control processing unit)
15 Display side storage unit (DP storage unit)
16 Antenna 17 Display side interface part (DPIF part)
21 Two-dimensional measurement unit 22 Color measurement side control processing unit (MD control processing unit)
23 Colorimetric side interface part (MDIF part)
24 Colorimetric storage unit (MD storage unit)
142 Video signal generation unit 143 Position processing unit 144 Display adjustment unit 145 Color measurement information storage processing unit 146 Position display processing unit 151 Color measurement information storage unit 211 Variable magnification optical system 213 Area image sensor 214 Focal length acquisition unit 222 Two-dimensional color measurement Calculation unit 223 Colorimetric position acquisition output processing unit

Claims (7)

A variable magnification optical system capable of varying the focal length within a predetermined range;
A correction information storage unit that stores correction information for correcting measurement errors caused by predetermined optical characteristics depending on the focal length in the variable magnification optical system in association with the focal length;
A two-dimensional photometric unit that receives an optical image to be measured via the variable magnification optical system and measures a plurality of two-dimensional light quantity distributions corresponding to a plurality of color components;
A focal length acquisition unit for acquiring a focal length of the variable magnification optical system when the plurality of two-dimensional light quantity distributions are measured by the two-dimensional photometry unit;
Based on the plurality of two-dimensional light amount distributions measured by the two-dimensional photometry unit and correction information stored in the correction information storage unit and corresponding to the focal length acquired by the focal length acquisition unit, the measurement target A two-dimensional colorimetric calculation unit for obtaining a two-dimensional color distribution ;
The optical property is spectral transmittance,
The two-dimensional colorimeter, wherein the correction information storage unit stores a plurality of spectral transmittances depending on the focal length and the image height of the variable magnification optical system as the correction information . The two-dimensional colorimetric calculation unit is measured by the two-dimensional photometry unit by using a conversion matrix that converts the plurality of two-dimensional light quantity distributions measured by the two-dimensional photometry unit into the two-dimensional color distribution of the measurement target. Obtaining a two-dimensional color distribution of the measurement object from the plurality of two-dimensional light quantity distributions
The correction information storage unit stores the conversion matrix as the correction information,
Each matrix element of the transformation matrix is two-dimensional colorimeter according to claim 1, wherein a value based on the predetermined optical characteristic that is dependent on the focal length in a variable magnification optical system. A variable magnification optical system capable of varying a focal length within a predetermined range, and correction information for correcting measurement errors caused by predetermined optical characteristics depending on the focal length in the variable magnification optical system are the focal length. A two-dimensional colorimetric method of a two-dimensional colorimeter comprising a correction information storage unit that stores the information in association with
A two-dimensional photometric process for receiving an optical image to be measured through the variable magnification optical system and measuring a plurality of two-dimensional light quantity distributions corresponding to a plurality of color components;
A focal length acquisition step of acquiring a focal length of the zoom optical system when measuring the plurality of two-dimensional light quantity distributions in the two-dimensional photometry step;
Based on the plurality of two-dimensional light quantity distributions measured in the two-dimensional photometry step and the correction information stored in the correction information storage unit and corresponding to the focal length acquired in the focal length acquisition step, A two-dimensional colorimetric calculation step for obtaining a two-dimensional color distribution ,
The optical property is spectral transmittance,
The two-dimensional colorimetric method, wherein the correction information storage unit stores a plurality of spectral transmittances depending on the focal length and the image height of the variable magnification optical system as the correction information . A variable magnification optical system capable of varying a focal length within a predetermined range, and correction information for correcting measurement errors caused by predetermined optical characteristics depending on the focal length in the variable magnification optical system are the focal length. A two-dimensional colorimetric program executed by a two-dimensional colorimeter comprising a correction information storage unit stored in association with
A two-dimensional photometric process for receiving an optical image to be measured through the variable magnification optical system and measuring a plurality of two-dimensional light quantity distributions corresponding to a plurality of color components;
A focal length acquisition step of acquiring a focal length of the zoom optical system when measuring the plurality of two-dimensional light quantity distributions in the two-dimensional photometry step;
Based on the plurality of two-dimensional light quantity distributions measured in the two-dimensional photometry step and the correction information stored in the correction information storage unit and corresponding to the focal length acquired in the focal length acquisition step, A two-dimensional colorimetric calculation step for obtaining a two-dimensional color distribution ,
The optical property is spectral transmittance,
The two-dimensional colorimetric program characterized in that the correction information storage unit stores a plurality of spectral transmittances depending on the focal length and the image height of the variable magnification optical system as the correction information . A display system comprising the two-dimensional colorimeter according to claim 1 or 2 and a display device for performing predetermined display,
The display device
A display unit for displaying on the display surface;
A position detection unit for detecting the location of the user with respect to the display surface;
Stores colorimetric information in which each of the plurality of colorimetric positions is associated with a plurality of colorimetric results obtained by measuring the display surface in two dimensions with the two-dimensional colorimeter from each of a plurality of colorimetric positions with respect to the display surface. A colorimetric information storage unit
Based on the location detected by the location detector and the colorimetric information stored in the colorimetric information storage unit, the target set in advance when the display surface is viewed from the location of the user. A display system comprising: a display adjustment unit that adjusts a display state of the display unit so as to be visible. The two-dimensional colorimeter further outputs a two-dimensional color distribution of the display surface obtained by the two-dimensional colorimetric calculation unit with the display surface of the display device as the measurement target to the display device as the color measurement result. With a colorimetric interface
The display device further includes:
A display-side interface unit for acquiring the colorimetry result output from the colorimetry-side interface unit of the two-dimensional colorimeter;
The display system according to claim 5 , further comprising: a colorimetric information storage processing unit that stores the colorimetric result acquired by the display-side interface unit as the colorimetric information in the colorimetric information storage unit. The display adjustment unit, when viewing the display surface from the location of the user based on the location detected by the location detector and the colorimetric information stored in the colorimetric information storage unit as a preset appearance of the target, the adjustment value corresponding to the position on the display surface, according to claim 5 or claim 6, characterized in that adjusting the display state of the display unit Display system.

Images