JP2011028058A - Display device and electronic apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display device which is capable of reducing the degradation of photosensing precision due to infrared light while suppressing the degradation of display quality. <P>SOLUTION: An infrared blocking spacer 50G for blocking infrared light LIR is provided between a TFT substrate 10 and a CF substrate 20. Detection of infrared light LIR by a photosensor 12B is reduced or avoided. Thus the degradation of photosensing precision due to infrared light LIR is reduced even when external light LO or display light includes large quantities of infrared light LIR. The infrared blocking spacer 50G is selectively provided in a region corresponding to at least one photosensor 12B. Even if the infrared blocking spacer 50G blocks a part of visible light also, a bad influence upon display light is reduced. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a display device having a photodetection element (photosensor) and an electronic apparatus including such a display device.

  In recent years, in display devices used for cellular phones, personal digital assistants (PDAs), digital still cameras, PC (Personal Computer) monitors, televisions, and the like, liquid crystal elements and organic electroluminescence (EL) elements Etc. are used. Display pixels including such display elements are arranged in a matrix on a substrate together with driving transistors such as TFTs (Thin Film Transistors).

  On the other hand, various display devices using a photosensor have been developed by forming a photosensor in the same layer as the TFT. Applications of such photosensors include an ambient light illuminance sensor (for example, Patent Document 1), a backlight color sensor (for example, Patent Documents 2 and 3), a touch panel (for example, Patent Documents 4 and 5), a color image sensor, and the like. Examples include a scanner function (for example, Non-Patent Document 1).

JP 2008-64828 A JP 2007-304520 A JP 2006-251806 A JP 2006-301864 A JP 2006-276223 A

Sharp Technical Journal, No. 96, November 2007, p. 40-41

  By the way, both the TFT and the photosensor are formed on the basis of silicon technology. Here, for example, when a photosensor is formed using crystalline silicon, it is known that not only visible light but also light in the near infrared region (780 nm to 1100 nm) has light receiving sensitivity. Therefore, when a display device has a function of an optical sensing device, a false reaction due to infrared light (decrease in detection accuracy due to infrared light) when used for the purpose of extracting visible light information. Is a problem.

  For example, when an incandescent lamp or sunset light with a large amount of infrared light is incident on a silicon-based external light illuminance sensor, the value is higher than the actual illuminance. In addition, such an external light illuminance sensor also reacts to invisible light such as an infrared remote controller.

  Therefore, it is conceivable to provide a light shielding member that shields infrared rays on the display screen. However, since the light blocking member for infrared light has a characteristic of blocking even a part of visible light, when such a light blocking member is provided, display image quality deterioration such as luminance reduction and color shift may occur. Become.

  The present invention has been made in view of such problems, and an object of the present invention is to provide a display device capable of reducing deterioration in light detection accuracy caused by infrared light while suppressing deterioration in display image quality, and so on. Another object is to provide an electronic device provided with a display device.

  A display device according to the present invention includes a first substrate having a plurality of pixel electrodes constituting a display element and a photodetecting element on a substrate surface, and a first substrate disposed opposite to the substrate surface in the first substrate. Two substrates and a spacer made of a material that blocks infrared light, and a spacer selectively disposed in a region corresponding to at least one of the light detection elements between the first substrate and the second substrate. It is provided.

  An electric apparatus according to the present invention includes the display device.

  In the display device and the electronic apparatus of the present invention, since the spacer that blocks infrared light is disposed between the first substrate and the second substrate, detection of infrared light by the light detection element is reduced or avoided. Is done. In addition, since the spacer is selectively disposed in a region corresponding to at least one of the light detection elements, even if the spacer blocks a part of visible light. Compared with the case where a light shielding layer is provided on the entire display screen, the adverse effect on the display light is reduced.

  According to the display device and the electronic apparatus of the present invention, since the spacer for blocking infrared light is provided between the first substrate and the second substrate, detection of infrared light by the light detection element is reduced or reduced. Even if a large amount of infrared light is included in external light or display light from the display element, reduction in light detection accuracy due to such infrared light can be reduced. Can do. In addition, since such a spacer is selectively provided in a region corresponding to at least one of the light detection elements, this spacer temporarily blocks part of visible light. However, the adverse effect on the display light can be suppressed. Therefore, it is possible to reduce deterioration in light detection accuracy due to infrared light while suppressing deterioration in display image quality such as luminance reduction and color shift.

It is a schematic diagram showing the plane structure of the display apparatus which concerns on embodiment of this invention. FIG. 2 is a cross-sectional view and a block diagram showing a schematic configuration near a boundary between a frame area and an effective display area according to the first embodiment of the present invention in the display device shown in FIG. 1. It is a characteristic view showing an example of the light absorbency of the infrared shielding material used for the infrared shielding spacer shown in FIG. FIG. 4 is an enlarged cross-sectional view in the vicinity of a boundary between a pixel driving TFT and a photosensor according to an embodiment of the present invention. It is a characteristic view for demonstrating the photosensitivity of a silicon semiconductor. It is a cross-sectional schematic diagram for demonstrating the image display operation | movement by visible light and external light detection operation in the display apparatus shown in FIG. It is a schematic diagram for demonstrating the display operation principle of FFS mode. This is an enlarged view of the cross section of the main part of the liquid crystal element. It is sectional drawing showing schematic structure of the boundary vicinity of the frame area | region and effective display area | region in the display panel of the display apparatus which concerns on a comparative example. It is a characteristic view showing an example of the transmittance | permeability of a green color filter, and a visibility curve. 10 is a cross-sectional view illustrating a schematic configuration near a boundary between a frame region and an effective display region in a display panel of a display device according to Modification Example 1. FIG. It is sectional drawing and the block diagram showing schematic structure of the boundary vicinity of the frame area | region and effective display area | region in the display apparatus which concerns on 2nd Embodiment. It is a characteristic view showing an example of the transmittance | permeability of each color filter corresponding to red, green, and blue. It is sectional drawing and the block diagram showing schematic structure of the boundary vicinity of the frame area | region and effective display area | region in the display apparatus which concerns on 3rd Embodiment. 10 is a cross-sectional view and a block diagram illustrating a schematic configuration near a boundary between a frame region and an effective display region in a display device according to Modification Example 2. FIG. It is sectional drawing and block diagram showing schematic structure of the boundary vicinity of the frame area | region and effective display area | region in the display apparatus which concerns on the modification 3. It is sectional drawing and block diagram showing schematic structure of the boundary vicinity of the frame area | region and effective display area | region in the display apparatus which concerns on 4th Embodiment. FIG. 18 is a schematic diagram illustrating a schematic configuration of the backlight illustrated in FIG. 17. FIG. 18 is a schematic plan view illustrating a pixel arrangement example in an effective display area illustrated in FIG. 17. FIG. 18 is a schematic plan view illustrating an arrangement example of main sensors and auxiliary sensors in the effective display area illustrated in FIG. 17. It is a characteristic view showing an example of the transmittance | permeability of the infrared light transmission black shown in FIG. It is a characteristic view showing an example of the relationship between the light emission wavelength range of the light source for detection, and the detection wavelength range of a main sensor and an auxiliary sensor. It is a characteristic view showing the other example of the relationship between the light emission wavelength area | region of the light source for a detection, and the detection wavelength area | region of a main sensor and an auxiliary sensor. It is a flowchart showing the outline | summary of a difference image position determination process. FIG. 25 is a timing chart for explaining the difference image position determination process shown in FIG. 24. It is a conceptual diagram for demonstrating the gravity center coordinate calculation in an object information calculating part. It is a figure for demonstrating the difference image position determination process in case external light is bright. It is a figure for demonstrating the difference image position determination process in case external light is dark. It is a characteristic view for demonstrating the difference image position determination process which concerns on a comparative example. It is a schematic diagram for demonstrating the difference image position determination process which concerns on a comparative example. It is a characteristic view for demonstrating the difference image obtained by the main sensor shown in FIG. It is a schematic diagram for demonstrating the difference image obtained by the main sensor shown in FIG. It is a characteristic view for demonstrating the difference image obtained by the auxiliary sensor shown in FIG. It is a schematic diagram for demonstrating the difference image obtained by the auxiliary sensor shown in FIG. It is a schematic diagram for demonstrating an example of the synthetic | combination process of the difference image obtained by a main sensor, and the difference image obtained by an auxiliary sensor. It is a characteristic view for demonstrating the difference image of the ON image obtained by a main sensor, and the ON image obtained by an auxiliary sensor. It is a schematic diagram for demonstrating the difference image of the ON image obtained by a main sensor, and the ON image obtained by an auxiliary sensor. It is sectional drawing and block diagram showing schematic structure of the boundary vicinity of the frame area | region and effective display area | region in the display apparatus which concerns on 5th Embodiment. It is sectional drawing and a block diagram showing schematic structure of the boundary vicinity of the frame area | region and effective display area | region in the display apparatus which concerns on the modification 4. It is a perspective view showing the external appearance seen from the (A) front side in the application example 1 of the display apparatus of each said embodiment, and the external appearance seen from the (B) back side. 12 is a perspective view illustrating an appearance of application example 2. FIG. 12 is a perspective view illustrating an appearance of application example 3. FIG. (A) is a front view of the application example 4 in an open state, (B) is a side view thereof, (C) is a front view in a closed state, (D) is a left side view, and (E) is a right side view, (F) is a top view and (G) is a bottom view.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The description will be given in the following order.
1. First embodiment (configuration example as an ambient light illuminance sensor)
Modification 1 (Configuration example using liquid crystal in a drive mode other than the transverse electric field mode)
2. Second Embodiment (Configuration Example as Color Image Sensor or Color Scanner)
3. Third Embodiment (Configuration Example as Display Color Balance Sensor; Frame Area)
Modification Example 2 (Configuration Example as Display Color Balance Sensor; Effective Display Area)
Modification 3 (Configuration example as a display color balance sensor and an external light illuminance sensor)
4). Fourth embodiment (configuration example as an optical touch panel using infrared light)
5. Fifth embodiment (example of display color balance sensor in the case of organic EL element; frame region)
Modification 4 (Example of display color balance sensor in the case of organic EL element; effective display area)
6). Application example to electronic equipment

<1. First Embodiment>
[Example of overall configuration of display device]
FIG. 1 is a schematic view of a display device 1 according to an embodiment of the present invention as viewed from the upper surface (display panel 1A side). FIG. 2 shows a schematic cross-sectional configuration along the line II in FIG. 1, and shows a region near the boundary between the frame region A and the effective display region B. In FIG. 2 and similar drawings to be described later, block configurations of a backlight driving unit 71 and the like described later are also shown. 2 and FIG. 6, FIG. 9, FIG. 12, FIG. 15, and FIG. 17 to be described later, for simplification of illustration, the pixel electrode 16A to be described later is illustrated as being provided one for each pixel. However, the detailed configuration of the pixel electrode 16A will be described later (FIGS. 4, 7, and 8).

  The display device 1 is a display device that can control the display brightness by measuring the illuminance of external light, and includes a display panel 1A, a backlight 40, and a backlight drive unit 71 (luminance control unit). It is configured to include.

  In the display panel 1 </ b> A, as shown in FIG. 1, a rectangular effective display area B is provided on the display screen, and an area around the effective display area B is a frame area A. In this way, the end portion of the display panel 1A is provided with an external connection region 210 that is exposed by extending the wiring on the TFT substrate 10, for example, and an external connection terminal (not shown) is formed. The external connection terminal is connected to a flexible printed circuit (FPC) (not shown) for signal input / output. On this FPC, an IC (Integrated Circuit) chip in which various circuits, storage elements, and the like as the backlight driving unit 71 are integrated is disposed. Alternatively, an IC chip may be disposed on the wiring of the TFT substrate 10 and an FPC may be connected to the outside thereof.

  In the frame area A, peripheral circuits (not shown) such as a signal line driving circuit and a scanning line driving circuit that are drivers for image display are formed.

  In the effective display area B, for example, display pixels of the three primary colors R, G, and B are arranged in a matrix. In the present embodiment, a liquid crystal display element as a display element is provided in the display pixel.

  These frame area A and effective display area B are configured by sealing a liquid crystal layer 30 between a TFT substrate 10 (first substrate) and a CF (Color Filter) substrate 20 (second substrate). 10 has a backlight 40 below. A polarizing plate 17 is bonded to the light incident side of the TFT substrate 10, and a polarizing plate 25 is bonded to the light output side of the CF substrate 20. Further, in the present embodiment, an infrared light shielding spacer 50 made of a material that shields infrared light, which will be described later, is selectively disposed in a predetermined region between the TFT substrate 10 and the CF substrate 20. . Hereinafter, specific configurations of the TFT substrate 10, the CF substrate 20, the liquid crystal layer 30, the infrared light shielding spacer 50G, and the backlight 40 will be described for each region (effective display region B and frame region A).

(Effective display area B)
First, each component in the effective display area B will be described. In the effective display area B, in the TFT substrate 10, a plurality of TFTs 12A are arranged at a predetermined pitch on a substrate 11 made of glass or the like, and at least one photosensor 12B (light detection element) is arranged. It is installed.

  The TFT 12A is for driving the plurality of display pixels by, for example, an active matrix method, and is connected to a pixel electrode 16A described later. The photosensor 12B is a photodetection element that can detect current and voltage when light is applied to a semiconductor PN junction. For example, a PIN photodiode using a silicon semiconductor or a PDN (Photosensitive doped layer) is used. P-doped-N) and the like. The photo sensor 12B is provided below a green color filter 22G among the color filters 22 described later.

  The TFT 12A and the photosensor 12B can be formed in the same layer on the substrate 11 by the same thin film process, for example. The detailed configuration of the TFT 12A and the photosensor 12B will be described later.

  On the substrate 11, a flattening layer 13 for flattening the unevenness of the TFT 12A and the photosensor 12B is formed. On the planarization layer 13, the common electrode 14 and the plurality of pixel electrodes 16 </ b> A are provided so as to face each other with the insulating layer 15 interposed therebetween. Among these, the common electrode 14 is an electrode common to each display pixel, and the pixel electrode 16A is separately provided for each display pixel. In the present embodiment, each pixel electrode 16A is patterned in, for example, a comb shape. Thereby, along with the liquid crystal layer 30 to be described later, display driving in a horizontal electric field mode, for example, an FFS (fringe field switching) mode, an IPS (in-plane switching) mode, or the like is performed.

  On the other hand, in the CF substrate 20, a color filter 22 is formed on one surface of a substrate 21 made of glass or the like. The color filter 22 is composed of, for example, a red color filter 22R, a green color filter 22G, and a blue color filter 22B. These three color filters 22R, 22G, and 22B are provided for each display pixel (pixel electrode 16A). It is provided corresponding to.

  The two polarizing plates 17 and 25 are arranged in a crossed Nicols state. The polarizing plate 17 is a polarizer that selectively transmits a specific polarization component of visible light incident from the backlight 40 side and enters the liquid crystal layer 30. On the other hand, the polarizing plate 25 is an analyzer that transmits a polarized light component orthogonal to the light transmitted through the polarizing plate 17 and emits display light upward.

  The liquid crystal layer 30 modulates light passing therethrough depending on the state of the electric field, and for example, liquid crystal in a horizontal electric field mode such as an FFS mode or an IPS mode can be used. The liquid crystal layer 30 is formed in a region corresponding to the effective display region B between the TFT substrate 10 and the CF substrate 20. Note that alignment films (not shown) are formed between the liquid crystal layer 30 and the TFT substrate 10 and between the liquid crystal layer 30 and the CF substrate 20, respectively. Further, the liquid crystal layer 30 is sealed at the peripheral edge of the frame area A by a sealing layer (not shown).

  The infrared light shielding spacer 50G is selectively disposed in a region corresponding to at least one photosensor 12B between the TFT substrate 10 and the CF substrate 20. Specifically, a green color filter 22G is disposed on the CF substrate 20 so as to face at least one photosensor 12B, and a red color is interposed between the photosensor 12B and the green color filter 22G. An outer light shielding spacer 50 is selectively provided.

  The infrared light shielding spacer 50 has a function of selectively shielding (absorbing) infrared light as shown in FIG. 3, for example, and also has an original function as a spacer. Such an original function is a function as a member for maintaining a gap between the two substrates 10 and 20. That is, the liquid crystal display device is used for controlling the thickness of the liquid crystal layer, the organic EL display device is used for controlling the thickness of the sealing resin, and the electrophoretic display is used for forming a box for confining the colored liquid. It is. Examples of a method for forming such a spacer include a method in which resin balls having a diameter corresponding to a gap are dispersed, and a method in which a resist is applied to a thickness that finally becomes the thickness of the gap and then patterned. Here, the latter method can be used.

  As the infrared light shielding spacer 50G, for example, a pigment dispersion resist in which a pigment that selectively transmits and absorbs light in a specific wavelength region is dispersed in a photosensitive resist material can be used. Examples of the resist material include acrylic, polyimide, and novolak. The pigment can be selected from pigments that have heat resistance and light resistance in the production process and that are used in paints and the like and have the property of absorbing infrared light. Specific examples of infrared light absorbing materials include bis (dithiobenzyl) nickel complexes and bis ((4-dimethylamino) dithiobenzylnickel used in the infrared imaging of solid-state imaging devices. In order to withstand the process (exposure, development, baking) as a spacer column material and withstand device reliability, heat resistance and light resistance are required compared to solid-state image sensors. Examples include finely divided quaterelin dyes and cyanine dye pigments that satisfy the characteristics, and such a pigment-dispersed resist is formed on a substrate 21 and then subjected to processes such as exposure, development, and baking. can do.

  The backlight 40 is a light source that illuminates the display panel 1 </ b> A, and the light emission surface thereof is disposed so as to face the entire effective display area B and the frame area A. The backlight 40 uses, for example, a light emitting diode (LED) as a light source, and emits at least visible light.

(Frame area A)
Next, each component in the frame area A will be described.

  In the frame region A, a planarizing layer 13 and an insulating layer 15 extending from the effective display region B are disposed on the substrate 11 in the TFT substrate 10.

  In the CF substrate 20, the light shielding black 24 is formed over almost the entire frame area A on the substrate 21. The light shielding black 24 blocks visible light, and is made of, for example, a resist in which carbon fine particles are dispersed in an acrylic resist.

  The liquid crystal layer 30 and the backlight 40 are the same as the effective display area B.

[Configuration example of TFT substrate]
Next, a detailed configuration of the TFT substrate 10 will be described with reference to FIGS. 4 and 5. FIG. 4 is an enlarged cross-sectional view of the TFT substrate 10 in the vicinity of the boundary between the pixel driving TFT 12A and the photosensor 12B formed on the substrate 11 (not shown in FIG. 4). FIG. 5 is a characteristic diagram for explaining the photosensitivity of a silicon semiconductor. Hereinafter, each component of the TFT 12A and the photosensor 12B will be described.

(TFT12A)
As shown in FIG. 4, in the TFT 12A, the pixel Tr. A gate 121 is provided, and the pixel Tr. A gate insulating film 18 is formed so as to cover the gate 121. On the gate insulating film 18, a P ⁻ doped layer 124, LDD layers 123A and 123B, and N ⁺ doped layers 122A and 122B, which become channels when driven, are formed. The P ⁻ doped layer 124, the LDD layers 123A and 123B, and the N ⁺ doped layers 122A and 122B are made of, for example, p-Si (polysilicon), and are obtained by controlling the impurity doping amount. The N ⁺ doped layers 122A and 122B are electrically connected to the source electrode 125 and the drain electrode 126 disposed through the interlayer film 19, respectively. A display signal line 127 electrically connected to the source electrode 125 is further provided on the interlayer film 19, and the planarization layer 13 is formed so as to cover the source electrode 125, the drain electrode 126, and the display signal line 127. Is formed.

  On the planarization layer 13, the common electrode 14 and the pixel electrode 16 </ b> A are disposed with the insulating layer 15 interposed. The planar shape of the pixel electrode 16 </ b> A has a comb-like shape due to the repeatedly formed sub-pixel electrode 160 and the slit 161, and a horizontal electric field is applied to the liquid crystal layer 30 by the potential difference between the comb-like electrode and the common electrode 14. Can be applied.

(Photo sensor 12B)
As shown in FIG. 4, in the photosensor 12 </ b> B, the sensor gate 131 is disposed on the substrate 11, and the gate insulating film 18 is formed so as to cover the sensor gate 131. On the gate insulating film 18, a region 133 that becomes an active region during driving, a P ⁺ doped layer 132A, and an N ⁺ doped layer 132B are formed. The region 133, the P ⁺ doped layer 132A, and the N ⁺ doped layer 132B are made of common, for example, p-Si, and are obtained by controlling the impurity doping amount. The N ⁺ doped layer 132B is electrically connected to the sensor power supply wiring 135 disposed via the interlayer film 19. A GND 134 and a sensor signal line 136 are further provided on the interlayer film 19, and the planarization layer 13 is formed so as to cover the GND 134, the sensor power supply wiring 135 and the sensor signal line 136. Thus, when light strikes the region 133 in a state where a reverse voltage is applied to the PN junction composed of the P ⁺ doped layer 132A, the region 133, and the N ⁺ doped layer 132B, carriers are separated and a photocurrent is generated. This changes the potential of an auxiliary capacitor (not shown) connected to the P ⁺ doped layer 132A, and the electric potential is read through the sensor signal line 136 electrically connected to the auxiliary capacitor.

Such a photosensor 12B is composed of the following silicon semiconductor. For example, polysilicon (p-Si; polycrystalline silicon), amorphous silicon (a-Si; amorphous silicon), micro silicon (μ-Si; microcrystalline silicon), and the like. Here, the absorption coefficient (cm ⁻¹ ) with respect to the photon energy (eV) of each silicon semiconductor exhibits characteristics as shown in FIG. 5, for example. Note that C-Si shown in FIG. 5 represents crystal silicon.

[Configuration example of backlight drive unit]
On the IC chip on the FPC connected to the display panel 1A or on the wiring of the TFT substrate 10, the above-described backlight driving unit 71 (see FIG. 2) is provided. The backlight drive unit 71 controls the brightness of the backlight (the brightness of the display light) based on the output from the photosensor 12B.

[Operation and effect of display device]
Next, functions and effects of the display device 1 will be described.

(Display operation)
First, the display operation of the display device 1 will be described with reference to FIGS. FIG. 6 is a schematic diagram for explaining image display using visible light L2. FIG. 7 is a schematic diagram for explaining the display operation principle in the FFS mode. FIG. 8 is an enlarged view of a cross-section of the main part of the liquid crystal element. 7 and 8, (A) shows the state of the liquid crystal element when no electric field is applied, and (B) shows the state of the liquid crystal element when the electric field is applied.

  In the display device 1, as shown in FIG. 6, in the effective display area B, when a driving voltage equal to or higher than a predetermined threshold voltage is supplied between the common electrode 14 and the pixel electrode 16A based on the image signal, A predetermined electric field is applied to the liquid crystal layer 30 to modulate the liquid crystal state. As a result, the visible light L2 incident on the liquid crystal layer 30 from the backlight 40 side through the polarizing plate 17 is modulated for each display pixel, and then passes through the corresponding color filters 22R, 22G, and 22B. The color display lights LR, LG, and LB are emitted above the polarizing plate 25. In this way, image display is performed in the image display area 30A of the effective display area B.

  Here, the display operation principle of the FFS mode described above will be described in detail with reference to FIGS. In FIG. 7, an alignment film 32 is formed so as to cover the pixel electrode 16 </ b> A composed of a plurality of subpixel electrodes 160, and the alignment film 33 is also formed on the substrate 21 (not shown in FIG. 7) side of the CF substrate 20. Is formed. Moreover, the case where the rubbing directions of the two alignment films 32 and 33 coincide with the transmission axis of the polarizing plate 25 on the emission side is shown.

  First, in a state where no voltage is applied between the common electrode 14 and the pixel electrode 16A (FIGS. 7A and 8A), the axis of the liquid crystal molecules 31 constituting the liquid crystal layer 30 is on the incident side. The state is perpendicular to the transmission axis of the polarizing plate 17 and parallel to the transmission axis of the polarizing plate 25 on the emission side. For this reason, incident light transmitted through the incident-side polarizing plate 17 reaches the output-side polarizing plate 25 without causing a phase difference in the liquid crystal layer 30 and is absorbed here, so that a black display is obtained.

  On the other hand, when a voltage is applied between the common electrode 14 and the pixel electrode 16A (FIGS. 7B and 8B), the orientation direction of the liquid crystal molecules 31 is a horizontal electric field generated between the sub-pixel electrodes 160. By E1, it rotates in an oblique direction with respect to the extending direction of the pixel electrode 16A. At this time, the electric field intensity at the time of white display is optimized so that the liquid crystal molecules 31 positioned at the center in the thickness direction of the liquid crystal layer 30 rotate about 45 degrees. As a result, the incident light h that has passed through the incident-side polarizing plate 17 becomes a linearly polarized light that is rotated by 90 degrees due to a phase difference while passing through the liquid crystal layer 30, and this linearly polarized light is converted into the polarizing plate 25 on the outgoing side. Since it passes, the white display.

(External light detection operation / display brightness control operation)
Subsequently, referring to FIGS. 9 and 10 in addition to FIGS. 2 and 6, the external light detection operation in the display device 1 and the display luminance control operation in accordance with the external light illuminance are compared with the comparative example. The details will be described. FIG. 9 schematically illustrates a cross-sectional configuration of the display panel 100A in the display device according to the comparative example. FIG. 10 shows an example of the transmittance of the green color filter 22G (“Green CF” shown in the figure) and a human visibility curve y (λ).

  First, in the display panel 1A of the present embodiment, as shown in FIG. 6, when the external light L0 is incident on the green color filter 22G in the effective display area B, the transmitted light from the green color filter 22G is , (Green light LG + infrared light LIR).

  Similarly, in the display panel 100A of the comparative example, as shown in FIG. 9, when the external light L0 is incident on the green color filter 22G in the effective display area B, the transmitted light from the green color filter 22G is transmitted. Becomes (green light LG + infrared light LIR). However, unlike the present embodiment, since the infrared light shielding spacer 50 is not provided between the green color filter 22G and the photosensor 12B, the transmitted light from the green color filter 22G remains as it is in the photosensor. It enters 12B.

  Here, as shown in FIG. 10, the transmittance of the green color filter 22G has a shape close to the visibility curve y (λ) in the visible light region, but in the near-infrared region, the visibility curve. The transmittance is higher than y (λ). Therefore, in the display panel 100A of this comparative example, when light such as sunset, incandescent lamp, infrared remote controller or the like with many near infrared light components enters the photosensor 12B, the illuminance value is higher than actual. Then, when measuring the illumination intensity of external light and controlling the display brightness, there arises a problem that the display brightness is increased more than necessary.

  On the other hand, in the display panel 1A of the present embodiment, as shown in FIG. 6, an infrared shielding spacer 50 that shields the infrared light LIR is disposed between the TFT substrate 10 and the CF substrate 20. Yes. As a result, as indicated by the arrow and the curve P2 in FIG. 10, the transmittance in the infrared region is reduced, and detection of the infrared light LIR by the photosensor 12B is reduced or avoided.

  Further, in the display panel 1A, such an infrared light shielding spacer 50 is selectively provided in a region corresponding to at least one photosensor 12B. Accordingly, even if the infrared light shielding spacer 50 shields part of the visible light, the arrangement region of the infrared light shielding spacer 50 is a non-opening portion, so that the entire display screen is shielded. Compared with the case where the layer is provided, the adverse effect on the display light is reduced.

  As described above, in the present embodiment, since the infrared light shielding spacer 50 that shields the infrared light LIR is provided between the TFT substrate 10 and the CF substrate 20, the infrared light LIR of the photosensor 12B is reduced. Detection can be reduced or avoided. Therefore, even when the external light L0 contains a large amount of infrared light LIR, it is possible to reduce the decrease in illuminance measurement accuracy (decrease in light detection accuracy) caused by such infrared light LIR. it can. In addition, since such an infrared light shielding spacer 50 is selectively provided in a region corresponding to at least one photosensor 12B, the infrared light shielding spacer 50 temporarily shields part of visible light. Even in this case, adverse effects on the display light can be suppressed. Therefore, it is possible to reduce deterioration in illuminance measurement accuracy (decrease in light detection accuracy) caused by infrared light while suppressing deterioration in display image quality such as luminance reduction and color shift.

  Further, since the backlight drive unit 71 controls the brightness of the backlight 40 (the brightness of the display light) based on the output of the photosensor 12B, the illuminance measurement accuracy decreases due to infrared light (light detection). It is possible to set an appropriate display luminance corresponding to the illuminance of outside light while suppressing (decrease in accuracy).

[Modification 1]
Next, a modified example (modified example 1) of the display panel of the display device 1 according to the first embodiment will be described. The same components as those in the first embodiment are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  FIG. 11 illustrates a schematic cross-sectional configuration in the vicinity of the boundary between the frame area A and the effective display area B in the display panel 1B according to the first modification. In the present modification, the common electrode 34 is disposed on the color filter 22 in the CF substrate 20B, and thus the driving mode of the liquid crystal element is different, which is the same as in the display device 1 of the first embodiment. It has a configuration.

  That is, in the present modification, the TFT substrate 10A is configured such that the pixel electrode 16B is disposed on the planarization layer 13 on the substrate 11, and the pixel electrode 16B is opposed to the common electrode 34 via the liquid crystal layer 30-1. It has become. Note that, unlike the pixel electrode 16A described in the first embodiment, the pixel electrode 16B is a single electrode provided for each pixel. In such a configuration, various modes such as TN (twisted nematic), VA (vertical alignment), or ECB (electric field control birefringence) are used as the liquid crystal layer 30-1.

  As described above, the liquid crystal element for display is not limited to the transverse electric field mode such as the FFS mode as described above, and liquid crystal elements in various driving modes can be used. Even in the case of such a configuration, an effect equivalent to that of the first embodiment can be obtained.

<2. Second Embodiment>
FIG. 12 shows a schematic cross-sectional structure near the boundary between the frame area A and the effective display area B in the display device 3 according to the second embodiment of the present invention. In addition, about the component similar to the display apparatus 1 of the said 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted suitably.

  In the display panel 3A in the display device 3 of the present embodiment, in the effective display area B, the photosensors 12B (first to third light detection elements) are arranged to face the color filters 22R, 22G, and 22B of the respective colors. Has been. The infrared light shielding spacers 50 described in the first embodiment are selectively disposed between the color filters 22R, 22G, and 22B of the respective colors and the photosensors 12B that face the color filters 22R, 22G, and 22B. .

  In this embodiment, an image generation unit 72 is provided instead of the backlight drive unit 71 described in the first embodiment. The image generation unit 72 generates a color image based on each output of the photosensor 12B obtained by detecting external light L0 or reflected light of display light. In addition, about another structure, it is the structure similar to the display apparatus 1 of 1st Embodiment.

  With such a configuration, the display device 3 functions as a color image sensor or a color scanner.

  Incidentally, for example, as shown in FIG. 13, the color filters 22R, 22G, and 22B each transmit the infrared light LIR. Therefore, in the display device 3 according to the present embodiment, as described above, the infrared light shielding spacer 50 is selectively provided between the color filters 22R, 22G, and 22B of the respective colors and the photosensors 12B that face the color filters 22R, 22G, and 22B. It is arranged. Therefore, the detection of the infrared light LIR by each photosensor 12B is reduced or avoided while the adverse effect on the display light is suppressed by the same operation as in the first embodiment.

  As described above, in the present embodiment, such an infrared light shielding spacer 50 is selectively provided. Therefore, even when the external light L0 is used as the light source of the color image sensor, infrared light is used. It becomes possible to prevent color degradation due to the influence of the light LIR.

  Further, when used as a color scanner, even when a strong Xe flash lamp or the like is used as a light source of the backlight 40, color deterioration due to the infrared light component of the backlight light can be prevented. It becomes possible.

<3. Third Embodiment>
FIG. 14 shows a schematic cross-sectional configuration in the vicinity of the boundary between the frame area A and the effective display area B in the display device 4 according to the third embodiment of the present invention. The same components as those of the display devices of the first and second embodiments are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  The display panel 4A in the display device 4 of the present embodiment includes a TFT substrate 10C and a CF substrate 20C.

  In the TFT substrate 10C, the photosensor 12B (first to third light detection elements) is arranged in the frame region A so as to face the color filters 22R, 22G, and 22B of the respective colors. Infrared light shielding spacers 50 are selectively disposed between the color filters 22R, 22G, and 22B of the respective colors and the photosensors 12B facing the color filters 22R, 22G, and 22B, respectively.

  On the other hand, in the CF substrate 20C, the metal black 24C configured to be able to reflect the external light L0 and the display light is uniformly provided in the frame region A. The metal black 24C is made of, for example, metal black, and the observation side (display screen side) is subjected to low reflection processing to prevent reflection, while the TFT substrate 10C side uses metal as it is and is highly reflective. To have a rate.

  In the present embodiment, a backlight drive unit 71 is provided as in the first embodiment. However, in the backlight drive unit 71 (display control unit) of the present embodiment, as shown in FIG. 14, the reflected light from the metal black 24C through the color filters 22R, 22G, and 22B of the display light is reflected. Each output of the photosensor 12B obtained by the detection is input. Based on each output, the color balance of the display light is controlled. That is, the display device 3 of the present embodiment functions as a display device having a display color balance sensor.

  The reason for controlling the color balance and the like of the display light is as follows. That is, when a system for lighting LEDs of each color of R, G, and B is used as a backlight of a liquid crystal display device, the white balance is shifted over time due to the temperature dependence of the luminous efficiency of each color LED and the lifetime. Is a problem. Therefore, as in the present embodiment, the luminance of each color of the R, G, B display light is measured, and the result is fed back to the supply current of the backlight LED to reduce or avoid such a problem. can do.

  Here, as described above, the color filters 22R, 22G, and 22B each transmit the infrared light LIR. Therefore, in the display device 4 according to the present embodiment, as described above, the infrared light shielding spacer 50 is selectively provided between the color filters 22R, 22G, and 22B of the respective colors and the photosensors 12B that face the color filters 22R, 22G, and 22B. It is arranged.

  As described above, in the present embodiment, such an infrared light shielding spacer 50 is selectively provided. Therefore, even when the backlight 40 has a light emitting component in the infrared region, R, It becomes possible to correctly measure the luminance of each color of G and B. Therefore, it is possible to accurately control the color balance of display light.

  Next, modified examples (modified examples 2 and 3) of the display device 4 according to the third embodiment will be described. In addition, the same code | symbol is attached | subjected about the component similar to the said 1st-3rd embodiment, and description is abbreviate | omitted suitably.

[Modification 2]
FIG. 15 illustrates a schematic cross-sectional configuration near the boundary between the frame area A and the effective display area B in the display device 4D according to the second modification. The display panel 4B in the display device 4D of this modification includes a TFT substrate 10D, a CF substrate 20D, and a backlight driving unit 71, and functions as a display device having a display color balance sensor. . The difference from the third embodiment is that each photosensor 12B as a color balance sensor and the corresponding infrared light shielding spacer 50 are arranged in the effective display area B instead of the frame area A. Is a point. Accordingly, the metal black 24C is selectively provided not only in the frame area A but also in an area corresponding to the photosensor 12B in the effective display area B. In addition, about another structure, it is the structure similar to the display apparatus 4 of 3rd Embodiment.

  With this configuration, in the present modification, the photosensors 12B as color balance sensors and the corresponding infrared light shielding spacers 50 are arranged in the effective display area B. Therefore, the following effects are obtained. Is obtained. That is, in addition to the effects of the third embodiment, the frame area is enlarged even when the frame area is limited and the distribution of the backlight light becomes a problem under the frame, as in the liquid crystal display device for mobile use. It is possible to measure the luminance of each color without doing so.

[Modification 3]
FIG. 16 illustrates a schematic cross-sectional configuration near the boundary between the frame area A and the effective display area B in the display device 4E according to the third modification. A display panel 4C in the display device 4E of the present modification includes a TFT substrate 10E and a CF substrate 20E. In addition, the display device 4E includes a backlight driving unit 71. The display device 4E of the present embodiment measures the illuminance of external light to control the display luminance, and functions as a display device having a display color balance sensor. Specifically, in the display device 4 according to the third embodiment shown in FIG. 14, in the frame area A, the green color filter 22 </ b> G and the infrared light shielding are opposed to the photosensor 12 </ b> B that functions as an illuminance sensor. A spacer 50 is provided. Further, in this region within the frame region A, the metal black 24C is selectively removed. In addition, about another structure, it is the structure similar to the display apparatus 4 of 3rd Embodiment.

  With such a configuration, in this modification, such an infrared light shielding spacer 50 is arranged in the frame region A. Therefore, when measuring the illuminance of external light and controlling the color balance of display light, Illuminance measurement accuracy can be improved.

  Since the three-color LED used in the liquid crystal display device often does not contain an infrared light component, an infrared light shielding spacer may be provided only in the external light illuminance sensor portion.

<4. Fourth Embodiment>
FIG. 17 shows a schematic cross-sectional configuration near the boundary between the frame area A and the effective display area B in the display device 5 according to the fourth embodiment of the present invention. In addition, about the component similar to the display apparatus of the said 1st-3rd embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted suitably.

[Example of overall configuration of display device]
The display device 5 of the present embodiment includes a display panel 5A having a TFT substrate 10F and a CF substrate 20F. Further, in the display device 5, a backlight 40F is provided instead of the backlight 40 described so far. Further, the display device 5 includes a light receiving drive unit 73, an image processing unit 74, and an object information calculation unit 75 which will be described later. With such a configuration, the display device 5 functions as an optical touch panel that acquires object information including at least one of the position, shape, and size of an object close to the display panel 5A.

  The backlight 4 </ b> F is a light source that illuminates the display panel 5 </ b> A, and the light emission surface thereof is disposed so as to face the entire effective display area B and the frame area A. The backlight 40F emits invisible light (infrared light LIR) in addition to visible light L2. In other words, the detection light for object detection made of infrared light LIR is emitted from the display surface side of the CF substrate 20F together with the display light made of visible light L2.

  Note that such invisible light (infrared light LIR) is light other than visible light, that is, light having a wavelength other than a wavelength range sensitive to human eyes (for example, 380 nm to 780 nm). Here, visible light is used. Infrared light on the longer wavelength side is used. As infrared light, it is desirable to use light in the near infrared region (780 nm to 1100 nm) that matches the sensitivity of the Si photodiode. The polarizing plates 17 and 25 provided on both surfaces of the display panel 5A have polarization characteristics in the visible and near-ultraviolet regions, while the polarization properties are lost in the near-infrared region, thereby suppressing reduction in the amount of detected light. This is because it does not depend on image light. That is, when a liquid crystal element that requires a polarizing plate is used as in this embodiment, it is desirable to use near infrared light as invisible light.

  FIG. 18 schematically shows a cross-sectional configuration of the backlight 40F. As described above, the backlight 40F includes, for example, the infrared light source 42A that emits the infrared light LIR and the visible light source 42B that emits the visible light L2 at both end positions of the flat light guide plate 41. . As the infrared light source 42A and the visible light source 42B, for example, LEDs can be used. With such a configuration, the infrared light LIR emitted from the infrared light source 42A and the visible light L2 emitted from the visible light source 42B propagate through the light guide plate 41, and then are extracted from one surface on the TFT substrate 10 side. It is supposed to be.

  In the TFT substrate 10F, two types of photosensors 12B1 and 12B2 are provided in the effective display area B. Among these photosensors, the photosensor (main sensor; main detection element) 12B1 is disposed in a region corresponding to an infrared transmission black 23 described later. On the other hand, the photosensor (auxiliary sensor; auxiliary detection element) 12B2 is provided in a part of the area corresponding to the blue color filter 22B (here, every other area), that is, in an area corresponding to an infrared light shielding spacer 50B described later. Is arranged. In the present embodiment, as the photosensors 12B1 and 12B2, polysilicon having a sensitivity in the region S (1.0 eV to 1.6 eV) corresponding to the infrared light shown in FIG. Above) or micro silicon (particle size: several tens of nm or more) is preferably used.

(Example of arrangement of main sensor 12B1 and auxiliary sensor 12B2)
Here, a detailed configuration example of each pixel in the effective display area B of the display panel 5A will be described with reference to FIGS. FIG. 19 schematically shows a pixel arrangement example in the effective display area B of the display panel 5A in a plan view. FIG. 20 schematically shows an arrangement example of the main sensor 12B1 and the auxiliary sensor 12B2 in the effective display area B of the display panel 5A in a plan view.

  As shown in FIG. 19, the pixel 51 in the effective display area B is composed of a display pixel 51RGB and an imaging pixel (light receiving unit) in which two types of photosensors 12B1 and 12B2 are arranged. The display pixel 51RGB is composed of a display pixel 51R for red (R), a display pixel 51G for green (G), and a display pixel 51B for blue (B). The imaging pixel includes a main sensor arrangement area 521 and an auxiliary sensor arrangement area 522. In FIG. 19, one sensor arrangement area is provided for one display pixel 51RGB, but one sensor arrangement area may be provided for a plurality of display pixels 51RGB.

  Such main sensor 12B1 (main sensor arrangement area 521) and auxiliary sensor 12B2 (auxiliary sensor arrangement area 522) are each within the effective display area B as shown in FIGS. 20 (A) and 20 (B). It is preferable that they are alternately arranged at a ratio of one to one. However, you may arrange | position so that the number of auxiliary sensors 12B2 may become smaller than the number of main sensors 12B1. In this case, since it is necessary to perform interpolation processing on the output signal from the auxiliary sensor 12B2, it is necessary to consider whether detection omission becomes a problem depending on the type of signal and application as well as the processing becomes complicated. In FIG. 20, the display pixels 31RGB are not shown for convenience of explanation.

  In the CF substrate 20F, an infrared transmission black 23 is provided in an area corresponding to the main sensor 12B1 in the same layer as the color filter 22 in the effective display area B. As shown in FIG. 17, the infrared transmission black 23 (infrared transmission layer) blocks visible light L2 and transmits infrared light LIR. However, the infrared light LIR may be selectively transmitted even if the visible light L2 is not completely blocked.

(Infrared light transmission black 23)
As the infrared light transmitting black 23, for example, a pigment dispersion resist in which a pigment that selectively transmits and blocks light in a specific wavelength region is dispersed in a photosensitive resist material can be used. Examples of the resist material include acrylic, polyimide, and novolak. Examples of the pigment include a pigment-dispersed resist that has heat resistance and light resistance in a manufacturing process and has a property of transmitting near-infrared light. Specifically, among azo pigments showing red, yellow and orange, phthalocyanine pigments showing blue and green, and dioxazine pigments showing purple (Violet) Including at least one kind. Alternatively, it can be realized by overlapping two or more layers of R, G, B color filters used as color filters. Such a pigment-dispersed resist can be formed by applying on the substrate 21 and then undergoing processes such as exposure, development, and baking.

  FIG. 21 shows an example of the transmission characteristics of the infrared light transmission black 23. Here, a near infrared LED having an emission center wavelength of 850 nm is used as a light source that emits infrared light LIR. The infrared light transmitting black 23 uses a pigment dispersion resist in which a copper phthalocyanine compound (blue, green) and an azo pigment (red) compound organic pigment are dispersed in an acrylic photosensitive resist. As shown in FIG. 21, in the infrared light transmitting black 23 thus produced, visible light L2 is slightly transmitted, but it is understood that infrared light LIR is selectively transmitted. .

(Configuration example of wavelength region in light source and light receiving sensor)
Next, a configuration example of the wavelength region in the light source and the photosensor will be described with reference to FIGS. 22 shows the emission wavelength region (FIG. 22A) of the detection light source (infrared light source 42A in the backlight 40F) and the detection wavelength regions of the main sensor 12B1 and auxiliary sensor 12B2 (FIGS. 22B and 22C). )) Is an example of the relationship.

  First, as indicated by reference numeral G21 in FIG. 22B, in the main sensor 12B1, the light reception wavelength region is a wavelength region on the long wavelength side of the wavelength λ1 or more. This is because, as shown in FIG. 17, an infrared transmission black 23 that transmits infrared light LIR and blocks visible light L2 is selectively provided in a region corresponding to the main sensor 12B1. is there. Therefore, the main sensor 12B1 includes the wavelength region Δλ23 (wavelength region of wavelengths λ2 to λ3) of the infrared light LIR for detection indicated by the symbol G1 in FIG. It functions as a photosensor for object detection.

  On the other hand, as indicated by reference numeral G31 in FIG. 22C, in the auxiliary sensor 12B2, the light reception wavelength region is a wavelength region on the short wavelength side of the wavelength λ2 or less. This is because the infrared light shielding spacer 50B is selectively disposed in the region corresponding to the auxiliary sensor 12B2, as shown in FIG. Therefore, in this auxiliary sensor 12B2, the light receiving sensitivity in the wavelength region Δλ23 of the detection infrared light LIR is lower than that in the main sensor 12B1 (here, the light reception in the wavelength region Δλ23 of the detection infrared light LIR). Sensitivity is 0 (zero)). Thereby, the auxiliary sensor 12B2 functions as a photosensor for detecting a false signal described later. Here, the wavelength region Δλ12 (wavelength region of wavelengths λ1 to λ2) is a light receiving wavelength region by both the main sensor 12B1 and the auxiliary sensor 12B2.

  Here, the main sensor 12B1 includes the wavelength region of the infrared light LIR for detection as the light reception wavelength region, and the auxiliary sensor 12B2 includes, for example, the wavelength region of the visible light L2 as the light reception wavelength region. That's fine. However, the relationship between the wavelength region of the infrared light LIR for detection and the light receiving wavelength regions of the main sensor 12B1 and the auxiliary sensor 12B2 is not limited to this. However, it should be noted that the light receiving wavelength region of the auxiliary sensor 12B2 preferably does not include the wavelength region of the infrared light LIR for detection, but external light that can be received by the main sensor 12B1. With respect to the wavelength of, the light can be received. This is because, as will be described later, the role of the auxiliary sensor 12B2 is to detect a false signal caused by the external light L0 incident on the main sensor 12B1.

  The light receiving wavelength region of the main sensor 12B1 may be the one indicated by the symbol G22 in FIG. 22B. Similarly, the light receiving wavelength region of the auxiliary sensor 12B2 is the symbol G32 in FIG. 22C. It may be shown by. In this case, the wavelength region Δλ12 (wavelength region of wavelength λ1 to wavelength λ2) and the wavelength region Δλ34 (wavelength region of wavelength λ3 to wavelength λ4) are light reception wavelength regions by both the main sensor 12B1 and the auxiliary sensor 12B2.

  In FIG. 22, as shown in FIG. 23A, the wavelength region Δλ12 (wavelength region of wavelength λ1 to wavelength λ2) and the wavelength region Δλ34 (wavelength region of wavelength λ3 to wavelength λ4) are connected to the main sensor 12B1 and It is a light receiving wavelength region by both of the auxiliary sensors 12B2. However, for example, as shown in FIG. 23B, the light receiving wavelength region of the main sensor 12B1 and the light receiving wavelength region of the auxiliary sensor 12B2 may be separated from each other. It can be said that it is preferable.

(Light receiving drive unit 73, image processing unit 74, object information calculation unit 75)
The light reception driving unit 73 shown in FIG. 17 performs light reception driving of the display panel 5A so that a light reception signal can be obtained from each of the photosensors 12B1 and 12B2 of the display panel 5A (so as to image an object). .

  The image processing unit 74 generates a composite image, which will be described later, by performing predetermined image processing (image generation processing) on the output (light reception signal) from the light reception driving unit 73. The generated composite image is stored in a frame memory (not shown), for example, in units of frames, and is output to the object information calculation unit 75 as a captured image. Details of such image generation processing will be described later.

  The object information calculation unit 75 performs predetermined image processing (calculation processing) based on the captured image (composite image) output from the image processing unit 74, and object information (positional coordinate data, the shape and size of the object) regarding the proximity object. Data relating to the thickness, etc.) is detected and acquired. The details of the detection process will be described later.

[Operation and effect of display device]
Next, the operation and effect of the display device 5 will be described.

(Basic operation when acquiring object information)
First, with reference to FIG. 17, the basic operation when acquiring object information in the display device 5 will be described. Note that the display operation in the display device 5 is the same as that of the display device described so far, and thus the description thereof is omitted.

  In the display device 5, an image is displayed in the effective display area B based on the visible light L2 emitted from the backlight 40F. On the other hand, the infrared light LIR from the backlight 40F is sequentially transmitted through the polarizing plate 17, the TFT substrate 10F, the liquid crystal layer 30, the CF substrate 20F, and the polarizing plate 25. At this time, the infrared light LIR passes without being blocked by the liquid crystal layer 30, the color filter 22, and the infrared light transmitting black 23.

  Here, for example, when an object such as a finger (not shown in FIG. 17) is placed on (in contact with) the upper surface of the display panel 5A (the upper surface of the polarizing plate 25), the red light emitted above the polarizing plate 25 is emitted. The external light LIR is diffusely reflected on the surface of the object. The reflected light (including external light) L3 is received by the photosensors (main sensor, auxiliary sensor) 12B1 and 12B2 disposed on the TFT substrate 10F, so that the light receiving drive unit 73 has the light intensity of the object. Get information about the distribution. Specifically, the light reception drive unit 73 accumulates the light reception signals of the pixels for one frame and outputs them to the image processing unit 74 as a captured image. Then, after predetermined image processing, which will be described later, is performed in the image processing unit 74, the object information calculation unit 75 calculates the center of gravity coordinates of the object based on the captured image after such image processing, whereby the object The position of is determined. Thereby, information (position coordinate data, data on the shape and size of the object, etc.) related to the proximity object is acquired based on the captured image after the image processing.

(Basic operations for differential image position determination processing)
Next, with reference to FIGS. 24 to 28, basic operations in the position determination process (difference image position determination process) using the difference image by the light receiving drive unit 73, the image processing unit 74, and the object information calculation unit 75. Will be described. FIG. 24 is a flowchart showing the difference image position determination process, and FIG. 25 is a timing diagram showing a part of the difference image position determination process. In FIG. 25, (A) shows the on / off state of the backlight 40F, (B) shows the reading (scanning) timing of the sensor output signal, (C) shows the waveform of the sensor output signal, and (D) shows the image processing. Each state is shown. Timing t0 indicates when the ON scan is completed and OFF integration is started, timing t1 indicates when the OFF integration is completed and OFF scan starts, and timing t2 indicates when the OFF scan is completed and ON integration is started. Yes. Timing t3 indicates when ON integration is completed and ON scan starts, timing t4 indicates when ON scan is completed and difference image position determination processing starts, and timing t5 indicates when difference image position determination processing is completed. ing.

  First, in the differential image position determination process, as shown in FIG. 25, in the first half period of each display 1 frame period, the infrared light source 42A of the backlight 40F is turned off (off), and the detection red color is detected. External light LIR is not emitted. On the other hand, in the latter half of each display 1 frame period, the infrared light source 42B is turned on (ON), and the infrared light LIR for detection is emitted. That is, the first half period of each display 1 frame period is a non-light period (off period) in which the detection infrared light LIR is not emitted from the display device 5, while the second half period of each display 1 frame period is the display device 5. It is a light period (ON period) during which infrared light LIR for detection is emitted from. At these timings, a signal synchronized with the display output from the light receiving drive unit 73 is supplied to the gate line of the sensor gate 131 and the sensor signal line 136 (see FIG. 4) existing on the TFT substrate 10F in the display panel 5A. Is controlled.

First, in the off period, which is the first half of the display 1 frame period, light based on reflected light L3 (= visible light L2) and external light L0 of the object is incident on the photosensors 12B1 and 12B2 in the display panel 5A. ⁺ Accumulated as a change in potential of the auxiliary capacitor connected to the doped layer 132A (period t0 to t1 in FIG. 25). Next, this auxiliary capacitance potential is sequentially read out for each sensor gate line via a readout circuit (not shown) (period t1 to t2 in FIG. 25), and is a captured image of the object in the off period. An off image Aoff (shadow image) is acquired (step S11 in FIG. 24).

Next, similarly, in the ON period which is the latter half of the display 1 frame period, the reflected light L3 (= visible light L2 + infrared light LIR) of the object and the external light L0 are applied to the photosensors 12B1 and 12B2 in the display panel 5A. And is accumulated as a change in potential of the auxiliary capacitor connected to the P ⁺ doped layer 132A (period t2 to t3 in FIG. 25). Next, this auxiliary capacitance potential is sequentially read out for each sensor gate line via a readout circuit (not shown) (period t3 to t4 in FIG. 25), and is a captured image of the object in the on period. An on image Bon (an image using reflected light) is acquired (step S12 in FIG. 24).

  Next, the image processing unit 74 generates a difference image C between the on image Bon and the off image Aoff (step S13 in FIG. 24).

  Next, the object information calculation unit 75 performs calculation processing for determining the center of gravity based on the generated difference image C (step S14), and specifies the center of contact (proximity) (step S15, timing t4 in FIG. 25). ~ T5 period). At this time, the object information calculation unit 75 calculates the center-of-gravity coordinates G of the object based on the difference image C.

  Specifically, in the image signal (digital) of the difference image C, an area having a value equal to or larger than a certain threshold value is binarized as shown in FIG. After removing noise from the binarized difference image, the center-of-gravity coordinates G of the object are calculated by calculating the average value of the x and y values of the center coordinates. For example, the x coordinate group is (4, 3, 4, 5, 2, 3, 4, 5, 6, 3, 4, 5, 4), and the y coordinate group is 4, 3, 4, 5, 2, 3, In the case of 4, 5, 6, 3, 4, 5, 4), these center coordinates are (x, y) = (4, 4). In this way, the position of the object is determined.

  Further, the object information calculation unit 75 may calculate the contact area of the object based on the difference image C. For example, by identifying the photosensors 12B1 and 12B2 that show a value equal to or higher than a predetermined threshold from the intensity distribution in the difference image C, the contact area can be obtained from the number of the identified photosensors 12B1 and 12B2, the installation interval, and the like. Is possible. Information regarding the contact area calculated in this way can be used to determine whether the object in contact is a finger or a pen. In addition, the present invention can also be used for an application that determines that the touch input is not a finger or a pen when the contact area greatly exceeds a predetermined reference value. For example, it is possible to prevent erroneous input such as when stored in a pocket or bag or when the display device 5 is used as a mobile phone and the ear is brought close to the display portion.

  In this way, in the differential image position determination process, the difference between the on image Bon using the detection infrared light LIR and the off image Aoff using the external light L0 without using the detection infrared light LIR. Based on the image C, object information acquisition processing (position determination processing) is performed. Thereby, the object is detected after the influence of the external light L0 is removed. Simultaneously with such external light removal, it is possible to remove fixed noise caused by variations in characteristics of the photosensors 12B1 and 12B2.

  Specifically, for example, as shown in the cross-sectional view of FIG. 27A, when the incident external light L0 is strong, the received light output voltage Von1 in the on period is as shown in FIG. become. That is, the voltage value Va corresponds to the brightness of the external light L0 except for the part touched by the object (finger) f. On the other hand, at the part touched by the finger f, the surface of the finger f touched at that time is back. The voltage decreases to a voltage value Vb corresponding to the reflectance for reflecting the light from the light 40F. On the other hand, the light reception output voltage Voff1 in the off period is the same in that the voltage value Va corresponds to the brightness of the external light L0 except where it is touched with the finger f. In the place, the external light L0 is blocked, and the voltage value Vc is very low.

  In addition, as shown in the cross-sectional view of FIG. 28A, in the state where the incident external light L0 is weak (almost), the received light output voltage Von2 in the on period is as shown in FIG. Become. That is, the voltage value Vc is very low because there is no external light L0 except at the position touched by the finger f. On the other hand, at the position touched by the finger f, the back surface is touched by the surface of the finger f touched at that time. The voltage rises to a voltage value Vb corresponding to the reflectivity for reflecting the light from the light 40F. On the other hand, the received light output voltage Voff2 during the off period remains at a very low voltage value Vc at both the part touched by the finger f and the other part and remains unchanged.

  As can be seen from a comparison of FIGS. 27 and 28, the light receiving output voltage is greatly different between the case where the finger f is not in contact and the case where the external light L0 is present. However, the voltage value Vb during the on period and the voltage value Vc during the off period are substantially the same regardless of the presence or absence of the external light L0 where the finger f is in contact.

(Differential image position determination processing when the object is moving)
Next, with reference to FIG. 29 to FIG. 35, the difference image position determination process in the case where the object is moving, which is one of the characteristic parts of the present invention, will be described in comparison with a comparative example.

  First, in the comparative example shown in FIG. 29 and FIG. 30, when the object is moving on the effective display area B of the display panel 5A as shown by the arrow in FIG. As described above, when the external light L0 has an infrared light component, the following problems occur. That is, there is a position shift in the portion corresponding to the object between the light reception output signal Voff (A101) in the off image Aoff101 and the light reception output signal Von (B101) in the on image Bon101. Thereby, in the difference image C101 (= Bon101−Aoff101) between the two images Aoff101 and Bon101 and the light reception output signal V (C101) (= Von (B101) −Voff (A101)), the original corresponding to the position of the object is obtained. In addition to the signal, a false signal F101 is generated at another position. Therefore, the presence of such a false signal F101 makes it difficult to stably detect an object.

  In contrast, in the present embodiment, the object information calculation unit 75 acquires object information using a composite image based on a captured image obtained by the main sensor 12B1 and a captured image obtained by the auxiliary sensor 12B2. Specifically, the image processing unit 74 generates a difference image C (= Bon−Aoff) between the on image Bon and the off image Aoff corresponding to each of the main sensor 12B1 and the auxiliary sensor 12B2. That is, the difference image MC (= MBon−MAoff; first difference image) between the on image MBon and the off image MAoff at the main sensor 12B1, and the difference image HC between the on image HBon and the off image HAoff at the auxiliary sensor 12B2. (= HBon−HAoff; second difference image) are respectively generated. And the object information calculating part 75 acquires object information using the synthetic | combination image F based on the difference image MC in this main sensor 12B1, and the difference image HC in auxiliary sensor 12B2.

  More specifically, in the image captured by the main sensor 12B1, for example, as shown in FIGS. 31 and 32, the difference image MC is generated. That is, when the external light L0 includes light in a wavelength region sensitive to the main sensor 12B1 (for example, when light including a wavelength region Δλ23, a halogen lamp, sunlight, or the like is incident), the object is displayed on the display panel 5A. In the case of moving above, in the difference image MC, a false signal F101 derived from the movement of the shadow image is generated in addition to the object detection signal, as in the comparative example. In other words, in the difference image MC between the images MAoff and MBon and the light reception output signal V (MC) (= Von (MB) −Voff (MA)), in addition to the original signal corresponding to the position of the object, another position is provided. Produces a false signal F101.

  On the other hand, in the image captured by the auxiliary sensor 12B2, for example, as shown in FIGS. 33 and 34, the difference image HC is generated. First, in the auxiliary sensor 12B2, the light receiving sensitivity in the wavelength region of the infrared light LIR for detection is lower than that of the main sensor 12B1 (here, 0). Therefore, in the difference image HC, the false signal F101 is generated as in the case of the main sensor 12B1, while the generation of the object detection signal is suppressed (in this case, avoided). In other words, the false signal F101 is generated in the difference image HC between the images HAoff and HBon and the received light output signal V (HC) (= Von (HB) −Voff (HA)), while the original image corresponding to the position of the object is generated. Generation of signals is suppressed (in this case, avoided).

  Next, the image processing unit 74 generates a predetermined mask image E based on the difference image HC obtained by the auxiliary sensor 12B2, for example, as shown in FIG. Further, the image processing unit 74 generates these composite images F by taking a logical product of the difference image MC obtained by the main sensor 12B1 and the generated mask image E. Then, the object information calculation unit 75 acquires object information using the composite image F. At this time, the image processing unit 74 can generate the mask image E by performing, for example, binarization processing and image inversion processing on the difference image HC. Specifically, as the binarization processing, a received light signal having a certain value (threshold value) or more in the difference image HC may be regarded as a false signal and converted into an image that masks the false signal portion. .

  Here, the signal exceeding the threshold is set as a false signal because the spectral characteristics cannot be completely separated depending on the effect of noise on the panel and the performance of the auxiliary sensor 12B2, and the detection signal is slightly This is because the difference image HC on the auxiliary sensor 12B2 side may also appear. Minimizing the leakage of the detection signal to the auxiliary sensor 12B2 improves the performance of this method. Specifically, the wavelength region Δλ23 of the infrared light LIR for detection is limited, and the auxiliary sensor 12B2 is designed to have as low a sensitivity as possible to the wavelength region Δλ23 of the infrared light LIR for detection. Further, since the auxiliary sensor 12B2 detects a false signal generated by the external light L0, the sensitivity is improved by increasing the sensitivity to the external light L0 relative to the wavelength sensitivity of the infrared light LIR for detection. It leads to things. In realizing such performance, the infrared light shielding spacer of the present invention plays an effective role.

  In addition to the method of generating the composite image F using such a mask image E, for example, a difference image (= MC−HC) between the difference image MC and the difference image HC is used as the composite image F. May be.

  In this way, object information is acquired using the composite image F based on the difference image MC obtained by the main sensor 12B1 and the difference image HC obtained by the auxiliary sensor 12B2. Thereby, for example, even when an object is moving on the effective display area B of the display panel 5A, generation of a false signal in the composite image F is suppressed (or avoided).

  As described above, in the present embodiment, a plurality of main sensors 12B1 including the wavelength region Δλ23 of the infrared light LIR for detecting the proximity object as the light receiving wavelength region are provided in the effective display region B of the display panel 5A. Yes. Further, a plurality of auxiliary sensors 12B2 having a light receiving sensitivity in the wavelength region of the infrared light LIR for detection lower than that of the main sensor 12B1 are provided. Specifically, in the present embodiment, the infrared light shielding spacer 50 is selected on the auxiliary sensor 12B2 as means for reducing the light receiving sensitivity in the wavelength region Δλ23 of the infrared light LIR in the auxiliary sensor 12B2. Are arranged. With such a structure, the influence of the infrared light shielding material on the display light is avoided, so the options for the infrared light shielding pigment are widened, and the sensitivity in the wavelength region Δλ23 of the auxiliary sensor 12B2 can be made almost zero. In this embodiment, the object information of the proximity object is acquired using the composite image F based on the difference image MC obtained by the main sensor 12B1 and the difference image HC obtained by the auxiliary sensor 12B2. . Therefore, for example, even when a proximity object is moving on the effective display area B of the display panel 5A, generation of a false signal in the composite image F can be suppressed, and the object can be stabilized regardless of use conditions. Can be detected. In addition, since it is possible in principle to cope with any false signal generation pattern, it can be operated satisfactorily under all external light conditions.

  In addition, since the optical position detection described in the present embodiment is performed by detecting light reflected from the surface of the object, the object moves away from the display screen or the module surface unlike the position detection such as the resistance type. The position can be detected even when it is present. That is, the position detection is possible not only when the object is in contact with the module surface, but also when the object is in proximity, as in the case of contact.

  In the present embodiment, the case has been described where object information is acquired using the composite image F based on the difference image MC obtained by the main sensor 12B1 and the difference image HC obtained by the auxiliary sensor 12B2. Object information may be acquired using this method. For example, as shown in FIGS. 36 and 37, a difference image MHC (=) between the on-image MBon (first on-image) in the main sensor 12B1 and the on-image HBoon (second on-image) in the auxiliary sensor 12B2. Object information may be acquired based on (MBon-HBon).

<5. Fifth embodiment>
FIG. 38 shows a schematic cross-sectional configuration near the boundary between the frame area A and the effective display area B in the display device 6 according to the fifth embodiment of the present invention. In addition, about the component similar to the display apparatus of the said 1st-4th embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted suitably.

[Example of overall configuration of display device]
In the display device 6 of the present embodiment, as an image display element (display pixel) in the effective display area B, for example, an organic EL element that generates electroluminescence of three primary colors of R, G, and B is used. This display device 6 has a configuration in which organic EL elements of respective colors formed on the TFT substrate 10G are sealed with a CF substrate 20G through a sealing layer 39. In addition, since the organic EL element is a self-luminous element, a light source for displaying an image is not particularly provided. The display device 6 includes a light emission drive unit 76 corresponding to the backlight drive unit 71 described in the third embodiment. With such a configuration, the display device 6 functions as a display device having a display color balance sensor, like the display device 4 of the third embodiment. This is because, in an organic EL element, white balance shifts with time due to temperature dependence of RGB light emission efficiency, lifetime, and the like. Therefore, such a problem can be reduced or avoided by measuring the luminance of each color of R, G, and B and feeding back the result to the supply current as in the present embodiment.

  In the TFT substrate 10G, the TFT 12A and the photosensor 12B are disposed in the frame region A on the substrate 11. The TFT 12A and the photosensor 12B are flattened by a flattening layer 38, and a pixel electrode 35 as an anode is provided for each pixel on the flattening layer 38. On each pixel electrode 35, a light emitting layer 36R that generates red light, a light emitting layer 36G that generates green light, and a light emitting layer 36B that generates blue light are sequentially provided in a matrix as a whole. ing. On these light emitting layers 36R, 36G, and 36B, a common electrode 37 as a cathode is formed in common for each pixel. Note that a hole injection layer or a hole transport layer may be provided between the pixel electrode 35 and the light emitting layers 36R, 36G, and 36B in common with each pixel. Further, an electron injection layer or an electron transport layer may be provided between the common electrode 37 and the light emitting layers 36R, 36G, and 36B in common for each pixel. Further, the pixel electrode 35 may function as a cathode, and the common electrode 37 may function as an anode.

  The light emitting layer 36 </ b> R includes a light emitting material having fluorescence or phosphorescence, and by applying an electric field, a part of holes injected from the pixel electrode 35 and one of electrons injected from the common electrode 37. Are recombined with each other to generate red light. Similarly, the light emitting layers 36G and 36B generate green or blue light by applying an electric field to recombine holes and electrons.

  As the light emitting layer 36R, for example, 4,4-bis (2,2-diphenylbinine) biphenyl (DPVBi) and 2,6-bis [(4′-methoxydiphenylamino) styryl] -1,5-dicyanonaphthalene ( BSN) is used. As the light emitting layer 36G, for example, a mixture of DPVBi and coumarin 6 is used. As the light emitting layer 36B, for example, DPVBi mixed with 4,4′-bis [2- {4- (N, N-diphenylamino) phenyl} vinyl] biphenyl (DPAVBi) is used.

  On the other hand, in the effective display area B, the TFTs 12A are arranged on the substrate 11 at a predetermined pitch, as in the third embodiment.

  The CF substrate 20G has a metal black 24 and color filters 22R, 22G, and 22B in the frame area A on one surface of the substrate 21 as in the third embodiment. The effective display area B includes color filters 22R, 22G, and 22B, as in the third embodiment. In the present embodiment, the color filter 22 is formed on the substrate 21, but the color filter 22 may not be provided in correspondence with the organic EL elements of the respective colors.

  The light emission drive unit 76 detects reflected light from the metal black 24C through the color filters 22R, 22G, and 22B in the display light, as in the backlight drive unit 71 of the third embodiment. Each output of the obtained photosensor 12B is input. Based on each output, the color balance of the display light is controlled.

[Operation and effect of display device]
In the display device 6 of the present embodiment, when a predetermined drive voltage is applied between the pixel electrode 35 and the common electrode 37 in the effective display region B, the light emission layers 36R, 36G, and 36B emit light of each color. Occurs and image display is performed. On the other hand, also in the frame region A, when a predetermined drive voltage is applied between the pixel electrode 35 and the common electrode 37, light emission of each color occurs in each light emitting layer 36R, 36G, 36B.

  At this time, in the present embodiment, as in the third embodiment, the infrared light shielding spacer 50R is provided between the color filters 22R, 22G, and 22B of the respective colors and the photosensors 12B that face the color filters 22R, 22G, and 22B. , 50G, 50B are selectively provided. Therefore, the detection of the infrared light LIR by each photosensor 12B is reduced or avoided by the same operation as in the first to third embodiments. Therefore, even when the light emitting layer 36 has a light emitting component in the infrared region, it is possible to correctly measure the luminance of each color of R, G, and B. Therefore, it is possible to accurately control the color balance of display light.

[Modification 4]
Note that, for example, a display device 6A (having the TFT substrate 10H and the CF substrate 20H) illustrated in FIG. 39 may have a configuration similar to that of the display device 4D according to the second modification illustrated in FIG. That is, the photosensor 12B and the infrared light shielding spacers 50G, 50B, and 50R are provided in the effective display area B instead of the frame area A, and the metal black 24C corresponds to the photosensor 12B in the effective display area B. You may make it selectively provide in an area | region.

<6. Application example to electronic equipment>
Next, with reference to FIGS. 40 to 43, application examples of the display device described in the above embodiment and modifications will be described. The display device in the above embodiment and the like can be applied to electronic devices in various fields such as a television device, a digital camera, a notebook personal computer, a mobile terminal device such as a mobile phone, or a video camera. In other words, the display device according to the above-described embodiment or the like can be applied to electronic devices in various fields that display an externally input video signal or an internally generated video signal as an image or video. In addition to the electronic devices described below, for example, an application like a surveillance camera is conceivable by taking advantage of the feature of the present invention in which only the reflected component by the detection light is extracted.

(Application example 1)
FIG. 40 illustrates an appearance of a digital camera to which the display device of the above-described embodiment or the like is applied. The digital camera includes, for example, a flash light emitting unit 410, a display unit 420, a menu switch 430, and a shutter button 440. The display unit 420 is configured by the display device according to the above-described embodiment and the like. Yes.

(Application example 2)
FIG. 41 illustrates the appearance of a notebook personal computer to which the display device of the above-described embodiment or the like is applied. The notebook personal computer has, for example, a main body 510, a keyboard 520 for inputting characters and the like, and a display unit 530 for displaying an image. The display unit 530 is a display according to the above-described embodiment and the like. It is comprised by the apparatus.

(Application example 3)
FIG. 42 shows the appearance of a video camera to which the display device of the above-described embodiment or the like is applied. This video camera includes, for example, a main body 610, a subject photographing lens 620 provided on the front side surface of the main body 610, a start / stop switch 630 at the time of photographing, and a display 640. And the display part 640 is comprised by the display apparatus which concerns on the said embodiment etc.

(Application example 4)
FIG. 43 shows an appearance of a mobile phone to which the display device of the above-described embodiment or the like is applied. For example, the mobile phone is obtained by connecting an upper housing 710 and a lower housing 720 with a connecting portion (hinge portion) 730, and includes a display 740, a sub-display 750, a picture light 760, and a camera 770. Yes. The display 740 or the sub-display 750 is configured by the display device according to the above-described embodiment or the like.

  The present invention has been described above with some embodiments, modifications, and application examples. However, the present invention is not limited to these embodiments and the like, and various modifications can be made.

  For example, in the above-described embodiment and the like, the polarizing plate on the display side of the display panel is exposed, and the case where an object such as a finger contacts the upper surface of the polarizing plate is described as an example. Another member such as a protective plate may be disposed on the top.

  In the above embodiments and the like, a liquid crystal display using a liquid crystal element and an organic EL display using an organic EL element have been described as examples of the display device. It can also be applied to e-paper using electrophoresis.

  1, 3, 4, 4D, 4E, 5, 6, 6A ... display device, 1A, 1B, 3A, 4A, 4B, 4C, 5A ... display panel, 10, 10B, 10C, 10D, 10E, 10F, 10G, 10H ... TFT substrate, 11, 21 ... substrate, 12A ... TFT, 12B ... photo sensor, 12B1 ... photo sensor (main sensor), 12B2 ... photo sensor (auxiliary sensor), 13, 38 ... flattening layer, 14, 34, 37 ... Common electrode, 15 ... Insulating layer, 16A, 35 ... Pixel electrode, 160 ... Sub-pixel electrode, 17, 25 ... Polarizing plate, 18 ... Gate insulating film, 19 ... Interlayer film, 20, 20B, 20C, 20D, 20E , 20F, 20G, 20H ... CF substrate, 210 ... external connection region, 22,22R, 22G, 22B ... color filter, 23 ... infrared light transmission black, 24 ... light shielding black, 24C Metal black, 30, 30-1 ... liquid crystal layer, 30A ... image display area, 31 ... liquid crystal molecule, 32, 33 ... alignment film, 36, 36R, 36G, 36B ... light emitting layer, 39 ... sealing layer, 40, 40F DESCRIPTION OF SYMBOLS ... Backlight, 41 ... Light guide plate, 42A ... Infrared light source, 42B ... Visible light source, 50 ... Infrared light shielding spacer, 51 ... Pixel, 51RGB ... Display pixel, 71 ... Backlight drive part, 72 ... Image generation part, 73 Light reception drive unit, 74 Image processing unit, 75 Object information calculation unit, 76 Light emission drive unit, A Frame area, B Effective display area, L0 Outside light, L2 (Backlight) Visible light, L3 ... Reflected light, LR ... Red light, LG ... Green light, LB ... Blue light, LIR ... Infrared light, Von1, Von2, Voff1, Voff2 ... Received light output voltage, Aoff, MAoff, HAoff ... Off image, Bon, MBon, HBon ... on picture, MC HC, MHC ... differential image, E ... mask image, F ... composite image, Voff (MA), Von (MB), V (MC) ... received light output signal (main sensor output voltage, main sensor differential voltage), Voff (HA) ), Von (HB), V (HC): light reception output signal (auxiliary sensor output voltage, auxiliary sensor differential voltage), Von (MHC): light reception output signal (differential voltage), λ1 to λ4, wavelength, Δλ12, Δλ23, Δλ34: wavelength region, f: object (finger), t0 to t5: timing.

Claims (18)

A first substrate having a plurality of pixel electrodes constituting a display element and a light detection element on the substrate surface;
A second substrate disposed opposite to the substrate surface of the first substrate;
A spacer that is made of a material that blocks infrared light, and is selectively disposed in a region corresponding to at least one of the light detection elements between the first substrate and the second substrate. Display device. The display device according to claim 1, wherein the second substrate has color filters corresponding to colors of R (red), G (green), and B (blue). On the second substrate, a color filter corresponding to the G is disposed opposite to at least one of the light detection elements, and
The display device according to claim 2, wherein the spacer is selectively disposed between the light detection element and the color filter corresponding to the G. The display device according to claim 3, further comprising: a luminance control unit that controls luminance of display light from the display element based on an output of the light detection element. The photodetecting element is
A first photodetecting element disposed to face the color filter corresponding to R;
A second photodetecting element disposed to face the color filter corresponding to G;
A third photodetecting element disposed opposite to the color filter corresponding to B, and
The color filter corresponding to R and the first photodetecting element, the color filter corresponding to G and the second photodetecting element, and the color filter corresponding to B and the third photodetecting element The display device according to any one of claims 2 to 4, wherein the spacer is disposed in at least one of the light detection elements. An image generation unit that generates a color image based on each output of the first to third light detection elements obtained by detecting external light or reflected light of display light from the display element. Item 6. The display device according to Item 5. The second substrate is provided with a light reflection layer provided at least in a region corresponding to the spacer on the opposite side of the color filter from the first substrate and configured to reflect light from the display element. The display device according to claim 5. Based on the outputs of the first to third photodetecting elements obtained by detecting the light reflected from the light reflecting layer through the color filter out of the light from the display element, the display The display device according to claim 7, further comprising a display control unit that controls a color balance of light from the element. The spacer is disposed in an effective display area of the display screen;
The display device according to claim 8, wherein the light reflection layer is selectively provided in a region corresponding to the light detection element in the effective display region. From the display surface side of the second substrate, it is configured such that detection light for object detection made of infrared light is emitted together with display light made of visible light,
The light detection element is composed of a main detection element and an auxiliary detection element,
The spacer is selectively disposed in a region corresponding to the auxiliary detection element, and an infrared transmission layer that transmits infrared light and blocks visible light is selectively selected in the region corresponding to the main detection element. Arranged in
Using a composite image based on the captured image of the object obtained by the output of the main detection element and the captured image of the object obtained by the output of the auxiliary detection element, at least one of the position, shape, or size of the object is obtained. The display device according to claim 1, further comprising an object information calculation unit that acquires object information including the object information. The main detection is a difference image between an on-image that is a captured image of an object obtained in an on-period in which the detection light is emitted and an off-image that is a captured image of an object in an off period in which the detection light is not emitted. An image processing unit that generates corresponding to each of the element and the auxiliary detection element,
The object information calculation unit includes a first difference image corresponding to a difference image between the on image and the off image obtained by the output of the main detection element, and the on image obtained by the output of the auxiliary detection element. The display device according to claim 10, wherein the object information is acquired using a composite image based on a second difference image corresponding to a difference image with the off image. The image processing unit generates a mask image by performing binarization processing and image inversion processing on the second difference image,
The display device according to claim 11, wherein the object information calculation unit acquires the object information using a composite image of the first difference image and the mask image. The object information calculation unit is obtained by the first on-image which is a captured image of the object obtained by the output of the main detection element in the on-period in which the detection light is emitted and the auxiliary detection element in the on-period. The display device according to claim 10, wherein the object information is acquired based on a difference image from a second on-image that is a captured image of the object. The display device according to claim 10, wherein the main detection elements and the auxiliary detection elements are alternately arranged at a ratio of 1: 1 on the substrate surface of the first substrate. The display device according to claim 1, wherein the spacer includes a resin layer in which a pigment is dispersed. The display element is
The pixel electrode;
A common electrode provided on the first substrate or the second substrate;
The display device according to claim 1, wherein the display device is configured using a liquid crystal element having a liquid crystal layer provided between the first substrate and the second substrate. The display element is
The pixel electrode;
The display device according to claim 1, wherein the display device is configured using an organic EL element having a common electrode and a light emitting layer provided on the first substrate. A display device,
The display device
A first substrate having a plurality of pixel electrodes constituting a display element and a light detection element on the substrate surface;
A second substrate disposed opposite to the substrate surface of the first substrate;
A spacer that is made of a material that blocks infrared light, and is selectively disposed in a region corresponding to at least one of the light detection elements between the first substrate and the second substrate. Electronics.

Images