JP2007226045A - Organic el display device and coordinate input method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To compactly and inexpensively provide a planar display device for performing image display and image capture. <P>SOLUTION: An object 651 (e.g. a color photograph or the like) scanning images on a display area 10 is closely arranged. An EL element 1411 of a display pixel 26 is emitted to make the emitted light 661 irradiate the object 651. Light intensity reflected on the object 651 is changed by the image drawn on the object 651. In other words, the light 661 is modulated by the image of the object 651. The modulated light reaches a photosensor pixel 27, and the photosensor pixel 27 changes an on-off state by receiving light intensity. The display pixel 26 makes white emission basic, and the photosensor pixel 27 has a RGB color filter. The three photosensor pixels 27 of RGB correspond to one display pixel 26. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an organic EL device having an image capturing function and a driving method.

  The organic EL display device includes an array substrate on which source signal lines, gate signal lines, and pixel transistors are formed, a source driver circuit that drives the source signal lines, and a gate driver circuit that drives the gate signal lines. With the recent progress and development of integrated circuit technology, a process technology for forming a part of a drive circuit on an array substrate has been put into practical use. As a result, the entire organic EL display device can be made light and thin, and it is widely used as a display device for various portable devices such as mobile phones and notebook computers. Further, since the organic EL display device is a self-luminous device, a backlight is not required, and further downsizing and low power consumption can be realized.

By the way, a display device having an image capturing function in which a contact area sensor for capturing an image is arranged on an array substrate has been proposed (see, for example, Patent Documents 1 and 2). A conventional display device having this type of image capture function changes the charge amount of a capacitor connected to the sensor in accordance with the amount of light received by the sensor, and detects the voltage across the capacitor, thereby capturing the image. It is carried out.
JP 2001-292276 A JP 2001-339640 A

  Since the current flowing through the sensor is weak, it is difficult to accurately detect the change in the voltage across the capacitor due to the current, resulting in a large measurement error. For this reason, noise tends to appear in the captured image.

  When an SRAM or a buffer circuit is connected to the capacitor in order to detect the voltage across the capacitor, it is “0” or “1” depending on whether or not the threshold voltage of the transistors constituting the SRAM or buffer circuit is exceeded. However, since the threshold voltages of the transistors vary, the determination criteria of “0” and “1” may be shifted. In addition, since the current flowing through the sensor also varies, there is a possibility that the determination criteria of “0” and “1” are shifted.

  The present invention has been made in view of such a point, and the object thereof is a flat display capable of capturing an image without being affected by variations in light leakage and variations in electrical characteristics of transistors and the like. The object is to provide a method of driving the apparatus.

  A flat display device (input display) having a coordinate input function is made of low-temperature polycrystalline Si, and a photosensor is produced for each pixel. However, since the photosensor is manufactured by a laser annealing method, the photosensor characteristics in-screen tilt and partial characteristic variations occur. When the variation in the photosensor characteristics occurs, the sensitivity varies within the screen (input area), and there arises a problem that incorrect input or input cannot be performed.

  The present invention has been made in view of the above points, and solves the problem that erroneous input and input cannot be performed by measuring the characteristics of a photosensor in an input region and reflecting the photosensor characteristics.

  Further, according to the present invention, a light emitting element composed of an EL element and a light receiving element such as the photosensor pixel 27 are formed in the display device. Therefore, it is possible to irradiate the object with the light from the light emitting element and receive the reflected light with the photo sensor pixel 27.

  In addition, the present invention has a function of turning on and off the LED of the light pen and inputting coordinates, but delaying the LED when the off signal is generated.

  The organic EL display device of the present invention is an input display whose display screen also serves as an input area. The input area is divided into matrix blocks, the photosensor characteristics of each divided block are measured, and encoded and recorded on a storage medium such as an EPROM. Light emission can be performed independently of RGB.

  At the time of input on the input display, the characteristic data recorded in the storage medium is read out, and input determination processing is performed at a location that matches the threshold value of the input location. The photo sensor characteristic of the input area is reflected by the above process (matching process with characteristic data).

  According to the present invention, it is possible to perform image display and image capture by forming the photo sensor element 27 in the display panel. Therefore, an image scanner is not necessary. Therefore, the flat display device can be provided in a compact and inexpensive manner.

  With the present invention, there is no need to use a separate scanner or the like. Therefore, power saving can be realized. Moreover, since it can be reduced in size and weight, resources are not consumed. Therefore, it is friendly to the global environment and space environment.

(First embodiment)
The flat display device according to the first embodiment of the present invention will be described below. First, in order to facilitate understanding, the display pixel will be described as a liquid crystal element.
(1) Configuration of Flat Display Device FIG. 1 is a schematic configuration diagram of a flat display device according to this embodiment. The present invention is characterized by having an image capturing function by at least the photosensor pixels 27 arranged in the image display region 10.

  The flat display device shown in FIG. 1 is mainly composed of a panel section made up of an array substrate 11 and a circuit board 17.

A flat display device having a coordinate input function is called an input display.
(1-1) Configuration of Array Substrate 11 The pixel 16 (display pixel 26 + photosensor pixel 27) of the present embodiment has a display resolution of 320 pixels in the horizontal direction × 240 pixels in the vertical direction. The pixel is divided into red (R), blue (B), and green (G) portions in the horizontal direction, and a source signal line 21 is provided for each. The total number of source signal lines 21 is 320 × 3 = 960, and the total number of gate signal lines 22 that drive the display pixels 26 is 240.

  On the array substrate 11, a source driver circuit including a source signal line 23, a gate signal line 22, a pixel 16 (display pixel 26 + photosensor pixel 27) controlled by the signal line, and an IC that drives the source signal line 23. 14, a gate driver circuit 12 composed of an IC for driving the gate signal line 22, and a photo sensor processing circuit 18 for capturing and outputting an image. These circuits are formed by transistors formed by, for example, low-temperature polysilicon technology.

  The formation of the transistor is not limited to the low-temperature polysilicon technology, but may be performed by a high-temperature polysilicon technology having a process temperature of 450 degrees Celsius or higher. Alternatively, a transistor may be formed using a semiconductor film grown by solid phase (CGS). The transistor may also be formed or configured with amorphous silicon technology. The pixels 16 are formed or configured on a matrix.

Further, the display pixel 26 of the pixel 16 is not limited to a liquid crystal element, but may be a self-luminous element composed of an EL element or the like.
(1-2) Configuration of Each Circuit The source driver circuit 14 includes a D / A conversion circuit that converts input digital pixel data into an analog voltage suitable for driving a display element. The source driver circuit 14 may perform digital output for performing PWM modulation or the like. In this case, since digital data is applied to the source signal line 23 in a pulsed manner, a D / A conversion circuit is unnecessary.

  When the display unit 10 is configured by an EL element, the source driver circuit 14 may output a current output video signal. In the case of an EL element, it is preferable to adopt a configuration in which the source driver circuit 14 formed of a chip such as silicon is mounted on the array substrate 11 by COG (glass on chip) technology. This is because the memory function and the like can be built in the IC, and a compact size can be realized.

  On the circuit board 17, a control IC (not shown) for controlling each circuit on the array board 11, a memory (not shown) for storing image data and the like, and various types used in the array board 11 and the circuit board 17. A power supply circuit (not shown) that outputs a direct current voltage may be mounted. In addition, a CPU and MPU may be provided separately from a control IC (not shown), a memory and a power supply circuit may be integrated with a video signal processing circuit made up of an IC, or discrete components may be connected to the circuit board 17, It may be mounted on the array substrate 11.

  The elements, ICs, etc. mounted on the circuit board 17 may be produced by, for example, polysilicon technology. Alternatively, it may be formed directly on the array substrate 11. Needless to say, the above items also apply to the source driver circuit 14 and the signal processing circuit 18.

  The gate driver circuit 12a is preferably formed on the array substrate 11 by low temperature polysilicon technology. This is because a narrow frame can be realized. Cost can also be reduced. The gate driver circuit 12a sequentially selects the gate signal line 22a and performs an operation of writing video data to the display pixel 26 in synchronization with the source driver circuit 14.

  The gate driver circuit 12a sequentially selects the gate signal line 22b and the gate signal line 22c, and applies a write signal (precharge signal Vp or precharge current) to the photosensor pixel 27 in synchronization with the source driver circuit 14. In addition, an operation of taking out an output voltage (sensor voltage) from the photosensor pixel 27 is performed.

  The precharge signal Vp has a voltage and a current. In this specification, the precharge signal Vp is mainly described as a voltage. However, as shown in FIGS. 59 and 60, the precharge signal Vp may be a current.

  In the embodiment of the present invention, the operation state of the transistor 32b is read. However, the present invention is not limited to this. For example, in a configuration in which one terminal of the photosensor 35 is connected to the drain terminal of the transistor 32c, the terminal voltage of the photosensor 35 can be read by closing the transistor 32c without the transistor 32b. In other words, the present invention may have any configuration as long as it can detect a change state of a terminal voltage or a charge of a device that is changed by light. A plurality of photo sensors 35 may be formed on one photo sensor pixel 27.

  When the photo sensor pixel 27 is irradiated with light, the photo sensor 35 leaks and the output state changes. Alternatively, the photo sensor 27 is shaded, so that there is no leak and a predetermined state is maintained.

  A precharge signal is applied to the photosensor pixel 27 in synchronization with the rewrite cycle of the image display. Further, the operation state of the photosensor pixel 27 is read out in synchronization with the image display rewrite cycle. However, rewriting of the image display is performed for each frame, and the cycle for applying the precharge signal to the photosensor pixel 27 or the cycle for reading the operation state of the photosensor pixel 27 may be performed in a two-frame cycle. Also, these may be performed in units of horizontal scanning periods instead of frame periods. Even when it is performed in units of horizontal scanning periods, it is performed in synchronization with rewriting of the image display. However, the timing for rewriting the display of each pixel row by selecting a pixel row and the timing for applying the precharge signal to the photosensor pixel 27 are not limited to being the same. In some cases, a fixed delay time is set.

  The precharge signal is applied to the photosensor pixel 27 and puts the photosensor 35 in a predetermined state. The impedance of the photo sensor 35 is changed by light irradiation, and the changed state is maintained. In the photosensor 35, current or charge leaks mainly due to light irradiation, and the terminal voltage of the photosensor 35 changes.

  The photosensor pixel 27 maintains a precharged signal by being shielded from light. Alternatively, the rate of leaking current or charge is reduced. Alternatively, the potential drop of the voltage applied to the photosensor 35 is delayed. When the photosensor pixel 27 is not shielded and light is irradiated onto the photosensor 35, the leak rate of current or charge increases. When current or charge leaks and the terminal voltage of the photosensor 35 decreases by a certain level or more, the transistor 32b is turned off in the photosensor pixel 27 in FIG.

  When the precharge signal is applied, the photosensor pixel 27 is set to an initial state or a predetermined state. When the photosensor pixel 27 is irradiated with light, the operation state of the photosensor pixel 27 changes. When the photosensor pixel 27 is not irradiated with light, the initial state or a state near a predetermined state is maintained. That is, the precharge signal is a signal for setting the photosensor pixel 27 to a predetermined threshold value. The predetermined threshold value is a value that can change the operation of the photosensor pixel 27 by light irradiation. For example, if the value of the precharge signal is a voltage at which the transistor 32b in FIG. 14 is turned off, the transistor 32b is turned off from the beginning. Even if light is applied to the photosensor 35, the transistor 32b is in an off state, and thus does not change. In this state, the precharge signal is equal to or lower than a predetermined threshold value and is not appropriate as a precharge signal except for an example applied in the embodiment such as FIG. That is, the precharge signal is applied to the photosensor pixel 27 with a value that changes the operating state of the photosensor pixel 27 when the photosensor pixel 27 is irradiated with light of a predetermined intensity during a predetermined period. .

  A precharge signal is applied to the photosensor pixel 27 and irradiated with light, whereby the precharge signal held in the photosensor 35 changes. A precharge signal is applied to the photosensor 35 of the present invention at a predetermined cycle. Further, the light is constantly radiated to the photosensor pixel 27. The precharge signal sets the photosensor pixel 27 in a predetermined state at a predetermined cycle. It may be considered that the photosensor pixel 27 is reset to a predetermined state. For example, in the embodiment of FIG. 14, even if light is irradiated to the photosensor 35 and the transistor 32b is turned off, the transistor 32b is set to the on state by the application of the precharge signal.

  In this specification, the precharge signal may be a precharge voltage Vp and a precharge current. For ease of explanation, the voltage will be mainly exemplified and described as the precharge signal Vp. Further, it may be considered that the precharge voltage Vp is held in the photosensor 35 by the precharge current. Of course, it is also a technical category of the present invention that the precharge current is held in the photosensor pixel 27.

  The precharge signal may be understood as a signal for turning on or off the photosensor pixel 27. Further, the precharge signal may be understood as a signal for changing the operation state of the photosensor pixel 27.

  The photosensor pixel 27 is in an on state when the precharge signal is maintained at a predetermined threshold value or higher, and the off state is a state where the precharge signal is at a predetermined threshold value or lower. However, this example is a case where the transistor 32b is an N-channel transistor as shown in FIG. When the transistor 32b is a P-channel transistor or when the configuration is different, the on / off state is reversed. Or, the operation can be reversed. This case is also a technical category of the present invention.

  The precharge signal Vp applied to the photosensor pixel 27 is output from the photosensor processing circuit 18 formed of an IC. The precharge signal Vp is applied to the precharge signal line 24. The output voltage from the photosensor pixel 27 is output to the photosensor output signal line 25 and taken into the photosensor processing circuit 18.

  Although it is described that a voltage is output to the photosensor output signal line 25, the present invention is not limited to this, and it may be an operation in which a current or a charge is output to or input to the photosensor output signal line 25. Needless to say.

  Further, the present invention is not limited to detecting the operation state of the photosensor 35 by inputting or outputting current or voltage to the photosensor output signal line 25. It is also possible to detect the operating state of the photosensor 35 by detecting the direction of current or voltage flowing into or out of the photosensor output signal line 25.

  In the present specification, the operation state of the photo sensor pixel 27 is described as being measured or detected. However, in the present invention, it is only necessary to know that the operating state of the photosensor 35 or the photosensor pixel 27 has changed or that the predetermined state is maintained. Therefore, measurement or detection has a broad meaning such as recognizing the operating state of the photosensor pixel 27. Alternatively, the operation state of the photosensor pixel 27 is stored and compared with the previous operation state. In addition to detecting the on state and the off state of the photosensor pixel 27, the on state change state or the off state change state may be detected. For example, when the threshold value of the on state of the photosensor pixel 27 is 2.0 V, the voltage or voltage level obtained when reading from the photosensor pixel 27 is 2.5 V on state, 2.8 V on state, 1. It is exemplified that processing, detection, or measurement is distinguished as an 8V off state.

  The photosensor signal processing circuit 15 controls the gate driver circuit 12b and the photosensor processing circuit 18, and performs calculation or comparison processing on output data from the photosensor processing circuit 18. Further, the position of the photosensor 35 irradiated or shielded with light is determined and the coordinate position is output. It also controls the input / output of control data with an external microcomputer (not shown).

  The photosensor signal processing circuit 15 preferably employs a configuration in which a chip made of silicon or the like is mounted on the array substrate 11 by COG (glass on chip) technology. This is because a memory function or the like can be built in the IC 15 and the information display device of the present invention can be made compact.

  A video signal processing circuit (IC) 21 that performs display control and image capture control is mounted on the circuit board 17. The array substrate 11 and the circuit substrate 17 transmit and receive various signals via, for example, a flexible substrate (FPC) 20. The output video signal from the video signal processing circuit 21 is applied to the source driver circuit 14.

The photosensor signal processing circuit 15 may incorporate a counter that takes out image data of the photosensor 35 and detects an average gradation as a circuit component. Here, the “average gradation” means an average of the gradation of the output data over the plurality of pixels 16. When an image having 256 gradations is finally formed, when 5 out of 10 pixels are white and the remaining 5 pixels are black, the average gradation is 256 [gradation] × 5 [pixel] / 10 [ Pixel] = 128 [gradation].
(2) Configuration of Pixel 16 FIG. 2 and FIG. 3 are block diagrams of the flat display device of the present embodiment shown in detail with the pixel 16 (display pixel 26 + photosensor pixel 27) as the center. Although only one pixel 16 is shown, the pixels are formed in a matrix as shown in FIG. Also, other components are omitted for ease of explanation. The pixel 16 in FIG. 2 includes a display pixel 26 and a photosensor pixel 27.
(2-1) Configuration of Display Pixel 26 The display pixel 26 is formed at or near each intersection of the source signal line 23 and the gate signal line 22a arranged in rows and columns. The display pixel 26 includes a thin film transistor, an FET or a bipolar transistor (hereinafter referred to as a transistor) 36, a liquid crystal layer 653 formed between one end of the transistor 36 and a counter electrode 654, and a common signal line 38. The auxiliary capacitor 37 is connected between them (FIGS. 3 and 65).
(2-2) Configuration of Photosensor Pixel 27 As shown in FIG. 3, the photosensor pixel 27 operates as a transistor 35 that operates as a photodiode, an auxiliary capacitor (capacitor) 34 that holds a precharge signal Vp, and a source follower. A transistor 32b that operates as a switching element that applies the precharge signal Vp to the auxiliary capacitor 34, and a transistor 32c that selects and outputs the source follower output of the transistor 32b to the photosensor output signal line 25. .

One terminal of the photosensor element 35 is connected to the common signal line 38. The potential of the common signal line 38 is preferably held at a fixed value such as a ground potential. The common signal line 38 constituting one terminal of the auxiliary capacitor 37 and the common signal line 38 constituting one terminal of the photosensor element (photodiode) 35 are separated so that the same potential or different potential can be applied. May be.
(2-3) Arrangement of Photosensor Pixel 27 As an example, in FIG. 4, the photosensor pixel 27 is formed in each pixel 16. That is, the number of display pixels 26 and the number of photosensor pixels 27 are the same.

  As shown in FIG. 5, one photosensor pixel 27b may be arranged for each of the RGB pixels 16 (26R, 26G, and 26B).

  As shown in FIG. 6, one photosensor pixel (27a, 27b, 27c) may be arranged or formed for every two pixels. Preferably, as shown in FIG. 6, the photo sensor pixel 27 is arranged in the odd pixel column of the even pixel row, and the photo sensor pixel 27 is arranged in the even pixel column of the odd pixel row.

  As shown in FIG. 7, one photosensor pixel 27 may be arranged or formed by a set of RGB pixels. The formation area of the photosensor pixel 27 can be increased, and the sensitivity is improved. Therefore, the input object can be detected even with low illuminance.

  As shown in FIG. 8, the configuration may be such that one photosensor pixel 27 is arranged or formed with six pixels (26R × 2, 26G × 2, 26B × 2). In FIG. 8, the number of rows forming the photosensor pixels 27 is one every two pixel rows. By configuring as shown in FIG. 8, the area of the photosensor pixel 27 larger than that of FIG. 7 can be secured, and the sensitivity is improved.

  As described above, the photosensor pixels 27 are not limited to be formed corresponding to all the display pixels 26. As shown in FIG. 9, one pixel 16 is composed of three RGB sub-pixels 26R, 26G, and 26B. Each sub-pixel 27 includes a transistor 36, a transistor 32a for controlling whether or not electric charge is accumulated in the capacitor 34, an image capturing photosensor (photodetection photosensor) 35, a capacitor 34 for holding a precharge signal Vp, A transistor 32b that outputs binary data corresponding to the charge stored in the capacitor 34 and a transistor 32c that outputs data held by the transistor 32b are provided.

  The photosensor 35 is exemplified by a configuration in which transistors are diode-connected, but is not limited thereto. Any one may be used as long as the resistance value changes by light irradiation. For example, a photodiode is exemplified. In addition, since most semiconductor materials have the property of changing physical characteristics or operation as an optical sensor, they can be used in the flat display device of the present invention.

  An SRAM (rewritable memory) may be formed in the pixel 16. The luminance or light transmittance of each pixel 16 is controlled in gradation by the difference between the pixel electrode potential determined based on the charge accumulated in the auxiliary capacitor 34 and the potential of the common electrode formed on the counter substrate 36.

  The pixel 16 may have a configuration in which the photosensor pixel 27 is formed in the odd pixel row or the odd pixel column and the photosensor pixel 27 is not formed in the even pixel row or the even pixel column. Further, the photo sensor pixels 27 may be formed in even pixel rows or even pixel columns, and the photo sensor pixels 27 may not be formed in odd pixel rows or odd pixel columns.

  Further, the photosensor pixels 27 may be formed or configured every three pixel rows, three pixel columns, or every four or more pixels. The photo sensor pixels 27 may be formed or configured at random in the display area 10. The photosensor pixels 27 may be configured at regular intervals. The photo sensor pixels 27 may be configured in a matrix such as 3 × 3 pixels.

  The position of the photosensor pixel 27 is not limited to the display area 10 and may be configured outside the display area 10. For example, the structure which forms the photo sensor pixel 27 in the peripheral part of the display area 10 is illustrated. The number of photosensor pixels 27 formed in the pixel 16 is not limited to one, and a plurality of photosensor pixels 26 may be formed in one pixel 16.

In addition, it is preferable to form a light-shielding film on the photosensor 35 of the photosensor pixel 27. When the photosensor 35 senses external light and does not sense light from the backlight, the light-shielding film includes the photosensor 35 and the backlight. Form or place between.
(2-4) Formation Area and Display Area of Photosensor Pixel 27 In the above embodiment, the photosensor pixel 27 and the display pixel 26 are formed in the display area 10. However, the present invention is not limited to this. For example, as shown in FIG. 10, display pixels 26 are formed in a matrix in half of the array substrate 11 or in a predetermined area 10a, and photosensor pixels 27 are formed in a matrix in the other areas as information input areas. Also good.

  As shown in FIG. 11, the display pixels 26 may be formed in a matrix on the array substrate 11a, and the photosensor pixels 27 may be formed on the array substrate 11b in a matrix. The array substrate 11a and the array substrate 11b are connected by the flexible substrate 20, and signals are transmitted and received between the array substrate 11a and the array substrate 11b via the flexible substrate 20.

  As shown in FIG. 12, the display pixels 26 may be formed in a matrix on the array substrate 11, and the photosensor pixels 27 may be formed around the display area 10 or at the four corners.

As shown in FIG. 13, in one array substrate 11, the display pixels 26 may be formed in a matrix in the display area 10a, and the photosensor pixels 27 and the display pixels 26 may be formed in a matrix in the display area 10b.
(3) Configuration and Operational Content of Equivalent Circuit of Photosensor Pixel 27 The pixel 16 includes a display pixel 26 and a photosensor pixel 27 as shown in FIG. A video signal is applied to the display pixel 26 by the source driver circuit 14. The application timing of the video signal is controlled by the gate driver circuit 12a.
(3-1) Description of Equivalent Circuit An equivalent circuit diagram of the photosensor pixel 27 is shown in FIG. As shown in FIG. 3, the photosensor pixel 27 includes a transistor (photosensor) 35 that operates as a photodiode. In the present embodiment, the photosensor 35 is formed by diode-connecting N-channel transistors. By connecting the N-channel transistor as a diode, the configuration is simplified and the charge retention characteristics are improved.

  The present embodiment is not limited to this configuration. For example, the photo sensor 35 may be formed of a P-channel transistor. Moreover, you may comprise with a thin film diode (TFD).

  The transistors constituting the photosensor pixel 27 are also composed of N channels, but are not limited to this. A P-channel transistor may be used. The transistors 32 and the like are formed directly on the array substrate 11. However, the present invention is not limited to this, and the display pixels 26 and the photosensor pixels 27 are transferred or formed on the array substrate 11 by a transfer technique or the like. Needless to say.

  When the photosensor 35 is irradiated with light, the photosensor 35 leaks according to the light intensity and the light irradiation time. Due to this leakage, the potential between both terminals of the photosensor 35 is lowered (the charge held in the capacitor 34 is discharged). Therefore, by measuring or detecting the potential between both terminals of the photosensor 35, it is possible to grasp that the photosensor is irradiated with light or the relative intensity of the light irradiated to the photosensor.

  The auxiliary capacitor (capacitor) 34 that holds the precharge signal Vp is configured using a gate insulating film. By using the gate insulating film, an auxiliary capacitor having a small area and a large capacitance can be configured.

  One terminal of the photosensor 35 is connected to the gate terminal of the transistor 32b operating as a source follower, and one terminal of the auxiliary capacitor 34 is connected to the gate terminal of the transistor 32b. When the gate terminal voltage of the transistor 32b becomes equal to or lower than a certain value (Vt voltage), the transistor 32b is turned off. When the voltage is equal to or higher than the Vt voltage, the transistor 32c is turned on. The Vt voltage becomes a predetermined threshold, and this predetermined threshold varies depending on the characteristics of the transistor 32b and the photosensor 35. Therefore, the predetermined threshold value is different for each photosensor pixel 27. In order to facilitate the processing, it may be used as a predetermined threshold common to a plurality of sections and a plurality of photosensor pixels 27.

  In this specification, it is assumed that the photosensor pixel 27 is turned on when it is equal to or higher than the Vt voltage, and that the photosensor pixel 27 is turned off when it is equal to or lower than the Vt voltage. This is for ease of understanding. Actually, the Vt voltage changes due to disturbance such as light such as backlight, measurement timing, or parasitic capacitance such as a transistor constituting a pixel. Therefore, a predetermined margin is increased or decreased for the Vt voltage. Or the voltage which processed to the Vt voltage is used as a predetermined threshold value.

  The transistor 32 a applies the precharge signal Vp applied to the precharge signal line 24 to one terminal of the photosensor 35. When a turn-on voltage is applied to the gate signal line 22c, the transistor 32a is turned on. The precharge signal Vp is a voltage (Vt voltage or more) that turns on the transistor 32b. When the photosensor 35 is irradiated with light, the electric charge held in the capacitor 34 is discharged through the channel of the photosensor 35. Preferably, the precharge signal Vp is applied every field or frame (one screen rewrite cycle). Of course, it may be applied once in a plurality of fields or frames (a rewriting cycle of a plurality of screens).

  A precharge signal Vp is applied to the photosensor pixel 27 by the transistor 32a to the gate terminal of the transistor 32b. The transistor 32c is controlled by the gate driver circuit 12b. The gate terminal of the transistor 32c is connected to the gate signal line 22b. When a turn-on voltage is applied to the gate signal line 22b, the transistor 32c is turned on. If the transistor 32b is in the on state, the charge of the photosensor output signal line 25 is discharged to the common signal line 38 via the transistors 32c and 32b (may be charged depending on the potential of the common signal line 38). .

  The potential of the photosensor output signal line 25 changes due to a change in the charge of the photosensor output signal line 25. Even if the transistor 32c is turned on, the charge of the photosensor output signal line 25 does not change if the transistor 32b is turned off.

As described above, by detecting a change in the charge of the photosensor output signal line 25, it is possible to detect whether the transistor 32b is in an on state, an intermediate on state, or an off state. That is, this detection detects the potential of the gate terminal of the transistor 32b. The gate terminal voltage of the transistor 32b varies depending on the magnitude of the precharge signal Vp, the intensity of light irradiated on the photosensor 35, and the irradiation time (exposure time Tc).
(3-2) Timing of Operation The cycle or timing at which the transistor 32c is turned on is performed every field or frame (one screen rewrite cycle). Alternatively, one frame period or one horizontal scanning period is used as one unit. For example, the operation state of the photosensor 35 is read by turning on the transistor 32c in a cycle of 2 frame periods and 10 horizontal scanning periods, and the precharge signal Vp is applied to the photosensor 35 by turning on the transistor 32a.

  The image display is performed in synchronization with the period and timing of applying the precharge signal Vp. The timing at which the transistor 32c is turned on (selection timing) may be a plurality of fields or a plurality of frames (a plurality of screen rewriting cycles).

  The magnitude of the precharge signal Vp and the exposure time Tc (from the time when the transistor 32a is turned on and the precharge signal Vp is applied to the gate terminal of the transistor 32b, the transistor 32c is turned on and the transistor 32b is connected to the photosensor output signal line 25. Or the amount of light leaked (sensitivity) of the photosensor 35, the intensity of the light applied to the photosensor 35 can be detected.

  The intensity of light is nothing but the operation of reading an image like an image scanner. In the present embodiment, the photosensor pixels 27 are formed in a matrix. Therefore, by detecting (measuring) the on / off state of the transistor 32b of each photosensor pixel 27, an image image formed or illuminated on the display region 10 can be captured. Further, the shadow of the object and the light reflected by the object can be detected or taken into the panel.

Hereinafter, the transistor 32b whose operation changes depending on the terminal voltage of the photosensor 35 is referred to as a detection transistor 32b. The transistors 32c and 32a that perform the switching operation are referred to as switch transistors 32a and 32c.
(3-3) First Modification The common signal line 38 constituting one terminal of the auxiliary capacitor 34 and the common signal line 38 constituting one terminal of the photosensor element (photodiode) 35 in FIG. You may comprise so that an electric potential or another electric potential can be applied.
(3-4) Second Modification It is preferable that the voltage applied to the common signal line 38 is variable. This is because the time during which the voltage held in the photosensor 35 is equal to or lower than the Vt voltage of the transistor 32b can be adjusted or varied by the voltage applied to the common signal line 38. Alternatively, by adjusting or setting within a certain voltage range before and after the Vt voltage, it is possible to adjust or vary the time during which the voltage held in the photosensor 35 is less than or equal to the Vt voltage of the transistor 32b.

  “Vt voltage” means that a voltage value equal to or higher than this voltage is applied to the gate terminal of the transistor 32b to change the transistor 32b to an on state or a state similar to the on state, thereby reducing the impedance between the channels of the transistor 32b. Alternatively, the voltage is changed to a state in which a current flows through the transistor 32b or becomes easy to flow.

  By applying a voltage value equal to or lower than the Vt voltage to the gate terminal of the transistor 32b, the transistor 32b changes to an off state or a state similar to the off state, and the impedance between the channels of the transistor 32b increases. Alternatively, the current changes to a state where current does not flow or is difficult to flow through the transistor 32b. The above is the case where the transistor 32b is an N channel. In the case of the P channel, the operation is reversed.

The transistor 32 may be formed of either an N channel or a P channel. In addition, the transistor 32b may be either an operation for converting the applied Vt voltage into a current, or an operation for amplifying or converting the applied Vt voltage into a constant voltage. For example, the current mirror operation or the offset cancel operation may be performed. These are technical categories of the present embodiment.
(3-5) Third Modification The transistor 32c, transistor 32b, and transistor 32a are not limited to transistors, and may be formed by TFD or the like. The Vt voltage in the case of TFD means a voltage that changes to an operating state of TFD (on state or state similar to on state, off state or state similar to off state) by a voltage applied to one terminal of TFD. .

The transistor 32 is not limited to a thin film transistor, and may be formed of an FET, a bipolar transistor, a CMOS transistor, or the like. Further, the pixel 16 may be formed by mixing a bipolar transistor and a CMOS transistor. Further, the pixel 16 may be formed by mixing P-channel and N-channel transistors.
(4) Configuration of Peripheral Part FIG. 15 is a configuration diagram illustrating the peripheral part of the pixel 16. The photosensor output signal line 25 is connected to the photosensor processing circuit 18. The photo sensor processing circuit 18 mainly includes a comparator circuit 155 and a selection circuit 151. The selection circuit 31 is an analog switch as an example. In addition, a mechanical relay circuit, a MOS relay, or the like may be used. The selection circuit 151 includes a shift register circuit in addition to a switching or selection circuit.

  The connection state between the photosensor pixel 27 and the comparator circuit 155 is shown in FIG. The comparator circuit 155 may be an operational amplifier circuit or a differential amplifier. That is, any one may be used as long as the output of the comparator circuit 155 changes with respect to the comparison voltage or the comparison reference at one terminal.

  In FIG. 15, the comparator circuit 155 detects a change in voltage applied to the photosensor output signal line 25, but the present invention is not limited to this.

  As shown in FIG. 17, the comparator circuit 155 or the like may not be configured, and the voltage (current) output may be converted into digital data by an analog-digital conversion circuit (AD circuit) 171 to perform processing. Further, the output analog data may be directly processed.

  The comparator circuit 155 and the like are not limited to being arranged or formed at the outputs of all the photosensor output signal lines 25. A configuration in which the comparator circuit 155 or the like is formed only in the even pixel column may be used. In addition, a selection circuit 151 may be arranged before the comparator circuit 155 (a selection circuit 151 may be provided between the photosensor output signal line and the comparator circuit 155 to reduce the number of comparator circuits 155 formed.

  A feature of the comparator circuit 155 is that it is determined whether it is larger or smaller than the comparison voltage Vref, and H or L is logically output (binarized). Therefore, since the output is converted into a logic signal, the subsequent logic processing becomes easy. That is, the comparison voltage Vref applied to the comparator circuit 155 is compared with the signal read from the photosensor pixel 27 and converted to a binary signal that is equal to or higher than the comparison voltage Vref. By converting to a binarized signal, the input coordinate position can be easily detected.

  The present embodiment is not limited to this, and an analog output (using an operational amplifier circuit or the like) may be used. Further, the output of the comparator circuit 155 may output a binary value (large, small, coincidence). The comparator circuit and the operational amplifier circuit are preferably configured or formed to have a hysteresis characteristic so that the output does not change in a voltage value or voltage range within a certain range. Further, the comparator circuit 155 may have a circuit configuration that converts a current into a voltage (for example, a current-voltage conversion circuit using an operational amplifier element).

  Although the gate driver circuit 12 is formed directly by the polysilicon technology of the array substrate 11, the present invention is not limited to this. The gate driver circuit 12 may be formed of a silicon chip or the like and mounted or loaded on the array substrate 11 by the COG technology. The same applies to the source driver circuit 14, the photosensor processing circuit 18, and the signal processing circuit 15.

The gate driver circuit 12 a controls the gate signal line 22 a of the display pixel 26. The gate driver circuit 12b controls the gate signal line 22b and the gate signal line 22c of the photosensor pixel 26. The gate driver circuit 12a and the gate driver circuit 12b operate in synchronization. Therefore, the selection clocks of the gate signal line 22a and the gate signal lines 22b and 22c are generated based on the same clock or this clock signal.
(4-1) Function of Comparator Circuit 155 Hereinafter, the circuit 155 will be described as a comparator circuit for ease of explanation. As shown in FIG. 15 and the like, the precharge signal Vp is applied to the precharge signal line 24 from the precharge signal terminal 153. The precharge signal Vp is applied in synchronization with the video signal output from the source driver circuit 14. The precharge signal Vp is described as being applied to the same precharge signal Vp to all the precharge signal lines 24, but is not limited to this, and may be changed or adjusted. Further, it may be changed or adjusted according to the characteristics of the photosensor 35.

  In FIG. 15, the comparison voltage Vref is applied from one comparator voltage terminal 154 to one input terminal of all the comparator circuits 155. Although the comparison voltage Vref is shown to apply the same voltage to all the comparator circuits 155, it is not limited to this and may be different. For example, the Vref voltage applied between the even pixel column and the odd pixel column may be different. Further, the Vref voltage may be varied according to the characteristics of the photosensor 35.

As shown in FIG. 15, one end of the photosensor output signal line 25 is connected to the input terminal of the comparator circuit 155. A selection circuit 151 is connected to the output terminal of the comparator circuit 155. A switch Sk (k = 1 to n, n is the number of pixel columns) of the selection circuit 151 is formed, and one switch Sk is selected. The output of the selected comparator circuit 155 is connected to the voltage output terminal 152. Therefore, an output voltage is output to the voltage output terminal 152. The switch Sk (k = 1 to n) is configured to be selected at least once in one horizontal scanning period. The gate driver circuit 12b selects the gate signal line 22b in synchronization with one horizontal scanning period (1H) clock, and outputs the output voltage of the transistor 32c to the photosensor output signal line 25 (see FIG. 18).
(5) Display and Reading Method As shown in FIG. 18, the video signal is applied to the source signal line 23 in units of one horizontal scanning period (1H) corresponding to the display image. The polarity of the video signal is inverted every 1H or every frame. In addition, the polarity applied to each pixel row is inverted every frame (or one field, that is, the cycle of rewriting the screen). On the other hand, the gate signal line 22a sequentially selects pixel rows in synchronization with the 1H clock, and the transistor 32 of the selected pixel 16 writes the video signal applied to the source signal line 23 to the pixel electrode 31.

  As shown in FIG. 18, the gate driver circuit 12b selects the gate signal line 22a in the 1H cycle, and shifts the position of the gate signal line 22c to be sequentially selected. The shifting method is matched with the shift direction of the gate signal line 22a. When a turn-on voltage is applied to the gate signal line 22c, the switching transistor 32a corresponding to the pixel row connected to the gate signal line 22c is turned on. Therefore, it is applied to the precharge signal line 24. A precharge signal Vp is applied to the photosensor 35. The precharge signal Vp may be changed every 1H, but is preferably a constant voltage.

  When the photosensor 35 is irradiated with light, electric charges are discharged through the photosensor 35, and the terminal voltage of the photosensor 35 is lowered from the precharge signal Vp. The decrease is determined by the intensity of light irradiated to the photosensor 35 and the light irradiation time (exposure time Tc). If the applied precharge signal Vp is lower than the Vt voltage of the detection transistor 32, the transistor 32b is turned off, and if it is higher than the Vt voltage, it is turned on.

  Similarly, the gate driver circuit 12b sequentially selects pixel rows in synchronization with the 1H clock of the gate signal line 22b, and the switching transistor 32c of the selected photosensor pixel 27 outputs the output of the detection transistor 32b to the voltage output signal line 25. Output to. When the photosensor 35 is irradiated with light, electric charges are discharged through the photosensor 35, and the terminal voltage of the photosensor 35 is lowered from the precharge signal Vp.

As described above, the voltage drop (discharge of electric charge) is determined by the intensity of light applied to the photosensor 35 and the exposure time Tc. Further, it is determined by the capacity of the capacitor 34. Due to light irradiation to the photosensor 35, the applied precharge signal Vp decreases. When the voltage applied to the gate terminal of the transistor 32b is equal to or lower than the Vt voltage, the transistor 32b is turned off, and when the voltage is higher than the Vt voltage, the transistor 32b is turned on. Therefore, the operating state of the transistor 32b can be output to the photosensor output signal line 25 by turning on the switching transistor 32c.
(6) Exposure time Tc
Next, the exposure time Tc will be described. As shown in FIG. 18, after the gate signal line 22c is selected, the gate signal line 22b is selected after the A period has elapsed. This period A is referred to as “exposure time Tc”. That is, the exposure time Tc is the time from when the precharge signal Vp is applied to an arbitrary photosensor pixel 27 to when it is read. More precisely, it is the time from when the precharge signal Vp applied to the photosensor 35 is determined until the voltage is output to the photosensor output signal line 25, the output state becomes stable, and it can be called from the voltage output terminal 152.

  In this specification, the exposure time Tc is the time from the timing when the precharge signal Vp is applied to the photosensor pixel 27 to the timing when the held voltage of the photosensor 35 of the applied photosensor pixel 27 is read. Since the selection timing of the gate signal line 22b and the gate signal line 22c is synchronized, the time for detecting the terminal voltage of the photosensor 35 is relatively proportional even if the exposure time Tc is varied or adjusted. Therefore, the external light intensity can be grasped with high accuracy. Further, there is no problem even if the photo sensor 35 differs depending on the lot of the array substrate 11.

  The exposure time Tc can be changed as shown in FIG. FIG. 19A shows a selection signal for the gate signal line 22c. During a certain period of one horizontal scanning period (1H), an ON voltage is applied to the gate signal line 22c, and a precharge signal Vp is applied to the photosensor pixel 27. FIG. 19B shows a selection signal for the gate signal line 22b. During a certain period of one horizontal scanning period (1H), an on-voltage is applied to the gate signal line 22b, and a voltage or the like is extracted from the photosensor pixel 27 to the photosensor output signal line 25.

  (B1) in FIG. 19 is a case where the exposure time Tc is within one horizontal scanning period (1H). (B2) of FIG. 19 is an embodiment when the exposure time Tc is 1H or more (near 2H in the figure). FIG. 19B3 shows an embodiment in which the exposure time Tc is nH (n is an integer).

  Although FIG. 19 shows 1H units, units of 1H or less may be used. For example, a 0.5H period (1/2 of one horizontal scanning period) and a 0.25H period (1/4 of one horizontal scanning period) are applicable. Further, the exposure time Tc may be changed or adjusted in units of one field or one frame. Further, the exposure time Tc may be changed or adjusted within one field or one frame period. The precharge signal Vp and the exposure time Tc are adjusted so as to be optimally output from the voltage output terminal 152.

  In order to realize the time setting of the exposure time Tc within 1H, it is preferable to add an enable (OEV) circuit to the gate driver circuit 12b as shown in FIG. Only when the H logic voltage is applied to the enable terminal (OEV) terminal 201 and the period during which the gate driver circuit 12b outputs the H logic voltage for selecting the gate signal line 22b is ANDed. An on-voltage is applied to the line 22b.

  In the configuration of the gate driver circuit 12b shown in FIG. 15 and the like, there is no enable terminal (OEV) terminal 201. Therefore, the ON voltage (selection voltage) is applied to the gate signal line 22c during the period in which the gate driver circuit 12b outputs the H logic voltage for selecting the gate signal line 22b.

  In the configuration of FIG. 20, the period during which the ON voltage is applied to the gate signal line 22b can be reduced to 1H or less by controlling the logic voltage of the enable terminal (OEV) 201.

  Therefore, when the gate driver circuit 22b selects the gate signal lines 22b and 22c formed in the same photosensor pixel 27 in the 1H period and applies the precharge signal Vp, the gate signal line 22b is not controlled by controlling the OEV terminal. Select. In other words, the gate signal line 22b is selected by the shift register circuit, but the OFF voltage is applied to the gate signal line 22b by the OEV terminal 201. After the precharge signal Vp is applied to the photosensor 35, after the exposure time Tc within 1H elapses, the photosensor 35 is brought into a selected state by controlling the OEV terminal 201 connected to the gate signal line 22b. That is, the ON voltage is applied to the gate signal line 22b by the OEV terminal 201. The gate signal line 22 b is controlled by ANDing the logic of the OEV terminal and the output of the shift register circuit 12 b with the AND circuit 202. Therefore, the transistor 32c is turned on, and the output of the transistor 32b is output to the photosensor output signal line 25.

The configuration or operation related to the OEV described above can also be applied to the gate driver circuit 12a. The operation of the gate driver circuit 12b controlling the gate signal line 22b is preferably applied to the gate signal line 22a and the gate signal line 22c. Moreover, it is applicable also to other embodiment of this embodiment.
(7) Terminal voltage of the photosensor 35 The terminal voltage of the photosensor 35 varies depending on the magnitude of the precharge signal Vp applied to the photosensor 35, the intensity of external light applied to the photosensor 35, and the like. This change is shown in FIG. The precharge signal Vp is applied during the period A in FIG.

  FIG. 21 (1) shows the case where the precharge signal Vp = 3.5V. After the precharge signal Vp of 3.5 V is applied, when the external light applied to the photosensor 35 is weak, the terminal voltage of the photosensor 35 changes along the straight line a. When the external light irradiated to the photosensor 35 is strong, the terminal voltage of the photosensor 35 changes along the straight line b. After the period B, the switching transistor 32c is turned on, and a voltage or the like is taken out to the photosensor output signal line 25. When the precharge signal Vp is applied at t1 and reading is performed at t2, period B is the exposure time Tc.

  Assume that Vt of the transistor 32b is 2.5V, the transistor 32b is turned on when the gate terminal voltage of the transistor 32b is equal to or higher than Vt, and the transistor 32b is turned off when less than 2.5V.

  In the case of the b line in FIG. 21 (1), the voltage is 1.5 V at t2. Therefore, the off state of the transistor 32b is taken out to the photosensor output signal line 25. If the B period is short, the voltage of the photosensor output signal line 25 becomes 1.5V or more. If the B period is long, the voltage of the photosensor output signal line 25 is 1.5 V or less. In the case of the a line in FIG. 21 (1), the voltage is 3.0 V at t2. Therefore, the ON state of the transistor 32b is taken out to the photosensor output signal line 25.

  FIG. 21 (2) shows the case where the precharge signal Vp = 4.0V. After the precharge signal Vp of 4.0 V is applied, when the external light applied to the photosensor 35 is weak, the terminal voltage of the photosensor 35 changes along the straight line a. When the external light irradiated to the photosensor 35 is strong, the terminal voltage of the photosensor 35 changes along the straight line b. After the period B, the switching transistor 32c is turned on, and a voltage or the like is taken out to the photosensor output signal line 25.

  If the change in impedance of the photosensor 35 with respect to the light irradiation intensity is proportional, the slope of the b line in FIG. 21 (1) and the slope of the b line in FIG. 21 (2) are the same. The slope of the straight line a in FIG. 21A is the same as the slope of the straight line a in FIG. In FIG. 21B, at t2, the transistor 32b is on in the straight line a, and the transistor 32b is off in the straight line b. FIG. 21 (3) shows a case where the precharge signal Vp = 4.5V, and FIG. 21 (4) shows a case where the precharge signal Vp = 5.0V.

  In FIG. 21, if the gate terminal voltage of the transistor 32c is Vt = 2.5 (V) or more and the transistor is in the on state, and less than that, the transistor 32b is in FIG. In (1), the straight line a is on, the straight line b is off, the straight line a is on, the straight line b is off, the straight line b is off, the straight line a is on in FIG. In the state, in FIG. 21 (4), the straight line a is turned on, and the straight line b is turned on.

  The gate driver circuit 22b that drives the gate signal line 22c and the gate driver circuit 22b that drives the gate signal line 22b may be configured as separate circuits.

  In the above embodiment, the period A during which the precharge signal Vp is applied is the same (FIGS. 21 (1) (2) (3) (4)). However, the present invention is not limited to this. For example, it may be driven as shown in FIG. In the embodiment of FIG. 22, FIG. 22 (2) shows that the period A during which the precharge signal Vp is applied is short and the exposure time Tc = B is the longest. In FIG. 22 (3), the period A during which the precharge signal Vp is applied is long, and the exposure time Tc = B is the shortest. 22 (1), (2), and (3), A period + B period = a constant value.

  In FIG. 22, if the gate terminal voltage of the transistor 32c is Vt = 1.5 (V) or more and the transistor is in the on state, and less than that, the transistor 32c is in FIG. In (1), the straight line a is on, and the straight line b is off. In FIG. 22 (2), the straight line a is on and the straight line b is off. In FIG. 22 (3), the straight line a is turned on, and the straight line b is turned on.

As described above, by changing or adjusting not only the exposure time Tc but also the application time of the precharge signal Vp or the exposure time Tc or the application time of the precharge signal Vp in a predetermined period, The state of the photo sensor 35 can be changed.
(8) Multiple Image Capture Operation It is preferable that the operation state of the photosensor pixel 27 is detected (image capture) a plurality of times while changing the imaging conditions (precharge signal Vp, exposure time Tc). Based on the results of these multiple image captures, the operating state distribution of the photosensor 35 and captured image data may be generated.

Specifically, as shown in FIG. 21, the precharge signal Vp to the capacitor 34 is changed a plurality of times (four ways in FIG. 21), and each voltage Vp is applied to the capacitor 34 to perform image capture. . A control signal for this purpose is supplied to the gate driver circuit 12b of the array substrate 11. In addition, the digital data or the analog data is processed from the comparator circuit 155 as a result of image capture output from the array substrate 11.
(9) Division of Selection Circuit In the configuration of FIG. 15, the selection switch Sk needs to be selected once every 1H period. Therefore, it is necessary to operate at a relatively high speed. In order to deal with this problem, the selection circuit is divided.
(9-1) Two-divided case In FIG. 17, the odd pixel columns are connected to the selection circuit 151b, and the even pixel columns are connected to the selection circuit 151a. The voltage from the selection circuit 151b is output from the voltage output terminal 152b. The voltage from the selection circuit 151a is output from the voltage output terminal 152a. Therefore, the time for selecting the switch Sk can be doubled compared to FIG.

  Although FIG. 17 illustrates that the precharge signal Vp is applied to all the precharge signal lines 24 from one precharge signal terminal 153, the present invention is not limited to this.

  For example, a plurality of precharge signal terminals 153 may be formed or arranged, and the precharge signal Vp applied to each precharge signal line 24 may be changed.

For example, by applying different precharge signals Vp to the photosensors 35 of the odd-numbered pixel rows and even-numbered pixel rows, the pixel rows to which the precharge signal Vp having high sensitivity to the external light intensity is applied are selected and the coordinate detection process is performed. Can be implemented. Different precharge signals Vp may be applied in a cycle of 3 pixel columns or more or 2 pixel rows or more.
(9-2) In the case of two or more divisions Although FIG. 17 shows a configuration in which two selection circuits 151 are formed, the present invention is not limited to this. For example, n selection circuits 151 may be configured as shown in FIGS. As the number n increases, the processing time of the signal applied to one photosensor output signal line 25 in the 1H period becomes longer. Therefore, stable output signal processing can be realized. However, as the number of divisions increases, the reassembly (rearrangement) of output data becomes more complicated.

  In FIG. 23, from the left end of the screen, m photosensor output signal lines 25 are connected to the selection circuit 151a, the next m photosensor output signal lines 25 are connected to the selection circuit 151b, and the m photosensor output signal lines 25 are connected. This is connected to the selection circuit 151c.

  In FIG. 24, 2n photosensor output signal lines 25 from the left end of the screen are connected to the selection circuits 151a, 151b, 151c, 151d... 151n, 151a, 151b, 151c,. 151n, 151b, 151c, 151d... 151n, 151a, 151b, 151c,... 151n, the next 2n photosensor output signal lines 25. Are connected to selection circuits 151a, 151b, 151c, 151d... 151n, 151a, 151b, 151c,.

In FIG. 25, m photosensor output signal lines 25 from the left end of the screen are connected to selection circuits 151a, 151b, 151c, 151d,... 151n, 151a, 151b, 151c,. 151 photosensor output signal lines 25 are selected from the selection circuits 151a, 151b, 151c, 151d... 151n, 151a, 151b, 151c,... 151n, the next m photosensor output signal lines 25. Are connected to selection circuits 151a, 151b, 151c, 151d... 151n, 151a, 151b, 151c,.
(10) Selection Function in Source Driver Circuit 14 FIG. 15 shows an embodiment in which all source signal lines 23 are configured to be connected to the source driver circuit 14. However, as shown in FIG. 17, the source driver circuit 14 sequentially outputs a red (R) video signal, a green (G) video signal, and a blue (B) video signal in one horizontal scanning period, and the array substrate 11. The R video signal is distributed to the R source signal line 23, the G video signal is distributed to the G source signal line 23, and the B video signal is distributed to the B source signal line 23 by the switch SW of the switching circuit 172 formed directly on May be. That is, the source driver circuit 14 has a function of a three selection circuit.

  In the configuration shown in FIG. 17, the number of output terminals of the source driver circuit 14 can be reduced to 1/3 as compared with the embodiment shown in FIG. Therefore, the number of connections between the array substrate 11 and the source driver circuit 14 is only 1/3, and mounting defects are less likely to occur.

In the embodiment of FIG. 17, the switching circuit 172 is formed on the array substrate 11 by the polysilicon technique. However, the switching circuit 172 is not limited to this and may be formed by a silicon chip and mounted on the array substrate 11.
(11) Operation Timing of FIG. 17 The operation timing of FIG. 17 is shown in FIG. The SW of the switching circuit 172 switches the terminals a, b, and c during one horizontal scanning period (1H). Further, the transistor 32a and the transistor 32c of the photosensor pixel 27 operate.

  At the beginning of the 1H period, SW selects the a terminal, and an R video signal is output from the source driver circuit 14. Therefore, the R video signal is applied to the R source signal line 23. Next, the SW of the switching circuit 172 selects the b terminal, and the G video signal is output from the source driver circuit 14. Therefore, the G video signal is applied to the G source signal line 23. Next, the SW of the switching circuit 172 selects the c terminal, and the B video signal is output from the source driver circuit 14. Therefore, the B video signal is applied to the B source signal line 23. At the next timing, the ON voltage is applied to the gate signal line 22c, the transistor 32a is turned ON, and the precharge signal Vp applied to the precharge signal line 24 is applied to the photosensor pixel 27. At the end of 1H, an ON voltage is applied to the gate signal line 22b, the transistor 32c of the photosensor pixel 27 is turned on, and the output of the transistor 32b is output to the photosensor output signal line 25.

  In FIG. 26, a period t1 is a period in which the SW selects the terminal a and the R video signal is output from the source driver circuit 14. The period t2 is a period in which the SW of the switching circuit 172 selects the b terminal and the G video signal is output from the source driver circuit 14. During the period t 3, the SW of the switching circuit 172 selects the c terminal, and the B video signal is output from the source driver circuit 14. Therefore, the B video signal is applied to the B source signal line 23. At the next timing, the ON voltage is applied to the gate signal line 22c, the transistor 32a is turned ON, and the precharge signal Vp applied to the precharge signal line 24 is applied to the photosensor pixel 27. At the end of 1H, an ON voltage is applied to the gate signal line 22b, the transistor 32c of the photosensor pixel 27 is turned on, and the output of the transistor 32b is output to the photosensor output signal line 25.

  Note that, by making the periods t1, t2, t3, t4, and t5 the same, the circuit configuration of the photosensor processing circuit 18 and the like is facilitated, but is not limited thereto. For example, it is preferable that the period t4 during which the precharge signal Vp is applied is longer than the periods t1, t2, and t3 during which the video signal is applied.

  In particular, it is preferable that the period t5 during which the transistor 32c is turned on is the longest. This is because a stable output can be supplied to the comparator circuit 155. Moreover, it is preferable to ensure the period of t6 between the periods of t1, t2, t3, t4, and t5. This is because the period during which each switch SW and transistor 32 is switched from the on state to the off state and the switching period are unstable.

Note that, as described with reference to FIG. 18, the photosensor pixel 27 to which the precharge signal Vp is applied and the photosensor pixel 27 that the transistor 32c outputs to the photosensor output signal line do not have to coincide with each other.
(12) Method of shortening the exposure time Tc In FIG. 26, the period (exposure time Tc) from the period t4 when the precharge signal Vp is applied to the output period t5 of the photosensor 35 can be extremely shortened.

  In FIG. 26, a period t1 is a period in which the SW selects the terminal a and the R video signal is output from the source driver circuit 14. The period t2 is a period in which the SW of the switching circuit 172 selects the b terminal and the G video signal is output from the source driver circuit 14. During the period t 3, the SW of the switching circuit 172 selects the c terminal, and the B video signal is output from the source driver circuit 14. Therefore, the B video signal is applied to the B source signal line 23. At the next timing, the ON voltage is applied to the gate signal line 22c, the transistor 32a is turned ON, and the precharge signal Vp applied to the precharge signal line 24 is applied to the photosensor pixel 27.

At the end of 1H, an ON voltage is applied to the gate signal line 22b, the transistor 32c of the photosensor pixel 27 is turned on, and the output of the transistor 32b is output to the photosensor output signal line 25.
(13) Method of Increasing Exposure Time Tc In order to make the exposure time Tc relatively long, it is preferable to configure as shown in FIG. In FIG. 27, first, the first precharge signal Vp of 1H is applied to the photosensor 35. At the end of 1H, the output of the photosensor 35 is taken out to the photosensor output signal line 25. During the first t4 period of 1H, the gate signal line 22c is selected, the transistor 32a is turned on, and the precharge signal Vp is applied to the photosensor 35. The next period t1 is a period in which the SW selects the a terminal and the R video signal is output from the source driver circuit 14. The next period t 2 is a period in which the SW of the switching circuit 172 selects the b terminal and the G video signal is output from the source driver circuit 14. In the next t3 period, the SW of the switching circuit 172 selects the c terminal, and the source driver circuit 14 outputs the B video signal. Therefore, the B video signal is applied to the B source signal line 23.

At the last timing of 1H, an on-voltage is applied to the gate signal line 22b, the transistor 32c is turned on, the transistor 32c of the photosensor pixel 27 is turned on, and the output of the transistor 32b is output to the photosensor output signal line 25.
(14) First Modification In the above embodiment, the application of the precharge signal Vp and the extraction of the photosensor output are performed for each photosensor pixel 27 in the period of 1H. However, the present invention is not limited to this. Therefore, a first modification of FIG. 28 is shown.
(14-1) Operation of First Modification In FIG. 28, the first horizontal scanning period (first H, for example, the period when the first pixel row is selected) and the next second horizontal The operation of the transistor 32a and the transistor 32c is different from the scanning period (second H, for example, a period in which the second pixel row is selected). The operations related to the video signals R, G, and B output from the source driver circuit 14 are the same (a video signal is output every 1H).

  In FIG. 28, the transistor 32a is turned on in the first H pixel row, and the precharge signal Vp is applied to the photosensor pixel 27 in the first pixel row. As is apparent from FIG. 28, the transistor 32c of the photosensor pixel 27 in the first pixel row is not selected, so that the output of the photosensor 35 in the first pixel row is not read out. Since the gate signal line 22c is not selected in the second H pixel row, the transistor 32a is kept off. Therefore, the precharge signal Vp is not applied to the pixels 27 in the second pixel row. As is apparent from FIG. 28, the gate signal line 22b in the second pixel row is selected, so that the transistor 32c of the photosensor pixel 27 is selected. Therefore, the output of the photosensor 35 in the second pixel row is read out to the photosensor output signal line 25.

From the above operation, in the first frame, the precharge signal Vp is applied to the odd pixel rows. In the even-numbered pixel row, the output of the photosensor 35 is read out. In the second frame following the first frame, the precharge signal Vp is applied to the even-numbered pixel rows. The output of the photosensor 35 is read out from the odd pixel rows. Accordingly, the exposure time Tc can be set to one frame or more.
(14-2) Modification Example of the First Modification Example The first modification example is limited to sequentially applying the precharge signal Vp to each pixel row and sequentially reading the output of the photosensor 35 from each pixel row. It is not something. For example, one pixel row may be skipped, or a plurality of pixel rows may be skipped. Alternatively, the precharge signal Vp may be applied and the output of the photosensor 35 may be read out by randomly skipping pixel rows. In addition, the above operation may be performed in units of pixel columns.
(15) Second Modification Example FIG. 29 shows a second modification example. As shown in FIG. 29, the application of the precharge signal Vp (transistor 32a operates) and the reading of the photosensor 35 (transistor 32c operates) in 1H (one horizontal scanning period), that is, in one pixel row unit. This is a technical category of the embodiment.

  FIG. 29A shows an embodiment in which the time t1 (exposure time Tc) from the application of the precharge signal Vp by the transistor 32a to the state output of the photosensor 35 by the transistor 32c is relatively short in the time of 1H period.

FIG. 29B shows an embodiment in which the time t2 (exposure time Tc) between the application of the precharge signal Vp by the transistor 32a and the state output of the photosensor 35 by the transistor 32c is relatively long. As described above, in the present embodiment, the exposure time Tc can be freely set or adjusted by controlling the gate driver circuit 12b (including OEV terminal control).
(16) Third Modification FIG. 30 shows a third modification. As shown in FIG. 30, the application of the precharge signal Vp (the transistor 32a operates) and the reading of the photosensor 35 (the transistor 32c operates) are performed in units of 1F (1 field or 1 frame) in this embodiment. It is a technical category.

  FIG. 30A shows the time from the application of the precharge signal Vp by the transistor 32a to the state output of the photosensor 35 by the transistor 32c in the time of 1F period, where nH is an integer of 1 or more and n <= 1F. In this embodiment, the number of horizontal scanning lines is changed.

FIG. 30B shows an embodiment in which the time mF (m is an integer of 1 or more) between the application of the precharge signal Vp by the transistor 32a and the state output of the photosensor 35 by the transistor 32c is variable.
(Second Embodiment)
FIG. 31 shows a pixel configuration in the second embodiment. Note that the transistor 32a, the transistor 32c, the transistor 312 and the like are illustrated as switches for ease of explanation. Further, the common signal line 38 is indicated by a ground (GND) symbol.
(1) Configuration of Pixel In FIG. 31, a gate signal line 22d is a signal line controlled by the gate driver circuit 12b. When the on voltage of the gate signal line 22d is applied, the transistor 312 is turned on. When the transistor 312 is turned on, the Vr potential is applied to the photosensor output signal line 25.

  The Vr voltage is preferably matched with the precharge signal Vp. At the same time as applying the precharge signal Vp to the precharge signal line 24, the precharge signal Vp is also applied to the photosensor output signal line 25. In order to apply the precharge signal Vp to the photosensor output signal line 25, the transistor 312 is closed. Further, the transistor 312 may be closed and the precharge signal Vp may be applied to the photosensor output signal line 25 before the transistor 32c is closed and the operation state of the transistor 32b is taken out.

  As a method of applying the precharge signal Vp to the photosensor output signal line 25, the photosensor processing circuit 18 may generate the precharge signal Vp and apply the precharge signal Vp to the photosensor output signal line 25. As another example, the Vr potential is a GND potential as an example. The Vr potential is, for example, the precharge signal Vp or a voltage in the vicinity thereof. The Vt voltage is supplied to the reset signal line 311.

  In the above embodiment, the GND potential and the precharge signal Vp are applied to the photosensor output signal line 25 by closing the transistor 312. However, the potential is not limited to the GND potential and the precharge signal Vp, and other potentials may be used. For example, a voltage near the Vt voltage of the transistor 32b is exemplified. Further, the comparison voltage Vref voltage of the comparator circuit 155 is exemplified. The Vr potential applied by the transistor 312 is preferably configured to be variable or adjustable. The variable can be digitally controlled by adding an electronic volume.

  By applying the Vr voltage, the potential of the photosensor output signal line 25 becomes the Vr potential. After applying the Vr potential, the transistor 32c of the photosensor pixel 27 is turned on, and the potential of the photosensor 35 is read. Therefore, an output change that turns on the transistor 32c appears on the photosensor output signal line 25, but the change always changes from the Vt potential. Therefore, it is stably applied to the comparator circuit 155.

  The application of the Vt voltage is also preferably performed when the use of the flat display device is started. It is also preferable to carry out at the beginning of one frame. Moreover, you may implement at the beginning of 1H. That is, it is preferable to carry out at the beginning of a certain break.

The comparator signal line 314 for applying the Vref voltage is applied to all the comparator circuits 155 in common. However, the present embodiment is not limited to this. For example, when a plurality of voltage output terminals 152 are provided as shown in FIG. 17, a plurality of comparator signal lines 314 may be formed or arranged. The same applies to the reset signal line 311.
(2) Modification Example of Comparator Circuit 155 A plurality of comparator circuits 155 may be formed for one photosensor output signal line 25. The characteristics of the plurality of comparator circuits 155 to be formed are different.

  As an example, two types of photosensor pixels 27 are formed, and the characteristics of the photosensors 35 of the photosensor pixels 27 are made different. Photosensors are configured with different sensitivities depending on the light intensity. A plurality of comparator circuits 155 are provided corresponding to the sensitivity of the photosensor.

  Further, the characteristics of the transistor 32b of the photosensor pixel 27 are made different. A plurality of comparator circuits 155 are provided corresponding to the different transistors 32b.

  For example, the transistors 32b of the different photosensor pixels 27 and the different photosensors 35 are configured to be different for each pixel row in the display area 10. Then, a different output signal level is output to the photosensor output signal line 25 every 1H. By selecting a comparator circuit 155 having a different output signal level, the level can be determined satisfactorily.

  A configuration in which the transistors 32b of the different photosensor pixels 27 and the different photosensors 35 are divided and formed above and below the display region 10 is also exemplified. In this case, different output signal levels are output to the photosensor output signal line 25 at the top and bottom of the screen (upper half display area and lower half display area). By selecting a comparator circuit 155 having a different output signal level, the level can be determined satisfactorily.

  In FIG. 32A, two comparator circuits 155a and 155b are formed for one photosensor output signal line 25. FIG. The common comparator voltage Vref is applied to the two comparator circuits 155a and 155b. However, the present invention is not limited to this, and the comparator voltage Vref may be different.

  Which of the two comparator circuits 155a and 155b is selected and output to the voltage output terminal 152 is selected by the switches Sa and Sb. The signal processing circuit 15 controls the switches Sa and Sb. When the switch Sa is closed, the output of the comparator circuit 155a is output to the output terminal 152. When the switch Sb is closed, the output of the comparator circuit 155b is output to the output terminal 152.

  FIG. 32B shows a configuration in which one comparator circuit 155 is formed for one photosensor output signal line 25. The difference from FIG. 16 is that two comparator voltages Vref can be selected. Comparator voltages Vref1 and Vref2 are applied to the comparator signal lines 314a and 314b. The Vref voltage can be varied in 64 steps with a 6-bit electronic volume 261b (see FIG. 33).

  In FIG. 33, the Vref voltage applied to the comparator signal line 314 can be varied by 6 bits (64 steps) by the electronic volume 261b. The Vref voltage is adjusted so as to be a good value in accordance with the characteristics of the photo sensor 35 and the transistor 32b. Further, by selecting the switches Sa and Sb, the optimum Vref voltage can be instantaneously applied to the comparator circuit 155.

  The Vref voltage applied to the comparator circuit 155 is compared with the voltage of the photosensor output signal line 25, and an output voltage is output to the output terminal 152. Which of the two Vref voltages is selected is selected by the sensor processing circuit 15. When the switch Sa is closed, the voltage Vref1 is applied to the comparator circuit 155. When the switch Sb is closed, the Vref2 voltage is applied to the comparator circuit 155.

  FIG. 34 shows an embodiment in which the potential of the common signal line 38 can be changed. In FIG. 34, the adjustment is made with the volume circuit composed of R, but the present invention is not limited to this, and the adjustment may be made with the electronic volume 261.

  In the above embodiment, the Vref voltage is changed by the electronic volume 261. However, the precharge signal Vp may also be changed by the electronic volume. For example, as shown in FIG. 33, the precharge signal line 24 is configured so that an 8-bit (256 steps) precharge signal Vp can be applied by the electronic volume 261a.

It should be noted that the precharge signal Vp has a smaller step (higher accuracy) than the comparator voltage. In this embodiment, the precharge signal Vp is 8 bits and the comparator voltage is 6 bits. This is because the comparator voltage Vref is a comparison voltage and does not require accuracy, but the precharge signal Vp needs to be finely adjusted or set in accordance with the sensitivity of the photosensor 35 and the exposure time Tc.
(Third embodiment)
The above embodiment is an embodiment in which one potential of the photosensor 35 is set to GND (a ground potential or a predetermined fixed potential). However, the present embodiment is not limited to this.

  For example, as shown in FIG. 35, the common signal line 38 may be connected to the gate driver circuit 12c and changed or changed. For example, the potential of the common signal line 38 may be changed in accordance with the polarity of the video signal output from the source driver circuit 14 (see FIG. 18). This is because the video signal applied to the source signal line 23 is coupled with the photosensor output signal line 25 and the like, and the output is changed. The influence of this coupling can be reduced or eliminated by changing the potential of the common signal line 38 in synchronization with or in accordance with the polarity of the video signal.

  As an example, when the polarity of the video signal is positive, the potential of the common signal line 38 is Vc1, and when the polarity of the video signal is negative, the potential of the common signal line 38 is Vc2. As described above, when the potential is set to the common signal line 38, Vc1 and Vc2 are repeatedly set (applied) for the potential of the common signal line 38 for each pixel row. Even if the characteristics of the photosensor 35 and the transistor 32b are the same, the Vt voltage of the transistor 32b can be relatively changed by changing the potential of the common signal line 38. This is because the GND potential of the photo sensor 35 or the like changes. Therefore, by applying a plurality of potentials of the common signal line 38 such as the formed photosensor 35, the same state as that of forming a photosensor having a plurality of sensitivities to external light is obtained.

  In the configuration of FIG. 33 and the like, the transistor 32b and the photosensor 35 have been described as having the same potential (Vr), but the present embodiment is not limited to this. For example, the terminal a of the transistor 32b may be set to the potential Vr1, and the terminal b of the photosensor 35 may be changed to Vr2. If the potential of Vr2 is higher than Vr1, the same effect as the Vt of the transistor 32b becomes relatively high is obtained. Therefore, even if the formed photosensor 35 and the like have the same characteristics, there is an effect in the same state as when a photosensor having a plurality of sensitivities to external light is formed. Further, the configuration may be such that the potential of Vr1 is a fixed potential, Vr2 is supplied from the common signal line 38, and the common signal line 38 is driven by the gate driver 12c.

The potential output from the gate driver circuit 12c is not limited to a plurality. For example, the voltage applied to the common signal line 38 is one, and this one voltage may be changed corresponding to the characteristics of the photosensor 35, the exposure time Tc, and the characteristics of the transistor 32b. Other configurations are the same as or similar to the configurations in FIG.
(1) Relationship between exposure time Tc and precharge signal Vp In the above embodiments, the sensitivity to external light is adjusted mainly by changing the precharge signal Vp. Also, the sensitivity is adjusted by changing the precharge signal Vp with respect to the exposure time Tc.

  FIG. 36 is an explanatory diagram of this. The leak amount of the photo sensor 35 increases as the outside light increases. In addition, the electric charge is discharged in proportion to the exposure time Tc. Assuming that a constant voltage is applied to the precharge signal Vp, the exposure time Tc is shortened when the external light to the photosensor 35 is strong in order to adjust the precharge signal Vp so as to change to approximately Vt of the transistor 32b. When the external light to the photosensor 35 is weak, the exposure time Tc is lengthened. The above relationship is illustrated in FIG. Therefore, when the external light is very strong, the exposure time Tc is made extremely short. Further, when the sensitivity of the photosensor 35 is very good with respect to outside light, the exposure time Tc is shortened.

  Even if the exposure time Tc is shortened, the gate terminal voltage of the transistor 32b immediately reaches the Vt voltage or less, and the change signal to the photosensor output signal line 25 may not be discriminated. For example, this is a case where the output of the transistor 32b of the full screen is output as an off state. That is, the output from the display panel of the present embodiment is in a state where the same imaging data cannot be obtained.

  In this case, the precharge signal Vp is set higher by the electronic volume 261a. By setting the precharge signal Vp voltage high, it takes a long time to reach the Vt voltage of the transistor 32b, so that imaging data (captured image data, object shadow, etc.) can be obtained.

  Even if the exposure time Tc is increased, the gate terminal voltage of the transistor 32b is far from the Vt voltage or less, and the change signal to the photosensor output signal line 25 may not be discriminated. For example, this is a case where the output of the transistor 32b of the full screen is output as an ON state. That is, the output from the display panel of the present embodiment is in a state where the same imaging data cannot be obtained. In this case, the precharge signal Vp is set lower by the electronic volume 261a.

  By setting the precharge signal Vp voltage low, the time taken to reach the Vt voltage of the transistor 32b is shortened, so that imaging data (captured image data, object shadow, etc.) can be obtained. A better result is obtained when the exposure time Tc is within one field (one frame). This is presumably because it is not easily affected by the coupling from the source signal line 23 to which the video signal is applied. This is because the polarity of the video data is inverted every field (one frame), and the potential of the photosensor 35 is distorted due to the effect of the inversion.

As described above, the present embodiment is characterized in that imaging data is obtained by adjusting or setting the exposure time Tc (control of the gate driver circuit 12b) and the precharge signal Vp. Also, the comparator voltage Vref is basically set to a fixed value.
(2) Matrix processing The photosensor 35 is formed in the same process (same process) as the pixel 26. The process used to form the photosensor 35 is polysilicon technology. The semiconductor film by polysilicon technology is formed by laser annealing technology. Therefore, the characteristics vary greatly depending on the temperature distribution of the laser beam. In this embodiment, matrix processing is performed as shown in FIG.

  Matrix processing counts the output of the photosensor pixels 27 in the matrix and performs signal processing based on the count value. As described with reference to FIG. 33 and the like, it is assumed that the present embodiment is binarized by the comparator circuit 155 and the like.

  In the laser annealing method or the like, the characteristics of the transistor 32b and the photosensor 35 are characteristic distributions having an inclination from one direction of the display area to the other direction. In order to correct this characteristic distribution, the region where the photosensor 35 is formed is irradiated with uniform external light, the exposure time Tc is constant, the precharge signal Vp is constant, and the output of the transistor 32b for each matrix. Are counted and added.

  Assume that the output from the voltage output terminal 152 is converted into binary data (on (1), off (0)) by the comparator circuit 155. For example, in a 10 × 10 matrix, the count value ranges from 0 to 100. This count value is totaled for each photosensor 35 in the matrix and stored (calibrated count value).

  Data picked up by the display device of the present embodiment is also processed in the same matrix section, and a difference process is performed on the previously calibrated count value at a constant ratio from the processed count value. Since the characteristic distribution of the photo sensor 35 and the like is subtracted from the performed data, good imaging data can be obtained.

  As described above, the influence of the distribution of the photosensor 35 and the transistor 32b is removed or reduced in the data resulting from the difference processing. In addition, the dispersion due to the characteristic distribution of the small region is subjected to matrix processing, and the output data of the matrix is handled as one data, so that it is averaged as a result. Therefore, it is not affected by variations in characteristics of the photosensor 35 and the transistor 32b. For example, even if a small number of transistors 32b having a low laser shot and a high Vt voltage are distributed in the matrix and the transistors 32b of other photosensor pixels 27 are good, a small number of the transistors 32b having a high Vt voltage There is no effect.

  As shown in FIG. 37 (a), the matrix processing is exemplified by a method of matrixing in a checkered pattern. FIG. 37A shows an implementation of 4 × 4 matrix processing. In particular, it is preferable that the number of photosensors 35 included in the block BL is 25 or more, such as 5 × 5. Furthermore, it is preferable that the configuration is 50 or more, such as 8 × 8. Furthermore, it is preferable to configure the number to be 100 or more, such as 10 × 10. However, as in 35 × 35, the number of photosensors included in the matrix should not exceed 1000.

  In the above embodiment, processing is performed by dividing into nxn matrices, but the concept of the matrix is not limited to this. For example, as shown in FIG. 37 (b), BL is partitioned in the vertical direction. This division is also a technical category of the matrix of the present embodiment. In FIG. 37 (b), it is divided into a matrix in units of three pixel columns. The horizontal direction (pixel row direction) may be divided into a matrix.

Of course, as shown in FIG. 17, when the signal processing is performed directly without using the comparator circuit 155, or analog data is converted into multi-bit digital data, the analog data is averaged by a low-pass filter ( DC). Digital data may be processed as data in the corresponding matrix range by adding.
(Fourth embodiment)
Hereinafter, another pixel configuration will be described as a fourth embodiment. Although the pixel configuration will be described, the configurations, methods, and operations of the previously described embodiments are applied to other configurations.

FIG. 38 is an equivalent circuit diagram of the pixel of the fourth embodiment. The transistor 32b operated by the Vt voltage is composed of an N-channel transistor 32bn and a P-channel transistor 32bp. That is, the transistor 32b has a P-channel and N-channel CMOS configuration. The P-channel transistor 32bp or transistor 32bn is operated by the potential at the point a. When the transistor 32c is turned on, the potential at the point b changed by the operation of the P-channel transistor 32bp or the N-channel transistor 32bn is output to the photosensor output signal line 25.
(Fifth embodiment)
FIG. 39 shows an embodiment in which a transistor 32d for short-circuiting the input a and the input b is formed in the inverter circuit composed of the transistor 32bp and the transistor 32bn. The gate terminal of the transistor 32d is connected to the gate signal line 22d. When the ON voltage is applied to the gate signal line 22d, the transistor 32d is closed, and the input a and output b of the inverter circuit are short-circuited.

  Due to the short circuit, the input terminal and the output terminal of the inverter circuit become an intermediate potential. By setting the intermediate potential, an inverter offset state is set. Therefore, the transistor 32 bp and the transistor 32 bn are not easily affected by variations in characteristics.

Note that depending on the characteristics of the P-channel transistor 32 bp and the transistor 32 bn, the case where both the P-channel transistor 32 bp and the N-channel transistor 32 bn operate is also in the technical category of this embodiment. This is because there is no problem in that the potential change of b is output to the photosensor output signal line 25. Other configurations are the same as or similar to those of the above-described embodiment, and thus description thereof is omitted.
(Sixth embodiment)
FIG. 40 shows a fifth embodiment in which the photosensor 35 is constituted by an N-channel transistor 32bn and a P-channel transistor 32bp.

  That is, the photosensor 35 is configured by connecting in series a P-channel and N-channel diode-connected transistor. Variations in the characteristics of the P-channel transistor 35p and transistor 35n are compensated for, and the characteristic variations are suppressed as a whole.

  In the configuration of FIG. 40, each of the P-channel transistor 324p and the N-channel transistor 35n is constituted by one, but this embodiment is not limited to this, and the N-channel transistor 35n and the P-channel transistor are not limited thereto. 35p may form or arrange each plurality.

The photosensor 35 may be composed of a plurality of N-channel transistors 35n. The photosensor 35 may be composed of a plurality of P-channel transistors 35p. Other configurations are the same as or similar to those of the above-described embodiment, and thus description thereof is omitted.
(Seventh embodiment)
FIG. 41 shows a sixth embodiment in which the photosensor output signal line 25 is shared with the source signal line 23R for applying the R video signal.

  The R video signal and the output (photosensor output) of the transistor 32c are multiplexed on the source signal line 23R. The selection of the gate signal line 22 b is performed at a timing when the video signal is not applied to the source signal line 23.

FIG. 41 shows a configuration in which the precharge signal line 24 is shared with the source signal line 23B for applying the B video. The precharge signal Vp and the B video signal are multiplexed on the source signal line 23B. The selection of the gate signal line 22 c is performed at a timing when the video signal is not applied to the source signal line 23. Other configurations are the same as or similar to those of the above-described other embodiments, and thus description thereof is omitted.
(Example of change)
(1) First Modification In the above embodiment, the photosensor output signal line 25 and the source signal line 23R for applying the R image are described as being common. However, the present embodiment is not limited to this. .

For example, the photosensor output signal line 25 may be shared with the source signal line 23G for applying the G video. Further, the photosensor output signal line 25 may be shared with the source signal line 23B for applying the B image. That is, this embodiment is characterized in that the photosensor output signal line 25 is shared with other signal lines such as a video signal line, and the video signal and the photosensor output are multiplexed on the common signal line.
(2) Second Modified Example In the above embodiment, the photosensor output signal line 25 and the source signal line 23 for applying the video are described as being shared. However, the present invention is not limited to this. For example, the photosensor output signal line 25 The common signal line 38 and the like may be shared.
(3) Third Modification FIG. 9 shows an embodiment in which the fifth embodiment and the embodiment of FIG. 35 are combined.
(4) Fourth Modification FIG. 42 shows an embodiment in which the transistor 32b is configured by a P-channel transistor. One terminal of the transistor 32b is connected to the positive power supply Vdd, and the other end is connected to the transistor 32c. Other configurations are the same as those of the embodiment of FIGS.
(5) Fifth Modification In the above embodiment, the precharge signal line 24 and the source signal line 23B for applying the B video are described as being common. However, the present embodiment is not limited to this. .

For example, the precharge signal line 24 may be shared with the source signal line 23G for applying the G video. Further, the precharge signal line 24 may be shared with the source signal line 23B for applying the B video. That is, this embodiment is characterized in that the precharge signal line 24 is shared with other signal lines such as a video signal line, and the video signal and the precharge signal Vp are multiplexed on the common signal line. .
(6) Sixth Modification In the above embodiment, the precharge signal line 24 and the source signal line 23 to which the video is applied have been described in common. However, the present invention is not limited to this. For example, the precharge signal line 24 The common signal line 38 and the like may be shared.
(7) Seventh Modification The video signal, the precharge signal Vp, and the photosensor output may be multiplexed by sharing the precharge signal line 24, the source signal line 23 for applying the video signal, and the photosensor output signal line 25. .
(8) Eighth Modification FIG. 43 shows that the photosensor output signal line 25 is made common to the source signal line 23R for applying the R image, the precharge signal line 24 is made common to the source signal line 23 for applying the image, The common signal line 38 of the GND potential of the photosensor 35 is made common with the source signal line 23G for applying the G video.

  Since the video signal applied to the source signal line 23 is alternately applied with positive polarity and negative polarity every 1H, even if the GND potential of the photosensor 35 fluctuates, it is fixed to a direct current (DC) potential on average. Thus, the potential is maintained.

  The R video signal and the output (photosensor output) of the transistor 32c are multiplexed on the source signal line 23R. The selection of the gate signal line 22 b is performed at a timing when the video signal is not applied to the source signal line 23. The precharge signal line 24 is configured in common with the source signal line 23B for applying the B video. The precharge signal Vp and the B video signal are multiplexed on the source signal line 23B. The selection of the gate signal line 22 c is performed at a timing when the video signal is not applied to the source signal line 23. Other configurations are the same as or similar to the embodiment described with reference to FIG.

  FIG. 44 is a timing chart in the pixel configuration of FIG. During the first t4 period of 1H, the gate signal line 22c is selected, the transistor 32a is turned on, and the precharge signal Vp is applied to the photosensor 35.

  The next period t1 is a period in which the SW selects the a terminal and the R video signal is output from the source driver circuit 14. The next period t 2 is a period in which the SW of the switching circuit 172 selects the b terminal and the G video signal is output from the source driver circuit 14. In the next t3 period, the SW of the switching circuit 172 selects the c terminal, and the source driver circuit 14 outputs the B video signal. Therefore, the B video signal is applied to the B source signal line 23.

  At the last timing of 1H, an on-voltage is applied to the gate signal line 22b, the transistor 32c is turned on, the transistor 32c of the photosensor pixel 27 is turned on, and the output of the transistor 32b is output to the photosensor output signal line 25.

By making the periods t1, t2, t3, t4, and t5 the same, the circuit configuration of the photosensor processing circuit 18 and the like is facilitated. In addition, it is preferable to secure a period t6 between the periods t1, t2, t3, t4, and t5. This is because the period during which each switch SW and transistor 32 is switched from the on state to the off state and the switching period are unstable.
(9) Ninth Modification FIG. 45 shows a configuration in which the common signal line 38 is shared with the gate signal line 22a. The gate signal line 22a is applied with an on-voltage for a period of 1H in one field (one frame). The off voltage is applied during other periods. Therefore, it can be considered that the potential of the gate signal line 22a is maintained at a fixed potential.

  As shown in FIG. 45, even if the common signal line 38 is shared with the gate signal line 22a, one terminal of the photosensor 35 and the transistor 32b is in the GND ground state. Therefore, it hardly affects the photosensor output due to potential fluctuation. However, the gate signal line 22a, the gate signal line 22b, and the gate signal line 22c are not simultaneously selected in the pixel 16 having the display pixel 26 and the photosensor pixel 27 or in the pixel 16 located in the pixel row adjacent to the pixel 16. Timing processing needs to be performed. Preferably, in the pixel 16, timing processing is performed so that the gate signal line 22b and the gate signal line 22c of the corresponding pixel 16 are not selected during a horizontal scanning period of 2H or more before and after the gate signal line 22a is selected. Other configurations are the same as or similar to the embodiment described with reference to FIG.

The first to ninth modifications described above are also applied to other embodiments of the present invention. Needless to say, it can be combined with other embodiments.
(Eighth embodiment)
FIG. 46 shows a pixel configuration in which offset cancellation is performed to compensate for the characteristic variation of the transistor 32b.

  By canceling the offset, the transistor 32b can be operated based on the cutoff voltage. Therefore, the Vt variation of the transistor 32b can be compensated, and a stable photosensor output can be obtained. The drain terminal D of the transistor 32b has a Vbb voltage and is separated from the common signal line 38 connected to the photosensor 35. The separation enables the Vbb voltage potential of the transistor 32b to be freely set or adjusted, and the reset operation of the transistor 32b is facilitated.

  In FIG. 46, before applying the precharge signal Vp, an on-voltage is applied to the gate signal line 22d, and the transistor 32d is turned on. When the transistor 32d is turned on, the drain terminal D and the gate terminal G of the transistor 32b are short-circuited. Due to a short circuit between the gate terminal G and the drain terminal D, the transistor 32b is reset to the Vt voltage. That is, the voltage at the gate terminal G of the transistor 32b is set to a voltage at which current starts to flow (basically, the Vt voltage). This voltage is referred to as V0 voltage. At this time, a predetermined potential V1 is applied to the precharge signal line.

  The potential of the gate terminal G is the potential of the photosensor 35. Next, an on-voltage is applied to the gate signal line 22 c and a precharge signal Vp is applied to the precharge signal line 24. The transistor 32 a is turned on, and the precharge signal Vp is applied to the photosensor 35 via the coupling capacitor 461. That is, the voltage V2 added to the V0 voltage is applied to the gate terminal of the transistor 32b. The V2 voltage is basically correlated or proportional to the V1 voltage. V1 is divided by a capacitor 461, a capacitor 34, and the like to become a V2 voltage.

  With the above operation, the V2 voltage is applied to the gate terminal of the transistor 32b. An off voltage is applied to the gate signal line 22c. Therefore, the transistor 32a is turned off, and the voltage V2 is held at one terminal of the photosensor 35.

Subsequent operations are the same as in the other embodiments. That is, the photo sensor 35 leaks due to external light, and the V2 voltage decreases. When the V2 voltage becomes equal to or lower than the Vt voltage of the transistor 32b, the transistor 32b is turned off. By turning on the transistor 32c, the state of the transistor 32b is output to the photosensor output signal line 25.
(1) First Modification Example FIG. 47 is a modification example of FIG. The drain terminal D of the transistor 32b and the common signal line 38 are connected. The common signal line 38 is connected to the gate driver circuit 12c. The other configurations are the same as or similar to the embodiment described with reference to FIG.
(2) Second Modified Example FIG. 48 is a modified example of FIG. The transistor 32d is a P-channel transistor. The other configurations are the same as or similar to the embodiment described with reference to FIG.
(3) Third Modification FIG. 49 is a modification of FIG. In FIG. 49, a transistor 32d for short-circuiting the gate terminal and the source terminal of the transistor 32b is provided. One terminal of the photosensor 35 is fixed to a predetermined potential (ground potential).

The above first, second and third modification examples are also applied to other embodiments of the present invention. Needless to say, it can be combined with other embodiments.
(Ninth embodiment)
Next, a ninth embodiment will be described. FIG. 50 shows a ninth embodiment in which the transistor 32b of FIG. 46 is replaced with an inverting circuit (inverter) 501. In FIG.

FIG. 50 shows an embodiment in which an inverter offset cancel circuit is configured to compensate for the characteristic variation of the transistor 32b of the photosensor pixel 27. By canceling the offset, the cutoff voltage can be set based on the reference.
(1) Configuration of Inverting Circuit 501 As shown in FIG. 38, the inverting circuit 501 includes a P-channel transistor and an N-channel transistor. Although the inverter circuit 501 is described as operating with Vdd and Vss power supplies, the invention is not limited to this, and the inverter circuit 501 may be operated with the Vdd power supply and the common signal line 38 potential. Further, it may be operated at another potential.

The P-channel transistor or N-channel transistor of the inverting circuit 501 operates by the potential at the point a of the inverting circuit 501 and is output to the point b. That is, the voltage output to the point b changes depending on the potential at the point a. The voltage at the point b is output to the photosensor output signal line 25 by turning on the transistor 32c.
(2) Contents of Operation The gate signal line 22c is controlled by the gate driver circuit 12. Further, the gate terminal of the P channel transistor 32dp is connected to the gate signal line 22d. When an on-voltage is applied to the gate signal line 22d, the P-channel transistor 32dp is turned on (the channel between the transistors 32dp is closed). When the off voltage is applied to the gate signal line 22d, the P-channel transistor 32dp is turned off (the channel between the transistors 32dp is opened).

  When the inverting circuit 501 is offset, a turn-on voltage is applied to the gate signal line 22d and the P-channel transistor 32dp is turned on (the channel between the transistors 32dp is closed). In other operating states, a turn-off voltage is applied to the gate signal line 22d, and the P-channel transistor 32dp is turned off (the channel between the transistors 32dp is opened).

  As described above, the transistor 32dp operates with the on-voltage applied to the gate signal line 22d. In the transistor 32dp, the impedance between the channels decreases due to the application of the ON voltage, and the a terminal and the b terminal of the inverting circuit 501 are short-circuited. Therefore, the inverting circuit 501 is reset.

  After the above reset operation, the off voltage of the gate signal line 22dp is applied. Then, the transistor 32dp is opened between the channels by applying the off voltage, and the a terminal and the b terminal are disconnected.

  In FIG. 50, before applying the precharge signal Vp, an ON voltage is applied to the gate signal line 22dp, and the transistor 63dp is turned on. When the transistor 32dp is turned on, the drain terminal D and the gate terminal G of the transistor 32bp are short-circuited. Due to a short circuit between the gate terminal G and the drain terminal D, the inverting circuit 501 is reset to the Vt voltage. That is, the inverting circuit 501 is set to a voltage at which current starts to flow (basically, the Vt voltage). This voltage is referred to as V0 voltage. At this time, a predetermined potential V1 is applied to the precharge signal line.

  The potential of the gate terminal G is the potential of the photosensor 35. Next, an on-voltage is applied to the gate signal line 22 c and a precharge signal Vp is applied to the precharge signal line 24. The transistor 32 a is turned on, and the precharge signal Vp is applied to the photosensor 35 via the coupling capacitor 461. That is, the voltage V2 added to the V0 voltage is applied to the gate terminal of the transistor 32b. The V2 voltage is basically correlated or proportional to the V1 voltage. V1 is divided by a capacitor 461, a capacitor 34, and the like to become a V2 voltage.

  With the above operation, the V2 voltage is applied to the gate terminal of the transistor 32b. An off voltage is applied to the gate signal line 22c. Therefore, the transistor 32a is turned off, and the voltage V2 is held at one terminal of the photosensor 35.

Subsequent operations are the same as in the other embodiments. That is, the photosensor 35 leaks due to external light, and the V2 voltage decreases. If the V2 voltage is equal to or higher than the Vt voltage of the inverting circuit 501, the potential at the point b changes correspondingly. By turning on the transistor 32c, the state of the transistor 32b is output to the photosensor output signal line 25. Other configurations are the same as or similar to those of the above-described embodiment, and thus description thereof is omitted.
(3) First Modified Example As a modified example, a configuration in which the transistor 32dn illustrated within the dotted line in FIG. 50 is added will be described. In the case of this configuration, the GND terminal of the photosensor 35 is not necessary. This is because the transistor 32dn is grounded to GND. The gate signal line 22c is controlled by the gate driver circuit 12.

  The gate terminal of the P channel transistor 32dp and the transistor 32dn is connected to the gate signal line 22d. When an on voltage is applied to the gate signal line 22d, the P-channel transistor 32dp is turned on (the channel between the transistors 32dp is closed), and the N-channel transistor 32dn is turned off (the channel between the transistors 32dn is opened). When the off voltage is applied to the gate signal line 22d, the N-channel transistor 32dn is turned on (the channel between the transistors 32dn is closed), and the P-channel transistor 32dp is turned off (the channel between the transistors 32dp is opened). That is, the P channel transistor 32dp and the N channel transistor 32dn operate in reverse.

  When the inverting circuit 501 is offset, a turn-on voltage is applied to the gate signal line 22d and the P-channel transistor 32dp is turned on (the channel between the transistors 32dp is closed). At this time, the N-channel transistor 32dn is turned off (the channel between the transistors 32dn is opened). In other operating states, a turn-off voltage is applied to the gate signal line 22d, the N-channel transistor 32dn is turned on (the channel between the transistors 32dn is closed), and the P-channel transistor 32dp is turned off (the channel between the transistors 32dp is open). ).

  As described above, the transistor 32dp and the transistor 32dn operate with the on-voltage applied to the gate signal line 22d. In the transistor 32dp, the impedance between the channels decreases due to the application of the ON voltage, and the a terminal and the b terminal of the inverting circuit 501 are short-circuited. Therefore, the inverting circuit 501 is reset, both terminals of the photosensor 35 are short-circuited, and the electric charge of the capacitor 34 is discharged.

  After the above reset operation, the off voltage of the gate signal line 22dp is applied. Then, the transistor 32dp is opened between the channels by applying the off voltage, and the a terminal and the b terminal are disconnected. On the other hand, the transistor 32dn is turned on, the c terminal of the photosensor 35 is connected to the common signal line 38, and the potential of the common signal line 38 is applied. , And the a terminal and the b terminal of the inverting circuit 501 are short-circuited. Therefore, the inverting circuit 501 is reset, both terminals of the photosensor 35 are short-circuited, and the electric charge of the capacitor 34 is discharged.

Other configurations are the same as or similar to those of the above-described embodiment, and thus description thereof is omitted.
(4) Second Modified Example FIG. 51 is a modified example in which the common signal line 38 is shared with the gate signal line 22a in the inverter offset circuit of FIG.

Other configurations are the same as or similar to those of the above-described embodiment, and thus description thereof is omitted.
(5) Third Modification Example FIG. 52 is also a third modification example of the offset cancel circuit. In FIG. 52, before applying the precharge signal Vp, an ON voltage is applied to the gate signal line 22e to turn on the transistor 32e. The transistor 32e discharges the charge at point b.

  Next, the ON voltage of the gate signal line 22d is applied. When the transistor 32d is turned on, the drain terminal D and the gate terminal G of the transistor 32b are short-circuited. Due to a short circuit between the gate terminal G and the drain terminal D, the transistor 32b is reset to the Vt voltage. That is, the voltage at the gate terminal G of the transistor 32b is set to a voltage at which current starts to flow (basically, the Vt voltage). This voltage is referred to as V0 voltage. At this time, a predetermined potential V1 is applied to the precharge signal line.

  The potential of the gate terminal G is the potential of the photosensor 35. Next, an on-voltage is applied to the gate signal line 22 c and a precharge signal Vp is applied to the precharge signal line 24. The transistor 32 a is turned on, and the precharge signal Vp is applied to the photosensor 35 via the coupling capacitor 461. That is, the voltage V2 added to the V0 voltage is applied to the gate terminal of the transistor 32b. The V2 voltage is basically correlated or proportional to the V1 voltage. V1 is divided by a capacitor 461, a capacitor 34, and the like to become a V2 voltage.

  With the above operation, the V2 voltage is applied to the gate terminal of the transistor 32b. An off voltage is applied to the gate signal line 22c. Therefore, the transistor 32a is turned off, and the voltage V2 is held at one terminal of the photosensor 35.

  Subsequent operations are the same as in the other embodiments. That is, the photosensor 35 leaks due to external light, and the V2 voltage decreases. When the V2 voltage becomes equal to or lower than the Vt voltage of the transistor 32b, the transistor 32b is turned off. By turning on the transistor 32c, the state of the transistor 32b is output to the photosensor output signal line 25. Since other configurations are the same as or similar to the above-described embodiment, the description thereof is omitted.

The first, second, and third modifications described above are also applied to other embodiments of the present invention. Needless to say, it can be combined with other embodiments.
(Tenth embodiment)
The intensity of outside light ranges widely from 1 lux to 100,000 lux. A photo sensor 35 is formed on the array substrate 11. Since the sensitivity of the photosensor 35 is determined by the size of the photosensor and the semiconductor film characteristics, adjustment to the exposure time Tc, adjustment of the precharge signal Vp, etc. is performed in order to cope with a wide range of external light. In the present embodiment, a pixel configuration for dealing with a wider range of outside light will be described.

  In the ninth embodiment shown in FIG. 53, a plurality of transistors 32a for applying the precharge signal Vp are formed.

A resistor R is formed in series with the transistor 32a. The resistor R is formed by a diffused resistor. A resistor R1 is formed in series with the transistor 32a1, and a resistor R2 is formed in series with the transistor 32a2. Even if the time for turning on the transistors 32a1 and 32a2 is the same, the precharge signal Vp written to the photosensor 35 becomes smaller as the impedance of the resistor R (R1, R2) is higher. Therefore, by making the resistance values of R1 and R2 different, the precharge signal Vp when the transistor 32a1 is turned on and the precharge signal Vp when the transistor 32a2 is turned on can be made different. The necessary exposure time Tc can be varied by the precharge signal Vp. Therefore, the sensitivity range of external light can be expanded by FIG.
(1) First Modification By making the ON voltage applied to the gate terminal of the transistor 32a1 different from the ON voltage applied to the gate terminal of the transistor 32a2, the resistance values of R1 and R2 are equivalently made different. Can do.

For example, when the transistor 32a is an N channel, the higher the ON voltage to be applied, the lower the impedance between the channels (the resistance R becomes smaller). The closer the applied ON voltage is to the Vt voltage, the higher the impedance between the channels of the transistor 32a (the resistance R becomes higher). In this case, it can be easily realized if the gate signal line 22c for driving the transistors 32a1 and 32a2 is formed on another gate signal line.
(2) Second Modification The embodiment of FIG. 53 has a configuration in which a plurality of transistors 32a are formed and the precharge signal Vp is variable. However, a separate switch may be formed in addition to the transistor 32a. For example, in FIG. 54, switches S1 and S2 are formed.
(3) Third Modification FIG. 54 is an embodiment in which switches S1 and S2 are formed in addition to the transistor 32c, and resistors R1 and R2 are formed.

  The resistor R1 is connected in series with the transistor 32c by the selection of the switch S1. The resistor R2 is connected in series with the transistor 32c by the selection of the switch S2. Even if the time to turn on the transistor 32c is the same, the higher the impedance of the resistor R (R1, R2), the smaller the charge output to the photosensor output signal line 25. Therefore, by making the resistance values of R1 and R2 different, the output when the transistor 32c is turned on can be made different. Therefore, the sensitivity range of external light can be expanded by FIG. Other configurations are the same as those in FIG.

The above first, second and third modification examples are also applied to other embodiments of the present invention. Needless to say, it can be combined with other embodiments.
(Eleventh embodiment)
As shown in FIG. 55A, a plurality of transistors 32b are formed, and the Vt voltage of the transistor 32b is made different by changing the WL ratio (ratio of channel width W and channel length L) of the transistor 32b. Can be made. If the Vt voltage is different and it is possible to detect which transistor 32b is operating, the intensity of external light can be known relatively.

  For example, it is assumed that the Vt voltage of the transistor 32b1 is 1.5V and the Vt voltage of the transistor 32b2 is 2.0V. The exposure time Tc is constant. If the terminal voltage at the point a of the photosensor 35 decreases to 1.5 V or less, both the transistor 32b1 and the transistor 32b2 are in the off state. Therefore, it can be detected that the terminal voltage at point a of the photosensor 35 is 1.5 V or less, and it is understood that the ambient light is strong and the leak amount of the photosensor 35 is large. If the terminal voltage at point a of the photosensor 35 decreases and is 1.5 V or more and 2.0 or less, the transistor 32b1 is in the on state, but the transistor 32b2 is in the off state.

  Therefore, it can be detected that the terminal voltage at the point a of the photosensor 35 is 1.5 V or more and 2.0 V or less, and it is understood that the external light is relatively strong. If the terminal voltage at the point a of the photosensor 35 decreases and is 2.0 V or higher, both the transistor 32b1 and the transistor 32b2 are in the on state. Therefore, it can be detected that the terminal voltage at point a of the photosensor 35 is 2.0 V or higher, the external light is weak, and the photosensor 35 hardly leaks.

  As shown in FIG. 55 (a), a plurality of transistors 32b are formed, and even if the characteristics of the plurality of transistors 32b are the same, the voltage at the drain terminal D of the transistors 32b is made different, so that the photo sensor The sensitivity to the terminal voltage of 35 can be varied.

  In FIG. 55A, the drain terminal D voltage of the transistor 32b1 is Vg1, and the drain terminal D voltage of the transistor 32b2 is Vg2. Therefore, if it can be detected which transistor 32b is operating, the intensity of external light can be known relatively. The transistor 32b to be selected is performed by the switch S (S1, S2).

For example, it is assumed that the drain terminal D voltage of the transistor 32b1 is 0V and the drain terminal D voltage of the transistor 32b2 is −2.0V. The exposure time Tc is constant. When the terminal voltage at the point a of the photosensor 35 decreases, the transistor 32b1 is turned off before the transistor 32b2. If the external light is strong and the a terminal voltage of the photosensor 35 further decreases, both the transistor 32b1 and the transistor 32b2 are turned off. When there is no external light or the light is weak, both the transistor 32b1 and the transistor 32b2 are kept on. Which transistor 32b is on can be selected by switching the switch S (S1, S2).
(1) First Modification In the above embodiment, the drain terminal D voltage of the transistor 32b is made different. In addition, as shown in FIG. 55 (b), it can be realized by forming a plurality of photosensors 35 and making the terminal voltages different. The photosensor 35 is formed by diode-connecting transistors.

  Even if a plurality of photosensors 35 are formed and the characteristics of the plurality of photosensors 35 are the same, the voltage at one terminal of the photosensor 35 is set to the Vg2 voltage and the common signal line 38 as shown in FIG. The potential is different. By selecting the switch S (S1, S2), a predetermined voltage is applied to one terminal of the photosensor 35. If the terminal voltage of the photosensor 35 is different, the amount of charge to be held is different, so that the sensitivity to external light can be made different. Therefore, if it can detect which photosensor is operating, the intensity of external light can be known relatively. The photo sensor 35 to be selected is performed by the switch S (S1, S2).

For example, it is assumed that the terminal voltage applied to the photosensor 35b is 0V and the terminal voltage applied to the photosensor 35a is -2.0V. The exposure time Tc is constant. The terminal voltage at point a of the photosensor 35 (35a, 35b) decreases due to external light. The difference in decrease is different between the photosensors 35a and 35b. Selection can be made with the switches S1 and S2. Of course, both photosensors 35a and 35b may be selected.
(2) Second Modification As shown in FIG. 56, the voltage at one terminal of the photosensors 35a and 35b is set as the potential of the common signal line 38, and one of the photosensors 35a and 35b is selected by the switches S1 and S2. Needless to say. The leak characteristics of the photo sensor 35a and the photo sensor 35b are made different. In order to vary the leak characteristics, the WL (W: channel width, L: channel length) of the transistors forming the photosensor 35 may be changed.
(3) Third Modification Note that a resistor R may be formed in series with the photosensor 35, as in FIGS. The resistor R is formed by a diffused resistor. A resistor R1 is formed in series with the transistor 32a1.

  For example, a resistor R1 is formed in the photosensor sensor 35a, and a resistor R2 is formed in series in the photosensor 35b. Even if the external light irradiated to the photosensor 35a and the photosensor 35b is the same, and the characteristics of the photosensors 35a and 35b are substantially the same and the leak characteristics match, the higher the impedance of the resistor R (R1, R2), The amount of charge discharged per unit time is different. Therefore, the terminal voltages of the photosensors 35a and 35b can be made different by making the resistance values of R1 and R2 different. Therefore, the exposure time Tc can be varied by selecting the switches S1 and S2. Therefore, the sensitivity range of external light can be expanded.

The photosensor 35 is constituted by a diode-connected transistor. Therefore, a photosensor having different diode characteristics can be configured by separately pulling out the gate terminal of the transistor and adjusting the voltage applied to the gate terminal. The gate voltage is supplied by a volume circuit. Further, it may be adjusted or set according to the intensity of outside light.
(4) Fourth Modification This embodiment may be combined with other embodiments. The above matters are the same as in other embodiments of the present embodiment.
(5) Fifth Modification The voltage applied to the common signal line 38 is not limited to a DC voltage, but may be an AC voltage or a rectangular voltage.
(6) Sixth Modification The exposure time Tc of the photo sensor 35 can be adjusted by changing the level of the rectangular voltage or the like. It goes without saying that the above items can be applied to other embodiments of the present embodiment.
(7) Seventh Modification As shown in FIG. 57, a plurality of capacitors 34 are formed, the voltage at one terminal is set as the potential of the common signal line 38, and one of the capacitors 34 is selected by the switches S1 and S2. May be selected. The potential change at point a varies depending on the capacitance of the capacitor 34.

Note that both (plurality) of capacitors 34 may be selected. Therefore, the exposure time Tc can be varied by selecting the switches S1 and S2. Therefore, the sensitivity range of external light can be expanded.
(8) Eighth Modified Example As shown in FIG. 58, a plurality of transistors 32b (32b1, 32b2) are formed, and the voltage at one terminal is set as the potential of the common signal line 38. Either of the transistors 32b may be selected.

  The WL (W: channel width, L: channel length) of the transistor forming the transistor 32b (32b1, 32b2) is changed. The exposure time Tc can be varied by selecting the switches S1 and S2. Therefore, the sensitivity range of external light can be expanded.

The first to eighth modifications described above are also applied to other embodiments of the present invention. Needless to say, it can be combined with other embodiments.
(Twelfth embodiment)
FIG. 59 shows another embodiment of the present invention. 55, 56, 57, 58, and 58 are configured to apply the precharge signal Vp to the photosensor 35 and the like. The embodiment of FIG. 59 has a configuration in which a write current is output from the source driver circuit 14 and a potential is set in the photosensor 35 with this current. That is, in this embodiment, the potential of the photosensor pixel 27 is set with a current instead of the precharge signal Vp.

  In FIG. 59, SW1 and SW2 are switches composed of transistors. The switch SW1 selects a source signal line 24 (a contact) or a predetermined potential (b contact) such as a ground potential. The switch SW2 selects a predetermined potential (a contact) such as the photosensor output signal line 25 (b contact) or the anode voltage Vdd. A charge holding capacitor 34 and a photosensor 35 are connected to the gate terminal of the transistor 32b. Further, one terminal of the capacitor 34 and the photosensor 35 is connected to the anode terminal Vdd. The transistor 32d is a switching transistor and short-circuits the gate terminal and the drain terminal of the transistor 32b.

  60, 61, and 62 are explanatory diagrams of the operation of FIG. FIG. 60 is an explanatory diagram of an operation of setting the voltage V1 to the photosensor pixel 27 by the photosensor processing circuit 18.

  The photo sensor processing circuit 18 outputs a predetermined constant current. The magnitude of the constant current Iw can be varied. The output current is a sink current. That is, current flows from the photosensor pixel 27 toward the photosensor processing circuit 18. However, the transistor 32b is a P channel. When the transistor 32b is an N channel, the current direction is reversed.

  The magnitude of the constant current is preferably 0.1 μA or more and 10 μA or less. If it is 0.1 μA or less, it takes time for the steady current to flow through the transistor 32b due to the parasitic capacitance of the precharge signal line 24, and the gate potential of the transistor 32b cannot be set within a predetermined time. On the other hand, if it is 10 μA or more, the size of the transistor 32b becomes too large and the aperture ratio of the pixel 16 cannot be obtained.

  As shown in FIG. 60, the switch SW1 selects the b terminal and the switch SW2 selects the a terminal, whereby the constant current Iw flows from the transistor 32b to the photosensor processing circuit 18.

  The transistor 32b changes the gate terminal potential so that the constant current Iw flows. It is assumed that the gate terminal potential of the transistor 32b is V1 in the state where the constant current Iw flows through the transistor 32b.

  The pixel configuration described in FIG. 14 is a driving method in which a constant precharge signal Vp is applied regardless of the characteristics of the transistor 32b. Therefore, since the predetermined precharge signal Vp is applied regardless of the characteristics of the transistor 32b, the output to the photosensor output signal line 25 varies depending on the characteristics of the transistor 32b.

  In the configuration of FIG. 60, the value of the gate terminal potential V1 of each transistor 32b through which the constant current Iw flows differs depending on the characteristics of the transistor 32b. The value of V1 reflects the characteristics of the transistor 32b. For this reason, even if the characteristics of the transistor 32b of each photosensor pixel 27 vary, the output of the photosensor output signal line 25 becomes constant if the exposure time Tc is made constant.

  When a constant current Iw is passed through the photosensor pixel 27 shown in FIG. 60 and the gate terminal potential reaches V1 in a steady state, the switch SW1 is switched to the b terminal as shown in FIG. Further, the transistor 32d is turned off (opened). With the above operation, the voltage V1 applied to the transistor 32b is held. Therefore, the Vp voltage−V1 voltage is applied to the photosensor 35. The V1 voltage is a voltage at which the transistor 32b is turned on. As described above, in the present invention, the transistor 32b is turned on by applying the constant current Iw.

  When the photosensor 35 is irradiated with light, the photosensor 35 leaks. Due to leakage of the photosensor 35, the gate terminal potential of the transistor 32b changes. The larger the leak, the closer the gate terminal potential of the transistor 32b approaches the Vp voltage. When the voltage approaches Vp, the transistor 32b is turned off at a predetermined potential due to the characteristics of the transistor 32b.

  It is assumed that the gate terminal potential becomes V2 due to leakage. Whether the transistor 32b is in an on state or an off state when the gate terminal voltage is applied with the V2 voltage can be detected (determined) by switching the switch SW2 to the b terminal.

  As shown in FIG. 62, the switch SW2 is switched to the b terminal. If the transistor 32b is on, a current flows from the photosensor output signal line 25 to the ground (predetermined potential) via the transistor 32b. Therefore, the input potential of the comparator circuit 155 changes, the changed potential is compared with the Vref voltage, and the output of the comparator circuit 155 changes.

  If the transistor 32b is in the OFF state, no current flows from the photosensor output signal line 25 to the transistor 32b even if the switch SW2 selects the b terminal. Therefore, the input potential of the comparator circuit 155 does not change, and the output of the comparator circuit 155 does not change.

  As described above, according to the present invention, the potential of the photosensor 35 can be set not only by the precharge signal Vp but also by the constant current Iw.

It goes without saying that the above items can be applied to other embodiments of the present embodiment. Moreover, it cannot be overemphasized that it can combine with the other Example of this invention.
(Description of flat display device)
FIG. 65 is an explanatory diagram of a flat display device using the display panel 658 of this embodiment. The display panel 658 is configured using the array substrate 11 described above. Further, the driving method, driving method, configuration, and control method of this embodiment are applied to the array substrate 11 and the display panel 658.

  In the display panel 658, a liquid crystal layer 653 is sandwiched between the array substrate 11 and the counter substrate 654. The array substrate 11 is disposed on the side on which external light is incident. This is because the external light is directly incident on the photosensor 35 formed on the array substrate 11.

  When the pixels arranged or formed in a matrix are red (R), green (G), blue (B), and white (W), the photo sensor 35 may be formed in white (W). This is because the white pixel 16 is not formed with a color filter, so that the amount of light incident on the photosensor 35 can be increased.

  In this case, the array substrate 14 may be disposed at the position of the counter substrate 654 in FIG. 65, and the counter substrate 654 may be disposed at the position of the array substrate 14 in FIG. In white (W), since a color filter containing a pigment or a dye is not formed, incident light is not attenuated. Therefore, even if external light is incident from the counter substrate 654 side where the color filter is formed, the external light reaches the photosensor 35 satisfactorily.

  The display panel 658 of the present embodiment is not limited to the display panel having the liquid crystal layer 653, and may be a display panel having an EL (organic EL, inorganic EL) layer. That is, an EL display panel in which an EL layer is formed on the pixel 16 may be used.

  Further, the liquid crystal layer, TN (Twisted Nematic), IPS (In-Plane Switching), FLC (Ferroelectric Liquid Crystal), OCB (OpticallyCompensatory Bend), STN (Supper Twisted Nematic), VA (VerticallyAligned), ECB (Electrically Controlled Birefringence ), Polymer dispersed (PD) liquid crystal, HAN (Hybrid Aligned Nematic) mode and the like. An OCB liquid crystal is particularly preferable. Further, the pixels of the display panel 658 may have any of a slightly reflective configuration, a reflective configuration, and a semi-transmissive configuration.

Hereinafter, the display panel 658 and the flat display device will be described with reference to FIG.
(1) Configuration of Array Substrate 11 Pixel electrodes 31 and the like are formed on the array substrate 11 made of glass or an organic material. Examples of the glass substrate include soda glass and quartz glass. The substrate made of an organic material may be either a plate-like material or a film-like material, and examples include those made of an epoxy resin, a polyimide resin, an acrylic resin, and a polycarbonate resin. These are formed by integral molding under pressure. The plate thickness is 0.2 mm or more and 0.8 mm or less. The array substrate 11 only needs to be light transmissive, and the counter substrate 654 does not have to be light transmissive, and may be formed of a colored plastic substrate even if it is formed of a metal substrate such as silicon or aluminum. It may be.

  In order to improve heat dissipation of the array substrate 11 and the counter substrate 654, sapphire glass may be used. In addition, a substrate on which a diamond thin film is formed, a ceramic substrate such as alumina, or a metal plate made of copper or the like may be used.

  An antireflection film (AIR coat) is formed on the surface of the array substrate 11 or the like that is in contact with air. When a polarizing plate or the like is not attached to the array substrate 11, an AIR coat is applied directly to the array substrate 11 or when another constituent material such as a polarizing plate (polarizing film) is attached to the surface of the constituent material. It is formed. A configuration in which the AIR coat is formed of a dielectric single layer film or a multilayer film is exemplified. In addition, a resin having a low refractive index of 1.35 to 1.45 may be applied.

The AIR coat has a three-layer structure or a two-layer structure. Note that it is preferable to apply a hydrophilic resin to the surface of the display panel 21 in order to prevent the liquid crystal display panel from being charged with static electricity. In addition, embossing may be performed in order to prevent surface reflection and to make dirt such as fingerprints less noticeable.
(2) Color filter, polarizing plate, phase film A color filter is formed or configured in the display pixel 26. The color filter is formed on the counter substrate 654.

  The color filter may be a color filter made of a resin dyed with gelatin or acrylic, a color filter formed with an optical dielectric multilayer film, or a color filter with a hologram. Alternatively, the liquid crystal layer itself may be substituted directly for coloring.

  Between the array substrate 11 and the polarizing plate 655, one or a plurality of phase films (phase plate, phase rotating means, phase difference plate, phase difference film) are disposed. Polycarbonate is preferably used as the phase film. A phase film (not shown) generates a phase difference between incident light and outgoing light, and contributes to efficient light modulation.

As the phase film, an organic resin plate or organic resin film such as a polyester resin, a PVA resin, a polysulfone resin, a vinyl chloride resin, a ZEONEX resin, an acrylic resin, or a polystyrene resin may be used. In addition, crystals such as quartz may be used. The phase difference of one phase plate 26 is preferably 50 nm to 350 nm in a uniaxial direction, and more preferably 80 nm to 220 nm.
(3) Other Configurations Pixels 16 (display pixels 26 and photosensor pixels 27) are arranged in a matrix on the array substrate 11. The array substrate 11 and the counter substrate 654 sandwich a sealing wall 652. A counter electrode 657 is formed on the counter substrate 654. A polarizing plate (polarizing film) 655 a is arranged on the array substrate 11, and a polarizing plate 655 b is arranged on the counter substrate 654. As a light source of the backlight 656, a fluorescent tube, a white LED, and a red (R) green (G) blue (B) LED are used. Light 661 emitted (emitted) from the backlight 656 is incident from the counter substrate 654 side, modulated by the liquid crystal layer 653, and emitted from the array substrate 11 side.
(4) Reading Operation As shown in FIG. 66, when an object 651 such as a finger or an image scanner object (image paper) is disposed on the array substrate 11 side, the light 661a emitted from a place where the object 651 is not present It passes through as it is. When the object 651 is present, the object 651 is reflected (light 661b). The reflected light 661b is incident on the photosensor pixel 27 at the B position. The photosensor pixel 27 on which the light 661b is incident leaks electric charge corresponding to the intensity of the light 661b and the exposure time Tc. The gate terminal voltage of the transistor 32b changes corresponding to the amount of charge leakage, and the on / off state of the transistor 32b is determined. Since the light reflected by the object 651 has an intensity distribution for each part, each photosensor pixel 27 reacts according to the intensity, and an image distribution corresponding to the object 651 can be formed.

The above is an embodiment in which the object 651 is irradiated with light 661 from the backlight (light generating means disposed in the display device 658) 656 to form an image distribution by the photosensor 35.
(5) Shading Operation FIG. 67 shows the image distribution of the shadow of the object 651 by blocking the external light 661a by the object 651 and forming the shadow and the light irradiation unit by the photo sensor 35. The outside light 661 is indoor light such as a fluorescent lamp, sunlight, and the like.

  As shown in FIG. 67, the outside light 661a at a place where the object 651 is not present enters the photosensor pixel 27 as it is. The photosensor 35 of the incident photosensor pixel 27 leaks electric charge according to the intensity of the external light 661a. In most cases, the photosensor pixel 27 to which the external light 661a is incident discharges the charge, and the transistor 32b is turned off.

On the other hand, as shown in FIG. 67, the outside light 661a does not enter the place where the object 651 is present (the light is blocked by the object 651). Therefore, no external light is incident on the B position. Therefore, the photosensor 35 of the photosensor pixel 27 at the B position hardly leaks charges. In most cases, the photosensor pixel 27 retains electric charge, and the transistor 32b is turned on (when the transistor 32b is an N-channel transistor, the opposite is true when it is a P-channel transistor). Therefore, the external light 661a can be shielded by the object 651, the shadow and the light irradiation unit can be formed by the photosensor 35, and the shadow image distribution of the object 651 can be formed.
(6) Operation by Optical Pen FIG. 68 irradiates the photo sensor pixel 27 with the light 661b 661b from the light generating means of the pen (optical pen) 681 that generates light, and the photo sensor 35 detects coordinates. . As described above, in the present embodiment, the light generation unit 681 may irradiate light to cause the behavior of the photosensor 35. Since other configurations and operations are the same as those of the previously described embodiment, the description thereof is omitted.
(7) Modified Example In the present embodiment, the array substrate 11 is arranged on the external light incident side (external light 661a in FIG. 67), but the present invention is not limited to this. The counter substrate 654 side may be disposed on the outside light incident side.

In the embodiment of the present invention, it is described that calibration is performed in accordance with the intensity of external light, the precharge signal Vp is set, and the exposure time Tc is set (FIG. 67). However, the present invention is not limited to this. As shown in FIG. 66, the setting of the precharge signal Vp, the setting of the exposure time Tc, and the like may be performed according to the intensity of light from the backlight 656. Further, as shown in FIG. 68, the precharge signal Vp and the exposure time Tc may be set according to the light intensity from the light generation source 681.
(Driving method of flat display device)
Hereinafter, the driving method of the flat display device of the present invention will be described with reference to the drawings. In the following embodiments, it goes without saying that the pixel 16 may have any pixel configuration described previously.
(First embodiment)
(1) ON Output Area and Shadow FIG. 69 shows a state where the display area 10 (photosensor pixel 27 forming area) is touched with a finger 701 as an object as shown in FIG. In addition, as illustrated in FIG. 67, a state in which the external light 661 is blocked by the finger 701 and the shadow of the finger is detected is described as an example. In FIG. 69 (a1), ON output regions 691a and 691b are generated. On the other hand, in FIG. 69 (b1), the ON output region 691 is not generated at all.

  The ON output area 691a in FIG. 69 (a1) is the shadow of the actual finger 701. The display area 10 in which the photosensor pixels 27 are formed or arranged in a matrix by the finger 701 generates an area where the external light 661 is irradiated and a light shielding area by the finger 701. The transistor 32b of the photosensor pixel 27 in the shielded region is turned on. This area becomes the ON output area 691.

  In FIG. 69 (a1), the original finger 701 also has an intensity distribution of the external light 661, and an ON output region 691b is generated. Since the ON output areas 691a and 691b are also substantially circular, the ON output area 691a has a center coordinate 692a, and the ON output area 691b has a center coordinate 692b. The center coordinate 692 is obtained from a line segment having a plurality of diameters by approximating the outline of the ON output area 691 as a circle.

In the embodiment of the present invention, it is described that the photosensor pixel 27 is kept in the ON state by the shadow of the object 701 and the ON output area 691 is generated as a set thereof, and the center coordinates of the ON output area 691 are obtained. Will be described. However, the present invention is not limited to this. When the transistor 32b of the photosensor pixel 27 is a P-channel transistor, the shaded portion of the object 701 is a set of off-state photosensor pixels 27. Therefore, the processing is performed as the off output area 691. Also, the operation is reversed in the embodiments of FIGS. Even if the transistor 32b of the photosensor pixel 27 is an N-channel transistor, the periphery of the ON output region 691 is an OFF output region. Therefore, the center coordinates of the object 701 can be detected by processing the off-output region in the peripheral portion.
(1-1) On Output Area and Off Output Area in FIG. 66 In FIG. 66, the object 651 reflects the light 661b emitted from the backlight 656, and the reflected light 661b is irradiated to the photosensor pixel 27. The A precharge signal Vp is applied to the photo sensor pixel 27 periodically, and the transistor 32b is turned on. The precharge signal Vp applied to the photosensor pixel 27 rapidly leaks charges when irradiated with the reflected light from the object 651, and the transistor 32b is turned off. A region where the object 32b is not on the light emitting side maintains the on state.

  In the embodiment of FIG. 66, an off output region is likely to occur below the object 651, and an on output region is likely to occur in other regions. In FIG. 66, the color filter or the light shielding film is formed on the photo sensor pixel 27 and shields light incident on the photo sensor pixel 27 directly from the backlight 656. Appropriate generation states of the ON output region and the OFF output region are adjusted by the precharge signal Vp and the exposure time Tc.

66, the array substrate 11 and the backlight 656 may be disposed, and the counter substrate 654 may be disposed on the light emission side.
(1-2) On Output Area and Off Output Area in FIG. 67 In FIG. 67, external light 661a is shielded by an object 651 such as a finger. That is, a shadow of the object 651 is generated on the lower surface of the object 651. The outside light 661a is directly incident on the portion (display area 10) where the object 651 is not present.

  A precharge signal Vp is applied to the photosensor pixel 27 periodically, and the transistor 32b is turned on. The precharge signal Vp applied to the photosensor pixel 27 is maintained at a certain threshold value or more within a predetermined exposure time Tc at a location where a shadow of the object 651 occurs. In the photosensor pixel 27 in the region where the object 661 is not present and the external light 661a is irradiated, charges are rapidly leaked, and the transistor 32b is turned off.

In the embodiment of FIG. 67, an ON output region is likely to occur below the object 651 and an ON output region is unlikely to occur in other regions. In the region where the external light 661a is directly incident on the photosensor pixel 27, it becomes an off output region. In FIG. 67, the color filter or the light shielding film is formed on the side of the counter substrate 654 and shields light incident on the photosensor pixel 27 directly from the backlight 656. Appropriate generation states of the ON output region and the OFF output region are adjusted by the precharge signal Vp and the exposure time Tc.
(1-3) On Output Area and Off Output Area in FIG. 68 In FIG. 68, light 661b is irradiated onto the photosensor pixel 27 with the light pen 681. In the region irradiated with the light 661b, the precharge signal Vp is rapidly discharged and the region is turned off. It is hardly affected by other outside light.

  A precharge signal Vp is applied to the photosensor pixel 27 periodically, and the transistor 32b is turned on. The precharge signal Vp applied to the photosensor pixel 27 maintains a predetermined threshold value or more within a predetermined exposure time Tc in a region where the light of the light pen 681 is not irradiated. In the photosensor pixel 27 in the region irradiated with the light 661b, the charge is rapidly leaked, and the transistor 32b is turned off.

In the embodiment shown in FIG. 68, the light output from the light pen 681 is an off-output region, and an off-output region is unlikely to occur in other regions. In an area where the light 661b is not irradiated, an ON output area is obtained. In FIG. 67, the color filter or the light shielding film is formed on the side of the counter substrate 654 and shields light incident on the photosensor pixel 27 directly from the backlight 656. Appropriate generation states of the ON output region and the OFF output region are adjusted by the precharge signal Vp and the exposure time Tc.
(1-4) On Output and Off Output Region As described above, the present invention will be described on the assumption that the on output region 691 is generated by the object 701 due to a shadow in order to facilitate the explanation. In the reverse operation, the on output area 691 may be read as the off output area 691.

In the present invention, the external light is blocked by the object 701, the light is reflected by the object 701, and the photosensor pixel 27 is irradiated with light by the light pen 681, whereby the photosensor pixel 27 is turned on and off. The position of the object 701 and the light irradiation position of the light pen 681 are detected by holding the change or on / off state. Further, as shown in FIG. 68 and the like, a portion where light is irradiated by the light pen 681 and the photosensor pixel 27 is turned off is detected.
(1-5) On-pixel number ratio The on-pixel number ratio (%) means a ratio of the number of photosensor pixels in a predetermined range being in an on state. Conversely, the off pixel number ratio (%) means the ratio of the number of photosensor pixels in a predetermined range being in an off state. In the present specification, the on-pixel number ratio (%) will be described as an example.
(2) Calibration In the present invention, calibration is performed in order to have one ON output region 691. In FIG. 69 (a1), the precharge signal Vp is lowered. In the following description, it is assumed that the precharge signal Vp is changed. However, the present invention is not limited to this. For example, in the embodiment of FIG. 59, the constant current Iw is changed and set.

  The exposure time Tc maintains a constant value (predetermined value). The precharge signal Vp is varied by the electronic volume 261a. The variable precharge signal Vp is output from the photosensor processing circuit 18. The precharge signal Vp is changed in constant increments, such as in increments of 0.1V. The rate of change is determined from the area of the ON output region 691.

  The meaning of the area is equivalent to, approximate to, or equivalent to the number of ON pixels or the ON pixel number ratio (%) (OFF pixel number or OFF pixel number ratio (%)).

  The number of steps of the precharge signal Vp is set to 64 steps or more. The maximum value of the precharge signal Vp is 5 (V), and the variable range is 1 V or more. When the ON output region 691 is large, the variable width of the precharge signal Vp that is changed at a time is increased. When the ON output region 691 is small, the variable width of the precharge signal Vp that is changed at a time is reduced.

The area of the on-output region 691 is the number of transistors 32b of the photosensor pixel 27 in the display region 10 that are on. That is, the area of the ON output region 691 can be obtained by counting the number of ON transistors 32b of the photosensor pixel 27 in the display region 10. It is easy to count the number that is on. This is because the output of the comparator circuit 155 of each photosensor output signal line 25 may be counted.
(3) Data Conversion by Comparator Circuit 155 The present invention has a feature that the number of data signals applied to the photosensor output signal line 25 is binarized by the comparator circuit 155, so that the number counting is easy. . Note that an operational amplifier may be arranged instead of the comparator circuit 155, and analog data may be directly processed to configure or generate the ON output region 691. In addition, as described with reference to FIG. 17, the on-output area 691 may be generated by processing as multi-value digital data in the AD conversion circuit 171.

In the embodiment of the present invention such as FIG. 69, the ON output area 691 is displayed in the display area 10, but this is for ease of explanation. The display area 10 in FIG. 69 is a data array obtained by processing the outputs of the photosensors 27 in a matrix. By explaining this data arrangement in conformity with the display area 10, it becomes easy to understand the situation or occurrence of shadows.
(4) Operation and processing by the precharge signal Vp The precharge signal Vp is lowered (changed), and the ON output region 691 is measured (detected). The area of the ON output region 691 is reduced by the decrease of the precharge signal Vp. The precharge signal Vp is lowered until the ON output region 691b is erased. Preferably, as shown in FIG. 69 (a2), the precharge signal Vp is lowered until the ON output region 691b is erased and the ON output region 691a becomes a single isolated substantially circular shape.

  For example, as shown in FIG. 71, the ON output region 691a varies depending on the magnitude of the precharge signal Vp. When the precharge signal Vp is high, an ON output region 691a having a large area is formed by the shadow of the finger 701 as shown in FIG. Further, the ON output area 691a is in contact with one side of the display area 10.

  When the precharge signal Vp is lowered, the area of the ON output region 691a is reduced. When the ON output area 691a is reduced, the ON output area 691a is separated from one side of the display area 10 and becomes an isolated area as shown in FIG. In the ON output area 691a in FIG. 71 (b), two coordinate centers 692a and 692b are generated.

  When the precharge signal Vp is further lowered, the area of the ON output region 691a is further reduced. When the ON output area 691a is further reduced, as shown in FIG. 71C, the ON output area 691a becomes nearly circular, and the coordinate center becomes one point of 692a.

The calibration is completed when the precharge signal Vp is lowered to the state shown in FIG. 71 (c). The above embodiment is an embodiment in which calibration is performed by changing the precharge signal Vp.
(4-1) Precharge Signal Vp and Other Precharge Signal Vp is changed according to the intensity of external light 661 as described with reference to FIGS. In particular, the initial value is set based on the intensity of outside light. Further, values (precharge signal Vp, exposure time Tc, etc.) obtained in the previous calibration are stored in memory, and these values are used as initial values.
(4-2) Setting and Optimization of Precharge Signal Vp The on output area 691 is in various generation states. For example, as shown in FIG. 72A, on output areas 691a and 691c are generated in addition to the target on output area 691b. In addition, as illustrated in FIG. 72B, an ON output region 691b may be generated in an arc shape around the target ON output region 691a. FIG. 72B shows the distribution of the ON output region 691 that often occurs when the light pen 681 is used. Even in the above case, only the target on-output region 691 can be obtained by appropriately setting or adjusting the precharge signal Vp.

  Even if there is one ON output region 691, the shape of the ON output region 691 varies depending on the setting of the precharge signal Vp. For example, as shown in FIG.

  FIG. 73A shows a case where the ON output area 691 is relatively large and the center coordinate 692 is one. In this case, the position of the center coordinate 692 is likely to fluctuate when the center coordinate is obtained from the ON output area 691. Therefore, there is no accuracy as to whether the center coordinates 692 indicate the center position of the finger 701. Therefore, the precharge signal Vp is lowered or the exposure time Tc is lengthened so that the state of FIG.

  FIG. 73B shows a case where the ON output area 691 is narrow and the center coordinate 692 is one. The precharge signal Vp or the exposure time Tc is set appropriately, which is the most preferable state. In this case, the position of the center coordinate 692 is fixed when the center coordinate is obtained from the ON output area 691. Therefore, the center coordinate 692 indicates the center position of the finger 701.

  FIG. 73C shows a case where the ON output area 691 is relatively large and the shape is distorted, but the center coordinate 692 is one. In this case, the position of the center coordinate 692 is likely to fluctuate when the center coordinate is obtained from the ON output area 691. Therefore, there is no accuracy as to whether the center coordinates 692 indicate the center position of the finger 701. In the case of FIG. 73C, it is necessary to lower the precharge signal Vp or lengthen the exposure time Tc than in FIG. 73A.

  FIG. 73 (d) shows a case where the ON output area 691 is relatively large, the shape is distorted, and there are two central coordinates 692. As shown in FIG. 73D, when there is one ON output area 691 and there are a plurality of center coordinates 692, it is necessary to reset (re-adjust) the calibration. In the case of FIG. 73 (d), it is necessary to lower the precharge signal Vp or extend the exposure time Tc than in FIG. 73 (c).

  In the ON output region 691, not all the transistors 32b of the photosensor pixels 27 in the ON output region 691 are in the ON state. As shown in FIG. 74, there is often a mixed on output region 691b in which the on-state and off-state transistors 32b are mixed outside the region 691a in which the photosensor pixel 27 is completely maintained on.

In FIG. 74A, the mixed ON output region 691b is surrounded by a wide area around the complete ON output region 691a. In FIG. 74 (b), the mixed ON output region 691b is surrounded by a small area around the complete ON output region 691a. In the above case, the number of ON states in the photo sensor pixels 27 per unit area may be counted, and a range (unit area) where the number of ON states equal to or greater than the set value may be processed as the ON output region 691.
(5) Photosensor processing circuit The photosensor processing circuit 18 obtains photosensor output information from the display area 10 via the comparator circuit 155 and detects the area of the ON output area 691 and the center coordinate value 692. Also, calibration is performed. As shown in FIG. 63A, the photo sensor processing circuit 18 sends a center coordinate value (X coordinate value, Y coordinate value: X and Y are 8 bits each) to a microcomputer (not shown). Also, 8 bits of the status signal IST are sent to the microcomputer. As the IST information, as shown in FIG. 63B, the calibration of the code 1 and the coordinate detection of the code 2 are being performed.

In addition, as shown in FIG. 64B, information related to the ON output area 691 is also sent to the microcomputer. For example, code 0 means that there was no ON output area 691. Code 1 is that the area of the ON output region 691 is larger than a predetermined value. Code 2 indicates that the area of the ON output region 691 is within a predetermined value range. Code 3 is information that the area of the ON output region 691 is smaller than a predetermined value, and therefore calibration should be performed. Code 4 is information that there are a plurality of center coordinates.
(6) Exposure time Tc
In the above embodiment, the precharge signal Vp is changed in the calibration. However, the present invention is not limited to this. For example, as described with reference to FIG. 36, the change in FIG. 71 can be realized by adjusting the exposure time Tc.

  For example, when the exposure time Tc is short, an ON output region 691a having a large area is formed by the shadow of the finger 701 as shown in FIG. Further, the ON output area 691a is in contact with one side of the display area 10.

  When the exposure time Tc is increased, the area of the ON output region 691a is reduced. When the ON output area 691a is reduced, the ON output area 691a is separated from one side of the display area 10 and becomes an isolated area as shown in FIG. In the ON output area 691a in FIG. 71 (b), two coordinate centers 692a and 692b are generated.

  When the exposure time Tc is further increased, the area of the ON output region 691a is further reduced. When the ON output area 691a is further reduced, as shown in FIG. 71C, the ON output area 691a becomes nearly circular, and the coordinate center becomes one point of 692a.

  The exposure time Tc is also changed in accordance with the intensity of the external light 661 as described with reference to FIG. In particular, the initial value is set based on the intensity of outside light. Further, values (precharge signal Vp, exposure time Tc, etc.) obtained in the previous calibration are stored in memory, and these values are used as initial values.

The change or change of the on-output region 691 may be performed not only by changing the exposure time Tc and the precharge signal Vp alone, but also by combining both the exposure time Tc and the precharge signal Vp. In addition, it goes without saying that the ON output region 691 can be changed or adjusted by changing the comparison voltage (comparator) Vref.
(7) Calibration and exposure time Tc
In the above embodiment, the area and size of the ON output region 691 are varied by changing the precharge signal Vp. However, the calibration of the present invention may change the exposure time Tc. For example, in the state of FIG. 69 (a1), it is assumed that the exposure time Tc is 100H (100 times the horizontal scanning period (1H)). The adjustment or change of the exposure time Tc is preferably performed in units of 1H. The exposure time Tc is also controlled by the photo sensor processing circuit 18.

  The photo sensor processing circuit 18 increases the exposure time Tc and measures (detects) the ON output region 691. The precharge signal Vp maintains a constant voltage. As the exposure time Tc increases, the area of the ON output region 691 decreases. The exposure time Tc is increased until the ON output area 691b is erased. When the exposure time Tc is increased, the amount of charge leaking from the photosensor 35 is increased, the gate terminal voltage of the transistor 32b is lowered, and the transistor 32b is turned off. Therefore, the ON output area 691 decreases. Preferably, as shown in FIG. 69 (a2), the exposure time Tc is increased until the ON output region 691b is erased and the ON output region 691a becomes a single isolated substantially circular shape.

  The change or change of the ON output region 691 may be implemented by combining not only the exposure time Tc and the precharge signal Vp alone, but also a combination of both the exposure time Tc and the precharge signal Vp. In addition, it goes without saying that the ON output region 691 can be changed or adjusted by changing the comparison voltage (comparator) Vref.

This is because the output voltage of the transistor 32b output to the photosensor output signal line 25 varies depending on the voltage of the gate terminal of the transistor 32b. The gate terminal voltage varies depending on the leak amount of the photosensor 35. Therefore, the voltage of the transistor 32b output to the photosensor output signal line 25 differs depending on the terminal voltage of the photosensor 35. The on output region 691 can be changed by changing the comparison voltage (comparator voltage) Vref of the comparator circuit 155.
(8) Other adjustments The timing for capturing the output of the transistor 32b, the magnitude / output timing of the video signal from the source driver circuit (IC) 14, the image display state of the display pixel 26, and the selection of the photosensors 35 having different sensitivities (FIG. 17). The ON output area 691 can be changed, changed, or adjusted. Further, the length of the exposure time Tc, the magnitude of the precharge signal Vp, the magnitude of the comparison voltage Vref, the capture timing of the output of the transistor 32b, the magnitude / output timing of the video signal from the source driver circuit (IC) 14, One or more of the image display states of the display pixels 26 and the selection of the photosensors 35 having different sensitivities are selected, and a plurality of them are combined to determine the range and size of the on output area 691 and whether or not the on output area 691 is generated. Needless to say, it may be adjusted or variable.

When the transistor 32b of the photosensor pixel 27 is a P-channel transistor, the control of the exposure time Tc, the magnitude of the precharge signal Vp, the magnitude of the comparison voltage (comparator voltage) Vref, and the like is the reverse of the previous embodiment. Needless to say, the direction can be controlled.
(Second Embodiment)
As shown in FIG. 69 (a1), when the original finger 701 also has the intensity distribution of the external light 661 and the on-output region 691b is generated, calibration is performed, as shown in FIG. 69 (a2). The display area 10 is formed as one isolated area, and the isolated area 691a is substantially circular. Center coordinates 692a of the on-output area 691a are sent to the microcomputer (not shown) as finger detection coordinates.

In FIG. 69 (b1), the shadow of the finger 701 is generated in the display area 10 as in FIG. 69 (a1). However, the display area 10 has no ON output area 691. This is mainly because the exposure time Tc is too long and the precharge signal Vp is too low.
(1) Calibration and precharge signal Vp
In the case of FIG. 69 (b1), calibration is performed to generate the ON output region 691. In FIG. 69 (b1), the precharge signal Vp is raised. The exposure time Tc maintains a constant value. The precharge signal Vp is controlled by the photosensor processing circuit 18 by the electronic volume 261a. The precharge signal Vp is changed in constant increments, such as in increments of 0.1V. When the precharge signal Vp is raised, an ON output region 691 appears as shown in FIG. 69 (b2).

  When the area of the on-output region 691 is greatly increased with respect to the precharge signal Vp in increments of 1, the precharge signal Vp is changed in small increments. When the increase in the area of the ON output region 691 with respect to the precharge signal Vp in increments of 1 is small, the change in the precharge signal Vp that is changed once (once) is increased.

  By increasing (higher) the precharge signal Vp, the ON number of the transistors 32b in the photosensor pixel 27 in the display area 10 increases. The area of the on-output region 691 is the number of transistors 32b of the photosensor pixel 27 in the display region 10 that are on. The ratio of increase or decrease of the ON number (change speed, change ratio) is obtained by counting the number of ON of the transistor 32b of the photosensor pixel 27 in the display area 10 in synchronization with the change of the precharge signal Vp. Obtainable.

  It is easy to count the number that is on. This is because the output of the comparator circuit 155 of each photosensor output signal line 25 may be counted. The above items can also be applied to the embodiment of FIG.

  Detection of the ON number ratio (change speed, change ratio) is easy because the data signal applied to the photosensor output signal line 25 is binarized by the comparator circuit 155.

  Note that an operational amplifier may be arranged instead of the comparator circuit 155, and analog data may be directly processed to configure or generate the ON output region 691. In addition, as described with reference to FIG. 17, the on-output area 691 may be generated by processing as multi-value digital data in the AD conversion circuit 171.

The precharge signal Vp is raised (changed), and the ON output region 691 is measured (detected). As the precharge signal Vp rises, the area of the ON output region 691 increases. The precharge signal Vp is increased immediately before the ON output regions 691 become plural or until the area of the ON output regions 691 reaches a predetermined value. If there are a plurality of ON output regions 691, the photo sensor processing circuit 18 can easily detect them. If there are a plurality of ON output regions 691, the precharge signal Vp is lowered and set again to the precharge signal Vp having one ON output region 691.
(2) Area of ON output region The maximum area of the ON output region 691 is defined in advance. The area of the on-output region 691 is the number of transistors 32b of the photosensor pixel 27 in the display region 10 that are on. By counting the number of ONs and comparing the count value with a predetermined count value, it can be determined whether or not the area of the predetermined ON output region 691 has been exceeded.

When the ON output region 691 exceeds the maximum area, the precharge signal Vp is lowered so that the ON output region 691 becomes equal to or less than a specified area.
(3) Center Coordinates As described above, the precharge signal Vp is lowered until the ON output region 691 becomes a single isolated substantially circular shape as shown in FIG. 69 (b2). The center coordinates 692a of the on-output area 691 are sent to the microcomputer (not shown) as finger detection coordinates.
(4) Modification Example In the above embodiment, the area and size of the on-output region 691 are varied by changing the precharge signal Vp. However, in the calibration of the present invention, the exposure time Tc may be changed as described with reference to FIG. For example, in the state shown in FIG. 69 (b1), it is assumed that the exposure time Tc is 100H (100 times the horizontal scanning period (1H)).

  The photo sensor processing circuit 18 shortens (shortens) the exposure time Tc and measures (detects) the ON output region 691. By shortening the exposure time Tc, the area of the ON output region 691 is generated or increased. The exposure time Tc is shortened until the ON output area 691b is erased. Preferably, as shown in FIG. 69 (b2), the ON output region 691 is generated, and the exposure time Tc is shortened until the ON output region 691 becomes a single isolated substantially circular shape with a fixed area. Let

  The change or change of the ON output region 691 may be implemented by combining not only the exposure time Tc and the precharge signal Vp alone, but also a combination of both the exposure time Tc and the precharge signal Vp. In addition, it goes without saying that the ON output region 691 can be changed or adjusted by changing the comparison voltage (comparator) Vref.

  It is also turned on according to the timing of capturing the output of the transistor 32b, the magnitude / output timing of the video signal from the source driver circuit (IC) 14, the image display state of the display pixel 26, and the selection of the photosensor 35 having different sensitivity (explained in FIG. 17). Appearance of the output region 691, change in area, variable or adjustment can be performed.

  Length of exposure time Tc, magnitude of precharge signal Vp, magnitude of comparison voltage Vref, capture timing of output of transistor 32b, magnitude / output timing of video signal from source driver circuit (IC) 14, display pixel One or more of 26 image display states and photosensors 35 having different sensitivities are selected, and a plurality of them are combined to adjust the range and size of the ON output area 691, the presence / absence of occurrence of the ON output area 691, and the like. Needless to say, it may be variable.

  When the transistor 32b of the photosensor pixel 27 is a P-channel transistor, the control of the exposure time Tc, the magnitude of the precharge signal Vp, the magnitude of the comparison voltage (comparator voltage) Vref, and the like is the reverse of the previous embodiment. Needless to say, the direction can be controlled.

  As shown in FIG. 69 (b2), the display area 10 is formed as one isolated area, and the ON output area 691 of the isolated area is substantially circular. Center coordinates 692 of the on-output area 691 are sent to the microcomputer (not shown) as finger detection coordinates.

  As described above, the present invention is characterized in that calibration is performed for the purpose of operating (adjusting or changing) the ON output region 691. In the calibration, the display area 10 (or the formation area of the photosensor pixel 27, which is the same as or substantially coincides with the display area 10 in the present invention) is set to one ON output area 691. It is characterized by. More preferably, the ON output region 691 is a single isolated region (the states shown in FIGS. 69 (a2) and (b2)). More preferably, the isolated state of the ON output region 691 is substantially circular, and the substantially circular center coordinates (692 in FIGS. 69 (a2) and (b2)) are specified as one. It is characterized by that.

  In order to prevent the display area 10 from being affected by variations in characteristics of the photosensor 35, the transistor 32b, etc., the display area 10 is divided into a matrix, and the average value or the number of ON outputs is counted within a certain range within the matrix. By determining that the matrix section is in the on or off state with the count number, processing is performed as one piece of judgment data in the matrix section.

An ON output area 691 is constituted by this determination data. The matrix division means that the processing is performed by dividing the photosensor pixels 27 or the pixels 16 so as to be 10 vertical × 10 horizontal.
(Third embodiment)
Although the above embodiment has been described as detecting the position coordinates of the input object, the present invention is not limited to this. For example, it is also an object of the present invention to detect that a finger touches the display area 10. It is also a feature of the present invention.
(1) Detection of the position touched by a finger
When the display area 10 is touched with the finger 701 and the touched position is detected, it is important to detect the tip coordinate of the finger 701. When the display screen 10 is touched with the finger 701, the light is shielded by the finger 701 as shown in FIG. Since the tip of the finger 701 is shielded most, an ON output region 691 is generated at the tip of the finger 701.

  Since the object 701 such as a finger is a light-shielding object, the shadow of the finger 701 is generated in the display area 10, and an ON output area 691 is generated in addition to the tip of the finger. In particular, when the precharge signal Vp is set high during calibration, an ON output region 691 is generated in the entire object 701 such as a finger.

  In this case, it is important to adjust the precharge signal Vp and the like so that the ON output region 691 is circular and the area of the ON output region 691 is small.

As shown in FIGS. 76 (b1) and 76 (b2), in order to detect the input coordinates of the finger 701, information on the setting (arrangement) direction of the screen 10 is also important. FIG. 76B shows a configuration in which the display panel 658 of the present invention is arranged in a portable display device. FIG. 76 (b1) shows the case where the input with the finger 701 is performed with the display panel 658 of the present invention in the horizontally long direction. FIG. 76 (b2) shows the case where the input with the finger 701 is performed with the display panel 658 of the present invention in the vertically long direction.
(2) Arrangement direction of display panel As shown in FIG. 76 (a), the portion A at the base of the finger 701 is likely to be a shadow. Therefore, the ON output region 691 is likely to occur. If the information indicating in which direction the display panel 658 is arranged can be known, the location A at the base of the finger 701 can be determined, and the finger 701 is excluded by removing the ON output area 691 of the location A. It is possible to extract the ON output region 691 at the front end portion. As described above, the present invention is also characterized in that information on the arrangement direction of the display panel (FIGS. 76 (b1) and (b2)) is used.

  If the place where the finger 701 is input can be specified in the display area 10, it becomes easier to detect the coordinate position of the finger input or the input of the finger.

  In the case of FIG. 76 (b1), even if a shadow occurs in the portion A and becomes the ON output area 691, if there is information indicating that the display panel 658 is arranged horizontally, the portion A is displayed on the display panel 658. It can be seen that this corresponds to the end of the display area 10. Therefore, the ON output area at position A can be excluded, and the true ON output area 691 that is the tip of the finger 701 can be detected as the input coordinate position.

In the case of FIG. 76 (b2), even if a shadow is generated in the portion A and becomes the ON output area 691, if there is information indicating that the display panel 658 is arranged vertically, the portion A is displayed on the display panel. It can be seen that this corresponds to the end of the display area 10 at 658. Therefore, the ON output area at position A can be excluded, and the true ON output area 691 that is the tip of the finger 701 can be detected as the input coordinate position.
(3) Method by Pressure In the present invention, the ON output area 691 which is a shadow portion of the object 701 is detected and the input coordinate position is obtained. However, the present invention is not limited to this. For example, when the surface of the display panel 658 is pressed with the finger 701, the thickness of the liquid crystal layer 653 changes. Due to the change in the thickness of the liquid crystal layer 653, the capacitance component of each photosensor pixel 27 changes. Therefore, the value of the precharge signal Vp for setting whether the photosensor pixel 27 at the place where the pressure is applied is turned on or off is different.

  In the case where the same precharge signal Vp is applied to the display area 10 and when the position is the on output area or the off output area 691 in a state where no pressure is applied, the place where the pressure is received is the off output area. Or it changes to the ON output region. Coordinate detection can also be performed by detecting the changed portion.

  That is, coordinate position detection and contact detection can be performed by pressing the object 701 regardless of the size and change of the external light. In the flat display device of the present invention, the function and operation of the application means of the precharge signal Vp, the capacitor 34 formed in the pixel 27 or formed naturally, the transistor 32b such as the source follower, and the transistors 32a and 32c are intended. The driving method is the same as described above.

The above matters can be applied to other embodiments of the present invention. Moreover, it can combine with the other Example of this invention.
(Input coordinate detection method)
As shown in FIG. 77, when the exposure time Tc is constant and the precharge signal Vp is varied, the ON pixel number ratio (%) changes. When the transistor 32b of the photosensor pixel 27 is an N-channel, the on-pixel ratio (%) increases as the precharge signal Vp increases. The precharge signal Vp at which the increase of the on-pixel number ratio (%) starts is set to V0.

  As an example, assume that the on-pixel ratio (%) is 100% from the V0 voltage to the A voltage. The width of the A voltage is about 0.4 to 0.6V.

The precharge signal Vp between the V0 voltage and V0 + A causes the ON pixel number ratio (%) to be any ON pixel number ratio (%) from 0% to 100%. That is, a predetermined on-pixel number ratio (%) is obtained by applying precharge signal Vp = V0 + Vx with V0 as a reference.
(1) Reference voltage position In the present invention, it is important to obtain the V0 voltage or the reference voltage position. This is because it becomes a reference for obtaining a predetermined ratio (%) of the number of ON pixels. In order to obtain V0, the characteristic of FIG. 77 is approximated by a straight line as shown in FIG. The characteristics of the photosensor pixels 27 in the display area 10 shown in FIG. 77 are almost normally distributed. The graph in FIG. 77 is precisely obtained by adding this normal distribution. Therefore, the graph is non-linear near V0 and near V0 + A. However, in this flat display device, the amount of change in the on-pixel ratio (%) is a problem. Therefore, non-linearity such as in the vicinity of V0 does not cause a problem in the amount of change in the ON output region 691. In particular, when the ON pixel number ratio (%) is around 50% (20% or more and 80%), there is no problem because the amount of change in the ON output region 691 is linear.

  FIG. 78A is a graph obtained by rotating the graph of FIG. 77 by 90 degrees for easy explanation. The dotted line in FIG. 78 (a) is the characteristic of FIG. This is approximated by a solid line as shown in FIG.

The V0 position in FIG. 77 is shifted from the V0 position in FIG. 78 (a). Also, the position V0 + A in FIG. 77 is shifted from the position V3 in FIG. Description will be made by approximating as shown in FIG. That is, the on-pixel ratio (%) starts to change from the precharge signal Vp = V0. When the precharge signal Vp = V3, the on-pixel ratio (%) is 100%. Further, the ratio of the number of ON pixels when the precharge signal Vp = V1 is applied (%) = a, and the ratio of the number of ON pixels when the precharge signal Vp = V2 (%) = b. Also, 0 to V0 is Va, and V3-V0 is Vb.
(2) On Pixel Number Ratio FIG. 79 illustrates the relationship between the external light illuminance and the on pixel number ratio (%). FIG. 79A is a graph of FIG. FIG. 79B illustrates the relationship between the ambient light illuminance and the precharge signal Vp.

  In FIG. 79, for ease of explanation, the on-pixel number ratio (%) will be described by exemplifying 0% (or a position or point where the on-pixel number ratio (%) slightly occurs).

  However, the present invention is not limited to processing with the on-pixel number ratio being 0%. For example, the ON pixel number ratio a (%) may be set as indicated by a dotted line. In this case, when the external light illuminance is L, the precharge signal Vp at point A is obtained. The precharge signal Vp at the point A is VLa. The conversion of the VLa voltage into the precharge signal Vp = VL0 in which the ON pixel number ratio (%) is 0% can be easily performed in FIG. This is because the relationship between the on-pixel ratio (%) and the precharge signal Vp is linearly approximated from VL0 to VL100 as shown by the dotted line (FIG. 78).

  Since the ratio (%) of the number of on-pixels and VL0 to VL100 of the precharge signal Vp are in a proportional relationship, the position of VL0 can be easily obtained by calculation. Therefore, point B in FIG. 79 (b) is also obtained. For general expression, a straight line (solid line) with an ON pixel number ratio (%) of 0% will be described below as an ON pixel number ratio b (%).

  It is preferable that the precharge signal Vp is adjusted with respect to an arbitrary external light illuminance L, and the target on-pixel number ratio b (%) is 0% or more and 20% or less. In particular, it is preferably 0% or more and 10% or less.

This is because the interval ΔVw between VL0 and VL100 changes depending on the temperature, the precharge signal Vp, etc., but the change amount of ΔV at the position where the on-pixel number ratio (%) starts to change (precharge signal Vp = VL0) is small. . VL0 = VLa−ΔVw · a / 100. Of course, the ON pixel number ratio (%) may be set to 70 to 100%. The vicinity of 100% is easy to process as a reference point.
(4) The value of the correction coefficient ΔVw is preferably corrected by the temperature of the photosensor 35 and the intensity of incident light (external light illuminance). In particular, the dependence on the illuminance of outside light in a low illuminance region of 1000 lux (Lx) or less may be large. In this case, a correction coefficient Cv for the voltage difference between VL0 and VL02 is set in advance and is set to ΔVw × (VL0−VL02) × Cv. Note that Cv is preferably further corrected by values such as m and n.

The magnitude of m, the voltage difference between the precharge signal Vp and the V0 at the first exposure time Tc1, the magnitude of the precharge signal Vp at the first exposure time Tc1, and the precharge signal Vp at the second exposure time Tc2. Needless to say, the correction coefficient Cv may be used as a reference. In terms of correction calculation, a correction coefficient Cv may be applied to the value or the like.
(4) Relationship with exposure time Tc A feature of the present invention is that any on-pixel number ratio (%) (for example, 0) in a certain external light illuminance (or a state in which light of arbitrary intensity is irradiated on the photosensor pixel 27). %, 5%, 10%, etc.) to adjust or set the precharge signal Vp. Further, the precharge signal Vp is adjusted or set so that the arbitrary ON pixel number ratio (%) is obtained in a plurality of exposure times Tc.

  In FIG. 79 (b), the plurality of exposure times Tc are 324H (324 horizontal scanning period) and half of that are 162H (162H horizontal scanning period). Of course, the present invention does not limit the exposure time Tc to 324H or the like. In the present invention, two or more exposure times Tc may be set. When selecting two exposure times Tc, it is preferable to adopt a value close to one frame for one exposure time Tc. For example, if one frame is 340H (horizontal scanning period), it is preferable to be close to 340H. As an example, if the horizontal scanning period D (1 frame = DH) constituting one frame is set, the first exposure time Tc is preferably set to D × 0.6 or more and D or less. In particular, D × 0.8 or more and D or less are preferable. For ease of explanation (in order to make it concrete), 1 frame = 340H, and in FIG. 79 (b), the first exposure time Tc is 324H.

  The second exposure time Tc is preferably in the vicinity of ½ of the first exposure time Tc. As an example, if the horizontal scanning period D (1 frame = DH) constituting one frame is set, the second exposure time Tc may be set to D × 0.6 × 0.5 or more and D × 0.8 or less. preferable. In particular, D × 0.8 × 0.5 or more and D × 0.6 or less are preferable. In order to make the explanation easy or specific, one frame = 340H, and in FIG. 79 (b), the second exposure time Tc is 324/2 = 162H.

The second exposure time Tc is preferably approximately ½ of the first exposure time Tc. In the bit processing, the second exposure time Tc is obtained by shifting the data of the first exposure time Tc to the right by 1 bit. That is, it is preferable that the change of the plurality of exposure times Tc is obtained or calculated by right or left shift of data.
(5) Values of m and n The on-pixel ratio is operated with a target of a%. When obtaining the distribution by counting from the number of off-pixels, it is preferable that a% is in the range of 100 or less and 50 or more. It is preferable to obtain the point of a% and obtain the ON pixel number ratio 0% by calculation such as VL0 = VLa−ΔVw · a / 100.

  When obtaining the precharge signal Vp whose on-pixel number ratio is a% in the first exposure time Tc and then obtaining the precharge signal Vp whose on-pixel number ratio is 2% in the second exposure time Tc By setting the voltage value to VLa−VLa × (second exposure time Tc / first exposure time Tc), the next precharge signal Vp can be set at high speed.

  The on-pixel ratio a% may be different between the first exposure time Tc and the second exposure time Tc. This is because it can be easily converted into a predetermined ratio of the number of ON pixels by a calculation such as VL0 = VLa−ΔVw · a / 100.

  The b straight line of the on-pixel number ratio indicates the precharge signal Vp so that the on-pixel number ratio (%) is b (%) (b = 0 in the embodiment of FIG. 79) at the outside light illuminance (Lx). Applied.

  When the first exposure time Tc = 324H, the straight line with the on-pixel number ratio 0 (%) becomes the precharge signal Vp = VL0 at the point B when the ambient light illuminance is L. When the second exposure time Tc is 324 / 2H, the straight line with the on-pixel number ratio 0 (%) becomes the precharge signal Vp = VL02 at the point C when the ambient light illuminance is L. Point D is a precharge signal Vp = Vk set during k calibration.

  VL0 and VL02 of the precharge signal Vp are voltages measured by changing or adjusting the precharge signal Vp. The precharge signal Vp = Vk is a value obtained by calculation or the like based on VL0 and VL02 of the precharge signal Vp.

  The distance between point B and point C is VL0−VL02. Therefore, it is obtained by changing the precharge signal Vp so that the on-pixel number ratio b (%) (exposure time Tc = DH) and the on-pixel number ratio b (%) (exposure time Tc = D / 2H). .

  The distance between point B and point C is m, and the distance between point C and point D is n. The ratio of m: n is the same even in the ambient light illuminances L, L ′, and L ″. Further, it hardly changes depending on the temperature and the wavelength of external light. The ratio of m: n or the values of m and n are obtained when the panel is shipped, inspected or adjusted.

  If the value (or relative size) of m is known, the value (or relative size) of n can be obtained. The value of m can be obtained from the precharge signal Vp by measuring VL0 and VL02 as the precharge signal Vp.

The on-pixel number ratio a% may be different between the first exposure time Tc and the second exposure time Tc. This is because it can be easily converted into a predetermined ratio of the number of ON pixels by calculation such as VL0 = VLa−ΔVw · a / 100.
(6) Temperature correction ΔVw varies depending on the illuminance of outside light. In general, the higher the external light illuminance, the larger it becomes. Therefore, it is preferable to multiply the correction coefficient in proportion to the value or magnitude of m and the value or magnitude of the precharge signal Vp. ΔVw varies depending on the temperature of the photosensor 35, the photosensor pixel 27, or the panel 658. Therefore, it is preferable to detect (measure) the temperature with a temperature sensor or the like and correct it. A thermistor is exemplified as the temperature sensor.
(7) Precharge signal Vp processing method The straight line b of the on-pixel number ratio indicates that the on-pixel number ratio (%) is b (%) when the ambient light illuminance (Lx) (b = 0 in the embodiment of FIG. 79). ) To which the precharge signal Vp is applied. When the first exposure time Tc = 324H, the straight line with the on-pixel number ratio 0 (%) becomes the precharge signal Vp = VL0 at the point B when the ambient light illuminance is L. When the second exposure time Tc is 324 / 2H, the straight line with the on-pixel number ratio 0 (%) becomes the precharge signal Vp = VL02 at the point C when the ambient light illuminance is L. Point D is a precharge signal Vp = Vk set during calibration.

  VL0 and VL02 of the precharge signal Vp are voltages measured by changing or adjusting the precharge signal Vp. The precharge signal Vp = Vk is a value obtained by calculation or the like based on VL0 and VL02 of the precharge signal Vp.

  The distance between point B and point C is VL0−VL02. Therefore, it is obtained by changing the precharge signal Vp so that the on-pixel number ratio b (%) (exposure time Tc = DH) and the on-pixel number ratio b (%) (exposure time Tc = D / 2H). .

  The distance between point B and point C is m, and the distance between point C and point D is n. The ratio of m: n is the same even in the ambient light illuminances L, L ′, and L ″. Further, it hardly changes depending on the temperature and the wavelength of external light. If the value of m (or relative size) is known by obtaining the ratio or value of m: n at the time of shipment, inspection or adjustment of the panel, the value of n (or relative size) )). The value of m can be obtained from the precharge signal Vp by measuring VL0 and VL02 as the precharge signal Vp.

  When the exposure time Tc is changed, the ratio of m: n is kept constant with respect to arbitrary external light illuminance if the target on-pixel ratio (%) is the same. Further, by changing the exposure time Tc, a plurality of on-pixel number ratio b (%) straight lines pass through the E point of the origin. The present invention takes advantage of this property. A straight line having an on-pixel ratio of a (%) (indicated by a dotted line) does not pass through the origin E. However, as described above, it can be obtained by VL0 = VLa−ΔVw · a / 100. ΔVw is obtained when the panel is shipped or inspected or adjusted. Therefore, Vk can be obtained from the ratio of AC: CD.

  If m: n = 2: 1, the first precharge signal Vp = VL0 = 2.0 V, and the second precharge signal Vp = VL02 = 1.2 V, then m = 0.8, n = 0. 4 From this, Vk = 0.8V. This precharge signal Vp = Vk = 0.8 V is applied to the photosensor pixel 27.

  In the above embodiment, a plurality of exposure times Tc are set for any external light illuminance (the amount of light incident on the photosensor 35), and the first precharge signal Vp = VL0 and the second precharge signal Vp = VL02 was determined.

  The exposure time Tc may be set to three or more. By setting three or more exposure times Tc for an arbitrary external light illuminance L and performing an averaging process or a ratio process, the value of Vk can be obtained more accurately. Further, the precharge signal Vp = VL0 is obtained from one exposure time Tc, and Vk may be directly obtained from the known m: n value from this absolute value. Further, Vk may be obtained from the absolute value or relative value or the vicinity value of the precharge signals Vp = VL0 and VL02 and the values of m and n.

  V0 varies depending on the temperature dependency of the photosensor pixel 27, the wavelength dependency of light of the photosensor 35, and the like. In the method described with reference to FIG. 79, the precharge voltage is changed, adjusted, or set so as to obtain a predetermined on-pixel number ratio b (%) using the same photosensor pixel 27 with respect to an arbitrary external light illuminance L. Is.

  The value of the ambient light illuminance L is not necessary for obtaining V0. That is, it is only necessary to apply two different types of precharge signals so that the same on-pixel number ratio b (%) for different exposure times Tc for any external light illuminance.

Although the adjustment is made so that the same on-pixel number ratio b (%) is set for different exposure times Tc, it is not the same on-pixel number ratio b (%). Even if the ON pixel number ratio (%) with respect to the first exposure time Tc is b1 (%) and the ON pixel number ratio (%) with respect to the second exposure time Tc is b2 (%), VL0 = VLa−ΔVw. -By applying a / 100, b1 = b2. That is, even if the straight line of the on-pixel number ratio (%) does not pass through the origin E, the origin E can be shifted by calculation to be currencyd.
(8) Photosensor Configuration The description of FIG. 79 is an example in which one type of photosensor pixel 27 is formed in the display area 10. However, the present invention is not limited to this. A plurality of types of photosensor pixels 27 may be formed in the display area 10. If one photosensor pixel 27 is extracted from a plurality of photosensor pixels 27, the method of FIG. 79 can be applied. If the plurality of photosensor pixels 27 are processed as a unit, the embodiment of FIG. 79 can be applied.
(Second Embodiment)
In the embodiment of FIG. 79, the on-pixel ratio (%) is made the same by a plurality of exposure times Tc, but the present invention is not limited to this. The V0 voltage may be obtained from a ratio (%) of the number of ON pixels of 2 or more. Accuracy is improved by obtaining Vk from many exposure times Tc, precharge signal Vp, and on-pixel ratio (%), averaging the obtained Vk, and picking up the median.
(Third embodiment)
Calibration is performed using the obtained Vk voltage. However, Vk is not limited to changing in real time. Theoretically, the value of Vk is a fixed value due to a change in the ambient light illuminance L, but in reality the Vk voltage fluctuates due to the calculation accuracy. Therefore, it is better to change the Vk voltage used for calibration slowly. Moreover, it is preferable to have a hysteresis characteristic. Therefore, a fixed number of Vk voltages obtained are stored in the memory, and a moving average process is performed. In addition, processing for excluding the maximum value and the minimum value is performed. In addition, the amount of change that changes during a certain period is set within a specified range.
(Fourth embodiment)
In the description of the present specification, it is assumed that the Vk voltage is obtained for ease of explanation, but the present invention is not limited to this. A value approximate to Vk or a value similar thereto is obtained. In addition, a value corresponding to Vk is obtained or obtained indirectly. In some cases, V0 is directly used for calibration, but a predetermined value is added to or subtracted from the Vk voltage. Further, it is used with a predetermined constant.

It goes without saying that both the exposure time Tc and the precharge signal Vp may be changed simultaneously so that the multiplication value of the precharge signal Vp and the exposure time Tc is constant or has a predetermined relationship. In addition, the comparison voltage (comparator voltage) Vref may be changed.
(Fifth embodiment)
FIG. 78A approximates a characteristic curve bent at V0 and V3, but the present invention is not limited to this. For example, as shown in FIG. 78 (b), the ON pixel number ratio (%) approximates to a characteristic curve in which the precharge signal Vp corresponding to the position is x, y, or the bending or the angle changes depending on Va, Vb. May be. That is, it may be approximated not only to the two-point bending curve of FIG. 78 (a) but also to the four-point bending curve of FIG. 847 (b). That is, it may be approximated to a plurality of multi-point bending curves or curved curves. By approximating in this way, the V0 position and the like can be obtained more accurately.
(External illuminance acquisition method)
As described with reference to FIG. 79, the calibration voltage Vk can be calculated by determining the voltage difference between the exposure time Tc1 and the exposure time Tc2 using the values of m and n, the n / m ratio, and the like. Further, as shown in FIG. 80, the illuminance of external light can also be obtained.

As shown in FIG. 80, the calibration voltage VL0 is obtained by changing the precharge signal Vp so that the exposure time is Tc1 and the ON pixel number ratio is a. On the other hand, the calibration voltage VL02 is obtained by changing the precharge signal Vp so that the exposure time Tc2 is the same as the previous ON pixel number ratio a.
(1) Adjustment of illuminance correction coefficient H VL0-VL02 is the magnitude of m. ΔVp = VL0−VL02 or m (or n, n + m) is proportional to the external light illuminance L. That is, the external light illuminance can be estimated by multiplying the value of VL0-VL02 by a constant H. The value of H is written in the EEPROM 1401 mounted on the panel module as a panel characteristic value. The written value of H is read by a controller IC mounted on the array substrate 11 of the panel by COG, and the illuminance of outside light is calculated. The calculated external illuminance is transmitted to the microcomputer 814 arranged or mounted outside the panel module.

  The value of H is measured in the inspection or adjustment process before shipping the panel module. The adjustment is performed by irradiating the panel with light of the illuminance L to be set and adjusting the precharge signal Vp so that the predetermined on-pixel number ratio is a% in the exposure time Tc1. Further, the precharge signal Vp is adjusted so that the exposure time Tc2 is obtained and the predetermined ON pixel number ratio a%. ΔVp, which is the difference between the two precharge signals Vp, is obtained. Further, the ambient light illuminance L is measured. H = L / ΔVp is obtained, and this H is stored in the EEPROM. H is the ambient light illuminance ratio per 1 V of ΔVp.

  Therefore, the external light illuminance can be obtained by obtaining H × ΔVp. The value of a is preferably 30 to 90%. As described above, the present invention is a method for obtaining the conversion coefficient H from the precharge signal Vp corresponding to a plurality of exposure times Tc and the external light illuminance L at the time of measurement. Further, it is a method of obtaining the estimated external light illuminance using the conversion coefficient H during panel operation.

From the above, the ambient light illuminance can be estimated from H measured in consideration of the characteristics of each panel and ΔVp (or a value such as m) measured during the calibration operation. The panel controller IC calculates the ambient light illuminance L and transmits the value (H, L, etc.) to the microcomputer 814 (see FIG. 81). The microcomputer 814 can obtain ambient light illuminance using the display device of the present invention as a photosensor.
(2) Control of Backlight Luminance The microcomputer 814 controls the backlight LED driver 813 and the like of the display device of the present invention, and the backlight 656 so as to obtain appropriate display brightness according to the external light intensity (external light illuminance). Adjust. For example, when the illuminance of the outside light is low, the luminance of the backlight 656 is reduced to realize low power consumption. On the other hand, when the external light illuminance is high, the luminance of the backlight 656 is increased to improve the visibility.

As described above, the intensity of external illuminance can be detected using the photosensor pixel 27 formed in the display panel of the present invention. Further, the brightness of the backlight can be controlled using the detected external illuminance, and the optimum display brightness can be set.
(3) Adjustment of precharge signal (calibration voltage) When the obtained external light illuminance or a value or data correlated with the illuminance is equal to or less than a predetermined value, a driving method for changing the processing of the on-output region 691 is also exemplified. . For example, it is a case where the external light illuminance is very dark such as 50 Lx or less. In this case, it is preferable that the light 661 emitted from the backlight 656 is reflected by the object 701 and the reflected light is detected by the photosensor 35 rather than detecting the shadow of the object 701. Therefore, the photosensor pixel 27 corresponding to the location of the object 701 becomes an off output region 691 by optimally adjusting the precharge signal Vp. Other locations are on-output regions due to weak external light. Therefore, the state is opposite to that in FIG.

  In the above case, the subsequent processing methods can be implemented by inverting the output logic of the photosensor pixel 27 that is on and the photosensor pixel 27 that is off. .

The present invention is capable of detecting external light illuminance (or a relative value of external light illuminance). A change in which low illuminance is detected by detecting or grasping the illuminance of external light and the reflected light from the object 701 is detected by changing the logic can be realized.
(Second Embodiment)
When obtaining H, it is preferable to obtain not only one point but also adjust the external light illuminance to a plurality of points to calculate the value of H at many points and perform an averaging process or the like. Further, an error occurs in the value of H due to the illuminance of outside light. Therefore, it is divided into a plurality of areas such as an indoor area (low illuminance), an outdoor area (high illuminance), an ultra-high illuminance area (direct sunlight), and each H (H1, H2, H3) is obtained. Or it asks beforehand.

  In the present invention, the calibration voltage Vt, the illuminance of external light, and the like are calculated or obtained based on a value or size such as m. However, the magnitude of the precharge signal Vp during the first exposure time Tc, the magnitude of the precharge signal Vp during the second exposure time Tc, the magnitude of the calibration voltage Vt, the relative value or the absolute value, etc. And so on. As described above, according to the present invention, various values are calculated and calibrated by the precharge signal Vp corresponding to one or more exposure times Tc.

Values such as ΔVw are preferably corrected by the panel temperature (the temperature of the photosensor pixel 27). Moreover, it is preferable to correct by the dominant wavelength such as external light. A temperature sensor or photo sensor is placed on the panel and the output is corrected.
(Third embodiment)
The display device of the present invention is a method for detecting a shadow of an object 701 such as a finger. Therefore, when the outside light is weak, there is no difference between the on-pixel region 691 and the off-pixel region. Therefore, a shadow cannot be detected on the target 701, and coordinate detection cannot be realized. That is, an object (finger) cannot be input. If finger input is not possible, it is necessary to inform the operator that input is not possible.

  The display device of the present invention can obtain the external light illuminance L from the value of H stored in the EEPROM 1401 and a measured value such as ΔVp. By sending the calculated value of the external light illuminance to the microcomputer 814, the microcomputer 814 side can determine whether or not it is a low illuminance area where input is not possible.

  For example, when the input is not possible in a low illuminance region such as an external light illuminance of 50 Lx, a finger input x icon 831 is displayed as shown in FIG. 83 (a1). If input is possible with relatively high illuminance, a finger input ○ icon 831 is displayed as shown in FIG. 83 (a2).

  In addition, as illustrated in FIG. 83 (b2), when a finger input is possible, a character icon 831 may be displayed. If the input is impossible, no icon or the like is displayed as shown in FIG. 83 (b1). Further, it may be determined whether or not input is possible by voice guidance. As a determination that the input is impossible, the color of the character or the like may be changed. The operator may be notified by vibration of the vibrator. The magnitude of the external light illuminance may be displayed on the display screen 10. The luminance of the backlight 656 may be changed depending on the illuminance of outside light. Further, the color of the display screen 10 may be changed. Further, the backlight may be blinked. Further, a buzzer sound may be generated.

As described above, the present invention exhibits a characteristic effect that the external light illuminance can be accurately detected by the photosensor pixel 27 without having a photosensor for detecting the external light illuminance.
(Fourth embodiment)
As shown in FIG. 82, in the indoor (low illuminance) region, the outside light illuminance or the estimated outside light covers a range of 0 or more L1a (Lx) (Lw1). The range of the precharge signal Vp at that time is set to V1min or more and V1max. L1a (Lx) can be adjusted or set by the exposure time Tc and the precharge signal Vp.

  In the outdoor (high illuminance) region, the external light illuminance or the estimated external light covers the range of L1b to L2a (Lw2). The range of the precharge signal Vp at that time is V2min or more and V2max. The range L1b to L2a can be adjusted or set by the exposure time Tc and the precharge signal Vp.

  In the direct sunlight (ultra-high illuminance) region, the outside light illuminance or the estimated outside light covers the range of L2b or more and L3a (Lw3). The range of the precharge signal Vp at that time is V3min or more and V3max. The range L2b to L3a can be adjusted or set by the exposure time Tc and the precharge signal Vp. Note that the maximum value V3max of the precharge signal Vp is maintained in the range of L3a or more. At this time, the exposure time Tc may be reduced.

As shown in FIG. 82, the present invention is that the illuminance ranges (Lw1, Lw2, Lw3) to be covered overlap. That is, the range of Lw1 and the range of Lw2 overlap in the area a1. The range of Lw2 and the range of Lw3 overlap in the area a2. Moreover, at least a1 and a2 are 0 or more. The magnitudes of a1 and a2 are the range of change of the precharge signal Vp in each region (Vnmin, Vnmax where n is any one of 1, 2, and 3 in the embodiment of FIG. 82), and the exposure time Tc. Can be adjusted in settings. By providing the ranges of a1 and a2, the following effects are exhibited.
(1) Calibration First, an adjustment operation for calibration will be described. Consider a case where the precharge signal Vp is changed in order to perform calibration in the flat display device of the present invention. The external light illuminance is between L2a and L3a, and the calibration is started from the precharge signal Vp = V1min in the range of Lw1. The precharge signal Vp changes in the higher direction.

  When the point A1 where the maximum precharge signal Vp = V1max in the range of Lw1 is reached, the range shifts to the range of Lw2, and the precharge signal Vp changes to the point B1. At this time, the exposure time Tc also changes. Since the external light illuminance (or estimated external light) is higher, calibration cannot be set even in the range of Lw2, and the precharge signal Vp rises in the range of Lw2.

When the point A2 where the maximum precharge signal Vp = V2max in the range of Lw2 is reached, the range shifts to the range of Lw3, and the precharge signal Vp changes to the point B2. The exposure time Tc also changes to a value set in the range of Lw3. The precharge signal Vp changes in the range of Lw3, and a precharge signal Vp appropriate for the target external light illuminance (estimated external light) is determined.
(2) Hysteresis operation Ambient light is constantly changing. Further, the amount of light incident on the display area 10 changes due to the influence of the shadow of the object 701 and the like. In the present invention, Lw1, Lw2,... Are changed in accordance with the illuminance of outside light. However, the exposure time Tc varies in each range (Lw1, Lw2, Lw3,...). The precharge signal Vp also changes greatly, and the accuracy also changes. Therefore, it is preferable that the movement does not occur frequently in each range (Lw1, Lw2, Lw3,...).

  In the present invention, the hysteresis characteristics are configured by providing ranges of a1 and a2. For example, when the precharge signal Vp is adjusted in the range of Lw1, when the precharge signal Vp reaches A1, it moves to point B1 in the range of Lw2. Returning to the range of Lw1 again is when the precharge signal Vp drops to point C1 in the range of Lw2.

  When the point C1 is reached, the point changes to the point D1 in the range of Lw1, and the exposure time Tc and the like change. Similarly, when the precharge signal Vp is adjusted in the range of Lw2, when the precharge signal Vp reaches A2, it moves to point B2 in the range of Lw3. Returning to the range of Lw2 again is when the precharge signal Vp drops to the point C2 in the range of Lw3. When the point C2 is reached, the point changes to the point D2 in the range of Lw2, and the exposure time Tc and the like change.

  As described above, since the overlap ranges (a1, a2) are provided between the ranges (Lw1, Lw2, Lw3), the number of movements in each range decreases. Therefore, calibration can be performed in a stable state. The stability can be easily realized by adjusting the sizes of a1 and a2. That is, by providing an overlap range, a hysteresis operation that does not cause a range shift when a certain range of external light changes is realized.

The overlap periods (ranges) (a1, a2) of the ranges (Lw1, Lw2, Lw3) may be different, but the calibration process is easier if they are the same. For the maximum range Lw3 or more, it is preferable to perform the calibration process by setting the maximum precharge signal Vp = V3max and reducing the exposure time Tc. This is because the margin range of the calibration voltage is wide in the ultra-high illuminance range. This is because the constant precharge signal Vp operates without any problem and the calibration process becomes easy.
(3) Setting of exposure time Tc The exposure times Tc1 and Tc2 of each range (Lw1, Lw2, Lw3) may be the same or different. The relationship (Tc1a / Tc1b) between the exposure time Tc1a of the smallest illuminance range Lw1 and the exposure time Tc1b of the next illuminance range Lw2 is set to satisfy 2 or more and 8 or less. The relationship (Tc1b / Tc1c) between the exposure time Tc1c of the largest illuminance range Lw3 and the exposure time Tc1b of the previous illuminance range Lw2 is set to satisfy 4 or more and 12 or less. That is, the change in the exposure time Tc is reduced in the low illuminance range, and the change in the exposure time Tc is increased in the high illuminance range.
(Photosensor characteristic compensation)
When there is no characteristic unevenness or characteristic inclination of the photosensor 35 or the like in the input screen (display area) 10, the Vk voltage or V0 voltage in FIG. That is, one Vk is obtained (or calculated) for the entire characteristic variation of the photosensor pixels 27 in the display area 10.

  Of course, it goes without saying that the calibration voltage Vk may be obtained for each region 861. As shown in FIG. 84, the display area 10 is divided into a plurality of processing blocks (BL) 861, and the Vk voltage is obtained in each processing block (BL) 861.

The processing block divides the entire display area 10 into a plurality of parts, or divides a part of the display area 10 or a part of a predetermined range into a plurality of parts. The processing block (BL) is also divided into a plurality of sections. This section has a plurality of photosensor pixels 27, but the minimum configuration is one photosensor pixel 27 = 1 section. In some cases, processing block (BL) = section. Therefore, the minimum configuration of the processing block may be 1 processing block (BL) = 1 photo sensor pixel 27 in some cases.
(1) Characteristic distribution The display area 10 has a characteristic inclination in a certain direction. For example, as shown in FIG. 85A, the input screen 10 has characteristic gradients such as the photosensor 35 and the transistor 32b. In addition, as illustrated in FIG. 85B, the characteristics of the photosensor 35, the transistor 32b, and the like may be different between the central portion and the peripheral portion of the input screen 10. In addition, as illustrated in FIG. 85C, characteristic distributions of the photosensor 35, the transistor 32b, and the like may occur in a band shape in the input screen 10.

Due to variations in characteristics of the photosensor 35 and the transistor 32b described with reference to FIG. 85, each processing block (BL) 861 illustrated in FIG. 84A is turned on by a pixel corresponding to the precharge signal Vp as illustrated in FIG. 84B. The number ratio (%) varies in a certain range. As an example, the solid line in FIG. 84B is the average value in the input screen 10, the dotted line is the minimum value, and the alternate long and short dash line is the maximum value. For example, in processing block (BL) 861 a, a characteristic curve is indicated by a dotted line, in processing block (BL) 861 b is a characteristic curve indicated by a solid line, and in processing block (BL) 861 c, a characteristic curve is indicated by a one-dot chain line. It may become.
(2) Processing block (BL)
When Vk is obtained in the entire display area 10, it becomes the start voltage of the solid line in FIG. As an example, the precharge signal Vp is 1V. As shown in FIG. 78A, since linear approximation is performed, V0 is about 1.5V. In addition, a process block adds a symbol as BL and 861.

  In each processing block of the display area 10, the value of Vk or V0 is different in each processing block (BL) 861, as shown in FIG. For this reason, when Vk and V0 are obtained in the entire input screen (display area) 10, the calibration deviates from the appropriate value.

The present invention solves this problem as follows. In the present invention, as shown in FIG. 86, the processing block (BL) 861 (in the example, divided into BL1 to BL12 as shown in FIG. 84 (a)) is further divided into a plurality of sections. (FIG. 86). Each section has a plurality of photosensor pixels 27.
(3) Processing Block (BL) and Section FIG. 86A shows an example in which the processing block (BL) 861 is divided into sections in a matrix. FIG. 86 (b) shows an example in which the processing block (BL) 861 is divided into stripes. Each section in FIG. 86A has a plurality of photosensor pixels 27. The stripe-shaped section in FIG. 86 (b) is divided for each pixel row. That is, it is divided into one pixel row or 27 photosensor pixel rows. Of course, the invention is not limited to this, and the photosensor pixels may be divided into 27 rows.
(4) Application of Precharge Signal Vp Hereinafter, in order to facilitate the description, the embodiment of FIG. This is because the implementation of FIG. 86 (a) may be performed by dividing the embodiment of FIG. 86 (b) in the pixel column direction.

  FIG. 87 is an explanatory diagram of a driving method or a control method that compensates for characteristic variations of the photosensor 35 and the transistor 32b. FIG. 87 (a) is an explanatory diagram illustrating an adjustment process of the flat display device of the present invention. FIG. 87 (b) is an explanatory diagram of the operation state (use state) of the flat display device of the present invention.

  87A, a plurality of precharge signals Vp are applied to the processing block (BL) 861. The same precharge signal Vp is applied to each section. Accordingly, a plurality of precharge signals Vp are applied in the processing block (BL) 861 which is the same in the pixel row direction as a section.

  In FIG. 87A, the precharge signal Vp is described as being applied to the photosensor pixel 27 or the photosensor 35. The precharge signal Vp is a signal for adjusting the display device of the present invention. The precharge signal Vp is applied, and the precharge signal Vp is adjusted to measure or detect the characteristics of the photosensor pixel 27 or the photosensor 35. Therefore, it should be called a characteristic detection signal rather than the precharge signal Vp. However, since the characteristic detection signal and the precharge signal Vp have the same function, the description will be given here as the precharge signal Vp.

In FIG. 87, the difference in the magnitude of the precharge signal Vp is indicated by numbers 1 to 4. 1 (precharge signal Vp1), 2 (precharge signal Vp2), 3 (precharge signal Vp3), 4 (precharge signal Vp4), 1 being the lowest precharge signal Vp, and 4 being the highest precharge signal Vp. A plurality of types of precharge signals Vp are generated by the photosensor processing circuit 18.
(4-1) The magnitude of the precharge signal Vp Preferably, the kind of the magnitude of the precharge signal Vp is 4 or more. However, even if it is 2 or more, it can cope with a relatively wide range of external light.

For example, the precharge signal Vp has two stages of 2.50V and 2.52V. The precharge signal Vp has four stages of 2.50V, 2.51V, 2.52V, and 2.53V. The precharge signal Vp at the eight stages is 2.50V, 2.51V, 2.52V, 2.53V, 2.54V, 2.55V, 2.56V, and 2.57V.
(4-2) Difference in Precharge Signal Vp The difference in each precharge signal Vp is preferably 0.05 to 0.2V. Moreover, it is preferable to divide the V0 voltage to the V3 voltage in FIG. 78A by an integer. Moreover, it is preferable that it can change for every processing block (BL) 861. For example, in the block 1 of the processing block (BL) 861, the precharge signal Vp is set to 2.50V, 2.51V, 2.52V, and 2.53V, and in the block 2 of the processing block (BL) 861, the precharge signal Vp is set. Is 2.53V, 2.54V, 2.55V, and 2.56V. The type of the precharge signal Vp is preferably a multiplier of 2. That is, the type of the precharge signal Vp is 2, 4, 6, 8,.
(4-3) Precharge Signal Vp Application Position In FIG. 87, it is most preferable to change the precharge signals Vp 1 to 4 for each pixel row. However, if it is changed for each pixel row (one photosensor pixel row), the processing becomes complicated, and a large capacity of the memory 1401 for storing the result is required. Therefore, it is preferable to change for each pixel row as shown in FIG. Of course, every two pixel rows or a plurality of pixels may be changed.
(5) Response to liquid crystal panel drive method In the liquid crystal panel drive method, in the case of line inversion drive, positive and negative video signals are applied to each pixel row. The source signal line 23 and the photosensor pixel 27 are coupled by parasitic capacitance. Therefore, the potential level of the photosensor pixel 27 varies depending on the polarity of the video signal. In particular, as shown in FIG. 43, the influence is great when the signal line to which the precharge signal Vp is applied and the source signal line to which the video signal is applied are shared.

  If the value of the precharge signal Vp is changed for every two pixel rows, since the positive and negative video signals are applied in pairs in the two pixel rows, they are not affected by the polarity of the video signal or can be reduced. . Therefore, it is effective to change the voltage of the precharge signal Vp for each pixel row that is a multiple of two.

  That is, the precharge signal Vp1 is applied to the first and second pixel rows, the precharge signal Vp2 is applied to the third and fourth pixel rows, the precharge signal Vp3 is applied to the fifth and sixth pixel rows, Apply to the 7th and 8th pixel rows. Also, the precharge signal Vp1 is applied to the first, second, third, fourth and fourth pixel rows, and the precharge signal Vp2 is applied to the fifth, sixth, seventh and eighth pixel rows, and the ninth, tenth, eleventh and twelfth rows. The precharge signal Vp3 is applied to the pixel rows of, and... Are applied to the 13, 14, 15, 16th pixel rows.

  As described above, when the line inversion drive changes the polarity of the video signal for each pixel row, the precharge signal Vp is changed for every two pixel rows. That is, the precharge signal Vp is changed with the polarity period of the video signal as one unit. Therefore, the division is divided in consideration of the polarity period of the video signal.

  The above embodiment is the description of the division in the pixel row direction. When the driving method of the liquid crystal display panel changes the polarity of the video signal in the column direction such as column inversion, the division is divided according to the pixel column.

Changing the precharge signal Vp for each pixel row or for each of a plurality of pixel rows can be performed by one precharge signal Vp generation source. This is because the precharge signal Vp to be applied may be changed every one horizontal scanning period or every plural horizontal scanning periods.
(6) Change in Precharge Signal Vp The precharge signal Vp of each processing block (BL) 861 is determined according to the intensity of external light illuminance and the illuminance of the backlight 656. Which precharge signal Vp is selected is determined by inspection (measurement) in an inspection process before shipment of the panel. In that case, the backlight 656 actually used or a similar light generation source is attached. This is because the precharge signal Vp to be selected may be different in the peripheral area of the display area 10 due to the influence of the backlight 656 or the like.
(7) Basic precharge signal Vp
It may be set not by the absolute value of the precharge signal Vp but by the difference from the value of the basic precharge signal Vp. The basic precharge signal Vp is V0, and the difference values are 0.1V, 0.25V, 0.32V, 0.11V, and the like. Therefore, the precharge signal Vp applied to each photosensor pixel 27 is V0 + 0.10, V0 + 010, V0 + 0.25, V0 + 0.30, V0 + 0.32,. That is, a median precharge signal Vp (basic precharge signal Vp) is determined, and the sizes of the plurality of precharge signals Vp are determined with the precharge signal Vp as a center.
(8) Adjustment Method FIG. 87A is an explanatory diagram of the adjustment method of the flat display device of the present invention. In FIG. 87A, the precharge signal Vp is applied for each section. The precharge signal Vp to be applied is applied in accordance with the characteristics of the photosensor pixel 27. First, the ratio (%) of the number of ON pixels in the section is set. For example, the ON pixel number ratio (%) that is easy to measure or grasp, such as 0%, 5%, 50%, and 100%, is determined for each category. Here, for ease of explanation, the on-pixel number ratio (%) is set to 50%.

  In the following description, it is assumed that the precharge signal Vp is determined based on one on-pixel number ratio (%), but the present invention is not limited to this. For example, the precharge signal Vp is adjusted so that the ratio (%) of the number of ON pixels is 5% and 20%, and a predetermined one precharge signal Vp is obtained by considering or calculating a plurality of precharge signals Vp. You may ask. In the following description, the on-pixel ratio (%) is described as a predetermined value, but the present invention is not limited to this. For example, the precharge signal Vp may be adjusted and determined so that the number of ON pixels becomes a predetermined value in each section.

  In FIG. 87A, the precharge signal Vp is applied to the section 1, and the on-pixel number ratio (%) is measured. When the on-pixel number ratio (%) is smaller than 50%, a precharge signal Vp higher than the previously applied precharge signal Vp is applied. When the on-pixel number ratio (%) is larger than 50%, a precharge signal Vp lower than the previously applied precharge signal Vp is applied. As described above, the precharge signal Vp to be applied is changed, and the on-pixel number ratio (%) is adjusted to 50% or a value in the vicinity thereof. The value in the vicinity is ± 10% or less. More preferably, the precharge signal Vp is adjusted or set to be ± 5% or less.

  As described above, the precharge signal Vp is adjusted so that the on pixel number ratio (%) is 50%. When the precharge signal Vp1 is applied, the on pixel number ratio (%) is 50%. And the value or data indicating the precharge signal Vp1 is stored in the EEPROM 1401 as the precharge signal Vp of section 1. The above operation is performed by controlling the photo sensor processing circuit 18 with the MPU 814.

  Similarly, the precharge signal Vp is applied to the section 2 and the on-pixel number ratio (%) is measured. When the on-pixel number ratio (%) is smaller than 50%, a precharge signal Vp higher than the previously applied precharge signal Vp is applied. When the on-pixel number ratio (%) is larger than 50%, a precharge signal Vp lower than the previously applied precharge signal Vp is applied. As described above, the precharge signal Vp to be applied is changed, and the on-pixel number ratio (%) is adjusted to 50% or a value in the vicinity thereof. The value in the vicinity is ± 10% or less. More preferably, the precharge signal Vp is adjusted or set to be ± 5% or less.

  As described above, also in the category 2, the precharge signal Vp is adjusted, and the on-pixel number ratio (%) is 50%. When the precharge signal Vp2 is applied, the on-pixel number ratio (% ) Is determined to be 50%), and the value or data indicating the precharge signal Vp2 is stored in the EEPROM 1401 as the precharge signal Vp of section 2.

  Similar processing is performed in each section, and a precharge signal Vp (precharge signal Vp in which the on-pixel number ratio (%) is 50%) optimum for the characteristics of the photosensor pixel 27 of each section is measured or set, and measured. Alternatively, the set precharge signal Vp is stored in storage means such as the EEPROM 1401.

  As described above, the precharge signal Vp for the section is determined. 87 (a), for section 1, section 2, section 3, section 4,..., Precharge signal Vp1, precharge signal Vp2, precharge signal Vp2, precharge signal Vp4,. ... And the set value is stored in the EEPROM 1401.

  When the application operation of the precharge signal Vp in FIG. 87A is performed, the photosensor pixel 27 is not irradiated with light. Alternatively, the display area 10 or the formed photosensor pixels 27 are uniformly irradiated with light having a predetermined known intensity. Alternatively, the photosensor pixels 27 to be adjusted are irradiated uniformly. The above matters are the same as in FIG. Further, the exposure time Tc and the panel temperature are fixed to predetermined values.

  By this processing, in FIG. 79, a = 50 and the origin position is determined. If a = 0 (on-pixel ratio (%) = 0), point E is obtained. Similarly, if the same processing is performed as the exposure time Tc / 2, the point E or the point V0 is determined (see the description of FIGS. 79 and 80). Therefore, the characteristic compensation of the photosensor pixel 27 can be performed. Further, the data of the precharge signal Vp stored in the EEPROM 1401 corresponds to the characteristics of the photosensor pixels 27 in each section.

The precharge signal Vp to be applied to each section is generated using the precharge signal Vpx of the EEPROM 1401, and the characteristics of the photosensor pixel 27 can be compensated by applying the precharge signal Vp to each section. This is because the data stored in the EEPROM 1401 reflects the characteristics of the photosensor pixels 27 of each section.
(8-1) Operation State Description of the operation state of the present invention is shown in FIG. 87 (b). In the operating state, the precharge signal Vp or data corresponding to the precharge signal Vp is read from the EEPROM 1401, and the precharge signal Vp corresponding to (compensating for) the characteristics of the photosensor pixel 27 of each section is obtained and applied to the photosensor pixel 27. To do.

  In FIG. 87 (b), for easy understanding, it is assumed that the precharge signal Vp in FIG. 87 (a) and the precharge signal Vp in FIG. 87 (b) are the same in each section. However, as described with reference to FIG. 79, the precharge signal Vp to be applied is processed so as to correspond to V0, Vk, etc., and the precharge signal Vp after the processing is applied to the photosensor pixel 27. Needless to say.

By driving or controlling as described above, calibration processing, on-pixel number ratio (%) processing, and the like can be favorably performed. In addition, by driving or controlling as shown in FIG. 87, even if there is characteristic unevenness and distribution of the photosensor pixel 27 as shown in FIG. 85, it can be compensated. Therefore, erroneous input does not occur in all the input areas 10, and coordinate input can be performed satisfactorily.
(8-2) Modification Example of Adjustment Method In the embodiment of FIG. 87, the optimum precharge signal Vp is determined for each section, and the data corresponding to the determined precharge signal Vp or precharge signal Vp is stored in the EEPROM 1401. It was a method to do.

  FIG. 88 shows a precharge signal Vp or a precharge signal Vp of the processing block (BL) 861 by measuring the precharge signal Vp suitable for the characteristics of the photosensor pixel 27 in the processing block (BL) 861 in the adjustment step. 4 is an explanatory diagram of a method of storing data in an EEPROM 1401. FIG.

  During operation, a different precharge signal Vp is applied to each section in each processing block (BL) 861, the section corresponding to the precharge signal Vp stored in the EEPROM 1401 is extracted, and the number of on pixels of the extracted section A ratio (%) is obtained and a calibration process or the like is performed.

  FIG. 88A is an explanatory diagram of the adjustment process. A precharge signal Vp is applied to each processing block (BL) 861 or the entire display area 10. Here, for ease of explanation, it is assumed that the precharge signal Vp is applied to each processing block (BL) 861 and the optimum precharge signal Vp is measured or adjusted.

  In FIG. 88A, the precharge signal Vp is applied to the processing block (BL1) 861, and the on-pixel number ratio (%) is measured. When the on-pixel number ratio (%) is smaller than 50%, a precharge signal Vp higher than the previously applied precharge signal Vp is applied. When the on-pixel number ratio (%) is larger than 50%, a precharge signal Vp lower than the previously applied precharge signal Vp is applied. As described above, the precharge signal Vp to be applied is changed, and the on-pixel number ratio (%) is adjusted to 50% or a value in the vicinity thereof.

  As described above, the precharge signal Vp is adjusted so that the on pixel number ratio (%) is 50%. When the precharge signal Vp1 is applied, the on pixel number ratio (%) is 50%. And the value or data indicating the precharge signal Vp1 is stored in the EEPROM 1401 as the precharge signal Vp of section 1.

  Similarly, the precharge signal Vp is applied to the processing block (BL2) 861, and the on-pixel number ratio (%) is measured. When the on-pixel number ratio (%) is smaller than 50%, a precharge signal Vp higher than the previously applied precharge signal Vp is applied. When the on-pixel number ratio (%) is larger than 50%, a precharge signal Vp lower than the previously applied precharge signal Vp is applied. As described above, the precharge signal Vp to be applied is changed, and the on-pixel number ratio (%) is adjusted to 50% or a value in the vicinity thereof.

  As described above, also in the processing block (BL2) 861, when the precharge signal Vp is adjusted and the precharge signal Vp2 (the precharge signal Vp2 is applied) in which the ON pixel number ratio (%) is 50%, And the value or data indicating the precharge signal Vp2 is stored in the EEPROM 1401 as the precharge signal Vp of the processing block (BL) 861.

  Similar processing is performed in each section, and a precharge signal Vp (precharge signal Vp in which the on-pixel number ratio (%) is 50%) optimum for the characteristics of the photosensor pixel 27 of each section is measured or set, and measured. Alternatively, the set precharge signal Vp is stored in storage means such as the EEPROM 1401.

  As described above, the processing block (BL) 861 precharge signal Vp is determined. 87A, for the processing block (BL1) 861, the processing block (BL2) 861, the processing block (BL3) 861,..., The precharge signal Vp1, the precharge signal Vp2, and the precharge signal. Vp4, precharge signal Vp2,... Are set, and the set values are stored in the EEPROM 1401.

  When applying the precharge signal Vp shown in FIG. 88A, the photosensor pixel 27 is not irradiated with light as in FIG. Alternatively, it is performed in a state where light of a predetermined known intensity is applied to the photosensor pixel 27. The light having a known intensity is uniformly applied to the area where the photosensor pixels 27 are formed. Further, the exposure time Tc and the panel temperature are fixed to predetermined values. The temperature is set at or near the operating temperature. Since other matters are the same as those in FIG.

  88A, the precharge signal Vp is described as being applied to the processing block (BL) 691, and this precharge signal Vp is a signal for adjusting the display device of the present invention. The precharge signal Vp is applied, and the precharge signal Vp is adjusted to measure or detect the characteristics of the processing block 691. Therefore, it should be called a characteristic detection signal rather than the precharge signal Vp.

  The operation state in FIG. 88 (b) is different from the operation state in FIG. 87 (b). In FIG. 87 (b), the precharge signal Vp read from the EEPROM 1401 or data corresponding to the precharge signal Vp is generated and applied to each section.

  In FIG. 88 (b), a precharge signal Vp in predetermined increments is applied to each section with a predetermined precharge signal Vp as the center. The predetermined precharge signal Vp is the precharge signal Vp stored in the EEPROM 1401 in FIG. 88A or the precharge signal Vp generated from the precharge signal Vp. A plurality of precharge signals Vp at predetermined intervals around the precharge signal Vp are generated and applied in order to each section.

  In FIG. 88 (b), for easy understanding, the precharge signal Vp has five types of precharge signals Vp1 to Vp5. Further, it is assumed that five types of precharge signals Vp are sequentially applied to the respective sections regardless of the average value of the precharge signal Vp in each processing block (BL) 861.

88B, in the processing block (BL1) 861, the precharge signal Vp1,
Precharge signal Vp2 for section 2, precharge signal Vp3 for section 3, precharge signal Vp4 for section 4, precharge signal Vp5 for section 5, precharge signal Vp1 for section 6, precharge signal Vp2 for section 7, section 8 , And five kinds of precharge signals Vp are sequentially applied.

  The central value of the precharge signal Vp applied to each processing block (BL) 861 may be different in the processing block (BL) 861. For example, precharge signal Vp1 = 2.0 (V), precharge signal Vp2 = 2.2 (V), precharge signal Vp3 = 2.4 (V), precharge signal Vp4 = 2.6 (V), The precharge signal Vp5 = 2.8 (V) and the increment is 0.2 (V). Since the processing block (BL1) 861 is the precharge signal Vp1 = 2.0 (V), the precharge signal Vp1 is generated around the precharge signal Vp1, and two stages of precharge signals Vp are generated before and after the processing block (BL1). 861 is applied. Accordingly, the precharge signal Vp applied to each section has five types of voltages of 1.6, 1.8, 2.0, 2.2, and 2.4.

  Further, since the processing block (BL2) 861 has the precharge signal Vp2 = 2.2 (V), the precharge signal Vp2 is generated around the precharge signal Vp2, and the precharge signal Vp is generated in two stages before and after the processing block (BL1). ) 861 is applied. Accordingly, the precharge signal Vp applied to each section has five types of voltages of 1.8, 2.0, 2.2, 2.4, and 2.6.

  As shown in FIG. 101, a difference ΔVp for each processing block (BL) 691 may be set and specified by No to be selected. For example, no. When = 2 is specified, ΔVp = 0.1V and the precharge signal Vp = V0 + 0.10. The difference ΔVp data is stored in the EEPROM.

  Although ΔVp in FIG. 101 is a difference for each processing block (BL) 691, the present invention is not limited to this. ΔVp may be a difference between sections (see FIG. 87, FIG. 88, etc.). ΔVp is not limited to the positive direction (for example, No. 3 is +3.0 V), but may be the negative direction (for example, No. 2 is −0.10 V and No. 3 is −0.25 V).

  In the embodiment of FIG. 101, V0 may be a precharge signal Vp obtained by averaging the characteristics of the photosensor pixels 27 in the input region, and ΔVp may be a difference in characteristics between the precharge signal Vp = V0 and the photosensor pixels 27 in each section. For example, when the reference precharge signal Vp = V0 = 2.5V, ΔVp = 0.10V in section 1 (No. 1), ΔVp = 0.10V in section 2 (No. 2), section 3 (No. 3) ΔVp = 0.25 V, Section 4 (No. 4) ΔVp = 0.30 V, Section 5 (No. 5) ΔVp = 0.32 V,. In this embodiment, the precharge signal Vp = (2.5 + 0.10) V is applied to the section 1 (No. 1), and the precharge signal Vp = (2. 5 + 0.10) V is applied, precharge signal Vp = (2.5 + 0.25) V is applied to section 3 (No. 3), and precharge signal Vp is applied to section 4 (No. 4). = (2.5 + 0.30) V is applied, and the precharge signal Vp = (2.5 + 0.32) V is applied to the section 5 (No. 5).

  The reference precharge signal Vp = V0 voltage has an optimum value depending on the external illuminance and the panel temperature, and is therefore changed by calibration. That is, the reference precharge signal Vp = V0 constantly changes depending on the external illuminance or the like. ΔVp indicates a relative characteristic difference of the photosensor pixel 27 in the section or processing block (BL) 691. The on-pixel ratio (%) of the photosensor pixels 27 in the input area is adjusted to a predetermined value or a predetermined range by calibration, and the precharge signal Vp applied at that time is set as a reference precharge signal Vp = V0. ΔVp indicating the characteristic difference of the photosensor pixel 27 of each section or processing block (BL) 691 is added to this reference precharge signal Vp = V0 (if ΔVp is in the negative direction, it is subtracted). Note that ΔVp is a characteristic difference of a photo sensor or the like, but is not limited thereto, and may be one that takes into account the influence of light emitted from the backlight. In particular, the light from the backlight wraps around the peripheral portion of the panel, and the optimum value of the precharge signal Vp is different from the central portion of the panel. This difference is measured as ΔVp and stored in the EEPROM.

  In each section or processing block (BL) 691, the characteristic difference ΔVp of the photosensor pixel 27 or the photosensor 35 of each section or processing block (BL) 691 is measured or acquired in the panel adjustment process. Or consider the influence of the backlight. This characteristic difference ΔVp is stored in the EEPROM. During panel operation, the characteristic difference ΔVp of each section or each processing block (BL) 691 stored in the EEPROM is added to or subtracted from the reference precharge signal Vp = V0 obtained by calibration, so that each section or each processing is performed. A precharge signal Vp (V0 + ΔVp) applied to the block (BL) 691 is obtained. The obtained precharge signal Vp (V0 + ΔVp) is applied to each processing block (BL) 691 or each section.

  By configuring or implementing as described above, it is possible to cancel the influence of the characteristic distribution of the photosensor pixel 27 and the like, and to realize favorable coordinate input and object contact determination. In the above embodiment, ΔVp of the classification and processing block (BL) 691 is acquired. However, the present invention is not limited to this. ΔVp data is acquired by each photosensor pixel 27 and stored in a memory. , ΔVp data may be used to generate the precharge signal Vp. In the above embodiment, the ΔVp data is stored in the EEPROM or the like. However, the present invention is not limited to this, and the acquired data such as ΔVp may be temporarily stored using a sample hold circuit.

  Needless to say, the above matters can be applied to other embodiments of the present invention. It goes without saying that the embodiments of the present invention such as FIGS. 87, 88 and 101 can be combined with each other. That is, the embodiments of the present invention can be implemented alone or in combination.

  The classification adopted for the on-pixel number ratio (%) is the same as the precharge signal Vp of the processing block (BL) 861 in FIG. For example, since the processing block (BL1) 861 has the precharge signal Vp = Vp1, the processing block (BL1) 861 of FIG. is there. It is not used for calculation or processing of the ratio of the number of on pixels (%) in other places.

  Similarly, since the processing block (BL2) 861 has the precharge signal Vp = Vp2, the section of the processing block (BL2) 861 in FIG. 88 (b) adopts a place where the precharge signal Vp = Vp2 is applied. Similarly, since the processing block (BL3) 861 has the precharge signal Vp = Vp4, the portion (section) where the precharge signal Vp = Vp4 is applied is adopted in the section of the processing block (BL3) 861 in FIG. 88 (b). To do.

  In the adjustment step shown in FIG. 88A, the characteristics of the photosensor 35 and the like of each processing block (BL) 861 are measured, and the precharge signal Vp or the precharge signal Vp having a central or average characteristic is used. Seeking corresponding data. Therefore, the selected section in FIG. 88B is a section to which the precharge signal Vp that matches the characteristics of the processing block (BL) 861 is applied.

  Therefore, by selecting a section to which the precharge signal Vp that matches the characteristics of each processing block (BL) 861 is selected and deselecting the other sections, erroneous input and erroneous detection are eliminated. Using the on / off state of the photosensor pixels 27 of the selected section, processing such as the ratio of the number of on-pixels (%), approach, contact, and separation is performed.

The kind of the precharge signal Vp applied to one processing block (BL) 861 is preferably a multiple of 2. Particularly, 4 or more and 8 or less are preferable. The type is preferably 2 or more and 16 or less. If the number of precharge signals Vp is small, variations in the display area 10 cannot be absorbed. If the number is too large, the number of photosensor pixels per type decreases, and the coordinate detection accuracy decreases.
(9) Type of Precharge Signal Vp Applied to Processing Block The type of precharge signal Vp applied to one processing block (BL) 861 is determined according to the external light or the intensity (luminance or illuminance) of the backlight 656. Good. When the illumination is low, the types of precharge signals Vp applied to one processing block (BL) 861 are increased. In the high illuminance range, the number of precharge signals Vp applied to one processing block (BL) 861 is reduced. This is because the calibration margin is narrow in the low illumination range.
(10) Change in Precharge Signal Vp The change width of a plurality of precharge signals Vp applied to one processing block (BL) 861 corresponds to the intensity of external light or backlight 656 (luminance or illuminance). It is good to decide. When the illuminance is low, the width of the precharge signal Vp is increased. In the high illuminance range, the change width of the precharge signal Vp is reduced. This is because the calibration margin is narrow in the low illumination range.

  Needless to say, the above items (type of precharge signal Vp and change width) may be used in combination with the illuminance of outside light.

The embodiment shown in FIGS. 87 and 88 measures the characteristics of the processing block (BL) 861 and the photosensor pixels 27 of the section, and applies the precharge signal Vp that matches the characteristics or sets it to a predetermined potential to turn it on. Pixel number ratio (%) processing and the like were performed. That is, the precharge signal Vp is applied so as to match the characteristics of the photosensor pixel 27. By matching the characteristics, variations in characteristics of the photosensor pixels 27 can be absorbed, and erroneous input or the like is eliminated.
(Setting of non-inputtable area)
If a precharge signal Vp that does not completely match the characteristics of the photosensor pixel 27 is applied, the corresponding photosensor pixel 27 does not operate. For example, if a precharge signal Vp of 5.0 (V) is applied to the photosensor pixel 27 having an optimal precharge signal Vp of 1.5 (V), the on state is always maintained. Alternatively, the on state or the off state is maintained by the incidence of external light, and the portion where the normal precharge signal Vp is applied is different from the operation. Therefore, the operation can be changed by distinguishing this difference.

  Further, when the precharge signal Vp of 0.5 (V) is applied to the photosensor pixel 27 having the optimum precharge signal Vp of 2.5 (V), the off state is always maintained. Alternatively, the on state or the off state is maintained by the incidence of external light, and the portion where the normal precharge signal Vp is applied is different from the operation. Therefore, by distinguishing this difference, the operation of the flat display device of the present invention can be changed.

  For ease of explanation, embodiments of the present invention will be described with the following assumptions. It is assumed that outside light is input to the flat display device of the present invention by shielding the light with a shield 701 such as a finger. Therefore, a precharge signal Vp for turning on the transistor 32b is applied to the photosensor pixel 27, the photosensor pixel 27 shielded by the finger 701 is kept on, and the photosensor pixel 27 irradiated with external light is turned off. Shall be.

  The processing block (BL) 861 that is not reacted is applied with the precharge signal Vp for turning off the photosensor pixel 27 from the beginning, or is not applied with the precharge signal Vp. An example in which a very high precharge signal Vp is applied to the non-reactive photosensor pixel 27 and the on state is maintained even when external light is irradiated is also exemplified.

The precharge signal Vp optimum for the processing block (BL) 861 varies depending on the characteristic variation of the photosensor pixel 27 (FIG. 85). However, for ease of explanation, the precharge signal Vp optimum for each processing block (BL) 861 is 2.5 (V). As the precharge signal Vp to be applied decreases, the photosensor pixel 27 is turned off and stops responding. That is, it becomes difficult to react as the precharge signal Vp becomes lower than 2.5 (V), and it does not react at all below 1.5 (V).
(1) Setting of Precharge Signal Vp FIG. 89A shows an embodiment in which the precharge signal Vp = 2.5 (V) is applied to all the processing blocks (BL) 861. All processing blocks (BL) 861 can detect the presence / absence of input and input coordinates by changing the on / off output area by an object 701 such as a finger.

  In FIG. 89B, the precharge signal Vp = 2.5 (V) is applied to BL1, BL3, BL10, BL12 of the processing block (BL) 861, and the precharge signal Vp is applied to the other processing block (BL) 861. = 1.5 (V) is applied. By applying the precharge signal Vp in this way, only BL1, BL3, BL10, and BL12 of the processing block (BL) 861 can perform input determination and coordinate detection.

  In FIG. 89C, the precharge signal Vp = 2.5 (V) is applied to BL5 and BL8 of the processing block (BL) 861, and the precharge signal Vp = 1.5 is applied to the other processing block (BL) 861. Apply (V).

  By applying the precharge signal Vp in this way, only BL5 and BL82 of the processing block (BL) 861 can perform input determination and coordinate detection. That is, only the central portion of the display area 10 can be input with coordinates, and the other portions can be input-prohibited areas or areas that do not react even if input is attempted.

  As described above, the precharge signal Vp is applied to each processing block (BL) 861, and the precharge signal Vp to be applied is changed or adjusted, thereby adjusting or setting the coordinate input and the validity / invalidity of the presence / absence of the input. be able to.

In the embodiment of FIG. 89, a precharge signal Vp or the like is set for each processing block (BL) 861, and coordinate input, whether input is valid or invalid is adjusted or set. However, the present invention is not limited to this. For example, it goes without saying that the precharge signal Vp or the like may be set or adjusted for each of the sections described with reference to FIG.
(2) Input Operation FIG. 90 is an explanatory diagram of the operation. 90A, a precharge signal Vp = 2.5 (V) is applied to BL1, BL2, BL3, BL10, BL11, and BL12 of the processing block (BL) 861, and the other processing block (BL) 861 is applied. A precharge signal Vp = 1.5 (V) is applied. By applying the precharge signal Vp in this manner, only BL1, BL2, BL3, BL10, BL11, and BL12 of the processing block (BL) 861 can perform input determination and coordinate detection. That is, it is not possible to input coordinates at the center of the display area 10.

Therefore, as shown in FIG. 90B, even if there is a shadow of the input object 701 in BL8 of the processing block (BL) 861, input cannot be performed. If there is a shadow of the input object 701 in BL3 of the processing block (BL) 861 as shown in FIG. 90 (c), an ON output area 691 is generated and can be input.
(3) Linkage with Screen Display FIG. 91 is a detailed example of the operation of the processing block (BL) 861. FIG. 91 shows an embodiment in which a plurality of selection screens are displayed and the precharge signal Vp applied to each processing block (BL) 861 is changed in synchronization with the screen display. The following is an example of selecting a film image displayed on the screen 10.

  In FIG. 91 (a 1), a film image 911 is displayed on the display screen 10. The film image 911a corresponds to BL1 of the processing block (BL) 861, and the film image 911b corresponds to BL4 of the processing block (BL) 861. Further, the film image 911c corresponds to BL7 of the processing block (BL) 861, and the film image 911d corresponds to BL10 of the processing block (BL) 861.

  The film image 911e corresponds to BL3 of the processing block (BL) 861, and the film image 911f corresponds to BL6 of the processing block (BL) 861. The film image 911g corresponds to BL9 of the processing block (BL) 861, and the film image 911h corresponds to BL12 of the processing block (BL) 861.

  In the above state, the precharge signal Vp = 2.5 (V) is applied to BL1, BL4, BL7, BL10, BL3, BL6, BL9, and BL12 of the processing block (BL) 861 to make it ready for input. On the other hand, the precharge signal Vp = 1.5 (V) is applied to BL2, BL5, BL8, and BL11 of the processing block (BL) 861 so as not to operate (cannot be selected).

  Therefore, the center part of the display area cannot be input, and the left and right parts are set in a state where input is possible. Note that the film image to be finally selected is indicated by a circle on the film 911a in FIG. 91 (a1).

  In this state, 911a having a film image to be selected by the object 701 is selected. Then, the display state changes to that shown in FIG. In FIG. 91 (b1), only the film image 911a is displayed in the display area 10. On the other hand, a precharge signal Vp = 2.5 (V) is applied to BL4, BL5, and BL6 of the processing block (BL) 861, so that input is possible. The other processing block (BL) 861 is applied with the precharge signal Vp = 1.5 (V) and set so as not to react.

  As described above, the precharge signal Vp is set so that it cannot be input in order to prevent erroneous input and malfunction due to selection of unnecessary portions.

  In FIG. 91 (b1), film images 911aa, 911ab, and 911ac are displayed at positions BL4, BL5, and BL6 of the processing block (BL) 861. The film image 911aa corresponds to BL4 of the processing block (BL) 861, the film image 911ab corresponds to BL5 of the processing block (BL) 861, and the film image 911ac corresponds to BL6 of the processing block (BL) 861. The film image 911ab is selected by touching BL5 of the processing block (BL) 861 with the object 701.

  Next, the display screen is in the display state of FIG. 91 (c1). In the processing block (BL) 861, the precharge signal Vp = 2.5 (V) is applied to BL2, BL5, and BL8 (FIG. 91 (c2)). Further, the precharge signal Vp = 1.5 (V) is applied to the other processing block (BL) 861 (FIG. 91 (c2)). Therefore, only BL2, BL5, and BL8 of the processing block (BL) 861 can be input, and the other processing blocks (BL) 861 are set to input disabled.

In the above state, the film 911aba is selected by touching BL2 of the processing block (BL) 861 with the object 701. As described above, according to the present invention, the precharge signal Vp is applied to the processing block (BL) 861, the section, and the like, and the size of the precharge signal Vp is changed to form the input enabled area and the disabled area. Further, the selected image is displayed in correspondence with the position of the processing block (BL) 861 or the like. Further, by controlling the application of the precharge signal Vp and the image display state, good control and coordinate input can be realized.
(9-1) First Modification In the above embodiment, the precharge signal Vp is applied to each processing block (BL) 861, and is set to a binary value indicating whether input is possible or not. . However, the present invention is not limited to this.

  FIG. 92A shows an embodiment in which three types of precharge signals Vp are applied. BL5 and BL8 of the processing block (BL) 861 are regions to which the precharge signal Vp = 2.5 (V) is applied. BL2, BL4, BL6, BL7, BL9, and BL11 of the processing block (BL) 861 are regions to which the precharge signal Vp = 2.0 (V) is applied. BL1, BL3, BL10, and BL12 of the processing block (BL) 861 are regions to which the precharge signal Vp = 1.5 (V) is applied.

  Inputs can be performed properly in BL5 and BL8 of the processing block (BL) 861, and BL2, BL4, BL6, BL7, BL9 and BL11 of the processing block (BL) 861 are in a relatively difficult range. . However, input is possible depending on the intensity of external light. For example, when the intensity of external light changes suddenly and becomes weak, the precharge signal Vp setting in BL2, BL4, BL6, BL7, BL9, and BL11 of the processing block (BL) 861 is optimized and input is possible. .

On the other hand, the precharge signal Vp is too high for BL5 and BL8 of the processing block (BL) 861, and the ON state is maintained. Therefore, it becomes impossible to input. BL1, BL3, BL10, and BL12 of the processing block (BL) 861 are ranges incapable of input.
(9-2) Second Modification FIG. 92B shows an embodiment in which two types of precharge signals Vp are applied. BL1, BL3, BL7, and BL9 of the processing block (BL) 861 are regions to which the precharge signal Vp = 2.5 (V) is applied. The other processing block (BL) 861 is a region to which the precharge signal Vp = 1.5 (V) is applied. Inputs can be performed properly in BL1, BL3, BL7, and BL9 of the processing block (BL) 861, and the other processing blocks (BL) 861 are areas in which input is not possible.
(9-3) Third Modification FIG. 92 (c) is an embodiment in which four types of precharge signals Vp are applied. BL1, BL2, and BL3 of the processing block (BL) 861 are regions to which the precharge signal Vp = 2.5 (V) is applied.
BL4, BL5, and BL6 of the processing block (BL) 861 are regions to which the precharge signal Vp = 2.25 (V) is applied. BL7, BL8, and BL9 of the processing block (BL) 861 are regions to which the precharge signal Vp = 2.0 (V) is applied. BL10, BL11, and BL12 of the processing block (BL) 861 are regions to which the precharge signal Vp = 1.75 (V) is applied.

  In the embodiment of FIG. 92 (c), the precharge signal Vp is 2.5 (V) for the set of vertical processing blocks (BL) 861 (for example, BL1, BL4, BL7, BL10). 25 (V). 2.00 (V) and 1.75 (V) are applied.

  In the present invention, calibration is performed for the intensity of external light, and an appropriate precharge signal Vp and exposure time Tc are set. However, since the intensity of external light is likely to change suddenly, the precharge signal Vp and the exposure time Tc may deviate from appropriate values. If calibration is frequently performed, it is possible to follow changes in the intensity of external light, but the coordinate input processing and the like will not be in time.

If the value of the precharge signal Vp (or exposure time Tc) is changed in the processing block (BL) 861 as shown in FIG. 92C, coordinates can be input in any of the processing blocks (BL) 861. Become. Therefore, the calibration setting may be rough.
(9-4) Fourth Modification In the above embodiment, the precharge signal Vp and the like are changed by the processing block (BL) 861. However, the present invention is not limited to this, and may be changed for each section. Further, the setting of the precharge signal Vp is not limited to being fixed, but may be changed in a time division manner.

  For example, a precharge signal Vp = 2.5 (V) is applied to all the processing blocks (BL) 861 in the first period, and all processing blocks (BL) are applied in the second period following the first period. A precharge signal Vp = 2.25 (V) is applied to 861. In addition, in the third period following the second period, the precharge signal Vp = 2.00 (V) is applied to all the processing blocks (BL) 861, and in the fourth period following the third period. The precharge signal Vp = 1.75 (V) is applied to all the processing blocks (BL) 861. Thereafter, the above process is repeated.

Therefore, the precharge signal Vp is supplied to the processing block (BL) 861 at 2.50 (V), 2.25 (V), 2.00 (V), 1.75 (V), 2.50 (V), 2.25 (V), ... are applied. Of course, different precharge signals Vp may be applied to the plurality of processing blocks (BL) 861 in the display area 10, and the applied precharge signals Vp may be changed in a time-sharing manner. Further, the exposure time Tc may be changed instead of the precharge signal Vp. Further, both the precharge signal Vp and the exposure time Tc may be changed. Further, the precharge signal Vp or the exposure time Tc may be changed not in units of processing block (BL) 861 but in units of sections. Needless to say, the precharge signal Vp and the exposure time Tc may be set, adjusted, or applied in accordance with the characteristics of the photosensor pixel 27 such as the processing block (BL) 861 (FIGS. 87 and 88). .
(9-5) Fifth modification example
In the above embodiment, the precharge signal Vp is changed in units of the processing block (BL) 861. However, the present invention is not limited to this. For example, as shown in FIG. 94, a plurality of precharge signals Vp may be applied to each section arranged in BL1 of the processing block (BL) 861.

  In the embodiment of FIG. 94, the magnitude of the precharge signal Vp is indicated by the color intensity. The precharge signal Vp is set every two pixel rows in six steps. For example, the precharge signal Vp is 3.00 (V), 2.75 (V), 2.50 (V), 2.25 (V), 2.00 (V), 1.75 (V). There are 6 stages. Further, different precharge signals Vp are set for adjacent sections.

  As described above, making the precharge signal Vp different for the section in the processing block (BL) 861 exhibits an effective effect when input determination is performed in units of the processing block (BL) 861. This is because a plurality of precharge signals Vp are applied in the processing block (BL) 861, and the section to which any of the precharge signals Vp is applied performs an appropriate operation with respect to the intensity of external light. Processing with higher accuracy can be realized by extracting classifications for performing appropriate operations and performing input determination and coordinate detection.

  In FIG. 94, the value of the precharge signal Vp applied in units of processing block (BL) 861 may be changed. For example, in BL1 of the processing block (BL) 861, the precharge signal Vp is set to 3.00 (V), 2.75 (V), 2.50 (V), 2.25 (V), 2.00 (V ) And 6.75 (V), and the precharge signal Vp is 2.50 (V), 2.25 (V), 2.00 (V), 1 in BL2 of the processing block (BL) 861. .75 (V), 1.50 (V), and 1.25 (V).

FIG. 94 shows an example in which a plurality of precharge signals Vp are applied by subdividing a section in the processing block (BL) 861. FIG. 95 shows an embodiment in which three types of precharge signals Vp are applied in a stripe shape.
(9-6) Sixth Modification In the present invention, the processing block (BL) 861 or section may change not only the precharge signal Vp but also the exposure time Tc. When changing the exposure time Tc, it is configured as shown in FIG. In the embodiment of FIG. 96, two gate driver circuits 12b (12b1, 12b2) are formed. The gate driver circuit 12b1 controls the photosensor pixels 27 in the odd rows. The gate driver circuit 12b2 controls the photosensor pixels 27 in even rows. With the above configuration, the exposure time Tc of the even-numbered photosensor pixels 27 and the exposure time Tc of the odd-numbered photosensor pixels 27 can be changed or controlled independently.
(9-7) Seventh Modification In the driving method of the present invention, the exposure time Tc may be changed by time division. For example, the exposure time Tc is set to 5 msec in the first period, and the exposure time Tc is set to 4 msec in the second period following the first period. In the third period following the second period, the exposure time Tc is set to 3 msec. In a fourth period subsequent to the third period, the exposure time Tc is set to 2 msec. Thereafter, the above process is repeated. Therefore, the exposure time Tc is changed to 5 msec, 4 msec, 3 msec, 2 msec, 5 msec, 4 msec,. Of course, the exposure time Tc may be set for each of a plurality of processing blocks (BL) 861 in the display area 10.
(9-8) Eighth Modification In the present invention, the precharge signal Vp is changed or controlled in units of processing blocks (BL) or in units of sections. However, the present invention is not limited to this. This may be done in units of 27 photosensor pixels. As shown in FIG. 97, the photosensor pixel 27 is connected to the precharge signal line 24. Therefore, it is easy to change the precharge signal Vp applied to the precharge signal line 24 for each pixel column or pixel row.

  FIG. 98 shows an embodiment in which the precharge signal Vp is set to 2.0 (V), 2.2 (V), 2.4 (V), 2.6 (V) and changed in the pixel column. FIG. 99 shows an embodiment in which the recharge voltage Vp is 2.0 (V), 2.2 (V), 2.4 (V), 2.6 (V), and is changed in the pixel row.

  As shown in FIG. 100, when the precharge signal Vp is applied, it is preferably applied to the photosensor output signal line 25 simultaneously with the precharge signal line 24. The switches SWa and SWb are on / off controlled in synchronization with the output of the precharge signal Vp.

The selection of which precharge signal Vp is optimal in each processing block (BL) 861 is determined according to the illuminance of the external light and the illuminance of the backlight 656. Which precharge signal Vp is to be selected is determined by inspection (measurement) in an inspection process before shipment of the panel. In that case, the backlight 656 actually used or a similar light generation source is attached. This is because the precharge signal Vp to be selected may be different in the peripheral area of the display area 10 due to the influence of the backlight 656 or the like.
(9-9) Ninth Modification It goes without saying that a plurality of precharge signals Vp may be applied to one pixel, and may be changed to perform calibration, approach, contact, separation processing, and the like. . For example, the precharge signal Vp is changed in each frame. The frame may be changed in a plurality of frames. For example, the precharge signal Vp is changed every two frames.

  At the same time or without synchronizing with the change of the precharge signal Vp, the exposure time Tc may be changed. Further, the precharge signal Vp and the exposure time Tc may be changed simultaneously. For example, the precharge signal Vp is set to 3.5 V, the exposure time Tc is set to 324H, and a change in the number of ON pixels in the processing block (BL) 861 is detected (for example, whether the number of ON pixels is 1 or more). May be calculated by multiplying the precharge signal Vp4.0V by a constant b (for example, if b = 0.5, the precharge signal Vp becomes 4.0 × 0.5 = 2V). ). That is, at the time of calibration, the precharge signal Vp = 2.0V and the exposure time Tc = 324H. Note that the change step of the exposure time Tc is preferably 2H or more.

The operation of detecting the change in the number of ON pixels in the processing block (BL) 861 is performed by changing the precharge signal Vp = 4.0V and the exposure time Tc = 324H from the start point or the center, and during calibration, the precharge signal Vp = 2.0V and exposure time Tc = 324H are changed as the starting point or the center. This on-pixel count detection operation and the calibration operation are performed alternately.
(10) Approach, contact, separation The approach means detecting or judging that a finger or the like approaches the panel surface. Also, it means an operation to be processed. Also, the approach means an operation for processing that a finger or the like approaches the panel surface.

  Contact means detecting or judging that a finger or the like is in contact with the panel surface. Also, it means an operation to be processed. Further, the contact means a processing operation in which a finger or the like is in contact with the panel surface.

  Detachment means detecting or determining that the panel surface is detached (separated) from a finger or the like. In addition, it means an operation for processing to leave.

Which precharge signal Vp or exposure time Tc of the precharge signal Vp or exposure time Tc to apply to the pixel row of each processing block (BL) 861 is determined in advance at the time of shipment of the panel. ) It is preferable to determine every 861 and store the data in the EEPROM.
(11) Change in Precharge Signal Vp and Exposure Time Tc The precharge signal Vp may be applied to successive pixel rows. Further, the precharge signal Vp may be applied randomly to the pixel rows. Further, the intensity of the precharge signal Vp may be changed at a constant period (two-dimensionally and in the time axis direction). The precharge signal Vp applied to each pixel row is changed for each frame.

  The same applies to the exposure time Tc. The exposure time Tc may be applied to successive pixel rows. The exposure time Tc may be applied randomly to the pixel rows. Further, the length of the exposure time Tc may be changed at a constant cycle (two-dimensionally and in the time axis direction). The exposure time Tc applied to each pixel row may be changed for each frame.

  The precharge signal Vp and the exposure time Tc may be changed simultaneously. The exposure time Tc and the precharge signal Vp may be alternately changed in units of frames or pixel rows.

  In addition, by configuring or forming a plurality of types of sensitivity of the photosensor pixel 27 and applying a plurality of precharge signals Vp to these photosensor pixels 27, and by setting a plurality of exposure times Tc. Needless to say, it is possible to cope with a wider range of external light intensity. Furthermore, it goes without saying that a plurality of comparator voltages of the comparator circuit 155 may be generated and applied.

It goes without saying that the above items can be implemented alone or in combination with other embodiments of the present invention. The same applies to other matters.
(12) Influence of disturbance The light 661 a from the backlight 656 halates in the panel 658. In addition, the object 701 is illuminated. Performing the calibration including the influence of the light 661a varies the origin V0 (point E in FIG. 79), which is a case where there is no external light illuminance.

  Here, the calibration voltage at an illuminance of 0 (light shielding state) is V0. The V0 voltage is a precharge signal Vp that can detect or grasp the occurrence of the on-pixel number ratio (%) at a value of 0% or the on-pixel number ratio (%) when the illuminance is zero. As the illuminance of outside light increases, the photosensor 35 leaks, so the precharge signal Vp for generating the on-pixel ratio (%) needs to be increased in accordance with the illuminance of outside light. Therefore, as shown by the calibration voltage line in FIG. 79, the voltage rises from V0 (point E) in correspondence with the external light illuminance (including light from the backlight 656 and the like).

  By applying the precharge signal Vp to the photosensor pixel 27 so as to coincide with the straight line of the calibration voltage, good calibration can be performed.

  As shown in FIG. 102, the origin V0 voltage is shifted by temperature change, transistor Vt shift, wavelength of external light (defined by the main wavelength), and reflected light 661 from the object 701 (finger, etc.). To do.

  As described with reference to FIG. 79, the on-pixel number ratio 0 (%) (Tc = 324H or the like) can be expressed as Va = a (La) + V0, where a and b are constants and Lx is the illuminance of outside light. The straight line of the calibration voltage can be expressed as Vb = ab (Lx) + V0. In other words, the calibration voltage Vb can be obtained by multiplying the straight line of the ON pixel number ratio (%) by the constant b obtained in advance.

Both the calibration voltage line and the on-pixel number ratio (%) line pass V0. The constants a and b are not affected by temperature, Vt, dominant wavelength, and the like. Therefore, an optimum calibration voltage can be obtained by obtaining a straight line having a predetermined on-pixel ratio (%) at any external light illuminance.
(Acquisition of V0 voltage)
In FIG. 70 and the like, the photosensor pixel 27 is shielded by the object 701, whereby the photosensor pixel 27 that has been turned off by the external light 661 or the like is turned on. The precharge signal Vp applied to the photosensor pixel 27 applies a voltage that turns on the photosensor pixel 27 in a light-shielded state (basically 0Lx). When external light is applied to the photosensor pixel 27, the precharge signal Vp is turned off.

  As shown in FIG. 70, if the illuminance of the lower part (shadow) of the object 701 such as a finger or the state of the photosensor pixel 27 is known, V0 or the calibration voltage can be known. That is, the calibration voltage corresponding to V0 or the intensity of external light illustrated in FIG. 79 is a voltage at which the photosensor pixel 27 in the light-shielded state maintains the on state or a voltage correlated therewith.

  Therefore, a light shielding state is configured or formed in the display area 10 at all times or during calibration. However, the light shielding portion needs to illuminate the back surface (the contact surface with the panel) of the object 701 with a part of the light incident from the other display region 10 or a certain percentage of light (151a and 151b in FIG. 70). There is.

  In order to generate the above-described state, according to the present invention, as shown in FIG. 107, a light shielding plate or film 1071 is arranged at the time of calibration. The light shielding plate 1071 rotates around a fulcrum 801 and is configured to be removed from the display area 10 except during calibration. The light shielding plate 1071 is mounted or disposed on the surface of the display panel during calibration.

  The light shielding plate 1071 does not mean a complete light shielding material. If the transmittance is 20% or less, it can be sufficiently handled. Further, the photosensor 35 may be anything that blocks sensitive light. When the photosensor 35 is made of polysilicon, light having a dominant wavelength of 500 nm or less is blocked. The light shielding plate 1071 may be always disposed on the surface of the display panel where the photosensor pixels 27 are formed. This location cannot be used as a coordinate input location.

Needless to say, the above matters can be applied to other embodiments of the present invention. Moreover, it cannot be overemphasized that it can combine with another Example.
(1) First Modification The embodiment of FIG. 108 has a configuration in which a light shielding sticker 1081 is pasted or arranged in the display area 10 instead of the light shielding plate 1071. As shown in FIG. 108, if the illuminance at the lower part (shadow) of the light shielding seal 1081 or the state of the photosensor pixel 27 is known, V0 or the calibration voltage can be known. That is, the calibration voltage corresponding to V0 or the intensity of external light illustrated in FIG. 79 is a voltage at which the photosensor pixel 27 in the light-shielded state maintains the on state or a voltage correlated therewith.
(2) Second Modification Example FIG. 109 is an example in which a light shielding portion 1091 is formed or configured in a part of the display area 10. The light shielding unit 1091 reflects part of the light 661 from the backlight 656 and illuminates the photosensor pixel 27. As shown in FIG. 109, V0 or the calibration voltage can be known if the illuminance at the lower part (shadow) of the light shielding unit 1091 or the state of the photosensor pixel 27 is known. Since other matters are the same as those of the embodiment of the present invention, description thereof is omitted.
(3) Third Modification FIG. 110 shows a configuration in which the light shielding portions 1091 are formed or arranged in a distributed manner. Since other matters are the same as those of the other embodiments such as FIGS.
(Contact detection)
When the external light is strong, the precharge signal Vp applied to the photosensor pixel 27 is sufficiently off. Further, the precharge signal Vp for maintaining the off state is relatively high. For example, as shown in FIG. 103, the solid line shows the relationship between the precharge signal Vp and the ON pixel number ratio (%) in the external light 500Lx. In the solid line, the precharge signal Vp with the ON pixel number ratio 0 (%) is V500a.

  The calibration voltage obtained from V500a is V500b. The precharge signal Vp and the ON pixel number ratio (%) at the time of light shielding (0Lx) are indicated by dotted lines.

  From the above, the photosensor pixel 27 to which the precharge signal Vp = V500b is applied is shielded from light by the object 701, whereby the ON pixel number ratio (%) changes as indicated by an arrow. In FIG. 103, the ON pixel number ratio (%) changes from 0% to 90% or more. Therefore, in the high illuminance region, the change in the on-pixel number ratio (%) is large, and the detection of the object 701 is easy.

  When the external light is weak, the precharge signal Vp applied to the photosensor pixel 27 is low. As shown in FIG. 104, the solid line indicates the relationship between the precharge signal Vp and the on-pixel number ratio (%) in the external light 100Lx. In the solid line, the precharge signal Vp with the ON pixel number ratio 0 (%) is V100a.

  The calibration voltage obtained from V100a is V100b. The potential difference between V100b and V0 is small. The precharge signal Vp and the ON pixel number ratio (%) at the time of light shielding (0Lx) are indicated by dotted lines. The photosensor pixel 27 to which the precharge signal Vp = V100b is applied is shielded from light by the object 701, whereby the ON pixel number ratio (%) changes as indicated by an arrow.

  In FIG. 104, the ON pixel number ratio (%) does not change from 0% to about 5%. Therefore, in the low illuminance region, the change in the on-pixel number ratio (%) is small, and it is difficult to detect the object 701.

  What is important is that the number of on-pixel ratio (%) changes corresponding to the illuminance of outside light. When the illuminance is high, the ON pixel number ratio (%) due to light shielding by the object 701 is large. When the illuminance is low, the ON pixel number ratio (%) is small due to light shielding by the object 701. In order to cope with this problem, the present invention determines contact, approach, separation, and the like in consideration of the maximum value of the assumed on-pixel number ratio (%) based on the absolute value of the calibration voltage.

  Needless to say, the amount of change in the on-pixel number ratio (%) may be determined based on the magnitude and ratio of m and n shown or described in FIG. If m and n become small, it means that the external light illuminance L is weak. Further, determination, determination, or calculation may be performed based on the values of VLa, VL0, and VL100, or the potential difference between these values and V0. That is, the on-pixel ratio (%) K when the object 701 is shielded from light is set based on the magnitudes and ratios of m and n, the values of VLa, VL0, and VL100, or the magnitude of these values and the potential difference between V0 and V0. Or grasp.

  FIG. 114 illustrates the on-pixel number ratio (%) for approach, contact, and withdrawal. The horizontal axis is time. When the object 701 “approaches”, the on-pixel ratio (%) increases. When the object 701 “contacts”, the on-pixel ratio (%) is stabilized at a constant value. When the object 701 “leaves”, the on-pixel ratio (%) decreases.

  At high illuminance, the on-pixel ratio (%) is close to 100%. However, at low illuminance, the on-pixel ratio (%) is K% of 100% or less. Accordingly, the ratio of the number of ON pixels per unit time at the time of approaching and leaving is 100 / elapsed time at high illumination. At low illuminance, K / elapsed time. Note that K is a real number of 100 or less and 0 or more.

  The elapsed time (for example, the time from when the finger as the object 701 starts to approach and touches the panel. The time from when the finger starts to leave the panel and completely leaves) is substantially constant.

  In the present invention, the change rate of the on-pixel number ratio (%) is obtained in consideration of the illuminance of outside light and taking into account the K of the on-pixel number ratio (%) (K is 0 to 100%). When the external light illuminance is low, the change in the number of ON pixels per unit time (%) is small. Therefore, even if the change in the on-pixel number ratio (%) is small, the approach or departure determination is performed. Further, when there is a ratio (%) of the number of on-pixels that exceeds a certain level, an approach or departure determination is not performed as an abnormal state. When the external light illuminance is high, the change in the number of ON pixels per unit time (%) is large. Therefore, when the change in the on-pixel number ratio (%) is a certain level or less, the approach or departure determination is not performed. When there is a change beyond a certain level, an approach or departure determination is performed.

  As shown in FIG. 114, the ratio of the number of pixels when light is shielded by the object 701 from the magnitudes and ratios of m and n, the values of VLa, VL0, and VL100, or the magnitudes of these values and V0 and the potential difference. Set K (%).

  The magnitudes and ratios of m and n, the values of VLa, VL0, and VL100, or the magnitudes of these values and V0 and the potential difference relatively indicate the external light illuminance L. FIG. 105 shows changes in the precharge signal Vp and the on-pixel number ratio (%) with respect to each external light illuminance. In a relatively low illuminance region, the curve of the precharge signal Vp and the ON pixel number ratio (%) shifts according to the illuminance while maintaining the inclination. The higher the external light illuminance, the larger the difference (change amount) in the ON pixel number ratio (%) from the 0Lx curve.

From the above, in the present invention, the on-pixel number ratio (%) is set in proportion to or in correlation with the magnitudes of m, n, and the like. For example, when the value of m is 1.0 V or more, the on-pixel number ratio (%) is 100%, and when it is 1.0 or less, the value of m multiplied by a constant 0.9 is the on-pixel number ratio (%). To do.
(1) Size of processing block (BL) The processing block (BL) 861 constitutes a state where it is completely shielded by the light shielding object 701, so that the approach, contact and separation detection of the object 701 are ensured. Therefore, as shown in the hatched area in FIG. 106 (a), the area of the processing block (BL) 861 is configured to divide the display area 10 and occupy a part of the divided area. )

  By configuring (setting) as shown in FIG. 106, the processing block (BL) 861 is well shielded by the light shield 701a. When the light shields 701b and 701c are smaller than the processing block 701, determinations such as approach and contact are uncertain. For this reason, the area of the processing block (BL) 861 is defined assuming the size of the target object (light shielding object) 701a such as a finger. That is, the sizes of the object 701 and the processing block 861 are proportional or correlated.

The display device of the present invention detects the shadow of the object 701 by the photosensor pixel 27. The coordinate position of the object 701 is detected by determining the center position of the shadow. A conventional coordinate input device has a touch panel or the like and detects a coordinate position at a pressed position.
(2) Detection of Shadow Position Since the present invention is a method of detecting a shadow as an example, coordinate position detection can be performed even when the object 701 does not touch the display panel or the like. That is, when the shadow of the object 701 occurs in the display area, the center position of the shadow can be obtained. Therefore, even when the object 701 is in the air, it can be determined where the object 701 is. The method for obtaining the center position 692 is described in FIG.

  As shown in FIG. 111, when a shadow of the object 701 occurs in the display area, an on-output area 691 that is a shadow area is generated. Therefore, the center position 692 of the ON output area 691 can be obtained. Therefore, even when the object 701 is in the air, it can be determined where the object 701 is. When the center position 692 can be detected, a cursor display 751 is displayed in the display area.

As shown in FIG. 75, when the object 701a is on the display panel 658, a shadow of the object 701a is generated. The photosensor pixel 27 is an ON output area 691 at the shadow position. A center position 692a of the ON output area 691 is obtained. Or calculate.
(3) Cursor Display As shown in FIG. 75, when the center position 692a can be detected or detected, cross cursor lines (751xa, 751ya) are displayed in the display area 10. That is, if the object 701 can be detected, the center position 692a is displayed. Therefore, it is possible to notify the operator of the input coordinate position before inputting with the object 701. This is an effect not found in conventional touch panels.

  As shown in FIG. 75, when the object 701a is on the display panel 658, a shadow of the object 701a is generated. The photosensor pixel 27 is an ON output area 691 at the shadow position. A center position 692a of the ON output area 691 is obtained. Or calculate.

  Next, the object 701 moves and comes to the position 701b. When the center position 692b of the object 701b can be detected or detected, cross cursor lines (751xb, 751yb) are displayed in the display area 10. That is, if it is at a position where it can be detected that the object 701b is present, the center position 692b is displayed.

  In the above embodiment, the cross cursor is displayed, but the present invention is not limited to this. For example, a cursor such as a point or a circle may be displayed. In other words, the present invention is characterized in that even when the object 701 is not in contact with the input surface 10 of the display panel, it is displayed on the display panel so that the position of the object 701 can be seen from the shadow of the object 701 or the like. Conversely, if a cursor or the like is displayed, it means that input is possible at or near the display position.

  As shown in FIG. 75, when there is an object 701b on the display panel 658, a shadow of the object 701b is generated. The photosensor pixel 27 is an ON output area 691 at the shadow position. A center position 692b of the ON output area 691 is obtained. Or calculate. As described above, the cross cursors (751x, 751y) move simultaneously with the movement of the object 701. On the other hand, when the object 701 moves away from the display area 10 by a certain distance, the shadow becomes weak and the ON output area 691 of the photosensor pixel 27 also decreases. Accordingly, the center position 692 is not obtained. Therefore, the cross cursor display disappears.

From the above, the operator can determine whether or not the coordinate input is possible by the presence or absence of the cursor display 751. Further, it can be determined at which position the input can be made.
(3-1) Second Modification Example A method in which the cross cursor display 751 is not operatively operated even when the center position 692 can be obtained is exemplified. For example, this is a case where the center coordinate 692 occurs in the input prohibited area. Whether or not to perform the cross cursor display 751 is controlled by a control signal from the microcomputer. From the display device of the present invention, a determination signal as to whether or not the center coordinate value is obtained and its x and y coordinate positions are output to the microcomputer. The microcomputer displays a cross cursor in the display area 10 based on the determination signal and the x and y coordinate positions.

  In FIG. 75, the cross cursor display 751 is performed, but the present invention is not limited to this. For example, as shown in FIG. 112, the tip position of the object 701 is calculated from the coordinate position of the object 701, and an icon 831 is displayed at a position where the operator can visually see the tip.

The icon 831 is moved as the object 701 moves. FIG. 112 (a) shows a time when the moving speed of the object 701 is slow, and FIG. 112 (b) shows a time when the moving speed of the object 701 is high. The moving speed of the object 701 is determined from the changing speed of the coordinate position 692 to be detected. It is preferable to change the display image of the icon 831 corresponding to the moving speed of the object 701.
(3-2) Third Modification FIG. 113 shows an embodiment in which the display of the icon 831 is changed. FIG. 113A shows a character display. The icon 891a is displayed following the moving direction of the object 701. FIG. 113 (b) shows a ball display. The displayed character is changed according to the moving speed of the object 701.

FIG. 113C and FIG. 113D are examples in which the size of the icon 891 displayed is changed based on the size of the shadow of the object 701 or the size of the detected object 701.
(3-3) Fourth Modified Example In the above example, a finger or the like is used as an object. However, the present invention is not limited to this. For example, even the one described with reference to FIG.

  FIG. 154 is a configuration diagram of the optical pen 681 that emits the light 661. A push switch 1541 is built in the housing 1513 of the optical pen 681. The switch 1541 includes a switch portion 1541a in which an on / off contact is formed and a change portion 1541b that contracts when pressed. A light guide 1544 made of a transparent member is disposed at the tip of the switch 1541. Inside the light guide 1544, a light emitting diode (LED) 1543 of blue (main wavelength is 430 nm or more and 510 nm or less) as a light generating means is incorporated.

  Light emitted from the LED 1543 is reflected inside the light guide 1544 and collected by the pen tip 1545. The shape of the light guide 1544 is configured to have an inclination that allows light emitted from the LED 1543 to be efficiently collected at the pen tip 1545. In addition, it is preferable to form a reflective film made of a metal film or the like on the surface where the light guide 1544 is in contact with air. The reflective film is not formed on the pen tip 1545. Further, instead of the reflective film, a reflective film made of a multilayer interference film made of an inorganic material may be formed.

  When the switch 1541 is not pushed, the LED 1543 is not lit (FIG. 154 (a)). When the pen tip touches the panel surface of the present invention and a pressure is applied to the pen tip, the light guide 1544 integrated with the pen tip 1545 is also pressed. Therefore, the light guide 1544 presses the switch changing portion 1541b, and the contact of the switch portion 1541a is closed. The contact ON / OFF signal is transmitted to a control circuit (not shown). When the controller circuit receives the ON signal, the controller circuit causes the LED 1543 to emit light. At the same time, the controller circuit detects the state of the photosensor pixel 27 and detects the coordinate position irradiated with the light 661.

  The switch 1541 generates a signal indicating that the switch is closed (ON) and that the switch is open (OFF). The controller circuit does not directly turn on (turn on) or turn off (turn off) the LED 1543 using this on / off signal.

  When the pen tip 1545 is pressed, the switch 1541 is turned on. However, the LED 1543 is not always lit when the switch 1541 is on. When the switch 1541 is off, the LED 1543 is not always turned off. The lighting and extinguishing of the LED 1543 is processed by the controller circuit based on the on / off signal of the switch 1541 to control the lighting and extinguishing of the LED 1543.

  In FIG. 155 (a), the pen tip 1545 of the optical pen 681 is pressed against the panel surface of the present invention. By pressing, the light guide 1544 applies pressure to the switch changing portion 1544b to turn on the switch 1541a. The controller circuit turns on the LED 1543 according to the ON signal of the switch 1541.

  In FIG. 155 (b), the nib 1545 of the optical pen 681 is separated from the panel surface of the present invention. Therefore, since the light guide 1544 does not apply pressure to the switch changing portion 1544b, the switch 1541a is off. Since the OFF signal is sent to the controller circuit in real time, the LED 1543 should be extinguished originally. However, the controller circuit lights the LED 1543 even though the signal from the switch 1541 is an off signal.

  When writing characters or the like on the panel surface using the optical pen 681, the pen tip 1545 is not always in contact with the panel surface while writing characters. The pen tip 1545 is in contact with the panel surface (input surface) at the beginning of writing the line, but the middle part where the line is written has a high movement speed of the pen tip 1545 and the writing pressure is weak or is not on the panel surface. It becomes a contact state.

  When the writing pressure becomes weak, the switch 1541 is turned off. When the LED 1543 is turned on / off in real time by the on / off signal of the switch 1543, the line becomes a dotted line. Or not continuous.

  In order to solve this problem, in the present invention, once an ON signal is received from the switch 1541, the lighting state of the LED 1543 is held for a certain period. The lighting holding time is preferably 10 msec or more and 100 msec or less depending on the writing speed. If the lighting holding time is too short, the lines are intermittent, and if the lighting holding time is too long, the lines are continuous, and the calligraphy characters become cursive letters. The lighting holding period is preferably configured to be adjustable by the user. Moreover, it is preferable to comprise so that a lighting period may be adjusted automatically by a user's learning function. For example, the user writes a line on the practice screen before inputting, and the speed adjustment or the lighting holding period is set so that the line is continuous.

  When the LED 1543 is turned on, the lighting state is maintained for a certain period. If the ON signal is output again from the switch 1541 before the switch 1541 is turned off and the lighting holding period is completed, the lighting holding period counter is reset. Therefore, even if an off signal is generated within the lighting holding period, if the on signal is generated, the lighting state of the LED 1543 is held.

  As described above, in the present invention, the lighting holding period of the LED 1543 is provided by the controller circuit. The detection of the coordinate position (irradiation position of the light 661) is performed during the period in which the LED 1543 is lit. Note that an ON signal of the switch 1541 generated at the beginning of line writing is transmitted to the controller circuit without delay, and the controller circuit lights the LED 1543.

  In the above embodiment, the lighting holding period is controlled by the controller circuit. However, the present invention is not limited to this, and a signal waveform may be delayed by inserting or arranging a capacitor, a resistor, or the like in a wiring for turning on / off the switch 1541.

  In the present invention, the LED 1543 is controlled to be turned on by an on / off signal of the switch 1541, but the present invention is not limited to this. For example, an on / off signal may be generated by vibration or sound generated when the pen tip 1545 touches the panel surface, and the signal may be transmitted to the controller circuit. For example, a pressure sensor and a piezoelectric speaker are exemplified. In addition, the switch 1541 is an electromagnetic coil, and a part of the conductor 1544 is a magnetic body or a conductor, so that when the pen tip 1545 is pressed, an electromotive force is generated in the electromagnetic coil by the movement of the magnetic body or the like. Then, an on / off signal or a similar signal may be generated by the change in electromotive force or current.

  FIG. 113 illustrates an example in which the icon 831 follows the position where the shadow is generated from the object. The same operation can be realized by the light pen 681. FIG. 156 illustrates an example thereof. The light pen 831a irradiates the panel surface with light 661, and a light spot 1561 is generated at the position where the light 661 is irradiated. Since the photo sensor pixel 27 of the light spot 1561 reacts, the coordinate position of the light spot 1561 is detected. The icon display 831a or the like is moved toward the detected coordinate position.

Therefore, also in the embodiment of FIG. 156, the coordinates of the light 661 can be detected without the optical pen 861 touching the panel surface, and the icon display 831 is moved from the detected coordinates, and the screen display is changed. Various operations or display switching can be realized. Further, when the light pen 861 touches the panel surface, the on / off information of the switch 1541 can be obtained. Therefore, this information can be used to turn on / off the LED, and various operations or display can be performed from the coordinate information of the contact position. Switching can be realized.
(4) On-output area and input detection photosensor As shown in FIG. 115, the photosensor pixel 27b that detects the on-output area 691 generated in the object 701, and operations such as approach and contact (see FIG. 114, etc.) It is preferable to separately form or configure the input photosensor pixel 27a for detecting the input.
(5) Identification of Coordinate Position As shown in FIG. 116A, when there is one ON output area 691 and the ON output area 691 approximates a circle, one coordinate position 692 can be detected. In addition, as shown in FIG. 116A, even if the ON output region 691 is slightly separated from a circle, one coordinate position 692 can be detected if it is a single isolated state. However, as illustrated in FIG. 116B, when the ON output area 691 is distorted and the ON output area 691 is not circular, a plurality of coordinate positions 692 may be detected. Of course, as shown in FIG. 117B, when a plurality of ON output areas 691 are generated, a plurality of coordinate positions 692 are generated.

  In order to make the shadow area appropriate, as shown in FIG. 118, the precharge signal Vp to be calibrated is changed for each frame. Due to the change of the precharge signal Vp, the size of the ON output region 691 changes. The center coordinates are detected in the ON output area 691 that matches in a plurality of frames.

In order to solve the above problems, the present invention detects the coordinate position by ANDing the consistency with the input determination based on the original approach, contact, and separation. For example, in FIG. 119, it is assumed that a contact determination has occurred in the processing block (BL) 861 in the shaded area of the display area 10. Further, it is assumed that the center coordinates 692 of the ON output area are also generated within the same processing block (BL) 861. In this case, the processing block at position A is the input location.
(5-1) Multiple Coordinate Position Processing Input determination (contact determination) based on approach, contact, separation or approach, or contact may occur in a plurality of processing blocks (BL) 861. For example, it is assumed that the error occurred in the processing block (BL) 861 in the shaded area in FIG. In FIG. 120A, it is assumed that the determination is made by five processing blocks (BL) 861. A and B are output at the center position 692 in the ON output area 691. The processing block (BL) 861 whose center position matches the contact determination is point B. Therefore, the point B is determined as the input position.

  In FIG. 120 (b), as in FIG. 120 (a), the five processing blocks (BL) 861 are determined to be in contact. A, B, and C are output at the center position 692 by the ON output area 691. The processing block (BL) 861 whose center position matches the contact determination is point C. Therefore, point C is determined as the input position.

  In FIG. 121, as in FIG. 120, it is assumed that contact is determined by five processing blocks (BL) 861. 1, 2, and 3 are output at the center position 692 in the ON output area 691. Processing blocks (BL) 861 whose center positions coincide with the contact determination are 1, 2, and 3. Therefore, it cannot be determined in which part the input is made.

In this case, the moving direction of the object 701 is considered as illustrated in FIG. As the object 701 moves in the direction of the arrow, the position where a shadow is generated by the object 701 moves. At the same time, the position of the ON output area 691 moves. The center coordinate position of the on-output area 691 also moves, and the center position moves from 1 → 2 → 3 as shown in FIG. 121 (b). Since the final position is highly likely to be an input location, the center coordinate 692c is determined as the input location.
(5-2) Input Direction of Object In the coordinate position detection, the position relationship between the object 701 and the display device may be important. For example, as shown in FIG. 122, the display positional relationship between the object 701 and the display panel 658 is important. In FIG. 122, FIG. 122 (a) is a horizontal arrangement, and FIG. 122 (b) is a left-right reverse arrangement. 122 (c) is a vertical arrangement, and FIG. 122 (d) is an upside-down arrangement.

  In the flat display device and the driving method thereof according to the present invention, input information on at least one of the arrangement direction information of the screen 10 and the input direction of the object 701 is input, and the operation is explicitly performed.

  FIG. 123A shows a case where the display screen 10 of the display device of the present invention is input with the left hand as the object 701. FIG. 123B shows a case where the display screen 10 of the display device of the present invention is input with the right hand as the object 701.

  123 (a) and 123 (b) both show a case where an input is made at point A in the center of the screen 10. FIG. However, when input is performed with the left hand of FIG. 123 (a), the point B can also be shaded by the object 701 (left hand). However, point C cannot be shaded at all. In the case of FIG. 123A, when the precharge signal Vp is relatively far from the optimum value, the point B as well as the point A may be determined as the coordinate input position. In this case, by setting in advance whether the object 701 is left-hand input or right-hand input, the point B can be excluded from the coordinate detection target.

FIG. 123 (b) shows a case where input is performed with the right hand. The case where it inputs into the A point of the center part of the screen 10 is shown. However, when inputting with the right hand of FIG. 123 (b), the point C can also be shaded by the object 701 (right). However, point B cannot be shaded at all. In the case of FIG. 123 (b), when the precharge signal Vp is relatively far from the optimum value, the C point may be determined as the coordinate input position together with the A point. In this case, the point C can be excluded from the coordinate detection target by setting in advance that the object 701 is a right-hand input.
(5-3) Display Screen Layout Direction Setting of the display screen 10 or above the layout direction is also important information for specifying the input coordinate position. For example, it is assumed that the screens are arranged vertically and horizontally as shown in FIGS. 124 (a) and 124 (b). It is assumed that the object 701 is a right-hand input and is in the same direction as FIGS. 124 (a) and 124 (b).

  As shown in FIG. 124 (a), it is assumed that the display screen 10 of the display device 658 of the present invention is arranged in the vertically long direction. The coordinate position detection process is performed with arrows 1, 2, 3, 4 as shown in FIG. Then, an ON output area 691 due to the object 701 is detected at point A, and then an ON output area 691 due to the object 701 is detected at point B. If the input direction of the object 701 (for example, right hand or left hand) and the arrangement direction of the screen 10 (vertically long, horizontally long, up and down, left and right) are known, it is automatically understood that the point A is the input coordinate position. . Therefore, the point B can be excluded.

  The arrangement direction (vertically long, horizontally long, up and down, left and right) of the screen 10 is known as a system since an image is displayed by a DSP, a microcomputer, or the like. Therefore, it is only necessary to specify the coordinate position of the object 701 by utilizing these upper portions.

  As shown in FIG. 124 (b), it is assumed that the display screen 10 of the display device 658 of the present invention is arranged in the horizontally long direction. The coordinate position detection process is performed with arrows 1, 2, 3, 4 as shown in FIG. Then, an ON output area 691 due to the object 701 is detected at point A, and then an ON output area 691 due to the object 701 is detected at point B. If the input direction (for example, right hand or left hand) of the object 701 and the arrangement direction of the screen 10 (vertically long, horizontally long, up and down, left and right) are known as in FIG. It can be seen that point A is the input coordinate position. Therefore, the point B can be excluded.

  The input direction of the object 701 is not limited to explicit setting by key input or the like. For example, in the cellular phone device shown in FIG. 151, a switch is formed at a position where a difference occurs in a position where the right hand and the left hand touch the casing 1513 by holding the casing 1513 with the left hand or the right hand. That is, the switch is pushed by holding the housing 1513 with the right hand, and the switch is not pushed when the housing 1513 is held by the left hand. It is assumed that the finger 701 is input with the hand that does not have the housing 1513. By configuring in this way, it is possible to determine (determine) without explicitly setting whether the object 701 is the right hand or the left hand.

  If the input direction of the object 701 is known, many ON output areas 691 are generated in the display area 10, and the input positions can be easily set even if coordinate detection positions are generated in many processing blocks (BL) 861. Judgment can be made. For example, FIG. 125 (a) (FIGS. 125 (a1) and (a2)) is a case where an input is performed on the display screen 10 with an object (finger) 701 from the lower right. 125B (FIGS. 125B1 and 125B2) is a case where an input is performed on the display screen 10 with an object (finger) 701 from the upper left.

  FIG. 125A1 shows that an ON output area 691 is generated in the object 701, and coordinates are detected in the two processing blocks (BL) 861. In FIG. 125, reference numeral 1 denotes a processing block (BL) 861 whose coordinates have been detected. 0 indicates a processing block (BL) 861 that has not been detected.

  FIG. 125 (a2) shows a case where an input is performed on the display screen 10 with an object (finger) 701 from the lower right. Therefore, coordinate positions are generated in D2 and E3 of the processing block (BL) 861. However, in the present invention, since the input direction of the object 701 is known, D2 can be detected (determined) as the input position as illustrated in FIG. 125 (a3).

  FIG. 125 (b1) shows that the ON output area 691 is generated in the object 701, and the coordinates are detected in the three processing blocks (BL) 861 (the possibility of being detected). FIG. 125B shows a case where an input is performed with the object (finger) 701 from the upper left on the display screen 10. Therefore, coordinate positions are generated in C1, D2, and E3 of the processing block (BL) 861. However, in the present invention, since the input direction of the object 701 is known, E3 can be detected (determined) as the input position as shown in FIG. 125 (b3).

  In FIG. 125 (a2) and FIG. 125 (b2), D2 and E3 are common in a portion that may be detected as a coordinate position. However, as shown in FIGS. 125 (a1) and (b1), since the input direction of the object 701 is known, the input coordinate position of the object 701 can be specified using this input information.

If there is no problem in operation even if an erroneous input occurs, the detected input coordinates may be used as the definite coordinates as they are. However, if there is a problem if a malfunction occurs as in communication No. 110, a confirmation icon 831 is displayed as shown in FIG. 126 (b).
(5-4) Input Confirmation FIG. 126 (a) is a normal input screen. Input portions a, b, c, d, e, and f are displayed. If the processing block (BL) 861 of b is input, as shown in FIG. 126 (b), the processing block (BL) 861 of b is displayed as it is and input OK? A confirmation icon 831 is displayed. If the input is OK, the processing block (BL) 861 or the confirmation icon 831 of b is suppressed and the input is confirmed.
(5-5) Start of calibration To start finger input, an instruction is given by touching a specific key 1512a as shown in FIG. 127 (a). Further, as illustrated in FIG. 127B, calibration is performed by touching an object 701 with a specific processing block (BL) 861 in the display area 10.

  As shown in FIG. 127 (b), in the display area 10, the display unit is displayed in the processing block (BL) 861. The display unit displays an instruction for pressing the finger 701 against this area, an outline for pressing the finger 701, and the like. The display on the display unit is performed by the source driver circuit 14.

  When the finger 701 is touched on the processing block (BL) 861, calibration is performed. Alternatively, calibration is started by pressing the key 1512. Alternatively, it is started by detecting that the finger 701 has touched. When the key 1512 is pressed or the finger 701 touches the display unit 10, the calibration starts. By changing the precharge signal Vp, the ON output region 691 is detected.

  When the precharge signal Vp is changed, the state of the ON output region 691 changes according to the precharge signal Vp. The precharge signal Vp changes slowly from a low voltage to a high voltage, and the precharge signal Vp changes from a high voltage to a low voltage. That is, the precharge signal Vp repeats high and low within a predetermined voltage range.

  While viewing the display state of the display area 10, the operator releases the finger 701 from the display unit 10 when the on-output image is most displayed in black, within a range where white and black of the display unit 10 can be most clearly identified. By releasing the finger 701, the change of the precharge signal Vp is stopped, and the precharge signal Vp when the stop is stopped is stored. Alternatively, the key 1512 is pressed to finish. When the key 1512 is pressed, the change of the precharge signal Vp is stopped, and the precharge signal Vp when the key 1512 is stopped is stored. If necessary, a value obtained by adding or subtracting a constant voltage from the precharge signal Vp and a true precharge signal Vp are stored.

As described in FIG. 106, FIG. 120, etc., there are many fluctuation factors in the approach, contact, and withdrawal states. Therefore, it is necessary to adjust or optimally set the changing speed of the ON output region.
(6) Change in ON Pixel Number Ratio (%) at Approaching, Contacting, and Leaving FIG. 128 shows a change in ON pixel number ratio (%) at approaching, contacting, and leaving. FIG. 128A shows a change in the number of ON pixels between approach and departure. When the object 701 approaches, a change in the number of on-pixels occurs. The change is in the positive direction since the on-pixel number ratio (%) increases. Even if the object 701 leaves, the on-pixel number change naturally occurs. The change is in the negative direction since the on-pixel number ratio (%) decreases. As shown in FIG. 128A, the period from the approach to the departure is Td. If this period is short, the process is not in time and the object 701 cannot be detected. If it is too long, an erroneous input occurs.

As shown in FIG. 128B, the on-pixel ratio (%) increases in contact. Rather than detecting the rate of change, a stable on-pixel ratio (%) is detected. The stable state is indicated by a period Tb from when it reaches 70% to 70% or less when the final value of the on-pixel ratio (%) is 100%. If this period is short, the process is not in time and the object 701 cannot be detected. If it is too long, an erroneous input occurs.
(7) Input determination method The above is a method of performing coordinate detection by three actions of approach, contact, and separation. In the present invention, there is a method of performing coordinate detection not only by three operations but also by two operations of approach and contact. The three-operation method and the two-operation method can be switched by a command. It can also be switched automatically.

  FIG. 129 shows a method of detecting coordinates by two actions of approach and contact. After detecting the approach in FIG. 129 (a), the contact signal in FIG. 129 (b1) is detected. The threshold A for detecting the contact signal can be varied. Ordinary A is a point of 70% when the final value of the on-pixel ratio (%) is 100%. As described with reference to FIG. 114, the threshold A is reduced when the illumination is low. The illuminance to be reduced is determined from the estimated illuminance L obtained by H or the like as described with reference to FIG. Further, the value of A may be changed according to the value of the estimated illuminance L.

  As illustrated in FIG. 129 (b2), the period of Tb may not be continuous. As shown in the figure, the ON pixel number ratio (%) may drop in the middle and drop below the threshold value A. Therefore, the period is Tc. In this case, whether or not to perform coordinate detection is determined by determining the length of the period Tb and the period Tc.

Further, as shown in FIG. 130A, the change in the number of ON pixels of the approach signal may be relatively slow as compared to the A period. In addition, as shown in FIG. 130B, the change in the number of ON pixels of the approach signal may be relatively fast as in the B period. A threshold is set for which range is determined as the approach signal. Further, as illustrated in FIG. 130C, the approach signal may be attenuated (decreased) in the middle. In this case, there is a high possibility of erroneous input. Therefore, the approach signal is canceled.
(8) Approaching and leaving signal processing The presence or absence of an approaching or leaving signal is preferably determined by both the entire region where the photosensor pixel 27 is formed and each processing block (BL) 861. FIG. 131 is an explanatory diagram of this.

  As shown in FIG. 131A, the display area 10 has 15 processing blocks (BL) 861 (indicated by numbers 1 to 15) arranged or set. The determination or processing of contact and separation described with reference to FIGS. 129, 130, and the like is based on how the on-pixel ratio (%) changes in the entire display area 10. This determination is shown in FIG. 0. In general, it is determined whether or not an object has approached or detached. Further, in each processing block (BL) 861, a change in the on-pixel number ratio (%) of the photosensor pixels of each processing block is detected, and it is determined which processing block (BL) 861 is approaching or leaving. . In FIG. 131 (b), the processing block No. “1” occurring in FIG. 8 is displayed.

  In FIG. 131 (b), it is determined that the approaching or leaving has occurred in the whole, and processing block No. 8, it is determined that an approach or departure has occurred. 8 is determined to have been input. If it is determined that an approach or departure has occurred as a whole, and there is no approach or departure in all processing blocks, it is not determined that there has been an input. If no approach or departure is detected as a whole and it is determined that one or more processing block Nos. Are approaching or leaving, the processing block that prompts input again or is determined to be the most input by the microcomputer processing Is specified.

  The determination or processing in FIG. 131 is performed for each approach and departure. When the input determination is performed by the three actions of approach, contact, and separation, as illustrated in FIG. 132, the determination is made as an input when the approach determination and the departure determination match. In addition, the order is monitored such that the determination of separation occurs after the determination of approach.

  In FIG. 132, steps indicate time, and determination output timings performed at predetermined intervals. However, contact determination is omitted for easy understanding.

  In case a, the approach determination is output in step 1 indicating time, and then the departure determination is performed in step 2 of the time timing. Therefore, the determination is input.

  In case b, the approach determination is output in step 1 indicating time, and then the departure determination is performed in step 2 of time timing. Further, an approach determination is output in step 4, and a departure determination is output in step 5. In this case, since the approach and the withdrawal are paired, the determination is input. Sometimes double-click input.

  In case c, the approach determination is continuously output in steps 1 and 2 indicating the time, and then the disconnection determination is continuously performed in steps 5 and 6 of the time timing. Therefore, the determination is input.

  In the case d, the approach determination is output in step 1 indicating time, and then the departure determination is performed in step 2 of time timing. However, an approach signal is output again at step 4, and thereafter there is no departure signal. In this case, an erroneous input state is determined, and the determination is no input or cancellation.

  In case e, the approach determination is continuously output in steps 1 and 2 indicating the time, and then the departure determination is performed in step 4 of the time timing. In this case, the operator takes time to select an input, but it is determined that the input has been made and it is assumed that there is an input. However, the determination must be made using other reasons.

  For the input determination (determination) of the display device of the present invention, the operation shown in FIG. 133 can be selected. These can be switched as required by command setting or the operator. Moreover, it can switch according to external light illumination intensity. For example, in the case of low illuminance, an erroneous input is likely to occur, so determination is made based on mode 2 approach + contact + detachment. In the case of high illuminance, input determination is performed by approaching + touching in mode 1. This switching is performed by output from a photo sensor that detects external light, or is switched according to the magnitude of the estimated illuminance as described with reference to FIG.

  Mode 3 in FIG. 133 is input by double clicking. Judge by approach + contact + separation + approach + contact. Of course, you may judge by approach + contact + separation + approach + contact + separation. Alternatively, it may be determined by approach + leave + close + leave. Since double-click input is a specific pattern, there are few malfunctions.

  The determination of approach and contact is performed for the entire display area 10 and is also performed for each processing block (BL) 861 as input determination. FIG. 134 illustrates an example of determination performed in the processing block (BL) 861. Note that the example of FIG. 134 exemplifies two operation modes of approach + contact. The same applies to the three operation modes such as approach + contact + separation.

  In the embodiment shown in FIGS. 134 (a1) and (b1), the processing block (BL) 861 determined to be approaching (processed) as shown in FIG. 134 (a1) is A2. Further, as illustrated in FIG. 134 (b1), the processing block (BL) 861 determined (processed) as a contact is A2. Therefore, the processing block (BL) 861 determined to be close and the processing block (BL) 861 determined to be in contact completely coincide with each other. Therefore, the input location is A2 of the processing block. Note that, as described with reference to FIG. 131, it is preferable that the display area 10 is determined to be in close contact with the entire display area 10.

  In the embodiment shown in FIGS. 134 (a2) and (b2), the processing block (BL) 861 determined to be approached (processed) is B2, as shown in FIG. 134 (a2). Further, as illustrated in FIG. 134 (b2), the processing block (BL) 861 determined to be contact (process) is A2. Therefore, the processing block (BL) 861 determined as approaching does not match the processing block (BL) 861 determined as contact. Accordingly, the approach and contact states in FIGS. 134 (a2) and 134 (b2) are not likely to be erroneously input, so input processing is not performed. Alternatively, as described with reference to FIG. 126 (b), input confirmation processing is performed.

  In the example of the pair of FIGS. 134 (a3) and (b3), the processing block (BL) 861 determined (processed) as approaching as shown in FIG. 134 (a3) is A2 and B2. Further, as illustrated in FIG. 134 (b2), the processing block (BL) 861 determined to be contact (process) is A2. Therefore, the processing block (BL) 861 determined to be close matches the processing block (BL) 861 determined to be in contact with A2. Therefore, it is determined that the input location is A2 of the processing block. Note that, as described with reference to FIG. 131, it is preferable that the display area 10 is determined to be in close contact with the entire display area 10. In addition, since the contact state may cause an erroneous input, it is preferable to perform an input confirmation process as described with reference to FIG. 126 (b).

  In a low illuminance region of 100 Lx or less, the sensitivity of the photosensor 35 with respect to outside light is insufficient. Therefore, it is preferable to detect whether the contact determination continues over a plurality of times (see a plurality of STEPs, see FIG. 132, etc.). FIG. 135 shows an example.

  FIG. 135 (c) describes the division of the processing block (BL) 861 as in FIG. 131 (a). FIG. 135 (a) (a1, a2, a3) is an example in which contact determination is performed three times. In FIG. 135 (a1), the location where contact is determined is A2. In FIG. 135 (a2), the location where contact is determined is B2. In FIG. 135 (a3), the location where contact is determined is B2. Accordingly, the processing block (BL) 861 determined to be contacted three times (3 STEP) has A2 once and B2 twice. Therefore, it is determined that contact has occurred in 5 of the processing block (BL) 861 (see FIG. 135C) which is B2. The same applies to approaching and leaving.

FIG. 135 (b) (b1, b2, b3, b4, b5) is an example in which contact determination is performed five times. In FIG. 135 (b1), the location where contact is determined is B3. In FIG. 135 (b2), the location where contact is determined is B3. In FIG. 135 (b3), the place where contact is determined is A3. In FIG. 135 (b4), the location where contact is determined is A2. In FIG. 135 (b5), the location where contact is determined is B3. Therefore, in the processing block (BL) 861 determined to be contacted three times (3 STEP), B3 is three times, A3 is one time, and A2 is one time. Therefore, it is determined that contact has occurred at 8 of the processing block (BL) 861 (see FIG. 135 (c)) which is B3. The same applies to approaching and leaving.
(8-1) First Modification The above examples are examples in which approach, contact, and / or separation are determined in the same exposure time Tc. The present invention is not limited to this. For example, as shown in FIG. 136, determination or detection processing may be performed by changing the exposure time Tc.

  FIG. 136 (a) shows an example in which the exposure time Tc is 180H. The precharge signal Vp is set to an appropriate value. FIG. 136 (b) shows an example in which the exposure time Tc is 200H. FIG. 136 (c) shows an example in which the exposure time Tc is 220H. Originally, the exposure time is changed to around 200H, which is the exposure time Tc to be used. As described above, the processing block (BL) 861 in which contact or separation is detected is determined.

In FIG. 136 (a), B2 and C2 are detected. In FIG. 136 (b), detection is performed at B2 and B3. In FIG. 136 (c), it is detected at A4. In this state, the detection state is unstable, but B2 of the processing block is detected twice in three times, and other detected locations are close. Therefore, it can be determined that the detection is performed at about B2.
(8-2) Second Modification Similarly, the precharge signal Vp may be changed. FIG. 137 (a) shows an embodiment in which the precharge signal Vp is 1.9V. The exposure time Tc is set to an appropriate value. FIG. 137 (b) shows an embodiment in which the precharge signal Vp is set to 2.0V. FIG. 137 (c) shows an example in which the precharge signal Vp is 2.1V. Originally, the precharge signal Vp to be used is changed around 2.0V. As described above, the processing block (BL) 861 in which contact or separation is detected is determined.

FIG. 137 (a) is detected at B2 and C2. In FIG. 136 (b), detection is performed at B2 and B3. In FIG. 136 (c), it is detected at A4. In this state, the detection state is unstable, but B2 of the processing block is detected twice in three times, and other detected locations are close. Therefore, it can be determined that the detection is performed at about B2. The process is a majority decision. The degree to which the majority vote is effective is configured to be variable.
(8-3) Third Modification In particular, in the low illuminance region, it is necessary to pay attention to the changing speed of the number of ON pixels when approaching (leaving). FIG. 138 shows the ratio (%) of the number of on-pixels approaching. FIG. 138 (c) has the smallest change rate and FIG. (A) is intermediate between (c) and (b). The rate of change tends to decrease as the illuminance decreases. Therefore, it is preferable to set the amount of change determined by the on-pixel ratio (%) in accordance with the illuminance of outside light.
(8-4) Fourth Modified Example FIG. 139 (a) is an example of the percentage (%) of on pixels that are approaching. FIG. 139 (b) shows an example of the ratio (%) of the number of on-pixels to be removed. It is preferable to set the amount of change determined by the on-pixel ratio (%) in accordance with the illuminance of outside light. Also, as shown in FIG. 139, a plurality of patterns may be set and an arbitrary pattern may be selected according to the estimated illuminance (such as FIG. 80).
(Circuit configuration and operation)
In FIG. 81, a source driver circuit (IC) 14 sends signals from a gate driver circuit (IC) 12a and the like. The signals include a gate driver circuit start signal (STV), a vertical inversion circuit (U / D), a forward shift clock (CKV1), a CKV2 having a phase opposite to CKV1, an enable signal (OEV), and a main clock (CLK ).

  These signals are input to an input pad (input PAD) 812 of the photosensor circuit (IC) 18 via connection terminals (OLB) 811 a and 811 b between the glass substrate of the panel and the flexible board 20.

  The photo sensor processing circuit 18 in the display device of the present invention generates a timing signal for the precharge signal Vp, a timing signal for the comparator voltage Vref, and the like based on the input signal. Further, a shift clock (HCX) of the gate driver circuit necessary for controlling the gate driver circuit 12b, a position control signal (CRT) of the precharge signal Vp, an output extraction timing signal (OPT), and the like are generated.

  In the display device of the present invention, as shown in FIG. 140, panel characteristic data or setting data (Tc1, Tc2, H, m, n, etc. described with reference to FIG. 80, etc.) are input to the EEPROM 1401. The photosensor circuit 18 according to the present invention includes an I2C controller 1402, data registers 1404 and 1405, a logic circuit (not shown) such as calibration, and the like.

The I2C controller 1402 reads the data of the EEPROM 1401 and transfers it to the register 1404a. The registers include an EEPROM register 1404a, a command (COMMND) register 1404b, a status (STATUS) register 1404c, and the like. The microcomputer (MPU) 1183 can read and write the contents of each register. In actual operation, either the command register 1404b or the register 1404a is selected by CRsel (command and ROM selection code) and stored in the DATA selector (DataSel) 1405.
(1) First Modification In the display device and the driving method thereof according to the present invention described above, the size of the photosensor pixel 27 has been mainly described as one type. However, the present invention is not limited to this, and needless to say, the photosensor pixel 27 or the photosensor 35 having a plurality of sensitivities may be provided.

For example, in the embodiments of FIGS. 79 and 80, the configuration, change, operation or adjustment of one photosensor pixel 27 or photosensor 35 is described. When a plurality of types of photosensor pixels 27 or photosensors 35 are formed, the present invention is implemented for one type of photosensor pixel 27 or photosensor 35. Alternatively, the processing of the present invention is performed on a plurality of photosensor pixels 27 or photosensors 35, and averaged or integrated.
(Organic EL input device)
(1) EL Pixel Configuration FIG. 141 is a configuration diagram of the display pixel 26 of the EL display device of the present invention. One pixel has four transistors (TFT) 36 (36a, 36b, 36c, 36d). The gate terminal of the driving transistor 36a is connected to the source terminal of the transistor 36b. The gate terminals of the transistors 36b and 36c are connected to the gate signal line 22a1. The drain terminal of the transistor 36 b is connected to the source terminal of the transistor 36 c and the source terminal of the transistor 36 d, and the drain terminal of the transistor 36 c is connected to the source signal line 23. The gate terminal of the transistor 36d is connected to the gate signal line 22a2, and the drain terminal of the transistor 36d is connected to the anode electrode (terminal) of the EL element 1411.

  The transistors 36b and 36c are on (closed) and off (open) controlled by an on / off control signal applied to the gate signal line 22a1. The transistor 36d is on (closed) and off (open) controlled by an on / off control signal applied to the gate signal line 22a2. The gate driver 12 controls the gate signal lines 22a1 and 22a2.

  In the pixel configuration of the organic EL illustrated in FIG. 141, the first transistor 36b functions as a switching transistor for selecting a pixel. The second transistor 36 a functions as a driving transistor for supplying current to the EL element 1411.

  The gate signal lines 22 simultaneously selected by the gate driver circuit 12 are not limited to one gate signal line. A plurality of pixel rows may be selected simultaneously. For example, two gate signal lines 22a1 may be selected simultaneously. That is, two pixel rows are selected simultaneously.

  In the display area 10, pixels of three primary colors of red (R), green (G), and blue (B) are formed in a matrix. RGB pixels are formed by coating and vapor deposition. Note that the present invention is not limited to R, G, and B. It may be a single color, may be cyan, yellow, magenta, or the like, and may be four colors of white (W) in addition to RGB. In the case of R, G, B, W, it is formed by a color filter. The above matters are the same when the display pixel 26 shown in FIG. 3 is a liquid crystal element.

  The display area 10 may have a plurality of screens. For example, a main screen and a sub screen. The gate driver circuits for the main screen and the sub screen are formed independently, and the source signal line 23 is shared. The source driver IC (circuit) 14 also has a common main screen and sub screen.

  In the display region 10, the film constituting the transistor of the display pixel 26 is manufactured by irradiating the laser irradiation spot so that the longitudinal direction of the laser irradiation spot is substantially parallel to the source signal line, as shown in FIG. 109. ing. The same applies to the case where the display pixel 26 is a liquid crystal element as shown in FIG.

  The transistor 36 constituting the display pixel 26 of the display panel of the present invention shown in FIG. 141 and the like is configured as a p-channel polysilicon thin film transistor. In addition, the transistors 36b and 36d have a multi-gate structure that is more than a dual gate.

  In FIG. 141, the transistor 36b constituting the display pixel 26 of the display panel of the present invention functions as a switch between the source and drain of the transistor 36a. Therefore, the transistor 36b is required to have as low a leakage current characteristic as possible. Low leakage current characteristics can be realized by making the gate structure of the transistor 36b a multi-gate structure having a dual gate structure or more.

In order to manufacture the panel at a low cost, it is preferable that all the transistors 36 constituting the pixel are formed by the P channel and the gate driver circuit 12 is also formed by the P channel. By forming the array with only P-channel transistors in this way, the number of masks becomes five, and cost reduction and high yield can be realized.
(2) Operation of EL Display Pixel In the EL display device and the driving method thereof according to the first aspect of the present invention, basically, there are two operation states of the first operation (writing operation) and the second operation (light emission operation). Become. The first operation is a potential changing operation in which the precharge voltage Vp or the like is applied to the source signal line 23 to forcibly change the potential of the source signal line 23 (the gate terminal potential of the driving transistor 36a of the display pixel 26). And the current program operation for applying the program current to the driving transistor 36a and the like. Further, if necessary, before the first operation, a constant current (including 0 (A)) is applied to the source signal line 23, and an initial operation for measuring or acquiring the potential of the source signal line 23 is performed.

  The second operation is a period in which the programmed current is applied to the EL element 1411 of the display pixel 26 or the programmed current is caused to flow through the EL element 1411 of the display pixel 26 to cause the EL element 1411 to emit light. . In the second operation, an on / off voltage is applied to the gate signal line 22a2 as necessary, and a current supplied from the driving transistor 36a to the EL element 1411 is applied or cut off.

  FIG. 142 is an explanatory diagram of the operation of FIG. FIG. 142A shows a state in which a constant current is supplied from the source driver IC (circuit) 14 and the constant current Iw flows from the driving transistor 36 a toward the source driver IC (circuit) 14. When the driving transistor 36a is passing the constant current Iw, the transistors 36b and 36c are closed (on). Therefore, the gate terminal potential of the driving transistor 36a and the potential of the source signal line 23 are the same.

  FIG. 142B shows a state in which the current Ie is supplied from the driving transistor 36a to the EL element 1411. That is, a current is supplied to the EL element 1411 to perform image display.

  In the case of the pixel configuration of FIG. 141, as shown in FIG. 142A, voltage setting (programming) is performed on the capacitor 37 so that the current Iw flows through the driving transistor 36a and the current flowing the program current Iw is held. Is done. Alternatively, the voltage is held such that a current that flows the program current Iw flows to the gate terminal of the driving transistor 36a. At this time, the transistor 36d is in an open state (off state).

Next, during a period in which current flows to the EL element 1411, as shown in FIG. 142B, the transistors 36c and 36b are turned off and the transistor 36d is operated. That is, the off voltage (VGH) is applied to the gate signal line 22a, and the transistors 36b and 36c are turned off. On the other hand, a turn-on voltage (VGL) is applied to the gate signal line 22a2, and the transistor 36d is turned on.
(3) Scanner operation The EL display device is a self-luminous device. Accordingly, the EL display pixel 26 emits light, the emitted light 661 is irradiated onto the object 651, and the reflected light 661 from the object 651 is received by the photosensor pixel 27, whereby the countermeasure object 651 can be image-scanned. it can.

  The EL element 1411 emits light in red (R), green (G), and blue (B). A color filter is formed in the photosensor pixel 27, and any one of RGB lights is selected by the color filter so that the photosensor pixel 27 can receive light. In particular, the active EL display device as illustrated in FIG. 141 can select the corresponding pixel row and cause the EL element 1411 to emit light by selecting the gate signal line 22a. In addition, the photosensor pixel 27 can also perform the application of the precharge signal Vp or the light receiving operation of the corresponding photosensor pixel row by selecting the gate signal lines 22b and 22c.

Therefore, the gate signal line 22a and the selection positions of the gate signal lines 22b and 22c are controlled in synchronization, and the image scan operation is performed by sequentially moving the light emitting EL pixel row and the light receiving photosensor pixel row. Yes.
(3-1) First Example FIG. 143 is a first example of the present invention. As shown in FIG. 143 (b), an object 651 (for example, a color photograph) for image scanning is closely arranged on the display area 10. The EL element 1411 of the display pixel 26 emits light, and the emitted light 661 is applied to the object 651. The intensity of light reflected by the object 651 changes depending on the image drawn on the object 651. That is, the light 661 is modulated by the image of the object 651.

  The modulated light reaches the photo sensor pixel 27, and the on / off state of the photo sensor pixel 27 changes depending on the intensity of the received light.

The operation, configuration, data processing method, coordinate detection operation, etc. of the display device of the present invention, such as the application of the precharge signal Vp and the ON output region 691, the photosensor pixel 27, etc. have been described previously, and thus the description thereof is omitted. To do.
(3-1-1) Scanning Operation As shown in FIG. 143 (a), the pixel row A of the EL element 1411 that is selected to emit light and the photosensor pixel row B that is selected to receive light are adjacently controlled. Is done. The distance between the selected A and B positions is equidistant. Preferably, pixel row A and pixel row B are the same pixel 16.

The pixel row A and the pixel row B are scanned in the direction indicated by the arrow in FIG. In the present invention, the display area 10 is scanned from the upper side to the lower side, and when the selected position reaches the lower side, the display area 10 starts again from the upper side.
(3-1-2)
The display pixel 26 is based on white light emission, and the photosensor pixel 27 has an RGB color filter. Three photosensor pixels 27 (27R, 27G, 27B) of RGB correspond to one display pixel 26.

  However, the present invention is not limited to this embodiment, and one photosensor pixel 27 may correspond to one display pixel 26. Further, one photosensor pixel 27 may correspond to a plurality of display pixels 27 (for example, three display pixels of three primary colors of RGB). In addition, a plurality of photosensor pixels 27 may correspond to a plurality of display pixels 26.

  The emission color of the display pixel 27 is not limited to the three primary colors RGB. It may be yellow (Y), magenta (M), cyan (C), or the like. The light received by the photosensor pixel 27 is not limited to RGB, and may be yellow (Y), magenta (M), cyan (C), or the like.

It goes without saying that the above matters can be applied to other embodiments of the present invention. Moreover, it cannot be overemphasized that it can combine with another Example.
(3-2) Multi-gradation The display device of the present invention processes the operation state of the photosensor pixel 27 as binary data. Therefore, binary image data is obtained in one image capture.

  FIG. 144 solves this problem. In order to acquire multi-gradation image data, the object 651 is scanned with a plurality of exposure times Tc. FIG. 144B is a table of a scanning operation for changing the image data to 8-bit gradation (256 gradations).

  The scan is performed 8 times. The unit exposure time Tc in each scan is a multiplier of 2. The exposure time Tc in the first scan (No. 0) is 128 times that in the eighth scan (No. 7). The precharge signal Vp in each scan is set to be the same. That is, in each scan, the precharge signal Vp has the same magnitude and the exposure time Tc is changed to obtain binarized data.

  When the exposure time Tc is short, most of the photosensor pixels 27 are turned on. As the exposure time Tc increases, the number of photosensor pixels 27 in the on output state decreases, and the number of photosensor pixels 27 in the off output state increases.

  The unit exposure time in the first scan (No. 0) = 128, and the unit exposure time in the second scan (No. 1) = 64. Further, the unit exposure time in the third scan (No. 2) = 32, and the unit exposure time in the fourth scan (No. 3) = 16. The unit exposure time in the fifth scan (No. 4) = 8, and the unit exposure time in the sixth scan (No. 5) = 4. In addition, the unit exposure time in the seventh scan (No. 6) = 2, and the unit exposure time in the eighth scan (No. 7) = 1.

  As described above, by changing the unit exposure time, that is, the exposure time Tc, the amount of light received by the photosensor at the pixel 27 increases, and the on / off state of the photosensor pixel 27 changes. Since the unit exposure time changes by ½, the amount of light received by the photosensor pixel 27 is also halved. Therefore, the captured image is multi-graded. The binarized data obtained by the first scan is the most significant bit (MSB) of 8 bits, and the binarized data obtained by the eighth scan is the least significant bit (LSB) of 8 bits. It becomes.

It goes without saying that the above matters can be applied to other embodiments of the present invention. Moreover, it cannot be overemphasized that it can combine with another Example.
(3-3) First Modification When the object 651 is a transmission type like a photographic film, the object 651 is arranged as shown in FIG. 143 (c). In FIG. 143 (c), reference numeral 148b denotes a panel in which the photosensor pixels 27 are formed in a matrix. Since the configuration and the like have been described before, the description will be omitted. Reference numeral 148a denotes a panel including the display elements 26 in which EL elements 1411 are formed in a matrix.

  The light 661 emitted from the EL element 1411 of the panel 148 a passes through the object 651 and reaches the photo sensor pixel 27. The intensity of the reaching light 661 varies depending on the transmittance of the target portion of the target object 651.

It goes without saying that the above matters can be applied to other embodiments of the present invention. Moreover, it cannot be overemphasized that it can combine with another Example.
(3-4) Second Modification In the example of FIG. 143, the 26 display pixel rows that emit light are one pixel row, and the 27 photosensor pixel rows that receive light are also one pixel row. However, the present invention is not limited to this. For example, a plurality of adjacent display pixel rows 26 may emit light. Further, the light 661 may be received by a plurality of adjacent photosensor pixels 27.

  Further, as shown in FIG. 145, the display pixel 26R row (R1 position) that emits R light and the photosensor pixel 27R row (B1 position) that receives R light are paired to operate the display pixel 26G row (G1) (G light emission). (A2 position) and a photosensor pixel 27G row (B2 position) that receives G light are operated in pairs to display a B light emitting display pixel 26B row (A3 position) and a photosensor pixel 27B row (B3 position) that receives B light. You may operate in pairs.

  As shown in FIG. 146, the pair of pixel rows (26, 27) are scanned from the upper side to the lower side of the screen 10 of the display device 148, and image data of the object 651 is captured. Also, the embodiment of FIG. 144 is implemented.

  By configuring and operating as described above, a color image of the object 651 can be captured at high speed.

It goes without saying that the above matters can be applied to other embodiments of the present invention. Moreover, it cannot be overemphasized that it can combine with another Example.
(3-5) Third Modification The example of FIG. 145 is a method of scanning with RGB pixels 16 (display pixels 26, photosensor pixels 27) paired. However, the present invention is not limited to this. For example, as illustrated in FIG. 147, the EL element 1411 may emit white (W) light, and the display area 10 may be scanned with a plurality of pixels 16 (display pixels 26, photosensor pixels 27) as a pair.
(3-6) Fourth Modification As shown in FIG. 146, not only RGB but also yellow (Y) pixels 16 (display pixels 26, photosensor pixels 27) are scanned or operated in pairs. Also good.

It goes without saying that the above matters can be applied to other embodiments of the present invention. Moreover, it cannot be overemphasized that it can combine with another Example.
(3-7) Fifth Modification Example Further, as illustrated in FIG. 148, the present invention is not limited to operating as a pixel row. A single pixel 16 (display pixel 26, photosensor pixel 27) may be paired and scanned or operated in the row direction and the column direction.

It goes without saying that the above matters can be applied to other embodiments of the present invention. Moreover, it cannot be overemphasized that it can combine with another Example.
(3-7) Sixth modification example
In the embodiment of the present invention, it has been described that only the selected display pixel 26 emits light and the image of the object 651 is scanned. However, the present invention is not limited to this. For example, the selected display pixel 26 may emit light with high luminance (high output), the object 651 may be scanned, and the other display pixels may emit light with normal luminance to perform video display. In this case, display pixels that emit light with high luminance are sequentially selected and scanned from the upper side to the lower side of the screen 10. Of course, you may scan from the lower side of the screen 10 toward the upper side.

  Further, as the selected display pixel row, a plurality of pixel rows, preferably 16 pixel rows or more may be simultaneously selected, and the screen 10 may be scanned in the selected display pixel row in a strip shape. The above matters are the same for the photo sensor pixel rows.

Alternatively, the display screen 10 may be displayed with normal luminance, and the display image of the object 651 may be scanned. In this case, R, G, and B raster display is performed on the display screen 10, and the photosensor pixel 27 is driven in synchronization with the color change of the raster display to capture an image of the object 651. Of course, the display screen 10 may be displayed as a white star to capture the image of the object 651. Alternatively, the R, G, and B display regions may be displayed on the display screen 10 in a band shape, and the photosensor pixel 27 may be selected to capture an image of the object 651.
(EL display and LCD)
By combining an EL display device and an LCD, a thin and lightweight display device can be configured. FIG. 149 shows an example.

On the surface of the array substrate 11, the display pixels 26 and the photosensor pixels 27 described in FIG. 3 and the like are formed in a matrix. Further, on the back surface of the array substrate 11, display pixels 26 including the EL elements 1411 described with reference to FIG. 141 are formed in a matrix. Note that 1493 is a sealing substrate that prevents moisture from entering the EL layer 1492, and 1493 is an adhesive that adheres the sealing substrate 1491 and the array substrate 11.
(1) First Example An EL layer 1492 composed of an assembly of EL elements 1411 is configured to emit light from both sides. The B-direction light 661 emitted from the EL layer 1492 forms a display image of the EL display device. The A-direction light 661 emitted in the A-direction functions as backlight light that illuminates the LCD.

  With the above configuration, the EL display unit A has the entire display region as an EL display region, and the opposite surface includes two display units, an LCD display unit and an EL display unit.

It goes without saying that the above matters can be applied to other embodiments of the present invention. Moreover, it cannot be overemphasized that it can combine with another Example.
(2) Second Example As shown in FIG. 150, an example of the configuration is also illustrated. On one surface of the array substrate 11, the display pixels 26 and the photosensor pixels 27 described with reference to FIG. 3 and the like are formed in a matrix. In addition, the display pixels 26 including the EL elements 1411 described in FIG. 141 are formed in a matrix.

The LCD display unit is illuminated with light from the backlight 146 and displays an image. The EL display unit can see images from both sides as shown in the EL display unit A and the EL display unit B.
(Application example)
Hereinafter, application examples of the present embodiment will be described. The following application examples implement the apparatus or method of the present embodiment described previously.
(1) Mobile phone FIG. 151 is a plan view of a mobile phone as an example of an information terminal device. An antenna 1511, a numeric keypad 1512, and the like are attached to the housing 1513. Reference numeral 1512 denotes a display color switching key or a power on / off / frame rate switching key.

In the display device 658 of this embodiment, the above key 1512 operation can be realized by touching the display screen with a finger. That is, a similar operation can be realized by displaying a key, a push switch, or the like on the display screen 10 and pressing the key or switch image with a finger.
(2) Video Camera FIG. 152 is a perspective view of a video camera. The video camera includes a photographing (imaging) lens unit 1522 and a video or mela body 1513, and the photographing lens unit 1522 and the viewfinder unit 1513 are back to back. The display panel 658 of this embodiment is also used as a display monitor. The display unit 10 can freely adjust the angle at a fulcrum 1521. When the display unit 10 is not used, it is stored in the storage unit 1523.

  Switch 1524 is a changeover or control switch that performs the following functions. By operating the switch 1524, the display mode can be operated by touching the display screen 10 with a finger.

  The display device of this embodiment can be applied not only to a video camera but also to an electronic camera, a still camera, etc. as shown in FIG. The display device 658 is used as a monitor attached to the camera body 1531. It is also used as a finger input device. In addition to the shutter 1533, a switch 1524 is attached to the camera body 1531.

  The present invention can be applied not only to a liquid crystal display panel but also to other display panels.

  For example, EL (organic, inorganic) display panel, field emission display (FED), SED (trademark), PDP (plasma display panel), liquid crystal display device, carbon nanotube (sometimes abbreviated as carbon nano tube, CNT) Needless to say, the present invention can be applied to other displays such as a display using a cathode ray tube and a cathode ray tube (CRT). Further, the technical idea of the present embodiment may be used not only for an active matrix display panel but also for a simple matrix display panel.

  The present invention can be applied to a video camera, a projector, a stereoscopic (3D) television, a projection television, and the like.

  The present invention can also be applied to a viewfinder, a main monitor and a sub monitor of a mobile phone or a clock display unit, a PHS, a portable information terminal and its monitor, a digital camera, a satellite TV, a satellite mobile TV and a monitor thereof.

  The present invention can also be applied to scanners, image sensors, electrophotographic systems, head mounted displays, direct-view monitor displays, notebook personal computers, video cameras, digital still cameras, and electronic still cameras.

  Further, the present invention can be applied to a monitor of an automatic cash drawer, a public telephone, a videophone, a personal computer, a wristwatch and its display device. The present invention can also be applied to a device that generates information such as a barcode. These technical ideas and the like can be combined with each other regardless of part or all of them.

  The present invention includes a display monitor for home appliances such as a rice cooker, a display unit for car audio, a car speedometer, a shaving display unit, a pocket game device and its monitor, a telephone number, an indicator of a factory measuring instrument, etc. Applicable to display monitors, train destination display monitors, replacement of neon display devices, backlights for display panels or lighting devices for home or commercial use, ceiling lights, window glass, car headlights, etc. Needless to say, it can be applied.

  It can also be applied to display devices such as advertisements or posters, RGB traffic lights, warning indicator lights, and the like. These technical ideas and the like can be combined with each other regardless of part or all of them.

1 is a block diagram of a display device according to a first embodiment of the present invention. It is an expansion explanatory view of the pixel of the present invention. It is a figure which shows arrangement | positioning of the pixel of this invention. It is a figure which shows arrangement | positioning of the photo sensor pixel of this invention. It is a figure which shows other arrangement | positioning of the photo sensor pixel of this invention. It is a figure which shows other arrangement | positioning of the photo sensor pixel of this invention. It is a figure which shows other arrangement | positioning of the photo sensor pixel of this invention. It is a figure which shows other arrangement | positioning of the photo sensor pixel of this invention. It is a figure which shows other arrangement | positioning of the photo sensor pixel of this invention. It is a figure which shows the photo sensor formation area | region of this invention. It is a figure which shows the photo sensor formation area | region of this invention. It is a figure which shows the photo sensor formation area | region of this invention. It is a figure which shows the photo sensor formation area | region of this invention. It is an equivalent circuit diagram of the pixel of the present invention. It is a block diagram of a display device of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is a block diagram of a display device of the present invention. It is a timing chart figure of the drive method of the display device of the present invention. It is a timing chart figure of the drive method of the display device of the present invention. It is a block diagram of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. It is a block diagram of a display device of the present invention. It is a block diagram of a display device of the present invention. It is a block diagram of a display device of the present invention. It is a timing chart figure of the drive method of the display device of the present invention. It is a timing chart figure of the drive method of the display device of the present invention. It is a timing chart figure of the drive method of the display device of the present invention. It is a timing chart figure of the drive method of the display device of the present invention. It is a timing chart figure of the drive method of the display device of the present invention. FIG. 3 is an equivalent circuit diagram of a pixel and a peripheral circuit unit of the present invention. FIG. 3 is an equivalent circuit diagram of a pixel and a peripheral circuit unit of the present invention. FIG. 3 is an equivalent circuit diagram of a pixel and a peripheral circuit unit of the present invention. FIG. 3 is an equivalent circuit diagram of a pixel and a peripheral circuit unit of the present invention. FIG. 3 is an equivalent circuit diagram of a pixel and a peripheral circuit unit of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. FIG. 3 is an equivalent circuit diagram of a pixel and a peripheral circuit unit of the present invention. FIG. 3 is an equivalent circuit diagram of a pixel and a peripheral circuit unit of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is a timing chart figure of the drive method of the display device of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. It is an equivalent circuit diagram of the pixel of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 3 is an equivalent circuit diagram of a pixel and a peripheral circuit unit of the present invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. FIG. 10 is an explanatory diagram representing a driving method of a display device of the present invention. It is explanatory drawing of the circuit structure of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus applied to the mobile phone. It is explanatory drawing of a video camera. It is explanatory drawing of an electronic camera. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention. It is explanatory drawing of the display apparatus of this invention.

Explanation of symbols

10 Display area 11 Array substrate 12 Gate driver circuit 14 Source driver circuit
15 Signal processing circuit 16 Pixel 17 Circuit board 18 Photo sensor processing circuit 19 Display area (+ photo sensor formation area)
20 Flexible substrate (FPC)
21 video signal processing circuit 22 gate signal line 23 source signal line 24 precharge signal line 25 photosensor output signal line 26 display pixel 27 photosensor pixel 31 pixel electrode 32 thin film transistor (TFT)
34 Auxiliary capacitance 35 Photodiode (photosensor)
36 Thin Film Transistor 37 Auxiliary Capacitor 38 Ground (Common Signal Line)
151 Selection circuit 152 Voltage output terminal 153 Precharge signal terminal 154 Comparator voltage terminal 171 Analog-digital conversion circuit (AD circuit)
172 Switching circuit 173 Connection terminal 201 Enable signal line 202 AND circuit 261 Flexible substrate 311 Reset signal line 312 Reset switch (TFT)
314 Comparator signal line 501 Inverter (inverting circuit)
651 object (shading object, reflection object)
652 Sealing wall 653 Liquid crystal layer 654 Counter substrate 655 Polarizing plate (polarizing film)
656 Backlight (light generation means)
657 Counter electrode 658 Display panel 661 Light (optical path)
681 Optical pen (light generation means)
691 ON output area (or OFF output area)
692 Center coordinates 751 Cursor display 814 MPU
811 Connection terminal 812 Input terminal (PAD)
813 LED driver 831 Icon display 861 Processing block 911 Film image 1071 Light guide plate 1081 Light shielding seal 1091 Light shielding part 1401 EEPROM
1402 I2C controller 1404 Register 1405 Register 1411 EL element 1491 Sealing substrate 1492 EL layer 1493 Adhesive 1511 Antenna 1512 Key 1513 Case 1521 Supporting point 1522 Shooting lens 1523 Storage unit 1524 Switch 1531 Integrated 1532 Shooting unit 1533 Shutter switch 1541 Switch 1543 Light emitting diode (LED)
1544 light guide 1545 nib 1561 light spot

Claims (5)

In the flat display device in which display pixels having EL elements are formed in a matrix on the array substrate, and photosensor pixels are also formed on the array substrate,
A gate driver circuit that sequentially selects a pixel row of the display pixel, a pixel row of the photosensor pixel, and
An EL display device comprising a processing circuit for processing an operation state of the photosensor pixel.   The EL display device according to claim 1, wherein the EL element has RGB pixels.   2. The EL display device according to claim 1, wherein the display pixels are controlled to be turned on linearly by sequentially selecting pixel rows.   2. The EL display device according to claim 1, wherein the selected display pixel row and the selected photosensor pixel row are sequentially selected while maintaining an equal interval. Signal generating means for generating an on / off signal depending on the presence or absence of pressing;
Comprising light generating means for irradiating or extinguishing light by the on / off signal;
Detecting the coordinate position of the light emitted from the light generating means;
A coordinate input method characterized by maintaining the lighting state of the light generating means for a predetermined period after an ON signal is generated from the signal generating means.

Images