JP2008251020A - Image display device and method of driving image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display device of a simple structure assuring the convenience in which object positions and so on can be detected without deterioration of image quality and a method of driving the image display device. <P>SOLUTION: The image display device is equipped with a display section 1 including a plurality of light emitting and receiving cells CWR each of which is equipped with a light emitting cell CW containing one light emitting element and a light receiving cell CR containing one light receiving element. The light emitting scanner 24 and the display signal driver 23 drive the light emitting elements according to image data created by the display signal creator 21. The light receiving scanner 31 drives the light receiving elements to receive light which is output from the light emitting elements and reflected on detected objects. The position detector 34 detects the objects according to the light reception signals obtained by the light reception signal receiver 32 from the light receiving elements. Consequently, the image display device detects the position of a contacting or adjoining object, with a simple structure, assuring the convenience without deterioration of image quality. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image display device having a function of detecting the position of an object and the like, and a method for driving the image display device.

  2. Description of the Related Art Conventionally, a technique for detecting the position of an object that touches or approaches a display device is known. Among them, a representative and widely used technique is a display device provided with a touch panel.

  There are various types of touch panels, but a type that detects a capacitance is one of the most popular touch panels. This type captures changes in the surface charge of the panel by touching the touch panel with a finger, thereby detecting the position of the object. Thereby, the user can operate intuitively.

  In recent years, various technologies have been proposed that enable an intuitive operation by detecting the position of an object on a display device without providing these touch panels.

For example, Patent Document 1 discloses an infrared type in which a light emitting element such as infrared light and a light receiving element are arranged at one end of a flat pad on which a finger can move, and pointer control can be performed only by moving the finger. A finger input pointer device is disclosed.
Japanese Patent Laid-Open No. 11-149348

  However, this technology must include an input device separately from the display device, which increases the cost of the product due to an increase in the number of parts, and is intuitively operated compared to a display device having a touch panel. There was a problem that it was not possible.

  In addition, for a display device provided with a touch panel, the number of components increases by providing the touch panel on the display screen, and the cost of the product increases. In addition, there is a problem that the light from the display screen changes when the light passes through the touch panel, causing deterioration in image quality.

  Further, in the case of the touch panel of the above-described type that detects electrostatic capacitance, only one point position on the display screen can be detected at the same time, and it is always convenient for the user. There was a problem that I could not say.

  In other words, these conventional techniques have a problem that it is difficult to detect the position of an object without degrading the image quality with a simple structure while ensuring convenience.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an image display device that can detect the position of an object and the like with a simple structure without degrading image quality while ensuring convenience. An object of the present invention is to provide a method for driving an image display device.

  The image display apparatus of the present invention emits light from a plurality of light emitting elements, a plurality of light receiving elements, a light emission driving means for driving the light emitting elements based on the image data, and a light emitting element emitting light based on the image data. A light receiving drive means for driving the light receiving element so as to receive light reflected by the detection target object, a detection means for detecting the detection target object based on a light receiving signal obtained from the light receiving element, and a part of the input image data, Image combining means for combining image data by replacing with mark data for displaying predetermined marks at a plurality of positions is provided. Here, the light emission drive unit and the light reception drive unit receive light emitted from the light emitting element driven according to the mark data of the image data by the light receiving element at a position corresponding to the light emitting element. The light emitting element and the light receiving element are driven. In addition, the detection means is configured to mark any position among the marks displayed at a plurality of positions based on a light receiving signal obtained from a light receiving element that receives light emitted from a light emitting element driven according to mark data. It is designed to detect whether the object to be detected has approached. Note that “input image data” means raw image data before being combined as input to the image display device, and “mark data” means, for example, the shape, brightness, and color of an arbitrary figure or character. Meaning the sign represented by.

  According to the driving method of the image display device of the present invention, a plurality of light emitting elements and a plurality of light receiving elements are arranged, the light emitting elements are driven based on the image data, and emitted from the light emitting elements emitting light based on the image data. Then, the light receiving element is driven so as to receive the light reflected by the detection target object, and the detection target object is detected based on the light reception signal obtained from the light receiving element. Here, part of the input image data is replaced with mark data for displaying predetermined marks at a plurality of positions, thereby synthesizing the image data. Further, the light emitting element and the light receiving element are driven so that light emitted from the light emitting element driven according to the mark data in the image data is received by the light receiving element at a position corresponding to the light emitting element. ing. Further, based on the light reception signal obtained from the light receiving element that receives the light emitted from the light emitting element driven according to the mark data, the detection target object is located at any of the marks displayed at a plurality of positions. It detects the approach.

In the image display device and the driving method of the image display device of the present invention, the light emitting element emits light based on the image data. The light receiving element receives light emitted from the light emitting element and reflected by the detection target object, and outputs a light reception signal. A detection target object is detected based on the received light signal. At this time, part of the input image data is replaced with mark data for displaying a predetermined mark at a plurality of positions, whereby the image data is synthesized. Further, the light emitting element and the light receiving element are driven so that light emitted from the light emitting element driven according to the mark data in the image data is received by the light receiving element at a position corresponding to the light emitting element. Then, based on the light reception signal obtained from the light receiving element that receives the light emitted from the light emitting element driven according to the mark data, the detection target object is located at any of the marks displayed at a plurality of positions. Whether it is approaching is detected.
Note that, even when a plurality of detection target objects are arranged at the same time, the plurality of detection target objects can be detected based on the light reception signal. Here, “disposed at the same time” means, for example, a situation where a plurality of fingers are in contact with or in close proximity to each other on the display unit of the image display device.

  In addition, when a threshold value is set according to the property of the object to be detected or the purpose or accuracy of the detection, the received light signal is compared with the set threshold value to The detection target object is detected in a manner corresponding to the above. Here, “the property of the detection target object” means, for example, the size and surface state (reflectance, color, roughness, etc.) of the object, and “the purpose of detection” means, for example, the object The detection of the position, the detection of the size of the object, the detection of the color of the object, and the like, and the “detection accuracy” means the detection resolution.

  In addition, based on the received light signal obtained when black display is performed when the object to be detected is not approaching the light receiving element, the ambient light intensity present in the surrounding area is obtained, and the influence of the ambient light is taken into consideration. When the detection target object is detected, the detection target object is detected without being influenced by the influence of ambient light. Here, “black display” means display in a state where the luminance of all the light emitting elements included in the image display device is the lowest, and “environment light” refers to, for example, sunlight or light from room lights from the surroundings. It means the light being irradiated.

  Further, the mark can be moved during image display, and the mark can be moved in accordance with the movement of the pattern, for example.

  Here, for example, the plurality of light emitting elements and light receiving elements are respectively arranged in a matrix so that the light emitting elements are driven so as to perform a line sequential light emitting operation, and the light receiving elements perform a line sequential light receiving operation in synchronization with this. You may comprise so that it may drive. Here, the “matrix shape” means a state in which a plurality of light emitting elements and light receiving elements are arranged in a matrix in the horizontal line direction and the vertical line direction of the screen over the entire display portion of the image display device. Each element is called a pixel. “Line-sequential light-emitting operation” and “line-sequential light-receiving operation” are operations of a mode in which a light-emitting element and a light-receiving element included in each pixel for a certain horizontal line sequentially perform a light-emitting operation and a light-receiving operation for each horizontal line. This means that by performing this operation over the entire display section of the image display device, it is possible to display image data for one screen and receive light for each pixel for one screen. In this case, the line sequential light emitting operation and the line sequential light receiving operation may be performed at independent timings or may be performed at the same timing. Here, the “same timing” does not necessarily have to be physically exactly the same, but includes the case where there is a time lag within the range of the control error.

According to the image display device and the driving method of the image display device of the present invention, the light emitting device includes a plurality of light emitting elements and a plurality of light receiving elements, drives the light emitting element based on the image data, and outputs and detects from the light emitting element. The light receiving element is driven so as to receive the light reflected by the target object, and the detection target object is detected based on the light reception signal obtained from the light receiving element. It is possible to detect the position of the object without degrading.
Further, the image data is synthesized by replacing a part of the input image data with mark data for displaying predetermined marks at a plurality of positions, and the light emitting element is driven according to the mark data of the image data The light emitting element and the light receiving element are driven so that the light emitted from the light receiving element at a position corresponding to the light emitting element is received, and the light emitted from the light emitting element driven according to the mark data is received from the light receiving element that receives the light. Based on the obtained light reception signal, it is arranged to detect at which position of the marks displayed at a plurality of positions the object to be detected has approached. It is possible to detect a plurality of contacts or close objects.

  Hereinafter, the best mode for carrying out the present invention (hereinafter simply referred to as an embodiment) will be described in detail with reference to the drawings.

[First Embodiment]
FIG. 1 shows the overall configuration of an image display apparatus according to the first embodiment of the present invention.

  The image display apparatus according to the present embodiment includes a display unit 1, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a light emitting side scanner 24, a light receiving side scanner 31, and a light receiving signal. A receiver 32, a light reception signal holding unit 33, and a position detection unit 34 are provided.

  The display unit 1 includes, for example, an organic or inorganic EL (ElectroLuminescence) display or LCD (Liquid Crystal Display) in which a plurality of pixels 11 are arranged in a matrix over the entire surface, and operates in a line sequential manner as will be described later. While displaying, images such as predetermined figures and characters are displayed. Each pixel 11 includes a light emitting / receiving cell CWR having a light emitting cell CW including one light emitting element and a light receiving cell CR including one light receiving element, and can perform a light receiving operation as well as a light emitting operation for each pixel as described later. It has become.

  The display signal generation unit 21 generates a display signal for display, for example, for each screen (for each display of one field) based on the supplied data generated by a CPU (Central Processing Unit) (not shown). , And outputs it to the display signal holding control unit 22.

  The display signal holding control unit 22 stores the display signal output from the display signal generation unit 21 for each screen (for each display of one field), for example, in a field memory including an SRAM (Static Random Access Memory). And the light emitting side scanner 24 and the display signal driver 23 that drive each light emitting cell CW, and the light receiving side scanner 31 that drives each light receiving cell CR are controlled to operate in conjunction with each other. Specifically, the light emission side scanner 24 emits the light emission timing control signal 41, the light reception side scanner 31 receives the light reception timing control signal 42, the display signal driver 23 displays the control signal and the display signal held in the field memory. Based on this, a display signal for one horizontal line is output. With these control signals and display signals, a line sequential operation is performed as will be described later.

  The light emission side scanner 24 has a function of selecting the light emitting cell CW to be driven in accordance with the light emission timing control signal 41 output from the display signal holding control unit 22. Specifically, as will be described later, a light emission selection signal is supplied through a light emission gate line connected to each pixel 11 of the display unit 1 to control the light emitting element selection switch. That is, when a voltage for turning on the light emitting element selection switch of a pixel is applied by the light emission selection signal, the pixel performs a light emission operation with a luminance corresponding to the voltage supplied from the display signal driver 23. It has become.

  The display signal driver 23 has a function of supplying display data to the light emitting cell CW to be driven in accordance with a display signal for one horizontal line output from the display signal holding control unit 22. Specifically, as described later, a voltage corresponding to the display data is supplied to the pixel 11 selected by the light emitting side scanner 24 via the data supply line connected to each pixel 11 of the display unit 1. The light-emitting side scanner 24 and the display signal driver 23 operate in a line-sequential manner, whereby an image corresponding to arbitrary display data is displayed on the display unit 1.

  The light receiving side scanner 31 has a function of selecting a light receiving cell CR to be driven according to a light receiving timing control signal 42 output from the display signal holding control unit 22. Specifically, as will be described later, a light receiving selection signal is supplied via a light receiving gate line connected to each pixel 11 of the display unit 1 to control the light receiving element selection switch. That is, similar to the operation of the light emitting side scanner 24 described above, when a voltage is applied to turn on the light receiving element selection switch of a certain pixel by the light receiving selection signal, the light receiving signal detected from that pixel is received by the light receiving signal receiver. 32 is output. Thereby, for example, the light receiving cell CR can receive and detect light reflected from an object that comes into contact with or close to the light based on light emitted from a certain light emitting cell CW. The light receiving side scanner 31 outputs a light receiving block control signal 43 to the light receiving signal receiver 32 and the light receiving signal holding unit 33, and has a function of controlling the blocks contributing to the light receiving operation. In the image display device according to the present embodiment, the light emitting gate line and the light receiving gate line are separately connected to each light emitting and receiving cell CWR, and the light emitting side scanner 24 and the light receiving side scanner 31 are respectively It is possible to operate independently.

  The light reception signal receiver 32 has a function of acquiring a light reception signal for one horizontal line output from each light reception cell CR in accordance with the light reception block control signal 43 output from the light reception side scanner 31. The light reception signal for one horizontal line acquired by the light reception signal receiver 32 is output to the light reception signal holding unit 33.

  The light reception signal holding unit 33 reconfigures the light reception signal output from the light reception signal receiver 32 into a light reception signal for each screen (every field display) in response to the light reception block control signal 43 output from the light reception side scanner 31. And has a function of storing and holding in a field memory including, for example, an SRAM. The received light signal data stored in the received light signal holding unit 33 is output to the position detecting unit 34. The received light signal holding unit 33 may be formed of a storage element other than a memory. For example, the received light signal data may be held as analog data. Hereinafter, in this embodiment, unless otherwise specified, it is assumed that the received light signal is held as analog data.

  The position detection unit 34 has a function of performing signal processing based on the data of the received light signal output from the received light signal holding unit 33 and specifying the position where the detected object is present in the light receiving cell CR. This makes it possible to specify the position of an object that is in contact with or close to it. When the light reception signal holding unit 33 stores the light reception signal data as analog data as described above, the position detection unit 34 performs analog / digital conversion (hereinafter referred to as A / D conversion). Signal processing is performed.

FIG. 2 shows an example of the configuration of the display unit 1 in FIG. It is assumed that the display unit 1 has a configuration in which a total of (m × n) pixels 11 are arranged in a matrix, with m in the horizontal line direction and n in the vertical line direction. Here, for example, XGA (eXtended Graphics) which is a general display standard in a PC (Personal Computer) or the like.
In the case of a display unit of the (Array) standard, a total of 2359296 pixels of m = 1024 × 3 (RGB) and n = 768 are arranged in a matrix.

  As shown in FIG. 2, the display unit 1 includes a total of (m × n) pixels 11, the light emitting / receiving cells CWR 11 to CWRmn included in each pixel, and the number of the pixels 11. The m data supply lines DW (DW1 to DWm) and the data read lines DR (DR1 to DRm), the n light emitting gate lines GW (GW1 to GWn) and the light receiving gate lines GR (GR1 to GR1) are connected. GRn).

  The data supply line DW, the data read line DR, the light emission gate line GW, and the light reception gate line GR are connected to the display signal driver 23, the light reception signal receiver 32, the light emission side scanner 24, and the light reception side scanner 31, respectively. A signal, a light emission selection signal, and a light reception selection signal are supplied to each light emission light reception cell CWR, and a light reception signal is output from each light emission light reception cell CWR. As shown in FIG. 2, one data supply line DW, one data read line DR, one light emission gate line GW, and one light receiving gate line GR are connected to each light emitting / receiving cell CWR. Further, for example, one light supply / receiver cell CWR11, CWR12,..., CWR1n is connected to one data supply line DW1 and one data read line DR1 in common, for example, one horizontal line of light emitting / receiving cell CWR11, One light emitting gate line GW and one light receiving gate line GR are commonly connected to CWR21,..., CWRm1. An arrow X in FIG. 2 indicates the scanning direction of the light emitting gate line GW and the light receiving gate line GR, as will be described later.

  3 to 6 schematically show an example of the arrangement configuration of the light emitting cells CW and the light receiving cells CR in the display unit 1 of FIG. 1 in plan views.

  FIG. 3 shows an example in which, in each light emitting / receiving cell CWR in the display unit 1, the light emitting cell CW and the light receiving cell CR are arranged vertically, that is, in the vertical line direction. In this case, each light emitting cell CW and each light receiving cell CR are arranged side by side in the left-right direction, that is, in the horizontal line direction. Specifically, for example, the light emitting cells are arranged side by side with CW11, CW21,..., CWm1 in the horizontal line direction, and the light receiving cells are arranged with CR11, CR21,. In this example, the light emitting cell CW is disposed above and the light receiving cell CR is disposed below. Conversely, the light receiving cell CR is disposed above and the light emitting cell CW is disposed below. It may be configured.

  FIG. 4 shows another example in which the light emitting cells CW and the light receiving cells CR are arranged one above the other in each light emitting / receiving cell CWR in the display unit 1. However, in this example, in one light-emitting / receiving cell CWR, a total of two light-receiving cells CR are arranged, one above the other with respect to one light-emitting cell CW. Here, of these two light receiving cells CR, the upper light receiving cell is referred to as CRa, and the lower light receiving cell is referred to as CRb. In this case, as in the example of FIG. 3, each light emitting cell CW and each light receiving cell CRa, CRb are arranged side by side in the left-right direction, that is, in the horizontal line direction. Specifically, for example, the light emitting cells are arranged side by side with CW11, CW21,..., CWm1 in the horizontal line direction, and the light receiving cells are arranged with CR11a, CR21a..., CRm1a and CR11b, CR21b,. Yes. In this case, conversely, two light emitting cells CW may be arranged above and below one light receiving cell CR in one pixel.

  FIG. 5 shows an example in which, in each light emitting / receiving cell CWR in the display unit 1, the light emitting cell CW and the light receiving cell CR are arranged on the left and right, that is, in the horizontal line direction. In this case, the light emitting cells CW and the light receiving cells CR are arranged side by side in the vertical direction, that is, in the vertical line direction. Specifically, for example, the light emitting cells are arranged side by side in the vertical line direction CW11, CW12,..., CW1n, and the light receiving cells are arranged in the vertical line direction CR11, CR12,. In this example, the light emitting cell CW is arranged on the left and the light receiving cell CR is arranged on the right. Conversely, the light receiving cell CR is arranged on the left and the light emitting cell CW is arranged on the right. It may be configured.

  FIG. 6 shows an example in which the light receiving cell CR is arranged inside the light emitting cell CW in each light emitting / receiving cell CWR in the display unit 1. In this case, each light emitting cell CW and each light receiving cell CR are arranged side by side in a matrix like each pixel 11.

  The plan view of the arrangement configuration example of the light emitting cells CW and the light receiving cells CR in the display unit 1 according to the present embodiment is not limited to these, and other arrangement configurations may be used.

  Next, FIGS. 7 to 9 schematically show an example of the arrangement configuration of the light emitting cells CW and the light receiving cells CR in the display unit 1 of FIG. 7 to 9, the light emitting element included in the light emitting cell CW is a liquid crystal element, and is based on a transmissive liquid crystal display unit in which a backlight light source is provided on one side of a pair of transparent substrates. Shows the case.

  FIG. 7 shows an example of a structure in which a light emitting cell CW including a liquid crystal element which is a light emitting element and a light receiving cell CR including a light receiving element PD are separated by a partition wall 13. The cross-sectional view shown in FIG. 7 corresponds to the horizontal cross-sectional view taken along the line AA in the plan view shown in FIG. The display unit 1 is disposed between a pair of transparent substrates 12A and 12B and the transparent substrates 12A and 12B, and has a plurality of light emitting cells CW (structures that are alternately separated by the partition walls 13 as described above. CW12, CW22, CW32,...) And a plurality of light receiving cells CR (CR12, CR22, CR32,...). Further, as described above, the light emitting cell CW includes a liquid crystal element as a light emitting element, and the light receiving cell CR includes a light receiving element PD (PD12, PD22, PD32,...). The other layers in the general liquid crystal display unit are not shown and are omitted. The same applies to FIG. 8, FIG. 9, and FIG. This figure also shows backlight light LB from a backlight light source (not shown) and transmitted light LT, which is the light transmitted through the display unit 1 by the backlight light LB. Further, in the light receiving cell CR, the backlight light LB is also shown. In this case, the shielding layer 14 is disposed between the transparent substrate 12B on the backlight light source side and the light receiving element PD so that the light does not enter. With such a configuration, each light receiving element PD is not affected by the backlight light LB, and can detect only the light incident from the direction of the transparent substrate 12A opposite to the backlight light source. It becomes possible.

  FIG. 8 shows an example of a structure in which a light receiving cell CR including a light receiving element PD is disposed inside a light emitting cell CW including a liquid crystal element which is a light emitting element. The cross-sectional view shown in FIG. 8 corresponds to the horizontal cross-sectional view taken along the line BB in the plan view shown in FIG. The display unit 1 is disposed between a pair of transparent substrates 12A and 12B and the transparent substrates 12A and 12B, and has a plurality of light emitting cells CW (CW12, CW22, CW32,...) And a plurality of light receiving cells CR (CR12, CR22, CR32,...) Included in these light emitting cells. Further, as described above, the light emitting cell CW includes a liquid crystal element as a light emitting element, and the light receiving cell CR includes a light receiving element PD (PD12, PD22, PD32,...). Also in the example of FIG. 8, similarly to the example of FIG. 7, a shielding layer is provided between the transparent substrate 12B on the backlight source side and the light receiving element PD so that the backlight light LB does not enter the light receiving cell CR. 14 is arranged so that each light receiving element PD is not affected by the backlight light LB, and detects only light incident from the direction of the transparent substrate 12A opposite to the backlight light source.

  FIG. 9 shows an example of a structure in which a light receiving cell CR including a light receiving element PD is disposed inside a light emitting cell CW including a liquid crystal element as a light emitting element, similarly to FIG. This corresponds to a horizontal cross-sectional view taken along line BB in the plan view. The same components as those shown in FIG. 8 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. The display unit 1 is different from the configuration of FIG. 8 in a portion in which the light receiving cell CR is arranged on the transparent substrate 12A side opposite to the backlight light source. Similarly to the structures of FIGS. 7 and 8, the shielding layer 14 is disposed on the backlight source side so that the backlight light LB is not incident on each light receiving element PD, and is not affected by the backlight light LB. Only light incident from the direction of the transparent substrate 12A opposite to the light source is detected.

  In addition, the sectional view of the arrangement configuration example of the light emitting cells CW and the light receiving cells CR in the display unit 1 according to the present embodiment is not limited to these, and other arrangement configurations may be used.

  FIG. 10 shows a circuit configuration of the light emitting / receiving cell CWR in FIG.

  The light emitting / receiving cell CWR includes one light emitting cell CW and one light receiving cell CR. The light emitting gate line GW and the data supply line DW are connected to the light emitting cell CW, and the light receiving gate line GR and the data read line are connected. The DR is connected to the light receiving cell CR. That is, the gate line and the data line are increased by one for receiving light as compared with a cell for one pixel including only a normal light emitting cell. The light emitting cell CW selectively conducts between one light emitting element CL and the data supply line DW and one end of the light emitting element CL in accordance with the light emission selection signal supplied from the light emission gate line GW. A light emitting element selection switch SW1, and the other end of the light emitting element CL is grounded. The light receiving cell CR selectively conducts between one light receiving element PD and one end of the light receiving element PD and the data read line DR according to the light receiving selection signal supplied from the light receiving gate line GR. The other end of the light receiving element PD is connected to the ground or a positive bias point (not shown). In the circuit configuration of the light emitting / receiving cell CWR, since the gate lines are separately connected for light emission and light reception as described above, the light emission operation and the light reception operation can be performed independently. is there.

  Here, the operation of each component during the light emitting operation and the light receiving operation will be specifically described. First, during the light emission operation, the data supply line is set so that the light emitting element selection switch SW1 is turned on in accordance with the light emission selection signal supplied from the light emission gate line GW as described above, and the light emission has the luminance corresponding to the display signal. The light emitting element CL is charged through a path from DW to I1 to perform a light emitting operation. On the other hand, during the light receiving operation, the light receiving element selection switch SW2 is turned on according to the light receiving selection signal supplied from the light receiving gate line GR as described above, and the current corresponding to the amount of light received by the light receiving element PD is I2. The light is supplied to the data read line DR through the path to perform the light receiving operation. When neither the light emitting operation nor the light receiving operation is performed, both the light emitting element selection switch SW1 and the light receiving element selection switch SW2 are in the off state, and the data supply line DW and the data read line DR are Each of the light emitting element CL and the light receiving element PD is cut off.

  Next, an operation for detecting an object in contact with or close to the image display apparatus having the above configuration will be described.

  First, with reference to FIG. 11, an operation for detecting an object that is in contact with or close to the image display apparatus having the above-described configuration will be described. FIG. 11 shows an example of processing for detecting a detection target object in the image display apparatus of FIG. 6 corresponds to the example of the structure shown in FIG. 6 in which the light emitting cell CW including the liquid crystal element as the light emitting element and the light receiving cell CR including the light receiving element PD are separated by the partition wall 13. Constituent elements that are the same as those of the elements are denoted by the same reference numerals, and description thereof is omitted as appropriate.

  As shown in FIG. 11, for example, when the detection target object 15 such as a finger is brought into contact with or close to the display unit 1, for example, the transmitted lights LT1 and LT2 emitted from the light emitting cell CW22 are reflected by the detection target object 15, respectively. To do. Here, the reflected lights LR1 and LR2 are incident on the light receiving cell close to the light emitting cell CW22, for example, CR12 or CR22, but the reflected light is not incident on the light receiving cell far from the light emitting cell CW22. For this reason, a light reception signal is obtained only from the light reception cell CR whose position is close to a certain detection target object 15. For example, it is assumed that timing driving is performed so that light emitted from the light emitting cells CW of the horizontal line that is driven to emit light and reflected by the detection target object 15 is detected by the light receiving element of the horizontal line that is emitting light. While the light receiving signal is detected from the light receiving element in the vicinity of the detection target object 15, the light reception signal is not detected from the other region, so it is detected at which position of the display unit 1 the detection target object 15 exists. It becomes possible. By sequentially performing such light emission drive and light reception drive for each horizontal line (hereinafter referred to as line sequential drive), it becomes possible to detect the detection target object 15 while displaying an image over the entire display unit 1. .

  12 and 13 show an example of the line-sequential light emission operation in the image display device of FIG. Here, one square shown in FIGS. 12 and 13 represents the pixel 11 in the display unit 1.

  In the example of the line sequential light emitting operation shown in FIG. 12, for example, one horizontal line at the position indicated by the arrow P1 is sequentially emitted in the direction indicated by the scanning direction X by the light emitting side scanner 24 and the display signal driver 23 described above. It represents the situation of doing. Further, in this example, one horizontal line at the position indicated by the arrow P1 is in a light emitting state until drawing by display data is completed on the screen, that is, until the next image data is supplied by the display signal driver 23. This represents a situation in which the entire display unit 1 is the light emitting area 51. As described above, one horizontal line at the position indicated by the arrow P1 performs a line sequential light emission operation, so that the entire display unit 1 becomes a light emitting region, and certain image data can be displayed over the entire display unit 1. .

  In the example of the line-sequential light emission operation shown in FIG. 13, as in FIG. 12, for example, one horizontal line at the position indicated by the arrow P <b> 1 sequentially emits light in the direction indicated by the scan direction X. . However, in this example, one horizontal line at the position indicated by the arrow P1 remains constant until a certain time has elapsed on the screen for drawing with display data, that is, until the next image data is supplied by the display signal driver 23. The light emission state is maintained only for a period, and the entire display unit 1 is divided into a light emitting region 51 and a non-light emitting region 52. Even in this case, one horizontal line at the position indicated by the arrow P1 performs line-sequential light emission operation, so that the whole or most of the display unit 1 becomes a light emitting region within a certain time during which the light emission state is maintained. Image data can be displayed over the entire display unit 1. The period during which the light emission state is maintained is determined by, for example, the capacitance value of the light emitting element CL in the circuit configuration of the light emitting cell CW shown in FIG. 10, and can be arbitrarily set. In the example shown in FIG. 13, the non-light-emitting region 52 exists in the display unit 1, but the non-light-emitting region 52 also moves line-sequentially, so that it can be visually recognized by human eyes due to the afterimage phenomenon effect. There is no problem.

  FIG. 14 shows an example in which a line sequential light receiving operation is performed in addition to the line sequential light emitting operation shown in FIGS. 12 and 13 in the image display apparatus of FIG. 14 shows an example in which a line sequential light receiving operation is added to the line sequential light emitting operation shown in FIG. 13, but a line sequential light receiving operation is added to the line sequential light emitting operation shown in FIG. It is also possible to configure.

  In the example shown in FIG. 14, as in FIGS. 12 and 13, for example, one horizontal line at the position indicated by the arrow P <b> 1 sequentially emits light in the direction indicated by the scanning direction X and is emitted from the light emitting region 51. This represents a situation in which the reflected light from the detection target object 15 by light is received in a line sequential manner in the direction indicated by the scanning direction X as described above. Thus, one horizontal line at the position indicated by the arrow P1 performs line-sequential light emission operation and line-sequential light reception operation of reflected light from the emitted light, so that the entire display unit 1 becomes a light-emitting region and a light-receiving region, In addition to displaying certain image data over the entire display unit 1, whether or not a detection target object 15 exists in the vicinity of the display unit 1 based on a light reception signal detected from the light receiving element, and if present, its position Can be detected. In this case as well, the light emission state is maintained for a certain period until a certain time on the screen is drawn, and the entire display unit 1 is divided into a light emitting area 51 and a non-light emitting area 52. Yes.

  Next, with reference to FIG. 2, FIG. 10, FIG. 11, FIG. 14, and FIG. 15, details of processing for detecting the detection target object 15 in the image display apparatus of FIG. FIG. 15 shows processing for detecting the detection target object 15 in the image display device of FIG. 1, and (D) a light emitting / receiving cell CWRi (CWRi1 to CWRin) for one vertical line, and each of these light emitting / receiving units. (A) data supply line DWi, (B) light emission gate lines GW (GW1 to GWn), (C) light reception gate lines GR (GR1 to GRn) and (E) data read lines DRi connected to the cell CWRi. Each signal is shown. In FIG. 15, i and j, which are symbols representing positions, represent certain natural numbers. As described above, for example, in the case of an XGA standard display unit (m = 1024 × 3 (RGB), n = 768), for example, the display unit I = 1536, j = 384. The same applies to the subsequent timing diagrams.

  In FIG. 15, the horizontal axis represents time, and the vertical periods TH1 and TH2 are the time required to scan the entire screen of the display unit 1, that is, in this case, the light emitting side scanner 24 and the light receiving side scanner 31 are respectively GW1 to GWn. And the time for scanning from GR1 to GRn. Here, it is assumed that the detection target object 15 is in the vicinity of the light emitting / receiving cells CWRi (j-1), CWRij, and CWRi (j + 1) in the display unit 1, and in this case, in the corresponding period, that is, in the vertical period TH1. In the period from timing t3 to t6 (light reception signal detection period TF1), similarly, the light reception signal is detected in the light reception signal detection period TF2 in the vertical period TH2. The vertical axis represents the voltage at each timing of each signal shown in (A) to (C) and (E) above. Here, it is assumed that the signal of the data supply line DWi shown in (A) is display data corresponding to an arbitrary luminance in each pixel 11 and an arbitrary image is displayed on the display unit 1. Also, (D) shows the light emitting / receiving period TRW and the light emitting period TW in each light emitting / receiving cell CWRi. The periods other than the light emitting / receiving period TRW and the light emitting period TW are non-operating periods. Of the periods during which the light emitting element CL emits light (the light emitting / receiving period TRW and the light emitting period TW), the light emitting / receiving period TRW is a period during which light emission driving based on image data is performed (the light emitting element selection switch SW1 in FIG. 10). The light emission period TW is a period in which the light emission state is maintained by the capacitance value of the light emitting element CL in FIG.

  The process shown in FIG. 15 is an example in which the scanning of the light emitting operation by the light emitting side scanner 24 and the scanning of the light receiving operation by the light receiving side scanner 31 are performed in sequence with the same horizontal line at the same timing. As described above, the light emission operation scan and the light reception operation scan can operate independently. Further, the line-sequential light emission operation shown in FIG. 15 is an example in which the light emission state is held for a certain period as shown in FIGS. 13 and 14, but this period can be arbitrarily set as described above. . Further, the signal of the data read line DRi shown in (E) is an example stored in the light reception signal holding unit 33 as analog data, but as described above, it is stored in the light reception signal holding unit 33 as digital data. It is also possible to configure.

  First, the selection signal is not output in all the light emitting gate lines GW and the light receiving gate lines GR, and the light emitting element selection switch SW1 and the light receiving element selection switch SW2 are turned off in each light emitting / receiving cell CWR. Thus, the data supply line DW and the data read line DR are disconnected from the light emitting element CL and the light receiving element PD, respectively. Therefore, during this period, each light emitting / receiving cell is in a non-operating state.

  Next, at timing t1, (B) light emission gate line GW1 and (C) light reception gate line GR1 are output with light emission selection signals and light reception selection signals, respectively, and the light emission light reception cells to which these gate lines are connected. The light emitting element selection switch SW1 and the light receiving element selection switch SW2 in CWR11, CWR21,..., CWRm1 are simultaneously turned on. At this time, as indicated by the light emission / reception period TRW in FIG. 15, (D) the light emitting element CL is charged through the display signal current path I1 shown in FIG. In addition, a current corresponding to the amount of light received by the light receiving element PD is supplied to the (E) data read line DRi through the path I2, and a light receiving operation is performed. Note that during this period (timing t1 to t2), since the light reception signal by the detection target object 15 is not detected, the output signal is not output from (E) the data read line DRi.

  Similarly, after timing t2, (B) light emitting gate line GW2 and (C) light receiving gate line GR2, (B) light emitting gate line GW3, and (C) light receiving gate line GR3,. Although the light emission operation and the light reception operation are performed, the light reception signal from the detection target object 15 is not detected, so that no output signal is output from (E) the data read line DRi. In each light emitting / receiving cell CWRi, after the light emitting / receiving period TRW ends, the light emitting period TW is held for a certain period as described above.

  At timings t3 to t6, (D) the respective light emitting / receiving cells CWRi (j-1), CWRij, and CWRi (j + 1) receive the reflected light from the detection target object 15, and receive the light as shown in FIG. The current corresponding to the amount of light is converted into a voltage, and (E) is output to the data read line DRi (light reception signal detection period TF1). In this case, mainly (D) each light emitting / receiving cell CWRi (j-1), CWRij, CWRi (j + 1) receives the reflected light from the emitted light by its own light emitting operation. E) The signal output to the data read line DRi has a value corresponding to the signal on the (A) data supply line DWi.

  After timing t6, similarly to timings t1 to t3, (B) light emitting gate line GWj + 2 and (C) light receiving gate line GRj + 2, (B) light emitting gate line GWj + 3 and (C) light receiving. .., (B) light emitting gate line GWn and (C) light receiving gate line GRn are sequentially light-emitting and receiving light, but no light-receiving signal from the detection target object 15 is detected. Therefore, (E) no output signal is output from the data read line DRi.

  In this way, it is possible to detect that the detection target object 15 exists at a position in the vicinity of the light emitting / receiving cell CWRi (j-1), CWRij, CWRi (j + 1) in the vertical period TH1. In the vertical period TH2, the output signal is output from the data read line DRi in the light receiving signal detection period TF2, and the light emitting / receiving cells CWRi (j-1), CWRij, CWRi are also operated. It is detected that the detection target object 15 exists at a position near (j + 1).

  As described above, according to the image display device and the driving method of the image display device of the present embodiment, a plurality of light emitting cells CW including one light emitting element CL and a plurality of light receiving cells CR including one light receiving element PD. The light emitting / receiving cell CWR is arranged, and the light emitting side scanner 24 and the display signal driver 23 drive these light emitting elements CL based on the image data generated by the display signal generating unit 21. At the same time, the light receiving side scanner 31 drives the light receiving element PD so as to receive the light emitted from the light emitting element and reflected by the detection target object 15, and based on the light receiving signal obtained from the light receiving element by the light receiving signal receiver 32. Since the detection object 15 is detected by the position detection unit 34, there is no need to add a separate component such as a touch panel or an input device. It is possible to detect the position of an object without causing deterioration in image quality because the light emitted from the display unit 1 does not need to pass through a separate part such as a touch panel while ensuring an easy structure. Become.

  Further, according to the image display device and the driving method of the image display device of the present embodiment, each light emitting cell CW performs a line sequential light emitting operation and each light receiving cell CR performs a line sequential light receiving operation. It is possible to display the image data and detect the position of the object by the light emission operation.

  In addition, according to the image display device and the driving method of the image display device of the present embodiment, the position or the like is detected by contacting or bringing a detection target object such as a finger on the display unit 1. The user can operate conveniently with the same operation as the touch panel.

  Furthermore, according to the image display device and the driving method of the image display device of the present embodiment, since the light emission gate line GW and the light reception gate line GR are separately provided, the light emission operation and the light reception operation are performed independently. For example, by setting the scanning speed of the light emitting operation to 60 (frames / second) and increasing the scanning speed of the light receiving operation to 120 (frames / second), the speed of the object moving at high speed can be increased. It becomes possible to detect the position and the like more accurately. Alternatively, conversely, the scan speed of the light emission operation is set to 60 (frames / second), and the scan speed of the light reception operation is reduced to half (30 frames / second), thereby increasing the detection current. It is also possible to improve the detection sensitivity by improving the / N ratio.

  Hereinafter, some modified examples of the first embodiment will be described.

[Modification 1]
First, Modification 1 will be described. In this modification, in the first embodiment, the light-receiving side scanner 31 is thinned and driven with respect to the light-emitting side scanner 24.

  FIG. 16 illustrates an overall configuration of an image display apparatus according to the first modification. In this figure, the same components as those shown in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. This image display device includes a display unit 1, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a light emitting side scanner 24, a light receiving side scanner 311, a light receiving signal receiver 32, A light reception signal holding unit 33 and a position detection unit 34 are provided. That is, a light receiving side scanner 311 is provided instead of the light receiving side scanner 31 in the first embodiment shown in FIG.

  Similar to the light receiving side scanner 31, the light receiving side scanner 311 has a function of selecting a light receiving cell CR to be driven according to a light receiving timing control signal 42 output from the display signal holding control unit 22. The difference from the light receiving side scanner 31 is that the light receiving side scanner 311 is thinned and driven with respect to the light emitting side scanner 24 as described above. Specifically, as described later, the light-emitting side scanner 24 scans the light-emitting gate lines GW with GW1, GW2, GW3,..., GWn as in the first embodiment, whereas the light-receiving side scanner. Reference numeral 311 scans the light receiving gate lines GR every other line with GR1, GR3, GR5,..., GRn-1, so that the remaining light receiving gate lines GR2, GR4, GR6,. It has become. As described above, the display unit 1 is assumed to be an even number, for example, in the case of the XGA standard (m = 1024 × 3 (RGB), n = 768). For convenience, j is an odd number.

  FIG. 17 shows processing for detecting the detection target object 15 in the image display apparatus of FIG. The basic operation of the driving method of the image display apparatus in the present modification is the same as the basic operation of the driving method of the image display apparatus in the first embodiment, and thus the description thereof is omitted and the light receiving side scanner 311 is related. Only the operation will be described.

  As shown in FIG. 17, (B) the light emission gate line GW outputs the light emission selection signals GW1, GW2, GW3,..., GWn and the light emission selection signal as in the first embodiment. On the other hand, (C) GR1, GR3,..., GRj,..., GRn-1, and other light receiving selection signals are output to the remaining light receiving gate lines GR2, GR1, GR3,. The light receiving selection signal is not output to GR4, GRj-1, GRj + 1,..., GRn. Therefore, the output signal of the data read line DR is also thinned out corresponding to the light receiving gate line GR, and for example, the light receiving signal is not detected during the period of timing t1 to t2, t3 to t4, t5 to t6, and the timing t4, for example. During the period from t5 to t5, the light reception signal is detected, and thus the data amount of the light reception signal can be reduced.

  Thus, according to the image display device and the driving method of the image display device in the present modification, the light receiving side scanner 31 is thinned and driven with respect to the light emitting side scanner 24, so the first embodiment. In addition to the effects of the above, it is possible to reduce the data amount of the light reception signal, simplify the circuit on the light reception side (light reception side scanner 311, light reception signal receiver 32, light reception signal holding unit 33), and reduce power consumption. Become. Therefore, it is particularly effective when it is desired to simplify the circuit configuration and reduce the power consumption rather than the accuracy of the detection position of an object that is in contact with or close to the object.

  In the present modification, an example in which only odd-numbered light receiving gate lines are scanned has been described. However, the configuration of the present modification is not limited to this, and the circuit on the light receiving side is simplified to reduce power consumption. Other configurations are possible as long as they can be realized. For example, on the contrary, only the even-numbered light receiving gate lines may be scanned, or the light receiving gate lines may be scanned every two or three lines, for example.

[Modification 2]
Next, Modification 2 will be described. In the present modification, in the first embodiment, the four light receiving cells CR receive the light emitted from the four light emitting cells CW, and add the light receiving signals to output as one light receiving signal. Is.

  FIG. 18 illustrates an overall configuration of an image display apparatus according to the second modification. In this figure, the same components as those shown in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. This image display device includes a display unit 102, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a light emitting side scanner 24, a light receiving side scanner 312, a light receiving signal receiver 322, A light reception signal holding unit 332 and a position detection unit 34 are provided. That is, instead of the display unit 1 in the first embodiment shown in FIG. 1, the display unit 102, the light receiving side scanner 312 instead of the light receiving side scanner 31, and the light receiving signal receiver 322 instead of the light receiving signal receiver 32. Instead of the received light signal holding unit 33, a received light signal holding unit 332 is provided.

  Similar to the display unit 1, the display unit 102 has a plurality of pixels 11 arranged in a matrix over the entire surface, and displays an image such as a predetermined figure or character while performing a line sequential operation. The difference from the display unit 1 is that four light receiving cells are connected and operate together. Specifically, as described above, the light emitted from the four light emitting cells is received by the four light receiving cells, and the light receiving signals are added and output as one light receiving signal.

  Similar to the light receiving side scanner 31, the light receiving side scanner 312 has a function of selecting the light receiving cell CR to be driven according to the light receiving timing control signal 42 output from the display signal holding control unit 22. The difference from the light-receiving side scanner 31 is that the four light receiving cells arranged in the display unit 102 are connected as described above and operate together, so the number of light receiving gate lines corresponding to this is the same. The point is that it is halved. Specifically, as will be described later, the light-emitting side scanner 24 scans the light-emitting gate lines GW with GW1, GW2, GW3,..., GWn, as in the first embodiment, whereas the light-receiving side scanner. Since the number 311 is halved, the light receiving gate line GR is scanned with GR1, GR3, GR5,..., GRn-1. In this case, it is assumed that the light receiving gate line is composed only of odd-numbered light lines as described above, and n is an even number as in the first modification. Similarly, for convenience, j is an odd number.

  Similar to the light receiving signal receiver 32, the light receiving signal receiver 322 has a function of acquiring a light receiving signal for one horizontal line output from each light receiving cell CR in accordance with a control signal output from the light receiving side scanner 312. The difference from the light receiving signal receiver 32 is that the number of data read lines DR is also halved corresponding to the configuration of the display unit 102. Specifically, the data read lines DR are configured as DR1, DR3, DR5,. In this case, it is assumed that the data read line is composed of only odd-numbered data read lines as described above, and m is an even number. Further, similarly to j, i is an odd number for convenience.

  Similar to the light reception signal holding unit 33, the light reception signal holding unit 332 converts the light reception signal output from the light reception signal receiver 322 into a light reception signal for each screen according to the light reception block control signal 43 output from the light reception side scanner 312. It has the function of reconfiguring, storing and holding. The difference from the received light signal holding unit 33 is that the number of data read lines DR is also halved corresponding to the configuration of the display unit 102, and the number of storage elements is reduced and simplified.

  FIG. 19 shows processing for detecting the detection target object 15 in the image display apparatus of FIG. Note that the basic operation of the driving method of the image display device in the present modification is the same as the basic operation of the driving method of the image display device in the first embodiment, so that the description thereof is omitted and the display unit 102 and the light receiving device are omitted. Only operations relating to the side scanner 312, the light reception signal receiver 322, and the light reception signal holding unit 332 will be described. Note that (A) the display data supplied from the data supply line is the same for one vertical line DWi, DWi + 1 for the sake of convenience, and (A) includes both lines DWi, DWi + 1. Show. Also, (D) shows the light emitting / receiving period TRW, the light emitting period TW, and the light receiving period TR in each light emitting / receiving cell CWRi. The periods other than the light emitting / receiving period TRW, the light emitting period TW, and the light receiving period TR are non-operation periods.

  As shown in FIG. 19, as described above, (B) the light emission gate line GW outputs the light emission selection signal GW1, GW2, GW3,..., GWn and the light emission selection signal as in the first embodiment. On the other hand, (C) the number of light receiving gate lines GR is halved, so that GR1, GR3, GR5,..., GRn-1 and a light receiving selection signal are output, and the pulse width of the signal is further increased. (B) The light emitting gate line GW is doubled as compared with FIG. 15 in the first embodiment. Therefore, the operation of each light emitting / receiving cell CWRi2, CWRi4, CWRi6,..., CWRin is different from that in the first embodiment shown in FIG. Specifically, for example, in the case of the light emitting / receiving cell CWRi2, in the case of FIG. 15, the period from the timing t1 to t2 is a non-operation period, whereas in the present modification, the period from the timing t1 to t2 is the light receiving period. It is TR. The reason is that the light emission selection signal is not output from the light emission gate line GW2 during the period from the timing t1 to the time t2, whereas the light emission light reception cell is transmitted from the light reception gate line GR1 as well as the light emission light reception cell CWRi1. This is because the selection signal for light reception is also output to CWRi2. Thus, in this case, the light emission and light reception cells CWRi1, CWRi3, CWRi5,..., CWRin-1 and the light emission light reception cells CWRi2, CWRi4, CWRi6,. .

In this modified example, as shown in FIG. 18, the light receiving signals detected in the four light receiving cells are added and output to the data read line DR as one light receiving signal. Therefore, for example, at timings t4 to t5, the light receiving signals detected in the four light emitting and receiving cells CWRij, CWRi (j + 1), CWR (i + 1) j, and CWR (i + 1) (j + 1) As a result of addition, (E) data is output to the data read line DRi. Therefore, in this example, (A) data supply line D
Since the display data supplied by W is the same for both DWi and DWi + 1, (E) the amount of received light signal on the data read line DRi is about four times that of the first embodiment shown in FIG. Will be. In this manner, the data amount of the light reception signal can be reduced and the signal amount in each light reception signal can be increased.

  In this way, according to the image display device and the driving method of the image display device in the present modification, the four light receiving cells receive the light emitted from the four light emitting cells, and add the light receiving signals to obtain one Since the light reception signal is output, in addition to the effects of the first embodiment, the data amount of the light reception signal is reduced, and the light reception side circuit (light reception side scanner 312, light reception signal receiver 322, light reception signal holding unit 332). ) And power consumption can be reduced. In addition, since the four light receiving signals are added and output as one light receiving signal to the light receiving signal receiver 322, it is possible to increase the output signal amount to improve the S / N ratio and increase the detection sensitivity. .

  In this modification, the light emitted from the four light emitting cells is output as one light receiving signal, and is described as an example including only odd numbered light receiving gate lines and odd numbered data readout lines. However, the configuration of the present modification is not limited to this, and other configurations are possible as long as the circuit on the light receiving side can be simplified and the power consumption can be reduced. For example, conversely, it may be configured by only even-numbered light receiving gate lines and odd-numbered data readout lines. For example, light emitted from six or nine light emitting cells is output as one light receiving signal. It may be.

[Modification 3]
Next, Modification 3 will be described. In the first modification, the arrangement of the light receiving cells CR is thinned out from the light emitting cells CW in the first embodiment.

  FIG. 20 illustrates an overall configuration of an image display apparatus according to Modification 3. In this figure, the same components as those shown in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. This image display device includes a display unit 103, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a light emitting side scanner 24, a light receiving side scanner 313, a light receiving signal receiver 323, A light reception signal holding unit 333 and a position detection unit 34 are provided. That is, instead of the display unit 1 in the first embodiment shown in FIG. 1, the display unit 103, the light receiving side scanner 313 instead of the light receiving side scanner 31, and the light receiving signal receiver 323 instead of the light receiving signal receiver 32. Instead of the light receiving signal holding unit 33, a light receiving signal holding unit 333 is provided.

  Similar to the display unit 1, the display unit 103 includes a plurality of pixels 11 arranged in a matrix over the entire surface, and displays an image such as a predetermined figure or character while performing a line sequential operation. The difference from the display unit 1 is that the arrangement of the light receiving cells CR is thinned out with respect to the light emitting cells CW. Specifically, one light receiving cell CR is arranged for four light emitting cells CW.

  Similar to the light receiving side scanner 31, the light receiving side scanner 313 has a function of selecting a light receiving cell CR to be driven according to a light receiving timing control signal 42 output from the display signal holding control unit 22. The light receiving side scanner 31 is different from the light receiving side scanner 31 in that the light receiving cells CR arranged in the display unit 103 are thinned out with respect to the light emitting cells CW. Accordingly, the number of light receiving gate lines GR is corresponding to this. The point is half. Specifically, as described later, the light-emitting side scanner 24 scans the light-emitting gate lines GW with GW1, GW2, GW3,..., GWn as in the first embodiment, whereas the light-receiving side scanner. Since the number 313 is halved, the light receiving gate line GR is scanned with GR1, GR3, GR5,..., GRn-1. In this case, as described above, it is assumed that only the odd-numbered light receiving gate lines are formed as in Modification 2, and n is an even number as in Modifications 1 and 2. Similarly, for convenience, j is an odd number.

  Similar to the light receiving signal receiver 32, the light receiving signal receiver 323 has a function of acquiring a light receiving signal for one horizontal line output from each light receiving cell CR in accordance with a control signal output from the light receiving side scanner 313. The difference from the light receiving signal receiver 32 is that the number of data read lines DR is also halved correspondingly to the configuration of the display unit 103. Specifically, the data read lines DR are configured as DR1, DR3, DR5,. In this case, it is assumed that the data read line is composed of only odd-numbered data read lines as described above, and m is an even number. Further, similarly to j, i is an odd number for convenience.

  The light reception signal holding unit 333 converts the light reception signal output from the light reception signal receiver 323 into a light reception signal for each screen in accordance with the light reception block control signal 43 output from the light reception side scanner 313, similarly to the light reception signal holding unit 33. It has the function of reconfiguring, storing and holding. The difference from the received light signal holding unit 33 is that the number of data read lines DR is also halved corresponding to the configuration of the display unit 103, and the number of storage elements is reduced and simplified.

  FIG. 21 shows processing for detecting the detection target object 15 in the image display apparatus of FIG. Note that the basic operation of the driving method of the image display device in the present modification is the same as the basic operation of the driving method of the image display device in the first embodiment, so that the description thereof is omitted and the display unit 103 and the light receiving device are omitted. Only operations relating to the side scanner 313, the light reception signal receiver 323, and the light reception signal holding unit 333 will be described.

  As shown in FIG. 21, the operation in this modification is basically the same as the example shown in FIG. This is because the scan of the light receiving gate line GR is thinned out in the example of FIG. 17, whereas the light receiving gate line GR itself is thinned out in this modification. Therefore, the output signal of the data readout line is also thinned out corresponding to the light receiving gate line GR, and the data amount of the light receiving signal can be reduced as in the example of FIG.

  As described above, according to the image display device and the driving method of the image display device in the present modification, the arrangement of the light receiving cells CR is thinned out with respect to the light emitting cells CW. Therefore, in the first embodiment, In addition to the effect, the data amount of the light reception signal can be reduced, the light reception side circuit (light reception side scanner 313, light reception signal receiver 323, light reception signal holding unit 333) can be simplified, and the power consumption can be reduced. .

  In the present modification, one light receiving cell CR is arranged for four light emitting cells CW, and only an odd number light receiving gate line and an odd number data read line are described. However, the configuration of the present modification is not limited to this, and other configurations are possible as long as the circuit on the light receiving side can be simplified and the power consumption can be reduced. For example, conversely, it may be configured by only even-numbered light receiving gate lines and even-numbered data readout lines, and for example, one light receiving cell CR is arranged for six or nine light emitting cells CW. You may comprise. Further, for example, a plurality of light receiving cells CR such as two or three are arranged for four light emitting cells CW, and the light receiving signals detected by the plurality of light receiving cells CR are output as one light receiving signal, that is, Modification 2 You may make it the structure which combined with.

[Modification 4]
Next, Modification 4 will be described. In this modification, contrary to Modification 3 in the first embodiment, a plurality of light receiving cells CR are arranged for one light emitting cell CW.

  FIG. 22 illustrates an overall configuration of an image display apparatus according to Modification 4. In this figure, the same components as those shown in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. The image display device includes a display unit 104, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a light emitting side scanner 24, a light receiving side scanner 314, a light receiving signal receiver 324, A light reception signal holding unit 334 and a position detection unit 34 are provided. That is, instead of the display unit 1 in the first embodiment shown in FIG. 1, the display unit 104, the light receiving side scanner 314 instead of the light receiving side scanner 31, and the light receiving signal receiver 324 instead of the light receiving signal receiver 32. Instead of the light receiving signal holding unit 33, a light receiving signal holding unit 334 is provided.

  Similar to the display unit 1, the display unit 104 has a plurality of pixels 11 arranged in a matrix over the entire surface, and displays an image such as a predetermined figure or character while performing a line sequential operation. The difference from the display unit 1 is that a plurality of light receiving cells CR are arranged for one light emitting cell CW. Specifically, four light receiving cells CR are arranged for one light emitting cell CW.

  Similar to the light receiving side scanner 31, the light receiving side scanner 314 has a function of selecting the light receiving cell CR to be driven according to the light receiving timing control signal 42 output from the display signal holding control unit 22. The light receiving side scanner 31 is different from the light receiving side scanner 31 in that four light receiving cells CR arranged on the display unit 104 are arranged for one light emitting cell CW as described above. Is the point that is doubled. Specifically, as described later, the light-emitting side scanner 24 scans the light-emitting gate lines GW with GW1, GW2, GW3,..., GWn as in the first embodiment, whereas the light-receiving side scanner. Since the number 311 is doubled, the light receiving gate line GR is scanned with GR1, GR2, GR3, GR4,..., GR (2n-1), GR2n.

  Similar to the light receiving signal receiver 32, the light receiving signal receiver 324 has a function of acquiring a light receiving signal for one horizontal line output from each light receiving cell CR in accordance with a control signal output from the light receiving side scanner 314. The difference from the light receiving signal receiver 32 is that the number of data readout lines DR is doubled correspondingly to the configuration of the display unit 104. Specifically, the data read lines DR are configured as DR1, DR2, DR3, DR4,..., DR (2m-1), DR2m as the number of the lines is doubled.

  The light reception signal holding unit 334 converts the light reception signal output from the light reception signal receiver 324 into a light reception signal for each screen in accordance with the light reception block control signal 43 output from the light reception side scanner 314, similarly to the light reception signal holding unit 33. It has the function of reconfiguring, storing and holding. The difference from the light reception signal holding unit 33 is that the number of data read lines DR is doubled corresponding to the configuration of the display unit 104, and the number of storage elements is also increased.

FIG. 23 shows processing for detecting the detection target object 15 in the image display apparatus of FIG. Here, the vertical axis indicates (D) light emitting cells CWi (CWi1 to CWin) for one vertical line, (E) light receiving cells CR2i (CWR2i1 to CWR2i2n) for the same vertical line, and light emitting cells CWi for these light receiving cells CWi. , CR2i2n, (A) data supply line DWi, (B) light emitting gate line GW (GW1 to GWn), (C) light receiving gate line GR (GR1 to GR2n) and (F) data read line DR2i Each signal is shown.
The basic operation of the driving method of the image display device in the present modification is the same as the basic operation of the driving method of the image display device in the first embodiment, so that the description thereof will be omitted and the display unit 104, the light receiving operation will be omitted. Only operations relating to the side scanner 314, the light reception signal receiver 324, and the light reception signal holding unit 334 will be described.

  As shown in FIG. 23, (B) the light emission gate line GW outputs the light emission selection signals GW1, GW2, GW3,..., GWn and the light emission selection signal as in the first embodiment as described above. On the other hand, (C) the number of light receiving gate lines GR is doubled, so that GR1, GR2, GR3, GR4,..., GR2n-1, GR2n and a light receiving selection signal are output. The pulse width of the signal is halved compared to (B) the light emitting gate line GW and FIG. 15 in the first embodiment.

  In the present modification, as shown in FIG. 22, four light receiving cells are separately arranged for one light emitting cell, and are output to the data read line DR as four light receiving signals. Therefore, for example, at timings t4 to t5, (E) received light detected in the four light receiving cells CR (2i-1) (2j-1), CR (2i-1) 2j, CR2i (2j-1), CR2i2j. Each of the signals is output to (F) data read lines DR (2i-1) and DR2i as four signals. Therefore, it is possible to detect an object that is in contact with or in close proximity with a resolution four times that in the case of the first embodiment shown in FIG.

  As described above, according to the image display device and the driving method of the image display device in the present modification, a plurality of light receiving elements are arranged for one light emitting element, and thus the effect of the first embodiment. In addition, it is possible to detect the position of an object that is in contact with or close to it with higher accuracy.

  In addition, in this modification, although the example which has arrange | positioned four light reception cells CR with respect to one light emitting cell CW was demonstrated, the structure of this modification is not restricted to this, The object which contacts or adjoins is shown. Other configurations are possible as long as the position can be detected with higher accuracy. For example, six or nine light receiving cells CR may be arranged for one light emitting cell CW.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.

  In the first embodiment, the light emitting gate line GW and the light receiving gate line GR are separately connected to one issue light receiving cell CWR and the driving of the image display apparatus. In the present embodiment, the light emitting gate line GW and the light receiving gate line GR are connected as one common gate line G to one issuing light receiving cell CWR. An image display device and a method for driving the image display device will be described.

  FIG. 24 shows the overall configuration of an image display apparatus according to the second embodiment of the present invention. In this figure, the same components as those of the image display device according to the first embodiment shown in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. The image display device includes a display unit 105, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a common scanner 25, a light receiving signal receiver 32, a light receiving signal holding unit 33, A position detector 34. That is, the display unit 105 is provided instead of the display unit 1 in the first embodiment shown in FIG. 1, and the common scanner 25 is provided instead of the light emitting side scanner 24 and the light receiving side scanner 31.

  Similar to the display unit 1, the display unit 105 includes a plurality of pixels 11 arranged in a matrix over the entire surface, and displays an image such as a predetermined figure or character while performing a line sequential operation. The difference from the display unit 1 is that, as described above, the light emitting gate line GW and the light receiving gate line GR in the first embodiment are connected to one issuing light receiving cell CWR as one common gate line G. It is the point which made it the structure.

  The common scanner 25 has the functions of the light emitting gate line GW and the light receiving gate line GR in the first embodiment. That is, it has a function of selecting both the light emitting cell CW and the light receiving cell CR to be driven according to the common timing control signal 44 output from the display signal holding control unit 22. Specifically, as described later, a selection signal is supplied through a common gate line connected to each pixel 11 of the display unit 1 to control the light emitting element selection switch and the light receiving element selection switch. That is, when a voltage is applied to turn on the light emitting element selection switch and the light receiving element selection switch of a certain pixel according to the selection signal, the pixel performs a light emission operation with luminance corresponding to the voltage supplied from the display signal driver 23. In addition, a light reception signal detected from the pixel is output to the light reception signal receiver 32. The common scanner 25 outputs a light reception block control signal 43 to the light reception signal receiver 32 and the light reception signal holding unit 33, and has a function of controlling the blocks contributing to the light reception operation. In the image display device according to the present embodiment, as described above, the light emitting gate line GW and the light receiving gate line GR in the first embodiment form one common light receiving cell as one common light receiving cell G. Since it is connected to the CWR, the light emitting operation and the light receiving operation can be operated line-sequentially at the same timing.

  FIG. 25 shows an example of the configuration of the display unit 105 in FIG. 24, and corresponds to FIG. 2 in the first embodiment. As in FIG. 2, the display unit 105 has a configuration in which m pixels in the horizontal line direction, n pixels in the vertical line direction, and a total of (m × n) pixels 11 are arranged in a matrix. Shall.

  As shown in FIG. 25, the display unit 105 includes a total of (m × n) pixels 11 and the light emitting / receiving cells CWR11 to CWRmn included in each pixel, and the number of the pixels 11. There are provided m data supply lines DW (DW1 to DWm) and data read lines DR (DR1 to DRm), and n common gate lines G (G1 to Gn).

  The data supply line DW, the data read line DR, and the common gate line G are connected to the display signal driver 23, the light receiving signal receiver 32, and the common scanner 25, respectively, and the display signal and the selection signal are supplied to each light emitting / receiving cell CWR. A light receiving signal is output from each light emitting / receiving cell CWR. Further, one data supply line DW, one data read line DR and one common gate line G are connected to each light emitting / receiving cell CWR. Further, for example, one light supply / receiver cell CWR11, CWR12,..., CWR1n is connected to one data supply line DW1 and one data read line DR1 in common, for example, one horizontal line of light emitting / receiving cell CWR11, A common gate line G1 is commonly connected to CWR21,..., CWRm1.

  FIG. 26 shows a circuit configuration of the light emitting / receiving cell CWR of FIG. 25, and corresponds to FIG. 10 in the first embodiment.

  The light emitting / receiving cell CWR includes one light emitting cell CW and one light receiving cell CR, the common gate line G for the light emitting cell CW and the light receiving cell CR, the data supply line DW for the light emitting cell CW, and the data read line DR for The configuration is connected to the light receiving cell CR. That is, the number of data lines is increased by one for receiving light as compared with a cell for one pixel including only a normal light emitting cell. Further, the light emitting cell CW is a light emitting element selection that selectively conducts between one light emitting element CL and the data supply line DW and one end of the light emitting element CL according to a selection signal supplied from the common gate line G. And the other end of the light emitting element CL is grounded. The light receiving cell CR selectively selects one light receiving element PD and one end of the light receiving element PD and the data read line DR in accordance with a selection signal supplied from the common gate line G. The other end of the light receiving element PD is connected to the ground or a positive bias point (not shown). In the circuit configuration of the light emitting / receiving cell CWR, since the gate lines are commonly connected for light emission and light reception as described above, the light emission operation and the light reception operation can be performed at the same timing. is there.

  Here, the operation of each component during the light emitting operation and the light receiving operation will be specifically described. As described above, the light emitting element selection switch SW1 and the light receiving element selection switch SW2 are turned on in accordance with the selection signal supplied from the common gate line G, and the data supply line DW is configured to emit light with luminance corresponding to the display signal. The light emitting element CL is charged through the path I3 to perform a light emitting operation, and a current corresponding to the amount of light received by the light receiving element PD is supplied to the data read line DR through the path I4 to perform the light receiving operation. ing. When the common operation of light emission and light reception is not performed, both the light emitting element selection switch SW1 and the light receiving element selection switch SW2 are in an off state, and the data supply line DW and the data read line DR are respectively The light emitting element CL and the light receiving element PD are cut off.

  FIG. 27 shows a process of detecting a detection target object in the image display apparatus of FIG. 24, and corresponds to FIG. 15 in the first embodiment. In this figure, (C) light emitting / receiving cells CWRi (CWRi1 to CWRin) for a certain vertical line, and (A) data supply lines DWi, (B) connected to these light emitting / receiving cells CWRi. Each signal of the common gate line G (G1 to Gn) and (D) data read line DRi is shown.

  The basic operation of the driving method of the image display device in the present embodiment is the same as the basic operation of the driving method of the image display device in the first embodiment. The difference is that the light emitting element CL is driven by the common gate line G. And the light receiving element PD are both selected at the same time. Therefore, as in the case of the first embodiment shown in FIG. 15, the light receiving / receiving cells CWRi (j-1), CWRij, CWRi (j + 1) are obtained by obtaining the light receiving signals in the light receiving element detection periods TF1, TF2. ) It can be detected that the detection target object 15 exists at a nearby position.

  As described above, according to the image display device and the driving method of the image display device of the present embodiment, a plurality of light emitting cells CW including one light emitting element CL and a plurality of light receiving cells CR including one light receiving element PD. The light emitting / receiving cell CWR is arranged, and the common scanner 25 and the display signal driver 23 drive these light emitting elements CL based on the image data generated by the display signal generating unit 21. The common scanner 25 drives the light receiving element PD so as to receive the light emitted from the light emitting element and reflected by the detection target object, and the position detection unit based on the light receiving signal obtained by the light receiving signal receiver 32 from the light receiving element. Since the detection target object 15 is detected in 34, a separate unit such as a touch panel or an input device is provided as in the first embodiment. In addition to ensuring a simple structure, the light emitted from the display unit 1 does not need to pass through a separate part such as a touch panel, so that the position of an object can be determined without causing deterioration in image quality. It becomes possible to detect.

  Further, according to the image display device and the driving method of the image display device of the present embodiment, as in the first embodiment, the position of the detection target object such as a finger is brought into contact with or brought close to the display unit 105. And the like are detected, so that the user can conveniently operate the same operation as the touch panel.

  Further, according to the image display device and the driving method of the image display device of the present embodiment, each light emitting cell CW performs a line sequential light emitting operation and each light receiving cell CR performs a line sequential light receiving operation. As in the first embodiment, it is possible to display image data and detect the position of an object by a normal light emission operation.

  Furthermore, according to the image display device and the driving method of the image display device of the present embodiment, since the gate line is configured to be commonly connected for light emission and light reception, the light emission operation and the light reception operation are performed at the same timing. And an image display device capable of receiving and emitting light without increasing the number of gate lines by increasing one data line (data read line DR) with respect to a normal light emission only image display device. It becomes possible.

[Third Embodiment]
Next, a third embodiment of the present invention will be described.

  In the present embodiment, in the second embodiment, the data supply line DW and the data readout line DR are further connected as one common data line D to one light emitting / receiving cell CWR. A driving method of the display device and the image display device will be described.

  FIG. 28 shows the overall configuration of an image display apparatus according to the third embodiment of the present invention. In this figure, the same reference numerals are used for the same components as those of the image display device according to the first embodiment shown in FIG. 1 and the image display device according to the second embodiment shown in FIG. The description is omitted as appropriate. This image display device includes a display unit 106, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a common scanner 25, a light receiving signal receiver 32, a light receiving signal holding unit 33, A position detector 34. That is, the display unit 106 is provided instead of the display unit 105 in the second embodiment shown in FIG.

  Similar to the display unit 105, the display unit 106 has a plurality of pixels 11 arranged in a matrix over the entire surface, and displays an image such as a predetermined figure or character while performing a line sequential operation. The difference from the display unit 105 is that, as described above, the data supply line DW and the data read line DR in the second embodiment are connected to one light emitting / receiving cell CWR as one common data line D. This is the configuration.

  FIG. 29 shows an example of the configuration of the display unit 106 in FIG. 28, and corresponds to FIG. 2 in the first embodiment and FIG. 25 in the second embodiment. 2 and 25, the display unit 106 has a configuration in which m pixels in the horizontal line direction, n pixels in the vertical line direction, and a total of (m × n) pixels 11 are arranged in a matrix. Suppose that

  As shown in FIG. 29, the display unit 106 includes a total of (m × n) pixels 11, the light emitting / receiving cells CWR 11 to CWRmn included in each pixel, and the number of the pixels 11. There are connected m shared data lines D (D1 to Dm) and n common gate lines G (G1 to Gn).

  The shared data line D and the common gate line G are connected to the display signal driver 23, the light receiving signal receiver 32 and the common scanner 25, respectively, and the display signal and the selection signal are supplied to each light emitting and receiving cell CWR, and the light receiving signal is supplied to each light receiving signal CWR. Output from the light emitting / receiving cell CWR. As shown in FIG. 29, one shared data line D and one common gate line G are connected to each light emitting / receiving cell CWR. Further, for example, one common data line D1 is commonly connected to the light emitting / receiving cells CWR11, CWR12,..., CWR1n of one vertical line, and for example, the light emitting / receiving cells CWR11, CWR21,. On the other hand, one common gate line G1 is connected in common.

  30 shows a circuit configuration of the light emitting / receiving cell CWR of FIG. 29, and corresponds to FIG. 10 in the first embodiment and FIG. 26 in the second embodiment.

  The light emitting / receiving cell CWR includes one light emitting cell CW and one light receiving cell CR, and a common gate line G and a common data line D are connected to the light emitting cell CW and the light receiving cell CR. . That is, the configuration is basically the same as that of a cell for one pixel including only a normal light emitting cell. The light emitting / receiving cell CWR further includes a change-over switch SW3 for switching whether to use the shared data line D for data supply or data read according to a selection signal supplied from the common gate line G. The light emitting cell CW includes one light emitting element CL and a light emitting element selection switch SW1 that selectively conducts between the shared data line D and one end of the light emitting element CL in accordance with a selection signal supplied from the common gate line G. The other end of the light emitting element CL is grounded. In addition, the light receiving cell CR selectively selects one light receiving element PD and one end of the light receiving element PD and the shared data line D in accordance with a selection signal supplied from the common gate line G. The other end of the light receiving element PD is connected to the ground or a positive bias point (not shown).

  Here, the operation of each component during the light emitting operation and the light receiving operation will be specifically described. As described above, the light emitting element selection switch SW1 and the light receiving element selection switch SW2 are turned on in accordance with the selection signal supplied from the common gate line G, and the changeover switch SW3 is turned off to emit light with luminance corresponding to the display signal. Thus, the light emitting element CL is charged from the shared data line D to the path I5 to perform a light emitting operation, and a current corresponding to the amount of light received by the light receiving element PD is supplied to the shared data line D through the path I6. Thus, a light receiving operation is performed. When the common operation of light emission and light reception is not performed, both the light emitting element selection switch SW1 and the light receiving element selection switch SW2 are turned off and the changeover switch SW3 is turned on, and the shared data line D is disconnected from the light emitting element CL and the light receiving element PD.

  FIG. 31 shows processing for detecting the detection target object 15 in the image display apparatus of FIG. 29, and corresponds to FIG. 15 in the first embodiment and FIG. 27 in the second embodiment. is there. In this figure, (C) light emitting / receiving cell CWRi (CWRi1 to CWRin) for a certain vertical line, and (A) shared data line Di (data supply side) connected to each of these light emitting / receiving cells CWRi. ), (B) Signals of the common gate line G (G1 to Gn) and (D) shared data line Di (data reading side) are shown.

  The basic operation of the driving method of the image display device in the present embodiment is the same as the basic operation of the driving method of the image display device in the first and second embodiments, and the difference is that light is emitted by the common gate line G. Both the element CL and the light receiving element PD are simultaneously selected, and the data line is a point where the data supply side and the data reading side are shared (shared data line D). Accordingly, as in the case of the first embodiment shown in FIG. 15 and the second embodiment shown in FIG. 27, the light receiving signal is obtained in the light receiving signal detection periods TF1 and TF2, so that the light emitting / receiving cell CWRi ( j-1), CWRij, CWRi (j + 1) can be detected if the detection target object 15 exists at a position in the vicinity.

  As described above, according to the image display device and the driving method of the image display device of the present embodiment, a plurality of light emitting cells CW including one light emitting element CL and a plurality of light receiving cells CR including one light receiving element PD. The light emitting / receiving cell CWR is arranged, and the common scanner 25 and the display signal driver 23 drive these light emitting elements CL based on the image data generated by the display signal generating unit 21. The common scanner 25 drives the light receiving element PD so as to receive the light emitted from the light emitting element and reflected by the detection target object 15, and the position is detected based on the light receiving signal obtained from the light receiving element by the light receiving signal receiver 32. Since the detection target object 15 is detected by the unit 34, as in the first and second embodiments, a touch panel or an input device is used. It is not necessary to add separate parts, and while ensuring a simple structure, the light emitted from the display unit 1 does not need to be transmitted through separate parts such as a touch panel. It is possible to detect the position of the.

  Further, according to the image display device and the driving method of the image display device of the present embodiment, the detection object 15 such as a finger is brought into contact with or brought close to the display unit 106 to detect the position thereof. As in the first and second embodiments, the user can operate conveniently with the same operation as the touch panel.

  Further, according to the image display device and the driving method of the image display device of the present embodiment, each light emitting cell CW performs a line sequential light emitting operation and each light receiving CR cell performs a line sequential light receiving operation. Similar to the first and second embodiments, it is possible to display image data and detect the position of an object by a normal light emission operation.

  Furthermore, according to the image display device and the driving method of the image display device of the present embodiment, since the gate line and the data line are connected in common for light emission and light reception, the light emission operation and the light reception operation Can be performed at the same timing, and an image display device capable of receiving and emitting light can be obtained with the same configuration without increasing the number of connection lines from an image display device with only normal light emission.

  Hereinafter, some common modifications will be described for the first to third embodiments. These modifications can be applied to any of the first to third embodiments. In the following description, the first embodiment will be used as a basis.

[Modification 5]
First, a fifth modification common to the first to third embodiments will be described. This modification is configured such that the comparator 35 is disposed between the light reception signal receiver 32 and the light reception signal holding unit 33 in the first to third embodiments.

  FIG. 32 illustrates an overall configuration of an image display device according to the fifth modification, and corresponds to FIG. 1 in the first embodiment. In this figure, the same components as those shown in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. The image display device includes a display unit 1, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a light emission side scanner 24, a light reception side scanner 31, a light reception signal receiver 32, A comparator 35, a light reception signal holding unit 33, and a position detection unit 34 are provided.

  The comparator 35 has a function of performing A / D conversion by comparing the light reception signal output from the light reception signal receiver 32 with a threshold voltage signal Vt that is a predetermined voltage output from the display signal holding control unit 22. Have. Specifically, as will be described later, the received light signal is converted into digital data such as 1 when the received light signal is higher than the threshold voltage signal Vt and 0 when the received voltage is lower than the threshold voltage signal Vt. . Further, the data (comparator output signal Vc) converted into the digital data is output to the received light signal holding unit 33.

  FIG. 33 shows processing for detecting a detection target object in the image display apparatus of FIG. 32, and corresponds to FIG. 15 in the first embodiment. In this figure, (D) light emitting / receiving cells CWRi (CWRi1 to CWRin) for one vertical line, and (A) data supply lines DWi, (B) connected to these light emitting / receiving cells CWRi. Light emitting gate line GW (GW1 to GWn) and (C) Light receiving gate line GR (GR1 to GRn), (E) Data read line DRi, (F) Threshold voltage signal Vt, (G) Comparator output signal Vci Each signal is shown.

  The basic operation of the driving method of the image display device in the present modification is the same as the basic operation of the driving method of the image display device in the first embodiment, and the difference is that the light receiving signal receiver 32 and the light receiving operation as described above. The comparator 35 is disposed between the signal holding unit 33 and the comparator output signal Vc, that is, the input signal to the light receiving signal holding unit 33 is digital data. Therefore, if (E) the signal amount on the data read line DRi is larger than the predetermined (F) threshold voltage signal Vt, (G) the comparator output signal Vci becomes 1, conversely (E) on the data read line DRi. If the signal amount is smaller than the predetermined (F) threshold voltage signal Vt, (G) the comparator output signal Vci is zero. In this manner, as in the case of the first embodiment shown in FIG. 15, the light receiving signal is obtained in the light receiving signal detection periods TF1 and TF2, so that the light emitting and receiving cells CWRi (j-1), CWRij, and CWRi ( It can be detected that the detection target object 15 exists at a position near j + 1).

  As described above, according to the image display device and the driving method of the image display device in this modification, the comparator 35 is arranged between the light reception signal receiver 32 and the light reception signal holding unit 33. Since the data handled by the unit 33 and the position detection unit 34 are digital data, in addition to the effects of the first embodiment, the processing load is suppressed in these blocks, and the circuit configuration is simplified and the power consumption is reduced. It becomes possible.

  FIG. 34 illustrates another overall configuration example of the image display device according to the fifth modification. This example has a configuration in which a shift register 36 is further arranged between the light receiving signal receiver 32 and the comparator 35 in the modified example 5 shown in FIG. In this figure, the same components as those shown in FIG. 32 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. The image display device includes a display unit 1, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a light emission side scanner 24, a light reception side scanner 31, a light reception signal receiver 32, A shift register 36, a comparator 351, a light reception signal holding unit 33, and a position detection unit 34 are provided.

  The shift register 36 sequentially selects the light reception signal output from the light reception signal receiver 32 by the shift register according to the light reception block control signal 43 output from the light reception side scanner 31, performs parallel / serial conversion, and performs the comparator 351. The function to output to. Specifically, the number of comparators is reduced from m to 1 compared to the configuration of FIG. 32 by outputting the received light signal, which is parallel data for m outputs, to the comparator 351 as serial data for one output. It becomes possible to do.

  The comparator 351 uses the received light signal output from the shift register 36 and subjected to parallel / serial conversion as described above to a predetermined voltage output from the display signal holding control unit 22, as in the comparator 35. Compared with the value voltage signal Vt, it has a function of performing A / D conversion. Further, the data (comparator output signal Vc) converted into the digital data is output to the received light signal holding unit 33.

  In this manner, according to the image display device and the driving method of the image display device in FIG. 34, the shift register 36 is further arranged between the light receiving signal receiver 32 and the comparator 351 in the modified example 5 shown in FIG. As a result, in addition to the effect of the fifth modification, the number of comparators is reduced, and it is possible to reduce the processing load in these blocks, further simplify the circuit configuration and reduce the power consumption. Become.

  Here, the effect when the threshold voltage Vt is changed will be described.

  FIG. 35 shows an example of the distribution of the signal amount of the light receiving signal, and each light emitting / receiving cell (CWR (i-4) (j-5) to CWR (i + 4)) centered on the light emitting / receiving cell CWRij. This shows the area (j + 5)).

  In this example, the light receiving signal 61 in the light emitting / receiving cell CWRij has a light receiving signal level of 9, light emitting / receiving cells CWRi (j-1), CWR (i + 1) j, CWRi (j + 1), CWR (i-1). The light receiving signals 62A to 62D at j have a light receiving signal level of 5, light emitting / receiving cells CWR (i + 1) (j-1), CWR (i + 1) (j + 1), CWR (i-1) (j +1), CWR (i-1) (j-1), the light receiving signals 63A to 63D have a light receiving signal level of 3, light emitting / receiving cells CWR (i + 2) j, CWRi (j + 2), CWR (i -2) The light reception signals 64A to 62C in j and the light reception signals in CWRi (j-2) (not shown) have a light reception signal level of 1, and the light reception signal level increases as the position moves away from the light emitting / receiving cell CWRij. The distribution is such that becomes smaller. As described above, by comparing the signal amount of each received light signal with a certain threshold voltage Vt in the position detection unit 34 or the comparators 35 and 351, it is possible to determine at which position the object that is in contact with or close to is present. Can be detected.

  FIG. 36 shows a case where the threshold voltage Vt is changed in the signal amount distribution of the received light signal of FIG. 36 (A), (B), and (C) show cases where the threshold voltage Vt in FIG. 35 is the light reception signal level 2, the light reception signal level 4, and the light reception signal level 6, respectively. The regions indicated by the light receiving signal detection regions 65 to 67 are regions where the signal amount of the light receiving signal in the light emitting / receiving cell CWR at that position is larger than the threshold voltage Vt, and an object is detected at that position. It represents what has been done.

  Thus, as the light reception signal level of the threshold voltage is increased in the order of (A) → (B) → (C), the area of the region where the object is detected is centered on the position of the light emitting / receiving cell CWRij. You can see that it gets smaller. Thus, for example, the user can describe the object properties (size, surface condition (reflectance, color, roughness, etc.)), detection purpose (position detection, size detection, color detection, etc.) By arbitrarily changing the threshold voltage Vt depending on the accuracy or the like, it becomes possible to perform more accurate and convenient position detection.

[Modification 6]
Next, a sixth modification common to the first to third embodiments will be described. The reflected light when an object is in contact with or close to the object is large if the light emission amount in the light emitting cell CW is high, and is small if the light emission amount in the light emitting cell CW is low. Therefore, the signal amount of the light reception signal detected by the light reception cell CR varies depending on the amount of light emitted from the light emitting cell CW. Therefore, in this modification, in the first to third embodiments, the shift register 36 and the comparator 351 are arranged between the light reception signal receiver 32 and the light reception signal holding unit 33 and further output from the display signal control unit 22. A threshold voltage generation unit 37 that generates a threshold voltage Vt in the comparator 351 based on the displayed display signal 45 is arranged. That is, the threshold voltage generator 37 for generating the threshold voltage Vt is added to the image display device shown in FIG.

  FIG. 37 illustrates an overall configuration of an image display apparatus according to the sixth modification, and corresponds to FIG. 1 in the first embodiment. In this figure, the same components as those shown in FIGS. 1 and 34 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. The image display device includes a display unit 1, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a light emission side scanner 24, a light reception side scanner 31, a light reception signal receiver 32, A shift register 36, a comparator 351, a threshold voltage generation unit 37, a light reception signal holding unit 33, and a position detection unit 34 are provided.

  The threshold voltage generation unit 37 has a function of generating a threshold voltage Vt in the comparator 351 based on the display signal 45 in each pixel 11 output from the display signal control unit 22 and outputting the threshold voltage Vt to the comparator 351. Therefore, the comparator 351 can set the threshold voltage Vt corresponding to the light emitted from the light emitting cell CW in each pixel 11 for each pixel.

  FIG. 38 shows a process of detecting a detection target object in the image display apparatus of FIG. 37, and corresponds to FIG. 15 in the first embodiment and FIG. 33 in the fifth modification. Further, in this figure, as in FIG. 33, (D) a light emitting / receiving cell CWRi (CWRi1 to CWRin) for one vertical line, and (A) a data supply line DWi connected to each of these light emitting / receiving cells CWRi. (B) Light emitting gate line GW (GW1 to GWn) and (C) Light receiving gate line GR (GR1 to GRn), (E) Data read line DRi, (F) Threshold voltage signal Vt, (G) Each signal of the comparator output signal Vci is shown. Note that the basic operation of the driving method of the image display apparatus in the present modification is the same as the operation shown in FIG. 33, and therefore the description thereof is omitted, and only the operations relating to the threshold voltage generator 37 and the comparator 351 are described. To do.

The basic operation of the driving method of an image display apparatus in this modification is the same as the basic operation of the driving method of the modification 5 shown in FIG. 33 differs from the output from the display signal holding control section 22 as described above The threshold voltage Vt in the comparator 351 is generated based on the display signal 45 in each of the pixels 11. Therefore, in the fifth modification shown in FIG. 33, the threshold voltage Vt is a constant value, whereas in this modification, the threshold voltage signal Vt corresponds to (A) the data supply line DWi. It is a variable value. Of course, also in this case, if the signal amount of (E) the data read line DRi is larger than the predetermined (F) threshold voltage signal Vt, (G) the comparator output signal Vci becomes 1, conversely (E) the data read If the signal amount of the line DRi is smaller than the predetermined (F) threshold voltage signal Vt, (G) the comparator output signal Vci becomes zero. In this way, as in the case of the first embodiment shown in FIG. 15, the light receiving signal is obtained in the light receiving signal detection periods TF1 and TF2, so that the light emitting / receiving cells CWRi (j-1), CWRij, CWRi ( It can be detected that the detection target object 15 exists at a position near j + 1).

  As described above, according to the image display device and the driving method of the image display device in the present modification, the threshold voltage generation unit 37 is further added to the image display device shown in FIG. The threshold voltage Vt of the comparator 351 is changed in accordance with the display signal of each pixel so that the threshold voltage is increased if the threshold is high, and the threshold voltage is decreased if the amount of light emission is low. In addition to the effects of the image display device shown in FIG. 34, it is possible to more accurately detect the position of an object that is in contact with or close to it.

[Modification 7]
Next, a seventh modification common to the first to third embodiments will be described. The surface of the display unit 1 of the image display device is irradiated with ambient light in addition to the reflected light from an object in contact with or in close proximity. Therefore, in this modification, in the first to third embodiments, the comparator 35 is disposed between the light reception signal receiver 32 and the light reception signal holding unit 33, and the light reception signal VR output from the light reception signal receiver 32. The threshold voltage generator 371 for generating the threshold voltage Vt in the comparator 35 based on the above is arranged. That is, the threshold voltage generation unit 371 is added to the modification 5 shown in FIG. 32, and thereby, the process of removing the influence of ambient light is performed when the light receiving signal is detected by the light receiving element. It is a thing.

  FIG. 39 illustrates an overall configuration of an image display apparatus according to the modification example 7, and corresponds to FIG. 1 in the first embodiment. In this figure, the same components as those shown in FIGS. 1 and 32 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. The image display device includes a display unit 1, a display signal generation unit 21, a display signal holding control unit 22, a display signal driver 23, a light emission side scanner 24, a light reception side scanner 31, a light reception signal receiver 32, A comparator 35, a threshold voltage generation unit 371, a light reception signal holding unit 33, and a position detection unit 34 are provided.

  The threshold voltage generation unit 371 generates a threshold voltage Vt in the comparator 35 based on the light reception signal VR in each pixel 11 for one horizontal line output from the light reception signal receiver 32 and outputs the threshold voltage Vt to the comparator 35. Have Therefore, the comparator 35 can set the threshold voltage Vt corresponding to the reflected light to the light receiving cell CR in each pixel 11 for each pixel.

The comparator 35 has a function of performing A / D conversion by comparing the light reception signal output from the light reception signal receiver 32 with the threshold voltage signal Vt output from the threshold voltage generation unit 371. Further, the data (comparator output signal Vc) converted into the digital data is output to the received light signal holding unit 33.

  FIG. 40 shows an example of a process for removing the influence of ambient light in the image display apparatus of FIG. 39, and includes processes (A) to (D). Here, one square shown in FIG. 40 represents the pixel 11 in the display unit 1 as in FIGS.

  First, in FIG. 14A, the entire display unit 1 is a black display region 53 in advance, and light emission from the light emitting cell CW has the lowest luminance. Accordingly, the light contact from the light emitting cell CW or the reflected light from an adjacent object is hardly detected in the light receiving cell CR. Further, while performing a series of processes for removing the influence of the ambient light, do not place an object to be reflected in the vicinity of the image display device and detect it in the light receiving cell CR. It is necessary to use only ambient light. Here, for example, one horizontal line at the position indicated by the arrow P2 performs the line-sequential light emission operation and the line-sequential light reception operation in the scanning direction X as described above.

  Next, the line sequential light emitting operation and the line sequential light receiving operation are performed in the same manner for one screen of the display unit 1 as shown by one horizontal line at the positions indicated by arrows P3 and P4 in FIGS. . At this time, the light reception signal detected in each light reception cell CR is output to the light reception signal receiver 32, and the light reception signal receiver outputs the light reception signal VR for one horizontal line to the threshold voltage generation unit 371. As described above, the threshold voltage generation unit 371 generates the threshold voltage Vt in the comparator 35 based on the light reception signal VR and outputs the threshold voltage Vt to the comparator 35.

  When the ambient light detection process for one screen is completed, a normal display operation is started on one horizontal line at the position indicated by the arrow P2 in FIG. As 54 spreads, the comparator 35 uses the threshold voltage Vt generated in consideration of the light reception signal VR by the ambient light obtained in (A) to (C), and the A of the light reception signal in each pixel 11. Since the / D conversion is performed, the influence of ambient light can be removed.

  FIG. 41 shows processing for removing the influence of ambient light, and corresponds to FIG. 15 in the first embodiment and FIG. 33 in the fifth modification. Further, in this figure, as in FIG. 33, (D) a light emitting / receiving cell CWRi (CWRi1 to CWRin) for one vertical line, and (A) a data supply line DWi connected to each of these light emitting / receiving cells CWRi. (B) Light emitting gate line GW (GW1 to GWn) and (C) Light receiving gate line GR (GR1 to GRn), (E) Data read line DRi, (F) Threshold voltage signal Vt, (G) Each signal of the comparator output signal Vci is shown. Note that the basic operation of the driving method of the image display apparatus in the present modification is the same as the operation shown in FIG. To do.

  First, as described above, in the vertical period TH1, the entire display unit 1 is the black display region 53, and (A) the signal amount on the data supply line DWi is the smallest value. Accordingly, the light reception signal output from the data read line DRi at the timings t4 to t7 is considered to be due to ambient light. Next, in the vertical period TH2, the threshold voltage Vt is set by the amount of the light reception signal due to the ambient light detected in the vertical period TH1 at the timings t8 to t9 corresponding to the timings t4 to t7 in the vertical period TH1. It is supposed to be added. In this way, the threshold value is set in consideration of the influence of ambient light.

  As described above, according to the image display device and the driving method of the image display device in the present modification, the threshold voltage generation unit 371 is further added in the modification 5 shown in FIG. Since the process of removing the influence of the ambient light is performed when detecting the light reception signal, in addition to the effect of the modified example 5, by detecting the influence of the ambient light in consideration, it is possible to detect the object that is in contact with or close to it. The position can be detected more accurately.

  In this modification, the original threshold voltage Vt has been described as an example having a constant value, but the threshold voltage Vt is generated based on the display signal 45 as in the examples of FIGS. The present invention can also be applied to the case where the value is a variable value. In this case, the threshold voltage Vt is generated based on both the display signal 45 and the light reception signal VR.

[Modification 8]
Next, a modification 8 common to the first to third embodiments will be described. In this modification, a plurality of verification objects that are simultaneously arranged at arbitrary positions in the image display device are detected, and the verification objects are also detected at arbitrarily moving positions.

  FIG. 42 illustrates an overall configuration of an image display apparatus according to the modification example 8, and corresponds to FIG. 1 in the first embodiment. In this figure, the same components as those shown in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. This image display device includes a display unit 1, a display signal generation unit 215, a display signal holding control unit 225, a display signal driver 235, a light emission side scanner 245, a light reception side scanner 315, a light reception signal receiver 32, A light reception signal holding unit 33 and a position detection unit 34 are provided.

  Here, the basic operations of the display signal generation unit 215, the display signal holding control unit 225, the display signal driver 235, the light emitting side scanner 245, and the light receiving side scanner 315 are the display signal generating unit 21 and the display signal holding control unit in FIG. 22, the display signal driver 23, the light emitting side scanner 24, and the light receiving side scanner 31 are the same as those in FIG.

  The display signal generation unit 215 further includes a function of synthesizing a display signal by replacing a part of the input image data with mark data for displaying a predetermined mark as will be described later. The signal driver 235, the light emitting side scanner 245, and the light receiving side scanner 315 receive the light emitted from the light emitting cell CW according to the mark data by the light receiving cell CR in the issuing light receiving cell CWR corresponding to the position of the light emitting cell CW. The light reception signal is detected. In this way, it is possible to detect an object that is in contact with or close to the area where a predetermined mark is displayed.

  FIG. 43 shows a case where a plurality of verification objects that are simultaneously arranged at arbitrary positions are detected in the image display apparatus of FIG. Further, in this figure, arbitrary image data is displayed and a plurality of predetermined marks 71 to 74 are simultaneously displayed on the display unit 1 provided in the image display device 7 corresponding to the image display device shown in FIG. Represents the situation.

  In this modification, the light emitted from the light emitting cell CW in the display unit 1 is used as a light source for detecting reflected light. Therefore, it is possible to detect contact from an arbitrary position of the display unit 1 or reflected light of an adjacent object. For example, if a button-like image including predetermined marks 71 to 74 is displayed at an arbitrary position on the display unit 1 and the reflected light of the object is detected from this region, the same effect as that of the touch panel can be obtained. it can. Further, in this modification, the position of the object is detected by the light reception signal reconstructed in the light reception signal holding unit 33, so that it is possible to detect a plurality of positions arranged at the same time. Thus, the user can detect a plurality of contacts or objects that are simultaneously arranged at arbitrary positions in the image display apparatus.

  FIG. 44 further shows a case where a predetermined mark moves in the image display apparatus of FIG. 42, and corresponds to the image display apparatus 7 shown in FIG. This figure shows a state in which the mark 74 moves as indicated by an arrow 741 among a plurality of predetermined marks 71 to 74 displayed on the image display device 7 shown in FIG. Moreover, in this figure, the same code | symbol is attached | subjected to the component same as the component shown in FIG. 43, and description is abbreviate | omitted suitably.

  In the present modification, the display signal generation unit 215 has a function of synthesizing a display signal by replacing a part of input image data with mark data for displaying a predetermined mark as described above. Here, when the input image data is moving image data including a plurality of frames, the display signal generation unit 215 marks a part of the input image data at different positions for each frame according to the moving image data. If it is replaced with data, for example, the button-like part is moved as shown in FIG. 44, the button-like part is displayed in the moving picture part, or the button-like part is displayed as necessary. Can be displayed or deleted.

  Accordingly, the user can detect an object that is in contact with or close to the object even at a position where the image display device arbitrarily moves. In addition, since what kind of image is displayed is determined by the display signal generation unit 215, when a button image including a predetermined mark is not displayed, data obtained as a result of position detection is used. If this is not done, erroneous detection can be prevented.

1 is a block diagram illustrating an overall configuration of an image display device according to a first embodiment of the present invention. It is a block diagram showing an example of a structure of the display part in FIG. FIG. 2 is a plan view schematically illustrating an example of an arrangement configuration of light emitting cells and light receiving cells in the display unit of FIG. 1. FIG. 2 is a plan view schematically illustrating an example of an arrangement configuration of light emitting cells and light receiving cells in the display unit of FIG. 1. FIG. 2 is a plan view schematically illustrating an example of an arrangement configuration of light emitting cells and light receiving cells in the display unit of FIG. 1. FIG. 2 is a plan view schematically illustrating an example of an arrangement configuration of light emitting cells and light receiving cells in the display unit of FIG. 1. It is sectional drawing which represents typically an example of the arrangement configuration of the light emitting cell and light receiving cell in the display part of FIG. It is sectional drawing which represents typically an example of the arrangement configuration of the light emitting cell and light receiving cell in the display part of FIG. It is sectional drawing which represents typically an example of the arrangement configuration of the light emitting cell and light receiving cell in the display part of FIG. FIG. 3 is a circuit diagram illustrating a configuration of a light emitting / receiving cell in FIG. 2. FIG. 2 is a schematic diagram illustrating an example of processing for detecting a detection target object in the image display apparatus of FIG. 1. It is a figure showing an example of the line sequential light emission operation | movement in the image display apparatus of FIG. It is a figure showing an example of the line sequential light emission operation | movement in the image display apparatus of FIG. It is a figure showing an example of the line sequential light emission operation | movement and line sequential light reception operation | movement in the image display apparatus of FIG. FIG. 2 is a timing diagram of processing for detecting a detection target object in the image display apparatus of FIG. 1. 10 is a block diagram illustrating an overall configuration of an image display device according to Modification Example 1. FIG. FIG. 17 is a timing diagram of processing for detecting a detection target object in the image display device of FIG. 16. FIG. 10 is a block diagram illustrating an overall configuration of an image display device according to Modification 2. FIG. 19 is a timing diagram of processing for detecting a detection target object in the image display device of FIG. 18. FIG. 10 is a block diagram illustrating an overall configuration of an image display device according to Modification 3. FIG. 21 is a timing diagram of processing for detecting a detection target object in the image display apparatus of FIG. 20. It is a block diagram showing the whole structure of the image display apparatus which concerns on the modification 4. FIG. 23 is a timing diagram of processing for detecting a detection target object in the image display device of FIG. 22. It is a block diagram showing the whole structure of the image display apparatus which concerns on the 2nd Embodiment of this invention. FIG. 25 is a block diagram illustrating an example of a configuration of a display unit in FIG. 24. FIG. 26 is a circuit diagram illustrating a configuration of a light emitting / receiving cell of FIG. 25. FIG. 25 is a timing diagram of processing for detecting a detection target object in the image display apparatus of FIG. 24. It is a block diagram showing the whole structure of the image display apparatus which concerns on the 3rd Embodiment of this invention. It is a block diagram showing an example of a structure of the display part in FIG. FIG. 30 is a circuit diagram illustrating a configuration of a light emitting and receiving cell in FIG. 29. FIG. 29 is a timing diagram of processing for detecting a detection target object in the image display device of FIG. 28. 10 is a block diagram illustrating an overall configuration of an image display device according to Modification Example 5. FIG. FIG. 33 is a timing diagram of processing for detecting a detection target object in the image display device of FIG. 32. FIG. 10 is a block diagram illustrating another example of the overall configuration of an image display device according to Modification Example 5. It is a distribution figure showing an example of the amount of signals of a received light signal. FIG. 36 is a schematic diagram when the threshold value is changed in the distribution of the signal amount of the received light signal in FIG. 35. FIG. 10 is a block diagram illustrating an overall configuration of an image display device according to Modification 6. FIG. 38 is a timing diagram of processing for detecting a detection target object in the image display device of FIG. 37. FIG. 10 is a block diagram illustrating an example of an overall configuration of an image display device according to Modification Example 7. It is a schematic diagram showing an example of the process which removes the influence of environmental light in the image display apparatus of FIG. It is a timing diagram of the process which removes the influence of environmental light. It is a block diagram showing the example of whole structure of the image display apparatus which concerns on the modification 8. FIG. 43 is a schematic diagram in the case of detecting a plurality of verification objects simultaneously arranged at arbitrary positions in the image display device of FIG. 42. FIG. 43 is a schematic diagram when a predetermined mark moves in the image display apparatus of FIG. 42.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1,102,103,104,105,106 ... Display part, 11 ... Pixel, 12 ... Transparent substrate, 13 ... Partition, 14 ... Shielding layer, 15 ... Detection target object, 21,215 ... Display signal generation part, 22, 225 ... Display signal holding control unit, 23, 235 ... Display signal driver, 24, 245 ... Light emission side scanner, 25 ... Common scanner, 31, 311, 312, 313, 314, 315 ... Light reception side scanner, 32, 322, 323 , 324 ... Light reception signal receiver, 33, 332, 333, 334 ... Light reception signal holding unit, 34 ... Position detection unit, 35, 351 ... Comparator, 36 ... Shift register, 37, 371 ... Threshold voltage generation unit, 41 ... Light emission timing control signal 42... Light reception timing control signal 43. Light reception block control signal 44. Common timing control signal 45. Display signal 5 ... light emitting area, 52 ... non-light emitting area, 53 ... black display area, 54 ... normal display area, 61-64 ... light reception signal detection level, 65-67 ... light reception signal detection area, 7 ... image display device, 71-74 ... Mark, 741 ... Mark movement status, CWR ... Light emitting / receiving cell, CW ... Light emitting cell, CR ... Light receiving cell, GW ... Light emitting gate line, GR ... Light receiving gate line, DW ... Data supply line, DR ... Data readout line , G: common gate line, D: shared data line, LB: backlight, LT, LT1, LT2 ... transmitted light, LR1, LR2 ... reflected light, CL ... light emitting element, PD ... light receiving element, SW1 ... light emitting element selection Switch, SW2 ... Light receiving element selection switch, SW3 ... Changeover switch, I1, I3, I5 ... Display signal current path, I2, I4, I6 ... Light reception signal current path, X ... Scan direction, P1 to P4 ... Scan Line position, TH1, TH2 ... vertical period, TRW ... light emission / light reception period, TW ... light emission period, TR ... light reception period, TF1, TF2 ... light reception signal detection period, t1-t9 ... timing, Vt ... threshold voltage signal , Vc: comparator output signal, VR: light reception signal.

Claims (27)

A plurality of light emitting elements;
A plurality of light receiving elements;
Light emission driving means for driving the light emitting element based on image data;
A light receiving drive means for driving the light receiving element so as to receive the light emitted from the light emitting element emitting light based on the image data and reflected by the detection target object;
Detection means for detecting the detection target object based on a light reception signal obtained from the light receiving element;
Image synthesizing means for synthesizing the image data by replacing a part of the input image data with mark data for displaying predetermined marks at a plurality of positions;
The light emission driving unit and the light receiving driving unit are configured to receive light emitted from a light emitting element driven according to the mark data of the image data by a light receiving element at a position corresponding to the light emitting element. Driving the light emitting element and the light receiving element;
The detection means is a mark at any position among the marks displayed at a plurality of positions based on a light reception signal obtained from the light receiving element that has received light emitted from a light emitting element driven according to the mark data. An image display device that detects whether the detection target object has approached. The input image data is moving image data composed of a plurality of frames,
The image display device according to claim 1, wherein the image composition unit replaces a part of the input image data with the mark data for each frame. The image display device according to claim 2, wherein the image synthesizing unit replaces a part of the input image data with the mark data at positions different from each other in each frame. The image display device according to claim 3, wherein the image synthesizing unit replaces a part of the input image data with the mark data at positions different from each other in accordance with contents of the input image data. The image display device according to claim 1, wherein the detection unit detects at least one of a position and a size of a detection target object based on the light reception signal. The image display device according to claim 1, wherein the detection unit detects a plurality of detection target objects arranged simultaneously based on the light reception signal. The image display apparatus according to claim 1, wherein the detection unit detects a detection target object by setting a threshold value according to the content of an image being displayed and comparing the light reception signal with the threshold value. . The detection means sets a threshold value according to the property of the detection target object or the purpose or accuracy of the detection, and detects the detection target object by comparing the light reception signal with the threshold value. 2. The image display device according to 1. The detection means obtains the intensity of ambient light existing in the surroundings based on a light reception signal obtained from the light receiving element when black display is performed in a state where the detection target object is not approaching the light receiving element. The image display apparatus according to claim 1, wherein the detection target object is detected in consideration of the influence of light. The plurality of light emitting elements and the plurality of light receiving elements are each arranged in a matrix,
The light emission driving means drives the plurality of light emitting elements in a line sequential manner,
The image display device according to claim 1, wherein the light receiving drive unit drives the plurality of light receiving elements in a line sequential manner in synchronization with a line sequential light emitting operation of the plurality of light emitting elements. The image display apparatus according to claim 1, wherein the light emitting element is a liquid crystal element. The image display device according to claim 11, wherein the light receiving element is separated from the liquid crystal element by a partition wall. The liquid crystal element has a pair of transparent substrates facing each other, and a liquid crystal layer provided between the pair of transparent substrates,
The image display device according to claim 11, wherein the light receiving element is provided inside the liquid crystal layer. The image display device according to claim 13, wherein the light receiving element is provided on a transparent substrate on a side from which display light is emitted, of the pair of transparent substrates. A backlight source used to transmit display light through the liquid crystal element;
The liquid crystal element has a pair of transparent substrates facing each other, and a liquid crystal layer provided between the pair of transparent substrates,
The image display apparatus according to claim 11, wherein a light-blocking body is provided between the light receiving element and the transparent substrate on the side where the backlight light source is provided. The image display apparatus according to claim 1, wherein each light emitting element and each light receiving element are arranged in a one-to-one relationship, and the pair of light emitting elements and light receiving elements constitute one light emitting and receiving cell. The light emission driving unit and the light receiving driving unit drive each light emitting element and each light receiving element so that the light emitting element and the light receiving element of each light emitting and receiving cell operate in a one-to-one relationship. Image display device. The light emission driving means and the light receiving drive means drive each light emitting element and each light receiving element so that the light receiving element of one light emitting / receiving cell performs light receiving driving for driving of the light emitting elements of the plurality of light emitting / receiving cells The image display device according to claim 16. In one light emitting / receiving cell, a light emitting gate line for selecting a light emitting element to be driven, a light receiving gate line for selecting a light receiving element to be driven, and supplying the image data to the light emitting element The image display apparatus according to claim 16, wherein one data supply line is connected to one data read line for reading the light reception signal from the light receiving element. For each light emitting / receiving cell,
A light emitting element selection switch that selectively conducts between the data supply line and the light emitting element in accordance with a light emission selection signal supplied from the light emission gate line;
A light receiving element selection switch for selectively conducting between the light receiving element and the data read line in accordance with a light receiving selection signal supplied from the light receiving gate;
The image display device according to claim 19, wherein the light emission drive unit and the light reception drive unit operate the light emitting element selection switch and the light reception element selection switch at timings independent of each other. One light emitting and receiving cell, one common gate line for selecting a light emitting element to be driven and a light receiving element, one data supply line for supplying the image data to the light emitting element, and the light receiving The image display device according to claim 16, wherein one data read line for reading the light reception signal from an element is connected. For each light emitting / receiving cell,
A light emitting element selection switch for selectively conducting between the data supply line and the light emitting element in response to a selection signal supplied from the common gate line;
A light receiving element selection switch for selectively conducting between the light receiving element and the data read line in response to a selection signal supplied from the common gate;
The image display device according to claim 21, wherein the light emission drive unit and the light reception drive unit operate the light emitting element selection switch and the light reception element selection switch at the same timing. One light emitting / receiving cell for supplying one common gate line for selecting a light emitting element and a light receiving element to be driven, and supplying the image data to the light emitting element and reading the light receiving signal from the light receiving element The image display apparatus according to claim 16, wherein one shared data line is connected. For each light emitting / receiving cell,
A changeover switch for switching whether to use the shared data line for data supply or data reading in accordance with a selection signal supplied from the common gate line;
A light emitting element selection switch for selectively conducting between the shared data line and the light receiving element according to a selection signal supplied from the common gate;
A light receiving element selection switch for selectively conducting between the light receiving element and the shared data line according to a selection signal supplied from the common gate;
The image display device according to claim 23, wherein the light emission driving unit and the light receiving driving unit operate the changeover switch, the light emitting element selection switch, and the light receiving element selection switch at the same timing. One or a plurality of light receiving elements are arranged corresponding to the plurality of light emitting elements,
The light emission driving unit and the light receiving driving unit reflect display light obtained by driving the light emitting element by the object to be detected and received by the one or more light receiving elements to generate one light reception signal. The image display apparatus according to claim 1, wherein each light emitting element and each light receiving element are driven so that A plurality of light receiving elements are arranged corresponding to one light emitting element,
The light emission drive means and the light reception drive means reflect the display light obtained by driving the one light emitting element by the object to be detected and receive the light by the plurality of light receiving elements to generate a plurality of light receiving signals. The image display apparatus according to claim 1, wherein each light emitting element and each light receiving element are driven so as to be different. A method for driving an image display device, comprising:
Arranging a plurality of light emitting elements and a plurality of light receiving elements,
Driving the light emitting element based on image data;
Driving the light receiving element to receive the light emitted from the light emitting element emitting light based on the image data and reflected by the detection target object;
Based on the light reception signal obtained from the light receiving element, detects the detection target object,
The image data is synthesized by replacing a part of the input image data with mark data for displaying predetermined marks at a plurality of positions,
Driving the light emitting element and the light receiving element so that the light emitted from the light emitting element driven according to the mark data of the image data is received by the light receiving element at a position corresponding to the light emitting element,
Based on a light reception signal obtained from the light receiving element that receives light emitted from a light emitting element driven in accordance with the mark data, the detection target object is placed at any one of the marks displayed at a plurality of positions. A method for driving an image display device that detects whether or not an object approaches.

Images