JP4831415B2 - Display device, light receiving method, and information processing device - Google Patents

Description

  The present invention relates to a display device, a light receiving method, and an information processing device, and more particularly to a display device, a light receiving method, and an information processing device that can improve the S / N ratio of a light reception signal with a simple configuration. .

  There has been proposed a display device in which a display circuit and a light receiving circuit are arranged on the same substrate to display an image and receive light from the outside (see, for example, Patent Documents 1 and 2). The light receiving circuit of the display device reflects light emitted from an object having an external light source such as an LED (Light Emitting Diode) (for example, a pen) or light from the backlight by a finger or pen touching the screen. Detects light that returns. In Patent Document 2, the present applicant proposes a method for driving a light receiving circuit in a case where light from a backlight is reflected by a finger or pen touching the screen and returned.

  Patent Documents 1 and 2 are technologies related to a liquid crystal display device of a type in which a display circuit controls liquid crystal. A display device that displays and receives light using an organic EL (Electroluminescence) element that is a self-luminous element. (For example, see Patent Documents 3 and 4).

JP 2000-19478 A JP 2006-127212 A JP 2004-127272 A JP 2005-293374 A

  In a display device in which the display circuit and the light receiving circuit are arranged on the same substrate as described above, if the S / N ratio of the light receiving signal output from the light receiving circuit is to be increased, it is necessary to increase the sensor size of the light receiving sensor. However, it is difficult to simply increase the sensor size of the light receiving sensor due to physical restrictions for maintaining display performance such as securing an opening.

  The present invention has been made in view of such a situation, and is intended to improve the S / N ratio of a received light signal with a simple configuration.

The display device according to the present invention includes a subpixel that emits a color of R, G, or B, and a light receiving region that is provided in a region different from the subpixel and includes at least a light receiving sensor. A display panel having pixels as display resolution units arranged in a matrix is provided, and the light receiving area of the pixel includes a reset element for resetting a light receiving signal obtained by the light receiving sensor and the light receiving sensor. Or a second light receiving circuit configured by the light receiving sensor and an output element for outputting the light receiving signal to the outside of the pixel, and In the display panel, a first pixel in which the first light receiving circuit is disposed in the light receiving region, and a second pixel in which the second light receiving circuit is disposed in the light receiving region. Adjacently and Kuseru, wherein the light receiving sensor each other of the first pixel second pixel are connected in parallel on the same substrate, a single light receiving signal obtained from the connected plurality of the light receiving sensor has been the output element of the second pixel is output.

The display panel also includes a third pixel in which a third light receiving circuit having the light receiving sensor in the light receiving region of the pixel and having neither the reset element nor the output element is disposed. One light receiving sensor of the first pixel and the second pixel and one or more of the third pixels are connected in parallel on the substrate, and the plurality of light receiving sensors connected to each other Can be output by the output element of the second pixel .

The one received light signal is output from four pixels including one of the first pixel, the second pixel, and two of the third pixels, and the four pixels are Two pieces can be arranged in the horizontal direction and in the vertical direction .

The first light receiving circuit of the first pixel and the second light receiving circuit of the second pixel may be adjacent to each other in the horizontal direction .

The light receiving method of the present invention includes a subpixel that emits a color of R, G, or B, and a light receiving region that is provided in a region different from the subpixel and includes at least a light receiving sensor. A display panel having pixels as display resolution units arranged in a matrix is provided, and the light receiving area of the pixel includes a reset element for resetting a light receiving signal obtained by the light receiving sensor and the light receiving sensor. Or a second light receiving circuit configured by an output element for outputting the light receiving signal to the outside of the pixel and the light receiving sensor, and the display panel The first pixel in which the first light receiving circuit is disposed in the light receiving region and the second pixel in which the second light receiving circuit is disposed in the light receiving region. DOO are adjacent, in the light-receiving method of the first pixel and the display light sensors each other are connected in parallel on the same board device of the second pixel, said output element of the second pixel The light receiving signals obtained by receiving the light from the light receiving sensors of the first light receiving circuit and the second light receiving circuit are output as one light receiving signal .

In the display device and the light receiving method of the present invention, the light receiving signal obtained by receiving the light from the output element of the second pixel by the light receiving sensors of the first light receiving circuit and the second light receiving circuit is used as one light receiving signal. Is output .

The information processing apparatus of the present invention is an image composed of subpixels that emit R, G, or B colors, and a light receiving region that is provided in a region different from the subpixels and includes at least a light receiving sensor. Input information analyzing means for analyzing input information input by a user using a display panel in which pixels as a unit of display resolution are arranged in a matrix and a received light image generated from a received light signal output from the received light sensor And a control means for performing a predetermined control process in response to a message supplied from the input information analysis means, and resets a light reception signal obtained by the light reception sensor in the light reception area of the pixel. A first light receiving circuit constituted by the reset element and the light receiving sensor, or an output element for outputting the light receiving signal to the outside of the pixel and the front One of the second light receiving circuits composed of a light receiving sensor is disposed, and in the display panel, the first pixel in which the first light receiving circuit is disposed in the light receiving region, and the light receiving region The second pixel in which the second light receiving circuit is arranged is adjacent to each other, and the light receiving sensors of the first pixel and the second pixel are connected in parallel on the same substrate, and the connection one light receiving signals obtained from a plurality of light receiving sensors, the output element of the second pixel is output.

In the information processing apparatus of the present invention , an image composed of a subpixel that emits light of R, G, or B and a light receiving region that is provided in a region different from the subpixel and includes at least a light receiving sensor. In a display panel in which pixels as a unit of display resolution are arranged in a matrix , input information input by the user is analyzed, analyzed and supplied using a received light image generated from a received light signal output from the received light sensor Predetermined control processing is performed in response to the message. In the light receiving area of the pixel, a first light receiving circuit configured by a reset element and a light receiving sensor for resetting a light receiving signal obtained by the light receiving sensor, or an output for outputting the light receiving signal to the outside of the pixel One of the second light receiving circuits composed of the element and the light receiving sensor is arranged. In the display panel, the first pixel in which the first light receiving circuit is arranged in the light receiving region and the first pixel in the light receiving region. A second pixel in which two light receiving circuits are arranged adjacent to each other, the light receiving sensors of the first pixel and the second pixel are connected in parallel on the same substrate, and the plurality of light receiving sensors connected to each other Is received from the output element of the second pixel .

  In the present invention, the S / N ratio of the received light signal can be improved with a simple configuration.

  Embodiments of the present invention will be described below. Correspondences between the constituent elements of the present invention and the embodiments described in the specification or the drawings are exemplified as follows. This description is intended to confirm that the embodiments supporting the present invention are described in the specification or the drawings. Therefore, even if there is an embodiment which is described in the specification or the drawings but is not described here as an embodiment corresponding to the constituent elements of the present invention, that is not the case. It does not mean that the form does not correspond to the constituent requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. Not something to do.

The display device of the present invention includes a sub-pixel that emits R, G, or B light and a light-receiving sensor (for example, the sensor SSR in FIG. 8) provided in a different area from the sub-pixel. A display panel (for example, the pixel shown in FIG. 1) in which pixels (for example, the pixel Pix in FIG. 10), which are composed of regions (for example, the light receiving region 71 in FIG. 10), are arranged in a matrix. A display panel 25), and the light receiving region of the pixel includes a reset element (for example, switching element SW2 in FIG. 8) for resetting a light receiving signal obtained by the light receiving sensor and the light receiving sensor. A first light receiving circuit (for example, the light receiving circuit 101a in FIG. 8) or an output element (for example, a switch in FIG. 8) for outputting the light receiving signal to the outside of the pixel. One of the second light receiving circuits (for example, the light receiving circuit 101c in FIG. 8) configured by the light receiving sensor and the light receiving sensor is disposed, and the first light receiving region is disposed in the light receiving region in the display panel. A first pixel in which a light receiving circuit is disposed and a second pixel in which the second light receiving circuit is disposed in the light receiving region are adjacent to each other, and the first pixel and the second pixel are receiving sensor each other are connected in parallel on the same substrate, a single light receiving signal obtained from the connected plurality of the light receiving sensor has, the output element of the second pixel is output.

The information processing apparatus according to the present invention (for example, the information processing apparatus 1 in FIG. 1) includes a subpixel that emits R, G, or B light, and a light receiving sensor provided in a region different from the subpixel. Generated from a display panel (for example, display panel 25 in FIG. 1) in which pixels as a unit of display resolution of an image composed of at least a light-receiving region are arranged in a matrix and a light-receiving signal output from the light-receiving sensor In response to a message supplied from the input information analysis means (for example, the input information analysis unit 27 in FIG. 1) for analyzing the input information input by the user using the received light image, control means for performing predetermined control processing (e.g., control unit 11 of FIG. 1) and a, in the light receiving region of the pixel, for resetting the light reception signals obtained by the light receiving sensor A first light receiving circuit constituted by a set element and the light receiving sensor, or a second light receiving circuit constituted by an output element for outputting the light receiving signal to the outside of the pixel and the light receiving sensor. In the display panel, a first pixel in which the first light receiving circuit is disposed in the light receiving region, and a second pixel in which the second light receiving circuit is disposed in the light receiving region. Two pixels are adjacent to each other, and the light receiving sensors of the first pixel and the second pixel are connected in parallel on the same substrate, and one light reception obtained from the plurality of the light receiving sensors connected thereto. A signal is output by the output element of the second pixel .

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a configuration example of an embodiment of an information processing apparatus to which the present invention is applied.

  The information processing apparatus 1 in FIG. 1 includes at least a display device that displays predetermined information as an image, and performs predetermined information processing such as call processing, imaging processing, and data transmission / reception processing, a mobile phone, a digital still camera, or And PDA (Personal Digital Assistant). In the information processing apparatus 1, it is possible to input predetermined information by instructing the screen of the display device with a finger or a pen.

  The information processing apparatus 1 includes a control unit 11, a ROM 12, a communication unit 13, a display processing unit 14, and the like. The display processing unit 14 corresponds to the above-described display device, and includes an image signal generation unit 21, a controller 22, a gate driver 23, a source driver 24, a display panel 25, a received light signal processing unit 26, an input information analysis unit 27, and a storage unit. 28.

  The control unit 11 controls the overall operation of the information processing apparatus 1 based on a control program stored in a ROM (Read Only Memory) 12. For example, the control unit 11 supplies display data to be displayed on the display panel 25 to the image signal generation unit 21 based on a command from another module (not shown) or data received by the communication unit 13. In addition, as will be described later, the control unit 11 updates display data supplied to the image signal generation unit 21 in response to a message supplied from the input information analysis unit 27, or updates the display data to the communication unit 13 or other modules. Also provide data.

  Here, the other module is, for example, a module that executes a call function if the information processing apparatus 1 is a mobile phone, or a module that executes an imaging function if the information processing apparatus 1 is a digital still camera. is there. The communication unit 13 communicates with various devices via a network such as the Internet by wire or wireless, and supplies the acquired data to the control unit 11. Note that the communication unit 13 can be omitted when the information processing apparatus 1 does not require communication with the outside.

  The image signal generation unit 21 generates an image signal for displaying an image corresponding to the display data supplied from the control unit 11, and outputs the generated image signal to the controller 22 that controls driving of the display panel 25. .

  The controller 22 interlocks with the driving of the gate driver 23 for controlling on (conducting) or off (non-conducting) of the switching element disposed in each pixel of the display panel 25, and the image signal The driving of the source driver 24 that supplies a voltage signal corresponding to (hereinafter referred to as a display signal) to each pixel is controlled.

  The display panel 25 is, for example, an LCD (Liquid Crystal Display) in which m pixels in the horizontal direction and n pixels in the vertical direction are arranged in a matrix, and light from a backlight (not shown) The predetermined information is displayed as an image by changing the transmittance of the liquid crystal in the liquid crystal layer. The display panel 25 has a built-in light receiving sensor, and the light from the backlight receives the return light that has returned by being reflected by a finger or pen that is in contact with or close to the uppermost surface of the display panel 25. Then, the light reception signal obtained as a result is supplied to the light reception signal processing unit 26. Therefore, the display panel 25 is provided with a display circuit for displaying an image and a light receiving circuit for detecting light as input information.

  One pixel as a unit of display resolution (image display unit) is composed of three pixels of R (Red), G (Green), and B (Blue). Strictly speaking, the total number of pixels is 3m × n. Hereinafter, a pixel as a unit of display resolution composed of three pixels of R, G, and B is referred to as a pixel, and each of R, G, and B pixels that constitute the pixel is referred to as a sub-pixel.

  The light reception signal processing unit 26 performs predetermined amplification processing, filter processing, image processing, or the like on the light reception signal supplied from the display panel 25, and the processed light reception signal is input to the input information analysis unit 27. Supply.

  The input information analysis unit 27 analyzes the information input by the user by analyzing the position (contact position) on the screen instructed by a finger or a pen using the received light image generated from the received light signal, The analysis result is supplied to the control unit 11 as a message. For example, if the light reception signal of the Nth frame is supplied from the light reception signal processing unit 26, the input information analysis unit 27 stores the light reception image generated from the light reception signal of the Nth frame in the storage unit 28. Compared with the received light image of the previous frame (N-1 frame), the difference between both received light images is calculated. Then, the input information analysis unit 27 analyzes the movement of the contact position from the previous frame based on the calculated difference. When there are a plurality of contact positions, the plurality of contact positions are analyzed. Further, the input information analysis unit 27 collates with the information on the change of the contact position from before the predetermined frame period stored in the storage unit 28 and determines a message related to the detection of the contact position supplied to the control unit 11.

  Next, the arrangement of the display circuit and the light receiving circuit provided in the display panel 25 will be described. Before that, the basic pattern of the arrangement of the display circuit and the light receiving circuit, the number of the light receiving circuits is a subpixel or a pixel. An example of arrangement that matches the number, that is, an example in which the light receiving circuits are arranged in one-to-one correspondence with subpixels or pixels will be described with reference to FIGS. However, the arrangement of the basic patterns described with reference to FIGS. 2 to 7 is not the arrangement of the light receiving circuits of the display panel 25. In the description of FIG. 2 to FIG. 7, each block of the information processing apparatus 1 will be described by appropriately quoting.

  FIG. 2 shows an arrangement example of the display circuit and the light receiving circuit in the pixel when the light receiving circuit is arranged one-to-one with the sub-pixel.

  As shown in FIG. 2, the pixel Pix is configured by arranging R, G, and B subpixels SubPix in the horizontal direction. In each R, G, or B subpixel SubPix, a display circuit 41 is arranged on the upper side in the figure, and a light receiving circuit 42 is arranged on the lower side in the figure. The display circuit 41 and the light receiving circuit 42 are formed on the same substrate (glass substrate).

  A display signal line 51 is connected to the display circuit 41 of each subpixel SubPix, and a display signal is supplied from the source driver 24 through the display signal line 51. The display circuits 41 of the R, G, and B subpixels SubPix are also connected to the same display selection line 52 extending in the horizontal direction. A display selection signal is supplied from the gate driver 23 to the display circuit 41 of the R, G, and B subpixels SubPix via the display selection line 52. The display circuit 41 controls light from the backlight according to the display selection signal and the display signal.

  On the other hand, a light receiving signal line 53 is connected to the light receiving circuit 42 of each subpixel SubPix. The light receiving circuit 42 controls light reception by the light receiving sensor SSR (FIG. 4), and supplies a light receiving signal generated by receiving light from the light receiving sensor SSR to the light receiving signal processing unit 26 via the light receiving signal line 53.

  FIG. 3 shows how the pixels Pix shown in FIG. 2 are arranged in a matrix. 3 shows a total of 16 pixels Pix (48 subpixels SubPix) of 4 × 4, and some of the reference numerals are omitted (FIGS. 7, 12, and 14 described later). , And FIG. 17).

  The arrangement shown in FIG. 3 forms R lines, G lines, and B lines by arranging subpixels SubPix of the same color in the vertical direction, and the R lines, G lines, and B lines are arranged in the horizontal direction. This is a so-called stripe arrangement that is repeatedly arranged.

  FIG. 4 shows circuit examples of the display circuit 41 and the light receiving circuit 42.

  The display circuit 41 includes a switching element SW1, a liquid crystal layer LC, a storage capacitor C, and the like. The switching element SW1 is composed of, for example, a TFT (Thin Film Transistor).

  In the display circuit 41, the switching element SW1 turns on or off the connection according to a display selection signal supplied from the gate driver 23 via the display selection line 52. When the switching element SW1 is on, the display signal from the source driver 24 is supplied to the liquid crystal layer LC and the storage capacitor C via the display signal line 51, and a predetermined voltage is applied to the liquid crystal layer LC and the storage capacitor C. Is done. In the liquid crystal layer LC, the arrangement of liquid crystal molecules changes according to the applied voltage, and light from the backlight is emitted to the front side of the display panel 25. When the switching element SW1 is off, the voltage applied to the liquid crystal layer LC and the storage capacitor C is held. The switching element SW1 is turned on and off by sequentially switching the subpixels SubPix aligned in a row in the horizontal direction as horizontal lines one by one in the vertical direction, that is, by performing line-sequential scanning. An image is displayed.

  The light receiving circuit 42 includes switching elements SW2 and SW3, a sensor SSR, and an amplifier AMP. Each of the switching elements SW2 and SW3 is configured by, for example, a TFT, and the sensor SSR is configured by, for example, a photodiode or a TFT.

  The sensor SSR receives light incident from the surface of the display panel 25 and outputs a current signal corresponding to the amount of received light to the amplifier AMP. The amplifier AMP converts an input current signal into a voltage signal, amplifies it, and outputs it as a light reception signal. The switching element SW3 is turned on or off according to the read control signal. When the switching element SW3 is turned on, the received light reception signal is supplied to the light reception signal processing unit 26 via the light reception signal line 53. . The switching element SW2 is turned on or off according to the reset control signal. When the switching element SW2 is on, the light reception signal is reset.

  The display circuit 41 and the light receiving circuit 42 configured as described above are arranged in the subpixel SubPix as shown in FIG.

  The display panel 25 can be realized by an EL display using an organic or inorganic EL element which is a self-luminous element instead of the LCD.

  FIG. 5 shows a circuit example of the display circuit 41 and the light receiving circuit 42 when the display panel 25 is configured by an EL display. The light receiving circuit 42 is the same as that in FIG.

  The display circuit 41 includes switching elements SW1 and SW4, a circuit group 61, and an EL element 62.

  The circuit group 61 includes, for example, a display data writing circuit, a threshold value variation correcting circuit, and the like. The display data writing circuit is an I / V (current / voltage) conversion circuit that converts a display signal (voltage signal) supplied from the switching element SW1 into a current signal. The threshold value variation correction circuit is a circuit (TFT threshold value correction circuit) for correcting variation of the display signal due to the switching element SW1.

  The switching element SW1 turns on or off the connection according to a display selection signal supplied from the gate driver 23 via the display selection line 52. When the switching element SW1 is on, the display signal from the source driver 24 is supplied to the circuit group 61 via the display signal line 51. The circuit group 61 performs the above-described processing such as I / V conversion and variation correction on the input display signal, and outputs the processed display signal to the switching element SW4. The switching element SW4 is turned on or off according to the light emission control signal. When the switching element SW4 is turned on, a display signal from the circuit group 61 is supplied to the EL element 62. Thereby, the EL element 62 emits light.

  Note that each of the read control signal, the reset signal, and the light emission control signal described with reference to FIGS. 4 and 5 is supplied from the gate driver 23 or the source driver 24 via a control line (not shown).

  FIG. 6 shows an arrangement example of the display circuit 41 and the light receiving circuit 42 in the pixel Pix when the light receiving circuit 42 is arranged one-to-one with the pixel Pix.

  When the light receiving circuit 42 is arranged one-on-one with the pixel Pix, as shown in FIG. 6, among the R, G, and B subpixels SubPix arranged side by side in the horizontal direction, A light receiving circuit region 71 is provided further adjacent to the subpixel SubPix, and the light receiving circuit 42 is disposed there.

  The light receiving circuit 42 supplies the light receiving signal generated by receiving light from the light receiving sensor SSR to the light receiving signal processing unit 26 via the light receiving signal line 53 wired in the light receiving circuit area 71 in the vertical direction. The arrangement of the display circuit 41, the display signal line 51, and the display selection line 52 is the same as in FIG.

  FIG. 7 shows a state where the pixels Pix and the light receiving circuit areas 71 shown in FIG. 6 are arranged in a matrix.

  When the light receiving circuit 42 is arranged for each pixel Pix, as shown in FIG. 7, the light receiving circuit line in which the light receiving circuit 42 is arranged is arranged next to the R line, the G line, and the B line. , G line, B line, and light receiving circuit line are repeatedly arranged in the horizontal direction.

  The basic pattern of the arrangement of the display circuit 41 and the light receiving circuit 42 in which the light receiving circuit 42 is arranged for each subpixel SubPix or pixel Pix has been described above with reference to FIGS. 2 to 7. The light receiving circuit provided in the panel 25 is configured to output a light receiving signal having a higher S / N ratio than the light receiving circuit 42.

  In order to further improve the S / N ratio of the light reception signal, the size (light reception area) of the sensor SSR provided in each subpixel SubPix can be simply increased. Increasing the sensor size should not be performed because it adversely affects display performance such as reducing the aperture.

  Also, instead of providing the display circuit and the light receiving circuit on the same substrate, the display substrate and the light receiving substrate are created separately, and the display substrate and the light receiving substrate are bonded together to increase the size of the sensor SSR. However, there is a problem that the cost becomes high.

  Therefore, as shown in FIG. 8, the display panel 25 substantially increases the sensor size by connecting the sensors SSR arranged in each pixel Pix or sub-pixel SubPix in parallel on the substrate. , Improving the S / N ratio.

  That is, FIG. 8 is a conceptual diagram of the light receiving circuit 101 employed in the display panel 25 of the information processing apparatus 1.

  The light receiving circuit 101 in FIG. 8 includes three types of sub light receiving circuits 101a to 101c and a sensor connection line 102 that connects outputs of the sensors SSR of the sub light receiving circuits 101a to 101c. The sub light receiving circuit 101a includes a sensor SSR and a switching element SW2, the sub light receiving circuit 101b includes a sensor SSR, and the sub light receiving circuit 101c includes a sensor SSR, an amplifier AMP, and a switching element SW3.

  Note that the number of sub light receiving circuits 101b inserted between the sub light receiving circuit 101a and the sub light receiving circuit 101c can be any number. The sub light receiving circuit 101b can be omitted.

  The amplifier AMP and the switching element SW3 need to be provided in the sub light receiving circuit 101c connected to the light receiving signal line 53. However, if the switching element SW2 is connected to the output of the sensor SSR, the sub light receiving circuit 101a. Thru 101c may be arranged anywhere.

  The sensor sizes of the sensors SSR provided in the sub light receiving circuits 101a to 101c do not have to be the same. However, in the present embodiment, the sensor sizes of the light receiving circuit 42 are assumed to be the same for simplicity of explanation. It is assumed that the size of the sensor SSR is the same.

  In the light receiving circuit 101, light reception signals output from the sensors SSR of the sub light receiving circuits 101a and 101b are input to the amplifier AMP of the sub light receiving circuit 101c via the sensor connection line 102. The light reception signal output from its own sensor SSR is also input to the amplifier AMP of the sub light reception circuit 101c. Therefore, the signal input to the amplifier AMP is a sum signal of the light reception signals output from the sensors SSR of the sub light reception circuits 101a to 101c. The amplifier AMP converts the received light signal (current signal) input to the amplifier AMP into a voltage signal, amplifies and outputs the voltage signal.

  Accordingly, the sub light receiving circuit 101 c outputs the light receiving signals output from all the sensors SSR included in the sub light receiving circuits 101 a to 101 c constituting the light receiving circuit 101 as the light receiving signals of the light receiving circuit 101. The light reception signal output from the sub light reception circuit 101 c is supplied to the light reception signal processing unit 26 via the light reception signal line 53.

  FIG. 9 is a diagram showing the relationship between the sensor size and the level of the output signal when the light receiving circuit 101 is configured as shown in FIG.

  The horizontal axis of FIG. 9 represents the sensor size of the sensor SSR included in the light receiving circuit 101, and the sensor size increases as the number of sub light receiving circuits 101a to 101c constituting the light receiving circuit 101 increases. 9 represents the level of the output signal output from the light receiving circuit 101 (hereinafter referred to as the output level).

  The output signal output from the light receiving circuit 101 includes a light receiving signal as a signal component, a noise signal derived from a sensor as a noise component, and a noise signal from the amplifier AMP. If the circuit configuration and circuit constants of the amplifier AMP do not change, the noise component due to the amplifier AMP does not change. The circuit constant of the amplifier AMP is designed according to a circuit (system) connected to the subsequent stage of the amplifier AMP. In the display panel 25, even if the number of the sub light receiving circuits 101a to 101c constituting the light receiving circuit 101 changes, the circuit after the amplifier AMP does not change, so the circuit constant does not change. Therefore, the noise component due to the amplifier AMP does not change even when the sensor size is increased.

  On the other hand, for example, a noise component caused by the sensor SSR such as a leak component and a light reception signal output from the sensor SSR both increase in proportion to the sensor size. However, the increase rate of the noise component due to the sensor SSR is slight as compared with the increase rate of the received light signal as shown in FIG.

  Therefore, the S / N ratio of the received light signal can be increased by connecting the sensors SSR in parallel and substantially increasing the sensor size.

  In the following, the light receiving circuit 101 in which each of the sub light receiving circuits 101a to 101c is arranged for each pixel Pix will be described. However, in the case where each of the sub light receiving circuits 101a to 101c is arranged for each sub pixel SubPix. Even if it exists, the same effect can be produced.

  FIG. 10 shows a first embodiment of the light receiving circuit 101.

  That is, FIG. 10 shows an arrangement example of the display circuit 41 and the light receiving circuit 101 when the light receiving circuit 101 includes the sub light receiving circuit 101a and the sub light receiving circuit 101c. In the following, the arrangement of the display circuit 41 is the same as the arrangement of the display circuit 41 described with reference to FIGS.

  When the light receiving circuit 101 includes the sub light receiving circuit 101a and the sub light receiving circuit 101c, a light receiving circuit region 71 provided for the upper pixel Pix of the set of two pixels Pix aligned in the vertical direction. The sub light receiving circuit 101a is arranged in the light receiving circuit region 71 provided for the lower pixel Pix of the set. The sub light receiving circuit 101 a and the sub light receiving circuit 101 c are connected by a sensor connection line 102, and the sensor connection line 102 intersects the display selection line 52. The sub light receiving circuit 101a and the sub light receiving circuit 101c may be arranged upside down.

  FIG. 11 shows a circuit of the light receiving circuit 101 shown in FIG. FIG. 12 shows an example of the display panel 25 in which the pixels Pix shown in FIG. 10 are arranged in a matrix.

  When the light receiving circuit 101 is configured by arranging the sub light receiving circuit 101a and the sub light receiving circuit 101c for the two pixels Pix arranged in the vertical direction, the sensor connection line 102 is connected to the display selection line 52 as shown in FIG. If the sub light receiving circuit 101a and the sub light receiving circuit 101c are arranged for two pixels Pix aligned in the horizontal direction to form the light receiving circuit 101, the sensor connection line 102 is arranged. Can be prevented from crossing the display selection line 52.

  Specifically, as shown in FIG. 13A, a pixel Pix in which a light receiving circuit region 71 is arranged next to the B subpixel, and a light receiving circuit region 71 is arranged next to the R subpixel as shown in FIG. 13B. The arranged pixels Pix are arranged adjacent to each other in the horizontal direction.

  The sub light receiving circuit 101c is arranged in the light receiving circuit area 71 of one pixel Pix (in FIG. 13, the pixel Pix shown in FIG. 13A), and the other pixel Pix (the pixel Pix shown in FIG. 13B in FIG. 13). If the sub light receiving circuit 101 a is arranged in the light receiving circuit area 71, the sensor connection line 102 does not intersect the display selection line 52.

  FIG. 14 shows an example of the display panel 25 in which the pixels Pix shown in FIGS. 13A and 13B are arranged in a matrix.

  FIG. 15 shows a second embodiment of the light receiving circuit 101.

  That is, FIG. 15 shows an arrangement example of the display circuit 41 and the light receiving circuit 101 when the light receiving circuit 101 includes the sub light receiving circuit 101a, the two sub light receiving circuits 101b, and the sub light receiving circuit 101c. .

  When the light receiving circuit 101 includes the sub light receiving circuit 101a, the two sub light receiving circuits 101b, and the sub light receiving circuit 101c, a total of four pixels Pix of 2 × 2 arranged in the vertical direction and the horizontal direction are assembled. The sub light receiving circuit 101a is arranged in the light receiving circuit area 71 provided for the upper left pixel Pix of the set, and the sub light receiving circuit 71a is provided in the light receiving circuit area 71 provided for the lower left and upper right pixels Pix of the set. The circuit 101b is arranged, and the sub light receiving circuit 101c is arranged in the light receiving circuit area 71 provided for the lower right pixel Pix of the set.

  At this time, the sensor connection line 102 connecting the sub light receiving circuit 101a and the sub light receiving circuit 101b arranged in the vertical direction, and the sensor connection line 102 connecting the sub light receiving circuit 101b and the sub light receiving circuit 101c intersect the display selection line 52. To do. The sensor connection line 102 connecting the sub light receiving circuits 101b and 101c arranged in the horizontal direction intersects the three display signal lines 51 in the R, G, and B sub pixels SubPix therebetween.

  FIG. 16 shows a circuit of the light receiving circuit 101 shown in FIG. FIG. 17 shows an example of the display panel 25 in which the four pixels Pix shown in FIG. 15 are arranged in a matrix.

  In the above, an example in which the light receiving circuit 101 is configured by the light receiving circuit region 71 provided for each of the two pixels Pix arranged in the vertical direction, and a total of 4 × 2 × 2 arranged in the vertical direction and the horizontal direction, respectively. The example in which the light receiving circuit 101 is configured by the light receiving circuit area 71 provided for each pixel Pix has been described, but the number of arrangements in the vertical direction and the horizontal direction in which the sub light receiving circuits 101a to 101c constituting the light receiving circuit 101 are arranged. Can be arbitrarily determined.

  Next, the result of processing a light reception signal having a high S / N ratio by connecting a plurality of sensors SSR in parallel will be described with reference to FIGS. It is assumed that the display resolution of the display panel 25 is 240 × 320 pixels.

  As described with reference to FIG. 6, the processed image of the light reception signal when the light reception circuit 42 is arranged one-on-one with the pixel Pix is as shown in FIG. 18.

  That is, when the light receiving circuit 42 is arranged in a one-to-one relationship with the pixels, the light receiving resolution is the same as the display resolution. Therefore, the processed image obtained by processing the light receiving signal is 240 × 320 pixels, which is the same as the display resolution. In the processed image of FIG. 18, a position (pixel) represented in white (high brightness) represents a position designated by the user with a finger or the like.

  On the other hand, as described with reference to FIG. 10, the light receiving circuit 101 in the display panel 25 includes the sub light receiving circuit 101 a and the sub light receiving circuit 101 c arranged with respect to two pixels Pix arranged in the vertical direction. In this case, a processed image obtained by processing the light reception signal from the display panel 25 is as shown in FIG.

  That is, the horizontal resolution of the processed image shown in FIG. 19 is 240 (pixels), which is the same as the display resolution, but the vertical resolution is that one received light signal is output by two pixels Pix arranged in the vertical direction. Therefore, the display resolution is 160 (pixels), which is ½ of the display resolution, and the processed image is an image obtained by thinning the image of FIG. 18 by ½ in the vertical direction. Therefore, the light receiving resolution is ½ of the display resolution.

  Similarly, as described with reference to FIG. 15, the light receiving circuit 101 in the display panel 25 includes a sub light receiving circuit 101 a arranged for a 2 × 2 pixel Pix, two sub light receiving circuits 101 b, and When the sub light receiving circuit 101c is used, a processed image obtained by processing the light receiving signal from the display panel 25 is as shown in FIG.

  That is, the processed image is 120 × 160 (pixels), which is 1/2 of the display resolution in both the horizontal direction and the vertical direction, and is an image obtained by thinning the image of FIG. 18 to 1/2 in both the horizontal direction and the vertical direction. . Therefore, the light receiving resolution is 1/4 of the display resolution.

  As shown in FIGS. 19 and 20, outputting one light reception signal from a plurality of pixels Pix makes a processed image smaller, so that the light reception signal processing in the subsequent stage that processes the light reception signal output from the display panel 25. In the unit 26, the processing load is reduced as compared with processing a light reception signal having the same light reception resolution as the display resolution. In addition, CPU specifications and memory capacity required for processing can be set low.

  Further, as described with reference to FIG. 8, it is possible to arbitrarily determine how many sub light receiving circuits 101b are connected between the sub light receiving circuit 101a and the sub light receiving circuit 101c. The light receiving resolution can be freely set without depending on the display resolution.

  Furthermore, the reduction in the light receiving resolution in the vertical direction has other merits described with reference to FIG.

  The display processing unit 14 contacts the display panel 25 by receiving light in both the state where the backlight is turned on and the state where the backlight is turned off during the time for displaying an image of one frame (hereinafter referred to as one frame period). Alternatively, the position of a close object is detected. Further, in order for the light receiving circuit 101 to output an accurate light receiving signal, it is necessary to reset the accumulated charge so far by the reset control signal. The display panel 25 is caused to perform line-sequential scanning for a total of four times: reset and readout in the lighting state and reset and readout in the off state. In other words, the controller 22 controls the driving of the gate driver 23 and the source driver 24 so that the light reception signal for one time is output to the light reception signal processing unit 26 in a time of ¼ of the frame rate.

  Here, assuming that the display resolution is 240 × 320 pixels similar to that shown in FIG. 18 and the frame rate is 60 [Hz], as shown in FIG. 6, the light receiving circuit 42 for each pixel Pix. In this case, the time required for one light receiving circuit 42 to be reset or read once is 1/60 × 1/4 × 1/320 = 1/76800 [sec] = 13 [μsec]. .

The upper output waveform f _{A in} FIG. 21 shows the waveform of the received light signal output from the light receiving circuit 42, and the cycle T of the output waveform f _A is 13 [μsec].

  On the other hand, as shown in FIG. 10, in the case where the light receiving circuit 101 composed of the sub light receiving circuit 101a and the sub light receiving circuit 101c is arranged as a set of two pixels Pix aligned in the vertical direction, one light receiving circuit 101 is provided. The time required for one reset or readout process is 1/60 × 1/4 × 1/160 = 1/38400 [sec] = 26 [μsec], which is twice that in the light receiving circuit 42 of FIG. Become.

The output waveform f _{B in} the lower part of FIG. 21 indicates a waveform output from the light receiving circuit 101 in which the sub light receiving circuit 101a and the sub light receiving circuit 101c are arranged in two pixels Pix arranged in the vertical direction.

  The light receiving process performed by the light receiving circuit 101 will be described with reference to the flowchart of FIG.

  When a reset control signal for turning off the connection is supplied to the switching element SW2 of the light receiving circuit 101, in step S1, the switching element SW2 turns off the connection and resets the light receiving signal.

  In step S2, each sensor SSR of the sub light receiving circuits 101a to 101c constituting the light receiving circuit 101 outputs a current signal corresponding to the amount of received light to the amplifier AMP.

  When a read control signal for turning on the connection is supplied to the switching element SW3 of the light receiving circuit 101, the light receiving circuit 101 outputs a light receiving signal in step S3. That is, the amplifier AMP of the sub light receiving circuit 101c converts a current signal input thereto into a voltage signal and outputs the amplified signal as a light receiving signal.

  The processes in steps S1 to S3 are executed in 26 [μsec] in the light receiving circuit 101 shown in FIG.

  Accordingly, the time that the amplifier AMP of the light receiving circuit 101 can use to output the light receiving signal is twice as long as that of the light receiving circuit 42, and the processing load of the amplifier AMP is reduced, so that the circuit of the amplifier AMP can be downsized. It becomes. Further, power consumption can be reduced by downsizing the circuit of the amplifier AMP. Further, downsizing the circuit of the amplifier AMP also reduces the noise component due to the amplifier AMP described with reference to FIG. 9, so that the S / N ratio of the received light signal is further improved.

  As described above, according to the display panel 25 of the information processing apparatus 1, the sensor size is substantially reduced by connecting the sensors SSR arranged in each pixel Pix or sub-pixel SubPix in parallel on the substrate. The S / N ratio of the received light signal can be further improved. That is, the S / N ratio of the received light signal can be improved with a simple configuration.

  The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

It is a figure which shows the structural example of one Embodiment of the information processing apparatus to which this invention is applied. It is a figure which shows the example of arrangement | positioning of the conventional display circuit and light receiving circuit. It is a figure which shows a mode that the pixel shown in FIG. 2 was arrange | positioned at matrix form. It is a figure which shows the circuit example of a display circuit and light receiving circuit in case a display panel is comprised by LCD. It is a figure which shows the circuit example of a display circuit and a light receiving circuit in case a display panel is comprised with an EL display. It is a figure which shows the other example of arrangement | positioning of the conventional display circuit and light receiving circuit. It is a figure which shows a mode that the pixel shown in FIG. 6 was arrange | positioned at matrix form. It is a conceptual diagram of the light receiving circuit employ | adopted with the display panel of FIG. It is a figure which shows the relationship between a sensor size and the level of an output signal. It is a figure which shows the example of arrangement | positioning of the display circuit and light receiving circuit of the display panel of FIG. It is a figure which shows the circuit of the light receiving circuit of FIG. FIG. 11 is a diagram showing a display panel in which the pixels shown in FIG. 10 are arranged in a matrix. It is a figure which shows the other example of arrangement | positioning of the display circuit and light receiving circuit of the display panel of FIG. FIG. 14 is a diagram showing a display panel in which the pixels shown in FIG. 13 are arranged in a matrix. FIG. 10 is a diagram showing still another arrangement example of the display circuit and the light receiving circuit of the display panel of FIG. 1. It is a figure which shows the circuit of the light receiving circuit of FIG. FIG. 16 is a diagram showing a display panel in which the pixels shown in FIG. 15 are arranged in a matrix. It is a figure explaining the process result which processed the light reception signal which the light reception circuit of FIG. 6 output. It is a figure explaining the process result which processed the light reception signal which the light reception circuit of FIG. 10 output. It is a figure explaining the process result which processed the light reception signal which the light reception circuit of FIG. 15 output. It is a figure explaining the period of the light reception signal which the light reception circuit of FIG. 6 and FIG. 10 outputs. It is a flowchart explaining a light reception process.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Information processing apparatus, 14 Display processing part, 25 Display panel, 41 Display circuit, Pix pixel, SubPix subpixel, SSR sensor, AMP amplifier, 62 EL element, 101 light receiving circuit, 101a thru | or 101c Sub light receiving circuit, 102 Sensor connection line

Claims (6)

A pixel as a unit of display resolution of an image, which is composed of a subpixel that emits light of R, G, or B, and a light receiving region that is provided in a region different from the subpixel and includes at least a light receiving sensor. Comprises a display panel arranged in a matrix,
In the light receiving area of the pixel, a first light receiving circuit including a reset element for resetting a light receiving signal obtained by the light receiving sensor and the light receiving sensor, or the light receiving signal to the outside of the pixel One of the second light receiving circuits composed of an output element for outputting to the light receiving sensor and the light receiving sensor is disposed,
In the display panel, a first pixel in which the first light receiving circuit is disposed in the light receiving region and a second pixel in which the second light receiving circuit is disposed in the light receiving region are adjacent to each other. The light reception sensors of the first pixel and the second pixel are connected in parallel on the same substrate, and one light reception signal obtained from the plurality of the light reception sensors connected to the second pixel is converted into the second pixel. A display device that outputs the output element . The display panel also includes a third pixel in which a third light receiving circuit having the light receiving sensor in the light receiving region of the pixel and having neither the reset element nor the output element is disposed. ,
One light receiving sensor of the first pixel and the second pixel and one or more light receiving sensors of the third pixel are connected in parallel on the substrate, and the plurality of light receiving sensors connected thereto The display device according to claim 1, wherein the output element of the second pixel outputs one obtained light reception signal . The one light reception signal is output from four pixels including one of the first pixel, the second pixel, and two of the third pixels,
The display device according to claim 2 , wherein two of the four pixels are arranged in a horizontal direction and a vertical direction . The display device according to claim 1, wherein the first light receiving circuit of the first pixel and the second light receiving circuit of the second pixel are adjacent to each other in the horizontal direction . A pixel as a unit of display resolution of an image, which is composed of a subpixel that emits light of R, G, or B, and a light receiving region that is provided in a region different from the subpixel and includes at least a light receiving sensor. Are arranged in a matrix, and the light receiving area of the pixel includes a reset element for resetting a light receiving signal obtained by the light receiving sensor and a first light receiving circuit. Alternatively, either one of a second light receiving circuit configured by an output element for outputting the light receiving signal to the outside of the pixel and the light receiving sensor is disposed, and in the display panel, the light receiving region includes the light receiving region. The first pixel in which the first light receiving circuit is disposed and the second pixel in which the second light receiving circuit is disposed in the light receiving region are adjacent to each other, and In the light receiving method of the display device, the light receiving sensors of the second pixel and the light receiving sensors of the second pixel are connected in parallel on the same substrate .
A light receiving method in which the output element of the second pixel outputs a light receiving signal obtained by receiving light by each of the light receiving sensors of the first light receiving circuit and the second light receiving circuit as one light receiving signal . A pixel as a unit of display resolution of an image, which is composed of a subpixel that emits light of R, G, or B, and a light receiving region that is provided in a region different from the subpixel and includes at least a light receiving sensor. Display panels arranged in a matrix ,
Input information analysis means for analyzing input information input by a user using a light reception image generated from a light reception signal output by the light reception sensor;
Control means for performing predetermined control processing in response to the message supplied from the input information analysis means,
In the light receiving area of the pixel, a first light receiving circuit including a reset element for resetting a light receiving signal obtained by the light receiving sensor and the light receiving sensor, or the light receiving signal to the outside of the pixel One of the second light receiving circuits composed of an output element for outputting to the light receiving sensor and the light receiving sensor is disposed,
In the display panel, a first pixel in which the first light receiving circuit is disposed in the light receiving region and a second pixel in which the second light receiving circuit is disposed in the light receiving region are adjacent to each other. The light reception sensors of the first pixel and the second pixel are connected in parallel on the same substrate, and one light reception signal obtained from the plurality of the light reception sensors connected to the second pixel is converted into the second pixel. An information processing apparatus that outputs the output element .

Images