KR101799691B1 - Display device having touch function and method for recognizing fingerprint thererof - Google Patents

Abstract

The present invention provides a display device having a touch function and a fingerprint recognition method thereof, which can accurately perform a fingerprint recognition operation of a user. According to an embodiment of the present invention, the display device having a touch function comprises: a pixel displaying an image, and operated as a touch sensor; and a processor performing the fingerprint recognition operation of the user based on a touch signal output from the pixel. Also, other embodiments are also included.

Description

TECHNICAL FIELD [0001] The present invention relates to a display device having a touch function, and a fingerprint recognition method using the same. BACKGROUND OF THE INVENTION [0002]

The present invention relates to a display device having a touch function capable of performing a fingerprint recognition operation of a user, and a fingerprint recognition method therefor.

2. Description of the Related Art Generally, a touch screen panel includes various types of displays such as a liquid crystal display (LCD), a plasma display panel (PDP), an organic light emitting diode (OLED), and an active matrix organic light emitting diode (AMOLED) An input device applied to the device is an apparatus for detecting a touch signal generated when an external object such as a finger or a touch pen approaches or touches the touch screen panel.

The touch screen panel may include various types of mobile devices such as a mobile phone, a PDA (Personal Digital Assistants), and a PMP (Portable Multimedia Player), as well as a navigation device, a netbook, a notebook, Devices, and desktop computers that use an operating system that supports touch input, Internet Protocol TV (IPTV), and military equipment.

For example, the display device having the touch screen panel may be manufactured by separately manufacturing the display device and the touch screen panel, and then attaching the touch screen panel to the upper panel of the display device. In this case, since a separate touch screen panel is attached to the display device, the thickness of the display device becomes thick, the brightness becomes dark, and the visibility may deteriorate.

When the touch screen panel is attached to the upper panel of the display device, an interference phenomenon occurs between various driving signals of the display device and a touch signal of the touch screen panel, so that the performance of the display device and the performance Can be lowered. In recent years, there has been a demand for a solution capable of accurately recognizing a user's fingerprint in a display device provided with a touch function.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and it is an object of the present invention to provide a display device having various types of display devices such as an LCD, PDP, OLED, and AMOLED having a touch function, The present invention provides a display device having a touch function and a fingerprint recognition method for accurately performing a fingerprint recognition operation.

According to an embodiment of the present invention, a display device having a touch function includes: a pixel that displays an image and operates as a touch sensor; And a processor for performing a fingerprint recognition operation of the user based on the touch signal output from the pixel.

The processor can recognize fingerprints of a plurality of fingers based on the touch signal.

The processor may repeat the operation of recognizing the fingerprint of the plurality of fingers continuously two or more times on the basis of the touch signal and combine the results repeated two or more times in succession to perform a user authentication operation can do.

The processor may perform an operation of recognizing the fingerprint of the plurality of fingers at the time of occurrence of a touch, always or at an N-tap cycle. The processor can perform an operation of recognizing a fingerprint of the plurality of fingers when a touch is generated, in a specific operation mode or at a specific coordinate position.

According to an embodiment of the present invention, there is provided a method of recognizing a fingerprint of a display device having a touch function, the method comprising: receiving a touch signal output from a pixel serving as a touch sensor, And performing a fingerprint recognition operation of the user based on the received touch signal.

The performing step may recognize fingerprints of a plurality of fingers based on the touch signal.

Wherein the step of performing the fingerprint recognition includes repeating the operation of recognizing the fingerprint of the plurality of fingers successively two or more times on the basis of the touch signal, Can be performed.

The performing step may perform an operation of recognizing the fingerprint of the plurality of fingers at the time of occurrence of a touch, at all times or at an N-time touch period. The performing step may perform an operation of recognizing a fingerprint of the plurality of fingers when a touch is generated in a specific operation mode or at a specific coordinate position.

According to an embodiment of the present invention, a display device provided with a touch function includes: a touch sensor mounted on a boundary surface between pixels displaying an image in a metal mesh form; And a processor for performing a fingerprint recognition operation of the user based on the touch signal output from the touch sensor.

The processor can recognize fingerprints of a plurality of fingers based on the touch signal.

The processor may repeat the operation of recognizing the fingerprint of the plurality of fingers continuously two or more times on the basis of the touch signal and combine the results repeated two or more times in succession to perform a user authentication operation can do.

The processor may perform an operation of recognizing the fingerprint of the plurality of fingers at the time of occurrence of a touch, always or at an N-tap cycle. The processor can perform an operation of recognizing a fingerprint of the plurality of fingers when a touch is generated, in a specific operation mode or at a specific coordinate position.

According to an embodiment of the present invention, there is provided a fingerprint recognition method of a display device having a touch function, including: receiving a touch signal output from a touch sensor mounted on a boundary surface between pixels displaying an image in a metal mesh form; And performing a fingerprint recognition operation of the user based on the received touch signal.

The performing step may recognize fingerprints of a plurality of fingers based on the touch signal.

Wherein the step of performing the fingerprint recognition includes repeating the operation of recognizing the fingerprint of the plurality of fingers successively two or more times on the basis of the touch signal, Can be performed.

The performing step may perform an operation of recognizing the fingerprint of the plurality of fingers at the time of occurrence of a touch, at all times or at an N-time touch period. The performing step may perform an operation of recognizing a fingerprint of the plurality of fingers when a touch is generated in a specific operation mode or at a specific coordinate position.

According to the embodiment of the present invention, for example, by recognizing fingerprints of a plurality of fingers on the basis of a touch signal outputted from a plurality of pixels which are displayed as an image and which act as a touch sensor, Can be improved.

According to the embodiment of the present invention, for example, fingerprints of a plurality of fingers are recognized based on a touch signal outputted from a plurality of touch sensors mounted on a boundary surface between pixels displaying an image in the form of a metal mesh , The accuracy of user fingerprint recognition can be improved.

1 is a block diagram schematically illustrating a touch function for detecting a touch signal in a display device according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a touch process performed by a driver including a multiplexer of a touch screen panel implemented by the pixel of FIG. 1. Referring to FIG.
3 is a view schematically showing a TFT substrate of a display device according to an embodiment of the present invention.
Figures 4 and 5 illustrate one embodiment of the generation of a storage capacitor in an LCD that is a type of display device.
6 is a view showing a structure for removing the storage capacitor Cst in the display device of the embodiment of the present invention.
Fig. 7 is a diagram showing a configuration of a circuit diagram for displaying an image using the display device of Fig. 6;
8 is a diagram for explaining the voltage magnitude and operation sequence of the gate signal line in the image display step of the display device with reference to the circuit diagram of Fig.
Fig. 9 is a diagram showing a configuration of a circuit for detecting a touch using the display device of Fig. 6; Fig.
10 is a diagram illustrating in detail a process of detecting a touch in synchronization with an AC voltage applied to a parasitic capacitor.
11 is an exemplary diagram for performing fingerprint recognition using the display device of the embodiment of the present invention.
12 is an enlarged view of a part of a display device according to another embodiment of the present invention.
13 is a view illustrating a laminated structure of a display device according to still another embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings and embodiments. The display device referred to in the embodiment of the present invention refers to any one of LCD, PDP, and OLED, or any other means for displaying other images. In order to fully understand the present invention, the operational advantages of the present invention and the objects achieved by the embodiments of the present invention, reference should be made to the accompanying drawings and the accompanying drawings which illustrate preferred embodiments of the present invention.

In the drawings attached to the embodiments of the present invention, the same components are not given separate reference numerals, but can be recognized as having the same reference numerals. For example, only the touch sensors of (ROW1, COL1) in FIG. 1 are numbered with reference numeral 10, but each of the 30 touch sensors shown in FIG. 1 should be recognized as being numbered with reference numeral 10. Similarly, only the touch detection signal line connected to the touch sensor of (ROW1, COL1) is numbered by reference numeral 22, but each of the touch detection signal lines shown in FIG. 1 should be recognized as being numbered by reference numeral 22 do.

As such, the drawing numbering rules for each component in the drawing apply equally to the remaining drawings. An embodiment of the present invention relates to a display device having a touch function and a fingerprint recognition method therefor, and more particularly to a display device using a pixel of a display device to display an image, To perform a touch function of detecting a touch point.

The display device having the touch function of the embodiment of the present invention may include a plurality of pixels that operate as a display component for displaying an image and also function as a touch sensor for outputting a touch signal.

The display device having a touch function of the embodiment of the present invention includes a plurality of pixel electrodes which act as a display component for displaying an image and also function as a touch sensor for outputting a touch signal, And a second pixel electrode that forms a storage capacitor when connected to the first pixel electrode and does not include the storage capacitor when the first pixel electrode is disconnected from the first pixel electrode.

The display device having a touch function of the embodiment of the present invention can perform fingerprint recognition using pixels. Generally, fingerprint recognition is performed using one finger, but in the display device of the embodiment of the present invention, it is possible to recognize a plurality of fingers. Thus, by performing fingerprint recognition for a plurality of fingers, errors in biometric identification can be minimized and the reliability of the user's display device can be further enhanced.

In the fingerprint recognition using the pixels of the embodiment of the present invention, fingerprint recognition is possible in the entire area where the pixels of the display device are arranged. For example, in a fingerprint recognition method of a general display device, a separate element for recognizing a fingerprint is installed in a specific area where pixels of the display device are not disposed, thereby performing fingerprint recognition. On the other hand, since the display device of the embodiment of the present invention can perform fingerprint recognition using pixels, it is not required to add a device for scanning another fingerprint.

In addition, since fingerprint recognition is possible in the entire area in which the pixels are arranged, it is possible to perform the fingerprint recognition of the user much faster and more accurately, not in a specific area of the display device. Embodiments of the present invention can provide a display device in which a display function and a touch function are integrated by adding a touch function to a pixel of a display device for displaying an image.

In an embodiment of the present invention, a unit pixel or a sub pixel refers to a minimum unit that includes red, green, or blue and forms a display image, and includes a plurality of unit pixels, Can be determined. For example, in the case of an FHD display device, 1920 horizontal and 1080 vertical pixels can be arranged (1920 X 1080 pixels). In an embodiment of the present invention, the unit pixel and the pixel may be used in the same sense.

In an embodiment of the present invention, a pixel is narrowly referred to as a pixel electrode of a TFT substrate, but it is widely used to form an image in the case of an LCD display device other than a pixel electrode Color filters).

The display device referred to in the embodiment of the present invention is not limited to a display device driven in a specific manner, and may include all display devices including a pixel or a component that performs a function similar to a pixel.

For example, it may include all LCDs using various types of liquid crystals such as a VA (Vertical Alignment) series LCD, a TN series LCD, and an IPS (In Plane Switching) series LCD. It may also include all types of display devices of various types of OLED (Organic Light Emitted Diode) such as PMOLED or AMOLED. It may also include any display or electronic device capable of displaying a still image (e.g., JPG, TIF, etc.) of arbitrary shape or a moving image (MPEG2, MPEG-4, etc.) to the user.

Configurations such as "to" described below are aggregates of Unit Function Elements that perform specific functions. For example, an amplifier in which a signal is a unit functional element and an aggregate in which amplifiers and signal converters are gathered Signal conversion unit. Also, "part" may be included in a larger element or "part, " or may include smaller elements and" parts. &Quot; The "part" may include a unique CPU (Central Processing Unit) capable of processing an operation function, a command stored in a memory, and the like.

As used herein, the term " signal "refers to a voltage or a current collectively referred to as data for transmitting arbitrary information, unless otherwise specified. In the present specification, the term "capacitance" refers to a physical size and can be used in the same sense as "capacitance ". On the other hand, a "capacitor" refers to an element having a capacitance that is a physical size.

In the present invention, the compensation capacitor Cbal may be formed by a designing and manufacturing process in a touch drive IC (Integrated Circuit), or may be naturally generated between two adjacent signal lines. In this specification, both the directly formed capacitor and the naturally formed capacitor are referred to as "capacitors ". In this specification, C, which is used as a symbol of a capacitor, is used as a code to designate a capacitor, and it may also indicate a capacitance which is a size of a capacitor. For example, C1 is a code that refers to a capacitor, and it may mean that the capacitance of the capacitor is C1.

In the present specification, the term " forcing "means that the level of a signal which is maintained in a certain state may be changed. For example, the signal applied to the ON / OFF control terminal of the switching element means that a conventional low level voltage (e.g., a zero voltage or a DC voltage of a certain magnitude, AC voltage) Hi) level (e. G., A DC voltage or AC voltage having a magnitude greater than the low level voltage).

1 is a block diagram schematically illustrating a touch function for detecting a touch signal in a display device according to an embodiment of the present invention. Referring to FIG. 1, the display device may include a touch sensor 10, a signal line 22, and an operation unit 30, for example, when performing a touch function. The touch sensor 10, the signal line 22, and the operation unit 30 are named according to their respective functions and may be referred to as other names.

In the display device of the embodiment of the present invention, the pixel performs the function of the touch sensor 10, the source signal line of the TFT (Thin Film Transistor) connected to the pixel can perform the function of the signal line 22 of the touch sensor, The pixel may mean a pixel electrode. For example, in the case of an LCD display device, the pixel may be a component that includes a common electrode and a color filter at the pixel electrode.

The operation unit 30 may be integrated into a driving chip of a display device. The touch signal generated in the pixel electrode (i.e., pixel) may be extracted in the coordinate form of one point on the rectangular coordinate system in the operation unit 30 and transmitted to the host through the communication unit 46 in FIG. 1 .

The operation unit 30 includes a touch detection unit 14, a signal processing unit 35, a memory unit 28, a power supply unit 47, a CPU 40, a driving unit 31 including a multiplexer, a timing control unit 33, an alternating voltage generator 42, a communication unit 46, and the like. The CPU 40 may be included in the operation unit 30 or may be a separate external configuration and may be referred to as any other name, for example, a processor that performs a fingerprint recognition operation.

Here, the processor is not limited to the CPU 40. For example, the processor may be a host that receives a touch coordinate value through the communication unit 46 of Fig. 1, and may also be a host in various types of electronic devices (e.g., a smart phone) A processor (Application Processor) or the like.

The driving unit 31 including the multiplexer performs a multiplexing function of selecting one of the plurality of touch sensors 10. The driving unit 31 isolates the touch sensor 10 in a high impedance state, precharge voltage or a change of the voltage after a predetermined time has elapsed since the alternating voltage generated by the alternating voltage generating unit 42 is applied.

The signal processing unit 35 receives a signal output from the driving unit 31 and amplifies or processes the signal, and the signal processing unit may include an ADC, a DAC, a comparator, and the like.

The memory unit 28 may temporarily store the result of the operation performed by the signal processing unit or may store firmware necessary for the operation of the CPU 40 or the like. The power unit 47 may generate power required by the touch screen panel or the operation unit 30 and may transmit the generated power to the components.

The CPU 40 may calculate touch coordinates based on the signal processed by the signal processing unit 35 or may control each unit element included in the operation unit 30. Also, And may be referred to as a processor or the like, and may be included in the operation unit 30 or may be a separate external configuration.

The timing control unit may generate a clock required by the operation unit 30. The alternating voltage generating unit 42 generates an alternating voltage required for detecting a touch signal, And may be included in the power supply unit 47.

For example, as shown in FIG. 1, the thumb and index finger of the user's finger 100 can touch the touch sensor 10, and if the user sets a lock function by fingerprint recognition, The user can perform the fingerprint recognition by touching the finger on an arbitrary area of the display device on which the pixel is disposed, and release the lock to use the display device as intended.

1 illustrates fingerprint recognition using two fingers as an embodiment of the present invention. However, it is obvious to those skilled in the art that fingerprint recognition can be performed for two or more fingers.

As mentioned above, since the display device of the embodiment of the present invention can perform fingerprint recognition using pixels, it is not required to add a device for a separate fingerprint scan. Therefore, there is an advantage that fingerprint recognition can be performed by touching an arbitrary area in which pixels are arranged (specifically, all areas in which pixels are arranged).

For example, referring to FIG. 1, there are six rows in the transverse direction and five columns in the longitudinal direction, which are represented by 6 X 5. 6 X 5 is an example of the size of the touch screen panel, and the size is not limited thereto. Other embodiments may include a touch screen panel having a size of 20 X 20 or 24 X 30.

FIG. 2 is a view for explaining a touch process performed by the driving unit 31 including the multiplexer of the touch screen panel implemented by the pixel of FIG. 2, a multiplexer 230 may be positioned between the switch 210 and the buffer 220, and the touch sensor 10 may be connected to the multiplexer 230 by a signal line 22.

(Row1-> Row2-> Row3-) in a direction perpendicular to the signal line 22 (in FIG. 1, horizontal) when touch signals are detected using the display device of the embodiment of the present invention, If the signal necessary for the touch detection is applied, such as> ....-> Row6 -> Row1 -> ..., the touch can be detected.

For example, one touch detection sensor 10 may be selected by a multiplexer included in the driving unit 31. Concretely, Row1, Col1, Row1, Col2, Row1, Col3, Row1, Col4, and Row1 and Col5 may be sequentially selected and connected to the driving circuit.

3 is a view schematically showing a TFT substrate of a display device according to an embodiment of the present invention. 3, the TFT substrate includes six gate signal lines (G1: G6) and five source signal lines (S1: S5), switching elements connected to signal lines 320, and pixel electrodes 310, respectively. Here, the structure and driving principle of the TFT substrate of FIG. 3 will be obvious to those skilled in the art, and a detailed description thereof will be omitted.

On the other hand, the arrangement of the touch sensor 10 of Fig. 1 and the pixel electrode 310 in the TFT substrate of Fig. 3 is similar. A source line 330 of FIG. 3 corresponds to a signal line 22 for driving a unit pixel (sub pixel), and corresponds to the signal line 22 in FIG.

However, although the touch detection signal lines 22 in FIG. 1 are connected to the respective touch sensors 10 one by one, a plurality of pixels are connected to one source signal line 330 in FIG. 3 There is a difference in point.

The touch detection process may be the same in the touch sensor 10 of Fig. 1 or the TFT pixel of Fig. In other words, as in the case where the touch sensor 10 of FIG. 1 detects the touch signal in the direction (the horizontal direction in FIG. 1) intersecting the signal line 22, the pixel electrodes of FIG. 3 are also driven by the gate signal line 340 The touch signal can be detected in the same manner by the time sharing method, and six pixel electrodes can be physically connected to the source signal line S1.

However, the touch signal can be detected by the time division method of the gate signal line in the same manner as the signal lines 22 connected to the respective touch sensors 10 of Fig. 1 at the time of touch signal detection. For example, pixel information can be transmitted to and operated only on a pixel of a TFT connected to G1 by a turn-on signal of G1 which is a gate signal line. Therefore, it is possible to detect only a touch on a pixel connected to [S1: G1] out of the six pixels connected to the source signal line S1.

Then, the touch of the pixel connected to [S1: G2] can be detected by the turn on signal of the gate signal line G2 and the touch of the pixel connected to [S1: G3] The touch of a pixel connected to [S1: G4] can be detected by the turn-on signal of the gate signal line G4 and the touch of the pixel connected to [S1: G5] by the turn-on signal of the gate signal line G5 And it is possible to detect the touch of the pixel connected to [S1: G6] by the turn-on signal of the gate signal line G6.

As described above, in the display device of the embodiment of the present invention, the pixel electrode or the pixel 310 can be used as the touch sensor 10. On the other hand, in the normal case, the pixels of the display device are used only as output elements for displaying an image or an image. That is, in the embodiment of the present invention, the pixel of the display device can operate as a touch sensor that detects a touch signal part of the time for displaying an image or an image, and when the pixel is used as the touch sensor 10 , The size of the pixel is small, so that the magnitude of the touch signal generated when the touch is generated, that is, the voltage or the current signal amplitude, is small.

In an embodiment of the present invention, a pixel group formed by connecting a plurality of pixels may be used as one touch sensor. For example, a plurality of pixels may be connected to each other to form an enlarged touch detection sensor.

As a first example in which a plurality of pixels are connected and used as one enlarged touch sensor as described above, the plurality of gate signal lines of FIG. 3 may be turned on at the same time. When the gate signal lines G1 to G6 are simultaneously turned on in the TFT substrate 300 of FIG. 3, six pixel electrodes or pixels connected to the source signal line S1 are coupled to each other to operate as one touch sensor 10 .

Similarly, a plurality of pixels connected to the source signal lines S2 to S5 may be combined to operate as one touch sensor 10. The gate signal lines G1 to G6 are simultaneously turned on in the TFT substrate 300 so that one touch sensor 10 is connected to each of S1 to S5.

Turning on the gates G1 to G6 at the same time is only one example of the present invention. Actually, the gate signal lines can be turned on at various times as needed, such as 10 or 100 from two gate signal lines. And may include independent components capable of adjusting the number of gate signal lines that are simultaneously turned on according to the size of the display device.

As a second example, a plurality of pixels are connected to a plurality of source signal lines and used as one touch sensor 10 by connecting a plurality of pixels as described above as a second enlarged touch sensor. If the source signal lines S1 to S5 are connected to each other, that is, turned on at the same time, and only G1 of the gate signal line is turned on, the plurality of pixels of G1 operate as one enlarged touch sensor 10 It is possible to obtain the same result as realizing a touch sensor having a larger area than the number of pixels connected to G1.

In the second example in which the source signal lines are turned on at the same time, connecting S1 to S5 simultaneously is merely an example, and they are connected to each other irrespective of the number of 2 to 10 or 100, It can be used as the sensor 10.

Meanwhile, a third example in which a plurality of pixels are connected and used as one enlarged touch sensor as described above is to use the first example method and the second method together. If the gate signal lines G1 to G6 are simultaneously turned on and the source signal lines S1 to S5 are simultaneously turned on, the 30 pixels connected to G1 to G6 and S1 to S5 of FIG. 3 are connected to each other As shown in Fig.

In the first example, when the gate signal line is all generated in the display device driving chip (for example, LDI, LCD Drive IC), the voltage level of the gate signal line turned on at the same time is determined in the display device driving chip . For example, when the gate signal lines G1 to G6 simultaneously output the turn-on voltage, all the gate signal lines originate from the display device driving chip, so that the voltage levels of G1 to G6 are determined and output from the display device driving chip.

Assuming that the turn-off voltage of the gate signal line is -10V and the turn-on voltage is + 15V, G1 to G6 should simultaneously output a state of + 15V. At this time, the voltage level of the remaining gate signal lines other than the gate signal line turned on at the same time should maintain a turn-off voltage of -10V. Meanwhile. When all the gate signal lines such as the GIP (Gate In Panel) are disposed on one side of the display device and only a part of the GIP control signal lines are outputted from the display device driving chip, the voltage level of the gate signal line is not outputted from the driving chip, Is determined in the GIP block mounted on one side.

For example, as shown in FIG. 7, which will be described later, the GIP means that the gate elements are not located in the IC but inside the Panel. That is, when the output voltages of G1 to G6 in Fig. 3 are + 15V, which is the turn-on voltage, the display device driving chip outputs a control signal to output the + 15V voltage to the GIP block through the GIP control signal line, In the GIP block provided on one side of the apparatus, the output voltage levels of G1 to G6 are output as + 15V based on the control signal.

When the display device of the embodiment of the present invention is an LCD, the LCD may have a storage capacitor (hereinafter referred to as Cst) in order to maintain the driving time of the liquid crystal.

Figures 4 and 5 illustrate one embodiment of the generation of a storage capacitor in an LCD that is a type of display device. For example, FIG. 4 shows a top view of an LCD display device, wherein the LCD shown in FIG. 4 may include three pixels 430. Although only one Cst 440 is shown in FIG. 4, in practice, Cst may exist for each pixel. One example of the formation of the storage capacitor may be formed by overlapping the pixel electrode constituting the pixel with the front gate signal line.

5 shows a side view of the LCD display device. When the n-th gate signal line 520 of FIG. 5 is turned on, the n-1th gate signal line 510, that is, A pixel electrode is overlapped on the upper surface of the pixel electrode. Referring to FIG. 5, Cst may be generated near the previous gate signal line by overlapping the pixel electrode 530 and the front gate signal line 510.

In the display device of the embodiment of the present invention, when the pixel is used as a touch sensor for performing touch detection, the storage capacitors in Figs. 4 and 5 can act as noise that weakens the magnitude of the touch signal detected in the pixel. Therefore, when the pixel is used as a touch sensor for touch detection, it is necessary to reduce or eliminate the size of the storage capacitor Cst in order to increase the touch signal.

6 is a view showing a structure for removing the storage capacitor Cst in the display device of the embodiment of the present invention. 6, one pixel electrode for displaying an image or an image may include a pixel electrode-1 (640) not involved in forming a storage capacitor and a pixel electrode-2 (650) involved in forming a storage capacitor .

For example, when performing an image or image display function, the pixel electrode-1 640 and the pixel electrode-2 650 are connected and operated as one pixel electrode, (640) and the pixel electrode-2 (650), so that only the pixel electrode-1 (640) operates as a touch sensor. The display device of the present invention can operate as a touch sensor at the same time as a pixel as a display component. Therefore, the operation period of the pixel may be composed of a display section that operates as a display component and a touch section that operates as a touch sensor.

In the section that operates as the display component, the pixel electrode-1 640 and the pixel electrode-2 650 are connected to operate as one pixel electrode, while in the section that operates as a touch sensor, the pixel electrode- The pixel electrode-2 650 is separated from the pixel electrode-1 650 so that only the pixel electrode-1 640 operates as a touch sensor.

Referring to FIG. 6, the pixel electrode-1 (640) for displaying the image and the pixel electrode-2 (650) for forming Cst may be formed of the same mask and may be located on the same layer, 1 640 and the pixel electrode-2 650 are connected in the display period but separated in the touch period in order to remove the storage capacitor Cst.

The display device of the embodiment of the present invention may include means for connecting and disconnecting the pixel electrode-1 640 and the pixel electrode-2 650. One embodiment of such means is a storage capacitor Cst on / off switch 660 present between the pixel electrode-1 640 and the pixel electrode-2 650. The storage capacitor Cst on / off switch 660 is the same switch as the switch (e.g., TFT switch) 630 that transmits the source data to the pixel electrode and is connected to the gate signal line.

In an embodiment of the present invention, the switch 660 for connecting and disconnecting the pixel electrode-1 640 and the pixel electrode-2 650 may be referred to as a storage capacitor Cst on / off switch, and the storage capacitor Cst on The / off switch 660 may be formed at the same time when the TFT switch 630 is formed. The Cst control signal is connected to the gate of the storage capacitor Cst on / off switch 660, and the storage capacitor Cst on / off switch 660 is turned on according to the voltage level of the Cst control signal Turn off.

When the storage capacitor Cst on / off switch 660 is turned on, the pixel electrode-1 640 and the pixel electrode-2 650 are connected to each other. When the storage capacitor Cst on / off switch 660 is turned off, the pixel electrode-1 640 and the pixel electrode-2 650 are separated from each other. In the display period, the pixel electrode-2 650 forms a storage capacitor with the front gate signal line 625. However, if the pixel electrode-1 640 and the pixel electrode-2 650 are separated from each other in the touch interval, the pixel electrode-1 640 is not affected by the storage capacitor Cst.

When the pixel electrode of the display device of the embodiment of the present invention is used as a touch sensor, the storage capacitor Cst on / off switch can be turned off to remove the storage capacitor existing in the pixel.

Fig. 7 is a diagram showing a configuration of a circuit diagram for displaying an image using the display device of Fig. 6; 7, it is obvious to a person skilled in the art that the gate signal line is sequentially turned on in order to display an image in the pixel and the pixel voltage is applied to the source signal line in synchronism therewith.

Since the pixel electrode-1 (for example, 750-1) and the pixel electrode-2 (for example, 760-1) should be connected to each other in the display period, the storage capacitor Cst on / off switch (for example, 1) must be turned on. In FIG. 7, only the pixel electrode-1 connected to the source signal line S4 and the gate signal line G1 is numbered 750-1, but the remaining pixel electrodes-1 connected to the gate signal line G1 should be recognized to have the same reference numerals.

For example, it is to be understood that the four pixel electrode-1 connected to the source signal lines S1 to S4 and the gate signal line G1 are numbered with reference numeral 750-1. The same is true for the remaining components. For example, only the pixel electrode-2 in the source signal line S4 and the dummy gate signal line Gdummy is numbered 760-1, but four pixel electrodes-2 connected to the source signal lines S1 to S4 and the dummy gate signal line Gdummy are numbered 760 -1. ≪ / RTI >

Accordingly, the term 'pixel electrode-1 (for example, 750-1) and pixel electrode-2 (for example, 760-1) are connected to each other' (Four pixel electrodes-1 (750-1) connected to the source signal lines S1 to S4) are connected to four pixel electrodes-2 (four pixel electrodes-2 connected to the source signal lines S1 to S4) RTI ID = 0.0 > 760-1. ≪ / RTI >

For example, it should be recognized that all four storage capacitors Cst on / off switches numbered 740-1 are turned on. Turning on or off of the storage capacitor Cst on / off switch 740-1 may turn on or off a signal originating from the display driver chip to drive the display or display device .

The gate terminal of the storage capacitor Cst on / off switch is connected to the output terminal of the inverter 730-1. The input terminal of the inverter 730-1 is connected to the previous gate signal line. That is, since the gate terminal of the storage capacitor Cst on / off switch 740-1 is connected to the output signal of the inverter 730-1, the storage capacitor Cst on / off switch 740-1 is applied to the front gate signal line Lt; RTI ID = 0.0 > voltage < / RTI >

In the display period in which the pixels included in the display device of the embodiment of the present invention display an image, the gate signal lines are turned on in a time-division manner. That is, the gate signal line (G1) 720-1 is turned on and all the other gate signal lines are turned off. When the gate signal line (G1) 720-1 is turned on, the first gate signal line is turned off after image data (source data) is applied to the pixel connected to the gate signal line (G1) 720-1.

After the gate signal line (G1) 720-1 is turned off, the gate signal line (G2) 720-2 is turned on. Then, the gate signal line (G3) 720-3 is turned on and the gate signal line (G2) 720-2 is turned off. When the gate signal line G1 720-1 is turned on in the step of displaying an image on the pixels, the TFT switch 770-1 connected to the gate signal line G1 720-1 is all turned on and connected to the turned on TFT switch The storage capacitor Cst on / off switch 740-1 is also all turned on so that the pixel electrode-2 (760-1) is connected to the pixel electrode-1 (750-1).

When the storage capacitor Cst on / off switch 740-1 is a switch having the same turn-on or turn-off characteristic as the TFT switch 770-1, the storage capacitor Cst on / off switch 740-1 is turned on The voltage applied to the gate of the storage capacitor Cst on / off switch should be the same as that of the turn-on voltage applied to the gate of the TFT switch 770-1, which voltage is connected to the gate signal line 720-dummy And supplied from inverter 730-1.

The inverter 730-1 receives the voltage of the gate signal line signal line as an input and reversely outputs the polarity of the input voltage. If the turn-on voltage of the TFT switch 770-1 or the storage capacitor Cst on / off switch 740-1 is 15V and the turn-off voltage is -10V, if the voltage of the gate signal line is 15V The inverter 730-1 which receives this as an input outputs -10V.

In addition, when the voltage of the gate signal line is -10V, which is the turn-off voltage, the inverter 730-1 which receives it as an input outputs + 15V. When the gate signal line G1 720-1 is turned on in the display period in which an image is displayed, to turn on the storage capacitor Cst on / off switch 740-1 interlocked with the gate signal line G1 720-1, A signal line is required and a separate dummy gate line (720-dummy) is added.

The dummy gate signal line 720-dummy provides a voltage to turn on the storage capacitor Cst on / off switch 740-1 when the gate signal line G1 720-1 is turned on to output an image. When the gate signal line 1 (G1) 720-1 is turned on, the storage capacitor Cst on / off switch 740-1 connected to the gate signal line 1 (G1) 720-1 is turned on, so that the dummy gate signal line 720- Should be maintained.

Therefore, the inverter 740-1 receiving the signal of the dummy gate signal line 720-dummy receives +15 V, which is the turn-on voltage, so that the storage capacitor Cst on / off switch 740-1 is turned on And the pixel electrode-1 (750-1) and the pixel electrode-2 (760-1) are interconnected to enable display of an image or an image. The dummy gate signal line 720-dummy preferably outputs the voltage in the turn-off state of the storage capacitor Cst on / off switch in the step of displaying only the image on the display device.

After the first gate signal line (G1) 720-1 is turned on and the image signal is transmitted in the step of displaying an image on the pixel, the first gate signal line G1 (720-1) The gate signal line G2 720-2 is turned on. When the second gate signal line G2 720-2 is turned on, the previous gate signal line of the second gate signal line G2 720-2 is the first gate signal line G1 720-1 and the first gate signal line G1 720-1, The inverter 730-2 connected to the first gate signal line G1 720-1 outputs a turn-on voltage to turn on the storage capacitor Cst on / off switch interlocked with the second gate signal line G2 720-2. Will be turned on.

The pixels connected to the second gate signal line G2 720-2 are connected to the second gate signal line G2 720-2, since the first gate signal line G1 720-1 maintains the turn-off state until the next turn- The liquid crystal voltage can be maintained by the voltage generated due to the charge accumulated in the pixel electrode-2 (760-2), so that a normal image can be expressed.

In FIG. 7, the inverter may be installed in a GIP (Gate In Panel) 780 provided on one side of the display device. The inverter also has the same configuration as the TFT switch 770-1 and the storage capacitor Cst on / off switch 740-1, and the TFT switch 770-1 and the storage capacitor Cst on / off switch 740-1 are formed . That is, when the gate signal line of the inverter is formed when the gate signal line of the TFT or the Cst on / off switch is formed and the source terminal or the drain terminal of the inverter is formed when the source terminal or the drain terminal of the TFT or Cst on / .

The inverter has the same structure as the TFT switch of Fig. It is preferable that the inverter has a resistance component at the source terminal. This is because it is easy to construct the inverter by inserting a resistor into the source terminal of the CMOS transistor or the collector terminal of the transistor, as is well known to those skilled in the art. The advantage of this invention is that it does not require a separate mask to fabricate the inverter since the inverter is created in the production phase of a TFT switch or storage capacitor Cst on / off switch.

The embodiment of FIG. 7 using four gate signal lines and four source signal lines is only one embodiment for explaining the present invention, and it can be actually constructed by including several thousands of gate signal lines and several thousand source signal lines. It is true.

8 is a view for explaining a voltage magnitude and a timing chart of the gate signal line in the image display step of the display device with reference to the circuit diagram of FIG. Referring to FIG. 8, when the voltage of the first gate signal line G1 720-1 is high, it is applied to the gate of the TFT switch 770-1 or the storage capacitor Cst on / off switch 740-1 The TFT switch 770-1 and the storage capacitor Cst on / off switch 740-1 are also turned on.

For example, in the display device of the embodiment of the present invention, it can be seen that the dummy gate signal line 720-dummy always maintains the low voltage in the step of displaying an image. In the image display step, when a specific gate signal line is turned on and image data is applied, the previous gate line is always kept in a low state.

On the other hand, the inverter connected to the front gate signal line outputs a high state, and the storage capacitor Cst on / off switch connected to the inverter is turned on. The storage capacitor Cst on / off switch is turned on. The image electrode-1 and the image electrode-2 are connected and display an image.

Fig. 9 is a diagram showing a configuration of a circuit for detecting a touch using the display device of Fig. 6; Fig. Referring to FIG. 9, the touch detection method in the display device of the embodiment of the present invention has been described in which an enlarged touch sensor that combines a plurality of pixels into one can be used. For example, a plurality of gate signal lines are turned on and a plurality of source signal lines are turned on to connect a plurality of pixels to form an enlarged touch sensor.

The second gate signal line G2 920-2 and the third gate signal line G3 920-3 are turned on and the first source signal line S1 910-1 and the second source signal line S2 910-2 are turned on, Can be connected at the same time to form an enlarged touch sensor. And a touch detection section that detects whether or not the touch is allocated by allocating some time during a period in which a display step of displaying an image on the pixel is completed or an image is displayed on the pixel.

In the step of displaying an image using the pixel, the first source signal line S1 910-1 and the second source signal line S2 910-2 are separated, but in the step of detecting a touch using the pixel, S1 (910-1) and the second source signal line S2 (910-2) are coupled together.

The first source signal line S1 (910-1) and the second source signal line S2 (910-2) may be coupled to each other in a display device or in a display device driving chip. The first source signal line S1 (910-1) and the second source signal line S2 (910-2) coupled to the driving unit 31 of FIG. 1 and FIG. 2 detect the touch signal.

Four pixels connected to the second gate signal line G2 (920-2), the third gate signal line G3 (920-3), the first source signal line S1 (910-1) and the second source signal line S2 (910-2) Thereby forming an enlarged touch sensor. More gate signal lines can be turned on and more source signal lines can be turned on at the same time to form a wider enlarged touch sensor.

When the second gate signal line G2 920-2 and the third gate signal line G3 920-3 are simultaneously turned on, the storage capacitor Cst on / off switch connected to the third gate signal line G3 920-3 is turned off .

Since the storage capacitor Cst is turned off, the storage capacitor Cst formed to overlap the third gate signal line G3 920-3 is not formed. However, since the first gate signal line G1 920-1 is in a Low state, the storage capacitor Cst on / off switch 940-2 coupled to the second gate signal line G2 920-2 is turned on.

When the storage capacitor Cst on / off switch 940-2 is turned on, the pixel electrode-1 (950-2) and the pixel electrode-2 (960-2) connected to the second gate signal line G2 And the storage capacitor Cst is formed. The formed storage capacitor Cst acts as a noise at the time of touch detection, thereby deteriorating the touch sensitivity. In order to solve this problem, the first gate signal line (here, the second gate signal line G2 (920 - 2)) of the gate block (here, the second gate signal line G2 920-2 and the third gate signal line G3 920-3) 2) of the storage capacitor Cst.

The order of the gate signal lines in Fig. 9 can be determined by the distance from the driving touch IC. For example, when the driving touch IC is located below the third gate signal line in FIG. 9, the gate signal line located farthest from the gate signal line becomes the first gate signal line and increases in order.

For example, in a case where a pixel of the display device of FIG. 9 is used as a touch sensor, when a plurality of gate signal lines are simultaneously turned on, the previous gate signal line (Previous Gate line) of the first gate signal line among the plurality of gate signal lines turned on is low the pixel electrode-1 and the pixel electrode-2 are not separated from each other.

The first gate signal line in FIG. 9 does not mean the order of the specific gate signal line, but means a previous gate signal line (Previous Gate line) of the gate signal line turned on at the same time. For example, when the second gate signal line G2 (920-2) and the third gate signal line G3 (920-3) are simultaneously turned on to detect a touch, a gate block turned on simultaneously (here, the second gate signal line G2 The previous gate signal line (Previous Gate line) of the gate signal line (here, the second gate signal line G2 920-2) starting from the first gate signal line G2 (920-2) and the third gate signal line G3 (920-3) .

In a display device including hundreds of gate signal lines, when the 100th gate signal line G100 to the 200th gate signal line G200 are simultaneously turned on, that is, when the gate blocks G100 to G200 are simultaneously turned on, the 99th gate signal line G99 It becomes the front gate signal line above.

Further includes converters 990-1 through 990-3 to remove the storage capacitor Cst formed in association with the front gate signal line. The converter receives as input signal a separate control signal from the voltage level of the previous gate signal line and outputs a low voltage to the storage capacitor Cst switch connected to the converter.

9 receives a control signal different from that of the voltage of the previous gate signal line as an input signal of the converter of FIG. 9, the converter turns off the storage capacitor Cst switch connected in accordance with a separate control signal regardless of the voltage of the previous gate signal line G1 . In other words, the converter is configured to control the output of the inverter regardless of the signal applied to the front gate signal line to turn off the storage capacitor Cst switch.

For example, if the voltage of the previous gate signal line is high or low, if the separate control signal input to the converter is high, the output of the converter is high and the control signal is low, The output of the transducer may be configured to be low.

The display device of the embodiment of the present invention may further include (for example, a converter) a means for controlling the voltage of the gate signal line of the gate group of the gate group which is simultaneously turned on in the touch detection period. Such a control means may include gates that implement various logic states such as an inverter, a comparator, an OR gate and an AND gate, and an OPAMP. Such a control means can be manufactured at the same time with a mask making a TFT switch or a storage capacitor Cst on / off switch.

The control signal of the transducer may be applied at the GIP of the display device (e.g., GIP 780 of FIG. 7). Also, a clock (clock) necessary for generating the control signal generated by the GIP can be transmitted from the display device driving chip to the GIP.

The step of displaying the image and the step of detecting the touch may be simultaneously performed using the display device of the embodiment of the present invention. However, in this case, the touch detection system is complicated because the touch must be detected based on the image voltage applied to the individual pixels (each unit pixel), that is, the voltage applied to the source signal line.

It is impossible to distinguish a touch signal from a signal for displaying an image because the voltage applied to the pixel for detecting a touch on a plurality of pixels is the same as the voltage applied to the pixel for displaying an image. For this reason, it is preferable that a period for detecting a touch using pixels of the display device of the embodiment of the present invention is set separately from a period for displaying an image using the pixel.

Charges are stored in the storage capacitor Cst in a period in which an image is displayed using a pixel, and a pixel electrode-2 is separated in a pixel electrode-1 in a period in which a touch is detected using a pixel. When the pixel electrode-2 is touched, the pixel electrode-2 is connected to the pixel electrode-1 again when the corresponding gate block is turned off after the touch detection is completed. The image can be normally displayed while the pixel electrode-2 is connected.

As described above, the present invention can detect a touch after displaying an image on a pixel. In order to detect a touch using the display device according to the present invention, it is preferable not to display an image but to detect a touch, but to change the order thereof so that touch detection is performed first and an image is displayed.

It is possible to display a better image because the method of performing the touch detection first in the operating period of the pixel and then displaying the image after the image can minimize the fluctuation of the storage capacitor Cst.

For example, assuming a method of detecting a touch using a gate block that simultaneously turns on the 100th gate signal line G100 to the 200th gate signal line G200, the 100th gate signal line G100 to the 200th gate signal line G200 are simultaneously turned on After the touch is detected using the enlarged touch sensor, the image can be displayed using the 100th gate signal line G100 in a time-divisional manner.

Then, displaying an image after touch detection using the 100th gate signal line G100 to the 200th gate signal line G200, such as displaying an image using the 101st gate signal line G101, can more stably maintain the storage capacitor Cst . The above-mentioned method can be configured to display an image after the touch detection period in the driving period of the pixel.

A plurality of pixels (hereinafter referred to as pixel touch detecting portions) mutually connected to detect the touch are connected to the driving portion 31 shown in Figs. 1 and 2. The pixel touch detection unit connected to the driving unit 31 can detect a touch in synchronization with an AC voltage applied to a capacitor connected to the driving unit 31 or a parasitic capacitor formed between a plurality of source signal lines for touch detection. Detailed explanations for detecting the touch in synchronization with the AC voltage applied to the parasitic capacitor are described in detail in Korean Patent Publication Nos. 10-1059096, 10-1085088, 10-1472001 and 10-2013-0035243.

10 is a diagram illustrating in detail a process of detecting a touch in synchronization with an AC voltage applied to a parasitic capacitor. Referring to FIG. 10, only source signal lines and gate signal lines are shown except pixels and various kinds of switches.

10, a description will be made of a process of forming a widened touch sensor by interlocking a plurality of pixels by turning on a plurality of source signal lines at the same time so that a plurality of source signal lines can be connected to each other to detect a touch, It is omitted here. For example, the enlarged touch sensor is formed by simultaneously turning on the plurality of gate signal lines only in the arrangement direction of the signal lines, or the touch sensor is formed by turning on the plurality of source signal lines at the same time.

Referring to FIG. 10, four source signal lines are connected to each other, and actually, 10, 20, or 100 can be configured in various ways. In the embodiment of the present invention, the touch detection method using pixels uses an alternating AC voltage, and a typical waveform is a square wave. In order to detect the touch using the SS2 which connects the four source signal lines, a parasitic capacitor existing between SS2 and S1 and a parasitic capacitor existing between SS2 and SS3 are used.

For example, in order to detect a touch using SS2, alternate AC voltages must be applied to S1 and SS3 on the left and right sides of SS2, so that it is impossible to detect a touch on the signal lines on the left and right sides of the signal line (here SS2) . In order to solve this problem, in the embodiment of the present invention, a part of the interconnected source signal lines for detecting a touch detects a touch and an alternating AC voltage is applied to a part thereof.

For example, when touch signals are detected using odd-numbered interconnected source signal lines SS3, alternating AC voltages are applied to even-numbered interconnected source signal lines SS2 and SS4. Or odd-numbered mutually connected source signal lines (SS2), an alternate AC voltage is applied to odd-numbered interconnected signal lines.

Referring to FIG. 10, when S1 through S4 are interconnected, since there is no signal line forming a parasitic capacitor on the left of S1 through S4 connected to each other, when an alternate voltage is applied to the left and right parasitic capacitors to detect touch The magnitude of the detected touch signal is weakened. Therefore, dummy signal lines may further be provided on the left or right side of the source signal line located at the leftmost or rightmost position of the display device as in S1 and S14.

For example, a dummy signal line interconnected by a single line or two lines or three lines may be further connected to form a parasitic capacitor with a touch sensor formed using adjacent pixels to obtain enhanced touch sensitivity . The added dummy signal line may be a dummy signal line used only for touch detection. However, the source signal line for transmitting the image signal may be used as the dummy signal line.

Although the example of the dummy signal line described above discloses the source signal line, the dummy signal line may include at least one dummy gate signal line. The dummy gate signal line may be formed outside the outermost gate signal line. The outer side of the outermost gate signal line refers to the front end of the first gate signal line and the rear end of the last gate signal line.

For example, in FIG. 10, the dummy gate signal line may be a Gdummy signal line positioned at the front end of the first gate signal line and a G6 signal line if the last gate signal line is assumed to be a G5 signal line. The dummy source signal line may be formed outside the outermost source signal line. Outside the outermost source signal line refers to the left end of the first source signal line S1 and the right end of the rightmost source signal line S14.

11 is an exemplary diagram for performing fingerprint recognition using the display device of the embodiment of the present invention. Referring to FIG. 11, in FIG. 11, the plurality of pixels 1100 operate as at least one or more touch sensors. For example, FIG. 1 is an enlarged view of a touch sensor or a pixel, and FIG. 11 is a view illustrating a scale of a finger and a touch pixel in order to explain the fingerprint recognition process more clearly.

The size of the pixel 1100 varies depending on the resolution of the display device, but is generally several tens of um. For example, since the distance between the peak and the peak of the fingerprint in a finger of a human being is 100 μm or more, 1100) can be sufficiently detected.

11, the thumb recognizes the fingerprint of the thumb by recognizing the pattern of the fingerprint based on the touch signals output from the plurality of pixels indicated by the A area 1110, The fingerprint of the index finger is recognized by recognizing the pattern of the fingerprint based on the touch signals output from the plurality of pixels indicated by the B area 1120. [

Here, the fingerprint recognition operation as described above may be performed by a CPU 40 (or a processor, hereinafter referred to as a " processor ") that may be included in the operation unit 30 or may be a separate configuration externally, ). ≪ / RTI > Here, the processor is not limited to the CPU 40.

For example, the processor may be a host that receives a touch coordinate value through the communication unit 46 of Fig. 1, and may also be an application in various types of electronic devices (e.g., a smart phone) Processor or the like.

The processor recognizes a pattern of a fingerprint based on a touch signal output from a plurality of pixels, and detects a change in a touch capacitance value formed between each pixel and an area where the fingerprint is formed according to a pattern of the fingerprint.

The processor can scan the fingerprint of the thumb by calculating the touch capacitance values of a plurality of pixels belonging to the A region 1100 and by calculating the touch capacitance values of the plurality of pixels belonging to the B region 1120, Can scan the fingerprint of the user. As an example, fingerprint scanning is possible by mapping and mapping the detected capacitance values in the pixels included in the A region 1100 or the B region 1120.

According to the embodiment of the present invention, the processor can recognize the fingerprint of the thumb and the finger of the index finger based on the touch signal output from the pixels, and the fingerprint recognition operation is continuously performed twice The accuracy of the fingerprint recognition can be further improved.

Here, the repetition of the above-mentioned two or more repetitions may be performed by, for example, displaying a guidance message or the like through a GUI (Graphic User Interfce) so that the user can know, The fingerprint recognition operation can be repeatedly performed twice or more continuously within a shortest time as soon as it is detected. The processor can perform a user authentication operation by combining the fingerprint patterns obtained as a result of repeating two or more consecutive fingerprint recognition operations as described above.

The processor recognizes fingerprints of the plurality of fingers when a touch is generated or displays a UI icon requiring security such as billing approval in a specific operation mode requiring a security such as a login operation At the specific position of the finger, when the touch is generated, the fingerprint of the plurality of fingers can be recognized. Here, the processor may perform two or more consecutive fingerprint recognition operations as needed, and then combine the fingerprint patterns obtained as a result to further enhance the user authentication operation.

The processor may perform the fingerprint recognition operation as described above at all times or at a touch cycle of N times (e.g., five times). If it is determined that the user authentication is valid as a result of performing the fingerprint recognition operation , Perform an operation corresponding to a touch generated before the authentication, or perform an operation corresponding to a touch generated after the authentication.

12 is an enlarged view of a part of a display device according to another embodiment of the present invention. 12, the touch sensor 1210 is mounted on a display device such as an LCD by a metal mesh method. For example, a touch sensor 1210 of a mesh pattern may be formed on the upper surface of a color filter of a display device (e.g., an LCD).

In this case, a color indicating resin may be present in the form of Red / Green / Blue on the opposite side of the surface where the touch sensor 1210 is patted to the color filter, and red, green, Pixels, and a form in which three pixels 1270a, 1270b, and 1270c of R / G / B are combined is defined as a dot (Dot) 1270.

The example of Fig. 12 is an enlarged view of a color filter composed of six dots 1270 in the horizontal direction and five dots 1270 in the vertical direction. A touch sensor 1210 may be located in a BM (Black Matrix) 1275 which is a boundary between the pixels 1270a, 1270b, and 1270c. The BM 1275 functions to cover a signal line connected to each of the pixels 1270a, 1270b and 1270c of the LCD, to distinguish colors of pixels, and to be arranged in a width of about several um to several tens of um .

The BM 1275 is composed of a black-based material that is not reflected and is not transmitted. The BM 1275 is located at the interface between the resin under the color filter and the occupancy rate of the BM 1275 in one pixel 1270a, 1270b, It is about 20% ~ 50%. Therefore, even if the touch sensor 1210 is formed in a mesh pattern on the BM 1275, a sufficient area of the touch sensor can be secured.

The touch sensor 1210 of the mesh pattern may be located at a BM corresponding to an interface between pixels and one touch sensor 1210 may be formed to accommodate four dots 1270 . The touch sensor 1210 can be connected to each other in a lattice structure within the BM 1275 around the pixels 1270a, 1270b and 1270c and the dot 1270, and the signal line 1222 can also be connected to the BM 1275 And can be connected to the touch drive IC.

The touch sensor 1210 and the signal line 1222 can be disposed on the BM 1275 so that the touch sensor 1210 and the signal line 1222 can be made of a metal having a high conductivity and high resistance to stress (metal).

Accordingly, the touch sensor 1210 and the signal line 1222 can be formed of a single mask, and the resistance value of the signal line 1222 can be lowered, so that the wiring resistance need not be considerably taken into consideration. Even if the touch sensor 1210 and the signal line 1222 are made of metal, the aperture ratio of the pixel is not lowered and the conductivity of the metal is excellent, so that the signal can be stably transmitted to the touch driver IC.

As described above with reference to Fig. 11, the size of the pixel varies depending on the resolution of the display device but generally has a size of several tens of um. For example, in a human finger, the distance between the peak and the peak of the fingerprint is 100um or more The touch signal output from the touch sensor of the mesh pattern located in the BM area between several pixels (for example, 4 X 4) has a sufficient resolution that can be used for fingerprint sensing.

11, the thumbprint of the thumb can be recognized by recognizing the pattern of the fingerprint based on the touch signals output from the touch sensors of the mesh pattern corresponding to the area A 1110, The index finger can recognize the fingerprint of the index finger by recognizing the pattern of the fingerprint based on the touch signals output from the touch sensors of the mesh pattern corresponding to the B area 1120. [

here. The above-described fingerprint recognition operation may be performed by a CPU 40 (or a processor, hereinafter referred to as a processor), which may be included in the operation unit 30 or may be a separate configuration externally, for example, ). ≪ / RTI > Here, the processor is not limited to the CPU 40.

For example, the processor may be a host that receives a touch coordinate value through the communication unit 46 of Fig. 1, and may also be an application in various types of electronic devices (e.g., a smart phone) Processor or the like.

The processor can recognize the pattern of the fingerprint based on the touch signal output from the plurality of touch sensors and can recognize the fingerprint of the thumbprint of the area A 1100 and the fingerprint of the area B 1120 of FIG. The fingerprint can be recognized at the same time.

According to the embodiment of the present invention, the processor can recognize the thumbprint of the thumb and the fingerprint of the index finger based on the touch signal, and by repeatedly performing the fingerprint recognition operation two or more times, The accuracy of recognition can be further improved.

Herein, the above-mentioned repetition of the above-mentioned two or more repetitive operations may be performed by displaying a guide message or the like through a GUI for the user to know, or at the moment when a user's touch is detected without a separate GUI, The fingerprint recognition operation can be repeatedly performed two or more times in the shortest possible time. The processor can perform a user authentication operation by combining a plurality of fingerprint patterns obtained as a result of repeating two or more successive fingerprint recognition operations as described above.

The processor recognizes fingerprints of the plurality of fingers when a touch is generated or displays a UI icon requiring security such as billing approval in a specific operation mode requiring a security such as a login operation At the specific position of the finger, when the touch is generated, the fingerprint of the plurality of fingers can be recognized. Here, the processor may perform two or more consecutive fingerprint recognition operations as needed, and then combine the fingerprint patterns obtained as a result to further enhance the user authentication operation.

The processor may perform the fingerprint recognition operation as described above at all times or at a touch cycle of N times (e.g., five times). If it is determined that the user authentication is valid as a result of performing the fingerprint recognition operation , Perform an operation corresponding to a touch generated before the user authentication, or perform an operation corresponding to a touch generated after the user authentication.

The touch sensor of the mesh pattern can be applied not only to a display device such as an LCD, but also to an organic light emitting diode (OLED) display device and an AMOLED display device. have.

13 is a view illustrating a laminated structure of a display device according to another embodiment of the present invention. 13, for example, the AMOLED display device 1300 includes a display layer 1314, a transparent substrate portion 1313, a phase difference polarizing layer 1312, a polarizing plate 1311, and a window 1310 And may have a laminated structure.

The display layer 1314 may be formed of an organic light emitting diode (OLED) or an active matrix organic light emitting diode (AMOLED).

A touch sensor TS and a signal line may be integrated in a mesh pattern on the transparent substrate portion 1313 disposed between the display layer 1314 and the phase difference polarizing layer 1312.

13, the touch sensor TS and the signal line (not shown) of the mesh pattern may be formed on the lower surface of the transparent substrate portion 1313, The signal line TS and the signal line may be formed so as to correspond to a BM (Black Matrix) region existing between the pixel P and the pixel P of the display layer 1314. Here, the BM region may be variously referred to as any other name.

The touch sensor and the signal line of the mesh pattern formed on the upper surface of the transparent substrate portion 1313 may be formed on the upper surface as well as the lower surface of the transparent substrate portion 1313, have.

Here, the touch sensor and the signal line of the mesh pattern may be various types of opaque metal materials such as electrically conductive silver, carbon, graphene, aluminum or copper, and the transparent substrate portion 1313 may be made of, Various types of flexible materials such as flexible films may be used. The retardation polarizing layer 1312, the polarizing plate 1311, and the window 1310 are well known in the art, and a detailed description thereof will be omitted.

According to the embodiment of the present invention, the processor can recognize the fingerprint of the thumb and the finger of the index finger based on the touch signal output from the touch sensor, and the fingerprint recognition operation is continuously performed twice The accuracy of the fingerprint recognition can be further improved.

Here, the repetition of the above-mentioned two or more repetitions may be performed as soon as the touch of the user is detected, for example, without any separate GUI, so that the user can know the guidance message or the like through the GUI It is possible to repeatedly perform two or more successive fingerprint recognition operations within a short time. The processor can perform a user authentication operation by combining the fingerprint patterns obtained as a result of repeating two or more consecutive fingerprint recognition operations as described above.

The processor recognizes fingerprints of the plurality of fingers when a touch is generated or displays a UI icon requiring security such as billing approval in a specific operation mode requiring a security such as a login operation At the specific position of the finger, when the touch is generated, the fingerprint of the plurality of fingers can be recognized. Here, the processor may perform two or more consecutive fingerprint recognition operations as needed, and then combine the fingerprint patterns obtained as a result to further enhance the user authentication operation.

The processor may perform the fingerprint recognition operation as described above at all times or at a touch cycle of N times (e.g., five times). If it is determined that the user authentication is valid as a result of performing the fingerprint recognition operation , Perform an operation corresponding to a touch generated before the user authentication, or perform an operation corresponding to a touch generated after the user authentication.

The embodiments of the present invention described in detail above may be implemented individually or in combination with each other. The present invention described above is not limited to the above-described embodiment and the accompanying drawings, and various substitutions, modifications and variations are possible without departing from the technical spirit of the present invention. Which will be apparent to those skilled in the art to which the present invention pertains.

610, 615: source signal lines 620, 625: gate signal lines
630: TFT switch 640: pixel electrode-1
650: pixel electrode -2 660: storage capacitor Cst switch
730-1: inverter 990-1: converter

Claims (24)

In a display device provided with a touch function,
A pixel that displays an image and operates as a touch sensor; And
And a processor for performing a fingerprint recognition operation of the user based on the touch signal output from the pixel,
Wherein the processor operates the display device by time division into a display section and a touch detection section,
A fingerprint sensor for detecting a fingerprint of a plurality of fingers simultaneously based on a touch signal output from a pixel disposed in the entire display area of the display device during the touch detection period,
And performing a user authentication operation based on the fingerprints of the plurality of simultaneously recognized fingers.
delete The method according to claim 1,
Wherein the processor repeats the operation of recognizing the fingerprint of the plurality of fingers continuously, more than two times, based on the touch signal.
The method of claim 3,
Wherein the processor performs a user authentication operation by combining the results repeated two or more times in succession.
The method according to claim 1,
Wherein the processor performs an operation of recognizing fingerprints of the plurality of fingers at a time of occurrence of a touch, always or N times in a touch cycle.
The method according to claim 1,
Wherein the processor performs an operation of recognizing a fingerprint of the plurality of fingers when a touch is generated in a specific operation mode or at a specific coordinate position.
A fingerprint recognition method for a display device having a touch function,
Time-divisionally operating the display device by a processor into a display section and a touch detection section;
Receiving a touch signal output from a pixel disposed on the entire display region of the display device during the touch detection period and displaying an image and operating as a touch sensor;
Recognizing fingerprints of a plurality of fingers simultaneously based on the received touch signal; And
And performing a user authentication operation based on the fingerprints of the plurality of simultaneously recognized fingers.
delete 8. The method of claim 7,
Wherein the recognizing step repeats the operation of recognizing the fingerprint of the plurality of fingers on the basis of the touch signal successively two or more times.
10. The method of claim 9,
Wherein the step of performing a user authentication operation is performed by combining the results repeated two or more times in succession.
8. The method of claim 7,
Wherein the performing step comprises performing an operation of recognizing fingerprints of the plurality of fingers at a time of generating a touch, always or N times in a touch cycle.
8. The method of claim 7,
Wherein the step of performing fingerprint recognition of the plurality of fingers is performed when a touch is generated in a specific operation mode or at a specific coordinate position.
In a display device provided with a touch function,
A touch sensor mounted on a boundary surface between pixels displaying an image in the form of a metal mesh; And
And a processor for performing a fingerprint recognition operation of the user based on the touch signal output from the touch sensor,
Wherein the processor simultaneously recognizes fingerprints of a plurality of fingers based on a touch signal outputted from a touch sensor mounted in a metal mesh form on a boundary surface between pixels arranged over the entire display area of the display device,
And performing a user authentication operation based on the fingerprints of the plurality of simultaneously recognized fingers.
delete 14. The method of claim 13,
Wherein the processor repeats the operation of recognizing the fingerprint of the plurality of fingers continuously, more than two times, based on the touch signal.
16. The method of claim 15,
Wherein the processor performs a user authentication operation by combining the results repeated two or more times in succession.
14. The method of claim 13,
Wherein the processor performs an operation of recognizing fingerprints of the plurality of fingers at a time of occurrence of a touch, always or N times in a touch cycle.
14. The method of claim 13,
Wherein the processor performs an operation of recognizing a fingerprint of the plurality of fingers when a touch is generated in a specific operation mode or at a specific coordinate position.
A fingerprint recognition method for a display device having a touch function,
Receiving touch signals output from a touch sensor mounted on a boundary surface between pixels for displaying an image, the touch sensor being disposed in the display region of the display device;
Recognizing fingerprints of a plurality of fingers simultaneously based on the received touch signal; And
And performing a user authentication operation based on the fingerprints of the plurality of simultaneously recognized fingers.
delete 20. The method of claim 19,
Wherein the step of performing the fingerprint recognition of the plurality of fingers repeatedly consecutively two or more times on the basis of the touch signal.
22. The method of claim 21,
Wherein the step of performing a user authentication operation is performed by combining the results repeated two or more times in succession.
20. The method of claim 19,
Wherein the performing step comprises performing an operation of recognizing fingerprints of the plurality of fingers at a time of generating a touch, always or N times in a touch cycle.
20. The method of claim 19,
Wherein the step of performing fingerprint recognition of the plurality of fingers is performed when a touch is generated in a specific operation mode or at a specific coordinate position.

Images