KR20190079289A - display device and mobile terminal using the same - Google Patents

Abstract

The present invention relates to a display apparatus, and to a mobile terminal using the same. The display apparatus comprises: a touch sensor sensing touch input on a screen of the display panel; a force sensor sensing pressure of the touch input when the touch input is positioned in a predetermined fingerprint sensing region; and a fingerprint sensor driven when the pressure of the touch input sensed by the force sensor is equal to or greater than a predetermined pressure to sense a fingerprint at the touch input position.

Description

The present invention relates to a display device and a mobile terminal using the same,

The present invention relates to a display device including a fingerprint sensor and a force sensor, and a mobile terminal using the same.

Biometrics recognizes a person's unchanging physical characteristics, such as fingerprints and voices, to identify or identify registered users. Biometric information used in biometrics technology includes fingerprint, face, and iris. Recently, various biometric technologies have been applied to information security in various information devices. In the case of high-end smart phones, biometrics technology is being applied competitively.

The fingerprint recognition system is a typical biometric system used in most information devices. Background Art [0002] A fingerprint sensor used in a fingerprint recognition device includes a capacitive type, an ultrasonic type, and an optical type. Ultrasonic fingerprint sensors and optical fingerprint sensors have a disadvantage in that the fingerprint recognition rate differs greatly depending on the fingerprint state or environment of the user.

If there is no input signal for a predetermined period of time, the mobile terminal is switched to a sleep mode (sleep mode or standby mode) to reduce power consumption. However, since the fingerprint recognition apparatus operates in the standby mode, power consumption is generated in the standby mode.

The present invention provides a fingerprint recognition device capable of improving a fingerprint recognition rate without being affected by a fingerprint state or environment of a user, a display device using the fingerprint recognition device, and a mobile terminal.

A display device of the present invention includes a display panel for displaying an image on a screen, a touch sensor for sensing a touch input on a screen of the display panel, a sensor for sensing a pressure of the touch input when the touch input is located in a preset fingerprint sensing area, And a fingerprint sensor that is driven when the pressure of the touch input sensed by the force sensor is equal to or higher than a predetermined pressure to sense a fingerprint of the touch input position.

The mobile terminal includes a display panel for displaying an image on a screen, a display panel driver for writing pixel data of the input image to pixels of the display panel, a touch sensor for sensing a touch input on a screen of the display panel, A force sensor which senses the pressure of the touch input when the touch input is located in a preset fingerprint sensing area, a sensor which is driven when the pressure of the touch input sensed by the force sensor is equal to or higher than a predetermined pressure, And fingerprint sensor data obtained from the fingerprint sensor are transmitted to the display panel drive unit, and the fingerprint sensor data received from the fingerprint sensor and the fingerprint sensor data received from the fingerprint sensor are transmitted to the display panel drive unit And a host system. The host system performs fingerprint authentication on the fingerprint data received after the touch data and the force data are received.

The present invention uses a force sensor to sense the fingerprint only when the pressure of the fingerprint is higher than a predetermined pressure, thereby inducing an increase in the contact area of the fingerprint. As a result, the present invention can improve the fingerprint recognition rate without being affected by the fingerprint state or environment of the user.

In addition, the present invention drives the force sensor only when the touch input is confirmed on the fingerprint sensing area and prevents the malfunction by driving the fingerprint sensor only when the pressure of the touch input (fingerprint) is equal to or higher than a predetermined pressure, Can be improved.

1A is a plan view schematically illustrating a front surface of a mobile terminal according to an exemplary embodiment of the present invention.
1B is a view illustrating a display device according to an embodiment of the present invention.
2 is a block diagram illustrating a mobile terminal according to an embodiment of the present invention.
3 and 4 are views schematically showing the external appearance and internal structure of the mobile terminal according to the embodiment of the present invention.
5A to 5C are views showing flexible printed circuits connected to a display device.
7A to 7D are circuit diagrams showing the touch and force sensor driving unit in detail.
8 is a detailed view showing a top plate and a bottom plate structure of the FSR type force sensor.
9 is a cross-sectional view of the force sensor taken along the line " I-I " in Fig.
10 is a view showing an operation principle of the FSR type force sensor.
11 is a view showing a fingerprint image obtained through a fingerprint sensor in a general fingerprint.
12 is a view showing a fingerprint image obtained through a fingerprint sensor in a dry fingerprint.
13 is a view showing a change in the fingerprint image obtained from the fingerprint sensor when the pressure of the dried fingerprint is increased.
14 is a flowchart illustrating fingerprint sensing and authentication in a sleep mode.
15 is a flowchart showing a fingerprint sensing method in the normal drive mode.
16A and 16B are views showing a directional light source device according to an embodiment of the present invention.
17 is a cross-sectional view showing a light path in the transparent substrate shown in Figs. 16A and 16B.
18A and 18B are views showing a directional light source device disposed on a display panel.
19 is a diagram showing an example in which a directional light source device, a fingerprint sensor, and a force sensor are arranged on a display panel.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. It should be noted that the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms. The following embodiments are provided so that the disclosure of the present invention is complete and that those skilled in the art will fully understand the scope of the present invention. The invention is defined by the claims.

The shapes, sizes, ratios, angles, numbers, and the like disclosed in the drawings for describing the embodiments of the present invention are illustrative, and thus the present invention is not limited thereto. Like reference numerals refer to like elements throughout the specification. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Where the terms "comprises", "having", "done", and the like are used in this specification, other portions may be added unless "only" is used. Unless the context clearly dictates otherwise, including the plural unless the context clearly dictates otherwise.

In interpreting the constituent elements, it is construed to include the error range even if there is no separate description.

In the case of a description of the positional relationship, for example, if the positional relationship between two parts is described as 'on', 'on top', 'under', and 'next to' Or " direct " is not used, one or more other portions may be located between the two portions.

In the description of the embodiments, the first, second, etc. are used to describe various components, but these components are not limited by these terms. These terms are used only to distinguish one component from another.

Like reference numerals refer to like elements throughout the specification.

It is to be understood that each of the features of the various embodiments of the present invention may be combined or combined with each other partially or wholly and technically various interlocking and driving are possible and that the embodiments may be practiced independently of each other, It is possible.

A display device of the present invention senses a fingerprint of a user who touches a screen on which an image is displayed, and the fingerprint sensor is driven when the pressure of the fingerprint is equal to or higher than a predetermined pressure.

The display device of the present invention is not limited as long as the fingerprint sensor and the force sensor can be disposed. The display device may be a flat panel display device such as a liquid crystal display (LCD), an electroluminescence display, a field emission display (FED), a plasma display panel (PDP) Lt; / RTI > An electroluminescent display device is classified into an inorganic light emitting display device and an organic light emitting display device depending on the material of the light emitting layer.

The pixels of an active matrix type organic light emitting display include organic light emitting diodes (OLEDs) that emit light by themselves. The organic light emitting display device has a high response speed and excellent luminous efficiency, luminance, viewing angle and the like, as well as excellent contrast ratios and color reproducibility since black gradations can be expressed entirely in black. Hereinafter, the display device of the present invention will be described mainly with reference to the organic light emitting display device, but the present invention is not limited thereto.

Various embodiments of the present invention will now be described in detail with reference to the accompanying drawings. In the following embodiments, an electroluminescent display device will be described mainly with respect to an organic light emitting display device including an organic light emitting material. However, it should be noted that the technical idea of the present invention is not limited to the organic light emitting display, but can be applied to an inorganic light emitting display device including an inorganic light emitting material.

1A is a plan view schematically illustrating a front surface of a mobile terminal according to an exemplary embodiment of the present invention. 1B is a view illustrating a display device according to an embodiment of the present invention. FIG. 1B is a cross-sectional view of a display device taken along line A-A 'in FIG. 1A along with a block diagram of a driving circuit.

1A and 1B, a display device according to the present invention includes a display panel 50 including a touch screen, a display panel driver 12 for driving the display panel 50, a fingerprint disposed under the display panel 50, A sensor 32 and a force sensor 24 disposed close to the fingerprint sensor 32. [ The display device of the present invention further includes a touch and force sensor driving unit 20, a fingerprint sensor driving unit 30, and a sensor signal processing unit 40.

The screen of the display panel 50 includes a pixel array for displaying an input image. The pixel array includes a plurality of data lines, a plurality of gate lines (or scan lines) intersecting the data lines, and pixels arranged in a matrix form. Each of the pixels may be divided into a red subpixel, a green subpixel, and a blue subpixel for color implementation. Each of the pixels may further include a white subpixel. Each of the subpixels includes a light emitting element such as an OLED.

Touch sensors 22 for implementing a touch screen may be disposed on the screen of the display panel 50. [ The touch sensors may be in-cell type touch sensors disposed on the screen of the display panel 50 in an on-cell type or an add-on type or embedded in a pixel array . ≪ / RTI >

A transparent substrate 60 may be adhered to the entire surface of the display panel 50. The transparent substrate 60 may be used as a cover glass of a mobile terminal. A foam pad 52 and a metal layer 54 may be laminated on the rear surface of the display panel 50.

A fingerprint sensor 32 and a force sensor 24 are disposed on the rear surface of the display panel 50. The fingerprint sensor 32 is bonded to the display panel 50 through the opening hole penetrating the foam pad 52 and the metal layer 54 and exposing the display panel 50. [ The fingerprint sensor 32 may be implemented as an ultrasonic sensor or an optical sensor. The fingerprint sensor 32 receives the ultrasonic sound or light reflected from the fingerprint on the opposite side of the fingerprint contact surface with the display panel 50 therebetween to sense the fingerprint pattern. The force sensor 24 is disposed close to the fingerprint sensor 32 to sense the pressure applied to the fingerprint sensing area.

The display panel driving unit 12 writes the pixel data of the input image on the pixels of the display panel 50 under the control of the timing controller 10 and displays the input image on the screen of the display panel 50. The display panel driving unit 12 displays an input image on a pixel array of the entire screen of the display panel 50 in the normal driving mode of the mobile terminal. On the other hand, in the sleep mode of the mobile terminal, the display panel driving unit 12 drives only some pixel regions of the screen of the display panel 50 at a low luminance, and displays predetermined information or images on a part of the screen at low luminance can do.

The display panel driver 12 includes a data driver and a gate driver. The data driver converts the pixel data (digital data) of the input image received from the timing controller 10 to the analog gamma compensation voltage every frame period using a digital-to-analog converter (DAC) And outputs the data voltage. The gate driver sequentially supplies a gate signal synchronized with the data voltage to the gate lines under the control of the timing controller 10 by using a shift register.

The timing controller 10 receives pixel data of an input image from the host system and a timing signal synchronized with the pixel data. The timing controller 10 transmits the pixel data of the input image to the data driver, and controls the operation timing of the data driver and the gate driver.

The touch and force sensor driving unit 20 drives the touch sensor 22 and the force sensor 24. The touch and force sensor driving unit 20 amplifies the touch sensor signal received from the touch sensor 22, converts the touch sensor signal into digital data through an analog to digital converter (ADC), compares the data with a preset reference value And determines that the data exceeding the reference value is a touch input. The touch and force sensor driving unit 20 transmits touch data including coordinate information of the touch input position to the sensor signal processing unit 40.

The touch and force sensor driving unit 20 amplifies the force sensor signal received from the force sensor 24, converts the force sensor signal into digital data through the ADC, generates force data, and transmits the force data to the sensor signal processing unit 40.

In the present invention, the touch sensor 22 and the force sensor 24 may share the sensing portion of the touch and force sensor driver 20 as shown in FIG. 7D. The sensing section includes an inverting amplifier and an ADC. The touch and force sensor driving unit 20 may be divided into a touch sensor driving unit for driving the touch sensor 22 and a force sensor driving unit for driving the force sensor 24. [

The fingerprint sensor driving unit 30 drives the fingerprint sensor 32. [ The fingerprint sensor 32 amplifies the signal obtained from the fingerprint and converts it into digital data through the ADC to generate fingerprint data including the fingerprint pattern information. The fingerprint sensor driving unit 30 transmits the fingerprint data output from the fingerprint sensor 32 to the sensor signal processing unit 40.

When the touch input is sensed on the fingerprint sensing area upon receipt of the touch data, the sensor signal processor 40 enables the fingerprint sensor driver 30 when the pressure of the fingerprint sensing area is equal to or greater than a preset threshold value according to the force data, Sensing. The sensor signal processing unit 40 may be disposed in the display device 100 or may be embedded in the host system 200 of the mobile terminal shown in Fig.

2 is a block diagram illustrating a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 2, the mobile terminal of the present invention includes a host system 200 connected to a display device 100.

The host system 200 controls the entire function of the mobile device. The host system 200 may be implemented as an AP (Application Processor). The host system 200 is connected to peripheral devices including the display device 100 through a Mobile Industry Processor Interface (MIPI) to control input / output between peripheral devices.

The main board on which the host system 200 is mounted is connected to a sensor unit, an input unit, an output unit, a communication unit, an interface unit, a memory, and a power supply unit. The sensor unit includes sensors 22, 24 and 32 disposed on the display panel 50, a fingerprint sensor, a heart rate sensor, a proximity sensor, an illumination sensor, an acceleration sensor, a sensor such as a magnetic sensor, a G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, or a fingerprint sensor Iris recognition sensor, facial recognition sensor), and the like. The image sensor may include a camera.

The input section is a microphone. A touch sensor, a keypad, and the like. The output unit may include a display device 50, an acoustic output module, a haptrip module, and an optical output module. The communication unit may include at least one of a broadcast receiving module, a mobile communication module, a wireless Internet module, a short distance communication module, and a location information module.

The interface unit provides an interface between the host system 200 and an external device. The interface unit includes a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port , A video I / O port, and an earphone port.

The memory may store an application program (an application program, an application, preset data and commands for controlling all operations of the mobile terminal). At least a part of the application program may be downloaded from an external server via wireless communication At least at the time of shipment of a mobile device or a wearable device, a program that executes at least a basic function is basically stored in a memory, and the basic functions include, for example, a phone call reception function, a message reception function, a message reception function, But are not limited thereto.

The main power supply unit connected to the host system 200 receives power from an external power source and generates power necessary for driving the mobile equipment. The main power supply unit includes a battery. The display module power module generates a power source necessary for driving the display device 50 as an input voltage from the main power supply unit.

The host system 200 converts the resolution of the video signal received from the video source into pixel data of the video signal matching the resolution of the display panel 50 and transmits the pixel data to the timing controller 10. The host system 200 may include the sensor signal processing unit 40 shown in FIG.

The mobile terminal of the present invention can be driven in a normal driving mode and a sleep mode. The host system controls the mobile terminal when there is no input signal for a predetermined time, and switches to the normal drive mode when an input signal is generated within a predetermined time. In normal drive mode, all circuits operate normally, while in sleep mode only minimal circuitry is driven, resulting in lower power consumption. The display device displays data at a high luminance throughout the screen in the normal drive mode, while a part of the display panel in the sleep mode can be driven at a low luminance.

The host system 200 transmits a wake-up signal to the peripheral devices including the display device 100 when the fingerprint is authenticated through the fingerprint authentication process shown in FIG. 14 in the sleep mode, It is possible to switch to the drive mode. In addition, the host system 200 executes an application related to the touch data 2D and force data 3D received through the process as shown in FIG. 15 in the normal drive mode, and performs the authentication procedure for the fingerprint data.

3 and 4 are views schematically showing the external appearance and internal structure of the mobile terminal according to the embodiment of the present invention. 3 and 4 illustrate a mobile information terminal having a full touch screen structure, but the present invention is not limited thereto.

3 and 4, the mobile terminal of the present invention includes a display panel 50, a front cover 211, a back cover 213, a mid frame 212, a battery 214, and the like. Here, the "cover" may be represented by a case and a housing.

The front surface of the display panel 50 can be covered by the transparent substrate 60. The transparent substrate 60 may be embodied as tempered glass. The front cover 211 covers the edges of the display panel 50 and the transparent substrate 60. A front camera and various sensors may be disposed on a front surface of the mobile information terminal. A back camera and various sensors may be disposed on the back of the mobile terminal.

A display panel 50, a mid frame 212, a main board on which the host system 200 is mounted, a battery 214, and the like are disposed in a space between the front cover 211 and the back cover 213. The mid frame 212 supports the display panel 50 and spatially separates the display panel 50 from the main board. The drive IC 110 and the flexible printed circuit (FPC) 120 are bonded to the display panel 50. The drive IC 110 may include the display panel driver 12 and the timing controller 10 shown in FIG. The flexible printed circuit 120 may include a plurality of flexible printed circuits as shown in Figures 5A-5C.

The main board includes a host system 200 and a main power supply unit. The main board is connected to various peripheral devices and the battery 214. The main board is connected to the display device 100 through the flexible printed circuit 120.

5A to 5C are views showing flexible printed circuits 121, 122 and 33 connected to the display device 100 with the back cover 213 and the battery 214 separated from each other.

5A to 5C, the first flexible printed circuit 121 connects the drive IC 110 to the main board on which the host system 200 is mounted. The second flexible printed circuit 122 includes an IC on which the touch and force sensor driver 20 is mounted. The second flexible printed circuit 122 connects the touch sensor 22 on the display panel 50 to the touch and force sensor driver 20 and the touch and force sensor driver 20 to the host system 200 Connect. The third flexible printed circuit 33 includes a fingerprint sensor 32. The third flexible printed circuit 33 is connected to the connector on the first flexible printed circuit 121 to connect the fingerprint sensor 32 to the host system (not shown) via the first flexible printed circuit 121 200).

The force sensor 24 may be connected to the host system 200 by being connected to a connector on the second flexible printed circuit 122 as shown in FIG. 5A. The force sensor 24 may be connected to the host system 200 by being connected to a connector on the third flexible printed circuit 33 as shown in FIG. 5B. The force sensor 24 may be directly connected to the connector on the main board on which the host system 200 is mounted, separated from the flexible printed circuits 121, 122, 33 as shown in Fig. 5C. Such a force sensor 24 may be manufactured in various structures in consideration of the arrangement of peripheral components in the mobile terminal as shown in FIG. 6, the force sensor 24 may be formed in a shape that surrounds at least two sides of the fingerprint sensor 32, for example, a rectangular band shape or an L shape. The L-shaped force sensor 24 surrounds two sides including one corner of the fingerprint sensor 32. A tail portion 24a extended from one side of the force sensor 24 is connected to the connector of the main board. The length and direction of the boss portion of the force sensor 24 may be suitably designed in consideration of peripheral components.

7A is a circuit diagram showing the touch and force sensor driving unit 20 in detail.

7A, the touch and force sensor driving unit 20 includes a sensing unit of a first channel connected to the touch sensor 22 and a sensing unit of a second channel connected to the force sensor 24. [ The touch and force sensor driving unit 20 may be realized by connecting remaining channels other than the channels connected to the touch sensor to the force sensor 24 in the conventional touch IC.

The sensing unit of the first channel includes an amplifier 73 and an ADC 74 for converting the output voltage Vout of the amplifier 73 into digital data. The touch sensor 22 may be implemented as a capacitive sensing method that senses a touch based on a change in capacitance before and after the touch. The capacitance type can be divided into mutual capacitance and self capacitance. In the case of the mutual capacitance type touch sensor 22, the charge sensing method as shown in FIG. 7B and the voltage sensing method as shown in FIG. 7C can sense the touch input.

이다. 상호 용량(C_M)에 의해 터치 센서(22)의 감도가 결정된다. In Fig. 7B, C _P2 is charged to Vref. The gain of the amplifier 73 is C _M / C _f . The output voltage Vout of the amplifier

to be. The sensitivity of the touch sensor 22 is determined by the mutual capacitance C _M.

7C is as follows. The sensitivity of the touch sensor 22 is determined by the mutual capacitance C _M.

Where C _s / C _f is the gain of the amplifier 73.

The ADC 74 converts the output signal of the amplifier 73 into digital data and outputs the touch data 2D.

The sensing unit of the second channel includes an amplifier 71 and an ADC 72 for converting the output voltage Vout of the amplifier 71 into digital data.

The force sensor 24 may be implemented by a force sensing resistor (FSR) method or a strain-gage method. The force sensor 24 may be represented by a variable resistance (R _force ) whose resistance value changes according to the pressure.

The amplifier 71 connected to the force sensor 24 amplifies the force sensor signal and outputs it as an input signal to the ADC 72. When the force sensor signal is outputted from the inverting amplifier 71, the output voltage Vout of the amplifier 25 becomes Vout = - (R ₂ / (R _force + R 0)) Vin to be. The ADC 72 converts the output signal of the amplifier 71 into digital data and outputs the force data 3D.

7D, the touch and force sensor driving unit 20 includes a sensing unit connected to the touch sensor 22 and the force sensor 24 through a multiplexer 80. [ The sensing unit includes an amplifier 75 and an ADC 76. This embodiment shares the sensing portion in the touch sensor 22 and the force sensor 24. Multiplexer 80 is a sensor signal processing section 40 or the host computer 20, the selection signal (M ₀₎ Force sensor 24 response after connecting the touch sensor 22, the sensing unit to receive from the sensing unit Connect.

The amplifier 75 amplifies the signal of the touch sensor 22 and outputs it to the ADCC 76 and then amplifies the signal of the force sensor 24 and outputs the amplified signal to the ADC 76. The ADC 76 converts the output signal of the amplifier 75 into digital data and continuously outputs the touch data 2D and the force data 3D.

8 is a detailed view showing an upper plate and a lower plate structure of the FSR-type force sensor 24. As shown in FIG. 9 is a view showing a sectional structure of the force sensor 24 by cutting along the line "I-I" in Fig. 8 in a state where the upper plate and the lower plate of the FSR type force sensor 24 are joined. 10 is a view showing the operation principle of the FSR type force sensor 24. As shown in FIG.

8 and 9, an upper plate of the FSR type force sensor 24 includes an upper substrate 240 on which pressure sensing material patterns 241 and an adhesive 242 are formed. The lower plate of the force sensor 24 includes electrodes 244 opposed to the pressure sensing material patterns 241 and a lower substrate 243 on which an insulating film pattern 245 is formed. The pressure sensing material patterns 241 are made of a highly resistive material. The upper substrate 240 and the lower substrate 234 may be a PET (polyethylene terephthalate) substrate. The upper substrate 240 and the lower substrate 243 include frame portions 240a and 243a. The upper and lower plates are bonded with an adhesive 242 with an air gap 246 therebetween.

The FSR type force sensor 24 operates as shown in FIG. 10 to sense the pressure of the fingerprint. The contact area between the pressure sensing material pattern 241 of the upper plate and the electrode 244 varies depending on the fingerprint pressure in the FSR type force sensor 24. As the fingerprint pressure Force (gf) is increased, the contact area between the pressure sensing material pattern 241 and the electrode 244 increases and the contact resistance value decreases. When the contact resistance value (k [Omega]) is reduced, the input signal voltage of the ADC becomes larger and the data value of the force data (3D) output from the ADC becomes larger.

The recognition rate of the fingerprint can be changed depending on the fingerprint state or environment. According to the present invention, when the pressure of the fingerprint is high on the screen of the display device using the force sensor 24, the fingerprint is sensed to raise the fingerprint recognition rate for the fingerprint with a low fingerprint recognition rate (hereinafter referred to as a "bad image fingerprint") . Here, the defective image fingerprint is a term to be compared with a general fingerprint having high sharpness in a fingerprint image obtained from the fingerprint sensor 32 at a low pressure. The sharpness of the fingerprint image can be determined by the ridge-valley contrast between the ridge R and the valley V of the fingerprint image obtained from the fingerprint sensor 32. The bad image fingerprint has low contrast ratios of the ridges R and the valleys of the fingerprint in the fingerprint image obtained by the fingerprint sensor 32 as compared with the general fingerprint image. As a result, the bad image fingerprint has a low fingerprint recognition rate at the same pressure as the ordinary fingerprint. Hereinafter, an example of the defective image fingerprint will be described mainly with respect to a fingerprint that is a dry fingerprint (hereinafter referred to as a "dry" fingerprint), but the defective image fingerprint is not limited to a dry fingerprint. Even in the case of general fingerprints, the sharpness of the fingerprint images may be lowered, such as in the case of dry fingerprints, when exposed to a dry environment.

11 and 12 are views showing differences in fingerprint images obtained from the fingerprint sensor 32 when the general fingerprint and the dry fingerprint are in contact with each other on the screen under the same pressure. 11 is a view showing a fingerprint image obtained through a fingerprint sensor in a general fingerprint. 12 is a view showing a fingerprint image obtained through a fingerprint sensor in a dry fingerprint.

Referring to FIGS. 11 and 12, the dry fingerprint has insufficient contact areas of fingerprints and insufficient oil and fat components as compared with general fingerprints. In the case of a general fingerprint, when the light absorbed in the ridge R is a dried fingerprint, light is reflected at the ridge R and is totally reflected on the transparent substrate CP. As a result, if the data output from the fingerprint sensor ISS is displayed as an image, the ridge pattern is cut off in the case of the dry fingerprint, so that the contrast ratio of ridges and valleys is smaller than that of a general fingerprint. The ratio of the ridge pattern becomes smaller. In the output image of the fingerprint sensor (ISS), since the ridge (R) is outputted as the gray level of the dry fingerprint, the difference in the gradation between the ridge (R) and the ridge (R) Is less than 30%. In the output image of the fingerprint sensor (ISS), the area occupied by the ridges is less than 50% of the ridge of the general fingerprint.

As shown in FIG. 13, when the pressure of the fingerprint is increased, the contact area of the fingerprint is increased on the screen, so that the sharpness of the fingerprint image obtained from the fingerprint sensor 32 can be increased. The present invention detects the pressure of the fingerprint applied on the screen by the force sensor 24 and drives the fingerprint sensor 32 only when the pressure of the fingerprint is equal to or higher than a predetermined pressure preset to increase the recognition rate of the fingerprint, 32 are minimized and power consumption can be reduced.

14 is a flowchart illustrating fingerprint sensing and authentication in a sleep mode.

The display panel 50 may operate in a partial mode in a sleep mode. The partial mode is a driving mode in which only pixels of a certain area are driven on the screen of the display panel 50 and the remaining pixels are kept off. One example of the partial mode is an always on mode and a virtual reality mode (VR). The present invention drives the display panel 50 in the partial mode in the sleep mode to display an image indicating the fingerprint sensing area of the screen as shown in FIG. 1A, and may not drive the other pixels.

Referring to FIG. 14, in the sleep mode, the touch sensor 22 senses a touch input. When the user touches the fingerprint sensing area on the screen, the touch sensor 22 senses the touch input (S1). In order to reduce the power consumption in the sleep mode, the sensing period of the touch sensor 22 can be controlled longer than the normal driving mode. For example, in the sleep mode, the touch sensor 22 can detect a touch input on the screen at a frequency of 30 Hz or less.

Meanwhile, the display panel 50 may operate in a partial mode in a sleep mode. The partial mode is a driving mode in which only pixels of a certain area are driven on the screen of the display panel 50 and the remaining pixels are kept off. One example of the partial mode is an always on mode and a virtual reality mode (VR). The present invention drives the display panel 50 in the partial mode in the sleep mode to display an image indicating a fingerprint sensing area of a predetermined screen as shown in FIG. 1A, and may not drive the other pixels. In the sleep mode, the user can receive the guidance of the image displayed on the screen and touch the fingerprint on the fingerprint sensing area. The fingerprint sensing area can be selected as the area with the highest fingerprint recognition rate as described later in FIGS. 18A and 18B, and the fingerprint sensor 32 and the force sensor 24 must be disposed in the fingerprint sensing area.

If the touch input position sensed in step S1 is the fingerprint sensing area, the force sensor 24 is driven (S2 and S3). When the force sensor 24 is driven only by pressure without judging a touch input, the force sensor 24 and the fingerprint sensor 32 are driven by an arbitrary object pressing the screen of the mobile terminal in the bag or bag of the user, May occur. The force sensor 24 is driven only when the touch input is sensed in a predetermined fingerprint sensing area on the screen.

The fingerprint sensor 32 is driven only when the pressure of the fingerprint applied on the fingerprint sensing area is equal to or higher than a predetermined pressure. For this, a trigger signal is generated when the force data 3D output from the force sensor 24 is equal to or higher than a predetermined threshold value TH and the touch data 2D and the force data 3D are transmitted to the host system 200 , And the fingerprint sensor 32 is driven (S4 to S6).

The fingerprint sensor 32 senses fingerprints on the fingerprint area and generates fingerprint data on the ridge R and feature information of the fingerprint V and transmits them to the host system 200 (S7 and S8). The host system 200 performs fingerprint authentication to compare the fingerprint data received from the fingerprint sensor 32 with the previously registered fingerprint pattern and generates a wake-up signal when the currently sensed fingerprint is the registration fingerprint The mode is switched to the normal drive mode (S9 to S11). On the other hand, if the fingerprint image currently sensed is not the registered fingerprint pattern, the host system 200 maintains the sleep mode (S10 and S12).

15 is a flowchart showing a fingerprint sensing method in the normal drive mode.

Referring to FIG. 15, in the normal drive mode, the touch sensor 22 senses a touch input. When the user touches the fingerprint sensing area on the screen, the touch sensor 22 senses the touch input (S11).

If the touch input position sensed in step S11 is the fingerprint sensing area, the touch data 2D is transmitted to the host system 200 and the force sensor 24 is driven (S12 to S14). When the force sensor 24 is driven only by pressure without judging a touch input, the force sensor 24 and the fingerprint sensor 32 are driven by an arbitrary object pressing the screen of the mobile terminal in the bag or bag of the user, May occur. The force sensor 24 is driven only when the touch input is sensed in a predetermined fingerprint sensing area on the screen.

The fingerprint sensor 32 is driven only when the pressure of the fingerprint applied on the fingerprint sensing area is equal to or higher than a predetermined pressure. The touch data 2D and the force data 3D are transmitted to the host system 200 when the force data 3D output from the force sensor 24 is equal to or greater than a predetermined threshold value TH, 32 are driven (S15 to S17). In step S15, it is possible to reduce the power consumption by increasing the contact area of the fingerprint in the fingerprint area, thereby increasing the fingerprint recognition rate even in the bad image fingerprint such as the dry fingerprint and driving the fingerprint sensor 32 only under the condition of high fingerprint recognition rate.

The fingerprint sensor 32 senses the fingerprint on the fingerprint area and generates fingerprint data on the characteristic information of the ridge R and the goal V of the fingerprint and transmits the generated fingerprint data to the host system 200 (S18 and S19). The host system 200 performs fingerprint authentication, compares the fingerprint data received from the fingerprint sensor 32 with the previously registered fingerprint pattern, and executes the application desired by the user when the currently sensed fingerprint is the registration fingerprint.

The fingerprint sensor 32 may be implemented as an ultrasonic sensor or an optical sensor. In the case of an optical sensor, a directional light source device for irradiating light on a screen is required. 16A to 19 show a directional light source device (SLS) according to an embodiment of the present invention.

16A to 19, the directivity light source device SLS of the present invention includes a transparent substrate CP, a light source LS, an incident element CHOE, an outgoing element EHOE, and a low refractive layer LR Respectively. The transparent substrate CP may be a substrate of a display panel in which a screen is implemented in the display device, or a cover glass covered on the display panel as shown in Fig. 16B.

A directional light source device (SLS) is an optical device that diffuses collimated light into a large area in a transparent substrate (CP). The light source LS preferably provides collimated light. The light source LS irradiates the laser light of the infrared (IR) band or the visible light band to the light-incident element (CHOE).

The light incident element CHOE is disposed between the light source LS and the transparent substrate CP and refracts light from the light source LS at an angle at which light can be totally reflected in the transparent substrate CP. The light-outgoing element EHOE is disposed between the display panel and the transparent substrate CP on the screen of the display panel so that a part of light traveling in the transparent substrate CP can travel toward the display panel through the lower surface of the transparent substrate. Thereby refracting a portion of the light traveling in the CP. The low refraction layer LR is disposed between the light exiting element EHOE and the display panel and has a lower refractive index than the light exiting element EHOE.

On the lower surface of the transparent substrate CP, an outgoing element EHOE and an incident element CHOE are bonded. The light-outgoing element (EHOE) is an optical element that provides the emitted light L3. A pixel array of the display panel DP is displayed below the light exiting element EHOE. The screen of the display device means a pixel array area of the display panel DP on which the input image is displayed. A fingerprint image is obtained by photoelectrically converting light, which is glued on a transparent substrate (CP) on a user's self-image plane and light is reflected on a user's fingerprint, to a fingerprint sensor (ISS).

The light-incident element CHOE is an optical element that converts collimated light from the light source LS into a collimator while diffusing the collimated light into the transparent substrate CP. The light-incident element (CHOE) must face the light source (LS). The collimated light from the light source LS may be incident perpendicularly to the incident element CHOE. The light-incident element is not directly related to (CHOE) image recognition, and therefore can be disposed at the edge of the display panel.

The light-emitting element (EHOE) and the light-receiving element (CHOE) can be arranged on the same plane. Considering the manufacturing process, it is preferable to form the regions of the light-emitting element (EHOE) and the light-receiving element (CHOE) separately on one film. The light-emitting element (EHOE) and the light-receiving element (CHOE) may be a hologram element. The light-incident element (CHOE) and the light-outgoing element (EHOE) can be manufactured simultaneously in the hologram recording process. In a hologram recording process, a master film having a pattern of an outgoing element (EHOE) and a master film having a pattern of an incident element (CHOE) are arranged adjacently, and on one film, a hologram pattern for an outgoing element, The hologram pattern can be recorded at the same time.

The hologram recording method can be divided into a transmissive recording method and a reflective recording method. The transmission type recording method irradiates a reference light and an object light toward one side of a holographic film to record an interference pattern on a recording surface of the holographic film. When reference light is irradiated toward one surface of the holographic film on which information is recorded by the transmission type recording method, object optical information is reproduced by first order diffracted light generated by the interference fringes on the holographic film. At the same time, 0th-order diffracted light passing through the holographic film is generated.

The reflection type recording method irradiates the reference light and the object light to the holographic film with the holographic film interposed therebetween. In the reflective recording method, the reference light is irradiated toward one surface of the holographic film, and the object light is irradiated toward the other surface of the holographic film. The other side of the holographic film is the opposite side of the one side. Thus, the interference pattern of the reference light and the object light is recorded on the recording surface of the holographic film. When reference light is irradiated toward one surface of a holographic film on which information is recorded by a reflection type recording method, object optical information is reproduced by 1st order diffracted light generated by an interference fringe on the holographic film. At the same time, 0th-order diffracted light passing through the holographic film is generated.

The first-order diffracted light having passed through the hologram film for the light-receiving element is totally reflected in the transparent substrate CP, and the zeroth-order diffracted light is transmitted through the holographic film to the transparent substrate CP. The fingerprint recognition device detects a fingerprint pattern of a user by using first order diffracted light refracted in the holographic film and incident on the transparent substrate CP. The 0th-order diffracted light transmitted through the holographic film can be blocked by a decolor film or a black matrix (BM) that prevents the user from seeing the light source LS.

A low refraction layer (LR) is disposed between the holographic films (CHOE, EHOE) and the display panel (DP). The low refraction layer (LR) has a lower refractive index than the transparent substrate (CP) and the hologram film.

The transparent substrate CP may be made of a transparent substrate having a refractive index of 1.5. The refractive index of the hologram film having the light-emitting element (EHOE) and the light-receiving element (CHOE) may have a value equal to or slightly larger than that of the transparent substrate (CP). Hereinafter, the refractive index of the holographic film (CHOE, EHOE) is the same as that of the transparent substrate CP. The refractive index of the low refractive layer LR is preferably similar to the fingerprint IM to be recognized, that is, the refractive index of the skin. For example, it can have a refractive index of about 1.4, which is similar to the refractive index of human skin, 1.39.

And a light source LS is disposed so as to face the light incident element CHOE. It is desirable that the light source LS provide high collimation light such as a laser.

The collimated light of the infrared (IR) band provided by the light source LS is provided as an incident point IP defined by the light incident element CHOE and having a constant cross sectional area as the incident light L1. It is preferable that the incident light L1 is incident in the normal direction with respect to the surface of the incident point IP. However, the present invention is not limited to this, and it may be incident at an inclined angle with respect to the normal line of the surface of the incident point IP, if necessary.

The light incident element CHOE refracts the incident light L1 at the incidence angle of the traveling light L2 and sends it to the inside of the transparent substrate CP. Here, it is preferable that the incident angle of the proceeding light L2 has a value larger than an internal total reflection critical angle of the transparent substrate CP. As a result, the progressed light L2 travels in the X-axis, which is the longitudinal direction of the transparent substrate CP, while totally reflecting within the transparent substrate CP. Light from the light source LS is generated at an infrared (IR) wavelength that is invisible to the user.

The outgoing light element EHOE converts some light amount of the proceeding light L2 into outgoing light L3 and refracts it toward the upper surface of the transparent substrate CP. The remaining light amount of the proceeding light L2 is totally reflected in the transparent substrate CP. The emitted light L3 is totally reflected on the upper surface of the transparent substrate CP, but is transmitted through the low refractive layer LR on the lower surface. That is, the emitted light L3 is totally reflected on the upper surface of the transparent substrate CP, and becomes the detection light (or 'sensing light') L4 transmitted through the lower surface.

The light amount of the emitted light L3 is determined by the light extraction efficiency of the light-emitting element EHOE. When the light extraction efficiency of the outgoing element EHOE is 3%, the amount of light corresponding to 3% of the initial incident light L1 in the first region in which the progressed light L2 is first contacted to the outgoing element EHOE, L3). 97% of the proceeding light L2 continues to be totally reflected, and the amount of light corresponding to 2.91% of the initial incident light (L1) of 3% of 97% in the second region proceeds at an angle of the outgoing light L3. Thus, outgoing light L3 is generated until reaching the end of the transparent substrate CP, which is the opposite side of the light source LS. The light extraction efficiency of the light exiting element EHOE is designed to have a value that gradually increases exponentially in order to provide the emergent light L3 having a constant amount of light while the progressed light L2 travels in the transparent substrate CP .

The collimated state of the incident light L1 is maintained when the traveling light L2 is viewed on the XZ plane (or the 'vertical plane') consisting of the longitudinal axis and the thickness direction axis. On the other hand, it is preferable to have the diffusion angle [phi] shown in Fig. 17 in the XY plane (or 'horizontal plane') consisting of the width direction axis and the longitudinal direction axis. This is to set the image detection area so as to correspond to the area of the transparent substrate CP. For example, it is preferable that the light exiting element (EHOE) is arranged so as to correspond to the entire light output portion (LOT) area. The diffusion angle PHI is equal to the inner angle formed by the two line segments connecting the two end points P1 and P2 of the other side of the transparent substrate CP opposed to the light incident element CHOE at the incident point IP Or larger.

The region where the light-incident element CHOE is disposed can be defined as the light incident portion LIN shown in Fig. 16B. Further, a region where the light-outgoing element (EHOE) is disposed can be defined as a light outputting portion (LOT). On the other hand, the light outputting section LOT is also a front reflector in which the propagating light L2 propagates.

When the cross-sectional area of the collimated light provided by the light source LS is in the garden of 0.5 mm x 0.5 mm, the incident light element CHOE may have a length corresponding to the width of the transparent substrate CP and a width of about 3 mm to 5 mm have. The light-incident element CHOE may be arranged to transverse the width direction of the transparent substrate CP.

Referring to FIG. 17, it will be described how the collimated light provided by the light source LS is converted into a directional light used for sensing the fingerprint image through a certain path in the transparent substrate CP.

The incident light L1 provided by the light source LS is incident on the surface of the incident point IP of the light incident element CHOE in the normal direction. The light-incident element CHOE converts incident light L1 into progressed light L2 refracted so as to have an incident angle [theta], and sends it to the inside of the transparent substrate CP.

The incident angle of the propagating light (L2) (θ) preferably has a value larger than the total reflection critical angle _{(_ EHOE} T _LR) of the interface device of the outgoing light (EHOE) and the low refractive index layer (LR). For example, when the refractive index of the transparent substrate CP and the light exit element EHOE are 1.5 and the refractive index of the low refractive layer LR is 1.4, the refractive index of the low refractive index layer LR at the interface between the light exit element EHOE and the low refractive layer LR the total reflection critical angle (T _{EHOE _ LR)} is calculated about 69 degrees. Therefore, it is preferable that the incident angle [theta] has a value larger than 69 degrees. For example, the incident angle? May be set to have a value between 70 degrees and 75 degrees.

Since the upper surface of the transparent substrate CP is in contact with the air layer AIR, the progressed light L2 is also totally reflected at the upper surface of the transparent substrate CP. This is because the total reflection critical angle T _{CP_AIR} at the interface between the transparent substrate CP and the air layer AIR is about 41.4 degrees. That is, the angle of incidence (θ) of the outgoing light element (EHOE) and the low refractive index layer (LR) the total reflection critical angle (T _{EHOE _ LR)} than has the largest value, which is always transparent substrate (CP) and the layer of air (AIR) at the interface Is greater than the total reflection critical angle (TCP_AIR) at the interface.

The outgoing light element EHOE converts the constant light amount of the proceeding light L2 into the outgoing light L3 having the reflection angle alpha and returns it to the inside of the transparent substrate CP. The outgoing light L3 is light for recognizing the pattern of the fingerprint IM touched on the upper surface of the transparent substrate CP. The outgoing light L3 is totally reflected on the upper surface of the transparent substrate CP and propagated to the fingerprint sensor disposed under the directional light source device SLS in the absence of a fingerprint on the surface of the transparent substrate CP. The outgoing light L3 is totally reflected on the upper surface of the transparent substrate CP and then propagates downwardly of the directional light source device SLS as the detection light L4.

The low refraction layer can be disposed above and below the holographic film (CHOE, EHOE) as shown in Figs. 18A and 19. The first low refractive index layer LR1 is disposed between the transparent substrate CP and the hologram films CHOE and EHOE. The second low refractive index layer LR2 is disposed between the hologram films CHOE and EHOE and the display panel DP. The refractive index of the low refractive layers LR1 and LR2 may be about 1.4, but is not limited thereto. The low refraction layers LR1 and LR2 may be implemented with optical adhesives, for example, OCA (Optical Clear Adhesive).

The display panel DP may be disposed under the directional light source device SLS as shown in Figs. 18A and 18B.

The fingerprint sensor ISS acquires a fingerprint image embedded in the display panel DP or disposed under the display panel DP as shown in Fig. 19 to be touched on the transparent substrate CP. The optical fingerprint sensor may be implemented as an image sensor that converts received light into an electrical signal. The pixels SS of the fingerprint sensor ISS may be embedded in the display panel DP together with the display pixels PIX of the display panel DP. The fingerprint sensor ISS may be adhered to the substrate of the display panel DP with an adhesive such as optical adhesive (OCA), pressure sensitive adhesive (PSA) or the like, but is not limited thereto.

18A to 19, incident light L1 is converted into progressed light L2 by the light incident element CHOE. The traveling light L2 is converted so as to have a diffusing angle? In the XY plane, which is a horizontal plane consisting of an X axis which is a longitudinal axis and a Y axis which is a width axis. In addition, the original collimated state is maintained in the XZ plane, which is a vertical plane consisting of the longitudinal axis X and the thickness direction axis Z axis.

It is preferable that the diffusing angle PHI is equal to or greater than the inner angle formed by the two line segments connecting the two ends of the other side of the transparent substrate CP opposite to the light incident element CHOE at the incident point IP. In this case, the propagating light L2 is diffused in the triangular shape having the diffusion angle?, And propagated in the transparent substrate CP. The outgoing light L3 is also provided over the same range as the progressed light L2. As a result, the fingerprint sensing area can be selected within the triangular area that widens from the entry point IP to the diffusion angle?. In FIG. 18B, a portion indicated by a hatched circle may be designated as the fingerprint sensing area SA, but is not limited thereto.

When the sensing area SA is set in the central part of the display panel DP or in a part of the upper side opposite to the light-incoming element CHOE, the light amount of the outgoing light L3 in the sensing area SA is designed to have the maximum value desirable. In order to achieve this, the light extraction efficiency of the EHOE may have a maximum value at a portion corresponding to the sensing area SA and a minimum value or a value close to '0' at other portions. have. The fingerprint recognition rate is high because the amount of light reflected from the fingerprint IM to the fingerprint sensor ISS in the sensing area SA is high.

When the fingerprint IM is brought into contact with the transparent substrate CP, light is reflected from the upper surface of the transparent substrate CP in the ridge position among ridges R and valleys of the fingerprint, Passes through the light exiting element (EHOE) and the low refractive layer (LR) and travels toward the display panel (DP), so that it can reach the fingerprint sensor (ISS). In the ridge R of the fingerprint that is in contact with the transparent substrate CP, light is not absorbed by the skin, and therefore, does not reach the fingerprint sensor ISS.

The fingerprint sensor (ISS) detects the fingerprint pattern by converting the received light into an electrical signal. The pixels of the fingerprint sensor ISS include a photoelectric conversion element, for example, a photodiode. The fingerprint sensor ISS amplifies the signal obtained from the photoelectric conversion element of the pixels, converts the signal into digital data through an ADC (Analog to Digital Converter), and outputs the fingerprint data. The fingerprint sensor (ISS) can output fingerprint image data with 8 bit data. The fingerprint sensor (ISS) outputs the ridge pattern of the fingerprint as data of dark grayscale values, while outputting the bone pattern of the fingerprint as data of bright grayscale values.

In the present invention, a fingerprint sensor (ISS) is disposed under the sensing area SA in FIG. 18B to increase the efficiency of light received by the fingerprint sensor ISS and to indicate the position on the screen Can be displayed. The fingerprint sensor ISS may be embedded in the display panel DP or disposed below the display panel so as to face the sensing area SA. The pixels SS of the fingerprint sensor ISS face the transparent substrate CP, the light exiting element EHOE and the low refractive layer LR of the directional light source device SLS.

The screen of the display panel DP includes a pixel array for reproducing an input image. The pixel array includes a plurality of data lines, a plurality of gate lines intersecting with the data lines, and display pixels PIX arranged in a matrix form. Each of the display pixels PIX may be divided into a red subpixel, a green subpixel, and a blue subpixel for color implementation, and may further include a white subfilter. Each of the subpixels may include a light emitting device such as an OLED.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Therefore, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.

10: timing controller 12: display panel driver
20: touch and force sensor driving unit 22: touch sensor
24: Force sensor 30: Fingerprint sensor driving unit
32, ISS: fingerprint sensor 40: sensor signal processor
50, DP: display panel 52: foam pad (PAD)
54: metal layer 60, CP: transparent substrate
62: mid-frame 100: display device
200: host system SLS: directional light source device
CHOE: Light-incident element EHOE: Exposure element
LR, LR1, LR2: low refractive layer LS: light source
PXL: pixel on the display panel SS: pixel on the fingerprint sensor

Claims (15)

A display panel for displaying an image on a screen;
A touch sensor for sensing a touch input on a screen of the display panel;
A force sensor for sensing a pressure of the touch input when the touch input is located in a preset fingerprint sensing area; And
And a fingerprint sensor that is driven when the pressure of the touch input sensed by the force sensor is equal to or higher than a predetermined pressure to sense a fingerprint at the touch input position. The method according to claim 1,
A display panel driver for driving the display panel to write pixel data of an input image to pixels of the display panel;
A touch and force sensor driver for driving the touch sensor and the touch sensor; And
And a fingerprint sensor driver for driving the fingerprint sensor. 3. The method of claim 2,
The sensing unit of the touch and force sensor driver
An amplifier connected to the touch sensor and the force sensor; And
And an analog-to-digital converter coupled to the amplifier. The method according to claim 1,
An input image is displayed on the entire screen of the display panel in the normal drive mode,
In the sleep mode, some pixel areas on the screen of the display panel are driven,
Wherein the portion of the pixel region driven in the sleep mode includes a fingerprint sensing region. 5. The method of claim 4,
In the sleep mode,
Wherein the force sensor is driven when the fingerprint sensing area is touched by the touch sensor. 6. The method of claim 5,
Wherein the fingerprint sensor is driven when the pressure of the touch input on the fingerprint sensing area is equal to or higher than the predetermined pressure by the force sensor in the sleep mode. The method according to claim 6,
And switches to the normal drive mode when the fingerprint pattern sensed by the fingerprint sensor in the sleep mode is a pre-registered fingerprint. The method according to claim 1,
Wherein the force sensor surrounds at least two sides of the fingerprint sensor. 9. The method according to any one of claims 1 to 8,
The force sensor
An upper substrate on which a pressure sensing material pattern is formed; And
And a lower substrate on which an electrode facing the pressure sensing material pattern is formed,
The upper substrate and the lower substrate are bonded so that the pressure sensing material pattern and the electrode face each other with an air layer therebetween,
And the contact resistance between the electrode pressure sensing material pattern and the electrode decreases as the pressure applied to the upper substrate increases. A display panel for displaying an image on a screen;
A display panel driver for writing pixel data of an input image to pixels of the display panel;
A touch sensor for sensing a touch input on a screen of the display panel;
A force sensor for sensing a pressure of the touch input when the touch input is located in a preset fingerprint sensing area;
A fingerprint sensor that is driven when the pressure of the touch input sensed by the force sensor is equal to or higher than a predetermined pressure and senses a fingerprint at the touch input position; And
A host system for transmitting pixel data of an input image to be displayed on the display panel to the display panel driving unit and receiving touch data obtained from the touch sensor, force data obtained from the force sensor, and fingerprint sensor data obtained from the fingerprint sensor and,
Wherein the host system performs fingerprint authentication on the fingerprint data received after the touch data and the force data are received. 11. The method of claim 10,
A touch and force sensor driver for driving the touch sensor and the touch sensor; And
Further comprising a fingerprint sensor driver for driving the fingerprint sensor,
Wherein the host system receives the touch data and the force data from the touch and force sensor driver and receives the fingerprint data from the fingerprint sensor driver. 12. The method of claim 11,
An input image is displayed on the entire screen of the display panel in the normal drive mode,
In the sleep mode, some pixel areas on the screen of the display panel are driven,
Wherein the partial pixel region driven in the sleep mode includes a fingerprint sensing region. 13. The method of claim 12,
In the sleep mode,
And the force sensor is driven when the fingerprint sensing area is touched by the touch sensor. 14. The method of claim 13,
Wherein the finger sensor is driven when the pressure of the touch input on the fingerprint sensing area is equal to or higher than the predetermined pressure by the force sensor in the sleep mode. 15. The method of claim 14,
The host system
And switches to the normal drive mode when the fingerprint pattern sensed by the fingerprint sensor in the sleep mode is a pre-registered fingerprint.

Images