EP2570896A1 - Electronic device and method for driving a touch sensor thereof - Google Patents

Electronic device and method for driving a touch sensor thereof Download PDF

Info

Publication number
EP2570896A1
EP2570896A1 EP20120006472 EP12006472A EP2570896A1 EP 2570896 A1 EP2570896 A1 EP 2570896A1 EP 20120006472 EP20120006472 EP 20120006472 EP 12006472 A EP12006472 A EP 12006472A EP 2570896 A1 EP2570896 A1 EP 2570896A1
Authority
EP
European Patent Office
Prior art keywords
touch sensor
mode
touch
drive signal
driving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP20120006472
Other languages
German (de)
French (fr)
Other versions
EP2570896B1 (en
Inventor
Te-Mu Chen
Pi-Lin Lo
Chen-Hsi Liu
Yi-Fan Hsueh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HTC Corp
Original Assignee
HTC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by HTC Corp filed Critical HTC Corp
Publication of EP2570896A1 publication Critical patent/EP2570896A1/en
Application granted granted Critical
Publication of EP2570896B1 publication Critical patent/EP2570896B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/0418Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0412Digitisers structurally integrated in a display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/0418Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • G06F3/04184Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G06F3/0445Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means using two or more layers of sensing electrodes, e.g. using two layers of electrodes separated by a dielectric layer

Definitions

  • the present disclosure relates to a touch sensor of an electronic device. More particularly, the present disclosure relates to an electronic device and a method for scanning a touch sensor of the electronic device.
  • Fig. 1 is a schematic diagram showing a conventional electronic device 100 including a system 110, a touch controller 120 and a capacitive touch sensor 130.
  • the system 110 is the main system of the electronic device 100.
  • the capacitive touch sensor 130 includes a set of drive lines and a set of sense lines. Each location where a drive line crosses a sense line is a sensing element of the capacitive touch sensor 130. For example, two sensing elements of the capacitive touch sensor 130 are marked as 132 and 134, respectively. Each sensing element is a sensor for sensing touch or proximity of the user.
  • the touch controller 120 may detect resultant touch events by scanning the capacitive touch sensor 130.
  • the touch controller 120 scans the capacitive touch sensor 130 by sending touch drive signal DST to the drive lines of the capacitive touch sensor 130.
  • the touch drive signal DST charges the sensing elements of the capacitive touch sensor 130 and the sensing elements generate sense signals SS in response.
  • the touch controller 120 receives the sense signals SS from the sense lines of the capacitive touch sensor 130.
  • the touch controller 120 analyzes the sense signals SS to determine the locations of the touch events.
  • the system 110 may perform predetermined functions of the electronic device 100 according to the touch events.
  • the present disclosure is directed to an electronic device and a method for driving a touch sensor integrated into a display module in an electronic device.
  • the electronic device and the method may determine a mode for applying a drive signal to the touch sensor and change the mode in order to avoid bursts of the noises.
  • an electronic device comprising a display module, a touch sensor integrated into the display module, and a control circuitry.
  • the control circuitry is coupled to the touch sensor and the display module and configured to drive the touch sensor by a touch drive signal at one of a first mode and a second mode and detect a sense signal from the touch sensor when the touch sensor is driven by the touch drive signal.
  • the control circuitry may further configured to determine the one of the first mode and the second mode for driving the touch sensor based on a determination.
  • the control circuitry comprises a sense circuitry, and a drive circuitry.
  • the sense circuitry is coupled to the touch sensor and configured to determine the one of the first mode and the second mode for driving the touch sensor, and configured to detect the sense signal from the touch sensor.
  • the drive circuitry is coupled to the sense circuitry, the display module and the touch sensor and configured to apply a display drive signal for driving the display module and apply the touch drive signal for driving the touch sensor at the one determined mode.
  • control circuitry may comprise a sense circuitry, a process unit and a drive circuitry.
  • the sense circuitry is coupled to the touch sensor, the process unit and the drive circuitry and configured to detect the sense signal from the touch sensor.
  • the process unit is configured to determine the one of the first mode and the second mode for driving the touch sensor.
  • the drive circuitry is coupled to the touch sensor and the process unit and configured to apply the display drive signal for driving the display module and apply the touch drive signal for driving the touch sensor.
  • the process unit determines to drive the touch sensor at the first mode.
  • the process unit determines to drive the touch sensor at the second mode.
  • a method for driving a touch sensor integrated into a display module in an electronic device includes the following steps: determining one of a first mode and a second mode for driving the touch sensor; driving the touch sensor by a touch drive signal at the one determined mode and detecting the sense signals from the touch sensor when the touch sensor is driven by the touch drive signal.
  • the method further comprises: applying the touch drive signal to the touch sensor within a display period; applying the touch drive signal to the touch sensor according to a first predetermined timing within the display period when the first mode is determined for driving the touch sensor; and applying the touch drive signal to the touch sensor according to a second predetermined timing within the display period when the second mode is determined for driving the touch sensor.
  • the method further comprises: applying the touch drive signal to the touch sensor at a first frequency within the display period when the first mode is determined for driving the touch sensor; and applying the touch drive signal to the touch sensor at a second frequency within the display period when the second mode is determined for driving the touch sensor.
  • Fig. 1 is a schematic diagram showing a conventional electronic device.
  • Fig. 2A is a schematic diagram showing an electronic device according to an embodiment of the present disclosure.
  • Fig. 2B is a cross-sectional view of a display module with an in-cell capacitive touch sensor according to an embodiment of the present disclosure.
  • Fig. 2C is a flow chart showing a method for scanning a touch sensor integrated into a display module of an electronic device according to an embodiment of the present disclosure.
  • Fig. 3A is a schematic diagram showing an electronic device according to an embodiment of the present disclosure according to another embodiment of the present disclosure.
  • Fig. 3B is a flow chart showing a method for driving a touch sensor integrated into a display module of an electronic device according to another embodiment of the present disclosure.
  • Fig. 4A is a schematic diagram showing an electronic device according to an embodiment of the present disclosure according to another embodiment of the present disclosure.
  • Fig. 4B is a flow chart showing a method for driving a touch sensor integrated into a display module of an electronic device according to another embodiment of the present disclosure.
  • Fig. 5 to Fig. 9 are schematic diagrams showing driving a touch sensor integrated into a display module of an electronic device according to embodiments of the present disclosure.
  • Fig. 10 is a schematic diagram showing an electronic device according to an embodiment of the present disclosure.
  • Fig. 11A and Fig. 11B are flow charts showing a method for driving a touch sensor integrated into a display module of an electronic device according to an embodiment of the present disclosure.
  • Fig. 11C is a schematic diagram showing pixel process periods of pixels or sub-pixels of a display module according to an embodiment of the present disclosure.
  • Fig. 11D and Fig. 11E are flow charts showing a method for driving a touch sensor integrated into a display module of an electronic device according to an embodiment of the present disclosure.
  • Fig. 2A is a schematic diagram illustrating an electronic device 200 according to an embodiment of the present disclosure.
  • the electronic device 200 may be any electronic devices with a touch display, such as smart phones, personal digital assistants, tablet computers or notebook computers.
  • An electronic device 200 comprises a display module 240, a touch sensor 230, which integrated into the display module 240, and a control circuitry 201.
  • the display module 240 comprises a plurality of pixels or sub-pixels and a plurality of scan lines connected to the plurality of pixels or sub-pixels, and the control circuitry 201 is further configured to drive the pixels or sub-pixels through the use of scan lines during a display period.
  • the display period includes a plurality of pixel process periods, during which the pixels or sub-pixels are driven, and a plurality of blank periods, during which no pixel or sub-pixel is driven.
  • the control circuitry 201 is coupled to the touch sensor 230 and the display module 240 and configured to drive the touch sensor by a touch drive signal DST at either a first mode or a second mode and detect a sense signals SS from the touch sensor 230 when the touch sensor 230 is driven by the touch drive signal DST.
  • the touch drive signal DST is applied to drive the touch sensor 230 within the display period.
  • the display module 240 may be a liquid crystal module (LCM), OLED (organic light emitting diode) display module or transparent OLED display module.
  • the touch sensor 230 may be an in-cell capacitive touch sensor which may includes a plurality of sensing elements coupled to the control circuitry 201. Each sensing element is a sensor for sensing the touch or the proximity of a conductive object such as a stylus or a finger of the user. These touch sensor 230 may be integrated into the display module 240. The sensing elements of the touch sensor may share or use a Vcom circuitry for the display module to charge or drive the sensing elements.
  • the touch sensor 230 is an in-cell capacitive touch sensor, the present disclosure is not limited to in-cell capacitive touch sensors only. The present disclosure is applicable to any touch sensor that is integrated into a display module, including on-cell touch sensor. In other words, the display module 240 may be an in-cell or on-cell display module.
  • the display module 240 includes an upper substrate 12, a lower substrate 14 and a liquid crystal (LC) layer 16.
  • the upper substrate 12 may be a color filter (CF) substrate with a color filter layer 12a
  • the lower substrate 14 may be a thin-film transistor (TFT) array substrate with a TFT array 18a.
  • the LC layer 16 is sandwiched between the two substrates 12 and 14.
  • the display module 240 also includes the in-cell capacitive touch sensor 230 integrated into the display module 240.
  • the touch sensor 230 has a first conductive layer 18a with drive line electrodes (not shown) formed on the upper surface of the lower substrate 14 for receiving drive signals, and a second conductive layer 18b with sense line electrodes (not shown) formed on the upper surface of the upper substrate 12 for providing sense signals.
  • the sense signals are provided from the touch sensor 230 when the touch sensor 230 is driven.
  • the sense signals may be generated by the touch or the proximity of one or more conductive objects to one or more sensing elements of the touch sensor 230.
  • the first conductive layer 18a is integrated into the TFT array 18a by using the gate lines of the TFT array 18a as the drive line electrodes of the first conductive layer 18a.
  • first and second conductive layers 18a and 18b integrated into the LCM module are not limited in the present disclosure.
  • first conductive layer 18a may also be formed on the lower surface of the upper substrate, and the two conductive layers 18a and 18b may be formed on the same layer so as to form a single-layer type sensor on the upper surface of the upper substrate.
  • the single-layer type sensor may be formed on the lower surface of the upper substrate.
  • the display module may be any type of LCM modules, e.g. IPS type, VA type, TN type, and etc.
  • the display module structure may be implemented in IPS type LCM module, or in VA or TN type LCM module.
  • a method for driving a touch sensor integrated into a display module of an electronic device comprises the steps of driving the touch sensor by a touch drive signal at either a first mode or a second mode and detecting sense signals from the touch sensor when the touch sensor is driven by the touch drive signal.
  • Fig. 2C is a flow chart illustrating a method for driving a touch sensor, which is integrated into a display module in an electronic device according to an embodiment of the present disclosure. The method shown in Fig. 2C may be executed by the electronic device 200 shown in Fig. 2A .
  • the control circuitry 201 is coupled to the touch sensor 230 and the display module 240 and configured to drive the touch sensor 230 by a touch drive signal DST at either a first mode or a second mode and detect sense signals SS from the touch sensor 230 when the touch sensor 230 is driven by the touch drive signal.
  • the control circuitry 201 is further configured to determine one of the first mode and the second mode for driving the touch sensor 230 based on a determination.
  • the determination may be determined as the following examples. First example is related to noise level.
  • the determination for driving the touch sensor 230 is to determine whether the sense signals SS has a noise level greater than a predetermined level.
  • the control circuitry 201 determines that the sense signals SS have the noise level greater than the predetermined level
  • the control circuitry 201 drives the touch sensor 230 at the first mode.
  • the control circuitry 201 determines that the sense signals SS do not have the noise level greater than the predetermined level
  • the control circuitry 201 drives the touch sensor 230 at the second mode.
  • Second example is related to characteristic of the touch sensor 230.
  • the determination for driving the touch sensor 230 is to determine a characteristic of the touch sensor. When it is determined that the touch sensor 230 has a first characteristic, the control circuitry 201 drives the touch sensor 230 at the first mode. When it is determined that the touch sensor 230 has a second characteristic, the control circuitry 201 drives the touch sensor at the second mode.
  • the third example is related to the charge level of the touch sensor 230.
  • the determination for driving the sensing element is to determine whether a charge level, which is determined based on the detected sense signal, of at least one of the sensing elements is lower than a predetermined charge level. When it is determined that the charge level is not lower than a predetermined charge level, the control circuitry 201 drives the touch sensor 230 at the first mode. When it is determined that the charge level is lower than a predetermined charge level, the control circuitry 201 drives the touch sensor 230 at the second mode.
  • the fourth example is related to image to be displayed on the display module. The determination for driving the touch sensor 230 is to determine whether an image to be displayed on display module 240 results in a noise level greater than a predetermined level for touch sensor 230.
  • the control circuitry 201 determines to drives the touch sensor 230 at the first mode.
  • the control circuitry to drives the touch sensor 230 at the second mode.
  • Fig. 3A is a schematic diagram illustrating another example an electronic device 200 according to an embodiment of the present disclosure.
  • the electronic device 200 includes a display module 240 with a touch sensor 230 integrated into the display module 240, a drive circuitry 250 coupled to the display module 240 and the touch sensor 230, and a sense circuitry 220 coupled to the touch sensor 230 and the drive circuitry 250.
  • the sense circuitry is configured to determine the one of the first mode and the second mode as a determined mode for driving the touch sensor, and configured to detect the sense signals from the touch sensor.
  • the drive circuitry 250 is configured to apply the display drive signal DSD for driving the display module and apply the touch drive signal DST for driving the touch sensor at the determined mode.
  • Fig. 3B is a flow chart illustrating a method for driving a touch sensor integrated into a display module of an electronic device according to another embodiment of the present disclosure.
  • the method shown in Fig. 3B may be executed by the electronic device 200 shown in Fig. 3A .
  • the sense circuitry 220 determines either a first or a second mode for the drive circuitry 250 to apply the drive signals.
  • the drive signals in this embodiment, comprises the display drive signal DSD for the display module 240 and the touch drive signal DST for the touch sensor 230.
  • the drive circuitry 250 applies the display drive signal DSD to the display module 240 and applies the touch drive signal DST to the touch sensor 230.
  • Steps 420 and 422 are the same as their counterparts in Fig.
  • the sense circuitry 220 may detect one or more sense signals SS from the touch sensor 230.
  • the sense circuitry 220 analyzes the sense signals SS.
  • the electronic device 200 may execute one or more functions according to the one or more touch events.
  • the sense circuitry 220 may change from the first mode to the second mode for the drive circuitry 250 to apply the touch drive signal DST for driving the touch sensor 230.
  • the sense circuitry 220 may determine to change the mode for the drive circuitry 250 to apply the touch drive signal DST for driving the touch sensor 230 when the sense circuitry 220 analyzes the sense signals SS and identifies at least one of the sense signals SS with a noise level greater than a predetermined value.
  • the sense circuitry 220 is further configured to determine one of the first mode and the second mode for driving the touch sensor 230 based on a determination.
  • the determination may be determined as the following examples.
  • First example is related to noise level.
  • the determination for driving the touch sensor 230 is to determine whether the sense signals SS has a noise level greater than a predetermined level.
  • the sense circuitry 220 determines the first mode for the drive circuitry 250 to drives the touch sensor 230.
  • the sense circuitry 220 determines to drives the touch sensor 230 at the second mode.
  • Second example is related to characteristic of the touch sensor 230.
  • the determination for driving the touch sensor 230 is to determine a characteristic of the touch sensor 230; wherein when it is determined that the touch sensor 230 has a first characteristic, the sense circuitry 220 determines to drive the touch sensor 230 at the first mode. When it is determined that the touch sensor 230 has a second characteristic, the sense circuitry 220 determines to drive the touch sensor 230 at the second mode.
  • the third example is related to the charge level of the touch sensor 230.
  • the determination for driving the sensing element is to determine whether a charge level, which is determined based on the detected sense signal, of at least one of the sensing elements is lower than a predetermined charge level.
  • the sense circuitry 220 determines that the charge level is not lower than a predetermined charge level, the sense circuitry 220 determines to drive the touch sensor 230 at the first mode.
  • the sense circuitry 220 determines that the charge level is lower than the predetermined charge level, the sense circuitry 220 determines to drive the touch sensor 230 at the second mode.
  • the aforementioned mode is related to the timing or the frequency to apply or send the touch drive signal DST to the touch sensor 230.
  • the control circuitry 201 determines the first mode for driving the touch sensor 230
  • the touch drive signal DST is applied to the touch sensor 230 according to a first predetermined timing within the display period.
  • the control circuitry 201 determines the second mode for driving the touch sensor 230
  • the touch drive signal DST is applied to the touch sensor 230 according to a second predetermined timing within the display period.
  • the first predetermined timing may be different from the second predetermined timing.
  • the sense circuitry 220 may send an instruction to control the drive circuitry 250 to change the timing or the frequency of the touch drive signal DST for driving the touch sensor 230.
  • the sense circuitry 220 may adjust the timing of the touch drive signal DST for the touch sensor 230 by changing the mode for the drive circuitry 250 to apply the touch drive signal DST.
  • Fig. 4A is a schematic diagram showing the electronic device 200 according to another embodiment of the present disclosure.
  • the electronic device 200 in Fig. 4A includes a display module 240 with a touch sensor 230 integrated into the display module 240, a drive circuitry 250 coupled to the display module 240 and the touch sensor 230, a process unit 210 coupled to the drive circuitry 250, and a sense circuitry 220 coupled to the touch sensor 230, the process unit 210 and the drive circuitry 250.
  • the process unit 210 may include a memory 215 configured to store different modes to be selected in step 1110 for applying the touch drive signal DST for the touch sensor 230.
  • Fig. 4B is a flow chart showing a method for driving a touch sensor integrated into a display module of an electronic device according to an embodiment of the present disclosure. This method may be executed by the electronic device 200 as shown in Fig. 4A .
  • the process unit 210 determines either a first mode or a second mode to apply the touch drive signal DST for the touch sensor 230 based on an image to be displayed on the display module 240 or an image property of the image such as histogram of the image.
  • the image to be displayed on display module may result in a noise level greater than a predetermined level for touch sensor.
  • the process unit determines for the drive circuitry to drives the touch sensor at the first mode.
  • the process unit determines for the drive circuitry to drives the touch sensor at the second mode.
  • the sense circuitry 220 instructs the driving circuitry 250 the timing or the frequency to apply the touch drive signal DST based on the mode. In other words, the timing or frequency to apply the touch drive signal DST is determined by the sense circuitry 220 and is implemented by the drive circuitry 250.
  • the drive circuitry 250 applies the display drive signal DSD and DST for the display module 240 and the touch sensor 230.
  • Fig. 5 is a schematic diagram showing the default mode 500 for sending the touch drive signal DST to scan the touch sensor 230 of the electronic device 200 according to an embodiment of the present disclosure.
  • the default mode 500 may be used as the mode in step 420 or the mode in step 428.
  • the drive circuitry 250 may scan the touch sensor 230 by applying the touch drive signal DST at the default mode 500.
  • the period from the beginning of a pulse of the vertical synchronization signal VSYNC to the beginning of the next pulse of the vertical synchronization signal VSYNC is the period of an image frame displayed by the display module 240.
  • the display period mentioned above may be the period of an image frame displayed by the display module 240.
  • the vertical synchronization signal VSYNC ensures the scan of the display module 240 starts at the top of the image frame at the right time.
  • the period from the beginning of a pulse of the horizontal synchronization signal HSYNC to the beginning of the next pulse of the horizontal synchronization signal HSYNC is the period of a scan line of the image frame displayed by the display module 240.
  • the display period mentioned above may be the period of a scan line of the image frame displayed by the display module 240.
  • the horizontal synchronization signal HSYNC has a plurality of high voltage levels and a plurality of low voltage levels to form a plurality of pulses.
  • the horizontal synchronization signal HSYNC synchronizes the start of the horizontal image scan line in the display module 240 with the image source that generates the horizontal synchronization signal HSYNC.
  • the display drive signal DSD is applied to the display module 240 during a display period, which may include a plurality of pixel process periods (such as the pixel process periods 521-523) for the drive circuitry 250 to drive pixels or sub-pixels of the display module 240 at the high voltage level of the horizontal synchronization signal HSYNC.
  • the pixel process periods 521-523 are defined within the high voltage level of the horizontal synchronization signal HSYNC.
  • Each pixel of the display module 240 may include multiple sub-pixels and each sub-pixel may display a different primary color, such as red, green or blue.
  • the drive circuitry 250 may control the greyscale of at least one pixel or at least one sub-pixel of the display module 240 in each pixel process period 521-523.
  • the display period mentioned above further includes one or more display blank periods, such as the display blank periods 511-514.
  • the blank periods are the periods during which no pixel or sub-pixel is driven.
  • Each display blank period is a period between the pixel process periods of two scan lines, two pixels or two sub-pixels of the display module 240.
  • a display blank period between two scan lines means a display blank period between the pixel process period of the last pixel of a scan line and the pixel process period of the first pixel of the next scan line, such as the display blank periods 511 and 514.
  • the display blank period 511 and 514 are defined within the low voltage levels of the horizontal synchronization signal HSYNC, respectively while the display blank periods 512 and 513 are defined within the high voltage level of the horizontal synchronization signal HSYNC.
  • the drive circuitry 250 does not drive any one pixel or sub-pixel of the display module 240 in the display blank periods. Since the display module 240 does not forward the drive signal DSD to the pixels in the display blank periods and thus has no big currents and does not produce common voltage (VCOM) noises in the display blank periods, the drive circuitry 250 may scan the touch sensor 230 by applying the touch drive signal DST in the display blank periods to avoid bursts of noises.
  • VCOM common voltage
  • the drive circuitry 250 scans the touch sensor 230 only in the display blank periods between two scan lines, such as the display blank periods 511 and 514.
  • the lowermost part of Fig. 5 shows two scanning periods 531 and 532.
  • Each scanning period is a period wherein the drive circuitry 250 scans the touch sensor 230 by applying the touch drive signal DST to the touch sensor 230.
  • the sense circuitry 220 may instruct the drive circuitry 250 to adjust the display blank periods to form a prolonged display blank period, and apply the touch drive signal DST for the touch sensor 230 within the prolonged display blank period.
  • the drive circuitry 250 may merge a part or all of one or more display blank periods into the prolonged display blank period.
  • Fig. 6 is a schematic diagram showing a comparison between the default mode 500 and another mode 600 according to an embodiment of the present disclosure.
  • the drive circuitry 250 merges a part of the display blank period 511 into the prolonged display blank period 514 to make the display blank period 514 longer for accommodating more touch drive signal DST, and then the drive circuitry 250 scans the touch sensor 230 by applying the touch drive signal DST in the prolonged display blank period 514.
  • the drive circuitry 250 may merge more display blank periods between scan lines into the prolonged display blank period 514 to make the prolonged display blank period 514 even longer.
  • the drive circuitry 250 may distribute the applying of the touch drive signal DST in one or more display blank periods according to the length of each display blank period and the length of time required for charging the sensing elements of the touch sensor 230.
  • Fig. 7 is a schematic diagram showing a comparison between the default mode 500 and another mode 700 according to an embodiment of the present disclosure.
  • the touch drive signal DST is applied by the drive circuitry 250 to drive the touch sensor 230 within the blank periods 511 and 514 according to a first predetermined timing.
  • the touch drive signal DST is applied by the drive circuitry 250 to drive the touch sensor 230 within the blank periods 512 and 513, in addition to the blank periods 511 and 514, according to a second predetermined timing.
  • the drive circuitry 250 scans the touch sensor 230 not only in the display blank period 511 or 514 between scan lines, but also in the display blank periods 512 and 513 between pixels or sub-pixels.
  • the drive circuitry 250 may distribute the scanning of the entire touch sensor 230 in one or more display blank periods according to the length of each display blank period and the length of time required for charging the sensing elements of the touch sensor 230.
  • the drive circuitry 250 may apply the touch drive signal DST to only a part of the touch sensor 230 or the entire touch sensor 230 in each display blank period. The longer a display blank period, the more sensing elements or drive lines of the touch sensor 230 that the drive circuitry 250 may scan in the display blank period.
  • the control circuitry drives the sensing elements at the first mode
  • the touch drive signal is applied to the sensing elements according to a first charging period within the display period for all sensing elements.
  • the control circuitry drives the sensing elements at the second mode, the sensing elements is charged to reach a predetermined charged level by adjusting a second charging period or a second charging voltage for charging each sensing elements.
  • the sense circuitry determine whether a charge level, which is determined based on the detected sense signal, of at least one of the sensing elements is lower than a predetermined charge level. When it is determined that the charge level is not lower than the predetermined charge level, the control circuitry drives the touch sensor at the first mode. When it is determined that the charge level is lower than the predetermined charge level, the control circuitry drives the touch sensor at the second mode.
  • the Sensing elements nearer to the drive circuitry 250 often require shorter charging time than the far sensing elements do. The number of near sensing elements that may be charged is often larger than the number of far sensing elements that may be charged in the same display blank period.
  • the drive circuitry 250 may arrange the timing of the touch drive signal DST according to the aforementioned details.
  • the drive circuitry 250 may use the entire display blank period or only part of the display blank period to apply the touch drive signal DST.
  • the control circuitry or sense circuitry drives the sensing elements at the first mode
  • the touch drive signal is applied to the sensing elements according to a first charging period within the display period for all sensing elements.
  • the first charging period is defined as the period for charging the far sensing elements.
  • the control circuitry or sense circuitry determine to drives the sensing elements at the second mode, the sensing elements is charged to reach a predetermined charged level by adjusting a second charging period or a second charging voltage for charging each sensing elements.
  • the drive circuitry may charge the sensing element with different charging period or charging voltage.
  • the near sensing element may only require short period of time to charge compared to the far sensing elements.
  • the control circuitry drives the touch sensor at the second mode; and wherein when the charge level of the sensing elements is not lower than a predetermined level, the control circuitry drives the touch sensor at the first mode.
  • Each drive line of the touch sensor 230 scanned in a display blank period may receive a single drive signal DST or a series of multiple touch drive signal DST or all of the touch drive signal DST applied by the drive circuitry 250 in the display blank period.
  • the touch drive signal DST sent out by the drive circuitry 250 in a display blank period may concentrate on a single drive line or may be distributed into multiple drive lines of the touch sensor 230.
  • a single drive line needs to be driven by a series of multiple touch drive signal DST so that a burst of noises cannot corrupt all of the resultant sense signals SS.
  • a display blank period may be very short such that only one drive signal DST may be sent out. Sometimes a display blank period may be too short for applying one drive signal DST to fully charge a sensing element of the touch sensor 230.
  • the drive circuitry 250 may distribute the full charging of at least one of the sensing elements of the touch sensor 230 into multiple display blank periods. In other words, the drive circuitry 250 may charge the same sensing element partially in each display blank period so that the sensing element may be fully charged after multiple display blank periods.
  • the drive circuitry 250 may drive a scan line of the display module 240 to display an image and simultaneously send one or more touch drive signal DST to one or more sensing elements of the touch sensor 230 in another scan line of the display module 240.
  • Fig. 8 is a schematic diagram showing a comparison between the default mode 500 and another mode 800 according to an embodiment of the present disclosure.
  • the drive circuitry 250 merges a part of the display blank periods 511 and 514 between scan lines into the display blank periods 512 and 513 between pixels or sub-pixels to even out the lengths of the display blank periods 511-514, and then the drive circuitry 250 scans the touch sensor 230 by applying the touch drive signal DST in each display blank period 511-514.
  • the drive circuitry 250 drives the pixels of a scan line of the display module 240 and simultaneously send touch drive signal DST to drive the touch sensor sensing elements in another scan line of the display module 240 to avoid the noises generated by the pixels of the first scan line.
  • Fig. 8 There is another interpretation for Fig. 8 . There are three pixel process periods at the mode 800, while there are ten scanning periods at the mode 800. Since more touch drive signal DST are applied to the touch sensor 230 than the display drive signal DSD are applied to the display module 240, the frequency of the touch drive signal DST is different from the frequency of the display drive signal DSD, which helps to reduce the noise level.
  • the drive circuitry 250 may select one or more pixel process periods of pixels or sub-pixels of the display module 240 according to the level of noises generated by the pixels or the sub-pixels displaying an image according to the display drive signal DSD and scan the touch sensor 230 by applying the touch drive signal DST in the selected pixel process periods of the pixels or sub-pixels.
  • the drive signal DSD from the drive circuitry 250 specifies the greyscales to be displayed by the pixels or sub-pixels of the display module 240.
  • the relation of the levels of noises generated by the display module 240 versus the displayed greyscales of the display module 240 may be measured in advance in a laboratory.
  • This relation may be pre-stored in the drive circuitry 250 such that the drive circuitry 250 knows in advance which greyscales produce major noises and which greyscales produce minor tolerable noises.
  • the drive circuitry 250 may select some pixel process periods of pixels or sub-pixels of the display module 240 with lower noises and applies the touch drive signal DST to the touch sensor 230 in the selected pixel process periods.
  • Fig. 9 is a schematic diagram showing a comparison between the default mode 500 and another mode 900 according to an embodiment of the present disclosure.
  • the drive circuitry 250 merges a part of the display blank periods 511 and 514 between scan lines into the display blank periods 512 and 513 between pixels or sub-pixels to even out the lengths of the display blank periods 511-514, and then the drive circuitry 250 scans the touch sensor 230 in each display blank period 511-514.
  • the drive circuitry 250 since the greyscale displayed in the pixel process period 521 generates more noises and the greyscales displayed in the pixel process periods 522 and 523 generate less noises, the drive circuitry 250 also scans the touch sensor 230 in the pixel process periods 522 and 523.
  • each mode of the touch drive signal DST involves specific timing or frequency of the touch drive signal DST.
  • the sense circuitry 220 may determine the timing and/or frequency of the touch drive signal DST and then notifies the drive circuitry 250 of the timing and/or frequency of the touch drive signal DST.
  • the drive circuitry 250 may synchronize the vertical synchronization signal VSYNC or the horizontal synchronization signal HSYNC or one or more display blank periods with the sense circuitry 220 for determining the timing and/or frequency for the drive circuitry 250 to apply the touch drive signal DST for the touch sensor 230.
  • the drive circuitry 250 may simply provide the vertical synchronization signal VSYNC and the horizontal synchronization signal HSYNC to the sense circuitry 220 so that the sense circuitry 220 may know the timing of the vertical synchronization signal VSYNC, the horizontal synchronization signal HSYNC, and the display blank periods.
  • Fig. 10 is a schematic diagram showing an electronic device 200 according to an embodiment of the present disclosure.
  • the electronic device 200 includes a display module 240, a touch sensor 230 integrated into the display module 240, and an integrated controller 205.
  • the display module 240 and the touch sensor 230 constitute the touch display of the electronic device 200.
  • the integrated controller 205 is coupled to the display module 240 and the touch sensor 230.
  • the integrated controller 205 may include the drive circuitry 250 and the sense circuitry 220 shown in Fig. 2 , or include the drive circuitry 250, the sense circuitry 220 and the process unit 210 shown in Fig. 10 .
  • Fig. 11A is a flow chart showing a method for driving a touch sensor integrated into a display module of an electronic device according to an embodiment of the present disclosure.
  • This method may be executed by the integrated controller 205.
  • the integrated controller 205 drives the display module 240 to display an image, such as the graphical user interface (GUI) of the electronic device 200.
  • the integrated controller 205 drives the display module 240 by providing the display drive signal DSD, the vertical synchronization signal VSYNC and the horizontal synchronization signal HSYNC to the display module 240.
  • Each of the display drive signal DSD controls the greyscale of a pixel or a sub-pixel of the display module 240.
  • the vertical synchronization signal VSYNC indicates the beginning of each image frame.
  • the horizontal synchronization signal HSYNC indicates the beginning of each scan line of an image frame.
  • the integrated controller 205 determines a signal frequency of the touch drive signal DST to be sent to the touch sensor 230.
  • the integrated controller 205 determines the signal frequency in order to avoid noises interfering with the sense signals SS.
  • the integrated controller 205 may determine the signal frequency simply by trial and error. In other words, the integrated controller 205 may try various signal frequencies of the touch drive signal DST until an ideal signal frequency that may reduce the level of the noises is found.
  • the integrated controller 205 may detect fundamental frequencies and harmonic frequencies of the noises by analyzing the sense signals SS received in previous scans of the touch sensor 230. How to detect the frequencies of the noises is well-known and is not discussed here.
  • the integrated controller 205 may set the signal frequency of the touch drive signal DST to avoid both the fundamental frequencies and harmonic frequencies of the noises for the best result. In other words, the signal frequency should be as far from the fundamental frequencies and harmonic frequencies of the noises as possible.
  • the integrated controller 205 may determine the signal frequency according to the flow shown in Fig. 11B .
  • the integrated controller 205 determines an image frequency by analyzing the greyscales of the image to be displayed by the display module 240.
  • the integrated controller 205 determines the signal frequency such that the signal frequency avoids the image frequency. In other words, the signal frequency should be as far from the image frequency as possible.
  • Fig. 11C is a schematic diagram showing pixel process periods of pixels or sub-pixels of the display module 240 according to an embodiment of the present disclosure. Fig. 11C also depicts some examples of the aforementioned image frequency.
  • each monochrome pixel is the smallest display unit and Fig. 11C shows the pixel process periods 442, 444 and 446 in which the integrated controller 205 sends the display drive signal DSD to the pixels of the display module 240.
  • the display module 240 is multicolored, each sub-pixel is the smallest display unit and Fig. 11C shows the pixel process periods 442, 444 and 446 in which the integrated controller 205 sends the display drive signal DSD to the sub-pixels of the display module 240.
  • the display drive signal DSD output by the integrated controller 205 specify the greyscales to be displayed by the pixels or sub-pixels of the display module 240.
  • Each multicolored pixel consists of multiple sub-pixels.
  • Each sub-pixel of a pixel displays a different primary color.
  • a pixel process period is a length of time in which the integrated controller 205 sends display drive signal DSD to one or more pixels or sub-pixels of the display module 240 for displaying the image.
  • the integrated controller 205 sends a drive signal DSD to the display module 240 for each of the nine pixels/sub-pixels 1-9. If the length of the pixel process period 442 is T, then the image frequency in the pixel process period 442 is 9/T.
  • the integrated controller 205 does not have to send the drive signal DSD to this pixel/sub-pixel.
  • the pixels/sub-pixels 4-6 and 8 display the default greyscale. Therefore, the integrated controller 205 outputs only five display drive signal DSD for the pixels/sub-pixels 1-3, 7 and 9.
  • the image frequency in the pixel process period 444 is 5/T.
  • the pixels/sub-pixels 2, 3, 5 and 8 display the default greyscale. Therefore, the integrated controller 205 outputs only five display drive signal DSD for the pixels/sub-pixels 1, 4, 6, 7 and 9.
  • the image frequency in the pixel process period 446 is also 5/T.
  • step 406 the integrated controller 205 determines the timing of each of the touch drive signal DST according to the vertical synchronization signal VSYNC, the horizontal synchronization signal HSYNC and the signal frequency determined in step 404.
  • step 408 the integrated controller 205 scans the touch sensor 230 by sending the touch drive signal DST to the touch sensor 230 according to the timing determined in step 406. By determining the signal frequency and the timing, the integrated controller 205 determines the mode for applying the touch drive signal DST for the touch sensor 230.
  • the integrated controller 205 may know the beginning time and the end time of each display blank period and each pixel process period of the display module 240 based on the vertical synchronization signal VSYNC and the horizontal synchronization signal HSYNC. The integrated controller 205 may determine the timing such that the integrated controller 205 sends the touch drive signal DST to the touch sensor 230 only in the display blank periods of the display module 240 or the pixel process periods of pixels or sub-pixels of the display module 240 that generate noises at a relatively lower level.
  • Fig. 5 to Fig. 9 provides some detailed examples and discussions about the timing of the touch drive signal DST.
  • the integrated controller 205 receives the sense signals SS generated by the touch sensor 230 in response to the touch drive signal DST.
  • the integrated controller 205 analyzes the sense signals SS to detect one or more touch events.
  • the integrated controller 205 may perform a function of the electronic device 200 according to the one or more touch events.
  • the integrated controller 205 may determine the mode to apply the touch drive signal DST based on any image property of the image to be displayed by the display module 240.
  • the image property may be a histogram of the greyscales of the image or the signal frequency of the display drive signal DSD in the example of Fig. 11C .
  • Fig. 11D is a flow chart showing a method for driving a touch sensor integrated into a display module of an electronic device according to another embodiment of the present disclosure. This method may be executed by the integrated controller 205.
  • Step 452 is a previous scan of the touch sensor 230 consisting of steps 402-410 in Fig. 11A .
  • the integrated controller 205 analyzes the sense signals SS to detect the level of the noises.
  • the integrated controller 205 checks whether the level of the noises is higher than a predetermined value or not. When the level of the noises is not higher than the predetermined value, the integrated controller 205 analyzes the sense signals SS to detect the touch event in step 466. When the level of the noises is higher than the predetermined value, the integrated controller 205 changes the signal frequency of the touch drive signal DST to a new frequency in step 458. The integrated controller 205 determines the new frequency in order to avoid the noises.
  • the integrated controller 205 may determine the new frequency of the touch drive signal DST according to the flow shown in Fig. 4E.
  • the integrated controller 205 analyzes the sense signals SS to detect the frequency of the noises in step 472 and then in step 474 determines the new frequency such that the new frequency avoids the noise frequency.
  • step 460 the integrated controller 205 determines the new timing of each of the touch drive signal DST according to the vertical synchronization signal VSYNC, the horizontal synchronization signal HSYNC and the new frequency determined in step 458.
  • step 462 the integrated controller 205 scans the touch sensor 230 by sending the touch drive signal DST to the touch sensor 230 according to the new timing.
  • step 464 the integrated controller 205 receives the sense signals SS generated by the touch sensor 230 in response to the touch drive signal DST, and then the flow returns to step 454.
  • the integrated controller 205 may execute the loop of steps 454-464 as a trial-and-error process. As long as the noise level is too high, the integrated controller 205 may simply choose another frequency for the touch drive signal DST and repeat the loop until the detected level of noises drops to an acceptable level.
  • the sense circuitry 220, the drive circuitry 250, and the process unit 210 may exchange data and control signals in order to cooperate in executing the steps in Fig 2A , Fig 2C , Fig 3A , Fig. 3B , Fig. 4A and Fig. 4B .
  • Step 402 may be executed by the drive circuitry 250.
  • Step 404 may be executed by the process unit 210, the sense circuitry 220 or the drive circuitry 250.
  • Step 406 may be executed by the sense circuitry 220 or the drive circuitry 250.
  • Step 408 may be executed by the drive circuitry 250.
  • Steps 410 and 412 may be executed by the sense circuitry 220.
  • Step 432 may be executed by the process unit 210.
  • Step 434 may be executed by the process unit 210, the sense circuitry 220 or the drive circuitry 250.
  • Steps 454 and 456 may be executed by the sense circuitry 220. Each of steps 458 and 460 may be executed by the sense circuitry 220 or the drive circuitry 250. Step 462 may be executed by the drive circuitry 250. Steps 464 and 466 may be executed by the sense circuitry 220. Step 472 may be executed by the sense circuitry 220. Step 474 may be executed by the sense circuitry 220 or the drive circuitry 250.
  • the sense circuitry 220 or the drive circuitry 250 may decide when to scan the touch sensor 230.
  • the sense circuitry 220 may send at least one control signal to inform the drive circuitry 250 to begin sending the touch drive signal DST to the touch sensor 230 and the sense circuitry 220 may wait to receive the sense signals SS.
  • the drive circuitry 250 may begin sending the touch drive signal DST to the touch sensor 230 and send at least one control signal to inform the sense circuitry 220 to receive the sense signals SS.
  • the process unit 210 is the main system of the electronic device 200. The process unit 210 may perform the function of the electronic device 200 according to one or more touch events detected by the sense circuitry 220.
  • the sense circuitry 220 may detect the relation of the levels of noises versus the displayed greyscales of the pixels or sub-pixels of the display module 240. This relation may be stored in the process unit 210, the sense circuitry 220 or the drive circuitry 250 for using the mode 900 in Fig. 9 .
  • the present disclosure may determine the mode for applying the drive signals for the touch sensor in order to avoid bursts of noises and get better results of touch sensor scanning.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

An electronic device (200) and a method for driving a touch sensor (230) integrated in a display module (240) of an electronic device (200) are provided. The electronic device (200) includes a display module (240) with a touch sensor (230) integrated in the display module (240), a drive circuitry (250), and a sense circuitry (220). The drive circuitry (250) is configured to apply drive signals (DSD, DST) to the display module (240) and the touch sensor (230). The sense circuitry (220) is configured to determine a mode for the drive circuitry (250) to apply the drive signals (DST), detect one or more sense signal (SS) from the touch sensor (230), analyze the sense signals (SS), and change the mode of the drive signals (DST) for the touch sensor (230).

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This application claims the priority benefit of Taiwan application serial no. 61/535,377, filed on September 16, 2011 . The entirety of the above-mentioned patent application is hereby incorporated by reference herein and made a part of this specification.
  • BACKGROUND DISCLOSURE Field of the Disclosure
  • The present disclosure relates to a touch sensor of an electronic device. More particularly, the present disclosure relates to an electronic device and a method for scanning a touch sensor of the electronic device.
  • Description of the Related Art
  • Fig. 1 is a schematic diagram showing a conventional electronic device 100 including a system 110, a touch controller 120 and a capacitive touch sensor 130. The system 110 is the main system of the electronic device 100. The capacitive touch sensor 130 includes a set of drive lines and a set of sense lines. Each location where a drive line crosses a sense line is a sensing element of the capacitive touch sensor 130. For example, two sensing elements of the capacitive touch sensor 130 are marked as 132 and 134, respectively. Each sensing element is a sensor for sensing touch or proximity of the user.
  • When a user performs some operations on the capacitive touch sensor 130, the touch controller 120 may detect resultant touch events by scanning the capacitive touch sensor 130. The touch controller 120 scans the capacitive touch sensor 130 by sending touch drive signal DST to the drive lines of the capacitive touch sensor 130. The touch drive signal DST charges the sensing elements of the capacitive touch sensor 130 and the sensing elements generate sense signals SS in response. Next, the touch controller 120 receives the sense signals SS from the sense lines of the capacitive touch sensor 130. The touch controller 120 analyzes the sense signals SS to determine the locations of the touch events. The system 110 may perform predetermined functions of the electronic device 100 according to the touch events.
  • In the scanning of a capacitive touch sensor, noises often affect the sense signals and cause erroneous results of the detection of touch events. The noise is always present and is always a problem. For example, many electronic devices, such as smart phones and tablet computers, are equipped with touch displays that consist of touch sensors and liquid crystal modules (LCMs). An LCM generates a lot of noises when the polarities of its pixels are inverted.
  • SUMMARY
  • Accordingly, the present disclosure is directed to an electronic device and a method for driving a touch sensor integrated into a display module in an electronic device. The electronic device and the method may determine a mode for applying a drive signal to the touch sensor and change the mode in order to avoid bursts of the noises.
  • According to an embodiment of the present disclosure, an electronic device is provided. The electronic device comprises a display module, a touch sensor integrated into the display module, and a control circuitry. The control circuitry is coupled to the touch sensor and the display module and configured to drive the touch sensor by a touch drive signal at one of a first mode and a second mode and detect a sense signal from the touch sensor when the touch sensor is driven by the touch drive signal. The control circuitry may further configured to determine the one of the first mode and the second mode for driving the touch sensor based on a determination.
  • According to one embodiment of the present disclosure, the control circuitry comprises a sense circuitry, and a drive circuitry. The sense circuitry is coupled to the touch sensor and configured to determine the one of the first mode and the second mode for driving the touch sensor, and configured to detect the sense signal from the touch sensor. The drive circuitry is coupled to the sense circuitry, the display module and the touch sensor and configured to apply a display drive signal for driving the display module and apply the touch drive signal for driving the touch sensor at the one determined mode.
  • According to another embodiment of the present disclosure, the control circuitry may comprise a sense circuitry, a process unit and a drive circuitry. The sense circuitry is coupled to the touch sensor, the process unit and the drive circuitry and configured to detect the sense signal from the touch sensor. The process unit is configured to determine the one of the first mode and the second mode for driving the touch sensor. The drive circuitry is coupled to the touch sensor and the process unit and configured to apply the display drive signal for driving the display module and apply the touch drive signal for driving the touch sensor. When the process unit determined that an image to be displayed on display module results in a noise level greater than a predetermined level for the touch sensor, the process unit determines to drive the touch sensor at the first mode. Whereas, when it is determined that the image to be displayed on display module does not result in the noise level for the touch sensor greater than the predetermined level for the touch sensor, the process unit determines to drive the touch sensor at the second mode.
  • According to another embodiment of the present disclosure, a method for driving a touch sensor integrated into a display module in an electronic device is provided. The method includes the following steps: determining one of a first mode and a second mode for driving the touch sensor; driving the touch sensor by a touch drive signal at the one determined mode and detecting the sense signals from the touch sensor when the touch sensor is driven by the touch drive signal.
  • According to one embodiment of the present disclosure, the method further comprises: applying the touch drive signal to the touch sensor within a display period; applying the touch drive signal to the touch sensor according to a first predetermined timing within the display period when the first mode is determined for driving the touch sensor; and applying the touch drive signal to the touch sensor according to a second predetermined timing within the display period when the second mode is determined for driving the touch sensor.
  • According to another embodiment of the present disclosure, the method further comprises: applying the touch drive signal to the touch sensor at a first frequency within the display period when the first mode is determined for driving the touch sensor; and applying the touch drive signal to the touch sensor at a second frequency within the display period when the second mode is determined for driving the touch sensor.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the disclosure and, together with the description, serve to explain the principles of the disclosure.
  • Fig. 1 is a schematic diagram showing a conventional electronic device.
  • Fig. 2A is a schematic diagram showing an electronic device according to an embodiment of the present disclosure.
  • Fig. 2B is a cross-sectional view of a display module with an in-cell capacitive touch sensor according to an embodiment of the present disclosure.
  • Fig. 2C is a flow chart showing a method for scanning a touch sensor integrated into a display module of an electronic device according to an embodiment of the present disclosure.
  • Fig. 3A is a schematic diagram showing an electronic device according to an embodiment of the present disclosure according to another embodiment of the present disclosure.
  • Fig. 3B is a flow chart showing a method for driving a touch sensor integrated into a display module of an electronic device according to another embodiment of the present disclosure.
  • Fig. 4A is a schematic diagram showing an electronic device according to an embodiment of the present disclosure according to another embodiment of the present disclosure.
  • Fig. 4B is a flow chart showing a method for driving a touch sensor integrated into a display module of an electronic device according to another embodiment of the present disclosure.
  • Fig. 5 to Fig. 9 are schematic diagrams showing driving a touch sensor integrated into a display module of an electronic device according to embodiments of the present disclosure.
  • Fig. 10 is a schematic diagram showing an electronic device according to an embodiment of the present disclosure.
  • Fig. 11A and Fig. 11B are flow charts showing a method for driving a touch sensor integrated into a display module of an electronic device according to an embodiment of the present disclosure.
  • Fig. 11C is a schematic diagram showing pixel process periods of pixels or sub-pixels of a display module according to an embodiment of the present disclosure.
  • Fig. 11D and Fig. 11E are flow charts showing a method for driving a touch sensor integrated into a display module of an electronic device according to an embodiment of the present disclosure.
  • DESCRIPTION OF THE EMBODIMENTS
  • Reference will now be made in detail to the present embodiments of the disclosure, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the description to refer to the same or like parts.
  • Fig. 2A is a schematic diagram illustrating an electronic device 200 according to an embodiment of the present disclosure. The electronic device 200 may be any electronic devices with a touch display, such as smart phones, personal digital assistants, tablet computers or notebook computers. An electronic device 200 comprises a display module 240, a touch sensor 230, which integrated into the display module 240, and a control circuitry 201. The display module 240 comprises a plurality of pixels or sub-pixels and a plurality of scan lines connected to the plurality of pixels or sub-pixels, and the control circuitry 201 is further configured to drive the pixels or sub-pixels through the use of scan lines during a display period. The display period includes a plurality of pixel process periods, during which the pixels or sub-pixels are driven, and a plurality of blank periods, during which no pixel or sub-pixel is driven. The control circuitry 201 is coupled to the touch sensor 230 and the display module 240 and configured to drive the touch sensor by a touch drive signal DST at either a first mode or a second mode and detect a sense signals SS from the touch sensor 230 when the touch sensor 230 is driven by the touch drive signal DST. In one embodiment, the touch drive signal DST is applied to drive the touch sensor 230 within the display period.
  • The display module 240 may be a liquid crystal module (LCM), OLED (organic light emitting diode) display module or transparent OLED display module. The touch sensor 230 may be an in-cell capacitive touch sensor which may includes a plurality of sensing elements coupled to the control circuitry 201. Each sensing element is a sensor for sensing the touch or the proximity of a conductive object such as a stylus or a finger of the user. These touch sensor 230 may be integrated into the display module 240. The sensing elements of the touch sensor may share or use a Vcom circuitry for the display module to charge or drive the sensing elements. Although the touch sensor 230 is an in-cell capacitive touch sensor, the present disclosure is not limited to in-cell capacitive touch sensors only. The present disclosure is applicable to any touch sensor that is integrated into a display module, including on-cell touch sensor. In other words, the display module 240 may be an in-cell or on-cell display module.
  • As depicted in Fig. 2B, it is a cross-sectional view of the display module 240 with the in-cell capacitive touch sensor 230 according to an embodiment of the present disclosure. The display module 240 includes an upper substrate 12, a lower substrate 14 and a liquid crystal (LC) layer 16. The upper substrate 12 may be a color filter (CF) substrate with a color filter layer 12a, while the lower substrate 14 may be a thin-film transistor (TFT) array substrate with a TFT array 18a. The LC layer 16 is sandwiched between the two substrates 12 and 14. The display module 240 also includes the in-cell capacitive touch sensor 230 integrated into the display module 240. The touch sensor 230 has a first conductive layer 18a with drive line electrodes (not shown) formed on the upper surface of the lower substrate 14 for receiving drive signals, and a second conductive layer 18b with sense line electrodes (not shown) formed on the upper surface of the upper substrate 12 for providing sense signals. The sense signals are provided from the touch sensor 230 when the touch sensor 230 is driven. The sense signals may be generated by the touch or the proximity of one or more conductive objects to one or more sensing elements of the touch sensor 230. In this embodiment, the first conductive layer 18a is integrated into the TFT array 18a by using the gate lines of the TFT array 18a as the drive line electrodes of the first conductive layer 18a.
  • Please note that the positions of the first and second conductive layers 18a and 18b integrated into the LCM module are not limited in the present disclosure. For example, the first conductive layer 18a may also be formed on the lower surface of the upper substrate, and the two conductive layers 18a and 18b may be formed on the same layer so as to form a single-layer type sensor on the upper surface of the upper substrate. In another embodiment, the single-layer type sensor may be formed on the lower surface of the upper substrate.
  • According to above-mentioned embodiments of the present disclosure, the display module may be any type of LCM modules, e.g. IPS type, VA type, TN type, and etc. The display module structure may be implemented in IPS type LCM module, or in VA or TN type LCM module.
  • A method for driving a touch sensor integrated into a display module of an electronic device comprises the steps of driving the touch sensor by a touch drive signal at either a first mode or a second mode and detecting sense signals from the touch sensor when the touch sensor is driven by the touch drive signal. Please refer to Fig. 2C, which is a flow chart illustrating a method for driving a touch sensor, which is integrated into a display module in an electronic device according to an embodiment of the present disclosure. The method shown in Fig. 2C may be executed by the electronic device 200 shown in Fig. 2A. In step 420, the control circuitry 201 is coupled to the touch sensor 230 and the display module 240 and configured to drive the touch sensor 230 by a touch drive signal DST at either a first mode or a second mode and detect sense signals SS from the touch sensor 230 when the touch sensor 230 is driven by the touch drive signal. The control circuitry 201 is further configured to determine one of the first mode and the second mode for driving the touch sensor 230 based on a determination. The determination may be determined as the following examples. First example is related to noise level. The determination for driving the touch sensor 230 is to determine whether the sense signals SS has a noise level greater than a predetermined level. When the control circuitry 201 determines that the sense signals SS have the noise level greater than the predetermined level, the control circuitry 201 drives the touch sensor 230 at the first mode. When the control circuitry 201 determined that the sense signals SS do not have the noise level greater than the predetermined level, the control circuitry 201 drives the touch sensor 230 at the second mode. Second example is related to characteristic of the touch sensor 230. The determination for driving the touch sensor 230 is to determine a characteristic of the touch sensor. When it is determined that the touch sensor 230 has a first characteristic, the control circuitry 201 drives the touch sensor 230 at the first mode. When it is determined that the touch sensor 230 has a second characteristic, the control circuitry 201 drives the touch sensor at the second mode. The third example is related to the charge level of the touch sensor 230. The determination for driving the sensing element is to determine whether a charge level, which is determined based on the detected sense signal, of at least one of the sensing elements is lower than a predetermined charge level. When it is determined that the charge level is not lower than a predetermined charge level, the control circuitry 201 drives the touch sensor 230 at the first mode. When it is determined that the charge level is lower than a predetermined charge level, the control circuitry 201 drives the touch sensor 230 at the second mode. The fourth example is related to image to be displayed on the display module. The determination for driving the touch sensor 230 is to determine whether an image to be displayed on display module 240 results in a noise level greater than a predetermined level for touch sensor 230. When it is determined that the image to be displayed on display module 240 results the noise level greater than the predetermined level, the control circuitry 201 determines to drives the touch sensor 230 at the first mode. When it is determined that the image to be displayed on display module does not result the noise level for the touch sensor 230 greater than the predetermined level, the control circuitry to drives the touch sensor 230 at the second mode.
  • Fig. 3A is a schematic diagram illustrating another example an electronic device 200 according to an embodiment of the present disclosure. The electronic device 200 includes a display module 240 with a touch sensor 230 integrated into the display module 240, a drive circuitry 250 coupled to the display module 240 and the touch sensor 230, and a sense circuitry 220 coupled to the touch sensor 230 and the drive circuitry 250. The sense circuitry is configured to determine the one of the first mode and the second mode as a determined mode for driving the touch sensor, and configured to detect the sense signals from the touch sensor. The drive circuitry 250 is configured to apply the display drive signal DSD for driving the display module and apply the touch drive signal DST for driving the touch sensor at the determined mode.
  • Fig. 3B is a flow chart illustrating a method for driving a touch sensor integrated into a display module of an electronic device according to another embodiment of the present disclosure. The method shown in Fig. 3B may be executed by the electronic device 200 shown in Fig. 3A. The In step 420, the sense circuitry 220 determines either a first or a second mode for the drive circuitry 250 to apply the drive signals. The drive signals in this embodiment, comprises the display drive signal DSD for the display module 240 and the touch drive signal DST for the touch sensor 230. In step 422, the drive circuitry 250 applies the display drive signal DSD to the display module 240 and applies the touch drive signal DST to the touch sensor 230. Steps 420 and 422 are the same as their counterparts in Fig. 4A. In step 424, the sense circuitry 220 may detect one or more sense signals SS from the touch sensor 230. In step 426, the sense circuitry 220 analyzes the sense signals SS. The electronic device 200 may execute one or more functions according to the one or more touch events. In step 428, the sense circuitry 220 may change from the first mode to the second mode for the drive circuitry 250 to apply the touch drive signal DST for driving the touch sensor 230. The sense circuitry 220 may determine to change the mode for the drive circuitry 250 to apply the touch drive signal DST for driving the touch sensor 230 when the sense circuitry 220 analyzes the sense signals SS and identifies at least one of the sense signals SS with a noise level greater than a predetermined value. One of the purposes of the change of the mode in step 428 is avoiding the noises interfering with the scanning of the touch sensor 230. The sense circuitry 220 is further configured to determine one of the first mode and the second mode for driving the touch sensor 230 based on a determination. The determination may be determined as the following examples. First example is related to noise level. The determination for driving the touch sensor 230 is to determine whether the sense signals SS has a noise level greater than a predetermined level. When the sense circuitry 220 determined that the sense signals have the noise level greater than the predetermined level, the sense circuitry 220 determines the first mode for the drive circuitry 250 to drives the touch sensor 230. When the sense circuitry 220 determined that the sense signals SS does not have the noise level greater than the predetermined level, the sense circuitry 220 determines to drives the touch sensor 230 at the second mode. Second example is related to characteristic of the touch sensor 230. The determination for driving the touch sensor 230 is to determine a characteristic of the touch sensor 230; wherein when it is determined that the touch sensor 230 has a first characteristic, the sense circuitry 220 determines to drive the touch sensor 230 at the first mode. When it is determined that the touch sensor 230 has a second characteristic, the sense circuitry 220 determines to drive the touch sensor 230 at the second mode. The third example is related to the charge level of the touch sensor 230. The determination for driving the sensing element is to determine whether a charge level, which is determined based on the detected sense signal, of at least one of the sensing elements is lower than a predetermined charge level. When the sense circuitry 220 determines that the charge level is not lower than a predetermined charge level, the sense circuitry 220 determines to drive the touch sensor 230 at the first mode. When the sense circuitry 220 determines that the charge level is lower than the predetermined charge level, the sense circuitry 220 determines to drive the touch sensor 230 at the second mode.
  • The aforementioned mode is related to the timing or the frequency to apply or send the touch drive signal DST to the touch sensor 230. When the control circuitry 201 determines the first mode for driving the touch sensor 230, the touch drive signal DST is applied to the touch sensor 230 according to a first predetermined timing within the display period. When the control circuitry 201 determines the second mode for driving the touch sensor 230, the touch drive signal DST is applied to the touch sensor 230 according to a second predetermined timing within the display period. The first predetermined timing may be different from the second predetermined timing. In order to switch the mode for driving the touch sensor 230, the sense circuitry 220 may send an instruction to control the drive circuitry 250 to change the timing or the frequency of the touch drive signal DST for driving the touch sensor 230. The sense circuitry 220 may adjust the timing of the touch drive signal DST for the touch sensor 230 by changing the mode for the drive circuitry 250 to apply the touch drive signal DST.
  • Fig. 4A is a schematic diagram showing the electronic device 200 according to another embodiment of the present disclosure. The electronic device 200 in Fig. 4A includes a display module 240 with a touch sensor 230 integrated into the display module 240, a drive circuitry 250 coupled to the display module 240 and the touch sensor 230, a process unit 210 coupled to the drive circuitry 250, and a sense circuitry 220 coupled to the touch sensor 230, the process unit 210 and the drive circuitry 250. The process unit 210 may include a memory 215 configured to store different modes to be selected in step 1110 for applying the touch drive signal DST for the touch sensor 230.
  • Fig. 4B is a flow chart showing a method for driving a touch sensor integrated into a display module of an electronic device according to an embodiment of the present disclosure. This method may be executed by the electronic device 200 as shown in Fig. 4A. In step 1110, the process unit 210 determines either a first mode or a second mode to apply the touch drive signal DST for the touch sensor 230 based on an image to be displayed on the display module 240 or an image property of the image such as histogram of the image. The image to be displayed on display module may result in a noise level greater than a predetermined level for touch sensor. When the process unit is determined that the image to be displayed on display module results in the noise level greater than the predetermined level, the process unit determines for the drive circuitry to drives the touch sensor at the first mode. When the process unit determined that the image to be displayed on display module does not result in the noise level for the touch sensor greater than the predetermined level, the process unit determines for the drive circuitry to drives the touch sensor at the second mode. In step 1120, the sense circuitry 220 instructs the driving circuitry 250 the timing or the frequency to apply the touch drive signal DST based on the mode. In other words, the timing or frequency to apply the touch drive signal DST is determined by the sense circuitry 220 and is implemented by the drive circuitry 250. In step 1130, the drive circuitry 250 applies the display drive signal DSD and DST for the display module 240 and the touch sensor 230.
  • Fig. 5 is a schematic diagram showing the default mode 500 for sending the touch drive signal DST to scan the touch sensor 230 of the electronic device 200 according to an embodiment of the present disclosure. The default mode 500 may be used as the mode in step 420 or the mode in step 428. The drive circuitry 250 may scan the touch sensor 230 by applying the touch drive signal DST at the default mode 500.
  • As shown in Fig. 5, the period from the beginning of a pulse of the vertical synchronization signal VSYNC to the beginning of the next pulse of the vertical synchronization signal VSYNC is the period of an image frame displayed by the display module 240. The display period mentioned above may be the period of an image frame displayed by the display module 240. The vertical synchronization signal VSYNC ensures the scan of the display module 240 starts at the top of the image frame at the right time. The period from the beginning of a pulse of the horizontal synchronization signal HSYNC to the beginning of the next pulse of the horizontal synchronization signal HSYNC is the period of a scan line of the image frame displayed by the display module 240. The display period mentioned above may be the period of a scan line of the image frame displayed by the display module 240. The horizontal synchronization signal HSYNC has a plurality of high voltage levels and a plurality of low voltage levels to form a plurality of pulses. The horizontal synchronization signal HSYNC synchronizes the start of the horizontal image scan line in the display module 240 with the image source that generates the horizontal synchronization signal HSYNC.
  • The display drive signal DSD is applied to the display module 240 during a display period, which may include a plurality of pixel process periods (such as the pixel process periods 521-523) for the drive circuitry 250 to drive pixels or sub-pixels of the display module 240 at the high voltage level of the horizontal synchronization signal HSYNC. In this embodiment, the pixel process periods 521-523 are defined within the high voltage level of the horizontal synchronization signal HSYNC. Each pixel of the display module 240 may include multiple sub-pixels and each sub-pixel may display a different primary color, such as red, green or blue. The drive circuitry 250 may control the greyscale of at least one pixel or at least one sub-pixel of the display module 240 in each pixel process period 521-523.
  • The display period mentioned above further includes one or more display blank periods, such as the display blank periods 511-514. The blank periods are the periods during which no pixel or sub-pixel is driven. Each display blank period is a period between the pixel process periods of two scan lines, two pixels or two sub-pixels of the display module 240. Here a display blank period between two scan lines means a display blank period between the pixel process period of the last pixel of a scan line and the pixel process period of the first pixel of the next scan line, such as the display blank periods 511 and 514. The display blank period 511 and 514 are defined within the low voltage levels of the horizontal synchronization signal HSYNC, respectively while the display blank periods 512 and 513 are defined within the high voltage level of the horizontal synchronization signal HSYNC. The drive circuitry 250 does not drive any one pixel or sub-pixel of the display module 240 in the display blank periods. Since the display module 240 does not forward the drive signal DSD to the pixels in the display blank periods and thus has no big currents and does not produce common voltage (VCOM) noises in the display blank periods, the drive circuitry 250 may scan the touch sensor 230 by applying the touch drive signal DST in the display blank periods to avoid bursts of noises. For example, at the default mode 500, the drive circuitry 250 scans the touch sensor 230 only in the display blank periods between two scan lines, such as the display blank periods 511 and 514. The lowermost part of Fig. 5 shows two scanning periods 531 and 532. Each scanning period is a period wherein the drive circuitry 250 scans the touch sensor 230 by applying the touch drive signal DST to the touch sensor 230.
  • The following is the discussion regarding the non-default modes of the touch drive signal DST that may be used in steps 420 and 428. When driving the touch sensor 230, the sense circuitry 220 may instruct the drive circuitry 250 to adjust the display blank periods to form a prolonged display blank period, and apply the touch drive signal DST for the touch sensor 230 within the prolonged display blank period. The drive circuitry 250 may merge a part or all of one or more display blank periods into the prolonged display blank period.
  • For example, Fig. 6 is a schematic diagram showing a comparison between the default mode 500 and another mode 600 according to an embodiment of the present disclosure. In the mode 600, the drive circuitry 250 merges a part of the display blank period 511 into the prolonged display blank period 514 to make the display blank period 514 longer for accommodating more touch drive signal DST, and then the drive circuitry 250 scans the touch sensor 230 by applying the touch drive signal DST in the prolonged display blank period 514. The drive circuitry 250 may merge more display blank periods between scan lines into the prolonged display blank period 514 to make the prolonged display blank period 514 even longer.
  • When driving the touch sensor 230, the drive circuitry 250 may distribute the applying of the touch drive signal DST in one or more display blank periods according to the length of each display blank period and the length of time required for charging the sensing elements of the touch sensor 230. For example, Fig. 7 is a schematic diagram showing a comparison between the default mode 500 and another mode 700 according to an embodiment of the present disclosure. At the default mode 500, the touch drive signal DST is applied by the drive circuitry 250 to drive the touch sensor 230 within the blank periods 511 and 514 according to a first predetermined timing. At the mode 700, the touch drive signal DST is applied by the drive circuitry 250 to drive the touch sensor 230 within the blank periods 512 and 513, in addition to the blank periods 511 and 514, according to a second predetermined timing. In other words, the drive circuitry 250 scans the touch sensor 230 not only in the display blank period 511 or 514 between scan lines, but also in the display blank periods 512 and 513 between pixels or sub-pixels.
  • The drive circuitry 250 may distribute the scanning of the entire touch sensor 230 in one or more display blank periods according to the length of each display blank period and the length of time required for charging the sensing elements of the touch sensor 230. The drive circuitry 250 may apply the touch drive signal DST to only a part of the touch sensor 230 or the entire touch sensor 230 in each display blank period. The longer a display blank period, the more sensing elements or drive lines of the touch sensor 230 that the drive circuitry 250 may scan in the display blank period. When the control circuitry drives the sensing elements at the first mode, the touch drive signal is applied to the sensing elements according to a first charging period within the display period for all sensing elements. When the control circuitry drives the sensing elements at the second mode, the sensing elements is charged to reach a predetermined charged level by adjusting a second charging period or a second charging voltage for charging each sensing elements.
  • The sense circuitry determine whether a charge level, which is determined based on the detected sense signal, of at least one of the sensing elements is lower than a predetermined charge level. When it is determined that the charge level is not lower than the predetermined charge level, the control circuitry drives the touch sensor at the first mode. When it is determined that the charge level is lower than the predetermined charge level, the control circuitry drives the touch sensor at the second mode. The Sensing elements nearer to the drive circuitry 250 often require shorter charging time than the far sensing elements do. The number of near sensing elements that may be charged is often larger than the number of far sensing elements that may be charged in the same display blank period. The drive circuitry 250 may arrange the timing of the touch drive signal DST according to the aforementioned details. For each display blank period, the drive circuitry 250 may use the entire display blank period or only part of the display blank period to apply the touch drive signal DST. When the control circuitry or sense circuitry drives the sensing elements at the first mode, the touch drive signal is applied to the sensing elements according to a first charging period within the display period for all sensing elements. The first charging period is defined as the period for charging the far sensing elements. When the control circuitry or sense circuitry determine to drives the sensing elements at the second mode, the sensing elements is charged to reach a predetermined charged level by adjusting a second charging period or a second charging voltage for charging each sensing elements. The drive circuitry may charge the sensing element with different charging period or charging voltage. Therefore, the near sensing element may only require short period of time to charge compared to the far sensing elements. When it is determined that the charge level of the sensing elements is lower than a predetermined level, the control circuitry drives the touch sensor at the second mode; and wherein when the charge level of the sensing elements is not lower than a predetermined level, the control circuitry drives the touch sensor at the first mode.
  • Each drive line of the touch sensor 230 scanned in a display blank period may receive a single drive signal DST or a series of multiple touch drive signal DST or all of the touch drive signal DST applied by the drive circuitry 250 in the display blank period. In other words, the touch drive signal DST sent out by the drive circuitry 250 in a display blank period may concentrate on a single drive line or may be distributed into multiple drive lines of the touch sensor 230. Sometimes a single drive line needs to be driven by a series of multiple touch drive signal DST so that a burst of noises cannot corrupt all of the resultant sense signals SS.
  • A display blank period may be very short such that only one drive signal DST may be sent out. Sometimes a display blank period may be too short for applying one drive signal DST to fully charge a sensing element of the touch sensor 230. For this case or other considerations, the drive circuitry 250 may distribute the full charging of at least one of the sensing elements of the touch sensor 230 into multiple display blank periods. In other words, the drive circuitry 250 may charge the same sensing element partially in each display blank period so that the sensing element may be fully charged after multiple display blank periods.
  • The drive circuitry 250 may drive a scan line of the display module 240 to display an image and simultaneously send one or more touch drive signal DST to one or more sensing elements of the touch sensor 230 in another scan line of the display module 240. For example, Fig. 8 is a schematic diagram showing a comparison between the default mode 500 and another mode 800 according to an embodiment of the present disclosure. At the mode 800, the drive circuitry 250 merges a part of the display blank periods 511 and 514 between scan lines into the display blank periods 512 and 513 between pixels or sub-pixels to even out the lengths of the display blank periods 511-514, and then the drive circuitry 250 scans the touch sensor 230 by applying the touch drive signal DST in each display blank period 511-514. Moreover, the drive circuitry 250 drives the pixels of a scan line of the display module 240 and simultaneously send touch drive signal DST to drive the touch sensor sensing elements in another scan line of the display module 240 to avoid the noises generated by the pixels of the first scan line.
  • There is another interpretation for Fig. 8. There are three pixel process periods at the mode 800, while there are ten scanning periods at the mode 800. Since more touch drive signal DST are applied to the touch sensor 230 than the display drive signal DSD are applied to the display module 240, the frequency of the touch drive signal DST is different from the frequency of the display drive signal DSD, which helps to reduce the noise level.
  • The drive circuitry 250 may select one or more pixel process periods of pixels or sub-pixels of the display module 240 according to the level of noises generated by the pixels or the sub-pixels displaying an image according to the display drive signal DSD and scan the touch sensor 230 by applying the touch drive signal DST in the selected pixel process periods of the pixels or sub-pixels. The drive signal DSD from the drive circuitry 250 specifies the greyscales to be displayed by the pixels or sub-pixels of the display module 240. The relation of the levels of noises generated by the display module 240 versus the displayed greyscales of the display module 240 may be measured in advance in a laboratory. This relation may be pre-stored in the drive circuitry 250 such that the drive circuitry 250 knows in advance which greyscales produce major noises and which greyscales produce minor tolerable noises. The drive circuitry 250 may select some pixel process periods of pixels or sub-pixels of the display module 240 with lower noises and applies the touch drive signal DST to the touch sensor 230 in the selected pixel process periods.
  • For example, Fig. 9 is a schematic diagram showing a comparison between the default mode 500 and another mode 900 according to an embodiment of the present disclosure. At the mode 900, the drive circuitry 250 merges a part of the display blank periods 511 and 514 between scan lines into the display blank periods 512 and 513 between pixels or sub-pixels to even out the lengths of the display blank periods 511-514, and then the drive circuitry 250 scans the touch sensor 230 in each display blank period 511-514. Moreover, since the greyscale displayed in the pixel process period 521 generates more noises and the greyscales displayed in the pixel process periods 522 and 523 generate less noises, the drive circuitry 250 also scans the touch sensor 230 in the pixel process periods 522 and 523.
  • As shown in Fig. 5 to Fig. 9, each mode of the touch drive signal DST involves specific timing or frequency of the touch drive signal DST. The sense circuitry 220 may determine the timing and/or frequency of the touch drive signal DST and then notifies the drive circuitry 250 of the timing and/or frequency of the touch drive signal DST. The drive circuitry 250 may synchronize the vertical synchronization signal VSYNC or the horizontal synchronization signal HSYNC or one or more display blank periods with the sense circuitry 220 for determining the timing and/or frequency for the drive circuitry 250 to apply the touch drive signal DST for the touch sensor 230. For the synchronization, the drive circuitry 250 may simply provide the vertical synchronization signal VSYNC and the horizontal synchronization signal HSYNC to the sense circuitry 220 so that the sense circuitry 220 may know the timing of the vertical synchronization signal VSYNC, the horizontal synchronization signal HSYNC, and the display blank periods.
  • Fig. 10 is a schematic diagram showing an electronic device 200 according to an embodiment of the present disclosure. The electronic device 200 includes a display module 240, a touch sensor 230 integrated into the display module 240, and an integrated controller 205. The display module 240 and the touch sensor 230 constitute the touch display of the electronic device 200. The integrated controller 205 is coupled to the display module 240 and the touch sensor 230. The integrated controller 205 may include the drive circuitry 250 and the sense circuitry 220 shown in Fig. 2, or include the drive circuitry 250, the sense circuitry 220 and the process unit 210 shown in Fig. 10.
  • Fig. 11A is a flow chart showing a method for driving a touch sensor integrated into a display module of an electronic device according to an embodiment of the present disclosure. This method may be executed by the integrated controller 205. In step 402, the integrated controller 205 drives the display module 240 to display an image, such as the graphical user interface (GUI) of the electronic device 200. The integrated controller 205 drives the display module 240 by providing the display drive signal DSD, the vertical synchronization signal VSYNC and the horizontal synchronization signal HSYNC to the display module 240. Each of the display drive signal DSD controls the greyscale of a pixel or a sub-pixel of the display module 240. The vertical synchronization signal VSYNC indicates the beginning of each image frame. The horizontal synchronization signal HSYNC indicates the beginning of each scan line of an image frame.
  • In step 404, the integrated controller 205 determines a signal frequency of the touch drive signal DST to be sent to the touch sensor 230. The integrated controller 205 determines the signal frequency in order to avoid noises interfering with the sense signals SS. The integrated controller 205 may determine the signal frequency simply by trial and error. In other words, the integrated controller 205 may try various signal frequencies of the touch drive signal DST until an ideal signal frequency that may reduce the level of the noises is found.
  • Alternatively, the integrated controller 205 may detect fundamental frequencies and harmonic frequencies of the noises by analyzing the sense signals SS received in previous scans of the touch sensor 230. How to detect the frequencies of the noises is well-known and is not discussed here. The integrated controller 205 may set the signal frequency of the touch drive signal DST to avoid both the fundamental frequencies and harmonic frequencies of the noises for the best result. In other words, the signal frequency should be as far from the fundamental frequencies and harmonic frequencies of the noises as possible.
  • Alternatively, the integrated controller 205 may determine the signal frequency according to the flow shown in Fig. 11B. In step 432, the integrated controller 205 determines an image frequency by analyzing the greyscales of the image to be displayed by the display module 240. In step 434, the integrated controller 205 determines the signal frequency such that the signal frequency avoids the image frequency. In other words, the signal frequency should be as far from the image frequency as possible.
  • Fig. 11C is a schematic diagram showing pixel process periods of pixels or sub-pixels of the display module 240 according to an embodiment of the present disclosure. Fig. 11C also depicts some examples of the aforementioned image frequency. When the display module 240 is monochrome, each monochrome pixel is the smallest display unit and Fig. 11C shows the pixel process periods 442, 444 and 446 in which the integrated controller 205 sends the display drive signal DSD to the pixels of the display module 240. When the display module 240 is multicolored, each sub-pixel is the smallest display unit and Fig. 11C shows the pixel process periods 442, 444 and 446 in which the integrated controller 205 sends the display drive signal DSD to the sub-pixels of the display module 240. The display drive signal DSD output by the integrated controller 205 specify the greyscales to be displayed by the pixels or sub-pixels of the display module 240. Each multicolored pixel consists of multiple sub-pixels. Each sub-pixel of a pixel displays a different primary color. A pixel process period is a length of time in which the integrated controller 205 sends display drive signal DSD to one or more pixels or sub-pixels of the display module 240 for displaying the image.
  • In the pixel process period 442, the integrated controller 205 sends a drive signal DSD to the display module 240 for each of the nine pixels/sub-pixels 1-9. If the length of the pixel process period 442 is T, then the image frequency in the pixel process period 442 is 9/T.
  • When a pixel/sub-pixel of the display module 240 displays the default greyscale of the display module 240, the integrated controller 205 does not have to send the drive signal DSD to this pixel/sub-pixel. For example, in the pixel process period 444, the pixels/sub-pixels 4-6 and 8 display the default greyscale. Therefore, the integrated controller 205 outputs only five display drive signal DSD for the pixels/sub-pixels 1-3, 7 and 9. The image frequency in the pixel process period 444 is 5/T. In the pixel process period 446, the pixels/sub-pixels 2, 3, 5 and 8 display the default greyscale. Therefore, the integrated controller 205 outputs only five display drive signal DSD for the pixels/sub-pixels 1, 4, 6, 7 and 9. The image frequency in the pixel process period 446 is also 5/T.
  • Next, in step 406, the integrated controller 205 determines the timing of each of the touch drive signal DST according to the vertical synchronization signal VSYNC, the horizontal synchronization signal HSYNC and the signal frequency determined in step 404. In step 408, the integrated controller 205 scans the touch sensor 230 by sending the touch drive signal DST to the touch sensor 230 according to the timing determined in step 406. By determining the signal frequency and the timing, the integrated controller 205 determines the mode for applying the touch drive signal DST for the touch sensor 230.
  • The integrated controller 205 may know the beginning time and the end time of each display blank period and each pixel process period of the display module 240 based on the vertical synchronization signal VSYNC and the horizontal synchronization signal HSYNC. The integrated controller 205 may determine the timing such that the integrated controller 205 sends the touch drive signal DST to the touch sensor 230 only in the display blank periods of the display module 240 or the pixel process periods of pixels or sub-pixels of the display module 240 that generate noises at a relatively lower level. Fig. 5 to Fig. 9 provides some detailed examples and discussions about the timing of the touch drive signal DST.
  • In step 410, the integrated controller 205 receives the sense signals SS generated by the touch sensor 230 in response to the touch drive signal DST. In step 412, the integrated controller 205 analyzes the sense signals SS to detect one or more touch events. The integrated controller 205 may perform a function of the electronic device 200 according to the one or more touch events.
  • The present disclosure is not limited to the example shown in Fig. 11C. In other embodiments of the present disclosure, the integrated controller 205 may determine the mode to apply the touch drive signal DST based on any image property of the image to be displayed by the display module 240. The image property may be a histogram of the greyscales of the image or the signal frequency of the display drive signal DSD in the example of Fig. 11C.
  • Fig. 11D is a flow chart showing a method for driving a touch sensor integrated into a display module of an electronic device according to another embodiment of the present disclosure. This method may be executed by the integrated controller 205. Step 452 is a previous scan of the touch sensor 230 consisting of steps 402-410 in Fig. 11A. Next, in step 454, the integrated controller 205 analyzes the sense signals SS to detect the level of the noises. In step 456, the integrated controller 205 checks whether the level of the noises is higher than a predetermined value or not. When the level of the noises is not higher than the predetermined value, the integrated controller 205 analyzes the sense signals SS to detect the touch event in step 466. When the level of the noises is higher than the predetermined value, the integrated controller 205 changes the signal frequency of the touch drive signal DST to a new frequency in step 458. The integrated controller 205 determines the new frequency in order to avoid the noises.
  • The integrated controller 205 may determine the new frequency of the touch drive signal DST according to the flow shown in Fig. 4E. The integrated controller 205 analyzes the sense signals SS to detect the frequency of the noises in step 472 and then in step 474 determines the new frequency such that the new frequency avoids the noise frequency.
  • Next, in step 460, the integrated controller 205 determines the new timing of each of the touch drive signal DST according to the vertical synchronization signal VSYNC, the horizontal synchronization signal HSYNC and the new frequency determined in step 458. In step 462, the integrated controller 205 scans the touch sensor 230 by sending the touch drive signal DST to the touch sensor 230 according to the new timing. In step 464, the integrated controller 205 receives the sense signals SS generated by the touch sensor 230 in response to the touch drive signal DST, and then the flow returns to step 454.
  • The integrated controller 205 may execute the loop of steps 454-464 as a trial-and-error process. As long as the noise level is too high, the integrated controller 205 may simply choose another frequency for the touch drive signal DST and repeat the loop until the detected level of noises drops to an acceptable level.
  • In an embodiment of the present disclosure, the sense circuitry 220, the drive circuitry 250, and the process unit 210 may exchange data and control signals in order to cooperate in executing the steps in Fig 2A, Fig 2C, Fig 3A, Fig. 3B, Fig. 4A and Fig. 4B. Step 402 may be executed by the drive circuitry 250. Step 404 may be executed by the process unit 210, the sense circuitry 220 or the drive circuitry 250. Step 406 may be executed by the sense circuitry 220 or the drive circuitry 250. Step 408 may be executed by the drive circuitry 250. Steps 410 and 412 may be executed by the sense circuitry 220. Step 432 may be executed by the process unit 210. Step 434 may be executed by the process unit 210, the sense circuitry 220 or the drive circuitry 250.
  • Steps 454 and 456 may be executed by the sense circuitry 220. Each of steps 458 and 460 may be executed by the sense circuitry 220 or the drive circuitry 250. Step 462 may be executed by the drive circuitry 250. Steps 464 and 466 may be executed by the sense circuitry 220. Step 472 may be executed by the sense circuitry 220. Step 474 may be executed by the sense circuitry 220 or the drive circuitry 250.
  • In an embodiment of the present disclosure, the sense circuitry 220 or the drive circuitry 250 may decide when to scan the touch sensor 230. When the time of the scanning is decided by the sense circuitry 220, the sense circuitry 220 may send at least one control signal to inform the drive circuitry 250 to begin sending the touch drive signal DST to the touch sensor 230 and the sense circuitry 220 may wait to receive the sense signals SS. When the time of the scanning is decided by the drive circuitry 250, the drive circuitry 250 may begin sending the touch drive signal DST to the touch sensor 230 and send at least one control signal to inform the sense circuitry 220 to receive the sense signals SS. The process unit 210 is the main system of the electronic device 200. The process unit 210 may perform the function of the electronic device 200 according to one or more touch events detected by the sense circuitry 220.
  • In an embodiment of the present disclosure, the sense circuitry 220 may detect the relation of the levels of noises versus the displayed greyscales of the pixels or sub-pixels of the display module 240. This relation may be stored in the process unit 210, the sense circuitry 220 or the drive circuitry 250 for using the mode 900 in Fig. 9.
  • In summary, the present disclosure may determine the mode for applying the drive signals for the touch sensor in order to avoid bursts of noises and get better results of touch sensor scanning.
  • It will be apparent to those skilled in the art that various modifications and variations may be made to the structure of the present disclosure without departing from the scope or spirit of the disclosure. In view of the foregoing, it is intended that the present disclosure cover modifications and variations of this disclosure provided they fall within the scope of the following claims and their equivalents.

Claims (17)

  1. An electronic device comprising:
    a display module;
    a touch sensor integrated into the display module; and
    a control circuitry coupled to the touch sensor and the display module and configured to drive the touch sensor by a touch drive signal at one of a first mode and a second mode and detect a sense signal from the touch sensor when the touch sensor is driven by the touch drive signal.
  2. The electronic device of claim 1, wherein the control circuitry is further configured to determine the one of the first mode and the second mode for driving the touch sensor based on a determination.
  3. The electronic device of any of claims 1-2, wherein the display module comprises a plurality of pixels or sub-pixels, and the control circuitry is further configured to drive the pixels or sub-pixels by a display drive signal during a display period, which includes a plurality of pixel process periods, during which the pixels or sub-pixels are driven, and a plurality of blank periods, during which no pixel or sub-pixel is driven; and wherein the touch drive signal is applied to drive the touch sensor within the display period.
  4. The electronic device of any of claims 2-3, wherein when the control circuitry determines the first mode for driving the touch sensor, the touch drive signal is applied to the touch sensor according to a first predetermined timing within the display period; and when the control circuitry determines the second mode for driving the touch sensor, the touch drive signal is applied to the touch sensor according to a second predetermined timing within the display period; and wherein the first predetermined timing is different from the second predetermined timing; wherein according to the first predetermined timing, the touch drive signal is applied to drive the touch sensor within at least first one of the blank periods; and according to the second predetermined timing, the touch drive signal is applied to drive the touch sensor within at least second one of the blank periods; wherein the display module further comprises a plurality of scan lines connected to the plurality of pixels or sub-pixels, and the control circuitry is configured to apply the display drive signal to each one of the scan lines based on a horizontal synchronization signal, wherein the horizontal synchronization signal has a plurality of first voltage levels and a plurality of second voltage levels to form a plurality of pulses within the display period; and
    wherein the first one of the blank periods is defined within the first voltage level of the horizontal synchronization signal, and the second one of the blank periods is defined within the second voltage level of the horizontal synchronization signal.
  5. The electronic device of claim 4, wherein the second one of the blank periods is a period between two adjacent pixel process periods of driving two pixels or sub-pixels connected to the same scan line.
  6. The electronic device of any of claims 2-5, wherein when the control circuitry determines the first mode for driving the touch sensor, the touch drive signal is applied to the touch sensor at a first frequency within the display period; and when the control circuitry determines the second mode for driving the touch sensor, the touch drive signal is applied to the touch sensor at a second frequency within the display period; and wherein the first frequency is different from the second frequency.
  7. The electronic device of any of claim 2-6, wherein the determination is to determine whether the sense signal has a noise level greater than a predetermined level; wherein when it is determined that the sense signal has the noise level greater than the predetermined level, the control circuitry drives the touch sensor at the first mode; and wherein when it is determined that the sense signal does not have the noise level greater than the predetermined level, the control circuitry drives the touch sensor at the second mode.
  8. The electronic device of any of claims 1-7, wherein the control circuitry further comprises:
    a sense circuitry coupled to the touch sensor and configured to determine the one of the first mode and the second mode for driving the touch sensor, and configured to detect the sense signal from the touch sensor; and
    a drive circuitry coupled to the sense circuitry, the display module and the touch sensor and configured to apply the display drive signal for driving the display module and apply the touch drive signal for driving the touch sensor at the one determined mode; and wherein when the sense circuitry determines the one of the first mode and the second mode for driving the touch sensor, the sense circuitry instructs the drive circuitry to change to the one determined mode for driving the touch sensor from the other mode.
  9. The electronic device of any of claims 2-8, wherein the touch sensor further comprises a plurality of sensing elements and the control circuitry applies the touch drive signal to charge the sensing elements at one of the first mode and the second mode, wherein when the control circuitry applies the touch drive signal to charge the sensing elements at the first mode, the touch drive signal charges each of the sensing elements for a first charging period of time; and when the control circuitry applies the touch drive signal to charge the sensing elements at the second mode, the touch drive signal charges at least one of the sensing elements for a second charging period of time; and
    wherein the determination is to determine whether a charge level, which is determined based on the detected sense signal, of at least one of the sensing elements is lower than a predetermined charge level; wherein when it is determined that the charge level is not lower than the predetermined charge level, the control circuitry drives the touch sensor at the first mode; and wherein when it is determined that the charge level is lower than the predetermined charge level, the control circuitry drives the touch sensor at the second mode.
  10. The electronic device of any of claims 1-9, wherein the touch sensor further comprises a plurality of sensing elements and the control circuitry applies the touch drive signal to charge the sensing elements at one of the first mode and the second mode, wherein when the control circuitry applies the touch drive signal to charge the sensing elements at the first mode, the touch drive signal charges each of the sensing elements by a first charging voltage; and when the control circuitry applies the touch drive signal to charge the sensing elements at the second mode, the touch drive signal charges at least one of the sensing elements for a second charging period of time by a second charging voltage.
  11. The electronic device of any of claims 1-10, wherein the display module further comprises a plurality of scan lines connected to the plurality of pixels or sub-pixels, and the control circuitry is configured to apply the display drive signal to each one of the scan lines based on a horizontal synchronization signal; and wherein when the control circuitry determines the one mode for driving the touch sensor, at least one of the blank periods is prolonged and the sense circuitry instructs the drive circuitry to apply the touch drive signal within the prolonged blank period for driving the touch sensor.
  12. The electronic device of any of claim 2-8, wherein the control circuitry further comprises:
    a sense circuitry coupled to the touch sensor and configured to detect the sense signal from the touch sensor;
    a process unit coupled to the sense circuitry and configured to determine the one of the first mode and the second mode for driving the touch sensor; and,
    a drive circuitry coupled to the sense circuitry and the process unit, the display module and the touch sensor and configured to apply the display drive signal for driving the display module and apply the touch drive signal for driving the touch sensor at the one determined mode; and
    wherein the determination is for the process unit to determine whether an image to be displayed on the display module results in a noise level greater than a predetermined level for the touch sensor; wherein when the process unit determines that the image to be displayed on the display module results in the noise level greater than the predetermined level, the process unit determines the first mode for the drive circuitry to drive the touch sensor; and wherein when the process unit determines that the image to be displayed on the display module does not result in the noise level greater than the predetermined level, the process unit determines the second mode for the drive circuitry to drive the touch sensor.
  13. A method for driving a touch sensor, which is integrated into a display module in an electronic device, comprising:
    determining one of a first mode and a second mode for driving the touch sensor;
    driving the touch sensor by a touch drive signal at the one determined mode; and
    detecting a sense signal from the touch sensor when the touch sensor is driven by the touch drive signal.
  14. The method of claim 13, wherein the step of driving the touch sensor by the touch drive signal at the one determined mode further comprises:
    applying the touch drive signal to the touch sensor within a display period, wherein the display period includes a plurality of pixel process periods, during which a plurality of pixels or sub-pixels in the display module are driven, and a plurality of blank periods, during which no pixel or sub-pixel is not driven;
    applying the touch drive signal to the touch sensor according to a first predetermined timing within the display period when the first mode is determined for driving the touch sensor; and
    applying the touch drive signal to the touch sensor according to a second predetermined timing within the display period when the second mode is determined for driving the touch sensor;
    wherein the first predetermined timing is different from the second predetermined timing.
  15. The method of any of claims 13-14, wherein the step of applying the touch drive signal to the touch sensor according to the first predetermined timing within the display period further comprises: applying the touch drive signal to the touch sensor within at least first one of the blank periods; and wherein the step of applying the touch drive signal to the touch sensor according to the second predetermined timing within the display period further comprises: applying the touch drive signal to the touch sensor within at least second one of the blank periods;
    driving the display module by a display drive signal based on a horizontal synchronization signal, which has a plurality of first voltage levels and a plurality of second voltage levels to form a plurality of pulses within the display period;
    wherein the first one of the blank periods is defined within the first voltage level of the horizontal synchronization signal, and the second one of the blank periods is defined within the second voltage level of the horizontal synchronization signal.
  16. The method of any of claims 13-15, further comprising:
    applying the touch drive signal to the touch sensor at a first frequency within the display period when the first mode is determined for driving the touch sensor; and
    applying the touch drive signal to the touch sensor at a second frequency within the display period when the second mode is determined for driving the touch sensor;
    wherein the first frequency is different from the second frequency.
  17. The method of any of claims 13-16, wherein the step of determining one of a first mode and a second mode for driving the touch sensor further comprises:
    determining whether the sense signal has a noise level greater than a predetermined level; and
    wherein the step of driving the touch sensor by a touch drive signal at the one determined mode further comprises:
    driving the touch sensor at the first mode when it is determined that the sense signal has the noise level greater than the predetermined level; and
    driving the touch sensor at the second mode when it is determined that the sense signal does not have the noise level greater than the predetermined level.
EP12006472.0A 2011-09-16 2012-09-14 Electronic device and method for driving a touch sensor thereof Active EP2570896B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161535377P 2011-09-16 2011-09-16
US13/615,562 US20130069894A1 (en) 2011-09-16 2012-09-13 Electronic device and method for driving a touch sensor thereof

Publications (2)

Publication Number Publication Date
EP2570896A1 true EP2570896A1 (en) 2013-03-20
EP2570896B1 EP2570896B1 (en) 2017-06-14

Family

ID=47010136

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12006472.0A Active EP2570896B1 (en) 2011-09-16 2012-09-14 Electronic device and method for driving a touch sensor thereof

Country Status (6)

Country Link
US (1) US20130069894A1 (en)
EP (1) EP2570896B1 (en)
JP (1) JP5656944B2 (en)
KR (1) KR101451735B1 (en)
CN (1) CN103049125B (en)
TW (1) TWI553514B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3136208A1 (en) * 2015-08-31 2017-03-01 LG Display Co., Ltd. Display device, method for driving the same, and driving circuit thereof
EP3128401A3 (en) * 2015-08-07 2017-04-19 LG Display Co., Ltd. Touch sensor integrated display device and method for driving the same

Families Citing this family (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9786254B2 (en) * 2010-02-26 2017-10-10 Synaptics Incorporated Sensing during non-display update time to avoid interference
US9298304B2 (en) * 2011-10-12 2016-03-29 Htc Corporation Electronic device and touch-sensing method
US9342181B2 (en) * 2012-01-09 2016-05-17 Nvidia Corporation Touch-screen input/output device touch sensing techniques
KR101378511B1 (en) * 2012-03-28 2014-03-27 주식회사 하이딥 Method, touch sensing apparatus and computer-readable recording medium for minimizing noise on touch panel
CN109407862B (en) 2012-04-10 2022-03-11 傲迪司威生物识别公司 Biometric sensing
TW201346662A (en) * 2012-05-09 2013-11-16 Wintek Corp Touch-sensing device and driving method thereof
US9823935B2 (en) 2012-07-26 2017-11-21 Nvidia Corporation Techniques for latching input events to display flips
CN103296491B (en) * 2012-09-05 2016-03-30 上海天马微电子有限公司 Electric connection structure of conductive pad and touch screen with same
JP6037327B2 (en) * 2012-09-24 2016-12-07 株式会社ジャパンディスプレイ Liquid crystal display
US9626889B2 (en) * 2012-09-24 2017-04-18 Semiconductor Energy Laboratory Co., Ltd. Method and program for driving information processing device
TWI509335B (en) * 2012-10-05 2015-11-21 Innocom Tech Shenzhen Co Ltd Tft touch-control display panel device and driving method thereof
JP5778122B2 (en) * 2012-12-14 2015-09-16 株式会社ジャパンディスプレイ Display device with touch detection function and electronic device including the same
JP2014120116A (en) * 2012-12-19 2014-06-30 Japan Display Inc Driving method of electronic apparatus
US10459546B2 (en) 2013-03-14 2019-10-29 Apple Inc. Channel aggregation for optimal stylus detection
US9811178B2 (en) 2013-03-14 2017-11-07 Apple Inc. Stylus signal detection and demodulation architecture
JP2014199495A (en) * 2013-03-29 2014-10-23 株式会社ジャパンディスプレイ Electronic device, application operation device, and method for controlling electronic device
US9946366B2 (en) 2013-06-03 2018-04-17 Apple Inc. Display, touch, and stylus synchronization
US10141930B2 (en) 2013-06-04 2018-11-27 Nvidia Corporation Three state latch
CN104238836A (en) * 2013-06-14 2014-12-24 群创光电股份有限公司 Touch control display device and driving and sensing method thereof
JP6306295B2 (en) * 2013-07-09 2018-04-04 株式会社ジャパンディスプレイ Display device
TWI507957B (en) * 2013-07-22 2015-11-11 Chunghwa Picture Tubes Ltd Method of driving touch display and touch display capable of increasing signal-to-noise ratio
CN103389848B (en) * 2013-08-08 2016-07-06 华映视讯(吴江)有限公司 Drive the method for touch control display and promote the touch control display of signal to noise ratio
US9823728B2 (en) 2013-09-04 2017-11-21 Nvidia Corporation Method and system for reduced rate touch scanning on an electronic device
US9178572B1 (en) * 2013-09-24 2015-11-03 Amazon Technologies, Inc. Integrated radio frequency or near field communications antenna
US9881592B2 (en) 2013-10-08 2018-01-30 Nvidia Corporation Hardware overlay assignment
JP6074625B2 (en) * 2013-10-29 2017-02-08 パナソニックIpマネジメント株式会社 Input device and display device
JP6074626B2 (en) * 2013-10-30 2017-02-08 パナソニックIpマネジメント株式会社 Input device and display device
US9507470B2 (en) 2013-12-16 2016-11-29 Nvidia Corporation Method and system for reduced power touch input detection on an electronic device using reduced scanning
US9256332B2 (en) * 2014-03-19 2016-02-09 Pixart Imaging Inc. Concurrent driving capacitive touch sensing device capable of resending drive signals
KR102338362B1 (en) * 2014-09-16 2021-12-14 삼성디스플레이 주식회사 Display device with touch panel and method for converting driving frequency of touch panel
TWM492475U (en) * 2014-09-19 2014-12-21 Superc Touch Corp Embedded display touch-control structure
KR20160056759A (en) * 2014-11-12 2016-05-20 크루셜텍 (주) Flexible display apparatus able to image scan and driving method thereof
CN104461133A (en) * 2014-11-27 2015-03-25 深圳市汇顶科技股份有限公司 In-cell touch panel, touch detection method and liquid crystal display device
KR102276911B1 (en) * 2015-01-14 2021-07-13 삼성전자주식회사 Touch controller, touch sensing device and touch sensing method
JP6549921B2 (en) 2015-07-06 2019-07-24 株式会社ジャパンディスプレイ Display unit with touch detection function
KR102360411B1 (en) * 2015-10-20 2022-02-10 엘지디스플레이 주식회사 Display Device Having Touch Sensor and Driving Method thereof
JP6603544B2 (en) * 2015-10-28 2019-11-06 株式会社ジャパンディスプレイ Touch detection device, display device with touch detection function
JP6562862B2 (en) 2016-03-29 2019-08-21 株式会社ジャパンディスプレイ Touch detection device and display device with touch detection function
JP6736385B2 (en) 2016-07-01 2020-08-05 株式会社ジャパンディスプレイ Display device
KR20180006519A (en) * 2016-07-07 2018-01-18 삼성디스플레이 주식회사 Touch sensor and display device including the same
US10025440B2 (en) * 2016-07-13 2018-07-17 Stmicroelectronics Asia Pacific Pte Ltd Correlated data acquisition among different touch sensors
WO2018073690A1 (en) 2016-10-21 2018-04-26 Semiconductor Energy Laboratory Co., Ltd. Touch sensor, display device, display module, and electronic device
JP2018077600A (en) * 2016-11-08 2018-05-17 株式会社ジャパンディスプレイ Display device
KR20180068383A (en) * 2016-12-13 2018-06-22 엘지디스플레이 주식회사 Electronic device having a touch sensor and driving method thereof
KR102284593B1 (en) * 2017-03-24 2021-08-04 삼성전자주식회사 Touch display dirving integrated circuit and operation method thereof
TWI728275B (en) * 2017-11-03 2021-05-21 瑞鼎科技股份有限公司 Organic light-emitting diode touch display operating method
US10936121B2 (en) * 2018-05-02 2021-03-02 Shenzhen China Star Optoelectronics Technology Co., Ltd. Method and device for controlling in-plane interference of liquid crystal touch screen, and display system
KR102159067B1 (en) * 2018-09-06 2020-09-23 주식회사 하이딥 Touch sensor panel driving method and touch input apparatus
TWI678654B (en) * 2018-11-14 2019-12-01 友達光電股份有限公司 Touch display device and touch driving method
US10775921B2 (en) * 2019-01-02 2020-09-15 Novatek Microelectronics Corp. Method of controlling timing for touch and display driver system and touch and display driver system using the same
TWI697822B (en) * 2019-03-29 2020-07-01 友達光電股份有限公司 Touch display and method for controlling the same
KR20200119143A (en) * 2019-04-09 2020-10-19 삼성전자주식회사 Electronic device including touch sensor and method for driving touch sensor included in electronic device
KR20200141861A (en) * 2019-06-11 2020-12-21 주식회사 하이딥 Touch apparatus and driving method thereof
KR20220017330A (en) * 2020-08-04 2022-02-11 삼성전자주식회사 Electronic device and method for controlling touch function
KR20220040577A (en) * 2020-09-23 2022-03-31 삼성디스플레이 주식회사 Display device
KR20220141365A (en) * 2021-04-12 2022-10-20 삼성디스플레이 주식회사 Display device
KR20230004176A (en) * 2021-06-30 2023-01-06 엘지디스플레이 주식회사 Touch display device and touch driving circuit
KR20230026593A (en) * 2021-08-17 2023-02-27 삼성디스플레이 주식회사 Display device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090009483A1 (en) * 2007-06-13 2009-01-08 Apple Inc. Single-chip touch controller with integrated drive system
US20100214259A1 (en) * 2007-07-31 2010-08-26 Harald Philipp Sensor and method of sensing
US20100253638A1 (en) * 2009-04-06 2010-10-07 Marduke Yousefpor Integrated Touch Sensitive Display Gate Driver
US20100295824A1 (en) * 2009-05-21 2010-11-25 Sony Corporation Display device and electronic unit
US20110007019A1 (en) * 2009-07-07 2011-01-13 Nuvoton Technology Corporation Systems and methods for using tft-based lcd panels as capacitive touch sensors

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06175771A (en) * 1992-10-05 1994-06-24 Mitsubishi Electric Corp Position detector and position detecting and displaying device
JPH09128146A (en) * 1995-10-31 1997-05-16 Casio Comput Co Ltd Touch panel controller
JP3595137B2 (en) * 1997-11-14 2004-12-02 シャープ株式会社 LCD tablet device
JP4097866B2 (en) * 1999-12-10 2008-06-11 シャープ株式会社 Display device
JP2006079405A (en) * 2004-09-10 2006-03-23 Oki Electric Ind Co Ltd Information processor and controlling method thereof
JP5570679B2 (en) * 2006-12-27 2014-08-13 エルジー ディスプレイ カンパニー リミテッド Touch panel device
US20090115735A1 (en) * 2007-11-06 2009-05-07 Himax Technologies Limited Sensor with pressure-induced varied capacitance
JP4846834B2 (en) * 2009-08-21 2011-12-28 Smk株式会社 Capacitive touch panel
US9036650B2 (en) * 2009-09-11 2015-05-19 Apple Inc. Automatic low noise frequency selection
CN102132232B (en) * 2009-09-27 2014-05-07 新励科技(深圳)有限公司 Touch control screen
JP5424326B2 (en) * 2009-11-05 2014-02-26 Necカシオモバイルコミュニケーションズ株式会社 Touch detection device, electronic device, and program
JP5489114B2 (en) * 2009-11-12 2014-05-14 株式会社ジャパンディスプレイ Display device with imaging function, driving method, and electronic apparatus
US9786254B2 (en) * 2010-02-26 2017-10-10 Synaptics Incorporated Sensing during non-display update time to avoid interference
KR20120014808A (en) * 2010-08-10 2012-02-20 엘지디스플레이 주식회사 Liquid crystal display device having touch sensor embedded therein, method for driving the same and method for fabricating the same
JP5766928B2 (en) * 2010-09-29 2015-08-19 株式会社ジャパンディスプレイ Display device with touch detection function and electronic device
JP2014512606A (en) * 2011-03-29 2014-05-22 シナプティクス インコーポレイテッド Capacitive touch screen interference detection and operation

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090009483A1 (en) * 2007-06-13 2009-01-08 Apple Inc. Single-chip touch controller with integrated drive system
US20100214259A1 (en) * 2007-07-31 2010-08-26 Harald Philipp Sensor and method of sensing
US20100253638A1 (en) * 2009-04-06 2010-10-07 Marduke Yousefpor Integrated Touch Sensitive Display Gate Driver
US20100295824A1 (en) * 2009-05-21 2010-11-25 Sony Corporation Display device and electronic unit
US20110007019A1 (en) * 2009-07-07 2011-01-13 Nuvoton Technology Corporation Systems and methods for using tft-based lcd panels as capacitive touch sensors

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3128401A3 (en) * 2015-08-07 2017-04-19 LG Display Co., Ltd. Touch sensor integrated display device and method for driving the same
US10185431B2 (en) 2015-08-07 2019-01-22 Lg Display Co., Ltd. Touch sensor integrated display device and method for driving the same
EP3136208A1 (en) * 2015-08-31 2017-03-01 LG Display Co., Ltd. Display device, method for driving the same, and driving circuit thereof
US9946403B2 (en) 2015-08-31 2018-04-17 Lg Display Co., Ltd. Display device, method for driving the same, and driving circuit thereof

Also Published As

Publication number Publication date
JP2013065301A (en) 2013-04-11
EP2570896B1 (en) 2017-06-14
JP5656944B2 (en) 2015-01-21
KR101451735B1 (en) 2014-10-16
KR20130030233A (en) 2013-03-26
US20130069894A1 (en) 2013-03-21
TW201314530A (en) 2013-04-01
TWI553514B (en) 2016-10-11
CN103049125A (en) 2013-04-17
CN103049125B (en) 2016-12-21

Similar Documents

Publication Publication Date Title
EP2570896A1 (en) Electronic device and method for driving a touch sensor thereof
KR101761580B1 (en) Display device having touch sensor
US9262024B2 (en) Liquid crystal display panel including touch sensor and liquid crystal display using the same
US9542030B2 (en) Display device with integrated touch screen having varied touch driving time and method of driving the same
US9870075B2 (en) Touch screen device
KR101424331B1 (en) Touch sensing apparatus and driving method thereof
KR101637174B1 (en) Display device with integrated touch screen
KR20120114534A (en) Display having touch sensor and driving method thereof
KR101461036B1 (en) Apparatus and method for driving touch sensor
CN105739751A (en) Touch screen device
US9600130B2 (en) Liquid crystal display device and method of driving the same
KR20140076054A (en) Display device having touch sensors and control method of gate driving circuit thereof
US11467679B2 (en) Touch screen device
KR102440812B1 (en) Touch sensing apparatus and driving method thereof
KR101845002B1 (en) Display device and method for driving the same
KR20160094541A (en) Display device and method of driving the same
KR101902564B1 (en) Touch sensor integrated type display and method for improving touch performance thereof
KR101920767B1 (en) Display device having touch sensor and method for driving the same
KR102506658B1 (en) Touch screen device and its driving method
KR20150015097A (en) Display device and method of driving the same
KR101970549B1 (en) Apparatus for driving touch sensor
EP4443277A1 (en) Touch sensing device and touch sensing method
KR101891711B1 (en) Display device and method for driving the same
KR102122449B1 (en) Display device and method of driving the same
KR101920758B1 (en) Apparatus and method for driving touch sensor

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20120914

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20131205

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: HTC CORPORATION

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/044 20060101ALN20160104BHEP

Ipc: G06F 3/041 20060101AFI20160104BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/041 20060101AFI20170111BHEP

Ipc: G06F 3/044 20060101ALN20170111BHEP

INTG Intention to grant announced

Effective date: 20170123

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 901564

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012033341

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170914

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170915

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 901564

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170914

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171014

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602012033341

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20180315

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20170930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170914

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170930

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170914

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170930

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170930

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170914

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20120914

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170614

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230602

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20240712

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240702

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240701

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240702

Year of fee payment: 13