CN110287931B - Touch coordinate determination method and device, terminal and storage medium - Google Patents

Touch coordinate determination method and device, terminal and storage medium Download PDF

Info

Publication number
CN110287931B
CN110287931B CN201910587064.9A CN201910587064A CN110287931B CN 110287931 B CN110287931 B CN 110287931B CN 201910587064 A CN201910587064 A CN 201910587064A CN 110287931 B CN110287931 B CN 110287931B
Authority
CN
China
Prior art keywords
touch
area
data
screen
fingerprint sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910587064.9A
Other languages
Chinese (zh)
Other versions
CN110287931A (en
Inventor
林进全
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910587064.9A priority Critical patent/CN110287931B/en
Publication of CN110287931A publication Critical patent/CN110287931A/en
Application granted granted Critical
Publication of CN110287931B publication Critical patent/CN110287931B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • G06V40/1306Sensors therefor non-optical, e.g. ultrasonic or capacitive sensing

Abstract

The embodiment of the application discloses a touch coordinate determination method, a touch coordinate determination device, a terminal and a storage medium, and belongs to the technical field of touch screens. The method is used for a terminal configured with a capacitive touch screen and an under-screen fingerprint sensor, and comprises the following steps: when water drops exist on the capacitive touch screen, the capacitive touch screen enters a waterproof state; in a waterproof state, when a touch signal is received, fingerprint data are collected through a fingerprint sensor under a screen; determining an area where the fingerprint data is collected as a target touch area; and determining touch coordinates according to the target touch area and candidate touch data acquired by the capacitive touch screen. By adopting the method provided by the embodiment of the application, under the condition that the finger is positioned in the water drop area, the finger position can be accurately positioned by means of the fingerprint sensor under the screen, the influence of the water drop on positioning of the hand touch position is avoided, the accuracy of the determined touch coordinate is improved, and the accuracy of touch operation is improved.

Description

Touch coordinate determination method and device, terminal and storage medium
Technical Field
The embodiment of the application relates to the technical field of touch screens, in particular to a touch coordinate determination method, a touch coordinate determination device, a terminal and a storage medium.
Background
The touch screen is a display screen with a touch function, and can be divided into a resistive touch screen and a capacitive touch screen according to a touch principle, and the capacitive touch screen is a type of touch screen which is most widely applied at present.
A capacitive touch screen is a touch screen that operates based on human body induced current. In addition, in order to realize multi-point touch, the capacitive touch screen is divided into a plurality of areas, and a group of capacitors is arranged in each area, so that the touch condition in each area is detected, and multi-point touch is realized.
Disclosure of Invention
The embodiment of the application provides a touch coordinate determination method, a touch coordinate determination device, a terminal and a storage medium. The technical scheme is as follows:
in one aspect, an embodiment of the present application provides a touch coordinate determination method, where the method is used for a terminal configured with a capacitive touch screen and an underscreen fingerprint sensor, and the method includes:
when water drops exist on the capacitive touch screen, the capacitive touch screen enters a waterproof state;
in the waterproof state, when a touch signal is received, fingerprint data are collected through the fingerprint sensor under the screen;
determining an area where the fingerprint data is collected as a target touch area;
and determining touch coordinates according to the target touch area and candidate touch data acquired by the capacitive touch screen.
In another aspect, an embodiment of the present application provides a touch coordinate determination apparatus, where the apparatus is used for a terminal configured with a capacitive touch screen and an off-screen fingerprint sensor, and the apparatus includes:
the state entering module is used for entering a waterproof state when water drops exist on the capacitive touch screen;
the acquisition module is used for acquiring fingerprint data through the fingerprint sensor under the screen when a touch signal is received in the waterproof state;
the first area determining module is used for determining an area where the fingerprint data are collected as a target touch area;
and the first coordinate determination module is used for determining touch coordinates according to the target touch area and candidate touch data acquired by the capacitive touch screen.
In another aspect, an embodiment of the present application provides a terminal, where the terminal includes a processor and a memory; the memory stores at least one instruction for execution by the processor to implement the touch coordinate determination method of the above aspect.
In another aspect, a computer-readable storage medium is provided that stores at least one instruction for execution by a processor to implement a touch coordinate determination method as described in the above aspect.
In another aspect, a computer program product is provided, which stores at least one instruction that is loaded and executed by a processor to implement the touch coordinate determination method of the above aspect.
By adopting the touch coordinate determination method provided by the embodiment of the application, when water drops exist on the capacitive touch screen, the terminal enters a waterproof state, and when a touch signal is received, fingerprint data is acquired through the fingerprint sensor under the screen, so that the area where the fingerprint data is acquired is determined as a target touch area, and then touch coordinates are determined according to the target touch area and candidate touch data acquired by the capacitive touch screen; under the condition that the finger is located the water droplet region, the finger position can be accurately positioned by means of the fingerprint sensor under the screen, the influence of the water droplet on the positioning of the hand touch position is avoided (because water is a conductor, when the finger contacts the water droplet, the terminal recognizes the enlarged touch region), the accuracy of the determined touch coordinate is improved, and the accuracy of touch operation is improved.
Drawings
Fig. 1 and 2 are block diagrams illustrating a structure of a terminal according to an exemplary embodiment of the present application;
FIG. 3 is a schematic diagram of a capacitive touch screen showing a drift in a touch point;
FIG. 4 illustrates a flow chart of a touch coordinate determination method shown in an exemplary embodiment of the present application;
FIG. 5 is a flow chart of a capacitive touch screen and fingerprint recognition sensor data interaction process;
FIG. 6 illustrates a flow chart of a touch coordinate determination method shown in another exemplary embodiment of the present application;
FIG. 7 is a schematic illustration of the change in capacitance of a water droplet area before and after touch;
FIG. 8 illustrates a flow chart of a touch coordinate determination method shown in another exemplary embodiment of the present application;
fig. 9 is a block diagram illustrating a structure of a touch coordinate determination apparatus according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Reference herein to "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
Referring to fig. 1 and 2, a block diagram of a terminal 100 according to an exemplary embodiment of the present application is shown. The terminal 100 may be a mobile phone, a tablet computer, a notebook computer, an e-book, etc. The terminal 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and a display 130.
Processor 110 may include one or more processing cores. The processor 110 connects various parts within the overall terminal 100 using various interfaces and lines, and performs various functions of the terminal 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a Neural-Network Processing Unit (NPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content to be displayed by the touch display screen 130; the NPU is used for realizing an Artificial Intelligence (AI) function; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a single chip.
The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 120 includes a non-transitory computer-readable medium. The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like; the storage data area may store data (such as audio data, a phonebook) created according to the use of the terminal 100, and the like.
Taking an operating system as an Android (Android) system as an example, programs and data stored in the memory 120 are shown in fig. 1, and a Linux kernel layer 220, a system runtime layer 240, an application framework layer 260, and an application layer 280 are stored in the memory 120. The Linux kernel layer 220 provides underlying drivers for various hardware of the terminal 100, such as a display driver, an audio driver, a camera driver, a bluetooth driver, a Wi-Fi driver, power management, and the like. The system runtime library layer 240 provides the main feature support for the Android system through some C/C + + libraries. For example, the SQLite library provides support for a database, the OpenGL/ES library provides support for 3D drawing, the Webkit library provides support for a browser kernel, and the like. Also provided in the system Runtime layer 240 is an Android Runtime library 242(Android Runtime), which mainly provides some core libraries and can allow developers to write Android applications using the Java language. The application framework layer 260 provides various APIs that may be used in building applications, and developers may build their own applications by using these APIs, such as activity management, window management, view management, notification management, content provider, package management, session management, resource management, and location management. At least one application program runs in the application layer 280, and the application programs may be a contact program, a short message program, a clock program, a camera application, etc. of the operating system; or an application program developed by a third-party developer, such as an instant messaging program, a photo beautification program, and the like.
Taking an operating system as an IOS system as an example, programs and data stored in the memory 120 are shown in fig. 2, and the IOS system includes: a Core operating system Layer 320(Core OS Layer), a Core Services Layer 340(Core Services Layer), a Media Layer 360(Media Layer), and a touchable Layer 380(Cocoa Touch Layer). The kernel operating system layer 320 includes an operating system kernel, drivers, and underlying program frameworks that provide functionality closer to hardware for use by program frameworks located in the kernel services layer 340. The core services layer 340 provides system services and/or program frameworks, such as a Foundation framework, an account framework, an advertisement framework, a data storage framework, a network connection framework, a geographic location framework, a motion framework, and so forth, that are needed by the application. The media layer 360 provides audiovisual interfaces for applications, such as graphics-related interfaces, audio-related interfaces, video-related interfaces, and audio/video transmission technology wireless broadcast (AirPlay) interfaces. The touchable layer 380 provides various common interface-related frameworks for application development, and the touchable layer 380 is responsible for user touch interaction operations on the terminal 100. Such as a local notification service, a remote push service, an advertising framework, a game tool framework, a messaging User Interface (UI) framework, a User Interface UIKit framework, a map framework, and so forth.
In the framework shown in FIG. 2, the framework associated with most applications includes, but is not limited to: a base framework in the core services layer 340 and a UIKit framework in the touchable layer 380. The base framework provides many basic object classes and data types, provides the most basic system services for all applications, and is UI independent. While the class provided by the UIKit framework is a basic library of UI classes for creating touch-based user interfaces, iOS applications can provide UIs based on the UIKit framework, so it provides an infrastructure for applications for building user interfaces, drawing, processing and user interaction events, responding to gestures, and the like.
The display screen 130 is used to display the display components of the user interface. In the embodiment of the present application, the display screen 130 is a capacitive touch screen, that is, the display screen 130 has both display and touch functions. Through the touch function, the user can perform a touch operation on the display screen 130 using any suitable object such as a finger, a touch pen, and the like. The display 130 is generally disposed on a front panel of the terminal 130. The display screen 130 may be designed as a full-face screen, a curved screen, a contoured screen, a double-face screen, or a folding screen. The display 130 may also be designed as a combination of a full-screen and a curved-screen, and a combination of a non-flat screen and a curved-screen, which is not limited in this embodiment.
In the embodiment of the present application, the terminal 100 further has a (full screen) fingerprint identification function under the screen, and the fingerprint identification function under the screen is realized by a fingerprint sensor under the screen. With the help of the off-screen fingerprint identification function, a user can perform fingerprint entry by touching any display area of the display screen 130.
Optionally, the underscreen fingerprint sensor is disposed below the display screen 130 or integrated within the display screen 130. The under-screen fingerprint sensor may be at least one of an optical fingerprint sensor or an ultrasonic fingerprint sensor, and the optical fingerprint sensor is taken as an example for description in the present application.
In addition, those skilled in the art will appreciate that the configuration of terminal 100 as illustrated in the above-described figures is not intended to be limiting of terminal 100, and that terminals may include more or less components than those illustrated, or some components may be combined, or a different arrangement of components. For example, the terminal 100 further includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a Wireless Fidelity (WiFi) module, a power supply, a bluetooth module, and other components, which are not described herein again.
The capacitive touch screen realizes touch coordinate positioning based on capacitance change. Due to the positioning principle, the waterproof effect of the capacitive touch screen is poor, and ghost points or touch insensitivity are easy to occur when water drops exist on the capacitive touch screen. For example, as shown in fig. 3, when a user touches the capacitive touch screen 31 with a water droplet 32, and touches the water droplet 31, the capacitance of the contact area between the finger and the capacitive touch screen 31 changes, and the capacitance of the contact area covered by the water droplet 31 also changes. In this case, the capacitive touch screen 31 determines the point a as the finger touch point according to the capacitance change, but in actual circumstances, the user finger does not contact the point a, and the actual finger touch point should be the point a', so that the problem of touch coordinate deviation occurs.
In order to solve the problem of poor waterproof effect of the capacitive touch screen, in the embodiment of the application, when a terminal provided with the capacitive touch screen and a fingerprint sensor under the screen detects that water drops exist on the capacitive touch screen, the terminal enters a waterproof state, and when a touch signal is received under the waterproof state, a target touch area touched by a finger is determined by means of a fingerprint acquisition function of the fingerprint sensor under the screen, so that a touch coordinate is determined according to the target touch area and touch data acquired by the capacitive touch screen. Because finger actual position can be discerned to fingerprint sensor under the screen, and do not receive the water droplet influence, consequently can effectively avoid the problem of touch coordinate skew, improved the accuracy of the touch coordinate who determines. The following description will be made by using exemplary embodiments.
Referring to fig. 4, a flowchart of a touch coordinate determination method according to an exemplary embodiment of the present application is shown. The present embodiment is illustrated by applying the method to the terminal 100 shown in fig. 1 or 2. The method comprises the following steps:
step 401, when water drops exist on the capacitive touch screen, entering a waterproof state.
In one possible implementation mode, in the screen-bright state, the terminal periodically detects whether water drops exist on the capacitive touch screen, and enters the waterproof state when the water drops are detected to exist.
Optionally, the terminal determines whether water drops exist according to a capacitance change condition of the capacitive touch screen in a manner of detecting whether water drops exist.
Optionally, when a microcontroller (Micro Controller Unit, MCU) is disposed in the capacitive touch screen, the capacitive touch screen may also autonomously detect water drops and enter a waterproof state.
Step 402, in a waterproof state, when a touch signal is received, fingerprint data is collected through a fingerprint sensor under a screen.
Because the work of the fingerprint sensor under the screen consumes a long time and consumes a large amount of power, in order to reduce the power consumption of the terminal, in a possible implementation manner, after entering a waterproof state, the terminal continuously receives a contact signal through the capacitive touch screen, and when receiving the touch signal, triggers the fingerprint sensor under the screen to acquire fingerprint data (when not receiving the touch signal, the fingerprint sensor under the screen cannot be triggered).
Certainly, after entering the waterproof state, the terminal may also immediately trigger the fingerprint sensor under the screen to perform fingerprint data acquisition without waiting for a touch signal, which is not limited in this embodiment.
Optionally, the fingerprint sensor under the screen performs fingerprint data acquisition on the whole area of the capacitive touch screen, or performs fingerprint data acquisition on a designated area of the capacitive touch screen.
Different from the related art, after the fingerprint data is acquired by the fingerprint sensor under the screen, the fingerprint data needs to be matched with the fingerprint template data which is input in advance.
It should be noted that, when the terminal is not in a waterproof state and there is no fingerprint acquisition requirement (i.e., it is not in a fingerprint acquisition scene), the terminal does not need to start a fingerprint sensor under the screen, but directly determines the touch coordinates according to the touch data acquired by the capacitive touch screen.
And step 403, determining the area where the fingerprint data is acquired as a target touch area.
Taking the underscreen fingerprint sensor as an example of the optical fingerprint sensor, the difference between the fingerprint data in the fingerprint area of the finger and the reference data (the data collected by the underscreen fingerprint sensor in the state without finger touch) is larger, and the fingerprint data cannot be collected in the non-fingerprint area and the water drop area. Therefore, the terminal determines the area where the fingerprint data is collected as a target touch area, and the target touch area is an actual contact area of the finger and the capacitive touch screen.
Optionally, the capacitive touch screen is divided into a plurality of touch areas in advance, and the target touch area is a set of the plurality of touch areas.
In one possible embodiment, the target touch area is determined by an off-screen fingerprint sensor, and the area coordinates of the target touch area are sent to the capacitive touch screen by the off-screen fingerprint sensor, so that the capacitive touch screen further determines the touch coordinates.
And step 404, determining touch coordinates according to the target touch area and candidate touch data acquired by the capacitive touch screen.
In a possible implementation manner, the capacitive touch screen determines touch coordinates of the finger touch area according to the target touch area and the collected candidate touch data (collected when the touch signal is received), and further reports the touch coordinates to the processor, and the processor responds to the touch operation.
Schematically, the interaction of the capacitive touch screen 51 with the underscreen fingerprint sensor 52 in the touch coordinate determination process is shown in fig. 5. The capacitive touch screen 51 (the MCU therein) detects whether there is a water droplet according to the capacitance change, and enters a waterproof state when it detects that there is a water droplet; in a waterproof state, the capacitive touch screen 51 continues to detect whether a touch operation exists according to a capacitance change condition, and when receiving a touch signal, notifies the fingerprint sensor 52 under the screen to acquire fingerprint data (for example, sends an instruction through a bus between the two); after receiving the notification, the fingerprint sensor 52 under the screen collects fingerprint data, determines a target touch area according to the collected fingerprint data, feeds the target touch area back to the capacitive touch screen 51, and determines a touch coordinate according to the target touch area and the collected touch data by the capacitive touch screen 51.
In summary, in the embodiment of the application, when water drops exist on the capacitive touch screen, the terminal enters a waterproof state, and when a touch signal is received, fingerprint data is collected through a fingerprint sensor under the screen, so that an area where the fingerprint data is collected is determined as a target touch area, and touch coordinates are determined according to the target touch area and candidate touch data collected by the capacitive touch screen; under the condition that the finger is located the water droplet region, the finger position can be accurately positioned by means of the fingerprint sensor under the screen, the influence of the water droplet on the positioning of the hand touch position is avoided (because water is a conductor, when the finger contacts the water droplet, the terminal recognizes the enlarged touch region), the accuracy of the determined touch coordinate is improved, and the accuracy of touch operation is improved.
Optionally, in the above embodiment, after the terminal enters the waterproof state, a waterproof state timer may be further set, and if the waterproof state timer expires, the terminal exits from the waterproof state; if the waterproof state timer is not up, the waterproof state is kept, and the waterproof state cannot be immediately exited even if the change of the capacitor is detected. For example, the waterproof state timer has a timer duration of 5 s.
Referring to fig. 6, a flowchart of a touch coordinate determination method according to another exemplary embodiment of the present application is shown. The present embodiment is illustrated by applying the method to the terminal 100 shown in fig. 1 or 2. The method comprises the following steps:
step 601, acquiring sampling data in each touch area on the capacitive touch screen, wherein the sampling data are obtained by sampling according to a sampling period.
To determine whether water droplets are present on the capacitive touch screen, in one possible embodiment, the capacitive touch screen samples at a sampling period (e.g., 8 ms/time) to obtain sample data in each touch area. The capacitive touch screen is divided into a plurality of touch areas in advance, and the sampling data can be capacitance values of capacitors at the touch areas.
Schematically, as shown in fig. 7, the capacitive touch screen is divided into (9 × 16) touch areas, each touch area is provided with a capacitor, and when sampling is performed, the capacitive touch screen can obtain a capacitance value at each touch area.
Step 602, determining a first touch area and a second touch area in the touch area according to the sampled data, where the first touch area is a touch area whose data difference is smaller than a first threshold, the second touch area is a touch area whose data difference is larger than a second threshold, the data difference is a difference between the sampled data and the reference data, the first threshold is a negative value, and the second threshold is a positive value.
In order to further determine the capacitance change condition of each touch area, the capacitive touch screen needs to calculate a difference value (diffdata) according to the original value and a reference value (refdata), so as to determine the capacitance change condition of each touch area according to the difference value.
Optionally, the terminal stores reference data of each touch area on the capacitive touch screen, the reference data may be a reference capacitance of each touch area, and the reference data is preset when the capacitive touch screen leaves a factory. When no water drop exists on the touch area, the difference between the sampling data and the reference data at the touch area is small; when a water drop exists on the touch area or the touch area is in contact with a finger, the difference between the sampling data and the reference data at the touch area is large, and the capacitance change conditions of the touch area with the water drop and the touch area with the finger are different. For example, when a water droplet exists on the touch area, the sampled data is smaller than the reference data, and when the touch area is in contact with a finger, the sampled data is larger than the reference data.
Therefore, in one possible implementation, the capacitive touch screen calculates a data difference value of each touch area according to the sampling data and the reference data, so as to determine a first touch area and a second touch area in the touch areas according to the data difference value.
The first touch area is a touch area with a data difference value smaller than a first threshold (negative value), that is, the first touch area is a suspected water drop area, and the second touch area is a touch area with a data difference value larger than a second threshold (positive value), that is, the second touch area is a suspected finger area.
Schematically, as shown in fig. 7, according to the calculated data difference value corresponding to each touch area, the capacitive touch screen determines the touch areas located in the 6 th row, the 4 th column to the 5 th column, the 7 th row, the 3 rd column to the 5 th column, the 8 th row, the 3 rd column to the 5 th column, and the 9 th row, the 4 th column as the first touch area (the data difference value is less than-35), and determines the touch area located in the 9 th row, the 5 th column as the second touch area.
Step 603, if the number of the first touch areas is greater than that of the second touch areas and the number of the first touch areas is greater than a number threshold, determining that water drops exist on the capacitive touch screen, and entering a waterproof state.
When water droplets exist on the screen, the number of the first touch areas is generally large, so that the existence of the water droplets can be determined according to the number of the first touch areas; meanwhile, in order to further improve the accuracy of water droplet detection, the user is prevented from being mistakenly identified as the presence of water droplets on the screen by the hand-wetting operation (when the user is operated by hand-wetting, the number of the second touch areas is greater than that of the first touch areas), and the number of the first touch areas and the number of the second touch areas can be further compared.
In one possible implementation, the capacitive touch screen detects whether the number of the first touch areas is greater than the number of the second touch areas, and whether the number of the first touch areas is greater than a number threshold. And if the number of the first touch areas is larger than that of the second touch areas and the number of the first touch areas is larger than the number threshold, determining that water drops exist on the capacitive touch screen, and entering a waterproof state.
Schematically, as shown in fig. 7, since the number 8 of the first touch areas is greater than the number 1 of the second touch areas, and the number of the first touch areas is greater than the number threshold 5, the capacitive touch screen enters a waterproof state.
In other possible embodiments, the capacitive touch screen may further detect the density of the first touch area, and determine that water drops exist on the capacitive touch screen when the density is greater than a density threshold. This embodiment is not limited to this.
And step 604, in a waterproof state, when a touch signal is received, determining a candidate touch area according to candidate touch data acquired by the capacitive touch screen.
In a possible implementation manner, in a waterproof state, the capacitive touch screen continuously performs data sampling, and determines that a touch signal is received when a sampling result indicates that the number of the second touch areas is greater than a threshold value.
In addition, because only the underscreen fingerprint sensor at the real touch area of the finger can acquire the fingerprint data, in order to avoid full-screen fingerprint scanning and reduce power consumption, the capacitive touch screen firstly determines a candidate touch area according to the acquired candidate touch data so as to subsequently indicate the underscreen fingerprint sensor at the candidate touch area to acquire the fingerprint data.
Schematically, as shown in fig. 7, when a finger touches the capacitive touch screen, the capacitive touch screen determines, as candidate touch areas, touch areas in rows 6, 4 th to 5 th columns, rows 7, columns 3 to 5, rows 8, columns 3 to 5 and rows 9, columns 3 to 5 according to the collected sampling data and the reference data.
Step 605, collecting fingerprint data in the candidate touch area through the under-screen fingerprint sensor.
Optionally, the capacitive touch screen sends the area information of the candidate touch area to the fingerprint sensor under the screen, and the fingerprint sensor under the screen collects fingerprint data in the candidate touch area.
If a finger contacts a water drop, the conductivity of the water drop causes inaccurate judgment of a finger touch area (the area is too large), so that the finger touch area needs to be positioned by means of a fingerprint sensor under a screen; when the finger does not touch the water drop, the water drop on the screen does not influence the determination of the touch coordinate. Therefore, in order to further reduce the power consumption of the terminal, after the candidate touch area is determined, the capacitive touch screen detects whether the intersection exists between the candidate touch area and the water drop area, and under the condition that the intersection exists between the candidate touch area and the water drop area, fingerprint data in the candidate touch area are collected through the fingerprint sensor under the screen.
Alternatively, on the basis of fig. 6, as shown in fig. 8, the present step may include the following steps.
In step 605A, a water droplet region in a waterproof state is acquired.
In one possible implementation manner, after the waterproof state is entered, the capacitive touch screen determines a water drop area in the waterproof state according to the first touch area, wherein the water drop area is greater than or equal to the first touch area.
Correspondingly, after the capacitive touch screen determines the candidate touch area, the water drop area is obtained, whether an intersection exists between the water drop area and the candidate touch area is detected, if so, step 605B is executed, and if not, touch coordinates are determined according to candidate touch data acquired by the capacitive touch screen (namely, a traditional touch coordinate determining mode) without acquiring fingerprint data through a fingerprint sensor under the screen.
Schematically, as shown in fig. 7, the capacitive touch screen determines an area formed by the 3 rd to 5 th columns in the 6 th row, the 3 rd to 5 th columns in the 7 th row, the 3 rd to 5 th columns in the 8 th row, and the 3 rd to 5 th columns in the 9 th row as a water drop area, and an intersection exists between the water drop area and the touch candidate area.
And step 605B, if an intersection exists between the water drop area and the candidate touch area, acquiring fingerprint data in the candidate touch area through the under-screen fingerprint sensor.
When intersection exists between the water drop area and the candidate touch area, the fact that the finger touches the water drop is indicated, and the capacitive touch screen informs the fingerprint sensor under the screen to acquire fingerprint data in the candidate touch area.
Schematically, as shown in fig. 7, the fingerprint sensor under the screen acquires fingerprint data in the area of the 7 th row, 4 th to 5 th columns and the 8 th row, 4 th to 5 th columns.
And step 606, determining the area where the fingerprint data is acquired as a target touch area.
The step 403 may be referred to in the implementation manner of this step, and this embodiment is not described herein again.
Schematically, as shown in fig. 7, the underscreen fingerprint sensor determines a target touch area from the areas of the 7 th row, the 4 th column to the 5 th column and the 8 th row, the 4 th column to the 5 th column.
Step 607, determining target touch data in the candidate touch data according to the target touch area, where the target touch data is touch data in the target touch area.
After the target touch area is determined, the capacitive touch screen further filters invalid touch data in the candidate touch area according to the target touch area, and finally obtains target touch data at the actual finger touch area, wherein the wireless touch data is touch data at the water drop area.
Step 608, determining touch coordinates according to the target touch area and the target touch data.
Because the target touch area comprises a plurality of touch sub-areas and the change situation of the capacitance in each touch sub-area is different, the capacitive touch screen adopts a gravity center algorithm to determine the touch coordinates.
As shown in fig. 8, this step may include the following steps.
Step 608A, determining a data difference value corresponding to each touch sub-area in the target touch area according to the target touch data and the reference data.
For each touch subarea, the capacitive touch screen calculates a data difference value between target touch data and reference data collected in the touch subarea.
Schematically, as shown in fig. 7, the data difference values calculated by the capacitive touch screen for each touch sub-area are 150, 146, 149 and 144, respectively.
And step 608B, calculating touch coordinates through a gravity center algorithm according to the area coordinates corresponding to each touch subarea and the data difference value.
Further, the capacitive touch screen calculates a touch abscissa according to the area abscissa corresponding to each touch subarea and the data difference value; and calculating the touch vertical coordinate according to the vertical coordinate of the area corresponding to each touch sub-area and the data difference value.
In one possible embodiment, the touch ordinate uses the following central calculation formula:
Figure BDA0002113873720000121
and i is the column number of the touch subarea, and Xi is the data difference value corresponding to the touch subarea.
The touch abscissa adopts the following central calculation formula:
Figure BDA0002113873720000122
wherein j is the column number of the touch sub-area, and Yj is the data difference value corresponding to the touch sub-area.
Schematically, as shown in fig. 7, the capacitive touch screen calculates a touch ordinate X (150 × 3+146 × 4+149 × 3+144 × 4)/(150+146+149+144) ═ 3.49, and calculates a touch ordinate Y (150 × 6+146 × 6+149 × 7+ 144)/(150 +146+149+144) ═ 6.49.
Compared with the related art, when the touch coordinates are directly calculated according to the candidate touch data, the touch ordinate X is calculated to be (145 × 3+147 × 4+150 × 2+150 × 3+146 × 4+143 × 2+149 × 3+144 × 4+140+ 2+147 × 3+ 141)/(145 +147+150+150+146+143+149+144+140+147+141) 3.09, and the touch abscissa Y is calculated to be (145+ 5+147+ 5+150 + 6+150 +146+ 6+143+ 7+149 + 7+144 + 7+140 + 8+147 + 8+ 141)/(145 +150+150+ 150+ 143+ 146+ 8+147 + 8+ 141) in a more approximate manner.
In the embodiment, the terminal determines the candidate touch area according to the candidate touch data acquired by the capacitive touch screen, and the fingerprint data at the candidate touch area is acquired by the fingerprint sensor under the screen, so that the power consumption of the fingerprint sensor under the screen during fingerprint scanning can be reduced.
In addition, in this embodiment, the terminal determines the water droplet region when getting into waterproof state to when having intersection between candidate touch region and water droplet region, carry out fingerprint data collection through fingerprint sensor under the screen, avoid carrying out the power consumption waste that fingerprint data collection caused when there is not intersection between candidate touch region and the water droplet region.
Referring to fig. 9, a block diagram of a touch coordinate determination apparatus according to an embodiment of the present application is shown. The apparatus may be implemented as all or a portion of the terminal in software, hardware, or a combination of both. The device includes:
a state entering module 910, configured to enter a waterproof state when there are water droplets on the capacitive touch screen;
an acquisition module 920, configured to acquire fingerprint data through the underscreen fingerprint sensor in the waterproof state when a touch signal is received;
a first region determining module 930, configured to determine a region where the fingerprint data is acquired as a target touch region;
and a first coordinate determining module 940, configured to determine touch coordinates according to the target touch area and candidate touch data collected by the capacitive touch screen.
Optionally, the acquiring module 920 includes:
the first determining unit is used for determining a candidate touch area according to the candidate touch data acquired by the capacitive touch screen when the touch signal is received;
and the acquisition unit is used for acquiring the fingerprint data in the candidate touch area through the fingerprint sensor under the screen.
Optionally, the collecting unit is configured to:
acquiring a water drop area in the waterproof state;
if the intersection exists between the water drop area and the candidate touch area, acquiring the fingerprint data in the candidate touch area through the under-screen fingerprint sensor;
the device further comprises:
and the second coordinate determination module is used for determining the touch coordinate according to the candidate touch data acquired by the capacitive touch screen if the intersection exists between the water drop area and the candidate touch area.
Optionally, the first coordinate determining module 940 includes:
a second determining unit, configured to determine, according to the target touch area, target touch data in the candidate touch data, where the target touch data is touch data in the target touch area;
and the third determining unit is used for determining the touch coordinate according to the target touch area and the target touch data.
Optionally, the third determining unit is configured to:
determining a data difference value corresponding to each touch subarea in the target touch area according to the target touch data and the reference data;
and calculating the touch coordinates through a gravity center algorithm according to the area coordinates corresponding to each touch subarea and the data difference value.
Optionally, the state entering unit 910 includes:
the acquisition unit is used for acquiring sampling data in each touch area on the capacitive touch screen, wherein the sampling data are obtained by sampling according to a sampling period;
a fourth determining unit, configured to determine, according to the sampled data, a first touch area and a second touch area in the touch areas, where the first touch area is a touch area with a data difference smaller than a first threshold, the second touch area is a touch area with a data difference larger than a second threshold, the data difference is a difference between the sampled data and reference data, the first threshold is a negative value, and the second threshold is a positive value;
and the state entering unit is used for determining that water drops exist on the capacitive touch screen and entering the waterproof state if the number of the first touch areas is larger than that of the second touch areas and the number of the first touch areas is larger than a number threshold.
Optionally, the apparatus further comprises:
and the second region determining module is used for determining a water drop region in the waterproof state according to the first touch region, wherein the area of the water drop region is larger than or equal to that of the first touch region.
Optionally, the apparatus further comprises:
the timer setting module is used for setting a waterproof state timer;
and the state exit module is used for exiting the waterproof state if the waterproof state timer is up.
In summary, in the embodiment of the application, when water drops exist on the capacitive touch screen, the terminal enters a waterproof state, and when a touch signal is received, fingerprint data is collected through a fingerprint sensor under the screen, so that an area where the fingerprint data is collected is determined as a target touch area, and touch coordinates are determined according to the target touch area and candidate touch data collected by the capacitive touch screen; under the condition that the finger is located the water droplet region, the finger position can be accurately positioned by means of the fingerprint sensor under the screen, the influence of the water droplet on the positioning of the hand touch position is avoided (because water is a conductor, when the finger contacts the water droplet, the terminal recognizes the enlarged touch region), the accuracy of the determined touch coordinate is improved, and the accuracy of touch operation is improved.
In addition, the terminal determines a candidate touch area according to candidate touch data acquired by the capacitive touch screen, and the fingerprint data at the candidate touch area is acquired by the fingerprint sensor under the screen, so that the power consumption of the fingerprint sensor under the screen during fingerprint scanning can be reduced.
In addition, in this embodiment, the terminal determines the water droplet region when getting into waterproof state to when having intersection between candidate touch region and water droplet region, carry out fingerprint data collection through fingerprint sensor under the screen, avoid carrying out the power consumption waste that fingerprint data collection caused when there is not intersection between candidate touch region and the water droplet region.
The present application further provides a computer-readable medium, which stores at least one instruction, where the at least one instruction is loaded and executed by the processor to implement the touch coordinate determination method according to the above embodiments.
The present application further provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the touch coordinate determination method according to the above embodiments.
Those skilled in the art will recognize that, in one or more of the examples described above, the functions described in the embodiments of the present application may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (11)

1. A touch coordinate determination method for a terminal equipped with a capacitive touch screen and an off-screen fingerprint sensor, the method comprising:
when water drops exist on the capacitive touch screen, the capacitive touch screen enters a waterproof state;
in the waterproof state, when a touch signal is received, fingerprint data is collected through the under-screen fingerprint sensor, and the under-screen fingerprint sensor is an optical fingerprint sensor or an ultrasonic fingerprint sensor;
determining an area where the fingerprint data is collected as a target touch area;
and determining touch coordinates according to the target touch area and candidate touch data acquired by the capacitive touch screen.
2. The method of claim 1, wherein collecting fingerprint data by the off-screen fingerprint sensor when the touch signal is received comprises:
when the touch signal is received, determining a candidate touch area according to the candidate touch data collected by the capacitive touch screen;
collecting the fingerprint data within the candidate touch area through the under-screen fingerprint sensor.
3. The method of claim 2, wherein the collecting the fingerprint data within the candidate touch area by the off-screen fingerprint sensor comprises:
acquiring a water drop area in the waterproof state;
if the intersection exists between the water drop area and the candidate touch area, acquiring the fingerprint data in the candidate touch area through the under-screen fingerprint sensor;
after the acquiring the water drop area in the waterproof state, the method further includes:
and if no intersection exists between the water drop area and the candidate touch area, determining the touch coordinate according to the candidate touch data acquired by the capacitive touch screen.
4. The method of any one of claims 1 to 3, wherein determining touch coordinates from the target touch area and candidate touch data collected by the capacitive touch screen comprises:
determining target touch data in the candidate touch data according to the target touch area, wherein the target touch data is touch data in the target touch area;
and determining the touch coordinate according to the target touch area and the target touch data.
5. The method of claim 4, wherein determining the touch coordinates from the target touch area and the target touch data comprises:
determining a data difference value corresponding to each touch subarea in the target touch area according to the target touch data and the reference data;
and calculating the touch coordinates through a gravity center algorithm according to the area coordinates corresponding to each touch subarea and the data difference value.
6. The method of any one of claims 1 to 3, wherein entering a waterproof state when water droplets are present on the capacitive touch screen comprises:
acquiring sampling data in each touch area on the capacitive touch screen, wherein the sampling data are obtained by sampling according to a sampling period;
determining a first touch area and a second touch area in the touch areas according to the sampling data, wherein the first touch area is a touch area with a data difference value smaller than a first threshold value, the second touch area is a touch area with a data difference value larger than a second threshold value, the data difference value is a difference value between the sampling data and reference data, the first threshold value is a negative value, and the second threshold value is a positive value;
and if the number of the first touch areas is larger than that of the second touch areas and the number of the first touch areas is larger than a number threshold, determining that water drops exist on the capacitive touch screen and entering the waterproof state.
7. The method of claim 6, wherein after entering the water-resistant state, the method further comprises:
and determining a water drop area in the waterproof state according to the first touch area, wherein the area of the water drop area is larger than or equal to that of the first touch area.
8. A method according to any one of claims 1 to 3, wherein after said waterproof condition is entered, the method further comprises:
setting a waterproof state timer;
and if the waterproof state timer is up, exiting the waterproof state.
9. A touch coordinate determination apparatus for a terminal equipped with a capacitive touch screen and an off-screen fingerprint sensor, comprising:
the state entering module is used for entering a waterproof state when water drops exist on the capacitive touch screen;
the acquisition module is used for acquiring fingerprint data through the under-screen fingerprint sensor when a touch signal is received in the waterproof state, wherein the under-screen fingerprint sensor is an optical fingerprint sensor or an ultrasonic fingerprint sensor;
the first area determining module is used for determining an area where the fingerprint data are collected as a target touch area;
and the first coordinate determination module is used for determining touch coordinates according to the target touch area and candidate touch data acquired by the capacitive touch screen.
10. A terminal, characterized in that the terminal comprises a processor and a memory; the memory stores at least one instruction for execution by the processor to implement the touch coordinate determination method of any of claims 1-8.
11. A computer-readable storage medium having stored thereon at least one instruction for execution by a processor to implement a touch coordinate determination method according to any one of claims 1 to 8.
CN201910587064.9A 2019-07-01 2019-07-01 Touch coordinate determination method and device, terminal and storage medium Active CN110287931B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910587064.9A CN110287931B (en) 2019-07-01 2019-07-01 Touch coordinate determination method and device, terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910587064.9A CN110287931B (en) 2019-07-01 2019-07-01 Touch coordinate determination method and device, terminal and storage medium

Publications (2)

Publication Number Publication Date
CN110287931A CN110287931A (en) 2019-09-27
CN110287931B true CN110287931B (en) 2021-09-03

Family

ID=68021592

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910587064.9A Active CN110287931B (en) 2019-07-01 2019-07-01 Touch coordinate determination method and device, terminal and storage medium

Country Status (1)

Country Link
CN (1) CN110287931B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111078046B (en) * 2019-12-05 2022-04-08 北京集创北方科技股份有限公司 Detection method and device and electronic equipment
CN111240517B (en) * 2020-01-09 2023-02-28 Oppo(重庆)智能科技有限公司 Touch display screen adjusting method and device, terminal and storage medium
CN112099666B (en) * 2020-09-10 2024-03-29 深圳市科航科技发展有限公司 Touch control method, system, terminal and storage medium applied to capacitive screen
CN115617191A (en) * 2022-06-08 2023-01-17 荣耀终端有限公司 Touch anomaly suppression method, electronic device and storage medium
CN115617192B (en) * 2022-06-20 2023-11-10 荣耀终端有限公司 Touch positioning method and electronic equipment
CN117687532A (en) * 2024-02-02 2024-03-12 深圳市坤巨实业有限公司 Capacitive screen working frequency setting method, touch device, equipment and medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102262470A (en) * 2010-05-28 2011-11-30 安国国际科技股份有限公司 Method and system for judging touch-control point on touch-control panel
CN102467302A (en) * 2010-11-05 2012-05-23 上海天马微电子有限公司 Detection method for capacitance type touch screen to distinguish conducting liquid from fingers
CN104423736A (en) * 2013-08-29 2015-03-18 天津富纳源创科技有限公司 Touch identification method for touch screen
CN105844262A (en) * 2016-04-25 2016-08-10 广东欧珀移动通信有限公司 Method and device for determination of touch position through combination of fingerprint in wet hand operation mode
CN106155437A (en) * 2015-04-10 2016-11-23 晨星半导体股份有限公司 Operator scheme determination methods, touch points position judging method and touch control circuit
CN106959779A (en) * 2017-03-27 2017-07-18 努比亚技术有限公司 A kind of apparatus and method for reducing touch screen wrong report point
JP2017212015A (en) * 2017-09-06 2017-11-30 三菱電機株式会社 Touch panel
KR20180105854A (en) * 2017-03-16 2018-10-01 주식회사 티원코리아 Infrared touch screen devices
CN109614016A (en) * 2019-01-11 2019-04-12 中国联合网络通信集团有限公司 Touch identification method, device and the electronic equipment of capacitance touch screen

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102262470A (en) * 2010-05-28 2011-11-30 安国国际科技股份有限公司 Method and system for judging touch-control point on touch-control panel
CN102467302A (en) * 2010-11-05 2012-05-23 上海天马微电子有限公司 Detection method for capacitance type touch screen to distinguish conducting liquid from fingers
CN104423736A (en) * 2013-08-29 2015-03-18 天津富纳源创科技有限公司 Touch identification method for touch screen
CN106155437A (en) * 2015-04-10 2016-11-23 晨星半导体股份有限公司 Operator scheme determination methods, touch points position judging method and touch control circuit
CN105844262A (en) * 2016-04-25 2016-08-10 广东欧珀移动通信有限公司 Method and device for determination of touch position through combination of fingerprint in wet hand operation mode
KR20180105854A (en) * 2017-03-16 2018-10-01 주식회사 티원코리아 Infrared touch screen devices
CN106959779A (en) * 2017-03-27 2017-07-18 努比亚技术有限公司 A kind of apparatus and method for reducing touch screen wrong report point
JP2017212015A (en) * 2017-09-06 2017-11-30 三菱電機株式会社 Touch panel
CN109614016A (en) * 2019-01-11 2019-04-12 中国联合网络通信集团有限公司 Touch identification method, device and the electronic equipment of capacitance touch screen

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
A Highly Linear and Accurate Touch Data Extraction Algorithm Based on Polar Coordinates for Large-Sized Capactive Touch Screen Panels;An jae-Sung et al.;《IEEE TRANSACTIONS ON CONSUMER ELECTRONICS》;20161130;第64卷(第1期);第341-348页 *
电容式触摸屏的多点解决方案;周自立;《中国优秀硕士学位论文全文数据库 信息科技辑》;20130115;I136-64 *

Also Published As

Publication number Publication date
CN110287931A (en) 2019-09-27

Similar Documents

Publication Publication Date Title
CN110287931B (en) Touch coordinate determination method and device, terminal and storage medium
CN108958681B (en) Split screen display method, device, terminal and storage medium
US11467715B2 (en) User interface display method, terminal and non-transitory computer-readable storage medium for splitting a display using a multi-finger swipe
CN108874288B (en) Application program switching method, device, terminal and storage medium
EP3570163B1 (en) Method for launching application, storage medium, and terminal
US20180365086A1 (en) Method for Processing Data Collected by Touch Panel, and Terminal Device
US20200201536A1 (en) Black screen gesture detection method and device, storage medium, and mobile terminal
CN107577415B (en) Touch operation response method and device
US11061558B2 (en) Touch operation response method and device
CN107608551B (en) Touch operation response method and device
CN108595230A (en) Application program preloads method, apparatus, storage medium and terminal
WO2020156199A1 (en) Application login method and device, terminal and storage medium
US10901608B2 (en) Method for recognizing a screen-off gesture, and storage medium and terminal thereof
US11086442B2 (en) Method for responding to touch operation, mobile terminal, and storage medium
CN107450838B (en) Response method and device of black screen gesture, storage medium and mobile terminal
CN111435277B (en) Method, device, terminal and storage medium for displaying content
US11194425B2 (en) Method for responding to touch operation, mobile terminal, and storage medium
CN111225138A (en) Camera control method and device, storage medium and terminal
CN111475097A (en) Handwriting selection method and device, computer equipment and storage medium
US20190079635A1 (en) Method for responding to touch operation and electronic device
CN107608550A (en) Touch operation response method and device
CN114138121B (en) User gesture recognition method, device and system, storage medium and computing equipment
CN107479700B (en) Black screen gesture control method and device, storage medium and mobile terminal
CN112788583A (en) Equipment searching method and device, storage medium and electronic equipment
CN106569716B (en) Single-hand control method and control system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant