WO2020062310A1 - 手写笔检测方法、系统及相关装置 - Google Patents

手写笔检测方法、系统及相关装置 Download PDF

Info

Publication number
WO2020062310A1
WO2020062310A1 PCT/CN2018/109226 CN2018109226W WO2020062310A1 WO 2020062310 A1 WO2020062310 A1 WO 2020062310A1 CN 2018109226 W CN2018109226 W CN 2018109226W WO 2020062310 A1 WO2020062310 A1 WO 2020062310A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
stylus
frequency
input signal
input
Prior art date
Application number
PCT/CN2018/109226
Other languages
English (en)
French (fr)
Inventor
罗红磊
张君勇
李伟欢
徐业健
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP18935164.6A priority Critical patent/EP3835928A4/en
Priority to CN201880097989.9A priority patent/CN112740152B/zh
Priority to PCT/CN2018/109226 priority patent/WO2020062310A1/zh
Priority to CA3113132A priority patent/CA3113132A1/en
Priority to AU2018456082A priority patent/AU2018456082B2/en
Priority to JP2021517691A priority patent/JP7397861B2/ja
Priority to US17/281,187 priority patent/US11899879B2/en
Publication of WO2020062310A1 publication Critical patent/WO2020062310A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/04166Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving
    • G06F3/041662Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving using alternate mutual and self-capacitive scanning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • G06F1/3262Power saving in digitizer or tablet
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383Signal control means within the pointing device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/04166Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G06F3/0442Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means using active external devices, e.g. active pens, for transmitting changes in electrical potential to be received by the digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04106Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04803Split screen, i.e. subdividing the display area or the window area into separate subareas
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G06F3/0446Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the present application relates to the field of mobile communication technology, and in particular, to a stylus detection method, system, and related device.
  • the present application provides a stylus detection method, system and related device, which can realize the function of the stylus quickly while reducing the power consumption of the terminal.
  • the present application provides a stylus detection method, including: first, a terminal detects an input signal of the stylus at a first frequency. Then, the terminal receives the first input of the stylus through the touch screen. In response to the first input, the terminal detects an input signal of the stylus at a second frequency. Then, if the terminal detects the input signal of the stylus at the second frequency and the terminal does not detect that the duration of the input signal of the stylus is greater than the first time, the terminal detects the input signal of the stylus at the third frequency. The second frequency is greater than the third frequency and greater than the first frequency.
  • the terminal can detect the input signal of the stylus at a low frequency (first frequency).
  • first frequency the input signal of the stylus
  • second frequency the high frequency
  • the terminal When the terminal is at a high frequency (second frequency) to detect the input signal of the stylus, if the input signal of the stylus is not detected for a period of time (for example, 30s to 60s), the terminal can reduce the detection frequency to the intermediate frequency (third frequency) , Save power and wait for the input signal of the stylus to come again, so that when the input signal of the stylus comes again, the terminal can quickly return to the high frequency (second frequency) state to respond, and quickly execute the stylus that comes again.
  • the action corresponding to the input signal improves the user experience.
  • the terminal when the terminal detects the input signal of the stylus at the third frequency, if the terminal does not detect that the duration of the input signal of the stylus is greater than the second time, the terminal detects at the first frequency Input signal from stylus. That is to say, when no input signal of the stylus arrives for a long time, the terminal can reduce the detection frequency of the input signal of the stylus to save power consumption.
  • the terminal when the terminal detects the input signal of the stylus at a third frequency, if the terminal receives the second input of the stylus, in response to the second input of the stylus, the terminal uses the second input of the stylus Frequency detection input signal of stylus. That is to say, when the input signal of the stylus comes again, the terminal can increase the detection frequency of the input signal of the stylus, so that the terminal can quickly respond to the input signal of the stylus.
  • the terminal in a case where the terminal detects an input signal of the stylus pen at a second frequency, the terminal receives a third input of the user. In response to the third input, the terminal turns off the touch screen and detects an input signal of the stylus pen at a first frequency. That is to say, when the terminal is at a high frequency (second frequency) to detect the input signal of the stylus, if the terminal goes off the screen, the terminal can detect the input signal of the stylus at a low frequency, saving power consumption, and also enabling the user to When the screen is off, the user responds to the input signal of the stylus and performs a response action, which improves the user's experience with the stylus.
  • second frequency high frequency
  • the terminal in a case where the terminal detects an input signal of the stylus pen at a third frequency, the terminal receives a fourth input of the user. In response to the fourth input, the terminal turns off the touch screen and detects an input signal of the stylus pen at a first frequency. That is to say, when the terminal is at the intermediate frequency (second frequency) to detect the input signal of the stylus, if the terminal goes off the screen, the terminal can detect the input signal of the stylus at low frequency, saving power consumption, and also enabling the user to turn off In the screen, the user responds to the input signal of the stylus and executes corresponding actions, which improves the user's experience of using the stylus.
  • the intermediate frequency second frequency
  • the terminal when the terminal detects an input signal of the stylus pen at a second frequency, the terminal detects a user's touch input in a first detection state through a touch screen. In the first detection state, the terminal detects a user's touch input in a mutual capacitance detection manner at a fourth frequency and a self-capacitance detection manner at a fifth frequency. That is to say, when the terminal detects the input signal of the stylus at a high frequency (second frequency), the terminal can also detect a finger touch input at the same time, which can improve the user's experience when using the stylus and fingers to operate the terminal at the same time.
  • the terminal when the terminal detects an input signal of the stylus pen at a third frequency, the terminal detects a user's touch input in a second detection state through a touch screen; wherein, in the second detection state, the terminal starts with The mutual capacitance detection method at the sixth frequency and the self-capacitance detection method at the seventh frequency detect the user's touch input. That is to say, when the terminal can detect the input signal of the stylus at the intermediate frequency (second frequency), the terminal can also detect the touch input of the finger at the same time, which saves the power consumption of the terminal when the user does not operate the terminal, and can also input the stylus. When signals or touch inputs arrive at the same time, the terminal can respond in time.
  • the method further includes: the terminal stops detecting the touch input of the user. That is to say, the terminal can not detect the user's touch input when the screen is off to save power consumption.
  • the terminal receives the fifth input of the stylus on the condition that the terminal extinguishes the touch screen and detects an input signal of the stylus at a first frequency.
  • the terminal detects an input signal of the stylus at the second frequency and saves the writing content of the fifth input; wherein the writing content includes the writing of the stylus
  • the terminal can receive the input of the stylus and record the writing content of the stylus, so that the user can quickly use the stylus to record the writing content.
  • the terminal receives a sixth input from the user.
  • the terminal stops detecting the input signal of the stylus, or the terminal detects the input signal of the stylus at the first frequency. That is to say, the terminal can turn off the detection of the stylus or detect the stylus at a low frequency according to the needs of the user, which saves the user's power consumption when the stylus is not used.
  • the terminal receives the seventh input of the user.
  • the terminal determines whether the terminal has received an input signal of the stylus before receiving the seventh input. If it is, the terminal detects the input signal of the stylus at the second frequency. If not, the terminal uses the The first frequency detects an input signal of the stylus. That is to say, when receiving the user's operation and turning on the stylus function, the terminal can determine whether the user has used the stylus before to determine the detection frequency of the stylus, which can save power.
  • the terminal receives an eighth input from the user.
  • the terminal restores the factory settings and detects the input signal of the stylus at a first frequency. That is to say, after the terminal is restored to the factory settings, the terminal detects the input signal of the stylus at a low frequency (first frequency).
  • the terminal receives a ninth input from the user.
  • the terminal restarts, wherein the frequency at which the terminal detects the input signal of the stylus before restarting is the same as the frequency at which the input signal of the stylus is detected after restarting.
  • the present application provides a terminal including one or more processors and one or more memories.
  • the one or more memories are coupled to one or more processors.
  • the one or more memories are used to store computer program code.
  • the computer program code includes computer instructions.
  • the communication device executes the instructions.
  • the stylus detection method in any possible implementation manner of any of the foregoing aspects.
  • an embodiment of the present application provides a computer storage medium including computer instructions, and when the computer instructions are run on an electronic device, the communication device is enabled to perform stylus detection in any one of the possible implementation manners of the foregoing aspects. method.
  • an embodiment of the present application provides a computer program product that, when the computer program product runs on a computer, causes the computer to execute the stylus detection method in any one of the possible implementation manners of the above aspects.
  • FIG. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • FIG. 2 is a schematic diagram of a software architecture according to an embodiment of the present application.
  • FIG. 3 is a schematic architecture diagram of a stylus system according to an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of a terminal screen according to an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a touch sensor according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a set of interfaces according to an embodiment of the present application.
  • FIG. 7 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 8 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 9 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 10 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 11 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 12 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 13 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 14 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 15 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 16 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 17 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 18 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • 19 is a schematic diagram of another group of interfaces according to an embodiment of the present application.
  • FIG. 20 is a schematic structural diagram of another stylus system according to an embodiment of the present application.
  • FIG. 21 is a schematic state diagram of a stylus smart switch according to an embodiment of the present application.
  • FIG. 22 is a schematic diagram of a state of another smart pen stylus switch according to an embodiment of the present application.
  • FIG. 23 is a schematic diagram of switching a working state of a touch device according to an embodiment of the present application.
  • FIG. 24 is a schematic state diagram of a stylus smart switch according to an embodiment of the present application.
  • FIG. 25 is a schematic diagram of a signal output by a stylus according to an embodiment of the present application.
  • FIG. 26 is a schematic flowchart of a stylus detection method according to an embodiment of the present application.
  • first and second are used for descriptive purposes only, and cannot be understood as implying or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise stated, the meaning of "a plurality" is two or more.
  • FIG. 1 is a schematic structural diagram of an electronic device 100.
  • the terminal 01 in the embodiment of the present application may be an electronic device 100.
  • the embodiment is specifically described below by taking the electronic device 100 as an example. It should be understood that the electronic device 100 shown in FIG. 1 is only an example of the terminal 01, and the electronic device 100 may have more or fewer parts than those shown in the figure, and two or more parts may be combined , Or can have different component configurations.
  • the various components shown in FIG. 1 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2.
  • Mobile communication module 150 wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display 194, And a subscriber identity module (SIM) card interface 195.
  • SIM subscriber identity module
  • the sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100.
  • the electronic device 100 may include more or fewer parts than shown, or some parts may be combined, or some parts may be split, or different parts may be arranged.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image, signal processor, ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural-network processing unit (NPU) Wait.
  • AP application processor
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • different processing units may be independent devices or integrated in one or more processors.
  • the controller may be a nerve center and a command center of the electronic device 100.
  • the controller can generate operation control signals according to the instruction operation code and timing signals, and complete the control of fetching and executing instructions.
  • the processor 110 may further include a memory for storing instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory may store instructions or data that the processor 110 has just used or used cyclically. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit (inter-integrated circuit, sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver receiver / transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input / output (GPIO) interface, subscriber identity module (SIM) interface, and / Or universal serial bus (universal serial bus, USB) interface.
  • I2C integrated circuit
  • I2S integrated circuit
  • PCM pulse code modulation
  • UART universal asynchronous transceiver receiver / transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input / output
  • SIM subscriber identity module
  • USB universal serial bus
  • the I2C interface is a two-way synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).
  • the processor 110 may include multiple sets of I2C buses.
  • the processor 110 may be respectively coupled to a touch sensor 180K, a charger, a flash, a camera 193, and the like through different I2C bus interfaces.
  • the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to implement the touch function of the electronic device 100.
  • the I2S interface can be used for audio communication.
  • the processor 110 may include multiple sets of I2S buses.
  • the processor 110 may be coupled with the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170.
  • the audio module 170 may transmit audio signals to the wireless communication module 160 through an I2S interface, so as to implement a function of receiving a call through a Bluetooth headset.
  • the PCM interface can also be used for audio communications, sampling, quantizing, and encoding analog signals.
  • the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface.
  • the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to implement the function of receiving calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus for asynchronous communication.
  • the bus may be a two-way communication bus. It converts the data to be transferred between serial and parallel communications.
  • a UART interface is generally used to connect the processor 110 and the wireless communication module 160.
  • the processor 110 communicates with a Bluetooth module in the wireless communication module 160 through a UART interface to implement a Bluetooth function.
  • the audio module 170 may transmit audio signals to the wireless communication module 160 through a UART interface, so as to implement a function of playing music through a Bluetooth headset.
  • the MIPI interface can be used to connect the processor 110 with peripheral devices such as the display 194, the camera 193, and the like.
  • the MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like.
  • CSI camera serial interface
  • DSI display serial interface
  • the processor 110 and the camera 193 communicate through a CSI interface to implement a shooting function of the electronic device 100.
  • the processor 110 and the display screen 194 communicate through a DSI interface to implement a display function of the electronic device 100.
  • the GPIO interface can be configured by software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface may be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like.
  • GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the USB interface 130 is an interface that complies with the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones and play audio through headphones. This interface can also be used to connect other electronic devices, such as AR devices.
  • the interface connection relationship between the modules illustrated in the embodiments of the present invention is only a schematic description, and does not constitute a limitation on the structure of the electronic device 100.
  • the electronic device 100 may also adopt different interface connection modes or a combination of multiple interface connection modes in the above embodiments.
  • the charging management module 140 is configured to receive a charging input from a charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 140 may receive the charging input of the wired charger through the USB interface 130.
  • the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100. While the charge management module 140 is charging the battery 142, the power management module 141 can also provide power to the electronic device.
  • the power management module 141 is used to connect the battery 142, the charge management module 140 and the processor 110.
  • the power management module 141 receives inputs from the battery 142 and / or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
  • the power management module 141 can also be used to monitor parameters such as battery capacity, number of battery cycles, battery health (leakage, impedance) and other parameters.
  • the power management module 141 may also be disposed in the processor 110.
  • the power management module 141 and the charge management module 140 may be provided in the same device.
  • the wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, and a baseband processor.
  • the antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals.
  • Each antenna in the electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization.
  • antenna 1 can be multiplexed into a diversity antenna for a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 may provide a wireless communication solution including 2G / 3G / 4G / 5G and the like applied on the electronic device 100.
  • the mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like.
  • the mobile communication module 150 may receive the electromagnetic wave by the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic wave, and transmit it to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic wave radiation through the antenna 1.
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110.
  • at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is configured to modulate a low-frequency baseband signal to be transmitted into a high-frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
  • the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is processed by the baseband processor and then passed to the application processor.
  • the application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194.
  • the modem processor may be a separate device.
  • the modem processor may be independent of the processor 110 and disposed in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 may provide wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (bluetooth, BT), and global navigation satellites applied to the electronic device 100. Wireless communication solutions such as global navigation system, GNSS, frequency modulation (FM), near field communication (NFC), and infrared technology (infrared, IR).
  • the wireless communication module 160 may be one or more devices that integrate at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and convert it into electromagnetic wave radiation through the antenna 2.
  • the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include a global mobile communication system (GSM), a general packet radio service (GPRS), a code division multiple access (CDMA), and broadband. Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and / or IR technology.
  • the GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidou navigation navigation system (BDS), and a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and / or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Bertdou navigation navigation system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor.
  • the GPU is a microprocessor for image processing and is connected to the display 194 and an application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • the processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos, and the like.
  • the display screen 194 includes a display panel.
  • the display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active matrix organic light emitting diode active-matrix organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • emitting diodes AMOLED
  • flexible light-emitting diodes FLEDs
  • Miniled MicroLed
  • Micro-oLed quantum dot light emitting diodes
  • QLEDs quantum dot light emitting diodes
  • the electronic device 100 may include one or N display screens 194, where N is a positive integer
  • the electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
  • the ISP processes the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and the light is transmitted to the light receiving element of the camera through the lens. The light signal is converted into an electrical signal, and the light receiving element of the camera passes the electrical signal to the ISP for processing and converts the image to the naked eye. ISP can also optimize the image's noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, an ISP may be provided in the camera 193.
  • the camera 193 is used to capture still images or videos.
  • An object generates an optical image through a lens and projects it onto a photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs digital image signals to the DSP for processing.
  • DSP converts digital image signals into image signals in standard RGB, YUV and other formats.
  • the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
  • a digital signal processor is used to process digital signals. In addition to digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform a Fourier transform on the frequency point energy and the like.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.
  • MPEG moving picture experts
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • the NPU can quickly process input information and continuously learn.
  • the NPU can realize applications such as intelligent recognition of the electronic device 100, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, save music, videos and other files on an external memory card.
  • the internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area may store an operating system, at least one application required by a function (such as a sound playback function, an image playback function, etc.) and the like.
  • the storage data area may store data (such as audio data, phone book, etc.) created during the use of the electronic device 100.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.
  • UFS universal flash memory
  • the electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, and an application processor. Such as music playback, recording, etc.
  • the audio module 170 is configured to convert digital audio information into an analog audio signal and output, and is also used to convert an analog audio input into a digital audio signal.
  • the audio module 170 may also be used to encode and decode audio signals.
  • the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.
  • the speaker 170A also called a "horn" is used to convert audio electrical signals into sound signals.
  • the electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.
  • the receiver 170B also referred to as the "handset" is used to convert audio electrical signals into sound signals.
  • the electronic device 100 answers a call or a voice message, it can answer the voice by holding the receiver 170B close to the human ear.
  • the microphone 170C also called “microphone”, “microphone”, is used to convert sound signals into electrical signals.
  • the user can make a sound through the mouth near the microphone 170C, and input a sound signal into the microphone 170C.
  • the electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, in addition to collecting sound signals, it may also implement a noise reduction function. In other embodiments, the electronic device 100 may further be provided with three, four, or more microphones 170C to achieve sound signal collection, noise reduction, identification of sound sources, and directional recording.
  • the headset interface 170D is used to connect a wired headset.
  • the headphone interface 170D may be a USB interface 130 or a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (United States of America, CTIA) standard interface.
  • OMTP open mobile electronic device platform
  • CTIA cellular telecommunications industry association
  • the pressure sensor 180A is used to sense a pressure signal, and can convert the pressure signal into an electrical signal.
  • the pressure sensor 180A may be disposed on the display screen 194.
  • the capacitive pressure sensor may be at least two parallel plates having a conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes.
  • the electronic device 100 determines the intensity of the pressure according to the change in capacitance.
  • the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A.
  • the electronic device 100 may also calculate the touched position based on the detection signal of the pressure sensor 180A.
  • touch operations acting on the same touch position but different touch operation intensities may correspond to different operation instructions. For example, when a touch operation with a touch operation intensity lower than the first pressure threshold is applied to the short message application icon, an instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction for creating a short message is executed.
  • the gyro sensor 180B may be used to determine a movement posture of the electronic device 100.
  • the angular velocity of the electronic device 100 around three axes ie, the x, y, and z axes
  • the gyro sensor 180B can be used for image stabilization.
  • the gyro sensor 180B detects the angle of the electronic device 100 shake, and calculates the distance that the lens module needs to compensate according to the angle, so that the lens cancels the shake of the electronic device 100 through the backward movement to achieve image stabilization.
  • the gyro sensor 180B can also be used for navigation and somatosensory game scenes.
  • the barometric pressure sensor 180C is used to measure air pressure.
  • the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C, and assists in positioning and navigation.
  • the magnetic sensor 180D includes a Hall sensor.
  • the electronic device 100 can detect the opening and closing of the flip leather case by using the magnetic sensor 180D.
  • the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. Further, according to the opened and closed state of the holster or the opened and closed state of the flip cover, characteristics such as automatic unlocking of the flip cover are set.
  • the acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 100 in various directions (generally three axes).
  • the magnitude and direction of gravity can be detected when the electronic device 100 is stationary. It can also be used to recognize the posture of electronic devices, and is used in applications such as switching between horizontal and vertical screens, and pedometers.
  • the electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F to measure the distance to achieve fast focusing.
  • the proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode.
  • the light emitting diode may be an infrared light emitting diode.
  • the electronic device 100 emits infrared light through a light emitting diode.
  • the electronic device 100 uses a photodiode to detect infrared reflected light from a nearby object. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficiently reflected light is detected, the electronic device 100 may determine that there is no object near the electronic device 100.
  • the electronic device 100 may use the proximity light sensor 180G to detect that the user is holding the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power.
  • the proximity light sensor 180G can also be used in holster mode, and the pocket mode automatically unlocks and locks the screen.
  • the ambient light sensor 180L is used to sense ambient light brightness.
  • the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.
  • Ambient light sensor 180L can also be used to automatically adjust white balance when taking pictures.
  • the ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touch.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the electronic device 100 may use the collected fingerprint characteristics to realize fingerprint unlocking, access application lock, fingerprint photographing, fingerprint answering an incoming call, and the like.
  • the temperature sensor 180J is used to detect the temperature.
  • the electronic device 100 executes a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds the threshold, the electronic device 100 performs a performance reduction of a processor located near the temperature sensor 180J so as to reduce power consumption and implement thermal protection.
  • the electronic device 100 when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid the abnormal shutdown of the electronic device 100 caused by the low temperature.
  • the electronic device 100 when the temperature is lower than another threshold, performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
  • the touch sensor 180K is also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also referred to as a "touch screen”.
  • the touch sensor 180K is used to detect a touch operation acting on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • a visual output related to the touch operation may be provided through the display screen 194.
  • the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.
  • the bone conduction sensor 180M can acquire vibration signals.
  • the bone conduction sensor 180M can acquire a vibration signal of a human voice oscillating bone mass.
  • Bone conduction sensor 180M can also contact the human pulse and receive blood pressure beating signals.
  • the bone conduction sensor 180M may also be disposed in the earphone and combined into a bone conduction earphone.
  • the audio module 170 may analyze a voice signal based on the vibration signal of the oscillating bone mass of the vocal part obtained by the bone conduction sensor 180M to implement a voice function.
  • the application processor may analyze the heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M to implement a heart rate detection function.
  • the keys 190 include a power-on key, a volume key, and the like.
  • the key 190 may be a mechanical key. It can also be a touch button.
  • the electronic device 100 may receive a key input, and generate a key signal input related to user settings and function control of the electronic device 100.
  • the motor 191 may generate a vibration alert.
  • the motor 191 can be used for vibration alert for incoming calls, and can also be used for touch vibration feedback.
  • the touch operation applied to different applications can correspond to different vibration feedback effects.
  • Acting on touch operations in different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects.
  • Different application scenarios (such as time reminders, receiving information, alarm clocks, games, etc.) can also correspond to different vibration feedback effects.
  • Touch vibration feedback effect can also support customization.
  • the indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, and can also be used to indicate messages, missed calls, notifications, and so on.
  • the SIM card interface 195 is used to connect a SIM card.
  • the SIM card can be contacted and separated from the electronic device 100 by inserting or removing the SIM card interface 195.
  • the electronic device 100 may support one or N SIM card interfaces, and N is a positive integer greater than 1.
  • SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card, etc. Multiple SIM cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards may be the same or different.
  • the SIM card interface 195 may also be compatible with different types of SIM cards.
  • the SIM card interface 195 is also compatible with external memory cards.
  • the electronic device 100 interacts with the network through a SIM card to implement functions such as calling and data communication.
  • the electronic device 100 uses an eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
  • the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture.
  • the embodiment of the present invention takes the layered architecture Android system as an example, and exemplifies the software structure of the electronic device 100.
  • FIG. 2 is a software structural block diagram of an electronic device 100 according to an embodiment of the present invention.
  • the layered architecture divides the software into several layers, each of which has a clear role and division of labor.
  • the layers communicate with each other through a software interface.
  • the Android system is divided into four layers, which are an application layer, an application framework layer, an Android runtime and a system library, and a kernel layer from top to bottom.
  • the application layer can include a series of application packages.
  • the application package can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, SMS and other applications.
  • the application framework layer provides an application programming interface (API) and a programming framework for applications at the application layer.
  • API application programming interface
  • the application framework layer includes some predefined functions.
  • the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
  • the window manager is used to manage window programs.
  • the window manager can obtain the display size, determine whether there is a status bar, lock the screen, take a screenshot, etc.
  • Content providers are used to store and retrieve data and make it accessible to applications.
  • the data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, and so on.
  • the view system includes visual controls, such as controls that display text, controls that display pictures, and so on.
  • the view system can be used to build applications.
  • the display interface can consist of one or more views.
  • the display interface including the SMS notification icon may include a view that displays text and a view that displays pictures.
  • the phone manager is used to provide a communication function of the electronic device 100. For example, management of call status (including connection, hang up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages that can disappear automatically after a short stay without user interaction.
  • the notification manager is used to inform download completion, message reminders, etc.
  • the notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window.
  • text messages are displayed in the status bar, sounds are emitted, electronic equipment vibrates, and the indicator light flashes.
  • Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.
  • the core library contains two parts: one is the functional functions that the Java language needs to call, and the other is the Android core library.
  • the application layer and the application framework layer run in a virtual machine.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • Virtual machines are used to perform object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
  • the system library can include multiple functional modules. For example: surface manager (media manager), media library (Media library), three-dimensional graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL) and so on.
  • surface manager media manager
  • media library Media library
  • Three-dimensional graphics processing library for example: OpenGL ES
  • 2D graphics engine for example: SGL
  • the Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
  • the media library supports a variety of commonly used audio and video formats for playback and recording, as well as still image files.
  • the media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
  • the 2D graphics engine is a graphics engine for 2D graphics.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least a display driver, a camera driver, an audio driver, and a sensor driver.
  • the following describes the workflow of the software and hardware of the electronic device 100 by way of example in conjunction with capturing a photographing scene.
  • a corresponding hardware interrupt is sent to the kernel layer.
  • the kernel layer processes touch operations into raw input events (including touch coordinates, time stamps of touch operations, and other information). Raw input events are stored at the kernel level.
  • the application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch and click operation, and the control corresponding to the click operation is the control of the camera application icon as an example, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer.
  • the camera 193 captures a still image or a video.
  • FIG. 3 is a structural diagram of a stylus system provided in the present application.
  • the stylus system 30 includes a stylus 30 and a terminal 31.
  • the terminal 31 may be the electronic device 100 in FIG. 1 described above.
  • the stylus is an active capacitive stylus.
  • the active capacitive stylus may include: a power source 301, a power management unit (PMU) 302, a microcontroller unit (MCU) 303, a driving unit 304, a pressure sensor 305, and a pen tip 306.
  • the power source 301 may be a rechargeable lithium battery or a replaceable standard battery.
  • the power management unit 302 may include an adaptive universal serial bus (USB-compatible) pulse width modulation (PMW) charging circuit, a multiple DC-DC converter (Buck DC-DC converter), and an LCD backlight. Drive circuit lights, etc.
  • the power management unit 302 can provide power required by the micro control unit 303, the driving unit 304, the pressure sensor 305, and the like of the stylus 30.
  • the micro-control unit 303 can be used to generate capacitive pen excitation signals, receive and analyze pressure data reported by the pressure sensor 305, detect functions of button states, and manage power mode switching and other functions.
  • the pressure sensor 305 can be used to detect the pressure data of the pen tip of the stylus and report the detected pressure data on the pen tip of the stylus 30 to the micro control unit 303.
  • the driving unit 304 can be used to provide a voltage driving signal to the stylus pen tip. After receiving the voltage driving signal, the stylus pen tip can output signals that can be detected by the terminal, such as electrical signals. When the pen tip is close to the terminal, the terminal can The electrical signal output by the pen tip is detected, that is, the terminal detects the input signal of the stylus.
  • the terminal After the terminal detects the input signal of the stylus, the terminal can determine the specific position of the pen tip 306 of the stylus 30 on the touch sensor 311 of the terminal 31 through the touch chip.
  • the stylus pen tip can continuously send out signals, such as electrical signals, the stylus pen tip can continuously send out low-frequency signals (for example, signals between 30KHz to 70KHz), and the stylus pen tip signal can include the pen tip Information such as the pressure you feel, the key state of the pen, and the pen's ID serial number.
  • the pen and terminal can be connected via Bluetooth, wifi, zigbee, etc. After the stylus detects the touch of the pen tip to the touch screen, it can tell the terminal to adjust the frequency of stylus detection via Bluetooth and turn on memorandum.
  • the terminal 31 may include a touch sensor 311, a display screen 312, a touch chip 313, a graphics processing unit (GPU) 314, and an application processor (AP) 315.
  • the touch chip 312 can determine the capacitance signal detected by the touch sensor 311 and the position where the capacitance signal is detected and report it to the application processor 315.
  • the display screen 312 may be the display screen 194 in FIG. 1 described above, and details are not described herein again.
  • the touch sensor 311 can be used to detect a capacitance signal generated by a proximity operation of the stylus 30 or a capacitance signal generated by a touch operation of a finger, and a capacitance signal generated when the stylus 30 is brought close to a touch screen or a finger.
  • the capacitance value signal generated by the touch operation is uploaded to the stylus touch chip 313.
  • FIG. 4 illustrates a screen 40 of a terminal provided in the present application.
  • the screen 40 of the terminal may include a protective glass, a touch sensor, a display screen, and a bottom plate.
  • the touch sensor and the display screen may form a touch screen.
  • FIG. 1 illustrates a device embodiment shown in FIG. 1 above, and details are not described herein.
  • the touch sensor 50 may include an X-axis electrode layer and a Y-axis electrode layer.
  • the X-axis electrode layer may include a plurality of transmit (Tx) electrodes distributed in a matrix
  • the Y-axis electrode layer may include a plurality of receive (Rx) electrodes distributed in a matrix.
  • the terminal can detect the touch operation of a finger by self-capacitance detection and mutual-capacitance detection of a touch screen.
  • the terminal can detect the input operation of the stylus by mutual touch detection of the touch screen.
  • the transmit (Tx) electrode and the receive (Rx) electrode on the touch sensor 50 of the terminal form a crisscross network, and a mutual capacitance is formed at the intersection (that is, the coordinate point) of the Tx electrode and the Rx electrode. (That is, the capacitance formed by the Tx electrode and the adjacent Rx electrode).
  • the touch chip connected to the touch screen on the terminal sends an excitation signal at each Tx electrode in turn, and then the touch chip scans each to receive Rx.
  • the touch chip converts the measured voltage value into a digital signal and calculates the capacitance value.
  • the finger When a finger touches the touch screen, the finger will absorb a part of the excitation signal from the Tx electrode. As a result, the signal received on the Rx electrode will be weakened, which can be calculated according to the capacitance change of each coordinate point on the touch sensor. Display the touch position information of the finger.
  • the detection method of the stylus by the terminal is a mutual capacitance detection method.
  • the tip of the stylus can replace the Tx electrode on the touch screen when the stylus pen sends out a signal, and the Tx electrode on the touch screen and the original Some Rx electrodes alternately sense the emission signal of the stylus in the horizontal (X-axis) and vertical (Y-axis) directions on the touch screen.
  • the mutual capacitance value of the contact point of the stylus received by the terminal is the coupling capacitance between the stylus pen tip and the Tx electrode or Rx electrode on the touch screen. In this way, the terminal can locate the intersection of the capacitance peaks on the X axis and the Y axis to obtain the position information of the stylus pen tip on the touch screen.
  • the mutual capacitance detection frequency may refer to that the touch screen collects the capacitance value (that is, the mutual capacitance value) between the Tx electrode and the Rx electrode of each touch point on the touch screen, and reports the mutual capacitance on the touch screen.
  • the capacitance value gives the frequency of the touch chip.
  • the 120Hz frequency mutual capacitance detection may refer to a touch screen collecting a mutual capacitance value between a transmit (Tx) electrode and a receive (Rx) electrode at each electrode crossing point on the touch screen, and The frequency at which the mutual capacitance value of each electrode crossing point is reported to the touch chip is 120 Hz.
  • the mutual capacitance detection frequency may also refer to a processing frequency at which the touch chip calculates the coordinate position of the touch point according to the mutual capacitance value of each electrode crossing point.
  • the 120Hz frequency mutual capacitance detection can also refer to the touch screen reporting the mutual capacitance value of the Tx electrode and the Rx electrode at the intersection of each electrode on the touch screen to the touch chip, and the touch chip uses a 120Hz processing frequency according to each The mutual capacitance value of the Tx electrode and the Rx electrode at the electrode crossing point is used to calculate the coordinate position of the touch point.
  • the terminal self-capacitance detects a user's touch operation on the touch screen the Tx electrode and the Rx electrode on the touch screen form a capacitance with the ground, that is, self-capacitance.
  • the Tx electrode and the Rx electrode form a crisscross network.
  • the capacitance of the finger will be superimposed on the screen body capacitance (self-capacitance formed by Tx electrode and ground, or self-capacitance formed by Rx electrode and ground) of the touch screen, so that the capacitance of the screen body is changed. .
  • the terminal When the terminal scans and detects the self-capacitance of the upper electrodes of each coordinate point on the touch screen, the terminal sequentially detects the Tx electrode and the Rx electrode array respectively. According to the change in capacitance before and after the touch, the lateral (Tx electrode arrangement can be determined separately) Direction) coordinates and longitudinal (Rx electrode arrangement direction) coordinates, and then form touch coordinates of a two-dimensional plane.
  • the self-capacitance detection frequency may refer to the frequency at which the touch screen collects the self-capacitance value between the electrodes of each touch point on the touch screen and reports the mutual capacitance value on the touch screen to the touch chip.
  • the 120Hz frequency self-capacitance detection may refer to the frequency at which the touchscreen collects the self-capacitance value of each electrode on the touchscreen and reports the self-capacitance value of each electrode to the touch-control chip at 120Hz.
  • the self-capacitance detection frequency may also refer to a processing frequency at which the touch chip calculates the coordinate position of the touch point according to the self-capacitance value of each electrode.
  • the 120Hz frequency mutual capacitance detection can also refer to the touch screen reporting the self-capacitance value of each electrode on the touch screen to the touch chip, and the touch chip calculates the touch point based on the self-capacitance value of each electrode at a processing frequency of 120 Hz. Coordinate position.
  • the following describes three detection states of the terminal for a user's finger touch input operation on the touch screen in the embodiments of the present application: an active state, an idle state, and a sleep state. among them,
  • the terminal uses the touch detection state of 120Hz frequency mutual capacitance detection and 120Hz frequency self-capacitance detection to detect the user's touch input operation on the touch screen.
  • Idle state In the Idle state, the terminal uses the touch detection state of 1Hz frequency mutual capacitance detection and 120Hz frequency self-capacitance detection to detect the user's touch input operation on the touch screen.
  • Sleep state In the Sleep state, the terminal does not detect the user's touch input operation on the touch screen.
  • the terminal when the terminal detects an input signal of a stylus pen and an input signal of a finger touch, the terminal may adopt a detection method of time division multiplexing.
  • one detection period of detecting the capacitive signal on the touch sensor at the terminal is 33.34ms, and one period can be divided into two signal detection time intervals, that is, the specific time period of the two signal detection time intervals in one period can be Signal detection time interval A: 0 ⁇ 16.67ms, pulse signal time interval B: 16.68ms ⁇ 33.34ms.
  • the terminal can detect the input signal of the stylus by using the signal detection time interval A, and the terminal can detect the touch input of the user by using the signal detection time interval B.
  • the terminal may also detect an input signal of the stylus pen and an input signal of a finger touch through two separate touch chips.
  • the terminal When the terminal is set at the factory, the terminal turns on the stylus function by default, and the terminal can scan and detect the input signal of the stylus through the first frequency (for example, 5 Hz) of the touch screen. After the terminal receives the input signal of the stylus pen through the touch screen, the terminal can switch to the second frequency (for example, 480 Hz) to scan the input signal state of the stylus pen to realize smooth writing on the terminal by the stylus pen.
  • the first frequency for example, 5 Hz
  • the terminal After the terminal receives the input signal of the stylus pen through the touch screen, the terminal can switch to the second frequency (for example, 480 Hz) to scan the input signal state of the stylus pen to realize smooth writing on the terminal by the stylus pen.
  • the second frequency for example, 480 Hz
  • FIG. 6, 6a, 6b, and 6c in FIG. 6 show an initial touch detection state and a stylus frequency detection state of the terminal after the factory setting.
  • the user has not used a stylus.
  • the terminal in the Active-5Hz state, can use the 120Hz mutual capacitance detection frequency and the 120Hz self-capacitance detection frequency to detect the input signal of the user's touch operation through the touch screen, and the terminal can use 5Hz scanning detection The frequency detects the input signal of the stylus through the touch screen.
  • the terminal in the Idle-5Hz state, can use the 1Hz mutual capacitance detection frequency and the 120Hz self-capacitance detection frequency to detect the touch operation input signal through the touch screen, and the terminal can use the 5Hz scanning detection frequency
  • the input signal of the stylus is detected through the touch screen.
  • the terminal in the Sleep-5Hz state, may not detect an input signal of a user's touch operation on the touch screen, and the terminal may use a 5Hz scanning detection frequency to detect the stylus by the touch screen. input signal.
  • the scanning detection state of the touch screen of the terminal may be an Active-5 Hz state as shown in 6a in FIG. 6. If the terminal can be in the Active-5Hz state shown in 6a in FIG. 6, if the duration of the input signal of the terminal without detecting the user's touch operation is greater than a preset time (for example, 30 seconds, 1 minute, 2 minutes, or Longer), the terminal may switch from the Active-5 Hz state shown in 6a in FIG. 6 to the Idle-5 Hz state shown in 4b in FIG. 4.
  • a preset time for example, 30 seconds, 1 minute, 2 minutes, or Longer
  • the terminal may switch from the Idle-5Hz state shown at 6b in FIG. 6 to 6a in FIG. 6 Active-5Hz status shown.
  • the terminal may switch from the Idle-5Hz state shown at 6b in FIG. 6 to the Sleep-5Hz state shown at 6c in FIG. 6.
  • the terminal may not detect the input signal of the user's touch operation, and the terminal may detect the input signal of the stylus pen through the touch screen with a scanning detection frequency of 5 Hz.
  • the terminal is in the Active-5Hz state shown in 6a in FIG. 6 or the Idle-5Hz state shown in 6b in FIG. 6, if the terminal receives the user's screen-off operation (such as a single When pressing the power button), the terminal can switch from Active-5Hz state or Idle-5Hz state to Sleep-5Hz state.
  • the terminal when the terminal is in the Sleep-5Hz state as shown in 6c in FIG. 6, if the terminal receives the user's bright screen operation (such as pressing the power button once when the screen is off), the terminal You can switch from Sleep-5Hz state to Active-5Hz state.
  • the terminal When the terminal is in the Active-5Hz state shown in 6a, the Idle-5Hz state shown in 6b, or the Sleep-5Hz state shown in 6c, if the terminal detects a stylus input signal, the terminal can switch to FIG. 7 Active-480Hz state shown in 7a of.
  • FIG. 7a, 7b, and 7c in FIG. 7 show several detection states of the terminal after the stylus input has been received.
  • the terminal in the Active-480Hz state, can use the 120Hz mutual capacitance detection frequency and the 120Hz self-capacitance detection frequency to detect the input signal of the touch operation through the touch screen, and the terminal can use the 480Hz scanning detection frequency To detect the input signal of the stylus through the touch screen.
  • the terminal in the Idle-60Hz state, can use the 1Hz mutual capacitance detection frequency and the 120Hz self-capacitance detection frequency to detect the input signal of the touch operation, and the terminal can use the 60Hz scanning detection frequency through the touch screen. To detect the input signal of the stylus.
  • the terminal may not detect the input signal of the user's touch operation on the touch screen, and the terminal may use the 5Hz scanning detection frequency to detect the stylus by the touch screen. input signal.
  • the scanning detection state of the touch screen of the terminal may be switched to the Active-480Hz state of the terminal as shown in 7a in FIG. 7.
  • the terminal can switch from the Active-5Hz state to the Active-480Hz state, that is, the terminal will write Pen detection frequency increased from 5Hz to 480Hz.
  • the terminal can switch from the Idle-5Hz state to the terminal shown in 7a in FIG.
  • Active-480Hz state that is, the terminal can switch the detection state of finger touch from Idle state to Active state, and increase the detection frequency of the stylus from 5Hz to 480Hz.
  • the terminal can switch from the Sleep-5Hz state to the Active-480Hz state, that is, the terminal can switch The detection state of the finger touch was switched from the Sleep state to the Active state, and the detection frequency of the stylus pen was increased from 5 Hz to 480 Hz.
  • the terminal When the terminal is in the Active-480Hz state shown in 7a in FIG. 7, if the terminal does not detect the stylus input signal through the touch screen and does not detect the user's touch input signal through the touch screen, the duration is greater than the preset time (For example, 30 seconds, 1 minute, 2 minutes, or longer), the terminal can switch from the Active-480Hz state shown in 7a in FIG. 7 to the Idle-60Hz state shown in 7b in FIG. 7.
  • the preset time For example, 30 seconds, 1 minute, 2 minutes, or longer
  • the terminal When the terminal is in the Idle-60Hz state shown in 7b in FIG. 7, if the terminal does not detect the input signal of the stylus through the touch screen and does not detect the input signal of the user's touch operation through the touch screen, the duration is longer than a preset At the time (for example, 30 seconds, 1 minute, 2 minutes, or longer), the terminal can switch from the Idle-60Hz state shown in 7b in FIG. 7 to the Sleep-5Hz state shown in 7c in FIG. 7. In a possible case, when the terminal is in the Idle-60Hz state shown in 7b in FIG.
  • the terminal can switch from the Idle-60Hz state shown in 7b in FIG. 7 to the Active-480Hz state shown in 7a in FIG. 7.
  • the terminal when the terminal is at a high frequency (for example, 480Hz) to detect the input signal of the stylus, if the input signal of the stylus is not detected for a period of time (for example, 30s to 60s), the terminal can reduce the detection frequency to an intermediate frequency (for example, 60Hz) , Waiting for the input signal of the stylus to come again, so that when the input signal of the stylus comes again, the terminal can quickly respond and quickly perform actions corresponding to the input signal of the stylus coming again, thereby improving the user experience. For example, when writing again after the stylus is temporarily paused, the terminal can quickly record the writing handwriting of the stylus to ensure the consistency of the writing handwriting of the stylus and improve the user's writing experience.
  • a high frequency for example, 480Hz
  • the terminal When the terminal is in the Active-480Hz state shown in 7a in FIG. 7 or in the Idle-60Hz state shown in 7b in FIG. 7, if the terminal receives the user's screen-off operation (such as pressing the power button once), The terminal can switch from the Active-480Hz state shown in 7a in FIG. 7 or the Idle-60Hz state shown in 7b in FIG. 7 to the Sleep-5Hz state shown in 7c in FIG. 7.
  • the terminal When the terminal is in the Sleep-5Hz state shown in 7c in FIG. 7, if the terminal detects the input signal of the stylus pen through the touch screen, the terminal can switch from the Sleep-5Hz state shown in 7c in FIG. 7 to FIG. 7 Active-480Hz state shown in 7a.
  • the terminal when the terminal is in the Sleep-5Hz state shown at 7c in FIG. 7, if the terminal receives the user's bright screen operation (such as pressing the power button once when the terminal is off), the terminal can From the Sleep-5Hz state shown at 7c in FIG. 7, it is switched to the Active-480Hz state shown at 7a in FIG. 7.
  • the terminal when the terminal is in the Active-5Hz state shown in 6a, the Idle-5Hz state shown in 6b, or the Sleep-5Hz state shown in 6c, if the terminal detects the stylus input Signal, the terminal can switch to the Active-480Hz state shown by 8a in FIG.
  • 8a, 8b, and 8c in FIG. 8 show several detection states of the terminal after receiving a user's stylus input.
  • the terminal in the Active-480Hz state, can use the 120Hz mutual capacitance detection frequency and the 120Hz self-capacitance detection frequency to detect the input signal of the user's touch operation through the touch screen, and the terminal can use 480Hz scanning detection Frequency to detect the input signal of the stylus through the touch screen.
  • the terminal in the Active-60Hz state, can use the 120Hz mutual capacitance detection frequency and the 120Hz self-capacitance detection frequency to detect the input signal of the user's touch operation through the touch screen, and the terminal can use 60Hz scanning detection Frequency to detect the input signal of the stylus through the touch screen.
  • the terminal in the Idle-480Hz state, can use the 1Hz mutual capacitance detection frequency and the 120Hz self-capacitance detection frequency to detect the input signal of the user's touch operation, and the terminal can use the 480Hz scanning frequency to pass the touch.
  • the screen detects the input signal of the stylus.
  • the terminal in the Idle-60Hz state, can use the 1Hz mutual capacitance detection frequency and the 120Hz self-capacitance detection frequency to detect the input signal of the user's touch operation, and the terminal can use the 60Hz scanning detection frequency to pass the touch. Screen to detect the input signal of the stylus.
  • the duration is greater than a preset time (for example, 30 seconds, 1 minute, 2 minutes, or more). Long), the terminal can switch from the Active-480Hz state shown in 8a in FIG. 8 to the Active-60Hz state shown in 8b in FIG. 8.
  • the duration is greater than a preset time (for example, 30 seconds, 1 minute, 2 minutes, or longer)
  • the terminal can switch from the Active-480Hz state shown in 8a in FIG. 8 to the Idle-480Hz state shown in 8c in FIG. 8.
  • the terminal When the terminal is in the Active-60Hz state shown in 8b in FIG. 8 and the terminal does not detect the duration of the input signal of the user's touch operation through the touch screen for a period longer than the fifth time, the terminal may select The Active-60Hz state is switched to the Idle-60Hz state shown in 8d in FIG. 8. In a possible case, when the terminal is in the Active-60 Hz state shown in 8b in FIG. 8, if the terminal detects the input signal of the stylus via the touch screen, the terminal may use the Active- 60Hz state, switch to Active-480Hz state shown in 8a in Figure 8.
  • the terminal When the terminal is in the Idle-480Hz state shown in 8c in FIG. 8 and the terminal does not detect the input signal of the stylus through the touch screen for a longer time than a preset time (for example, 30 seconds, 1 minute, 2 minutes, or longer) At this time, the terminal can switch from the Idle-480Hz state shown in 8c in FIG. 8 to the Idle-60Hz state shown in 8d in FIG. 8.
  • a preset time for example, 30 seconds, 1 minute, 2 minutes, or longer
  • the terminal can switch from the Idle-480Hz state shown in 8c in FIG. 8 to the Idle-60Hz state shown in 8d in FIG. 8.
  • the terminal may use the Idle shown in 8c in FIG. 8
  • the -60Hz state is switched to the Active-480Hz state shown at 8a in FIG. 8.
  • the terminal When the terminal is in the Idle-60Hz state shown in 8d in FIG. 8, if the terminal detects the input signal of the user's touch operation through the touch screen, the terminal can switch from the Idle-60Hz state shown in 8d in FIG. 8 to FIG. 8 The state of Active-60Hz shown in 8b.
  • the terminal when the terminal is in the Idle-60Hz state shown in 8d in FIG. 8, if the terminal detects a stylus input signal through the touch screen, the terminal may use the Idle- shown in 8d in FIG. 8- 60Hz state, switch to Idle-480Hz state shown in 8c in Figure 8.
  • the terminal when the terminal is in the Idle-60Hz state shown in 8d in FIG.
  • the terminal does not detect the input signal of the stylus through the touch screen and does not detect the user ’s touch operation through the touch screen.
  • the terminal can switch from the Idle-60Hz state shown in 8d in Figure 8 to the Sleep-5Hz state (the Sleep-5Hz state It is not shown in FIG. 8 and reference may be made to 7c) in FIG. 7.
  • the terminal When the terminal is in the Active-480Hz state shown in 8a in FIG. 8, or in the Active-60Hz state shown in 8b in FIG. 8, or in the Idle-480Hz state shown in 8c in FIG. 8, or in 8d in FIG. 8
  • the terminal can switch from the Active-480Hz state shown in 8a in FIG. 8 or 8b in FIG. 8
  • the Active-60Hz state, or the Idle-480Hz state shown at 8c in FIG. 8 is switched to the Sleep-5Hz state (the Sleep-5Hz state is not shown in FIG. 8, please refer to 7c in FIG. 7).
  • the terminal When the terminal is in the Sleep-5Hz state (the Sleep-5Hz state is not shown in FIG. 8 and can be referred to 7c in FIG. 7), if the terminal detects a stylus input signal through the touch screen, the terminal can Sleep-5Hz state, switch to Active-480Hz state shown in 8a in Figure 8.
  • the terminal when the terminal is in the Sleep-5Hz state (the Sleep-5Hz state is not shown in FIG. 8, refer to 7c in FIG. 7), if the terminal receives a bright screen operation of the user (such as Press the power button once when the screen is off), the terminal can switch from the Sleep-5Hz state to the Active-480Hz state shown in 8a in Figure 8.
  • FIG. 9 a in FIG. 9 shows a main interface 910 that the terminal has enabled a stylus function and is displayed in an Active-5 Hz state.
  • the main interface 910 may include an icon for setting an application 911 and other applications (for example, Alipay, notepad, music, WeChat, camera, dialer, information, contacts, etc.).
  • the terminal may receive a user's touch operation 912 (for example, a click) on the set application icon 911 on the main interface 910.
  • the terminal may display a setting interface as shown in 9b in FIG. 9 on the touch screen 920.
  • the terminal may store an event that the terminal detects the stylus input signal in the memory. For example, when the terminal can store a 1-bit field in the memory, the terminal detects handwriting. In the event of a pen input signal, if the value of the 1-bit field is 1, it indicates that the terminal has a record of using the stylus. If the value of the 1-bit field is 0, it means that there is no use of the stylus on the terminal. recording.
  • the terminal has the stylus function turned on, and the terminal is in an Active-5 Hz state, but there is no usage record of the user using the stylus on the terminal.
  • the setting interface 920 may include a smart assistant setting field 921 and other setting fields (such as a sound setting field, a notification center setting field, an application management setting field, a battery setting field, a storage setting field, a security and privacy setting field, and user and account settings. Bar, etc.).
  • the terminal may receive a user's touch operation 922 (for example, a click) on the smart assistance setting field 921 on the setting interface 920.
  • the terminal may display the smart assistance shown in FIG. 9c on the touch screen Setting interface 930.
  • the terminal has the stylus function turned on and the terminal is in an Active-5 Hz state, but there is no record of the user's use of the stylus on the terminal.
  • the intelligent assistant setting interface 930 may include a stylus setting field 931 and other setting fields (such as a smart screen setting field, a one-handed operation setting field, a gesture control setting field, a voice control setting field, a holster mode setting field, and a glove mode. Settings bar, timer switch settings bar, etc.).
  • the stylus setting field 931 is associated with a stylus setting control 932. In 9c of FIG. 9, the stylus setting control 932 is turned on, that is, the stylus function is enabled on the terminal.
  • the terminal can receive a user's touch operation 933 (eg, click) on the stylus setting control 932 on the smart assist setting interface 930.
  • the terminal turns off the stylus function, and the terminal switches from the Active-5 Hz state as shown in FIG. 9 Active-0Hz state shown in 9d.
  • the stylus setting control 942 is turned off, that is, the terminal has the stylus function turned off, and the terminal does not detect the stylus input signal after the stylus function is turned off.
  • the terminal can detect the input signal of the user's touch operation through the touch screen using the 120 Hz mutual capacitance detection frequency and the 120 Hz self-capacitance detection frequency, and the terminal may not detect the input signal of the stylus. If the terminal is in this Active-0Hz state, and the terminal does not detect that the duration of the user's touch operation is longer than the first time (for example, 30 seconds, 1 minute, 2 minutes, or longer), the terminal can switch from Active-0Hz state to Idle -0Hz state.
  • the first time for example, 30 seconds, 1 minute, 2 minutes, or longer
  • the terminal can use the 1Hz mutual capacitance detection frequency and 120Hz self-capacitance detection frequency to detect the input signal of the user's touch operation through the touch screen, and the terminal may not detect the input signal of the stylus.
  • the terminal In the Idle-0Hz state, if the terminal does not detect the duration of the input signal of the user ’s touch operation is longer than the second time (for example, 30 seconds, 1 minute, 2 minutes, or longer), the terminal can switch from the Idle-0Hz state to Sleep-0Hz state. In this Sleep-0 Hz state, the terminal does not detect the input signal of the user's touch operation, nor does it detect the input signal of the stylus.
  • the terminal when the terminal is in the Idle-0Hz state or the Sleep-0Hz state, if the terminal receives the user's off-screen operation (such as a single press of the power button), the terminal can be in the Active-0Hz state, or The Idle-0Hz state is switched to the Sleep-0Hz state. In a possible case, the terminal is in the Sleep-0Hz state as shown in 4c in FIG. 4. If the terminal receives the user's bright screen operation (such as pressing the power button once when the screen is off), the terminal You can switch from Sleep-0Hz state to Active-0Hz state.
  • the terminal receives the user's bright screen operation (such as pressing the power button once when the screen is off)
  • the terminal You can switch from Sleep-0Hz state to Active-0Hz state.
  • FIG. 10 shows a main interface 1010 displayed on the terminal under a stylus function and in an Active-480 Hz state.
  • the main interface 1010 may include an icon 1011 for setting applications and other applications (for example, Alipay, notepad, music, WeChat, camera, dialer, information, contacts, etc.).
  • the terminal may receive an input operation 1012 (for example, a click of the stylus pen tip) for setting an application icon 1011 on the main interface 1010 by the pen tip of the stylus pen.
  • the terminal may display a touch screen as shown in FIG. 10
  • the setting interface 1020 is shown in 10b.
  • the terminal has the stylus function enabled, and the terminal is in an Active-480 Hz state.
  • the setting interface 1020 may include a smart assistance setting field 1021 and other setting fields (such as a sound setting field, a notification center setting field, an application management setting field, a battery setting field, a storage setting field, a security and privacy setting field, and user and account settings. Bar, etc.).
  • the terminal may receive an input operation 1022 (for example, a click of the stylus pen tip) of the stylus pen tip on the smart assist setting field 1021 on the setting interface 1020, and in response to the input operation 1022, the terminal may display a touch screen as shown in FIG. 10
  • the smart assistant setting interface 1030 shown in 10c.
  • the terminal has the stylus function turned on, and the terminal is in the Active-480Hz state, and the terminal has a record of the use of the stylus, that is, the terminal has received an input signal from the stylus (such as input operation 1012 or input Input signal generated by operation 1022).
  • the setting interface 1030 may include a stylus setting field 1031 and other setting fields (such as a smart screen setting field, a one-handed operation setting field, a gesture control setting field, a voice control setting field, a holster mode setting field, and a glove mode setting field. , Timer switch settings bar, etc.).
  • the stylus setting field 1031 is associated with a stylus setting control 1032. In 10c of FIG.
  • the stylus setting control 1032 is turned on, that is, the stylus function is enabled on the terminal.
  • the terminal may receive an input operation 1033 (for example, a click of the stylus pen tip) of the stylus pen pen on the stylus setting control 1032 on the smart assist setting interface 1030, and in response to the input operation 1033, the terminal turns off the stylus function, and the terminal starts from Active- The 480Hz state is switched to the Active-0Hz state as shown at 10d in FIG. 10.
  • the stylus setting control 1042 is turned off, that is, the terminal has the stylus function turned off, and the terminal does not detect the stylus input signal after the stylus function is turned off.
  • FIG. 11 shows a setting interface 1110 displayed when the terminal has the stylus function turned off and is displayed in an Active-0 Hz state.
  • the terminal There is no record of using the stylus on the terminal, that is, the terminal has not received the input signal of the stylus.
  • the terminal uses the touch detection state of 120Hz frequency mutual capacitance detection and 120Hz frequency self-capacitance detection to detect the user's touch input operation on the touch screen, and the touch sensor on the touch screen of the terminal does not touch the touch.
  • the control chip reports the input signal of the stylus to cause the capacitance value change of each electrode on the touch sensor.
  • the setting interface 1110 may include a stylus setting field 1111 and other setting fields (such as a smart screen setting field, a one-handed operation setting field, a gesture control setting field, a voice control setting field, a holster mode setting field, and gloves Mode setting bar, timer switch setting bar, etc.).
  • the stylus setting column 1111 is associated with a stylus setting control 1112.
  • the stylus setting control 1112 is turned off, that is, the stylus function is turned off on the terminal.
  • the terminal can receive a user's touch operation (such as a finger tap) on the stylus setting control 1112 on the smart assist setting interface 1110.
  • the terminal can switch from Active-0 Hz Go to Active-5Hz state as shown by 11b in FIG. 11.
  • the stylus setting control 1122 is turned on in the intelligent auxiliary setting interface 1120 shown in FIG. 11b, that is, the stylus function is turned on in the terminal.
  • the 11c in FIG. 11 shows a setting interface 1130 that the terminal has the stylus function turned off and is displayed in an Active-0 Hz state.
  • the terminal has a record of using the stylus, that is, the terminal has received an input signal from the stylus.
  • the setting interface 1130 may include a stylus setting field 1131 and other setting fields (such as a smart screen setting field, a one-handed operation setting field, a gesture control setting field, a voice control setting field, a holster mode setting field, and gloves Mode setting bar, timer switch setting bar, etc.).
  • the stylus setting field 1131 is associated with a stylus setting control 1132. In 11c of FIG. 11, the stylus setting control 1132 is turned off, that is, the stylus function is turned off on the terminal.
  • the terminal can receive the user's input operation (such as a finger tap) on the stylus setting control 1132 on the smart assist setting interface 1130. Since the terminal has a record of the use of the stylus, in response to the input operation 1132, the terminal can switch from the Active-0 Hz state Go to Active-480Hz state as shown by 11d in FIG. 11.
  • the stylus setting control 1142 is turned on in the intelligent assistant setting interface 1140 shown in 11d in FIG. 11, that is, the stylus function is turned on in the terminal.
  • FIG. 12 shows a restart interface 1210 displayed by the terminal in an Active-5 Hz state.
  • the restart interface 1210 includes a restart button 1211 and a shutdown button 1212.
  • the terminal can receive a user's touch operation 1213 (for example, a finger click) on the restart button 1211 on the restart interface 1210.
  • the terminal can restart.
  • the terminal can be as shown in 12b in FIG. 12 Active-5Hz status.
  • FIG. 12c shows a restart interface 1230 displayed by the terminal in an Active-480Hz state.
  • the terminal has a record of using the stylus, that is, the terminal has received an input signal from the stylus.
  • the restart interface 1230 includes a restart button 1231 and a shutdown button 1232.
  • the terminal can receive the stylus input operation 1233 (such as a click on the stylus pen tip) on the restart button 1231 on the restart interface 1230.
  • the terminal can restart. After the restart, the terminal can be shown as 12d in FIG. 12 Active-480Hz.
  • FIG. 13 a in FIG. 13 shows a factory reset interface 1310 displayed by the terminal in an Active-5 Hz state.
  • the factory reset interface 1310 includes a factory reset button 1311.
  • the terminal can receive a user's touch operation 1312 (eg, a finger click) on the factory reset button 1311, and in response to the touch operation 1312, the terminal can perform a factory reset.
  • the factory reset of the terminal can include all network settings, fingerprints, face information, lock screen password, stylus function settings, etc. After restoring the factory settings, the terminal can be in the Active-5 Hz state shown at 13b in FIG. 13. In the Active-5 Hz state shown at 13b in FIG. 13, there is no record of the use of the stylus on the terminal.
  • FIG. 13c shows the factory reset interface 1330 displayed by the terminal in the Active-480Hz state.
  • the terminal has a record of using the stylus, that is, the terminal received an input signal of the stylus before displaying the interface shown in 13c in FIG. 13.
  • the factory reset interface 1330 includes a factory reset button 1331.
  • the terminal can receive the stylus input operation 1332 (such as a click of the stylus pen tip) on the factory reset button 1331 on the factory reset interface 1330, and in response to the input operation 1332, the terminal can perform the factory reset.
  • the factory reset of the terminal can include all network settings, fingerprints, face information, lock screen password, stylus function settings, etc. After restoring the factory settings, the terminal can be in the Active-5 Hz state shown at 13d in FIG. 13. In the Active-5 Hz state shown by 13d in FIG. 13, there is no record of using the stylus on the terminal.
  • FIG. 14 a in FIG. 14 shows the touch screen 1410 of the terminal in the Sleep-5 Hz state.
  • the touch screen 1410 may be a touch screen when the terminal is in the Sleep-5 Hz state shown in 6c in FIG. 6 or 7c in FIG. 7.
  • 14a in FIG. 14 also shows a stylus 1411 having keys 1412 on the stylus 1411.
  • a key 1412 on the stylus 1411 can receive a user's input operation 1413 (for example, a long press). When the key 1412 is pressed, the signal output by the pen tip of the stylus will change.
  • the terminal may receive an input operation 1414 (for example, a pen point click) of the stylus 1411 on the touch screen 1410 by a user long-pressing a button 1412, and in response to the input operation 1414 (for example, a pen point click), the terminal may detect the stylus
  • the terminal can switch from the Sleep-5Hz state to the Active-480Hz state, that is, the terminal detects the input signal of the stylus at 480Hz, and displays a memo edit as shown in 14b of FIG. 14 on the touch screen. Interface 1420.
  • the terminal can receive the user's writing operation 1423 on the memo editing interface 1420 using the stylus 1421, and in response to the writing operation 1423, the terminal can recognize the writing content of the writing operation 1423 through picture recognition ( Such as text), and save the writing.
  • the terminal is not limited to 14a shown in FIG. 14.
  • the terminal may also receive the pressed button 1414 when the touch screen is on the bright screen, the lock screen, or the main interface and the APP application interface are displayed on the touch screen.
  • the input operation 1414 of the stylus 1411 (for example, the pen tip is clicked on the screen).
  • the terminal can automatically open an app that can perform text or graffiti input, such as WeChat, SMS, and browser.
  • the terminal can enter the memo editing interface and record the writing operation of the stylus.
  • the pen tip can output a different signal from that before the key 1412, and the signal output by the pen tip can be an electrical signal (for example, a signal with a frequency between 30KHz to 70KHz),
  • the signal output by the pen tip may include information such as the pressure felt by the pen tip, the key state of the stylus, and the pen ID serial number.
  • the pen and the terminal may be connected in a manner such as Bluetooth. After the stylus detects the contact of the pen tip with the touch screen, it can tell the terminal to adjust the detection frequency of the stylus via Bluetooth and open the memo.
  • 14c in FIG. 14 shows the touch screen 1430 of the terminal in the Sleep-5Hz state.
  • the touch screen 1430 may be a touch screen when the terminal is in the Sleep-5 Hz state shown in 6c in FIG. 6 or 7c in FIG. 7.
  • 14c in FIG. 14 also shows a stylus 1431 having keys 1432 on the stylus 1431.
  • the key 1432 on the stylus 1431 can receive a user's input operation 1433 (for example, long press).
  • the terminal can receive the input operation 1434 (such as a pen point click) of the stylus pen 1431 on the touch screen 1430 by the user long-pressed the key 1432.
  • the terminal can switch from the Sleep-5Hz state Switch to the Sleep-480Hz state as shown in 14d of FIG. 14. In this Sleep-480Hz state, the terminal can save the writing handwriting 1443 of the stylus 1441.
  • the terminal may respond to the writing operation 1423 and save the writing handwriting of the writing operation 1423 in the form of a picture.
  • the terminal may respond to the writing operation 1423 and save the writing handwriting of the writing operation 1423 in the form of a picture.
  • the terminal when the terminal is off the screen, when the user presses a key on the stylus and clicks the touch screen of the terminal with the stylus, the user can quickly record the content written by the user on the touch screen with the stylus. Provide users with a fast-recording experience.
  • 15 a in FIG. 15 shows a main interface 1510 displayed by the terminal in an Active-480 Hz state.
  • the main interface 1510 may include one or more application (for example, Alipay, notepad, music, WeChat, settings, camera, dialer, information, contacts, etc.) icons.
  • a key 1512 on the stylus pen 1511 can receive a long-press operation 1513 by the user.
  • the terminal can receive an input operation 1514 (such as a long press of the pen tip) on the main interface of the stylus 1511 by the user long-pressing the key 1512.
  • the terminal can turn on the smart screen.
  • the interface of the screen can be shown as 15b in FIG. 15.
  • the smart screen interface 1520 may include a smart recognition area 1525.
  • the size of the intelligent screen area 1525 can be adjusted.
  • the terminal can recognize the text or picture in the smart screen area 1525.
  • the text in the screen area 1525 of the terminal includes "Alipay”, “Notepad”, “Music”, “WeChat”, “Settings", “Camera” Wait.
  • it is not limited to the main interface 1510 shown in 15a in FIG. 15, and the user can also use a stylus to open the smart identification screen on other interfaces, which is not limited herein. In this way, when the user presses and holds the key on the stylus pen and presses the touch screen of the terminal with the stylus pen, the smart screen recognition function can be quickly turned on, which improves the user experience.
  • 16 a in FIG. 16 shows a main interface 1610 displayed by the terminal in an Active-480 Hz state.
  • the main interface 1610 may include one or more application (for example, Alipay, notepad, music, WeChat, settings, camera, dialer, information, contacts, etc.) icons.
  • a key 1612 on the stylus pen 1611 can receive a user's long-press operation 1613.
  • the terminal may receive an input operation 1614 on the main interface of the stylus 1611 (for example, the pen tip circles out an area on the main interface), and respond to the input operation 1614 (for example, the pen tip circles out a piece on the main interface).
  • the terminal can enable the screen capture function to capture an area circled on the main interface 1610 by the tip of the stylus.
  • the screen capture interface can be shown as 16b in FIG. 16.
  • the screenshot interface 1620 may include an area 1624 circled by the tip of the stylus, a share button, an edit button, a save button, and the like.
  • the terminal can receive a double-click operation of the stylus 1611 on the main interface 1610 by the user long-pressing the button 1612.
  • the terminal can enable a screen capture function to capture the current display on the terminal's current display screen.
  • the main interface 1610. Among them, it is not limited to the main interface 1610 shown in 16a in FIG.
  • the user can also use a stylus to open the screen capture function on other interfaces, which is not limited herein.
  • a stylus to open the screen capture function on other interfaces, which is not limited herein.
  • the screen capture function can be quickly turned on, improving the user experience .
  • FIG. 17 shows a main interface 1710 displayed by the terminal in an Active-480 Hz state.
  • the main interface 1710 may include one or more application (for example, Alipay, notepad, music, WeChat, settings, camera, dialer, information, contacts, etc.) icons.
  • a key 1712 on the stylus 1711 can receive a long-press operation 1714 by the user.
  • the terminal may receive an input operation 1714 (for example, the pen tip draws a horizontal line in the center of the touch screen) of the stylus 1711 on the main interface 1610 when the user presses the key 1712 for a long time.
  • the terminal can enable the split screen function, and the interface after the terminal split screen can be shown as 17b in FIG. 17.
  • the two interfaces after the split screen may be a music playback interface 1720 and a photo album application interface 1730.
  • the user can also use the stylus to enable the split screen function on other interfaces, which is not limited herein. In this way, when the user presses a key on the stylus pen and draws a horizontal line through the center of the stylus pen on the touch screen, the split-screen function can be quickly turned on, which improves the user experience.
  • the terminal receives a user's input operation.
  • the terminal can turn off the stylus function.
  • the terminal can detect the first frequency (for example, 5 Hz). Input signal from stylus.
  • the terminal has the stylus function turned on and the terminal is in an Active-5 Hz state, but there is no record of the user's use of the stylus on the terminal.
  • the smart assistant setting interface 1810 may include a stylus setting field 1811 and other setting fields (such as a smart screen setting field, a one-handed operation setting field, a gesture control setting field, a voice control setting field, a holster mode setting field, and a glove mode Settings bar, timer switch settings bar, etc.).
  • the stylus setting column 1811 is associated with a stylus setting control 1812. In 18a of FIG. 18, the stylus setting control 1812 is turned on, that is, the stylus function is enabled on the terminal.
  • the terminal may receive a user's touch operation 1813 (for example, a click) on the stylus setting control 1812 on the smart assistant setting interface 1810.
  • the terminal turns off the stylus function and the terminal maintains an Active-5 Hz state.
  • the stylus setting control 1822 is turned off, that is, the stylus function is turned off on the terminal.
  • the terminal detects the input signal of the stylus at a detection frequency of a first frequency (for example, 5 Hz).
  • the terminal When the stylus setting control 1812 is turned off and the terminal detects an input signal of the stylus at a detection frequency of a first frequency (for example, 5 Hz), if the terminal receives an input operation (for example, clicking) of the stylus to the touch screen, In response to this input operation (such as clicking) of the stylus, the terminal detects an input signal of the stylus at a frequency of 480 Hz.
  • a detection frequency of a first frequency for example, 5 Hz
  • the terminal has the stylus function turned on, and the terminal is in an Active-480 Hz state, but there is no record of the user's use of the stylus on the terminal.
  • the intelligent assistant setting interface 1830 may include a stylus setting field 1831 and other setting fields (such as a smart screen setting field, a one-handed operation setting field, a gesture control setting field, a voice control setting field, a holster mode setting field, and a glove mode Settings bar, timer switch settings bar, etc.).
  • the stylus setting field 1831 is associated with a stylus setting control 1832. In 18c of FIG. 18, the stylus setting control 1832 is turned on, that is, the stylus function is enabled on the terminal.
  • the terminal can receive a user's touch operation 1833 (for example, a click) on the stylus setting control 1832 on the smart assistant setting interface 1830.
  • the terminal turns off the stylus function, and the terminal switches from the Active-480Hz state to Active-5Hz status.
  • the stylus setting control 1842 is turned off, that is, the terminal has the stylus function turned off. After the stylus function is turned off, the terminal can detect the stylus input at a detection frequency of 5 Hz. signal.
  • the terminal can ensure that the user can quickly respond to the user's stylus input operation when using the stylus for the first time, which improves the user experience.
  • the terminal when the terminal enables the stylus function, the terminal can verify the stylus. After the verification is successful, the terminal may execute the stylus functions shown in FIG. 14, FIG. 15, FIG. 16, and FIG. 17 described above.
  • the terminal has the stylus function turned off and is in an Active-0 Hz state.
  • the setting interface 1910 may include a smart assist setting bar 1911 and other setting bars (such as a sound setting bar, a notification center setting bar, an application management setting bar, a battery setting bar, a storage setting bar, a security and privacy setting bar, user and account settings Bar, etc.).
  • the terminal may receive a user's touch operation 1912 (eg, click) on the smart assist setting bar 1911, and in response to the touch operation 1912, the terminal may display a smart assist setting interface 1920 as shown in 19b in FIG. 19 on the touch screen.
  • the intelligent assistant setting interface 1920 may include a stylus setting field 1921 and other setting fields (such as a smart screen setting field, a one-handed operation setting field, a gesture control setting field, a voice control setting field, a holster mode setting field, and gloves Mode setting bar, timer switch setting bar, etc.).
  • the terminal may receive a user's touch operation 1922 (for example, click) on the stylus setting field 1921, and in response to the touch operation 1912 (for example, click), the terminal detects the input signal of the stylus at 480 Hz, and the terminal displays as shown in 19c in FIG. 19 Shown stylus settings interface 1930.
  • the stylus setting interface 1930 displays an introduction to the stylus function (for example, shorthand for writing a pen) and a verification popup 1940.
  • the verification popup window 1940 includes a solid circle 1941, a hollow circle 1942, and the terminal can receive the input operation 1944 of the solid circle 1941 by the stylus 1944 (such as dragging the hollow circle 1941 to the hollow circle 1942 with the pen tip). Position), in response to the input operation 1944, the terminal successfully authenticates the stylus and pops up a verification success pop-up window 1950 as shown in 19d of FIG. 19, and the verification success pop-up window 1950 can prompt the user that the stylus has been completed Verification. After the verification is successful, the terminal may execute the stylus functions shown in FIG. 14, FIG. 15, FIG. 16, and FIG. 17.
  • the terminal detects that the user's finger drags the solid circle 1941, after the user's finger drags the solid circle to a specified range (not to the position of the hollow circle 1942), the solid circle 1941 returns to the starting point .
  • the stylus pen 1943 input operation 1944 on the solid circle 1944 quit halfway, the verification failed, and when the verification interface 1930 was entered again, a verification pop-up window 1940 popped up until the stylus verification was successfully turned on.
  • the terminal can enable functions such as pen-taking shorthand. Operate the keys on the stylus to get closer to the terminal, and the terminal will automatically display the memo interface. If the verification is unsuccessful, the keys on the stylus are operated to approach the terminal, and the terminal will not automatically display the memo interface.
  • FIG. 20 is a structural diagram of a stylus pen system according to an embodiment of the present application.
  • the devices or modules designed by the stylus system in this application include stylus, touch chip, driving system, input system, event convergence layer, low-level information reading, and application software and hardware architecture.
  • the stylus of the present application is an active capacitive stylus.
  • the touch chip mainly includes chip modules such as digital front-end and analog back-end, which are responsible for processing and amplifying the capacitance value signals sent and received in the physical detection channel in the drive system.
  • the stylus can be activated as follows:
  • the stylus performs enabling operations, such as pressing physical buttons, drawing lines, clicking, and double-clicking.
  • the terminal completes the pen registration and process running in the driver system.
  • the terminal sends an incentive to the event reporting layer (event hub).
  • event reporting layer event hub
  • the event and reporting information is based on different stylus events.
  • the terminal responds to different APP applications, for example, the stylus double-clicks the screen, and the stylus clicks the screen when the key is pressed, and the terminal can launch the notepad application.
  • the terminal can start the screen capture function.
  • the stylus draws a horizontal line on the screen when a key is pressed, and the terminal can start the split screen function.
  • the terminal may start the screen recognition function.
  • FIG. 21 is a state diagram of a stylus smart switch according to an embodiment of the present application.
  • the three-state switch involved in the stylus smart switch of the present application includes S1: normal frequency detection; S2: 5Hz low frequency detection; S3: completely off.
  • the two-state choice includes C1: On (default state) and C2: Off. It is non-perceptive, corresponding to S2: 5Hz low-frequency detection.
  • FIG. 22 is a state diagram of a smart pen smart switch according to an embodiment of the present application.
  • the stylus smart switch of the present application mainly includes switching of the following scene states:
  • the initial state is low frequency detection.
  • the terminal can receive the user's input and turn off the switch.
  • the terminal When the terminal receives the user's input and turns on the switch again, the terminal can distinguish whether the user has a history of using the stylus, and if so, the terminal switches to a high-frequency detection state.
  • the terminal switches to the low-frequency detection state, that is, the initial state.
  • the terminal can turn on the stylus function when a user uses the stylus for the first time, record the stylus used by the user, and keep the input signal of the stylus detected at high frequency; there is no user on the terminal
  • the input signal of the stylus can be detected at a low frequency; when the terminal is turned on or restarted, the detection state before the startup or restart can be maintained; when the terminal is restored to the factory settings, the original state can be restored; when the terminal is turned off, handwriting
  • the pen function is used, the input signal of the stylus can not be detected; if the terminal has a record of the user using the stylus, when the terminal has the stylus function enabled, the terminal can detect the input signal of the stylus at high frequency; if no user uses handwriting on the terminal
  • the terminal can detect the input signal of the stylus at a low frequency.
  • the terminal can realize the balance between user experience and power consumption by implementing the detection
  • FIG. 23 is a working state switching diagram of a touch device according to an embodiment of the present application. As shown in FIG. 23, the working state switching diagram of the touch device can be as follows:
  • the initial state is the state Q1: Active-5Hz state, and the presence of a pen is detected at a frequency of 5Hz.
  • the stylus switch of the terminal turns on, and the touch device enters the Q4: Active-480Hz state.
  • the touch device enters Q2: Idle-5Hz state, detects the pen at 5Hz frequency, and returns to Active-5Hz state when there is a touch event.
  • the touch device enters Q3: Sleep-5Hz state, that is, the sleep state.
  • the touch device can switch from Q2: Idle-5Hz state and Q3: Sleep-5Hz state to Active-480Hz state.
  • the touch device changes from Q5: Idle-60Hz state to Sleep-5Hz state.
  • the touch device can enter Q4: Active-480Hz state from Q5: Idle-60Hz state and Q6: Sleep-5Hz state.
  • the terminal can achieve low power consumption for users with multiple fingers and stylus This kind of operation behavior is intelligently switched to ensure the user experience.
  • FIG. 24 is a state diagram of a stylus smart switch according to an embodiment of the present application.
  • the stylus function is turned off by default on the terminal.
  • the terminal can detect the input signal of the stylus at a low frequency (for example, 5 Hz). If there is no record of the user using the stylus on the terminal, the terminal keeps a low frequency (such as 5 Hz) to detect the input signal of the stylus. If there is a record of the user using the stylus on the terminal, when a pen user turns on the stylus switch, the touch device on the terminal can detect the input signal of the stylus at a normal frequency.
  • a low frequency for example, 5 Hz
  • the terminal can ensure that the user can quickly respond to the user's stylus input operation when using the stylus for the first time, thereby improving the user experience.
  • FIG. 25 is a schematic diagram of a signal output by a stylus pen according to an embodiment of the present application.
  • the signal output by the pen tip of the stylus pen can be transmitted using a fixed dual frequency point, and the pen tip can transmit the dual frequency point signals in a time-sharing manner, wherein the frequency points of the synchronization signals can be the frequencies of the synchronization signal 1 and the synchronization signal 3, respectively.
  • the value of the pulse signal ink (eg, ink1, ink2, ink3, ink4, etc.) displayed on the pen tip is 1, it means that the terminal needs to show the writing traces of the pen tip. If the pulse signal ink (eg, ink1, ink2, ink3, ink4, etc.) The value of 0 indicates that the touch screen of the pen tip on the terminal is hovering.
  • the pulse signals a0-a11 can represent the tactile sensation of 4096-level pen pressure of the stylus, and the pulse signal a12 can represent whether the key 1 on the stylus is pressed (for example, if the value of the pulse signal a12 is 1, the key 1 is pressed, the pulse If the value of the signal a12 is 0, the key 1 is not pressed), and the pulse signal a12 can indicate whether the key 1 on the stylus is pressed (for example, if the value of the pulse signal a13 is 1, the key 2 is pressed, If the value of the pulse signal a13 is 0, the button 2 is not pressed).
  • the pulse signals b0-b11 can characterize the tactile sensation of the stylus pen's 4096-level pen pressure.
  • the pulse signal b12 can indicate whether button 1 is pressed on the stylus (for example, if the value of the pulse signal b12 is 1, the button 1 is pressed, and if the value of the pulse signal b12 is 0, the button 1 is not pressed)
  • the pulse signal b12 can indicate whether button 1 on the stylus is pressed (for example, if the value of the pulse signal b13 is 1, the button 2 is pressed, and if the value of the pulse signal b13 is 0, the button 2 is not pressed. ).
  • the stylus can improve the anti-noise capability through this dual-frequency working mode, and prevent the fixed frequency from being interfered by other noise signals.
  • the terminal when the terminal detects the input signal of the stylus, the terminal may mistake the noise interference as the input signal of the stylus due to noise interference (for example, the noise interference of the terminal when charging), and Switch the frequency of stylus detection.
  • the terminal can filter the misoperation caused by noise interference.
  • the terminal can determine whether the area formed by the received coordinate position of the detected signal is smaller than a preset range. If it is smaller than the preset range, the terminal can determine that the detected signal is noise. Signal, the terminal can ignore the noise signal and not perform the action of switching the detection frequency of the stylus. For example, when the terminal detects the input signal of the stylus pen at a frequency of 5 Hz, the contact area of the pen tip on the sensor may be the size of the three adjacent coordinate point areas on the touch sensor. The terminal detects the signal 2 through the touch screen.
  • the terminal can ignore the signal 2 and not perform the switching of the stylus detection frequency, and continue to use 5Hz.
  • the frequency detects the input signal of the stylus.
  • the two types of noise filtering solutions provided in this embodiment may be implemented by the terminal alone or in combination.
  • the terminal can prevent misoperation due to noise, and save power consumption of the terminal.
  • FIG. 26 is a schematic flowchart of a stylus detection method according to an embodiment of the present application. As shown in FIG. 26, the method may include:
  • the terminal detects an input signal of the stylus at a first frequency.
  • the value range of the first frequency may be 2 Hz to 10 Hz.
  • the first frequency may be when the terminal is in an Active-5 Hz state, an Idle-5 Hz state, or a Sleep-5 Hz state as in the foregoing embodiment.
  • the detection frequency of the input signal of the stylus that is, the first frequency may be 5 Hz.
  • the terminal receives the first input of the stylus through the touch screen.
  • the terminal In response to the first input, the terminal detects an input signal of the stylus pen at a second frequency.
  • the value range of the second frequency may be 300 Hz to 600 Hz.
  • the first frequency may be when the terminal is in an Active-480 Hz state, an Idle-480 Hz state, or a Sleep-480 Hz state as in the foregoing embodiment.
  • the first input of the stylus may be an input of the stylus pen clicking on the screen, sliding long pressing, double-clicking, dragging, etc.
  • the terminal receives the first input of the stylus, that is, the terminal detects an input signal of the stylus.
  • the terminal In the Sleep-5Hz state shown at 7c in FIG. 7, after the pen tip of the stylus clicks on the screen, the terminal can detect the input signal of the stylus through the touch screen, and the terminal can switch from the Sleep-5Hz state shown in 7c in FIG. 7 , Switch to the Active-480Hz state shown at 7a in FIG. 7.
  • the first input of the stylus may also be an input operation 1414 as shown in 14a of FIG. 14, or may be an input operation 1434 as shown in 14c of FIG. 14.
  • the examples are merely for explanation of the application and should not be construed as limiting. For specific content, reference may be made to the foregoing embodiments, and details are not described herein again.
  • S2604 If the terminal detects the input signal of the stylus at the second frequency and the terminal does not detect that the duration of the input signal of the stylus is greater than the first time, the terminal detects the input signal of the stylus at the third frequency.
  • the second frequency is greater than the third frequency and greater than the first frequency.
  • the value range of the second frequency may be 30 Hz to 100 Hz.
  • the first frequency may be the input of the stylus by the terminal when the terminal is in the Active-60 Hz state or the Idle-60 Hz state in the foregoing embodiment.
  • the detection frequency of the signal. That is, the third frequency may be 60 Hz.
  • the first time may be 30 seconds, 1 minute, 2 minutes, or longer.
  • the terminal when the terminal is at Active-480Hz shown in 7a in FIG. 7, the terminal detects the input signal of the stylus at the second frequency (480Hz).
  • the terminal may be in an Idle-60 Hz state shown in 7b in FIG. 7 and detect the input signal of the stylus pen at a third frequency (60 Hz).
  • the terminal when the terminal is at Active-480Hz shown in 8a, the terminal detects the input signal of the stylus at the second frequency (480Hz).
  • the terminal may be in an Active-60 Hz state shown in 8b in FIG. 8, and detect the input signal of the stylus pen at a third frequency (60 Hz). As shown in Figure 8, when the terminal is at Idle-480Hz shown in 8c, the terminal detects the input signal of the stylus at the second frequency (480Hz). If the terminal does not detect the input signal of the stylus for a duration longer than the first time (30s) ), The terminal may be in an Idle-60 Hz state shown in 8d in FIG. 8 and detect the input signal of the stylus pen at a third frequency (60 Hz).
  • the examples are only used to explain the application and should not be construed as limiting.
  • the terminal can detect the input signal of the stylus at a low frequency (first frequency), and when the input signal of the stylus is detected, it can quickly switch to detecting the input signal of the stylus at a high frequency (second frequency). To achieve a fast user experience with the stylus.
  • the terminal When the terminal is at a high frequency (second frequency) to detect the input signal of the stylus, if the input signal of the stylus is not detected for a period of time (for example, 30s to 60s), the terminal can reduce the detection frequency to the intermediate frequency (third frequency) , Save power and wait for the input signal of the stylus to come again, so that when the input signal of the stylus comes again, the terminal can quickly return to the high frequency (second frequency) state to respond, and quickly execute the stylus that comes again.
  • the action corresponding to the input signal improves the user experience.
  • the terminal when the terminal detects the input signal of the stylus at the third frequency, if the terminal does not detect that the duration of the input signal of the stylus is greater than the second time, the terminal detects at the first frequency Input signal from stylus. That is to say, when no input signal of the stylus arrives for a long time, the terminal can reduce the detection frequency of the input signal of the stylus to save power consumption.
  • the second time may be 30 seconds, 1 minute, 2 minutes, or longer.
  • the first frequency is 5 Hz and the third frequency is 60 Hz.
  • the terminal detects the input signal of the stylus at a frequency of 60Hz), if the terminal fails
  • the touch screen detects the input signal of the stylus pen and does not detect the input signal of the user's touch operation through the touch screen for longer than the second time (for example, 30 seconds, 1 minute, 2 minutes, or longer)
  • the terminal can switch from The state of Idle-60Hz shown in 7b in FIG.
  • the terminal when the terminal detects the input signal of the stylus at a third frequency, if the terminal receives the second input of the stylus, in response to the second input of the stylus, the terminal uses the second input of the stylus Frequency detection input signal of stylus. That is to say, when the input signal of the stylus comes again, the terminal can increase the detection frequency of the input signal of the stylus, so that the terminal can quickly respond to the input signal of the stylus.
  • the second input of the stylus may be input such as tapping the pen tip on the screen, sliding long press, double-clicking, or dragging, and the terminal receives the second input of the stylus, that is, the terminal detects an input signal of the stylus.
  • the second frequency may be 480 Hz
  • the third frequency may be 60 Hz.
  • the terminal detects the input signal of the stylus at a frequency of 60Hz.
  • the terminal detects the stylus via the touch screen. Input signal, the terminal can switch from the Idle-60Hz state shown in 7b in FIG. 7 to the Active-480Hz state shown in 7a in FIG.
  • the terminal detects the input signal of the stylus at a frequency of 480Hz ).
  • the terminal detects the input signal of the stylus at a frequency of 60Hz.
  • the terminal detects the stylus via the touch screen.
  • the input signal can be switched from the Active-60Hz state shown in 8b in FIG. 8 to the Active-480Hz state shown in 8a in FIG. 8.
  • the terminal detects the input signal of the stylus at a frequency of 60Hz). After the tip of the stylus clicks on the screen, the terminal detects the stylus through the touch screen.
  • the terminal can switch from the Idle-60Hz state shown in 8d in FIG. 8 to the Idle-480Hz state shown in 8c in FIG. 8 (In the Idle-480Hz state, the terminal detects the input of the stylus at a frequency of 480Hz signal).
  • Idle-60Hz state shown in 8d in FIG. 8
  • Idle-480Hz state the terminal detects the input of the stylus at a frequency of 480Hz signal.
  • the terminal in a case where the terminal detects an input signal of the stylus pen at a second frequency, the terminal receives a third input of the user. In response to the third input, the terminal turns off the touch screen and detects an input signal of the stylus pen at a first frequency. That is to say, when the terminal is at a high frequency (second frequency) to detect the input signal of the stylus, if the terminal goes off the screen, the terminal can detect the input signal of the stylus at a low frequency, saving power consumption, and also enabling the user to When the screen is off, the user responds to the input signal of the stylus and performs a response action, which improves the user's experience with the stylus.
  • second frequency high frequency
  • the third input may be a user's screen-off operation, such as (single pressing the power key).
  • the terminal detects the input signal of the stylus at a frequency of 480 Hz
  • the terminal receives the user's screen-off operation and responds
  • the terminal's detection frequency of the stylus is switched from 480Hz to 5Hz.
  • the terminal in a case where the terminal detects an input signal of the stylus pen at a third frequency, the terminal receives a fourth input of the user. In response to the fourth input, the terminal turns off the touch screen and detects an input signal of the stylus pen at a first frequency. That is to say, when the terminal is at the intermediate frequency (third frequency) to detect the input signal of the stylus, if the terminal goes off the screen, the terminal can detect the input signal of the stylus at low frequency, which saves power consumption and also enables the user to turn off When the screen is on, it responds to the input signal of the stylus and executes the response action, which improves the user's experience of using the stylus.
  • the fourth input may be a user's screen-off operation, such as (single pressing the power key).
  • the terminal detects the input signal of the stylus at a frequency of 60 Hz
  • the terminal receives the screen-off operation of the user
  • the terminal's detection frequency of the stylus is switched from 60Hz to 5Hz.
  • the terminal when the terminal detects an input signal of the stylus pen at a second frequency, the terminal detects a user's touch input in a first detection state through a touch screen. In the first detection state, the terminal detects a user's touch input in a mutual capacitance detection manner at a fourth frequency and a self-capacitance detection manner at a fifth frequency.
  • the first detection state may be an Active state in the foregoing embodiment.
  • the fourth frequency may be 120 Hz
  • the fifth frequency may be 120 Hz.
  • the terminal is under Active-480Hz. Under Active-480Hz, the terminal can use 120Hz mutual capacitance detection frequency and 120Hz self-capacitance detection frequency to detect the input signal of touch operation through the touch screen, and the terminal can use the 480Hz scanning detection frequency to pass The touch screen detects the input signal of the stylus.
  • the fourth frequency and the fifth frequency may also have other values. For specific content, reference may be made to the foregoing embodiments, and details are not described herein again.
  • the terminal when the terminal detects an input signal of the stylus pen at a third frequency, the terminal detects a user's touch input in a second detection state through a touch screen; wherein, in the second detection state, the terminal starts with The mutual capacitance detection method at the sixth frequency and the self-capacitance detection method at the seventh frequency detect the user's touch input.
  • the second detection state may be the Idle state in the foregoing embodiment
  • the sixth frequency may be 1 Hz
  • the seventh frequency may be 120 Hz.
  • the terminal can use 1Hz mutual capacitance detection frequency and 120Hz self-capacitance detection frequency to detect the input signal of the touch operation, and the terminal can use the 60Hz scanning detection frequency to detect the input signal of the stylus through the touch screen.
  • the sixth frequency and the seventh frequency may also have other values. For specific content, reference may be made to the foregoing embodiments, and details are not described herein again.
  • the method further includes: the terminal stops detecting the touch input of the user.
  • the terminal may not detect the input signal of the user's touch operation on the touch screen, and the terminal may detect the input signal of the stylus pen through the touch screen with a scanning detection frequency of 5 Hz.
  • the terminal may not detect the input signal of the user's touch operation on the touch screen, and the terminal may detect the input signal of the stylus pen through the touch screen with a scanning detection frequency of 5 Hz.
  • the terminal receives the fifth input of the stylus on the condition that the terminal extinguishes the touch screen and detects an input signal of the stylus at a first frequency.
  • the terminal detects an input signal of the stylus at the second frequency and saves the writing content of the fifth input; wherein the writing content includes the writing of the stylus The handwriting or the text information recognized by the terminal from the writing handwriting of the stylus.
  • the fifth input of the stylus pen may be the input operation 1414 of the foregoing embodiment shown in 14a of FIG. 14, or may be the input operation 1434 of the foregoing embodiment shown in 14c of FIG. 14.
  • the fifth input of the stylus pen may be the input operation 1414 of the foregoing embodiment shown in 14a of FIG. 14, or may be the input operation 1434 of the foregoing embodiment shown in 14c of FIG. 14.
  • the terminal receives a sixth input from the user.
  • the terminal stops detecting the input signal of the stylus, or the terminal detects the input signal of the stylus at the first frequency.
  • the sixth input may be the touch operation 933 shown in 9c of FIG. 9 described above, or the stylus input operation 1033 shown in 10c of FIG. 10 described above.
  • the foregoing embodiment shown in FIG. 9 or FIG. 10 and details are not described herein again.
  • the terminal receives the seventh input of the user.
  • the terminal determines whether the terminal has received an input signal of the stylus before receiving the seventh input. If it is, the terminal detects the input signal of the stylus at the second frequency. If not, the terminal uses the The first frequency detects an input signal of the stylus.
  • the seventh input may be the touch operation 1113 shown in 11a of FIG. 11 described above, or the touch operation 1133 shown in 11c of FIG. 11 described above.
  • the touch operation 1113 shown in 11a of FIG. 11 described above or the touch operation 1133 shown in 11c of FIG. 11 described above.
  • reference may be made to the foregoing embodiment shown in FIG. 11, and details are not described herein again.
  • the terminal receives an eighth input from the user.
  • the terminal restores the factory settings and detects the input signal of the stylus at a first frequency.
  • the eighth input may be the touch operation 1312 shown in 13a of FIG. 13 described above, or the input operation 1332 of the stylus shown in 13c of FIG. 13 described above.
  • the eighth input may be the touch operation 1312 shown in 13a of FIG. 13 described above, or the input operation 1332 of the stylus shown in 13c of FIG. 13 described above.
  • the terminal receives a ninth input from the user.
  • the terminal restarts, wherein the frequency at which the terminal detects the input signal of the stylus before restarting is the same as the frequency at which the input signal of the stylus is detected after restarting.
  • the ninth input may be the touch operation 1213 shown in 12a of FIG. 12 described above, or the input operation 1233 of the stylus pen shown in 12c of FIG. 12 described above.
  • the ninth input may be the touch operation 1213 shown in 12a of FIG. 12 described above, or the input operation 1233 of the stylus pen shown in 12c of FIG. 12 described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

提供了一种手写笔检测方法,包括:首先,终端以第一频率检测手写笔的输入信号。然后,终端通过触控屏接收手写笔的第一输入。响应于第一输入,终端以第二频率检测手写笔的输入信号。接着,若终端以第二频率检测手写笔的输入信号,且终端未检测到手写笔的输入信号的持续时长大于第一时间,则终端以第三频率检测手写笔的输入信号。其中,该第二频率大于该第三频率大于该第一频率。这样,可以在实现在快速的实现手写笔功能的同时,降低终端的功耗。

Description

手写笔检测方法、系统及相关装置 技术领域
本申请涉及移动通信技术领域,尤其涉及一种手写笔检测方法、系统及相关装置。
背景技术
随着手机和平板等移动设备应用的普及化,对设备输入方式的研究也越来越细化。手指的操作在移动设备上尤其局限性,由于手指较粗所以很难在尺寸较小的屏幕上进行精确书写和快速书写。于是,催生了各种各样应用于触摸屏的手写笔。主动电容式手写笔是现有电容式触摸屏系统的硬件基础上实现的高精度,低成本的手写笔。
相比传统的键盘和手指输入方式,手写笔的出现大大的提高了移动终端的使用效率,也丰富了人们的应用场景。但是,如何降低终端的系统功耗,提升续航能力为行业内改进的主要方向。
发明内容
本申请提供了一种手写笔检测方法、系统及相关装置,可以在实现在快速的实现手写笔功能的同时,降低终端的功耗。
第一方面,本申请提供了一种手写笔检测方法,包括:首先,终端以第一频率检测手写笔的输入信号。然后,终端通过触控屏接收手写笔的第一输入。响应于第一输入,终端以第二频率检测手写笔的输入信号。接着,若终端以第二频率检测手写笔的输入信号,且终端未检测到手写笔的输入信号的持续时长大于第一时间,则终端以第三频率检测手写笔的输入信号。其中,该第二频率大于该第三频率大于该第一频率。
通过该方案,终端可以以低频(第一频率)检测手写笔的输入信号,当检测到手写笔的输入信号时,可以快速的切换至高频(第二频率)检测手写笔的输入信号,以达到快速使用手写笔的用户体验。当终端处于高频(第二频率)检测手写笔的输入信号时,若在终端一段时间(例如30s~60s)未检测到手写笔的输入信号,终端可以将检测频率降低中频(第三频率),省功耗的等待手写笔的输入信号的再次到来,以便在手写笔的输入信号再次到来时,终端可以快速的回到高频(第二频率)状态作出响应,快速执行再次到来的手写笔的输入信号对应的动作,提高了用户的体验。
在一种可能的情况下,在终端以第三频率检测所述手写笔的输入信号情况下,若终端未检测到手写笔的输入信号的持续时长大于第二时间,则终端以第一频率检测手写笔的输入信号。也即是说,在长时间没有手写笔的输入信号到来时,终端可以降低对手写笔的输入信号的检测频率,以节省功耗。
在一种可能的情况下,在终端以第三频率检测所述手写笔的输入信号的情况下,若终端接收到了手写笔的第二输入,响应于手写笔的第二输入,终端以第二频率检测手写笔的输入信号。也即是说,在当手写笔的输入信号再次到来时,终端可以提高对手写笔的输入信号的检测频率,以便终端可以快速的对手写笔的输入信号作出相应的响应动作。
在一种可能的情况下,在终端以第二频率检测手写笔的输入信号的情况下,终端接收 用户的第三输入。响应于第三输入,终端熄灭触控屏,并以第一频率检测所述手写笔的输入信号。也即是说,在终端处于高频(第二频率)检测手写笔的输入信号时,若终端灭屏,终端可以以低频检测手写笔的输入信号,节省了功耗,还能够在用户能够在灭屏时,响应手写笔的输入信号,执行响应的动作,提高了用户的手写笔使用体验。
在一种可能的情况下,在终端以第三频率检测手写笔的输入信号的情况下,终端接收用户的第四输入。响应于第四输入,终端熄灭触控屏,并以第一频率检测手写笔的输入信号。也即是说,在终端处于中频(第二频率)检测手写笔的输入信号时,若终端灭屏,终端可以以低频检测手写笔的输入信号,节省了功耗,还能够在用户能够在灭屏时,响应手写笔的输入信号,执行相应的动作,提高了用户的手写笔使用体验。
在一种可能的情况下,在终端以第二频率检测手写笔的输入信号时,终端通过触控屏以第一检测状态检测用户的触摸输入。其中,在第一检测状态下,终端以第四频率的互容检测方式和第五频率的自容检测方式,来检测用户的触摸输入。也即是说,终端在高频(第二频率)检测手写笔的输入信号时,终端还可以同时检测手指触摸输入,可以提高用户在同时使用手写笔和手指操作终端时的体验。
在一种可能的情况下,在终端以第三频率检测手写笔的输入信号的时,终端通过触控屏以第二检测状态检测用户的触摸输入;其中,在第二检测状态下,终端以第六频率的互容检测方式和第七频率的自容检测方式,检测用户的触摸输入。也即是说,终端可以在中频(第二频率)检测手写笔的输入信号时,终端还可以同时检测手指触摸输入,节省了终端在用户未操作终端的功耗,也可以在手写笔的输入信号或触摸输入同时到来时,终端能够及时作出反应。
在一种可能的情况下,在所述终端熄灭所述触控屏的条件下,所述方法还包括:所述终端停止对所述用户的触摸输入的检测。也即是说,终端可以在灭屏时,不检测用户的触摸输入,以节省功耗。
在一种可能的情况下,在所述终端熄灭所述触控屏,且以第一频率检测所述手写笔的输入信号的条件下,所述终端接收所述手写笔的第五输入。响应于所述第五输入,所述终端以所述第二频率检测所述手写笔的输入信号,并保存所述第五输入的书写内容;其中,所述书写内容包括所述手写笔的书写笔迹或所述终端从所述手写笔的书写笔迹中识别出的文字信息。也即是说,终端在息屏时,可以接收手写笔的输入,并记录下手写笔的书写内容,让用户可以快速的利用手写笔记录书写内容。
在一种可能的情况下,终端接收所述用户的第六输入。响应于第六输入,终端停止对手写笔的输入信号的检测,或,终端以所述第一频率检测手写笔的输入信号。也即是说,终端可以根据用户的需求,关闭对手写笔的检测或者以低频对手写笔进行检测,节省了用户在不使用手写笔时的功耗。
在一种可能的情况下,在终端停止对手写笔的输入信号的检测的条件下,终端接收所述用户的第七输入。响应于第七输入,终端判断在终端在接收所述第七输入之前是否接收到过手写笔的输入信号,若是,则终端以第二频率检测手写笔的输入信号,若否,则终端以所述第一频率检测手写笔的输入信号。也即是说,终端在接收用户的操作打开手写笔功能时,可以判断用户之前是否使用过手写笔,来确定对手写笔的检测频率,可以为节省功 耗。
在一种可能的情况下,终端接收用户的第八输入。响应于第八输入,终端恢复出厂设置,并以第一频率检测所述手写笔的输入信号。也即是说,终端在恢复出厂设之后,终端以低频(第一频率)检测手写笔的输入信号。
在一种可能的情况下,终端接收用户的第九输入。响应于第九输入,终端进行重启,其中,终端在重启之前检测手写笔的输入信号的频率与在重启之后检测手写笔的输入信号的频率相同。
第二方面,本申请提供了一种终端,包括一个或多个处理器和一个或多个存储器。该一个或多个存储器与一个或多个处理器耦合,一个或多个存储器用于存储计算机程序代码,计算机程序代码包括计算机指令,当一个或多个处理器执行计算机指令时,使得通信装置执行上述任一方面任一项可能的实现方式中的手写笔检测方法。
第三方面,本申请实施例提供了一种计算机存储介质,包括计算机指令,当计算机指令在电子设备上运行时,使得通信装置执行上述任一方面任一项可能的实现方式中的手写笔检测方法。
第四方面,本申请实施例提供了一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行上述任一方面任一项可能的实现方式中的手写笔检测方法。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍。
图1为本申请实施例提供的一种电子设备的结构示意图;
图2为本申请实施例提供的一种软件架构示意图;
图3为本申请实施例提供的一种手写笔系统架构示意图;
图4为本申请实施例提供的一种终端屏幕的结构示意图;
图5为本申请实施例提供的一种触摸传感器的示意图;
图6为本申请实施例提供的一组界面示意图;
图7为本申请实施例提供的另一组界面示意图;
图8为本申请实施例提供的另一组界面示意图;
图9为本申请实施例提供的另一组界面示意图;
图10为本申请实施例提供的另一组界面示意图;
图11为本申请实施例提供的另一组界面示意图;
图12为本申请实施例提供的另一组界面示意图;
图13为本申请实施例提供的另一组界面示意图;
图14为本申请实施例提供的另一组界面示意图;
图15为本申请实施例提供的另一组界面示意图;
图16为本申请实施例提供的另一组界面示意图;
图17为本申请实施例提供的另一组界面示意图;
图18为本申请实施例提供的另一组界面示意图;
图19为本申请实施例提供的另一组界面示意图;
图20为本申请实施例提供的另一种手写笔系统架构示意图;
图21为本申请实施例提供的一种手写笔智能开关的状态示意图;
图22为本申请实施例提供的另一种手写笔智能开关的状态示意图;
图23为本申请实施例提供的一种触控器件工作状态切换示意图;
图24为本申请实施例提供的一种手写笔智能开关的状态示意图;
图25是本申请实施例提供的一种手写笔输出的信号示意图;
图26为本申请实施例提供的一种手写笔检测方法的流程示意图。
具体实施方式
下面将结合附图对本申请实施例中的技术方案进行清楚、详尽地描述。其中,在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;文本中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,在本申请实施例的描述中,“多个”是指两个或多于两个。
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
图1示出了电子设备100的结构示意图。
如图1所示,本申请实施例中的终端01可以是电子设备100。下面以电子设备100为例对实施例进行具体说明。应该理解的是,图1所示电子设备100仅是终端01的一个范例,并且电子设备100可以具有比图中所示的更多的或者更少的部件,可以组合两个或多个的部件,或者可以具有不同的部件配置。图1中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
电子设备100可以包括:处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
可以理解的是,本发明实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬 件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
其中,控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
I2C接口是一种双向同步串行总线,包括一根串行数据线(serial data line,SDA)和一根串行时钟线(derail clock line,SCL)。在一些实施例中,处理器110可以包含多组I2C总线。处理器110可以通过不同的I2C总线接口分别耦合触摸传感器180K,充电器,闪光灯,摄像头193等。例如:处理器110可以通过I2C接口耦合触摸传感器180K,使处理器110与触摸传感器180K通过I2C总线接口通信,实现电子设备100的触摸功能。
I2S接口可以用于音频通信。在一些实施例中,处理器110可以包含多组I2S总线。处理器110可以通过I2S总线与音频模块170耦合,实现处理器110与音频模块170之间的通信。在一些实施例中,音频模块170可以通过I2S接口向无线通信模块160传递音频信号,实现通过蓝牙耳机接听电话的功能。
PCM接口也可以用于音频通信,将模拟信号抽样,量化和编码。在一些实施例中,音频模块170与无线通信模块160可以通过PCM总线接口耦合。在一些实施例中,音频模块170也可以通过PCM接口向无线通信模块160传递音频信号,实现通过蓝牙耳机接听电话的功能。所述I2S接口和所述PCM接口都可以用于音频通信。
UART接口是一种通用串行数据总线,用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中,UART接口通常被用于连接处理器110与无线通信模块160。例如:处理器110通过UART接口与无线通信模块160中的蓝牙模块通信,实现蓝牙功能。在一些实施例中,音频模块170可以通过UART接口向无线通信模块160传递音频信号,实现通过蓝牙耳机播放音乐的功能。
MIPI接口可以被用于连接处理器110与显示屏194,摄像头193等外围器件。MIPI接口包括摄像头串行接口(camera serial interface,CSI),显示屏串行接口(display serial interface,DSI)等。在一些实施例中,处理器110和摄像头193通过CSI接口通信,实现电子设备100的拍摄功能。处理器110和显示屏194通过DSI接口通信,实现电子设备100的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号,也可被配置为数据信号。在一些实施例中,GPIO接口可以用于连接处理器110与摄像头193,显示屏194,无线通信模块160,音频模块170,传感器模块180等。GPIO接口还可以被配置为I2C接口,I2S接口,UART接口,MIPI接口等。
USB接口130是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口130可以用于连接充电器为电子设备100充电,也可以用于电子设备100与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他电子设备,例如AR设备等。
可以理解的是,本发明实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备100的结构限定。在本申请另一些实施例中,电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为电子设备供电。
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,外部存储器,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个 器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。
电子设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样,电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令,从而执行电子设备100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。
电子设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。电子设备100可以通 过扬声器170A收听音乐,或收听免提通话。
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。
麦克风170C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风170C发声,将声音信号输入到麦克风170C。电子设备100可以设置至少一个麦克风170C。在另一些实施例中,电子设备100可以设置两个麦克风170C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,电子设备100还可以设置三个,四个或更多麦克风170C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器180A可以设置于显示屏194。压力传感器180A的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器180A,电极之间的电容改变。电子设备100根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194,电子设备100根据压力传感器180A检测所述触摸操作强度。电子设备100也可以根据压力传感器180A的检测信号计算触摸的位置。在一些实施例中,作用于相同触摸位置,但不同触摸操作强度的触摸操作,可以对应不同的操作指令。例如:当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时,执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时,执行新建短消息的指令。
陀螺仪传感器180B可以用于确定电子设备100的运动姿态。在一些实施例中,可以通过陀螺仪传感器180B确定电子设备100围绕三个轴(即,x,y和z轴)的角速度。陀螺仪传感器180B可以用于拍摄防抖。示例性的,当按下快门,陀螺仪传感器180B检测电子设备100抖动的角度,根据角度计算出镜头模组需要补偿的距离,让镜头通过反向运动抵消电子设备100的抖动,实现防抖。陀螺仪传感器180B还可以用于导航,体感游戏场景。
气压传感器180C用于测量气压。在一些实施例中,电子设备100通过气压传感器180C测得的气压值计算海拔高度,辅助定位和导航。
磁传感器180D包括霍尔传感器。电子设备100可以利用磁传感器180D检测翻盖皮套的开合。在一些实施例中,当电子设备100是翻盖机时,电子设备100可以根据磁传感器180D检测翻盖的开合。进而根据检测到的皮套的开合状态或翻盖的开合状态,设置翻盖自动解锁等特性。
加速度传感器180E可检测电子设备100在各个方向上(一般为三轴)加速度的大小。当电子设备100静止时可检测出重力的大小及方向。还可以用于识别电子设备姿态,应用于横竖屏切换,计步器等应用。
距离传感器180F,用于测量距离。电子设备100可以通过红外或激光测量距离。在一些实施例中,拍摄场景,电子设备100可以利用距离传感器180F测距以实现快速对焦。
接近光传感器180G可以包括例如发光二极管(LED)和光检测器,例如光电二极管。发光二极管可以是红外发光二极管。电子设备100通过发光二极管向外发射红外光。电子设备100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时,可以确定电子设备100附近有物体。当检测到不充分的反射光时,电子设备100可以确定电子设备100附近没有物体。电子设备100可以利用接近光传感器180G检测用户手持电子设备100贴近耳朵通话,以便自动熄灭屏幕达到省电的目的。接近光传感器180G也可用于皮套模式,口袋模式自动解锁与锁屏。
环境光传感器180L用于感知环境光亮度。电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合,检测电子设备100是否在口袋里,以防误触。
指纹传感器180H用于采集指纹。电子设备100可以利用采集的指纹特性实现指纹解锁,访问应用锁,指纹拍照,指纹接听来电等。
温度传感器180J用于检测温度。在一些实施例中,电子设备100利用温度传感器180J检测的温度,执行温度处理策略。例如,当温度传感器180J上报的温度超过阈值,电子设备100执行降低位于温度传感器180J附近的处理器的性能,以便降低功耗实施热保护。在另一些实施例中,当温度低于另一阈值时,电子设备100对电池142加热,以避免低温导致电子设备100异常关机。在其他一些实施例中,当温度低于又一阈值时,电子设备100对电池142的输出电压执行升压,以避免低温导致的异常关机。
触摸传感器180K,也称“触控面板”。触摸传感器180K可以设置于显示屏194,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器180K也可以设置于电子设备100的表面,与显示屏194所处的位置不同。
骨传导传感器180M可以获取振动信号。在一些实施例中,骨传导传感器180M可以获取人体声部振动骨块的振动信号。骨传导传感器180M也可以接触人体脉搏,接收血压跳动信号。在一些实施例中,骨传导传感器180M也可以设置于耳机中,结合成骨传导耳机。音频模块170可以基于所述骨传导传感器180M获取的声部振动骨块的振动信号,解析出语音信号,实现语音功能。应用处理器可以基于所述骨传导传感器180M获取的血压跳动信号解析心率信息,实现心率检测功能。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入,产生与电子设备100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息, 未接来电,通知等。
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195,或从SIM卡接口195拔出,实现和电子设备100的接触和分离。电子设备100可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡,Micro SIM卡,SIM卡等。同一个SIM卡接口195可以同时插入多张卡。所述多张卡的类型可以相同,也可以不同。SIM卡接口195也可以兼容不同类型的SIM卡。SIM卡接口195也可以兼容外部存储卡。电子设备100通过SIM卡和网络交互,实现通话以及数据通信等功能。在一些实施例中,电子设备100采用eSIM,即:嵌入式SIM卡。eSIM卡可以嵌在电子设备100中,不能和电子设备100分离。
电子设备100的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本发明实施例以分层架构的Android系统为例,示例性说明电子设备100的软件结构。
图2是本发明实施例的电子设备100的软件结构框图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android系统分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和系统库,以及内核层。
应用程序层可以包括一系列应用程序包。
如图2所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图3所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
视图系统包括可视控件,例如显示文字的控件,显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供电子设备100的通信功能。例如通话状态的管理(包括接通,挂断等)。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例 如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备振动,指示灯闪烁等。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。
表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。
下面结合捕获拍照场景,示例性说明电子设备100软件以及硬件的工作流程。
当触摸传感器180K接收到触摸操作,相应的硬件中断被发给内核层。内核层将触摸操作加工成原始输入事件(包括触摸坐标,触摸操作的时间戳等信息)。原始输入事件被存储在内核层。应用程序框架层从内核层获取原始输入事件,识别该输入事件所对应的控件。以该触摸操作是触摸单击操作,该单击操作所对应的控件为相机应用图标的控件为例,相机应用调用应用框架层的接口,启动相机应用,进而通过调用内核层启动摄像头驱动,通过摄像头193捕获静态图像或视频。
下面介绍本申请实施例提供的一种手写笔系统架构。请参见图3所示,为本申请提供的一种手写笔系统架构图。如图3所示,本申请提供的手写笔系统架构图中,手写笔系统30包括手写笔30和终端31。终端31可以是上述图1中的电子设备100其中,
手写笔为主动电容手写笔。该主动电容手写笔可以包括:电源301、电源管理单元(power management unit,PMU)302、微控制单元(microcontroller unit,MCU)303、驱动单元304、压力传感器305、笔尖306。其中,电源301可以是可充电锂电池或者可更换标准电池等。电源管理单元302可以包括自适应的兼容通用串行总线(USB-compatible)的脉冲宽度调制(pulse width modulation,PMW)充电电路、多路直流直流转换器(Buck DC-DC converter)、LCD背光灯驱动电路灯等。该电源管理单元302可以提供给手写笔30的微控制单元303、驱动单元304、压力传感器305等所需要的电源。该微控制单元303可用于产生电容笔激励信号,接收并分析压力传感器305上报的压力数据,检测功能按键状态,电源模式切换管理等功能。该压力传感器305可用于检测手写笔的笔尖的压力数据,并将该检测到的手 写笔30的笔尖上的压力数据上报给微控制单元303。该驱动单元304可以用于提供电压驱动信号到手写笔的笔尖,手写笔的笔尖在接收到电压驱动信号后,可以输出终端可以检测到的信号,例如电信号,该笔尖靠近终端时,终端可以检测到该笔尖输出的电信号,即终端检测到了手写笔的输入信号。当终端检测到该手写笔的输入信号之后,终端可以通过触控芯片确定出手写笔30的笔尖306在终端31触控传感器311上的具体位置。其中,手写笔的笔尖可以不断发出信号,例如电信号,该手写笔的笔尖可以不断的发出低频信号(例如30KHz~70KHz之间的信号),该手写笔的笔尖的发出的信号中可以包括笔尖所感受到的压力、笔的按键状态和笔的ID序列号等信息。在一种可选的情况下,笔和终端可以有蓝牙、wifi、zigbee等方式连接,手写笔检测到笔尖的接触触控屏之后,可以通过蓝牙告诉终端调节对手写笔的检测频率,并打开备忘录。
该终端31可以包括触控传感器311、显示屏312、触控芯片313、图形处理器(graphics processing unit,GPU)314、应用处理器(application processor,AP)315。其中,该触控芯片312可以确定出该触控传感器311检测到的电容信号及检测到电容信号的位置上报给应用处理器315。该显示屏312可以是如上述图1中的显示屏194,在此不再赘述。
该触控传感器311可用于检测手写笔30的靠近操作所产生的电容值信号或者手指的触摸操作所产生的电容值信号,并将手写笔30靠近触控屏时所产生的电容信号或者手指的触摸操作所产生的电容值信号上传至手写笔触控芯片313。
请参见图4,图4中示出了本申请提供的一种终端的屏幕40,该终端的屏幕40可以包括保护玻璃、触摸传感器、显示屏、底板。该触摸传感器和显示屏可以组成触控屏,具体内容可以参考上述图1所示装置实施例,在此不作赘述。
请参见图5,图5示出了本申请提供的一种触控传感器50。其中,该触摸传感器50可以包括X轴电极层和Y轴电极层。其中,X轴电极层可以包括多个成矩阵式分布的发射(transmit,Tx)电极,Y轴电极层可以包括多个成矩阵式分布的接收(receive,Rx)电极。其中,终端可以通过触控屏的自容检测和互容检测,检测手指的触摸操作。终端可以通过触摸屏的互容检测,检测手写笔的输入操作。
基于上述图5所示触摸传感器50,下面介绍本申请涉及的互容检测和自容检测。
1、互容检测:终端的触摸传感器50上的发射(transmit,Tx)电极和接收(receive,Rx)电极形成纵横交错的网络,在Tx电极和Rx电极交叉点(即坐标点)形成互电容(即Tx电极与相邻Rx电极构成的电容)。在终端在扫描检测触控屏上每个坐标点的互电容的大小时,终端上与触控屏相连的触控芯片在每根Tx电极依次发出激励信号,然后触控芯片扫每根接收Rx电极接收到的信号,触控芯片将测量到的电压值模数转换为数字信号并计算电容值。当有手指触摸到触控屏上时,手指会从Tx电极吸收掉一部分激励信号,由此,Rx电极上接收到的信号会减弱,从而可以根据触摸传感器上各坐标点的电容变化量来计算出手指的触摸位置信息。
其中,终端对手写笔的检测方式为互容检测方式。当手写笔(主动式电容笔)靠近触控屏时,手写笔的笔尖发送出信号时手写笔上的笔尖可以取代触控屏上的Tx电极,而此时触控屏上的Tx电极和原有的Rx电极轮流在触控屏上的横轴(X轴)、纵轴(Y轴)方向上感测手写笔的发射信号。此时,终端接收到的手写笔的接触点的互容值是手写笔的笔尖 与触控屏上的Tx电极或Rx电极之间的耦合电容。这样,终端可以定位X轴上Y轴上的电容峰值交叉点来得到手写笔笔尖的在触控屏上的位置信息。
其中,互容检测频率可以是指触控屏采集触控屏上每个触控点的Tx电极和Rx电极之间的电容值(即互电容值)后,并上报触控屏上的该互电容值给触控芯片的频率。示例性的,120Hz频率互容检测可以指触控屏采集触控屏上每个电极交叉点的发射(transmit,Tx)电极和接收(receive,Rx)电极之间的互电容值后,并将各电极交叉点的互电容值上报给触控芯片的频率为120Hz。
互容检测频率还可以指触控芯片根据每个电极交叉点的互电容值计算触摸点坐标位置的处理频率。120Hz频率互容检测还可以指触控屏将触控屏上每个电极交叉点的Tx电极和Rx电极的的互电容值上报给触控芯片后,触控芯片以120Hz的处理频率根据每个电极交叉点的Tx电极和Rx电极的的互电容值计算出触摸点的坐标位置。
2、自容检测:终端自容检测触控屏上用户的触摸操作时,触控屏上的Tx电极和Rx电极分别与地构成电容,即自电容。其中,Tx电极和Rx电极形成纵横交错的网络。当手指触摸到电容屏时,手指的电容将会叠加到触控屏的屏体电容(Tx电极与地构成的自电容,或Rx电极与地构成的自电容)上,使屏体电容量改变。终端在扫描检测触控屏上每个坐标点的上各电极的自电容的大小时,终端依次分别检测Tx电极与Rx电极阵列,根据触摸前后电容的变化,可以分别确定横向(Tx电极排布方向)坐标和纵向(Rx电极排布方向)坐标,然后组成二维平面的触摸坐标。
其中,自容检测频率可以指触控屏采集触控屏上每个触控点的各电极之间的自电容值后,并上报触控屏上的该互电容值给触控芯片的频率。示例性的,120Hz频率自容检测可以指触控屏采集触控屏上每根电极的自电容值后,并将各电极的自电容值上报给触控芯片的频率为120Hz。
自容检测频率还可以指触控芯片根据每根电极的自电容值计算触摸点坐标位置的处理频率。120Hz频率互容检测还可以指触控屏将触控屏上每根电极的自电容值上报给触控芯片后,触控芯片以120Hz的处理频率根据每根电极的自电容值计算出触摸点的坐标位置。
下面介绍本申请实施例中终端针对用户在触控屏上的手指触摸输入操作的三种检测状态:激活(Active)状态,闲置(Idle)状态,休眠(Sleep)状态。其中,
Active状态:在Active状态下,终端采用120Hz频率互容检测和120Hz频率自容检测的触摸检测状态检测用户在触控屏上的触摸输入操作。
Idle状态:在Idle状态下,终端采用1Hz频率互容检测和120Hz频率自容检测的触摸检测状态检测用户在触控屏上的触摸输入操作。
Sleep状态:在Sleep状态下,终端不检测用户在触控屏上的触摸输入操作。
在一种可能的情况下,终端在检测手写笔的输入信号和手指触摸的输入信号时,可以采用时分复用的检测方式。例如,在终端检测触控传感器上的电容信号的一个检测周期为33.34ms,一个周期可以分为两个信号检测时间区间,即在一个周期内的两个信号检测时间区间的具体时间段可以为信号检测时间区间A:0~16.67ms、脉冲信号时间区间B: 16.68ms~33.34ms。终端可以利用信号检测时间区间A来检测手写笔的输入信号,终端可以利用信号检测时间区间B来检测用户的触摸输入。上述示例仅仅用于解释本申请,不应构成限定。在一种可能的情况下,终端还可以通过两个单独的触控芯片分别检测手写笔的输入信号和手指触摸的输入信号。
以下将结合附图和应用场景,对本申请实施例提供的手写笔检测方法进行详细介绍。
终端在出厂设置时,终端默认打开手写笔功能,终端可以通过触控屏第一频率(例如5Hz)扫描检测手写笔的输入信号。当终端通过触控屏接收到了手写笔的输入信号之后,终端可以切换到第二频率(例如480Hz)扫描手写笔的输入信号状态,实现手写笔在终端上的流畅书写。具体实现可以如下:
请参见图6,图6中的6a、6b、6c示出了终端在出厂设置之后初始的触摸检测状态和手写笔频率检测状态。在图6中的6a、6b、6c中所示的触控屏的检测状态中,用户未使用过手写笔。如图6中的6a所示,在Active-5Hz状态下,终端可以采用120Hz互容检测频率和120Hz自容检测频率通过触控屏来检测用户触摸操作的输入信号,终端可以采用5Hz的扫描检测频率通过触控屏来检测手写笔的输入信号。如图6中的6b所示,在Idle-5Hz状态下,终端可以采用1Hz互容检测频率和120Hz自容检测频率通过触控屏来检测触摸操作的输入信号,终端可以采用5Hz的扫描检测频率通过触控屏来检测手写笔的输入信号。如图6中的6c所示,在Sleep-5Hz状态下,终端可以不检测用户在触控屏上的触摸操作的输入信号,终端可以采用5Hz的扫描检测频率通过触控屏来检测手写笔的输入信号。
在终端检测到了用户的触摸操作的输入信号时,终端的触控屏的扫描检测状态可以是如图6中6a中所示的Active-5Hz状态。若在终端可以处于图6中的6a所示的Active-5Hz状态下,若终端在未检测到用户的触摸操作的输入信号的持续时长大于预设时间(例如30秒、1分钟、2分钟或者更长),则终端可以从图6中的6a示出的Active-5Hz状态切换到图4中的4b示出的Idle-5Hz状态。
若在图6中的6b示出的Idle-5Hz状态下,终端检测到了用户的触摸操作的输入信号时,终端可以从图6中的6b示出的Idle-5Hz状态切换到图6中的6a示出的Active-5Hz状态。
若在图6中的6b示出的Idle-5Hz状态下,终端未检测到用户的触摸操作的输入信号的持续时长大于预设时间(例如30秒、1分钟、2分钟或者更长),则终端可以从图6中的6b示出的Idle-5Hz状态切换到图6中的6c所示的Sleep-5Hz状态。其中,在该Sleep-5Hz状态下,终端可以不检测用户的触摸操作的输入信号,终端可以采用5Hz的扫描检测频率通过触控屏来检测手写笔的输入信号。
在一种可能的情况下,终端处于图6中的6a所示的Active-5Hz状态,或者图6中的6b所示的Idle-5Hz状态,若终端接收到用户的灭屏操作(如单次按下电源键)时,终端可以从Active-5Hz状态,或者Idle-5Hz状态切换到Sleep-5Hz状态。在一种可能的情况下,终端处于如图6中的6c所示的Sleep-5Hz状态下,若终端接收到用户的亮屏操作(如在终端灭屏时单次按下电源键),终端可以从Sleep-5Hz状态,切换到Active-5Hz状态。
当终端处于图6中的6a所示的Active-5Hz状态、6b所示的Idle-5Hz状态或6c所示的 Sleep-5Hz状态,若终端检测到了手写笔的输入信号,终端可以切换到图7中的7a所示的Active-480Hz状态。
请参见图7,图7中的7a、7b、7c示出了终端在已接收过的手写笔输入后的几种检测状态。
如图7中的7a所示,在Active-480Hz状态下,终端可以采用120Hz互容检测频率和120Hz自容检测频率通过触控屏来检测触摸操作的输入信号,终端可以采用480Hz的扫描检测频率来通过触控屏检测手写笔的输入信号。
如图7中的7b所示,在Idle-60Hz状态下,终端可以采用1Hz互容检测频率和120Hz自容检测频率来检测触摸操作的输入信号,终端可以采用60Hz的扫描检测频率通过触控屏来检测手写笔的输入信号。
如图7中的7c所示,在Sleep-5Hz状态下,终端可以不检测用户在触控屏上的触摸操作的输入信号,终端可以采用5Hz的扫描检测频率通过触控屏来检测手写笔的输入信号。
其中,当终端第一次检测到了手写笔的输入信号时,终端的触控屏的扫描检测状态可以切换至如图7中7a中所示终端的Active-480Hz状态。例如,在图6中的6a所示终端的Active-5Hz状态下,若终端第一次检测到了手写笔的输入信号,则终端可以从Active-5Hz状态切换至Active-480Hz状态,即终端将手写笔的检测频率从5Hz提高至480Hz。又例如,在图6中6b所示终端的Idle-5Hz状态下,若终端第一次检测到了手写笔的输入信号,则终端可以从Idle-5Hz状态切换到如图7中7a所示终端的Active-480Hz状态,即终端可以将手指触摸的检测状态从Idle状态切换至Active状态,将手写笔的检测频率从5Hz提高到480Hz。又例如,在图6中6c所示终端的Sleep-5Hz状态下,若终端第一次检测到了手写笔的输入信号,则终端可以从Sleep-5Hz状态切换至Active-480Hz状态,即终端可以将手指触摸的检测状态从Sleep状态切换至Active状态,将手写笔的检测频率从5Hz提高到了480Hz。
在终端处于图7中7a所示的Active-480Hz状态下,若终端未通过触控屏检测到手写笔的输入信号并且也未通过触控屏检测到用户的触摸输入信号的时长大于预设时间(例如30秒、1分钟、2分钟或者更长)时,终端可以从图7中7a所示的Active-480Hz状态切换至图7中7b所示的Idle-60Hz状态。
在终端处于图7中7b所示的Idle-60Hz状态下,若终端未通过触控屏检测到手写笔的输入信号并且也未通过触控屏检测到用户触摸操作的输入信号的时长大于预设时间(例如30秒、1分钟、2分钟或者更长)时,终端可以从图7中7b所示的Idle-60Hz状态切换至图7中7c所示的Sleep-5Hz状态。在一种可能的情况下,在终端处于图7中7b所示的Idle-60Hz状态下,若终端通过触控屏检测到手写笔的输入信号或者通过触控屏检测到了用户触摸操作的输入信号时,终端可以从图7中7b所示的Idle-60Hz状态,切换至图7中7a所示的Active-480Hz状态。这样,当终端处于高频(例如480Hz)检测手写笔的输入信号时,若在终端一段时间(例如30s~60s)未检测到手写笔的输入信号,终端可以将检测频率降低中频(例如60Hz),等待手写笔的输入信号的再次到来,以便在手写笔的输入信号再次到来时,终端可以快速的作出响应,快速执行再次到来的手写笔的输入信号对应的动作,提高了用户的体验。例如,在手写笔短暂停笔书写之后再次书写时,终端可以快速的记录下手写笔的书写笔迹,保证手写笔的书写笔迹的连贯性,提高了用户书写体验。
在终端处于图7中7a所示的Active-480Hz状态下、或图7中7b所示的Idle-60Hz状态下,若终端接收到用户的灭屏操作(如单次按下电源键)时,终端可以从图7中7a所示的Active-480Hz状态,或者图7中7b所示的Idle-60Hz状态,切换到如图7中7c所示的Sleep-5Hz状态。
在终端处于图7中7c所示的Sleep-5Hz状态下,若终端通过触控屏检测到手写笔的输入信号时,终端可以从图7中7c所示的Sleep-5Hz状态,切换至图7中7a所示的Active-480Hz状态。在一种可能的情况下,在终端处于图7中7c所示的Sleep-5Hz状态下,若终端接收到用户的亮屏操作(如在终端灭屏时单次按下电源键),终端可以从图7中7c所示的Sleep-5Hz状态,切换到图7中7a所示的Active-480Hz状态。
在一种可能的情况下,当终端处于图6中的6a所示的Active-5Hz状态、6b所示的Idle-5Hz状态或6c所示的Sleep-5Hz状态,若终端检测到了手写笔的输入信号,终端可以切换到图8中的8a所示的Active-480Hz状态。
请参见图8,图8中的8a、8b、8c示出了终端在接收到用户的手写笔输入后的几种检测状态。
如图8中的8a所示,在Active-480Hz状态下,终端可以采用120Hz互容检测频率和120Hz自容检测频率通过触控屏来检测用户触摸操作的输入信号,终端可以采用480Hz的扫描检测频率来通过触控屏检测手写笔的输入信号。
如图8中的8b所示,在Active-60Hz状态下,终端可以采用120Hz互容检测频率和120Hz自容检测频率通过触控屏来检测用户触摸操作的输入信号,终端可以采用60Hz的扫描检测频率来通过触控屏检测手写笔的输入信号。如图8中的8c所示,在Idle-480Hz状态下,终端可以采用1Hz互容检测频率和120Hz自容检测频率来检测用户触摸操作的输入信号,终端可以采用480Hz的扫描频率来通过触控屏检测手写笔的输入信号。
如图8中的8d所示,在Idle-60Hz状态下,终端可以采用1Hz互容检测频率和120Hz自容检测频率来检测用户触摸操作的输入信号,终端可以采用60Hz的扫描检测频率通过触控屏来检测手写笔的输入信号。
其中,在终端处于图8中8a所示的Active-480Hz状态下,且终端未通过触控屏检测到手写笔的输入信号的时长大于预设时间(例如30秒、1分钟、2分钟或者更长)时,终端可以从图8中8a所示的Active-480Hz状态切换至图8中8b所示的Active-60Hz状态。在一种可能的情况下,在终端处于图8中8a所示的Active-480Hz状态下,且终端未通过触控屏检测到用户触摸操作的输入信号的时长大于预设时间(例如30秒、1分钟、2分钟或者更长)时,终端可以从图8中8a所示的Active-480Hz状态切换至图8中8c所示的Idle-480Hz状态。
在终端处于图8中8b所示的Active-60Hz状态下,且终端未通过触控屏检测到用户触摸操作的输入信号的时长大于上述第五时间时,终端可以从图8中8b所示的Active-60Hz状态切换至图8中8d所示的Idle-60Hz状态。在一种可能的情况下,在终端处于图8中8b所示的Active-60Hz状态下,若终端通过触控屏检测到手写笔的输入信号,终端可以从图8中8b所示的Active-60Hz状态,切换至图8中8a所示的Active-480Hz状态。
在终端处于图8中8c所示的Idle-480Hz状态下,且终端未通过触控屏检测到手写笔的输入信号的时长大于预设时间(例如30秒、1分钟、2分钟或者更长)时,终端可以从图8中8c所示的Idle-480Hz状态切换至图8中8d所示的Idle-60Hz状态。在一种可能的情况下,在终端处于图8中8c所示的Idle-480Hz状态下,若终端通过触控屏检测到用户触摸操作的输入信号,终端可以从图8中8c所示的Idle-60Hz状态切换至图8中8a所示的Active-480Hz状态。
在终端处于图8中8d所示的Idle-60Hz状态下,若终端通过触控屏检测到了用户触摸操作的输入信号,终端可以从图8中8d所示的Idle-60Hz状态,切换至图8中8b所示的Active-60Hz状态。在一种可能的情况下,在终端处于图8中8d所示的Idle-60Hz状态下,若终端通过触控屏检测到了手写笔的输入信号,终端可以从图8中8d所示的Idle-60Hz状态,切换至图8中8c所示的Idle-480Hz状态。在一种可能的情况下,在终端处于图8中8d所示的Idle-60Hz状态下,终端未通过触控屏检测到手写笔的输入信号并且也未通过触控屏检测到用户触摸操作的输入信号的时长大于预设时间(例如30秒、1分钟、2分钟或者更长)时,终端可以从图8中8d所示的Idle-60Hz状态切换至Sleep-5Hz状态(该Sleep-5Hz状态在图8中未示出,可以参考图7中的7c)。
在终端处于图8中8a所示的Active-480Hz状态下、或图8中8b所示的Active-60Hz状态下,或图8中8c所示的Idle-480Hz状态下、或图8中8d所示的Idle-60Hz状态下,若终端接收到用户的灭屏操作(如单次按下电源键)时,终端可以从图8中8a所示的Active-480Hz状态、或图8中8b所示的Active-60Hz状态,或图8中8c所示的Idle-480Hz状态,切换至Sleep-5Hz状态(该Sleep-5Hz状态在图8中未示出,可以参考图7中的7c)。
当终端处于Sleep-5Hz状态(该Sleep-5Hz状态在图8中未示出,可以参考图7中的7c)下,若终端通过触控屏检测到手写笔的输入信号时,终端可以从该Sleep-5Hz状态,切换至图8中8a所示的Active-480Hz状态。在一种可能的情况下,当终端处于Sleep-5Hz状态(该Sleep-5Hz状态在图8中未示出,可以参考图7中的7c)下,若终端接收到用户的亮屏操作(如在终端灭屏时单次按下电源键),终端可以从该Sleep-5Hz状态,切换到图8中8a所示的Active-480Hz状态。
请参见图9,图9中的9a示出了终端已开启手写笔功能且在Active-5Hz状态下显示出的主界面910。在图9的9a中,终端上没有手写笔的使用记录,即终端未接收到过手写笔的输入信号。其中,主界面910上可以包括有设置应用的图标911和其他应用(例如支付宝、记事本、音乐、微信、相机、拨号、信息、联系人等)图标。终端可以接收用户对主界面910上设置应用的图标911的触摸操作912(例如单击),响应于该触摸操作912,终端可以在触控屏上显示出如图9中9b所示的设置界面920。
其中,终端在接收到的手写笔输入信号之后,终端可以在存储器上存储该终端检测到了手写笔输入信号的事件,例如,当终端可以在存储器中用1比特大小的字段存储该终端检测到了手写笔输入信号的事件,若该1比特大小的字段的值为1,则表示终端上有手写笔的使用记录,若该1比特大小的字段的值为0,则表示终端上没有手写笔的使用记录。
如图9中的9b所示,终端已开启手写笔功能,且终端处于Active-5Hz状态,但终端上没有用户使用手写笔的使用记录。该设置界面920可以包括有智能辅助设置栏921和其他 设置栏(例如声音设置栏、通知中心设置栏、应用管理设置栏、电池设置栏、存储设置栏、安全与隐私设置栏、用户和账户设置栏等)。终端可以接收用户对设置界面920上智能辅助设置栏921的触摸操作922(例如单击),响应于该触摸操作922,终端可以在触控屏上显示出如图9中9c所示的智能辅助设置界面930。
如图9中的9c所示,终端已开启手写笔功能,且终端处于Active-5Hz状态,但终端上没有用户使用手写笔的使用记录。该智能辅助设置界面930可以包括有手写笔设置栏931和其他设置栏(例如智能识屏设置栏、单手操作设置栏、手势控制设置栏、语音控制设置栏、皮套模式设置栏、手套模式设置栏、定时开关机设置栏等)。其中,该手写笔设置栏931关联有手写笔设置控件932。在图9的9c中,该手写笔设置控件932为打开状态,即终端已开启手写笔功能。终端可以接收用户对智能辅助设置界面930上手写笔设置控件932的触摸操作933(例如单击),响应于该触摸操作933,终端关闭手写笔功能,终端从Active-5Hz状态切换如图9中9d所示的Active-0Hz状态。在图9中9d所示智能辅助设置界面940中手写笔设置控件942为关闭状态,即终端已关闭手写笔功能,终端在关闭手写笔功能之后不检测手写笔的输入信号。
其中,在该Active-0Hz状态下,终端可以采用120Hz互容检测频率和120Hz自容检测频率通过触控屏来检测用户触摸操作的输入信号,终端可以不检测手写笔的输入信号。若终端处于该Active-0Hz状态下,终端未检测到用户触摸操作的持续时长大于第一时间(例如30秒、1分钟、2分钟或者更长),则终端可以从Active-0Hz状态切换至Idle-0Hz状态,在该Idle-0Hz状态下,终端可以采用1Hz互容检测频率和120Hz自容检测频率通过触控屏来检测到用户触摸操作的输入信号,终端可以不检测手写笔的输入信号。在Idle-0Hz状态下,终端未检测到用户的触摸操作的输入信号的持续时长大于第二时间(例如30秒、1分钟、2分钟或者更长),则终端可以从Idle-0Hz状态切换到Sleep-0Hz状态。在该Sleep-0Hz状态下,终端不检测用户的触摸操作的输入信号,也不检测手写笔的输入信号。在一种可能的情况下,终端处于Idle-0Hz状态或者Sleep-0Hz状态下,若终端接收到用户的灭屏操作(如单次按下电源键)时,终端可以从Active-0Hz状态,或者Idle-0Hz状态切换到Sleep-0Hz状态。在一种可能的情况下,终端处于如图4中的4c所示的Sleep-0Hz状态下,若终端接收到用户的亮屏操作(如在终端灭屏时单次按下电源键),终端可以从Sleep-0Hz状态,切换到Active-0Hz状态。
请参见图10,图10中的10a示出了终端已开启手写笔功能且在Active-480Hz状态下显示出的主界面1010。其中,该主界面1010上可以包括有设置应用的图标1011和其他应用(例如支付宝、记事本、音乐、微信、相机、拨号、信息、联系人等)图标。终端可以接收手写笔的笔尖在主界面1010上设置应用的图标1011的输入操作1012(例如手写笔笔尖的单击),响应于该输入操作1012,终端可以在触控屏上显示出如图10中10b所示的设置界面1020。
如图10中的10b所示,终端已开启手写笔功能,且终端处于Active-480Hz状态。该设置界面1020可以包括有智能辅助设置栏1021和其他设置栏(例如声音设置栏、通知中心设置栏、应用管理设置栏、电池设置栏、存储设置栏、安全与隐私设置栏、用户和账户设置栏等)。终端可以接收手写笔的笔尖对设置界面1020上智能辅助设置栏1021的输入操作 1022(例如手写笔笔尖的单击),响应于该输入操作1022,终端可以在触控屏上显示出如图10中10c所示的智能辅助设置界面1030。
如图10中10c所示,终端已开启手写笔功能,且终端处于Active-480Hz状态,终端上有手写笔的使用记录,即终端有接收到过手写笔的输入信号(例如输入操作1012或输入操作1022所产生的输入信号)。该设置界面1030可以包括有手写笔设置栏1031和其他设置栏(例如智能识屏设置栏、单手操作设置栏、手势控制设置栏、语音控制设置栏、皮套模式设置栏、手套模式设置栏、定时开关机设置栏等)。其中,该手写笔设置栏1031关联有手写笔设置控件1032。在图10的10c中,该手写笔设置控件1032为打开状态,即终端已开启手写笔功能。终端可以接收手写笔的笔尖对智能辅助设置界面1030上手写笔设置控件1032的输入操作1033(例如手写笔笔尖的单击),响应于该输入操作1033,终端关闭手写笔功能,终端从Active-480Hz状态切换至如图10中10d所示的Active-0Hz状态。在图10的10d所示智能辅助设置界面1040中手写笔设置控件1042为关闭状态,即终端已关闭手写笔功能,终端在关闭手写笔功能之后不检测手写笔的输入信号。
请参见图11,图11中的11a示出了终端已关闭手写笔功能且在Active-0Hz状态下显示出的设置界面1110。终端上没有手写笔的使用记录,即终端没有接收到过手写笔的输入信号。其中,在Active-0Hz状态下,终端采用120Hz频率互容检测和120Hz频率自容检测的触摸检测状态检测用户在触控屏上的触摸输入操作,终端的触控屏上的触摸传感器不向触控芯片上报手写笔的输入信号引起触摸传感器上每根电极的电容值变化量。
其中,该设置界面1110上可以包括有手写笔设置栏1111和其他设置栏(例如智能识屏设置栏、单手操作设置栏、手势控制设置栏、语音控制设置栏、皮套模式设置栏、手套模式设置栏、定时开关机设置栏等)。其中,该手写笔设置栏1111关联有手写笔设置控件1112。在图11的11a中,该手写笔设置控件1112为关闭状态,即终端已关闭手写笔功能。终端可以接收用户对智能辅助设置界面1110上手写笔设置控件1112的触摸操作(例如手指点击),由于终端上没有手写笔的使用记录,响应于该触摸操作1112,终端可以从Active-0Hz状态切换至如图11中11b所示的Active-5Hz状态。在图11的11b所示智能辅助设置界面1120中手写笔设置控件1122为打开状态,即终端已打开手写笔功能。
图11中11c示出了终端已关闭手写笔功能且在Active-0Hz状态下显示出的设置界面1130。终端上有手写笔的使用记录,即终端接收到过手写笔的输入信号。其中,该设置界面1130上可以包括有手写笔设置栏1131和其他设置栏(例如智能识屏设置栏、单手操作设置栏、手势控制设置栏、语音控制设置栏、皮套模式设置栏、手套模式设置栏、定时开关机设置栏等)。其中,该手写笔设置栏1131关联有手写笔设置控件1132。在图11的11c中,该手写笔设置控件1132为关闭状态,即终端已关闭手写笔功能。终端可以接收用户对智能辅助设置界面1130上手写笔设置控件1132的输入操作(例如手指点击),由于终端上有手写笔的使用记录,响应于该输入操作1132,终端可以从Active-0Hz状态切换至如图11中11d所示的Active-480Hz状态。在图11中的11d所示智能辅助设置界面1140中手写笔设置控件1142为打开状态,即终端已打开手写笔功能。
请参见图12,图12中的12a示出了终端在Active-5Hz状态下显示出的重启界面1210。终端上没有手写笔的使用记录,即终端没有接收到过手写笔的输入信号。其中,该重启界 面1210包括有重启按钮1211和关机按钮1212。终端可以接收用户对重启界面1210上重启按钮1211的触摸操作1213(例如手指单击),响应于该触摸操作1213,终端可以进行重启,在重启之后,终端可以为图12中的12b示出的Active-5Hz状态。
图12c示出了终端在Active-480Hz状态下显示出的重启界面1230。终端上有手写笔的使用记录,即终端接收到过手写笔的输入信号。其中,该重启界面1230包括有重启按钮1231和关机按钮1232。终端可以接收手写笔对重启界面1230上重启按钮1231的输入操作1233(例如手写笔笔尖的点击),响应于该输入操作1233,终端可以进行重启,重启之后,终端可以为图12中12d示出的Active-480Hz。
请参见图13,图13中的13a示出了终端在Active-5Hz状态下显示出的还原出厂设置界面1310。终端上没有手写笔的使用记录,即终端在显示出图13中13a所示界面之前未接收到过手写笔的输入信号。其中,该还原出厂设置界面1310包括还原出厂设置按钮1311。终端可以接收用户对还原出厂设置按钮1311的触摸操作1312(例如手指单击),响应于该触摸操作1312,终端可以进行还原出厂设置。终端还原出厂设置可以包括所有网络设置、指纹、人脸信息、锁屏密码、手写笔功能设置等。在还原出厂设置之后,终端可以为图13中的13b示出的Active-5Hz状态。在图13中的13b示出的Active-5Hz状态下,终端上没有手写笔的使用记录。
图13c示出了终端在Active-480Hz状态下显示出的还原出厂设置界面1330。终端上有手写笔的使用记录,即终端在显示出图13中13c所示界面之前接收到过手写笔的输入信号。其中,该还原出厂设置界面1330包括有还原出厂设置按钮1331。终端可以接收手写笔对还原出厂设置界面1330上还原出厂设置按钮1331的输入操作1332(例如手写笔笔尖的点击),响应于该输入操作1332,终端可以进行还原出厂设置。终端还原出厂设置可以包括所有网络设置、指纹、人脸信息、锁屏密码、手写笔功能设置等。在还原出厂设置之后,终端可以为图13中的13d示出的Active-5Hz状态。在图13中的13d示出的Active-5Hz状态下,终端上没有手写笔的使用记录。
请参见图14,图14中的14a示出了终端在Sleep-5Hz状态下的触控屏1410。该触控屏1410可以是终端处于上述图6中6c、或上述图7中7c所示Sleep-5Hz状态下的触控屏。图14中的14a还示出了手写笔1411,该手写笔1411上有按键1412。如图14中14a所示,手写笔1411上的按键1412可以接收用户的输入操作1413(例如长按)。其中,当按键1412被按下时,手写笔的笔尖输出的信号会发生变化。终端可以接收被用户长按按键1412的手写笔1411在触控屏1410上的输入操作1414(例如笔尖单击),响应于该输入操作1414(例如笔尖单击),终端可以检测到该手写笔的笔尖输出的变化信号,终端可以从Sleep-5Hz状态切换至Active-480Hz状态,即终端以480Hz检测手写笔的输入信号,并在触控屏上显示出如图14中14b所示的备忘录编辑界面1420。如图14中14b所示,终端可以接收用户利用手写笔1421在备忘录编辑界面1420上的书写操作1423,响应于该书写操作1423,终端可以通过图片识别,识别出该书写操作1423的书写内容(例如文字),并保存该书写内容。
其中,不限于图14中的14a所示,终端还可以在触控屏处于亮屏、锁屏、或者在触控屏显示出主界面、APP应用界面的情况下,接收该被按下按键1414的手写笔1411的输入操作1414(例如笔尖单击屏幕),响应于该输入操作1414,终端可以自动打开可以进行文 本或涂鸦输入的APP,例如微信、短信、浏览器。终端可以进入备忘录编辑界面,并记录下手写笔的书写操作。其中,手写笔的上的按键1412在被按住之后,手写笔的笔尖可以输出与按键1412之前不同的信号,笔尖的输出的信号可以是电信号(例如30KHz~70KHz之间频率的信号),笔尖输出的信号中可以包括笔尖所感受到的压力、手写笔的按键状态和笔的ID序列号等信息。在一种可选的情况下,笔和终端可以有蓝牙等方式连接,手写笔检测到笔尖的接触触控屏之后,可以通过蓝牙告诉终端调节对手写笔的检测频率,并打开备忘录。
在一种可能的情况下,图14中的14c示出了终端在Sleep-5Hz状态下的触控屏1430。该触控屏1430可以是终端处于上述图6中6c、或上述图7中7c所示Sleep-5Hz状态下的触控屏。图14中的14c还示出了手写笔1431,该手写笔1431上有按键1432。如图14中14c所示,手写笔1431上的按键1432可以接收用户的输入操作1433(例如长按)。终端可以接收被用户长按按键1432的手写笔1431在触控屏1430上的输入操作1434(例如笔尖单击),响应于该输入操作1434(例如笔尖单击),终端可以从Sleep-5Hz状态切换至如图14的14d中所示的Sleep-480Hz状态,在该Sleep-480Hz状态下,终端可以保存手写笔1441的书写笔迹1443。
在一种可能的情况下,终端可以响应与该书写操作1423,以图片的形式保存该书写操作1423的书写笔迹。这样,终端可以在灭屏的情况下,当用户长按手写笔上的按键,通过手写笔点击终端的触控屏时,可以快速的记录下用户利用手写笔在触控屏上的书写内容,提供给用户快速记录的体验。
请参见图15,图15中的15a示出了终端在Active-480Hz状态下显示出的主界面1510。该主界面1510中可以包括一个或多个应用(例如支付宝、记事本、音乐、微信、设置、相机、拨号、信息、联系人等)图标。如图15中15a所示,手写笔1511上的按键1512可以接收用户的长按操作1513。终端可以接收被用户长按按键1512的手写笔1511在主界面上的输入操作1514(例如笔尖长按),响应于该输入操作1514(例如笔尖长按),终端可以开启智能识屏,该智能识屏的界面可以如图15中的15b所示。如图15中的15b所示,智能识屏界面1520中可以包括智能识别区域1525。其中,该智能识屏区域1525的大小可以调整。终端可以识别出智能识屏区域1525中的文字或图片,例如,终端识屏区域1525中的文字有“支付宝”、“记事本”、“音乐”、“微信”、“设置”、“相机”等。其中,不限于图15中15a所示的主界面1510,用户还可以利用手写笔在其他界面上开启智能识屏,在此不作限定。这样,当用户长按手写笔上的按键,通过手写笔长按终端的触控屏时,可以快速的打开智能识屏功能,提高了用户体验。
请参见图16,图16中的16a示出了终端在Active-480Hz状态下显示出的主界面1610。该主界面1610中可以包括一个或多个应用(例如支付宝、记事本、音乐、微信、设置、相机、拨号、信息、联系人等)图标。如图16中16a所示,手写笔1611上的按键1612可以接收用户的长按操作1613。终端可以接收被用户长按按键1612的手写笔1611在主界面上的输入操作1614(例如笔尖圈出主界面上的一块区域),响应于该输入操作1614(例如笔尖圈出主界面上的一块区域),终端可以开启截屏功能,截取出手写笔的笔尖在主界面1610 上圈出的一块区域,截屏界面可以如图16中的16b所示。如图16中的16b所示,截屏界面1620中可以包括手写笔的笔尖圈出的区域1624、分享按钮、编辑按钮、保存按钮等。在一种可能的情况下,终端可以接收被用户长按按键1612的手写笔1611在主界面1610上的双击操作,响应于该双击操作,终端可以开启截屏功能,截取终端当前显示屏上显示的主界面1610。其中,不限于图16中16a所示的主界面1610,用户还可以利用手写笔在其他界面上开启截屏功能,在此不作限定。这样,当用户长按手写笔上的按键,通过手写笔在触控屏上圈出一块区域或者通过手写笔的笔尖在触控屏上双击屏幕时,可以快速的开启截屏功能,提高了用户体验。
请参见图17,图17中的17示出了终端在Active-480Hz状态下显示出的主界面1710。该主界面1710中可以包括一个或多个应用(例如支付宝、记事本、音乐、微信、设置、相机、拨号、信息、联系人等)图标。如图17中17a所示,手写笔1711上的按键1712可以接收用户的长按操作1714。终端可以接收被用户长按按键1712的手写笔1711在主界面1610上的输入操作1714(例如笔尖在触控屏中央划横线),响应于该输入操作1714(例如笔尖在触控屏中央划横线),终端可以开启分屏功能,终端分屏之后的界面可以如图17中17b所示。如图17中的17b所示,分屏之后的两个界面可以是音乐播放界面1720和相册应用界面1730。其中,不限于图17中17a所示的主界面1710,用户还可以利用手写笔在其他界面上开启分屏功能,在此不作限定。这样,当用户长按手写笔上的按键,通过手写笔在触控屏上的中央划横线时,可以快速的开启分屏功能,提高了用户体验。
在一种可能的情况下,终端接收用户的输入操作,响应于该输入操作,终端可以关闭手写笔功能,在终端关闭手写笔功能的状态下,终端可以通过第一频率(例如5Hz)来检测手写笔的输入信号。
请参见图18,如图18中的18a所示,终端已开启手写笔功能,且终端处于Active-5Hz状态,但终端上没有用户使用手写笔的使用记录。该智能辅助设置界面1810可以包括有手写笔设置栏1811和其他设置栏(例如智能识屏设置栏、单手操作设置栏、手势控制设置栏、语音控制设置栏、皮套模式设置栏、手套模式设置栏、定时开关机设置栏等)。其中,该手写笔设置栏1811关联有手写笔设置控件1812。在图18的18a中,该手写笔设置控件1812为打开状态,即终端已开启手写笔功能。终端可以接收用户对智能辅助设置界面1810上手写笔设置控件1812的触摸操作1813(例如单击),响应于该触摸操作1813,终端关闭手写笔功能,终端保持Active-5Hz状态。在图18中18b所示智能辅助设置界面1820中手写笔设置控件1822为关闭状态,即终端已关闭手写笔功能。在终端关闭手写笔功能的状态下,即图18的18a中的手写笔设置控件1812为关闭状态,终端以第一频率(例如5Hz)的检测频率,来检测手写笔的输入信号。在手写笔设置控件1812为关闭状态,终端以第一频率(例如5Hz)的检测频率检测手写笔的输入信号的情况下,若终端接收到手写笔对触控屏的输入操作(例如点击),响应于手写笔的该输入操作(例如点击),终端以480Hz频率检测手写笔的输入信号。
如图18中的18c所示,终端已开启手写笔功能,且终端处于Active-480Hz状态,但终端上没有用户使用手写笔的使用记录。该智能辅助设置界面1830可以包括有手写笔设置栏 1831和其他设置栏(例如智能识屏设置栏、单手操作设置栏、手势控制设置栏、语音控制设置栏、皮套模式设置栏、手套模式设置栏、定时开关机设置栏等)。其中,该手写笔设置栏1831关联有手写笔设置控件1832。在图18的18c中,该手写笔设置控件1832为打开状态,即终端已开启手写笔功能。终端可以接收用户对智能辅助设置界面1830上手写笔设置控件1832的触摸操作1833(例如单击),响应于该触摸操作1833,终端关闭手写笔功能,终端从Active-480Hz状态切换至Active-5Hz状态。在图18中18d所示智能辅助设置界面1840中手写笔设置控件1842为关闭状态,即终端已关闭手写笔功能,终端在关闭手写笔功能之后可以以5Hz的检测频率,来检测手写笔的输入信号。
这样,终端可以在保证用户在首次使用手写笔时,可以快速的响应用户的手写笔输入操作,提高了用户体验。
在一种可能的情况下,终端开启手写笔功能时,终端可以对手写笔进行验证。在验证成功之后,终端可执行上述图14、图15、图16、图17所示的手写笔功能。
请参见图19,如图19中的19a所示,终端已关闭手写笔功能,处于Active-0Hz状态。该设置界面1910可以包括有智能辅助设置栏1911和其他设置栏(例如声音设置栏、通知中心设置栏、应用管理设置栏、电池设置栏、存储设置栏、安全与隐私设置栏、用户和账户设置栏等)。终端可以接收用户对智能辅助设置栏1911的触摸操作1912(例如点击),响应于该触摸操作1912,终端可以在触控屏上显示出如图19中19b所示的智能辅助设置界面1920。该智能辅助设置界面1920中可以包括有手写笔设置栏1921和其他设置栏(例如智能识屏设置栏、单手操作设置栏、手势控制设置栏、语音控制设置栏、皮套模式设置栏、手套模式设置栏、定时开关机设置栏等)。终端可以接收用户对手写笔设置栏1921的触摸操作1922(例如点击),响应于该触摸操作1912(例如点击),终端以480Hz频率检测手写笔的输入信号,并且终端显示如图19中19c所示的手写笔设置界面1930。该手写笔设置界面1930显示有手写笔功能的介绍(例如提笔速记)和验证弹窗1940。如图19的19c所示,验证弹窗1940中包括有实心圆1941、空心圆1942,终端可以接收手写笔1943对实心圆1941的输入操作1944(如笔尖拖动空心圆1941到空心圆1942的位置处),响应于该输入操作1944,终端对手写笔的验证成功,并弹出如图19的19d中所示的验证成功弹窗1950,该验证成功弹窗1950可以提示用户已完成对手写笔的验证。在验证成功之后,终端可以可执行上述图14、图15、图16、图17所示的手写笔功能。在一种可能的情况下,终端若检测到用户的手指拖动实心圆1941,当用户的手指拖动实心圆到指定范围(未到空心圆1942的位置处)之后,实心圆1941回到起点。当手写笔1943对实心圆1941的输入操作1944中途退出时,验证失败,再次进入验证界面1930时,弹出验证弹窗1940,直至手写笔验证成功开启。
终端可以在手写笔验证成功后,才会启用提笔速记等功能。操作手写笔上的按键,靠近终端,终端会自动显示备忘录界面。若验证未成功,则操作手写笔上的按键,靠近终端,终端不会自动显示备忘录界面。
参见图20,图20为本申请实施例提供的一种手写笔系统架构图。如图19所示,本申 请中的手写笔系统设计的器件或模块包括手写笔、触控芯片、驱动系统、输入系统、事件汇聚层、底层信息读取、应用等软硬件架构。其中,本申请的手写笔为主动式电容手写笔。触控芯片主要包括数字前端和模拟后端等芯片模块,负责处理驱动系统中发送和接收物理检测通道中发出和获取的容值信号进行处理和放大。
该手写笔的启用流程可以如下:
1、手写笔执行启用操作,如按下物理按键、划线、单击、双击等动作。
2、终端在驱动系统中完成笔的注册和进程运行。
3、终端激励下发到事件汇报层(event hub),底层信息读取按键按压或释放信息后,根据不同的触控笔(pen stylus)事件和报点信息。
4、终端响应不同的APP应用,例如,手写笔双击屏幕、手写笔在按键被按下时单击屏幕,终端可以启动记事本应用。又例如,手写笔在按键被按下时双击屏幕,终端可以启动截屏功能。又例如,手写笔在按键被按下时在屏幕上划横线,终端可以启动分屏功能。又例如,手写笔在按键被按下时笔尖长按屏幕,终端可以启动识屏功能。以上示例仅仅用于解释本申请,不应构成限定。
参见图21,图21为本申请实施例提供的一种手写笔智能开关的状态图。如图21所示,本申请的手写笔智能开关涉及的三态(state)开关包括S1:正常频率检测;S2:5Hz低频检测;S3:完全关闭。二态可选择(choice)包括C1:开(默认状态)和C2:关。一态无感知,对应S2:5Hz低频检测,当有笔用户首次使用开启后,终端即切换为正常频率检测,为亚稳定状态。
参见图22,图22为本申请实施例提供的一种手写笔智能开关的状态图。如图22所示,本申请的手写笔智能开关主要包括以下场景状态的切换:
1、起始状态为低频检测。
2、首次使用开启,采用正常频率检测。
3、有笔用户保持正常频率检测为常态。
4、当终端开启重启后,依然保持正常频率检测。
5、当终端恢复出厂设置时,恢复低频检测状态。
6、不需要用笔的用户担心功耗时,终端可以接收用户的输入,将开关关闭。
7、当终端接收用户的输入再次打开开关时,终端可以区分该用户是否有手写笔的使用历史,如果有的话,则终端切换为高频检测状态。
8、如果终端上无手写笔的使用历史,则终端切换为低频检测状态,即起始状态。
通过本申请图22所示实施例,终端可以在有笔用户首次使用手写笔时,开启手写笔功能,记录下用户已使用手写笔,并保持高频检测手写笔的输入信号;终端上没有用户使用手写笔的记录时,可以保持低频检测手写笔的输入信号;终端开机或重启时,可以保持开机或重启之前的检测状态;终端恢复出厂设置时,可以恢复到起始状态;终端在关闭手写笔功能时,可以不检测手写笔的输入信号;若终端上有用户使用手写笔的记录,当终端开启手写笔功能时,终端可以高频检测手写笔的输入信号;若终端上没有用户使用手写笔的记录,当终端开启手写笔功能时,终端可以低频检测手写笔的输入信号。终端通过实现上 述多种场景下的检测状态,可以实现用户体验和功耗的平衡。
参见图23,图23为本申请实施例提供的一种触控器件工作状态切换图。如图23所示,该触控器件的工作状态切换图可以如下所示:
1、起始状态为状态Q1:Active-5Hz状态,以5Hz频率检测是否有笔。
2、当有笔靠近时,终端的手写笔开关打开,触控器件进入Q4:Active-480Hz状态。
3、若没有触摸(No Touch)事件发生时,触控器件进入Q2:Idle-5Hz状态,以5Hz频率检测笔,有触摸(Touch)事件时返回Active-5Hz状态。
4、灭屏时触控器件进入Q3:Sleep-5Hz状态,即睡眠状态。
5、当有笔靠近时,触控器件从Q2:Idle-5Hz状态和Q3:Sleep-5Hz状态,都可以切换至Active-480Hz状态。
6、触控器件进入Q4:Active-480Hz以后,没有触摸(No Touch)事件发生时,触控器件切换至Q5:Idle-60Hz状态;有触摸事件发生时,触控器件返回Q4:Active-480Hz状态。
7、终端灭屏时,触控器件由Q5:Idle-60Hz状态,进入Sleep-5Hz状态。
8、有笔靠近时,触控器件由Q5:Idle-60Hz状态,和Q6:Sleep-5Hz状态,都可以进入Q4:Active-480Hz状态。
9、当终端的手写笔功能开关关闭时,由Q4:Active-480Hz状态恢复到起始状态,即Q1:Active-5Hz。
其中,在图23所示实施例中未详细描述的内容可以参考上述图6、图7所述实施例,在此不作赘述。
通过本申请图23所示实施例提供的三态开关,二态可选择,一态无感知,根据用户行为智能切换的开关设计方式,终端可以以低功耗,实现用户手指和手写笔的多种操作行为的智能开关切,保障了用户的体验。
参见图24,图24为本申请实施例提供的一种手写笔智能开关的状态图。如图24所示,终端上默认关闭手写笔功能,在终端关闭手写笔功能时,终端可以以低频率(如5Hz)检测手写笔的输入信号。若终端上没有用户使用手写笔的记录,则终端保持低频率(如5Hz)检测手写笔的输入信号。若终端上有用户使用手写笔的记录,则当有笔用户开启手写笔开关时,终端上的触控器件可以以正常频率检测手写笔的输入信号。
通过本申请图24所示的手写笔智能开关的状态图,终端可以保证用户在首次使用手写笔时,可以快速的响应用户的手写笔输入操作,提高了用户体验。
参见图25,图25是本申请实施例提供的一种手写笔输出的信号示意图。如图25所示,手写笔的笔尖输出的信号可以采用固定双频点传输,笔尖可以分时传送双频点信号,其中,同步信号的频点可以分别为同步信号1和同步信号3的频点可以为f1=176.37KHz,同步信号2和同步信号4的频点可以为f2=252.49KHz。笔尖的显示脉冲信号ink(例如ink1、ink2、ink3、ink4等)的值若为1,则表示终端需显示出笔尖的书写痕迹,若,脉冲信号ink(例 如ink1、ink2、ink3、ink4等)的值为0,则表示笔尖的在终端的触控屏为悬浮状态。脉冲信号a0-a11可以表征手写笔4096级笔压力的触感,脉冲信号a12可以表征手写笔上按键1是否被按下(例如,脉冲信号a12的值若为1,则按键1被按下,脉冲信号a12的值若为0,则按键1未被按下),脉冲信号a12可以表征手写笔上按键1是否被按下(例如,脉冲信号a13的值若为1,则按键2被按下,脉冲信号a13的值若为0,则按键2未被按下)。脉冲信号b0-b11可以表征手写笔4096级笔压力的触感。脉冲信号b12可以表征手写笔上按键1是否被按下(例如,脉冲信号b12的值若为1,则按键1被按下,脉冲信号b12的值若为0,则按键1未被按下),脉冲信号b12可以表征手写笔上按键1是否被按下(例如,脉冲信号b13的值若为1,则按键2被按下,脉冲信号b13的值若为0,则按键2未被按下)。手写笔通过这种双频点的工作方式,可以提升抗噪声能力,防止固定频点被其他杂讯信号干扰。
在一种可能的情况下,终端在检测手写笔的输入信号时,由于有噪声的干扰(例如终端在充电时的噪声干扰),终端可能会将噪声干扰误认为是手写笔的输入信号,而进行手写笔检测频率的切换。终端滤除噪声干扰带来的误操作,可以采用如下方案:
1、由于噪声是突发的,噪声的持续时间较短,则终端在检测手写笔的输入信号时,可以判断检测到的信号的持续时间是否小于预设时间,若小于预设时间,则终端可以判定该检测到的信号为噪声信号,则终端可以忽略该噪声信号,不执行手写笔检测频率的切换的动作。例如,终端在以5Hz的频率检测手写笔的输入信号时,手写笔的笔尖输出的信号的两个频点耦合时间为T(例如T=2*4167us),终端通过触控屏检测到了信号1,终端可以判断该信号1的持续时间是否小于T,若是,则终端可以忽略该信号1,不执行手写笔检测频率的切换,继续以5Hz的频率检测手写笔的输入信号。
2、由于噪声是随机产生的,所以触控传感器接收到噪声信号的坐标范围是小范围的,小于手写笔的笔尖在触控传感器上的接触范围。因此,则终端在检测手写笔的输入信号时,可以判断检测到的信号的接收坐标位置的形成的区域是否小于预设范围,若小于预设范围,则终端可以判断该检测到的信号为噪声信号,则终端可以忽略该噪声信号,不执行手写笔检测频率的切换的动作。例如,终端在以5Hz的频率检测手写笔的输入信号时,笔尖在传感器上的接触区域可以是触控传感器上3个相邻坐标点区域的范围大小,终端通过触控屏检测到了信号2,可以判断信号2的接收坐标位置形成的区域是否小于触控传感器上3个相邻坐标点区域的范围大小,若是,则终端可以忽略该信号2,不执行手写笔检测频率的切换,继续以5Hz的频率检测手写笔的输入信号。
上述本实施例提供的两种滤除噪声的方案,终端可以单独执行,也可以结合执行。通过上述滤除噪声的方案,终端可以防止由于噪声引起的而引起的误操作,节省了终端的功耗。
请参见图26,图26为本申请实施例提供的一种手写笔检测方法的流程示意图。如图26所示,该方法可以包括:
S2601、终端以第一频率检测手写笔的输入信号。
示例性的,第一频率的取值范围可以是2Hz~10Hz,具体实现中,第一频率可以是如上述实施例中终端处于Active-5Hz状态、Idle-5Hz状态或Sleep-5Hz状态时,终端对手写笔的输入信号的检测频率,即第一频率可以是5Hz。其中,终端对手写笔的检测过程可以参考 上述图3、图4、图5所示的实施例,在此不再赘述。
S2602、终端通过触控屏接收手写笔的第一输入。
S2603、响应于第一输入,终端以第二频率检测手写笔的输入信号。
示例性的,第二频率的取值范围可以是300Hz~600Hz,具体实现中,第一频率可以是如上述实施例中终端处于Active-480Hz状态、Idle-480Hz状态或Sleep-480Hz状态时,终端对手写笔的输入信号的检测频率。即第二频率可以是480Hz。
示例性的,手写笔的第一输入可以是手写笔的笔尖点击屏幕、滑动长按、双击、拖动等输入,终端接收了手写笔的第一输入,即终端检测到了手写笔的输入信号。如图7中7c所示的Sleep-5Hz状态下,手写笔的笔尖点击屏幕之后,终端可以通过触控屏检测到手写笔的输入信号,终端可以从图7中7c所示的Sleep-5Hz状态,切换至图7中7a所示的Active-480Hz状态。手写笔的第一输入还可以是如图14的14a中所示的输入操作1414,还可以是如图14的14c中所示的输入操作1434。示例仅仅由于解释本申请,不应构成限定。具体内容,可以参考前述实施例,在此不再赘述。
S2604、若终端以第二频率检测手写笔的输入信号,且终端未检测到手写笔的输入信号的持续时长大于第一时间,则终端以第三频率检测手写笔的输入信号。其中,该第二频率大于该第三频率大于该第一频率。
示例性的,第二频率的取值范围可以是30Hz~100Hz,具体实现中,第一频率可以是如上述实施例中终端处于Active-60Hz状态或Idle-60Hz状态时,终端对手写笔的输入信号的检测频率。即第三频率可以是60Hz。
示例性的,第一时间可以是30秒、1分钟、2分钟或者更长等。如图7所示,终端处于图7中7a所示Active-480Hz的情况下,终端以第二频率(480Hz)检测手写笔的输入信号,若终端未检测到手写笔的输入信号的持续时长大于第一时间(30s),则终端可以处于图7中7b所示Idle-60Hz状态,以第三频率(60Hz)检测手写笔的输入信号。如图8,终端处于8a所示Active-480Hz的情况下,终端以第二频率(480Hz)检测手写笔的输入信号,若终端未检测到手写笔的输入信号的持续时长大于第一时间(30s),终端可以处于图8中8b所示Active-60Hz状态,以第三频率(60Hz)检测手写笔的输入信号。如图8,终端处于8c所示Idle-480Hz的情况下,终端以第二频率(480Hz)检测手写笔的输入信号,若终端未检测到手写笔的输入信号的持续时长大于第一时间(30s),终端可以处于图8中8d所示Idle-60Hz状态,以第三频率(60Hz)检测手写笔的输入信号。示例仅仅用于解释本申请,不应构成限定。
通过本申请实施例,终端可以以低频(第一频率)检测手写笔的输入信号,当检测到手写笔的输入信号时,可以快速的切换至高频(第二频率)检测手写笔的输入信号,以达到快速使用手写笔的用户体验。当终端处于高频(第二频率)检测手写笔的输入信号时,若在终端一段时间(例如30s~60s)未检测到手写笔的输入信号,终端可以将检测频率降低中频(第三频率),省功耗的等待手写笔的输入信号的再次到来,以便在手写笔的输入信号再次到来时,终端可以快速的回到高频(第二频率)状态作出响应,快速执行再次到来的手写笔的输入信号对应的动作,提高了用户的体验。
在一种可能的情况下,在终端以第三频率检测所述手写笔的输入信号情况下,若终端 未检测到手写笔的输入信号的持续时长大于第二时间,则终端以第一频率检测手写笔的输入信号。也即是说,在长时间没有手写笔的输入信号到来时,终端可以降低对手写笔的输入信号的检测频率,以节省功耗。
示例性的,第二时间可以是30秒、1分钟、2分钟或者更长等。例如,第一频率为5Hz,第三频率为60Hz。如图7中的7b、7c所示,在终端处于图7中7b所示的Idle-60Hz状态下(Idle-60Hz状态下,终端以60Hz的频率检测手写笔的输入信号),若终端未通过触控屏检测到手写笔的输入信号并且也未通过触控屏检测到用户触摸操作的输入信号的时长大于第二时间(例如30秒、1分钟、2分钟或者更长)时,终端可以从图7中7b所示的Idle-60Hz状态切换至图7中7c所示的Sleep-5Hz状态(Sleep-5Hz状态,终端以5Hz的频率检测手写笔的输入信号)。终端对手写笔的输入信号的检测频率从第三频率切换至第一频率,详细可以参考其他实施例,在此不再赘述。
在一种可能的情况下,在终端以第三频率检测所述手写笔的输入信号的情况下,若终端接收到了手写笔的第二输入,响应于手写笔的第二输入,终端以第二频率检测手写笔的输入信号。也即是说,在当手写笔的输入信号再次到来时,终端可以提高对手写笔的输入信号的检测频率,以便终端可以快速的对手写笔的输入信号作出相应的响应动作。
示例性的,手写笔的第二输入可以是手写笔的笔尖点击屏幕、滑动长按、双击、拖动等输入,终端接收了手写笔的第二输入,即终端检测到了手写笔的输入信号。第二频率可以是480Hz,第三频率可以是60Hz。如图7中7b所示的Idle-60Hz状态(Idle-60Hz状态下,终端以60Hz的频率检测手写笔的输入信号)下,手写笔的笔尖点击屏幕之后,终端通过触控屏检测到了手写笔的输入信号,终端可以从图7中7b所示的Idle-60Hz状态,切换至图7中7a所示的Active-480Hz状态(Active-480Hz状态下,终端以480Hz的频率检测手写笔的输入信号)。如图8中8b所示的Active-60Hz状态下(Active-60Hz状态下,终端以60Hz的频率检测手写笔的输入信号),手写笔的笔尖点击屏幕之后,终端通过触控屏检测到了手写笔的输入信号,终端可以从图8中8b所示的Active-60Hz状态,切换至如图8中8a所示的Active-480Hz状态。如图8中8d所示的Idle-60Hz状态下(Idle-60Hz状态下,终端以60Hz的频率检测手写笔的输入信号),手写笔的笔尖点击屏幕之后,终端通过触控屏检测到了手写笔的输入信号,终端可以从图8中8d所示的Idle-60Hz状态,切换至如图8中8c所示的Idle-480Hz状态(Idle-480Hz状态下,终端以480Hz的频率检测手写笔的输入信号)。示例仅仅由于解释本申请,不应构成限定。具体内容,可以参考前述实施例,在此不再赘述。
在一种可能的情况下,在终端以第二频率检测手写笔的输入信号的情况下,终端接收用户的第三输入。响应于第三输入,终端熄灭触控屏,并以第一频率检测所述手写笔的输入信号。也即是说,在终端处于高频(第二频率)检测手写笔的输入信号时,若终端灭屏,终端可以以低频检测手写笔的输入信号,节省了功耗,还能够在用户能够在灭屏时,响应手写笔的输入信号,执行响应的动作,提高了用户的手写笔使用体验。
示例性的,第三输入可以是用户的灭屏操作,如(单次按下电源键),例如,在终端以480Hz的频率检测手写笔的输入信号时,终端接收用户的灭屏操作,响应于灭屏操作,终端对手写笔的检测频率从480Hz切换至5Hz。具体内容可以参考前述图7和图8所示实施 例,在此不再赘述。
在一种可能的情况下,在终端以第三频率检测手写笔的输入信号的情况下,终端接收用户的第四输入。响应于第四输入,终端熄灭触控屏,并以第一频率检测手写笔的输入信号。也即是说,在终端处于中频(第三频率)检测手写笔的输入信号时,若终端灭屏,终端可以以低频检测手写笔的输入信号,节省了功耗,还能够在用户能够在灭屏时,响应手写笔的输入信号,执行响应的动作,提高了用户的手写笔使用体验。
示例性的,第四输入可以是用户的灭屏操作,如(单次按下电源键),例如,在终端以60Hz的频率检测手写笔的输入信号时,终端接收用户的灭屏操作,响应于灭屏操作,终端对手写笔的检测频率从60Hz切换至5Hz。具体内容可以参考前述图7和图8所示实施例,在此不再赘述。
在一种可能的情况下,在终端以第二频率检测手写笔的输入信号时,终端通过触控屏以第一检测状态检测用户的触摸输入。其中,在第一检测状态下,终端以第四频率的互容检测方式和第五频率的自容检测方式,来检测用户的触摸输入。
示例性的,第一检测状态可以是前述实施例中的Active状态。第四频率可以是120Hz,第五频率可以是120Hz。终端处于Active-480Hz下,在Active-480Hz状态下,终端可以采用120Hz互容检测频率和120Hz自容检测频率通过触控屏来检测触摸操作的输入信号,终端可以采用480Hz的扫描检测频率来通过触控屏检测手写笔的输入信号。其中,第四频率和第五频率还可以为其他值。具体内容,可以参考前述实施例,在此不再赘述。
在一种可能的情况下,在终端以第三频率检测手写笔的输入信号的时,终端通过触控屏以第二检测状态检测用户的触摸输入;其中,在第二检测状态下,终端以第六频率的互容检测方式和第七频率的自容检测方式,检测用户的触摸输入。
示例性的,第二检测状态可以是前述实施例中的Idle状态,第六频率可以是1Hz,第七频率可以是120Hz。在Idle-60Hz状态下,终端可以采用1Hz互容检测频率和120Hz自容检测频率来检测触摸操作的输入信号,终端可以采用60Hz的扫描检测频率通过触控屏来检测手写笔的输入信号。其中,第六频率和第七频率还可以为其他值。具体内容,可以参考前述实施例,在此不再赘述。
在一种可能的情况下,在所述终端熄灭所述触控屏的条件下,所述方法还包括:所述终端停止对所述用户的触摸输入的检测。
示例性的,在Sleep-5Hz状态下,终端可以不检测用户在触控屏上的触摸操作的输入信号,终端可以采用5Hz的扫描检测频率通过触控屏来检测手写笔的输入信号。具体内容可以参考前述实施例,在此不再赘述。
在一种可能的情况下,在所述终端熄灭所述触控屏,且以第一频率检测所述手写笔的输入信号的条件下,所述终端接收所述手写笔的第五输入。响应于所述第五输入,所述终端以所述第二频率检测所述手写笔的输入信号,并保存所述第五输入的书写内容;其中,所述书写内容包括所述手写笔的书写笔迹或所述终端从所述手写笔的书写笔迹中识别出的文字信息。
示例性的,手写笔的第五输入可以是前述图14的14a中所示实施例的输入操作1414,还可以是前述图14的14c中所示实施例的输入操作1434。详细内容可以参考前述图14所 示实施例,在此不再赘述。
在一种可能的情况下,终端接收所述用户的第六输入。响应于第六输入,终端停止对手写笔的输入信号的检测,或,终端以所述第一频率检测手写笔的输入信号。
示例性的,第六输入可以是前述图9的9c所示的触摸操作933,还可以是前述图10的10c所示的手写笔输入操作1033。详细内容可以参考前述图9或图10所示实施例,在此不再赘述。
在一种可能的情况下,在终端停止对手写笔的输入信号的检测的条件下,终端接收所述用户的第七输入。响应于第七输入,终端判断在终端在接收所述第七输入之前是否接收到过手写笔的输入信号,若是,则终端以第二频率检测手写笔的输入信号,若否,则终端以所述第一频率检测手写笔的输入信号。
示例性的,第七输入可以是前述图11的11a所示的触摸操作1113,还可以是前述图11的11c所示的触摸操作1133。详细内容可以参考前述图11所示实施例,在此不再赘述。
在一种可能的情况下,终端接收用户的第八输入。响应于第八输入,终端恢复出厂设置,并以第一频率检测所述手写笔的输入信号。
示例性的,第八输入可以是前述图13的13a所示的触摸操作1312,还可以是前述图13的13c中所示的手写笔的输入操作1332。详细内容可以参考前述图13所示实施例,在此不再赘述。
在一种可能的情况下,终端接收用户的第九输入。响应于第九输入,终端进行重启,其中,终端在重启之前检测手写笔的输入信号的频率与在重启之后检测手写笔的输入信号的频率相同。
示例性的,第九输入可以是前述图12的12a所示的触摸操作1213,还可以是前述图12的12c中所示的手写笔的输入操作1233。详细内容可以参考前述图12所示实施例,在此不再赘述。
以上所述,以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。

Claims (16)

  1. 一种手写笔检测方法,其特征在于,包括:
    终端以第一频率检测手写笔的输入信号;
    所述终端通过触控屏接收所述手写笔的第一输入;
    响应于所述第一输入,所述终端以第二频率检测所述手写笔的输入信号;
    在所述终端以第二频率检测所述手写笔的输入信号,且所述终端未检测到手写笔的输入信号的持续时长大于第一时间,则终端以第三频率检测所述手写笔的输入信号;其中,所述第二频率大于所述第三频率大于所述第一频率。
  2. 根据权利要求1所述方法,其特征在于,所述方法包括:在所述终端以第三频率检测所述手写笔的输入信号情况下,若所述终端未检测到手写笔的输入信号的持续时长大于第二时间,则终端以第一频率检测所述手写笔的输入信号。
  3. 根据权利要求1所述方法,其特征在于,所述方法还包括:
    在所述终端以第三频率检测所述手写笔的输入信号的情况下,若所述终端接收到了所述手写笔的第二输入,响应于所所述手写笔的第二输入,所述终端以第二频率检测所述手写笔的输入信号。
  4. 根据权利要求1所述方法,其特征在于,所述方法还包括:
    在所述终端以第二频率检测手写笔的输入信号的情况下,所述终端接收用户的第三输入;
    响应于所述第三输入,所述终端熄灭所述触控屏,并以所述第一频率检测所述手写笔的输入信号。
  5. 根据权利要求1所述方法,其特征在于,所述方法还包括:
    在所述终端以第三频率检测手写笔的输入信号的情况下,所述终端接收用户的第四输入;
    响应于所述第四输入,所述终端熄灭所述触控屏,并以第一频率检测所述手写笔的输入信号。
  6. 根据权利要求1所述方法,其特征在于,在所述终端以第二频率检测手写笔的输入信号时,所述方法还包括:
    所述终端通过所述触控屏以第一检测状态检测用户的触摸输入;其中,在第一检测状态下,所述终端以第四频率的互容检测方式和第五频率的自容检测方式,来检测所述用户的触摸输入。
  7. 根据权利要求1所述方法,其特征在于,在所述终端以第三频率检测手写笔的输入信号的时,所述方法还包括:
    所述终端通过所述触控屏以第二检测状态检测用户的触摸输入;其中,在第二检测状态下,所述终端以第六频率的互容检测方式和第七频率的自容检测方式,检测所述用户的触摸输入。
  8. 根据权利要求3或4所述方法,其特征在于,在所述终端熄灭所述触控屏的条件下,所述方法还包括:
    所述终端停止对所述用户的触摸输入的检测。
  9. 根据权利要求3或4所述方法,其特征在于,所述方法还包括:
    在所述终端熄灭所述触控屏,且以第一频率检测所述手写笔的输入信号的条件下,所述终端接收所述手写笔的第五输入;
    响应于所述第五输入,所述终端以所述第二频率检测所述手写笔的输入信号,并保存所述第五输入的书写内容;其中,所述书写内容包括所述手写笔的书写笔迹或所述终端从所述手写笔的书写笔迹中识别出的文字信息。
  10. 根据权利要求1所述方法,其特征在于,所述方法还包括:
    所述终端接收所述用户的第六输入;
    响应于所述第六输入,所述终端停止对所述手写笔的输入信号的检测,或,所述终端以所述第一频率检测所述手写笔的输入信号。
  11. 根据权利要求1或9所述方法,其特征在于,所述方法还包括:
    在所述终端停止对所述手写笔的输入信号的检测的条件下,所述终端接收所述用户的第七输入;
    响应于所述第七输入,所述终端判断在所述终端在接收所述第七输入之前是否接收到过所述手写笔的输入信号,若是,则所述终端以第二频率检测所述手写笔的输入信号,若否,则所述终端以所述第一频率检测所述手写笔的输入信号。
  12. 根据权利要求1所述方法,其特征在于,所述方法还包括:
    所述终端接收所述用户的第八输入;
    响应于所述第八输入,所述终端恢复出厂设置,并以第一频率检测所述手写笔的输入信号。
  13. 根据权利要求1所述方法,其特征在于,所述方法还包括:
    所述终端接收用户的第九输入;
    响应于所述第九输入,所述终端进行重启,其中,所述终端在重启之前检测所述手写笔的输入信号的频率与在重启之后检测所述手写笔的输入信号的频率相同。
  14. 一种终端,其特征在于,包括:一个或多个处理器、一个或多个存储器;所述一 个或多个存储器与所述一个或多个处理器耦合,所述一个或多个存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,当所述一个或多个处理器执行所述计算机指令时,所述终端执行如权利要求1-13任一项所述的手写笔检测方法。
  15. 一种计算机存储介质,其特征在于,包括计算机指令,当所述计算机指令在终端上运行时,使得所述终端执行如权利要求1-13任一项所述的手写笔检测方法。
  16. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-13任一项所述的手写笔检测方法。
PCT/CN2018/109226 2018-09-30 2018-09-30 手写笔检测方法、系统及相关装置 WO2020062310A1 (zh)

Priority Applications (7)

Application Number Priority Date Filing Date Title
EP18935164.6A EP3835928A4 (en) 2018-09-30 2018-09-30 PEN, SYSTEM AND ASSOCIATED DEVICE DETECTION METHOD
CN201880097989.9A CN112740152B (zh) 2018-09-30 2018-09-30 手写笔检测方法、系统及相关装置
PCT/CN2018/109226 WO2020062310A1 (zh) 2018-09-30 2018-09-30 手写笔检测方法、系统及相关装置
CA3113132A CA3113132A1 (en) 2018-09-30 2018-09-30 Stylus detection method, system, and related apparatus
AU2018456082A AU2018456082B2 (en) 2018-09-30 2018-09-30 Stylus detection method, system, and related device
JP2021517691A JP7397861B2 (ja) 2018-09-30 2018-09-30 スタイラスペン検出方法、システムおよび関連装置
US17/281,187 US11899879B2 (en) 2018-09-30 2018-09-30 Stylus detection method, system, and related apparatus for switching frequencies for detecting input signals

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/109226 WO2020062310A1 (zh) 2018-09-30 2018-09-30 手写笔检测方法、系统及相关装置

Publications (1)

Publication Number Publication Date
WO2020062310A1 true WO2020062310A1 (zh) 2020-04-02

Family

ID=69953587

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/109226 WO2020062310A1 (zh) 2018-09-30 2018-09-30 手写笔检测方法、系统及相关装置

Country Status (7)

Country Link
US (1) US11899879B2 (zh)
EP (1) EP3835928A4 (zh)
JP (1) JP7397861B2 (zh)
CN (1) CN112740152B (zh)
AU (1) AU2018456082B2 (zh)
CA (1) CA3113132A1 (zh)
WO (1) WO2020062310A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113268174A (zh) * 2021-03-15 2021-08-17 荣耀终端有限公司 功能控制方法和系统
WO2023010983A1 (zh) * 2021-07-31 2023-02-09 荣耀终端有限公司 刷新率的切换方法、电子设备和系统

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114527900A (zh) * 2020-10-30 2022-05-24 华为技术有限公司 界面信息的展示方法和电子设备
JP2022088187A (ja) * 2020-12-02 2022-06-14 富士フイルム株式会社 情報処理装置及び情報処理プログラム
JP2022183573A (ja) * 2021-05-31 2022-12-13 株式会社ワコム 電子ペンによる入力を制御するためのプロセッサ、及び、電子ペンとともに用いられるコンピュータにより実行される方法
CN113434064B (zh) * 2021-07-01 2022-03-29 掌阅科技股份有限公司 手写阅读器笔锋切换方法、电子设备和存储介质
WO2023198051A1 (zh) * 2022-04-15 2023-10-19 华为技术有限公司 一种手写笔检测方法、系统及相关装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102866792A (zh) * 2012-08-20 2013-01-09 深圳市汇顶科技有限公司 一种触摸笔、触摸控制器、触摸检测系统及其方法
CN104991682A (zh) * 2015-08-07 2015-10-21 京东方科技集团股份有限公司 一种触控驱动方法、触控驱动装置及触控显示装置
CN105739757A (zh) * 2016-01-20 2016-07-06 厦门天马微电子有限公司 触摸屏的扫描方法和系统、触摸屏以及触摸屏装置
CN106325635A (zh) * 2015-07-03 2017-01-11 晶门科技有限公司 控制触摸板的方法
CN107003781A (zh) * 2015-02-03 2017-08-01 三星电子株式会社 控制触摸屏的方法及支持该方法的电子设备

Family Cites Families (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7825908B2 (en) * 2006-08-08 2010-11-02 Carrier Corporation Method for resetting configuration on a touchscreen interface
TWI419034B (zh) 2009-04-03 2013-12-11 Novatek Microelectronics Corp 用於一觸控面板中偵測觸碰事件的控制方法及其相關裝置
CN101943939A (zh) * 2009-07-09 2011-01-12 上海易狄欧电子科技有限公司 终端及其手写笔控制方法
JP5008707B2 (ja) * 2009-09-15 2012-08-22 シャープ株式会社 入力表示ボード兼テーブル
CN101702106B (zh) * 2009-11-04 2011-11-23 深圳市汇顶科技有限公司 一种触摸屏终端的唤醒方法及系统
CN103176638A (zh) * 2011-12-23 2013-06-26 瀚宇彩晶股份有限公司 触控式面板装置与其扫描方法
TWI456487B (zh) * 2012-04-26 2014-10-11 Acer Inc 行動裝置以及手勢判斷方法
JP2013250828A (ja) 2012-06-01 2013-12-12 Canon Inc 入力装置
KR101441396B1 (ko) 2012-08-13 2014-09-17 엘지디스플레이 주식회사 입력 시스템 및 이를 이용한 터치 검출 방법
US9158393B2 (en) * 2012-12-18 2015-10-13 Logitech Europe S.A. Active stylus for touch sensing applications
JP5752157B2 (ja) 2013-01-31 2015-07-22 シャープ株式会社 文字表示装置及び文字表示方法
TWI496047B (zh) * 2013-03-19 2015-08-11 Compal Electronics Inc 觸控裝置及其操作方法
CN103235664A (zh) 2013-04-27 2013-08-07 深圳市金立通信设备有限公司 一种终端及触摸屏的控制方法
US10845901B2 (en) 2013-07-31 2020-11-24 Apple Inc. Touch controller architecture
CN104423658A (zh) * 2013-08-28 2015-03-18 中兴通讯股份有限公司 一种触摸屏点亮方法和装置、移动终端
CN104571732B (zh) * 2013-10-14 2018-09-21 深圳市汇顶科技股份有限公司 触摸终端、主动式触控笔检测方法及系统
JP6253497B2 (ja) 2014-04-25 2017-12-27 株式会社東芝 データ入力システム、アクティブスタイラスペンおよびアクティブスタイラスペンの制御方法
KR101637174B1 (ko) * 2014-06-30 2016-07-21 엘지디스플레이 주식회사 터치스크린 일체형 표시장치
JP6472196B2 (ja) 2014-09-17 2019-02-20 株式会社ワコム センサ信号処理回路及びセンサ信号処理方法
CN104317495B (zh) 2014-10-17 2019-01-15 联想(北京)有限公司 一种信息处理方法及电子设备
US10061449B2 (en) 2014-12-04 2018-08-28 Apple Inc. Coarse scan and targeted active mode scan for touch and stylus
US10324877B2 (en) 2014-12-24 2019-06-18 Texas Instruments Incorporated Circuit and method for interfacing universal serial bus
KR101859419B1 (ko) * 2014-12-26 2018-05-23 엘지디스플레이 주식회사 터치 스크린 장치와 그의 구동방법
JP2016162205A (ja) * 2015-03-02 2016-09-05 ファナック株式会社 複数系統をグループ化することにより制御を一元管理できる制御装置
JP6473671B2 (ja) * 2015-06-05 2019-02-20 株式会社ジャパンディスプレイ タッチ検出機能付き表示装置及び表示システム
US10444819B2 (en) 2015-06-19 2019-10-15 Intel Corporation Techniques to control computational resources for an electronic device
EP3186695B1 (en) * 2015-06-22 2021-11-10 SigmaSense, LLC Multi-touch sensor and electrostatic pen digitizing system utilizing simultaneous functions for improved performance
JP6551915B2 (ja) * 2015-07-06 2019-07-31 シグマセンス,エルエルシー 内圧、傾き及び回転についてのペンシステム
CN105045414B (zh) * 2015-08-04 2018-11-27 青岛歌尔声学科技有限公司 一种触控笔、实现方法以及一种触控系统
KR102607842B1 (ko) * 2015-12-31 2023-12-01 엘지디스플레이 주식회사 능동형 스타일러스 펜을 포함한 터치 센싱 시스템
KR102513147B1 (ko) 2016-01-19 2023-03-23 삼성전자 주식회사 전자 장치 및 그의 터치 입력 인식 방법
WO2017183743A1 (ko) * 2016-04-19 2017-10-26 엘지전자 주식회사 이동 단말기, 스타일러스 펜 및 그 제어방법
US20180095521A1 (en) * 2016-09-30 2018-04-05 Synaptics Incorporated Retention mode operation for reduced standby consumption in touch solutions
EP3413174B1 (en) * 2017-03-20 2020-04-29 Shenzhen Goodix Technology Co., Ltd. Signal processing method for active pen, active pen, and touch screen

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102866792A (zh) * 2012-08-20 2013-01-09 深圳市汇顶科技有限公司 一种触摸笔、触摸控制器、触摸检测系统及其方法
CN107003781A (zh) * 2015-02-03 2017-08-01 三星电子株式会社 控制触摸屏的方法及支持该方法的电子设备
CN106325635A (zh) * 2015-07-03 2017-01-11 晶门科技有限公司 控制触摸板的方法
CN104991682A (zh) * 2015-08-07 2015-10-21 京东方科技集团股份有限公司 一种触控驱动方法、触控驱动装置及触控显示装置
CN105739757A (zh) * 2016-01-20 2016-07-06 厦门天马微电子有限公司 触摸屏的扫描方法和系统、触摸屏以及触摸屏装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3835928A1 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113268174A (zh) * 2021-03-15 2021-08-17 荣耀终端有限公司 功能控制方法和系统
CN113268174B (zh) * 2021-03-15 2022-10-25 荣耀终端有限公司 功能控制方法和系统
WO2023010983A1 (zh) * 2021-07-31 2023-02-09 荣耀终端有限公司 刷新率的切换方法、电子设备和系统

Also Published As

Publication number Publication date
US11899879B2 (en) 2024-02-13
JP7397861B2 (ja) 2023-12-13
AU2018456082A1 (en) 2021-04-15
EP3835928A4 (en) 2021-09-01
AU2018456082B2 (en) 2022-08-11
CA3113132A1 (en) 2020-04-02
JP2022501739A (ja) 2022-01-06
CN112740152B (zh) 2023-09-08
US20210397342A1 (en) 2021-12-23
EP3835928A1 (en) 2021-06-16
CN112740152A (zh) 2021-04-30

Similar Documents

Publication Publication Date Title
WO2021017889A1 (zh) 一种应用于电子设备的视频通话的显示方法及相关装置
WO2020182065A1 (zh) 快捷功能启动的方法及电子设备
WO2020052529A1 (zh) 全屏显示视频中快速调出小窗口的方法、图形用户接口及终端
EP4131911A1 (en) Application interface interaction method, electronic device, and computer readable storage medium
WO2020224449A1 (zh) 一种分屏显示的操作方法及电子设备
WO2020062310A1 (zh) 手写笔检测方法、系统及相关装置
WO2021169337A1 (zh) 屏下指纹显示方法及电子设备
WO2021036770A1 (zh) 一种分屏处理方法及终端设备
EP3846427B1 (en) Control method and electronic device
WO2021063237A1 (zh) 电子设备的控制方法及电子设备
WO2020173370A1 (zh) 一种应用图标的移动方法及电子设备
WO2021078032A1 (zh) 用户界面的显示方法及电子设备
US20230117194A1 (en) Communication Service Status Control Method, Terminal Device, and Readable Storage Medium
WO2022068483A1 (zh) 应用启动方法、装置和电子设备
EP3958106A1 (en) Interface display method and electronic device
WO2020056778A1 (zh) 一种屏蔽触摸事件的方法及电子设备
WO2022037726A1 (zh) 分屏显示方法和电子设备
WO2021057699A1 (zh) 具有柔性屏幕的电子设备的控制方法及电子设备
WO2024045801A1 (zh) 用于截屏的方法、电子设备、介质以及程序产品
WO2021042878A1 (zh) 一种拍摄方法及电子设备
WO2020221062A1 (zh) 一种导航操作方法及电子设备
CN110058729B (zh) 调节触摸检测的灵敏度的方法和电子设备
US20220317841A1 (en) Screenshot Method and Related Device
CN110609650A (zh) 一种应用状态切换方法及终端设备
CN115206308A (zh) 一种人机交互的方法及电子设备

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2018408668

Country of ref document: AU

Date of ref document: 20181008

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18935164

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3113132

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2018935164

Country of ref document: EP

Effective date: 20210309

ENP Entry into the national phase

Ref document number: 2021517691

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018456082

Country of ref document: AU

Date of ref document: 20180930

Kind code of ref document: A