WO2022206785A1 - Procédé et appareil de commutation intelligente d'un type de stylet, dispositif et support de stockage - Google Patents

Procédé et appareil de commutation intelligente d'un type de stylet, dispositif et support de stockage Download PDF

Info

Publication number
WO2022206785A1
WO2022206785A1 PCT/CN2022/083827 CN2022083827W WO2022206785A1 WO 2022206785 A1 WO2022206785 A1 WO 2022206785A1 CN 2022083827 W CN2022083827 W CN 2022083827W WO 2022206785 A1 WO2022206785 A1 WO 2022206785A1
Authority
WO
WIPO (PCT)
Prior art keywords
stylus
pen
inclination angle
pressing point
user
Prior art date
Application number
PCT/CN2022/083827
Other languages
English (en)
Chinese (zh)
Inventor
曹诗勇
张飞雨
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022206785A1 publication Critical patent/WO2022206785A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G06F3/04162—Control or interface arrangements specially adapted for digitisers for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Definitions

  • the embodiments of the present application relate to the field of electronic devices, and in particular, to a method, device, device, and storage medium for intelligently switching pen types.
  • a stylus also known as a touch pen, is an electronic device that can be used in conjunction with terminal devices that support handwriting functions, such as mobile phones and tablet computers, for users to implement handwriting input operations on the terminal device.
  • the terminal device may include a touch screen, and the user can hold a stylus to perform touch operations such as writing and drawing on the touch screen of the terminal device.
  • the terminal device can respond to the touch operation of the stylus on the touch screen, and generate corresponding Handwriting, such as: handwriting may be lines, words, etc.
  • handwriting may be lines, words, etc.
  • the handwriting function of many terminal devices can also support switching of multiple pen types.
  • the user can actively select on the terminal device to switch the pen type of the stylus to a different type.
  • the pen type of the stylus is switched to a different type, in response to a touch operation of the stylus on the touch screen, the handwriting generated on the terminal device can correspondingly change to a type matching the pen type.
  • the solution for switching the pen type of the stylus in the above terminal device needs to rely on the user to actively perform touch operations such as clicking or touching on the UI interface of the terminal device, and the handwriting function of the terminal device is not intelligent enough.
  • the embodiments of the present application provide a method, device, device, and storage medium for intelligently switching pen types, which can recognize the user's pen-holding posture when a user interacts with a terminal device by holding a stylus, and intelligently recognize the user's pen-holding posture according to the user's pen-holding posture.
  • the virtual pen type of the stylus in the terminal device can be switched intelligently.
  • an embodiment of the present application provides a method for intelligently switching pen types, the method includes: acquiring the position of a pressing point when a user holds a stylus, and the inclination angle of the stylus; The position of the pressing point and the inclination angle of the stylus when the stylus is used to identify the user's pen-holding posture; switch the virtual pen type of the stylus in the terminal device to be consistent with the recognized user's pen-holding posture Matching first stroke type.
  • the user's pen-holding posture includes, but is not limited to, a pen-holding posture, a ballpoint pen-holding posture, a pencil pen-holding posture, a marker pen-holding posture, a writing brush pen-holding posture, and a watercolor pen-holding posture.
  • the first pen type correspondingly may include any one of the following: fountain pen, ballpoint pen, pencil, marker pen, brush pen, and watercolor pen.
  • the method can recognize the user's gesture of holding the pen according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus when the user interacts with the terminal device by holding the stylus, and put the stylus in the terminal device.
  • the virtual pen type is switched to the first pen type that matches the recognized pen-holding gesture of the user. Therefore, intelligent switching of the virtual pen type of the stylus in the terminal device can be realized, and the handwriting function of the terminal device can be more intelligent.
  • a more immersive interactive experience can be brought to the user.
  • the mobile phone can switch the pen type of the stylus to a fountain pen, so that the virtual handwriting written on the mobile phone by the user using the stylus pen is the pen handwriting, and the signature and signing of the pen can be completed.
  • the stylus is provided with first to Nth pressure sensors, where N is an integer greater than 0.
  • the acquiring the position of the pressing point when the user holds the stylus includes: acquiring the pressure information collected by each of the first pressure sensor to the Nth pressure sensor; The pressure information collected by each of the Nth pressure sensors is used to determine the position of the pressing point when the user holds the stylus.
  • a gravity sensor may also be provided in the stylus, and the gravity sensor may be used to obtain the inclination angle of the stylus.
  • the gravity sensor can also be replaced by a gyroscope, an inclination sensor, etc., which is not limited here.
  • recognizing the user's pen-holding posture according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus includes: according to the position of the pressing point when the user holds the stylus. position and the inclination angle of the stylus, query the position of the pre-established pressing point, and the correspondence between the inclination angle of the stylus and the gesture of holding the pen, and determine the position of the pressing point when the user holds the stylus , and the pen-holding gesture corresponding to the inclination angle of the stylus as the recognized pen-holding gesture of the user.
  • the pre-established position of the pressing point and the relationship between the inclination angle of the stylus and the pen-holding posture are queried.
  • the corresponding relationship between the stylus is determined, and the position of the pressing point when the user holds the stylus and the pen-holding posture corresponding to the inclination angle of the stylus is determined as the recognized user's pen-holding posture, including: from the pre-established pressing In the correspondence between the position of the point and the inclination angle of the stylus and the gesture of holding the pen, query the position of the corresponding pressing point and the inclination angle of the stylus, and the position of the pressing point when the user holds the stylus, and the handwriting
  • the pen-holding posture with the same inclination angle of the pen is used as the pen-holding posture of the recognized user.
  • the position of the pre-established pressing point, the inclination angle of the stylus and the posture of holding the pen are queried.
  • determining the position of the pressing point when the user holds the stylus and the pen-holding posture corresponding to the inclination angle of the stylus as the recognized user's pen-holding posture including: according to the user's handwriting The position of the pressing point and the inclination angle of the stylus when the pen is selected, and the corresponding relationship between the position of the pressing point and the inclination angle of the stylus and the posture of holding the pen, the position of the corresponding pressing point and the inclination of the stylus
  • a pen-holding gesture whose angle is most similar to the position of the pressing point when the user holds the stylus pen and the inclination angle of the stylus pen is used as the recognized pen-holding gesture of the user.
  • a preset similarity calculation algorithm can be used to calculate the position of the pressing point when the user holds the stylus, the inclination angle of the stylus, and the position of each pressing point included in the corresponding relationship, and the inclination of the stylus. Similarity between combinations of angles.
  • the position of the pressing point may account for the first weight
  • the inclination of the stylus may account for the second weight
  • the sum of the first weight and the second weight is 1.
  • the first weight and the second weight may be the same or different.
  • the first weight may be 60% and the second weight may be 40%. This embodiment of the present application does not limit the sizes of the first weight and the second weight.
  • the pre-established position of the pressing point and the correspondence between the inclination angle of the stylus and the posture of holding the pen can also be implemented by a neural network model.
  • a neural network model According to the position of the pressing point when the user holds the stylus pen and the inclination angle of the stylus pen, query the position of the pre-established pressing point, and the correspondence between the inclination angle of the stylus pen and the posture of holding the pen, and determine the The position of the pressing point when the user holds the stylus and the pen-holding posture corresponding to the inclination angle of the stylus are used as the recognized user's pen-holding posture, including: through a preset neural network model, according to the user's holding The position of the pressing point when the stylus is used, and the inclination angle of the stylus, identify the user's gesture of holding the pen.
  • the user's pen-holding posture output by the neural network model according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus may include at least one type of pen-holding posture.
  • the neural network model outputs each pen-holding posture , which can also output the confidence of the pen-holding posture, which is a value in the range of 0 to 1.
  • one of the pen-holding postures with the highest confidence may be selected from at least one pen-holding posture as the recognized pen-holding posture of the user.
  • the method further includes: switching the effect of the virtual handwriting of the stylus generated on the terminal device to the first effect according to the inclination angle of the stylus.
  • the first effect may refer to the thickness and weight effects of the handwriting of the stylus generated on the terminal device.
  • the handwriting of the stylus pen generated on the terminal device is compared with the handwriting generated on the terminal device when the inclination angle of the stylus pen is 80 degrees.
  • the handwriting of the pen it can be thicker and the visual effect is heavier.
  • the method further includes: acquiring the tilt angle of the terminal device.
  • the recognizing the user's pen-holding posture according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus includes: obtaining the stylus and the terminal device according to the inclination angle of the stylus and the inclination angle of the terminal device.
  • the relative inclination angle between the stylus pen and the user's pen-holding posture is recognized according to the position of the pressing point when the user holds the stylus pen and the relative inclination angle between the stylus pen and the terminal device.
  • the recognized gesture of the user's holding the pen may be more accurate.
  • the tilt angle of the terminal device may be acquired by one or more of a gravity sensor, a gyroscope, an inclination sensor, and the like in the terminal device.
  • the method further includes: switching the effect of the virtual handwriting of the stylus generated on the terminal device to a first effect according to the relative inclination angle between the stylus and the terminal device.
  • an embodiment of the present application provides a device for intelligently switching pen types, and the device can be used to implement the method for intelligently switching pen types described in the first aspect above.
  • the functions of the apparatus may be implemented by hardware, or by executing corresponding software by hardware.
  • the hardware or software includes one or more modules or units corresponding to the above functions, for example, a data acquisition module, a gesture recognition module, a pen type switching module, and the like.
  • the data acquisition module is used for acquiring the position of the pressing point when the user holds the stylus, and the inclination angle of the stylus.
  • the gesture recognition module is used for recognizing the user's gesture of holding the pen according to the position of the pressing point when the user holds the stylus pen and the inclination angle of the stylus pen.
  • a pen type switching module configured to switch the virtual pen type of the stylus in the terminal device to a first pen type matching the recognized gesture of holding the pen of the user.
  • the gesture recognition module is specifically configured to query the position of the pre-established pressing point and the position of the stylus according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus.
  • the corresponding relationship between the inclination angle of the stylus and the pen-holding posture is determined, and the position of the pressing point when the user holds the stylus pen and the pen-holding posture corresponding to the inclination angle of the stylus pen are determined as the recognized user's pen-holding posture .
  • the data acquisition module is further configured to acquire the tilt angle of the terminal device.
  • the gesture recognition module is specifically configured to obtain the relative inclination angle between the stylus pen and the terminal device according to the inclination angle of the stylus pen and the inclination angle of the terminal device; The position of the pressing point when the pen is pressed and the relative inclination angle between the stylus and the terminal device identify the user's gesture of holding the pen.
  • the apparatus further includes: an effect switching module.
  • the effect switching module is configured to switch the effect of the virtual handwriting of the stylus generated on the terminal device to a first effect according to the inclination angle of the stylus.
  • the effect switching module is configured to switch the effect of the virtual handwriting of the stylus generated on the terminal device according to the relative inclination angle between the stylus and the terminal device for the first effect.
  • the stylus is provided with first to Nth pressure sensors, where N is an integer greater than 0.
  • the data acquisition module is specifically configured to acquire the pressure information collected by each of the first pressure sensor to the Nth pressure sensor; The pressure information collected by each pressure sensor determines the position of the pressing point when the user holds the stylus.
  • a gravity sensor may also be provided in the stylus, and the gravity sensor may be used to obtain the inclination angle of the stylus.
  • the gravity sensor can also be replaced by a gyroscope, an inclination sensor, etc., which is not limited here.
  • the user's pen-holding posture includes, but is not limited to, a pen-holding posture, a ballpoint pen-holding posture, a pencil pen-holding posture, a marker pen-holding posture, a writing brush pen-holding posture, and a watercolor pen-holding posture.
  • the first pen type includes any one of the following: a fountain pen, a ballpoint pen, a pencil, a marker pen, a writing brush, and a watercolor pen.
  • an embodiment of the present application provides an electronic device, including: a processor, a memory for storing instructions executable by the processor; when the processor is configured to execute the instructions, the electronic device achieves the implementation of the first aspect.
  • the described method of intelligently switching pen types when the processor is configured to execute the instructions, the electronic device achieves the implementation of the first aspect.
  • the electronic device may be a stylus, or a terminal device, or a server, a computer, or the like.
  • terminal devices include but are not limited to interactive electronic whiteboards that can support handwriting, mobile phones, wearable devices (such as smart watches, smart bracelets, etc.), tablet computers, notebook computers, desktop computers, portable electronic devices (such as laptop computers, etc.) Upper computer, Laptop), ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), smart TV (such as smart screen), car computer, smart speaker, augmented reality (augmented reality, AR) devices, virtual reality (virtual reality, VR) devices, and other smart devices with displays.
  • Exemplary embodiments of terminal devices include, but are not limited to, piggybacks Portable or non-portable electronic devices with Linux or other operating systems.
  • Portable electronic devices include, but are not limited to, smart phones, smart earphones, tablet computers, wearable electronic devices with wireless communication functions (such as smart watches, smart bracelets, smart rings, smart glasses), and the like.
  • the embodiments of the present application do not limit the specific product form of the terminal device.
  • an embodiment of the present application provides a computer-readable storage medium on which computer program instructions are stored; when the computer program instructions are executed by an electronic device, the electronic device can implement the intelligent switching pen as described in the first aspect type method.
  • an embodiment of the present application further provides a computer program product, including computer-readable codes, which, when the computer-readable codes are run in an electronic device, enable the electronic device to implement the intelligent switching described in the first aspect. pen method.
  • FIG. 1 is a schematic diagram of a handwriting interface of a tablet computer
  • FIG. 2 is a schematic diagram of an application scenario provided by an embodiment of the present application.
  • FIG. 3 is a schematic structural diagram of a terminal device provided by an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of a stylus provided by an embodiment of the present application.
  • FIG. 5 is a schematic flowchart of a method for intelligently switching pen types provided by an embodiment of the present application
  • FIG. 6 is a schematic diagram of a pen holding posture of a pen provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a pencil-holding posture provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of another pencil holding posture provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram of another pencil-holding posture provided by an embodiment of the present application.
  • FIG. 10 is a schematic diagram of another pencil-holding posture provided by an embodiment of the application.
  • FIG. 11 is a schematic diagram of a watercolor pen holding a pen posture provided by an embodiment of the application.
  • FIG. 12 is a schematic diagram of another watercolor pen holding posture provided by the embodiment of the application.
  • FIG. 13 is a schematic diagram of another watercolor pen holding a pen posture provided by the embodiment of the application.
  • FIG. 14 is a schematic diagram of another watercolor pen holding posture provided by the embodiment of the application.
  • 15 is a schematic diagram of another watercolor pen holding a pen posture provided by an embodiment of the application.
  • 16 is another schematic flowchart of a method for intelligently switching pen types provided by an embodiment of the present application.
  • 17 is another schematic flowchart of a method for intelligently switching pen types provided by an embodiment of the present application.
  • 19 is a schematic structural diagram of a device for intelligently switching pen types provided by an embodiment of the application.
  • FIG. 20 is another schematic structural diagram of an apparatus for intelligently switching pen types provided by an embodiment of the present application.
  • references in this specification to "one embodiment” or “some embodiments” and the like mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application.
  • appearances of the phrases “in one embodiment,” “in some embodiments,” “in other embodiments,” “in other embodiments,” etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless specifically emphasized otherwise.
  • the terms “including”, “including”, “having” and their variants mean “including but not limited to” unless specifically emphasized otherwise.
  • the term “connected” includes both direct and indirect connections unless otherwise specified.
  • first and second are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implicitly indicating the number of indicated technical features.
  • a feature defined as “first” or “second” may expressly or implicitly include one or more of that feature.
  • words such as “exemplarily” or “for example” are used to represent examples, illustrations or illustrations. Any embodiment or design described in the embodiments of the present application as “exemplarily” or “such as” should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as “exemplarily” or “such as” is intended to present the related concepts in a specific manner.
  • a stylus also known as a touch pen, is an electronic device that can be used in conjunction with terminal devices that support handwriting functions, such as mobile phones and tablet computers, for users to implement handwriting input operations on the terminal device.
  • the terminal device may include a touch screen, and the user can hold a stylus to perform touch operations such as writing and drawing on the touch screen of the terminal device.
  • the terminal device can respond to the touch operation of the stylus on the touch screen, and generate corresponding Handwriting, such as: handwriting may be lines, words, etc.
  • handwriting generated on the terminal device is virtual handwriting.
  • the handwriting function of many terminal devices can also support switching of multiple pen types.
  • the user can actively select on the terminal device to switch the pen type of the stylus to a different type.
  • the pen type of the stylus is switched to a different type, in response to a touch operation of the stylus on the touch screen, the handwriting generated on the terminal device can correspondingly change to a type matching the pen type.
  • the pen type of the stylus described in this application is a virtual pen type.
  • the tablet computer can display a user interface (UI) through an application (such as a drawing board, a memo, etc.) deployed on it, and cooperate with a stylus Provide users with handwriting capabilities.
  • UI user interface
  • This UI interface may be referred to as a handwriting interface.
  • FIG. 1 is a schematic diagram of a handwriting interface of a tablet computer. As shown in FIG. 1 , when the tablet computer provides the user with a handwriting function, a toolbar 110 may be included in the handwriting interface.
  • the toolbar 110 may include selection function controls (or selection buttons) corresponding to various pen types, and the selection function controls corresponding to each pen type may be displayed in the form of virtual pen heads corresponding to the pen type, such as the toolbar 110 A ballpoint pen button 111, a pen button 112, a pencil button 113, a marker pen button 114, a writing brush button 115, a watercolor pen button 116, etc.
  • the user can actively click on the virtual pen head corresponding to any pen type on the screen (touch screen) of the tablet computer (that is, click the selection function control corresponding to any pen type), and the tablet computer can respond to the user clicking a certain pen.
  • the operation of the virtual pen head corresponding to the stylus type switches the pen type of the stylus to this pen type.
  • the terminal device responds to the touch operation of the stylus on the touch screen, and the handwriting generated on the terminal device may be handwriting of this type of pen.
  • the user may click the ballpoint pen button 111, and the tablet computer may switch the pen type of the stylus to the ballpoint pen in response to the operation of the user clicking the ballpoint pen button 111.
  • the terminal device responds to the touch operation of the stylus on the touch screen, and the handwriting generated on the terminal device may be the handwriting of the ballpoint pen.
  • the terminal device responds to the touch operation of the stylus on the touch screen.
  • the handwriting generated on the above can be correspondingly changed into pencil handwriting, marker handwriting, brush handwriting, watercolor pen handwriting, etc., which will not be repeated here.
  • the current solution for switching the pen type of the stylus in the terminal device relies on the user to actively perform touch operations such as clicking or touching on the UI interface of the terminal device (may be called UI operation), and the handwriting function of the terminal device is not enough. intelligent.
  • the embodiments of the present application provide a method for intelligently switching pen types.
  • the method can recognize the user's pen-holding posture when the user interacts with the terminal device by holding the stylus, and intelligently switch the pen type of the stylus according to the user's pen-holding posture.
  • the method can make the handwriting function of the terminal device more intelligent, and when the user interacts with the terminal device by holding the stylus, it can bring the user a more immersive interactive experience.
  • FIG. 2 is a schematic diagram of an application scenario provided by an embodiment of the present application.
  • an application scenario of this embodiment of the present application may include: a terminal device 200 and a stylus 300 .
  • FIG. 2 exemplarily takes the terminal device 200 as a mobile phone as an example.
  • the terminal device 200 and the stylus 300 can be connected in a wired or wireless manner.
  • the wireless communication protocol adopted when the terminal device 200 and the stylus 300 establish a connection wirelessly may be a wireless fidelity (wireless fidelity, Wi-Fi) protocol, a bluetooth (bluetooth) protocol, a ZigBee protocol, and a short-range wireless communication. (near field communication, NFC) protocol, various cellular network protocols, etc., which are not specifically limited here.
  • the terminal device 200 includes, but is not limited to, an interactive electronic whiteboard that can support a handwriting function, a mobile phone, a wearable device (such as a smart watch, a smart bracelet, etc.), a tablet computer, a notebook computer, Desktop computers, portable electronic devices (such as laptop computers, Laptops), ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), smart TVs (such as smart screens) , car computers, smart speakers, augmented reality (AR) devices, virtual reality (VR) devices, and other smart devices with displays.
  • Exemplary embodiments of the terminal device 200 include, but are not limited to, onboard Portable or non-portable electronic devices with Linux or other operating systems.
  • Portable electronic devices include, but are not limited to, smart phones, smart earphones, tablet computers, wearable electronic devices with wireless communication functions (such as smart watches, smart bracelets, smart rings, smart glasses), and the like. This embodiment of the present application does not limit the specific product form of the terminal device 200 .
  • FIG. 3 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
  • the mobile phone may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1.
  • Antenna 2 Mobile Communication Module 250, Wireless Communication Module 260, Audio Module 270, Speaker 270A, Receiver 270B, Microphone 270C, Headphone Interface 270D, Sensor Module 280, Key 290, Motor 291, Indicator 292, Camera 293, Display screen 294, and a subscriber identification module (subscriber identification module, SIM) card interface 295 and the like.
  • Subscriber identification module subscriber identification module, SIM
  • the processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the controller can be the nerve center and command center of the mobile phone.
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 210 for storing instructions and data.
  • the memory in processor 210 is cache memory.
  • the memory may hold instructions or data that have just been used or recycled by the processor 210 . If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided, and the waiting time of the processor 210 is reduced, thereby improving the efficiency of the system.
  • the processor 210 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, SIM interface, and/or USB interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM interface SIM interface
  • USB interface etc.
  • the external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone.
  • the external memory card communicates with the processor 210 through the external memory interface 220 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • Internal memory 221 may be used to store computer executable program code, which includes instructions.
  • the processor 210 executes various functional applications and data processing of the mobile phone by executing the instructions stored in the internal memory 221 .
  • the internal memory 221 may also include a storage program area and a storage data area.
  • the storage program area may store an operating system, an application program required for at least one function (for example, the first application described in the embodiments of the present application), and the like.
  • the storage data area can store data (such as image data, phone book) created during the use of the mobile phone.
  • the internal memory 221 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the charging management module 240 is used to receive charging input from the charger. While the charging management module 240 charges the battery 242, it can also supply power to the mobile phone through the power management module 241.
  • the power management module 241 is used to connect the battery 242 , the charging management module 240 , and the processor 210 .
  • the power management module 241 can also receive the input of the battery 242 to supply power to the mobile phone.
  • the wireless communication function of the mobile phone can be realized by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in a cell phone can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile phone can implement audio functions through an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, and an application processor. Such as music playback, recording, etc.
  • the sensor module 280 may include a pressure sensor 280A, a gyro sensor 280B, an air pressure sensor 280C, a magnetic sensor 280D, an acceleration sensor 280E, a distance sensor 280F, a proximity light sensor 280G, a fingerprint sensor 280H, a temperature sensor 280J, a touch sensor 280K, and an ambient light sensor 280L, bone conduction sensor 280M, etc.
  • Display screen 294 is used to display images, videos, and the like.
  • Display screen 294 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • emitting diode AMOLED
  • flexible light-emitting diode flex light-emitting diode, FLED
  • Miniled MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
  • the cell phone may include 1 or N display screens 294, where N is a positive integer greater than 1.
  • display screen 294 may be used to display application programming interfaces.
  • the mobile phone realizes the display function through the GPU, the display screen 294, and the application processor.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 294 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the structure shown in FIG. 3 does not constitute a specific limitation on the mobile phone.
  • the mobile phone may also include more or less components than those shown in FIG. 3, or some components may be combined, or some components may be separated, or different component arrangements, and the like.
  • some of the components shown in FIG. 3 may be implemented in hardware, software, or a combination of software and hardware.
  • the terminal device 200 is a wearable device, a tablet computer, a notebook computer, a desktop computer, a portable electronic device, a UMPC, a netbook, a PDA, a smart TV, a car computer, a smart speaker, an AR device, a VR device, and other devices with a display
  • the specific structure of the terminal device 200 can also be referred to as shown in FIG. 3 .
  • other terminal devices may have components added or reduced on the basis of the structure given in FIG. 3 , which will not be repeated here.
  • FIG. 4 is a schematic structural diagram of a stylus provided by an embodiment of the present application.
  • the stylus 300 may at least include: a plurality of pressure sensors, such as: a first pressure sensor 310 , a second pressure sensor 311 , . . . , an Nth pressure sensor 312 , etc. (N is greater than an integer of 0), the gravity sensor 320 , the processor 330 , and the communication module 340 .
  • a third pressure sensor, a fourth pressure sensor, a fifth pressure sensor, etc. may be further included between the second pressure sensor 311 and the Nth pressure sensor 312 , which are not shown one by one. and label.
  • the first pressure sensor 310 to the Nth pressure sensor 312 may be disposed in areas such as the tip, the body, and the tail of the stylus 300, and the positions of each pressure sensor may be different.
  • Each of the pressure sensors from the first pressure sensor 310 to the Nth pressure sensor 312 can be used to collect pressure information at its location and transmit it to the processor 330 .
  • the gravity sensor 320 can be disposed in the stylus 300 , such as the inside of the pen head or the pen body, for collecting the tilt angle of the stylus and transmitting it to the processor 330 . It can be understood that the inclination angle of the stylus collected by the gravity sensor 320 refers to the included angle of the stylus relative to the horizontal plane, which is between 0 degrees and 90 degrees (including 0 degrees and 90 degrees).
  • the processor 330 can determine whether the position of the pressure sensor is a pressing point (or referred to as a pen-holding contact) according to the pressure information collected by each pressure sensor, so as to obtain the positions of all the pressing points when the user holds the stylus.
  • the pressure information collected by the pressure sensor is a current or voltage signal, which can be converted into a corresponding pressure value.
  • the pressure value collected by the pressure sensor at the pressure point position is generally greater than 0 (not close to 0)
  • the pressure value at the non-pressing point position is generally greater than 0 (not close to 0).
  • the pressure value collected by the pressure sensor is generally equal to 0 (or close to 0). If the pressure value collected by a certain pressure sensor is greater than 0 (not close to 0), the processor 330 may determine that the location of the pressure sensor is the pressing point. If the pressure value collected by a certain pressure sensor is equal to 0 (or close to 0), the processor 330 may determine that the location of the pressure sensor is a non-pressing point.
  • the processor 330 may send the position of the pressing point when the user holds the stylus and the inclination angle of the stylus to the communication module 340 .
  • the communication module 340 is used to communicate with the terminal device 200 .
  • the stylus 300 can send the position of the pressing point when the user holds the stylus and the tilt angle of the stylus to the terminal device 200 through the communication module 340 .
  • the position of the pressing point may be represented as the coordinates of the pressing point on the stylus 300 .
  • the stylus 300 can be unfolded into a plane along the direction parallel to the pen body, and then the lower left corner of the plane (or the upper left corner, the lower right corner, the upper right corner or any point in the plane) can be used as the origin ( 0, 0, 0) to establish a plane coordinate system.
  • the coordinates of the pressing point in the plane coordinate system can be used as the coordinates of the pressing point on the stylus 300 .
  • a connection may be established between the communication module 340 and the terminal device 200 in the above-mentioned wired or wireless manner to implement communication.
  • the communication module 340 may be a Bluetooth module, an NFC chip, a Wi-Fi chip, etc., which will not be described in detail here.
  • the structure shown in FIG. 4 above is only an exemplary illustration of the stylus 300, and the stylus 300 may also include other structures or internal circuits such as a battery, a power management module, a speaker, etc., which are not limited here.
  • the above-mentioned gravity sensor 320 can also be replaced with a device that can detect the tilt angle of the stylus, such as a gyroscope, an inclination sensor, etc. The combination of two or more of the devices detects the tilt angle, which is also not limited here. In the embodiments of the present application, only the gravity sensor 320 is used as an example for description.
  • the terminal device 200 can determine the position of the pressing point when the user holds the stylus, and The tilt angle of the stylus recognizes the user's pen-holding posture, and then intelligently switches the pen type of the stylus according to the user's pen-holding posture.
  • FIG. 5 is a schematic flowchart of a method for intelligently switching pen types provided by an embodiment of the present application. As shown in FIG. 5, the method may include S501-S506.
  • the stylus acquires the pressure information collected by each of the first pressure sensor to the Nth pressure sensor, and the inclination angle of the stylus collected by the gravity sensor.
  • the manner in which the stylus acquires the pressure information collected by each of the first to Nth pressure sensors and the tilt angle of the stylus collected by the gravity sensor can be referred to as described above in the description of FIG. 4 .
  • S502 The stylus determines the position of the pressing point when the user holds the stylus according to the pressure information collected by each of the first pressure sensor to the Nth pressure sensor.
  • the stylus sends to the mobile phone the position of the pressing point when the user holds the stylus, and the inclination angle of the stylus.
  • the mobile phone receives the position of the pressing point when the user holds the stylus, and the inclination angle of the stylus.
  • the mobile phone recognizes the user's gesture of holding the pen according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus.
  • the user's pen-holding posture includes, but is not limited to, a pen-holding posture, a ballpoint pen-holding posture, a pencil pen-holding posture, a marker pen-holding posture, a writing brush pen-holding posture, a watercolor pen-holding posture, and the like.
  • the embodiments of the present application do not limit the types of pen-holding gestures.
  • the position of the pressing point and the inclination angle of the stylus may be different.
  • the position of the pressing point and the inclination angle of the stylus when the user holds the stylus in different pen-holding postures can be collected in advance, and the position of the pressing point, the inclination angle of the stylus and the pen-holding posture can be established.
  • the mobile phone recognizes the user's pen-holding posture according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus.
  • the pre-established position of the pressing point and the correspondence between the inclination angle of the stylus and the pen-holding posture determine the position of the pressing point when the user holds the stylus, and the pen-holding posture corresponding to the inclination angle of the stylus as the identification to the user's pen-holding posture.
  • the mobile phone can query the position of the corresponding pressing point and the inclination angle of the stylus from the pre-established position of the pressing point and the correspondence between the inclination angle of the stylus and the gesture of holding the pen, which is related to the position of the stylus.
  • the position of the pressing point when the user holds the stylus pen and the pen-holding posture with the same inclination angle of the stylus pen are sent as the recognized pen-holding posture of the user.
  • FIG. 6 is a schematic diagram of a pen holding posture of a pen according to an embodiment of the present application.
  • the thumb 601 described in FIG. 6 acts as a swipe
  • the index finger 602 acts as a push
  • the middle finger 603 acts as a hook
  • the ring finger 604 acts as a hook. grid
  • the role of the little finger 605 is to reach.
  • the position where the user's thumb 601 holds the stylus, the position where the index finger 602 presses the stylus, the middle finger 603 where the stylus is hooked, and the ring finger 604 where the stylus is drawn The position and the position where the little finger 605 touches the stylus are the pressing points when the user holds the stylus.
  • the position where the user's thumb 601 holds the stylus is the pressing point 1
  • the position where the index finger 602 presses the stylus is the pressing point 2
  • the middle finger 603 hooks the stylus.
  • the position is the pressing point 3
  • the position of the stylus with the ring finger 604 is the pressing point 4
  • the position where the little finger 605 touches the stylus is the pressing point 5
  • the inclination angle of the stylus is the first angle (such as 75 degrees, 80 degrees, etc.)
  • the positions of the pressing point 1, the pressing point 2, the pressing point 3, the pressing point 4, and the pressing point 5, and the first angle may be collected in advance.
  • pressing point 1, pressing point 2, pressing point 3, pressing point 4 and pressing point 5 can be represented by their coordinates on the stylus, which will not be repeated here. After the positions of pressing point 1, pressing point 2, pressing point 3, pressing point 4 and pressing point 5 and the first angle are collected, pressing point 1, pressing point 2, pressing point 3, pressing point 4 and The position of the pressing point 5 and the corresponding relationship between the first angle and the pen holding posture.
  • the pre-established position of the pressing point and the correspondence between the inclination angle of the stylus and the holding posture of the pen include: pressing point 1, pressing point 2, pressing point 3, pressing point 4, and pressing
  • the position of point 5 and the pen-holding posture corresponding to the first angle are the pen-holding posture of the pen.
  • the positions of the pressing points when the user holds the stylus sent by the stylus to the mobile phone in S503 are the pressing point 1, the pressing point 2, the pressing point 3, the pressing point 4 and the pressing point 5, and the inclination angle of the stylus is the first
  • the mobile phone in S504 can query the position of the pre-established pressing point, and the inclination angle and grip of the stylus according to the pressing point 1, pressing point 2, pressing point 3, pressing point 4 and pressing point 5, and the first angle.
  • the correspondence between the pen gestures identifies that the user's pen-holding gesture is a pen-holding gesture.
  • the mobile phone can query the positions of the pressing points corresponding to the pen-holding posture as pressing point 1 and pressing point 2 from the pre-established position of the pressing point and the correspondence between the inclination angle of the stylus and the pen-holding posture.
  • pressing point 3, pressing point 4 and pressing point 5 the inclination angle of the stylus is the first angle, so that it can be recognized that the user's pen-holding gesture is the pen-holding gesture.
  • the pre-established position of the pressing point and the correspondence between the inclination angle of the stylus and the pen-holding posture may also include, but are not limited to: the position of the pressing point, and the position of the stylus.
  • the correspondence between the inclination angle and the ballpoint pen holding posture, the position of the pressing point, and the correspondence between the inclination angle of the stylus and the pencil holding posture, the position of the pressing point, and the inclination angle of the stylus and the marker pen holding The correspondence between the pen postures, the position of the pressing point, and the correspondence between the inclination angle of the stylus and the pen-holding posture of the brush, the position of the pressing point, and the inclination of the stylus and the watercolor pen holding posture. Correspondence, etc., are not limited here.
  • the coordinates used to represent the position of the pressing point should be the same as the coordinates used to represent the position of the stylus in S502.
  • the determined coordinates of the position of the pressing point when the user holds the stylus are in the same coordinate system.
  • the mobile phone After the mobile phone recognizes the user's pen-holding posture according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus, the mobile phone can determine the first pen-holding posture that matches the user's pen-holding posture according to the user's pen-holding posture.
  • One stroke type, and switch the pen type of the stylus to the first stroke type For example, S505 and S506 may be performed.
  • the mobile phone determines a first pen shape matching the user's pen-holding posture according to the user's pen-holding posture.
  • the mobile phone switches the pen type of the stylus to the first pen type.
  • the mobile phone can determine that the first pen type matching the pen-holding posture is a pen.
  • the mobile phone can switch the pen type of the stylus to a fountain pen.
  • the handwriting generated on the mobile phone (display screen or touch screen) in response to the touch operation of the stylus on the touch screen can be the handwriting of the pen.
  • the mobile phone recognizes in S504 that the user's pen-holding posture is a ball-point pen-holding posture, or a pencil-holding posture, or a marker pen-holding posture, or a writing brush pen-holding posture, or a watercolor pen-holding posture, then S505
  • the middle mobile phone can accordingly determine that the first pen type that matches the user's pen-holding posture is a ballpoint pen, or a pencil, or a marker, or a writing brush, or a watercolor pen, which will not be repeated here.
  • the stylus may be provided with the first pressure sensor to the Nth pressure sensor, and the gravity sensor.
  • the stylus can acquire the pressure information collected by each of the first pressure sensor to the Nth pressure sensor and the inclination angle of the stylus collected by the gravity sensor, and according to each of the first pressure sensor to the Nth pressure sensor
  • the pressure information collected by the pressure sensor determines the position of the pressing point when the user holds the stylus. After that, the stylus can send the position of the pressing point when the user holds the stylus, and the inclination angle of the stylus to the terminal device.
  • the terminal device After receiving the position of the pressing point when the user holds the stylus and the inclination angle of the stylus, the terminal device can recognize the user's pen-holding posture according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus. Switch the pen type of the stylus to the first pen type that matches the user's pen-holding posture. Therefore, the terminal device can intelligently switch the pen type of the stylus according to the user's pen-holding posture.
  • the method can make the handwriting function of the terminal device more intelligent, and when the user interacts with the terminal device by holding the stylus, it can bring the user a more immersive interactive experience.
  • the mobile phone can switch the pen type of the stylus to a fountain pen according to the logic described in the foregoing embodiment, so that the handwriting written by the user on the mobile phone with the stylus pen is the pen handwriting, and the signature and signing of the pen can be completed.
  • a combination of the position of the pressing point and the inclination angle of the stylus only corresponds to A pen-holding posture; the combination of the positions of different pressing points and the inclination angle of the stylus can correspond to the same pen-holding posture. That is, one pen-holding posture can correspond to a combination of the positions of various pressing points and the inclination angle of the stylus.
  • the pen type suitable for the stylus is generally a pencil.
  • the position of the pressing point and/or the inclination angle of the stylus may be different when the user holds the stylus.
  • the position of the pressing point and the inclination angle of the stylus when the user holds the stylus in different sketch scenarios and the corresponding pen-holding postures are the pencil-holding postures.
  • FIG. 7 to FIG. 10 sequentially show four different pencil-holding postures (take four as an example) provided by the embodiments of the present application. Please refer to Figures 7 to 10.
  • the pencil-holding posture shown in Figure 7 can generally be used to draw some clear outlines;
  • the pencil-holding posture shown in Figure 8 can generally be used to draw a large area in the initial stage Darkness;
  • the pencil-holding posture shown in Figure 9 can generally be used for later depiction of light and shade;
  • the pencil-holding posture shown in Figure 10 can generally be used to depict parts with heavier tones.
  • the position of the pressing point of the stylus and the inclination angle of the stylus may be different when the user holds the stylus (including: the pressing point The position of the stylus is different, or the inclination angle of the stylus is different, or the position of the pressing point and the inclination angle of the stylus are different).
  • the position of the pressing point and the inclination angle of the stylus in the pencil-holding posture shown in FIG. 7 are combination 1, and the position of the pressing point and the inclination angle of the stylus in the pencil-holding posture shown in FIG.
  • the pen-holding postures corresponding to combination 1, combination 2, combination 3, and combination 4 are all Hold the pen pose for the pencil.
  • the terminal device When receiving any one of combination 1, combination 2, combination 3, and combination 4, the terminal device queries the position of the pressing point and the correspondence between the inclination angle of the stylus and the posture of holding the pen, and the determined The holding posture of the user is the pencil holding posture.
  • the terminal device can switch the pen type of the stylus to a pencil that matches the pen-holding posture of the pencil.
  • the pen type suitable for the stylus is generally a watercolor pen.
  • the position of the pressing point and/or the inclination angle of the stylus may also be different when the user holds the stylus.
  • the position of the pressing point and the inclination angle of the stylus when the user holds the stylus in different watercolor painting modes angle, and the corresponding pen-holding postures are the watercolor pen-holding postures.
  • FIG. 11 to FIG. 15 sequentially show five (take five as an example) different holding postures of the watercolor pen provided by the embodiments of the present application.
  • the watercolor pen holding posture shown in Fig. 11 is generally a classical (commonly used) watercolor pen painting method; the watercolor pen holding posture shown in Fig. 12 is a press painting way; the watercolor pen holding posture shown in Figure 13 is a remote painting method; the watercolor pen holding posture shown in Figure 14 is another pressing painting method; the watercolor pen holding pen shown in Figure 15
  • the pose is the ZISA painting style.
  • the position of the pressing point of the stylus when the user holds the stylus, and the inclination angle of the stylus may also be different (the same can be Including: the position of the pressing point is different, or the inclination angle of the stylus is different, or the position of the pressing point and the inclination angle of the stylus are different).
  • the position of the pressing point in the watercolor pen holding posture shown in FIG. 11 and the inclination angle of the stylus are combination 5
  • the terminal device When receiving any one of combination 5, combination 6, combination 7, combination 8, and combination 9, the terminal device queries the position of the pressing point and the correspondence between the inclination angle of the stylus and the posture of holding the pen.
  • the determined user's pen-holding postures are all watercolor pen-holding postures.
  • the terminal device can switch the pen type of the stylus to a watercolor pen that matches the holding posture of the watercolor pen.
  • the position of the pressing point corresponding to each pen-holding posture and the combination of the inclination angle of the stylus is not limited, it can be a combination or a combination of two or more.
  • the terminal device queries the position of the corresponding pressing point and the position of the stylus from the pre-established position of the pressing point and the correspondence between the inclination angle of the stylus and the gesture of holding the pen.
  • the position of the pressing point and the inclination angle of the stylus may not necessarily be the same as the position of the pre-established pressing point.
  • the correspondence between the inclination angle of the stylus and the pen-holding posture, the position of the pressing point corresponding to the pen-holding posture and the inclination angle of the stylus are exactly the same.
  • the terminal device queries the position of the pressing point and the relationship between the inclination angle of the stylus and the posture of holding the pen according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus.
  • the position of the pressing point and the corresponding relationship between the inclination angle of the stylus and the pen-holding posture can also be selected, the position of the corresponding pressing point, and the inclination angle of the stylus pen.
  • a pen-holding gesture that is most similar to the position of the pressing point sent by the stylus and the inclination angle of the stylus is used as the recognized user's pen-holding gesture.
  • the terminal device queries the position of the pressing point and the correspondence between the inclination angle of the stylus and the posture of holding the pen.
  • a similarity calculation algorithm may be preset in the terminal device, and the terminal device may use the similarity calculation algorithm to calculate the position of the pressing point sent by the stylus when the user holds the stylus, and the inclination angle of the stylus, which corresponds to The similarity between the combination of the position of each pressing point and the tilt angle of the stylus included in the relationship. Then, the terminal device can determine that the gesture of holding the pen corresponding to a combination with the greatest similarity between the position of the pressing point when the user holds the stylus and the tilt angle of the stylus sent by the stylus is the recognized grip of the user Pen pose.
  • the position of the pressing point may account for a first weight
  • the inclination of the stylus may account for a second weight
  • the sum of the first weight and the second weight is 1.
  • the first weight and the second weight may be the same or different.
  • the first weight may be 60% and the second weight may be 40%. This embodiment of the present application does not limit the sizes of the first weight and the second weight.
  • the positions of the pressing points sent by the stylus when the user holds the stylus include: the coordinates of the pressing point 1, the pressing point 2, the pressing point 3, and the pressing point 4, and the inclination angle of the stylus is the second angle;
  • the combination of the position of a certain pressing point and the inclination angle of the stylus (for the convenience of description, hereinafter referred to as the first combination) is:
  • the position of the pressing point includes coordinate 1, coordinate 2, coordinate 3, and coordinate 4, and the inclination angle of the stylus is the third angle.
  • the process for the terminal device to calculate the similarity between the position of the pressing point when the user holds the stylus and the inclination angle of the stylus sent by the stylus and the first combination may be as follows.
  • the cosine distance, Mahalanobis distance, Euclidean distance, etc. between the first line and the second line may be calculated as the first similarity between the first line and the second line.
  • the similarity between the third angle and the second angle can be calculated by the following formula (1).
  • ⁇ represents the second similarity between the third angle and the second angle
  • ⁇ represents the third angle
  • ⁇ represents the second angle
  • represents the absolute value of the difference between the third angle and the second angle .
  • ⁇ represents the position of the pressing point sent by the stylus when the user holds the stylus, and the inclination angle of the stylus, and the similarity between the first combination; ⁇ represents the first similarity; ⁇ 1 represents the first weight; ⁇ represents the second similarity between the third angle and the second angle; ⁇ 2 represents the second weight.
  • the terminal device calculates and obtains the position of the pressing point sent by the stylus when the user holds the stylus, and the inclination angle of the stylus, and the position of each pressing point included in the corresponding relationship, and the similarity between the combination of the tilt angles of the stylus, if the maximum similarity is less than the first threshold, the terminal device may not send the position of the pressing point when the user holds the stylus sent by the stylus, and The pen-holding gesture corresponding to the combination with the largest similarity between the inclination angles of the stylus is taken as the recognized pen-holding gesture of the user.
  • the user can actively perform an interactive operation on the terminal device to switch the pen type of the stylus (for details, please refer to the foregoing embodiments).
  • the terminal device may only determine the position of the pressing point sent by the stylus when the user holds the stylus, the tilt angle of the stylus, the position of the pressing point included in the corresponding relationship, and the handwriting
  • the maximum similarity between the combination of the inclination angles of the pen is greater than or equal to the first threshold
  • the similarity between the position of the pressing point when the user holds the stylus and the inclination angle of the stylus sent by the stylus will be the maximum.
  • the pen-holding gesture corresponding to this combination is taken as the recognized pen-holding gesture of the user. It can be understood that the value of the similarity calculated by the terminal device should be in the range of 0 to 1.
  • the first threshold may be 0.75, 0.8, 0.9, etc.
  • the size of the first threshold is not limited in this application.
  • the pre-established position of the pressing point and the correspondence between the inclination angle of the stylus and the gesture of holding the pen can also be implemented by a neural network model.
  • the pre-collected position of the pressing point when the user holds the stylus in different pen-holding postures and the inclination angle of the stylus can be used as sample input, and the corresponding pen-holding posture can be used as sample output to train the neural network.
  • Get the neural network model The neural network model represents the position of the pressing point and the correspondence between the inclination angle of the stylus and the posture of holding the pen.
  • Angle a function of outputting the user's pen-holding posture corresponding to the position of the pressing point when the user holds the stylus and the tilt angle of the stylus sent by the stylus.
  • the neural network model can be preset in the terminal device. According to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus sent by the stylus, the terminal device queries the position of the pressing point and the correspondence between the inclination angle of the stylus and the posture of holding the pen. It may refer to the process in which the terminal device inputs the position of the pressing point when the user holds the stylus and the tilt angle of the stylus sent by the stylus into the neural network model, and obtains the output result of the neural network model.
  • the neural network model may include at least one of the user’s pen-holding gestures outputted by the stylus according to the position of the pressing point when the user holds the stylus and the tilt angle of the stylus. Meanwhile, the neural network model outputs each grip When the pen gesture is used, the confidence of the pen-holding gesture can also be output, and the confidence is a value in the range of 0 to 1. After obtaining at least one pen-holding posture output by the neural network model and the confidence level of each pen-holding posture, the terminal device can select a pen-holding posture with the highest confidence from the at least one pen-holding posture as the recognized one. The user's pen-holding posture.
  • the terminal device can determine the position of the pressing point when the user holds the stylus and the inclination of the stylus sent according to the stylus angle, and the recognized pen-holding gesture of the user is the pen-holding gesture.
  • the terminal device obtains at least one pen-holding posture and gripping position output by the neural network model according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus sent by the stylus.
  • the terminal device may not use the pen-holding gesture with the highest confidence level as the recognized pen-holding gesture of the user.
  • the user can also actively perform interactive operations on the terminal device to switch the pen type of the stylus (for details, please refer to the foregoing embodiments).
  • the terminal device may only determine the maximum confidence level among the confidence levels of at least one pen-holding gesture output by the neural network model is greater than or equal to the second threshold.
  • the pen-holding gesture is the recognized user's pen-holding gesture.
  • the second threshold may also be 0.75, 0.8, 0.9, etc., and the magnitude of the second threshold may be the same as or different from the above-mentioned first threshold. This application does not limit the size of the second threshold.
  • the above embodiments mainly describe that the terminal device recognizes the user's pen-holding posture according to the position of the pressing point when the user holds the stylus pen and the inclination angle of the stylus pen sent by the stylus pen, and adjusts the pen-holding posture of the stylus pen according to the user's pen-holding posture.
  • the terminal device after the terminal device switches the pen type of the stylus to the first pen type, it can also change the handwriting of the stylus generated on the terminal device according to the inclination angle of the stylus sent by the stylus.
  • the effect also known as the brush effect of the stylus
  • the effect is switched to different thickness and weight effects, such as the first effect.
  • FIG. 16 is another schematic flowchart of a method for intelligently switching pen types provided by an embodiment of the present application. As shown in Figure 16, the method may include:
  • S1601-S1606 S1601-S1606 are respectively the same as the above-mentioned S501-S506, and will not be repeated here.
  • the mobile phone switches the handwriting effect of the stylus generated on the mobile phone to the first effect according to the inclination angle of the stylus sent by the stylus.
  • the first effect is different, that is, the thickness and weight of the handwriting of the stylus generated on the mobile phone are different.
  • the handwriting of the stylus pen generated on the terminal device is compared with the handwriting generated on the terminal device when the inclination angle of the stylus pen is 80 degrees.
  • the handwriting of the pen it can be thicker and the visual effect is heavier.
  • the corresponding relationship between the tilt angle and the first effect may also be established in advance.
  • the effect of the handwriting generated under the inclined angle of establishes the corresponding relationship and presets it in the terminal device.
  • the terminal device may query the pre-established correspondence between the inclination angle and the first effect according to the inclination angle of the stylus sent by the stylus, and switch the effect of the handwriting of the stylus generated on the terminal device to the first effect.
  • the terminal device when the user uses a stylus to interact with the terminal device, the terminal device may have a certain inclination angle with the horizontal direction.
  • the inclination angle of the stylus measured by the gravity sensor on the stylus is only the inclination angle of the stylus relative to the horizontal direction. Therefore, implementing the solutions described in the foregoing embodiments solely based on the inclination angle of the stylus may lack accuracy.
  • the terminal device can also first calculate the inclination angle according to the inclination angle of the terminal device itself.
  • the relative tilt angle between the stylus and the terminal device can identify the user's holding gesture according to the position of the pressing point when the user holds the stylus sent by the stylus, and the calculated relative inclination angle between the stylus and the terminal device.
  • the range of the inclination angle of the terminal device itself is between 0 degrees and 90 degrees, and the range of the relative inclination angle is also between 0 degrees and 90 degrees.
  • the terminal device can calculate the relative inclination angle between the stylus and the terminal device. is 60 degrees.
  • the terminal device can identify the user's pen-holding posture according to the position of the pressing point when the user holds the stylus sent by the stylus, and the calculated relative inclination angle between the stylus and the terminal device, the above S504
  • the position of the pre-established pressing point and the correspondence between the inclination angle of the stylus and the pen-holding posture described in should also be correspondingly changed to the position of the pressing point, and the relative inclination angle between the stylus and the terminal device. Correspondence between pen-holding poses.
  • the process of pre-establishing the position of the pressing point and the corresponding relationship between the relative inclination angle between the stylus and the terminal device and the gesture of holding the pen reference may be made to the pre-establishing the position of the pressing point, And the process of the correspondence between the inclination angle of the stylus and the gesture of holding the pen.
  • the terminal device queries the position of the pressing point, the relative inclination angle between the stylus and the terminal device and the
  • the correspondence between the pen-holding gestures and the process of recognizing the user's pen-holding gesture may also refer to the position of the pressing point when the user holds the stylus sent by the terminal device according to the stylus and the position of the stylus as described in the foregoing embodiment.
  • Inclination angle query the position of the pressing point and the correspondence between the inclination angle of the stylus and the pen-holding posture, and identify the user's pen-holding posture. They are not repeated here.
  • the terminal device (such as a mobile phone) in S1607 can also switch the effect of the handwriting of the stylus generated on the mobile phone to the first effect according to the calculated relative inclination angle between the stylus and the terminal device.
  • the specific principle is the same as the principle of switching the handwriting effect of the stylus generated on the mobile phone to the first effect according to the inclination angle of the stylus sent by the stylus described in the aforementioned S1607, and will not be repeated.
  • the terminal device before calculating the relative inclination angle between the stylus and the terminal device, the terminal device needs to obtain its own inclination angle first.
  • the process of acquiring the inclination angle of the terminal device is similar to the process of acquiring the inclination angle of the stylus by the aforementioned stylus.
  • the terminal device may obtain its own tilt angle through its own gravity sensor, or a gyroscope (sensor), or an inclination sensor, etc., which is not limited here.
  • FIG. 17 is another schematic flowchart of a method for intelligently switching pen types provided by an embodiment of the present application. As shown in Figure 17, the method may include:
  • the stylus acquires the pressure information collected by each of the first pressure sensor to the Nth pressure sensor, and the inclination angle of the stylus collected by the gravity sensor.
  • the stylus sends the pressure information collected by each of the first pressure sensor to the Nth pressure sensor and the tilt angle of the stylus collected by the gravity sensor to the mobile phone.
  • the mobile phone receives the pressure information collected by each of the first pressure sensor to the Nth pressure sensor, and the inclination angle of the stylus collected by the gravity sensor.
  • the mobile phone determines the position of the pressing point when the user holds the stylus according to the pressure information collected by each of the first pressure sensor to the Nth pressure sensor.
  • the specific principle is the same as the principle of determining the position of the pressing point when the user holds the stylus according to the pressure information collected by each of the first pressure sensor to the Nth pressure sensor by the stylus in the foregoing embodiment, and will not be repeated.
  • the mobile phone recognizes the user's gesture of holding the pen according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus.
  • the mobile phone determines a first pen shape matching the user's pen-holding posture according to the user's pen-holding posture.
  • the mobile phone switches the pen type of the stylus to the first pen type.
  • the mobile phone switches the handwriting effect of the stylus generated on the mobile phone to the first effect according to the inclination angle of the stylus sent by the stylus.
  • the stylus can Send the pressure information collected by each of the first pressure sensor to the Nth pressure sensor and the tilt angle of the stylus collected by the gravity sensor to the terminal device (mobile phone). Then, the terminal device may determine the position of the pressing point when the user holds the stylus according to the pressure information collected by each of the first pressure sensor to the Nth pressure sensor.
  • the execution subject of the step of determining the position of the pressing point when the user holds the stylus may be a stylus or a terminal device.
  • FIG. 18 is another schematic flowchart of the method for intelligently switching pen types provided by an embodiment of the present application. As shown in Figure 18, the method may include:
  • the stylus acquires the pressure information collected by each of the first pressure sensor to the Nth pressure sensor, and the inclination angle of the stylus collected by the gravity sensor.
  • the stylus determines the position of the pressing point when the user holds the stylus according to the pressure information collected by each of the first pressure sensor to the Nth pressure sensor.
  • the stylus recognizes the user's gesture of holding the pen according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus.
  • the stylus sends the recognized gesture of holding the pen and the inclination angle of the stylus to the mobile phone.
  • the stylus may send a first message to the mobile phone, where the first message includes the recognized type of the user's pen-holding gesture, such as: a pen-holding gesture, a pencil-holding gesture, and the like.
  • the recognized type of the user's pen-holding gesture such as: a pen-holding gesture, a pencil-holding gesture, and the like.
  • the mobile phone receives the recognized gesture of the user holding the pen and the inclination angle of the stylus.
  • the mobile phone determines a first pen shape matching the user's pen-holding posture according to the user's pen-holding posture.
  • the mobile phone switches the pen type of the stylus to the first pen type.
  • the mobile phone switches the handwriting effect of the stylus generated on the mobile phone to the first effect according to the inclination angle of the stylus sent by the stylus.
  • the stylus determines the position of the pressing point when the user holds the stylus according to the pressure information collected by each of the first pressure sensor to the Nth pressure sensor, it can be directly
  • the user's gesture of holding the pen is recognized according to the position of the pressing point when the user holds the stylus pen and the inclination angle of the stylus pen.
  • the stylus sends the recognized gesture of holding the pen and the inclination angle of the stylus to the terminal device. Therefore, the terminal device can perform the subsequent step of switching the pen type according to the user's pen-holding posture, and the subsequent step of switching the handwriting effect according to the inclination angle of the stylus.
  • the execution subject of the step of recognizing the user's pen-holding posture according to the position of the pressing point when the user holds the stylus pen and the inclination angle of the stylus pen may be a terminal device or a stylus pen.
  • the steps of recognizing the user’s pen-holding posture according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus can also be replaced with the steps of identifying the user’s pen-holding posture according to the user’s
  • the position of the pressing point when holding the stylus and the relative inclination angle between the stylus and the terminal device identify the user's gesture of holding the pen.
  • the stylus is based on the position of the pressing point when the user holds the stylus and the stylus.
  • the relative inclination angle with the terminal device Before identifying the user's pen-holding gesture, the terminal device should first send the inclination angle of the terminal device to the stylus, so that the stylus can calculate the inclination angle of the stylus and the inclination angle of the terminal device.
  • the relative tilt angle between the stylus and the terminal device For specific principles, please refer to the descriptions in the foregoing embodiments, which will not be repeated here.
  • the execution subject of some calculation steps in the method for intelligently switching pen types may also be other devices other than a stylus and a terminal device, such as the first device.
  • the terminal device and the stylus can communicate with the first device, and send data to the first device for calculation.
  • the specific calculation process of the first device is the same as the calculation process on the stylus and the terminal device in the foregoing embodiment.
  • the first device may include a computer, a server, etc., which is not limited herein.
  • an embodiment of the present application further provides a device for intelligently switching pen types, which can be applied to terminal equipment.
  • the functions of the apparatus may be implemented by hardware, or by executing corresponding software by hardware.
  • the hardware or software includes one or more modules or units corresponding to the above functions.
  • FIG. 19 is a schematic structural diagram of an apparatus for intelligently switching pen types provided by an embodiment of the present application.
  • the device for intelligently switching pen types may include: a data acquisition module 1901, a gesture recognition module 1902, and a pen type switching module 1903.
  • the data acquisition module 1901 is used to acquire the position of the pressing point when the user holds the stylus, and the inclination angle of the stylus.
  • the gesture recognition module 1902 is configured to recognize the user's gesture of holding the pen according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus.
  • the pen type switching module 1903 is configured to switch the virtual pen type of the stylus in the terminal device to the first pen type matching the recognized gesture of holding the pen of the user.
  • the stylus may be provided with first to Nth pressure sensors, where N is an integer greater than 0.
  • the data acquisition module 1901 is specifically configured to acquire the pressure information collected by each of the first pressure sensor to the Nth pressure sensor; according to the pressure collected by each of the first pressure sensor to the Nth pressure sensor information to determine the position of the pressing point when the user holds the stylus.
  • the first pen type includes any one of the following: a fountain pen, a ballpoint pen, a pencil, a marker pen, a writing brush, and a watercolor pen.
  • the user's pen-holding posture includes, but is not limited to, a pen-holding posture, a ballpoint pen-holding posture, a pencil-pen posture, a marker pen-holding posture, a writing brush pen-holding posture, a watercolor pen-holding posture, and the like.
  • the gesture recognition module 1902 can specifically be used to query the position of the pre-established pressing point and the position of the stylus according to the position of the pressing point when the user holds the stylus and the inclination angle of the stylus.
  • the corresponding relationship between the inclination angle of the stylus and the pen-holding posture is determined, and the position of the pressing point when the user holds the stylus pen and the pen-holding posture corresponding to the inclination angle of the stylus pen are determined as the recognized user's pen-holding posture .
  • the data acquisition module 1901 can also be used to acquire the tilt angle of the terminal device.
  • the gesture recognition module 1902 may be specifically configured to obtain the relative inclination angle between the stylus pen and the terminal device according to the inclination angle of the stylus pen and the inclination angle of the terminal device ; According to the position of the pressing point when the user holds the stylus, and the relative inclination angle between the stylus and the terminal device, identify the user's gesture of holding the pen.
  • FIG. 20 is another schematic structural diagram of an apparatus for intelligently switching pen types provided by an embodiment of the present application.
  • the device for intelligently switching pen types may further include: an effect switching module 1904 .
  • the effect switching module 1904 may be configured to switch the effect of the virtual handwriting of the stylus generated on the terminal device to the first effect according to the inclination angle of the stylus.
  • the effect switching module 1904 may be configured to switch the effect of the virtual handwriting of the stylus generated on the terminal device according to the relative inclination angle between the stylus and the terminal device for the first effect.
  • units in the above apparatus is only a division of logical functions, and may be fully or partially integrated into a physical entity in actual implementation, or may be physically separated.
  • all the units in the device can be realized in the form of software calling through the processing element; also can all be realized in the form of hardware; some units can also be realized in the form of software calling through the processing element, and some units can be realized in the form of hardware.
  • each unit can be a separately established processing element, or can be integrated in a certain chip of the device to be implemented, and can also be stored in the memory in the form of a program, which can be called by a certain processing element of the device and execute the unit's processing. Function.
  • all or part of these units can be integrated together, and can also be implemented independently.
  • the processing element described here may also be called a processor, which may be an integrated circuit with signal processing capability.
  • each step of the above method or each of the above units may be implemented by an integrated logic circuit of hardware in the processor element or implemented in the form of software being invoked by the processing element.
  • the units in the above apparatus may be one or more integrated circuits configured to implement the above method, eg, one or more application specific integrated circuits (ASICs), or, one or more A digital signal processor (DSP), or, one or more field programmable gate arrays (FPGA), or a combination of at least two of these integrated circuit forms.
  • ASICs application specific integrated circuits
  • DSP digital signal processor
  • FPGA field programmable gate arrays
  • the processing element can be a general-purpose processor, such as a CPU or other processors that can invoke programs.
  • these units can be integrated together and implemented in the form of a system-on-a-chip (SOC).
  • the unit of the above apparatus for implementing each corresponding step in the above method may be implemented in the form of a processing element scheduler.
  • the apparatus may include a processing element and a storage element, and the processing element invokes a program stored in the storage element to execute the method described in the above method embodiments.
  • the storage element may be a storage element on the same chip as the processing element, ie, an on-chip storage element.
  • the program for performing the above method may be in a storage element on a different chip from the processing element, ie, an off-chip storage element.
  • the processing element calls or loads the program from the off-chip storage element to the on-chip storage element, so as to call and execute the methods described in the above method embodiments.
  • an embodiment of the present application may further provide an apparatus, such as an electronic device, which may include a processor, a memory for storing instructions executable by the processor.
  • an electronic device which may include a processor, a memory for storing instructions executable by the processor.
  • the processor When the processor is configured to execute the above-mentioned instructions, the electronic device can implement the method for intelligently switching pen types as described in the foregoing embodiments.
  • the memory may be located within the electronic device or external to the electronic device.
  • the processor includes one or more.
  • the electronic device may be a stylus, or a terminal device, or a server, a computer, or the like.
  • terminal devices include but are not limited to interactive electronic whiteboards that can support handwriting, mobile phones, wearable devices (such as smart watches, smart bracelets, etc.), tablet computers, notebook computers, desktop computers, portable electronic devices (such as laptop computers, etc.) Upper computer, Laptop), ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), smart TV (such as smart screen), car computer, smart speaker, augmented reality (augmented reality, AR) devices, virtual reality (virtual reality, VR) devices, and other smart devices with displays.
  • Exemplary embodiments of terminal devices include, but are not limited to, piggybacks Portable or non-portable electronic devices with Linux or other operating systems.
  • Portable electronic devices include, but are not limited to, smart phones, smart earphones, tablet computers, wearable electronic devices with wireless communication functions (such as smart watches, smart bracelets, smart rings, smart glasses), and the like.
  • the embodiments of the present application do not limit the specific product form of the terminal device.
  • the unit of the apparatus implementing each step in the above method may be configured as one or more processing elements, where the processing elements may be integrated circuits, such as: one or more ASICs, or, one or more Multiple DSPs, or, one or more FPGAs, or a combination of these types of integrated circuits. These integrated circuits can be integrated together to form chips.
  • an embodiment of the present application further provides a chip, which can be applied to the above-mentioned electronic device.
  • the chip includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected by lines; the processor receives and executes computer instructions from the memory of the electronic device through the interface circuit, so as to realize the above-mentioned embodiments.
  • the method of intelligently switching pen type includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected by lines; the processor receives and executes computer instructions from the memory of the electronic device through the interface circuit, so as to realize the above-mentioned embodiments.
  • Embodiments of the present application further provide a computer program product, including computer-readable codes, when the computer-readable codes are executed in an electronic device, the electronic device enables the electronic device to implement the method for intelligently switching pen types described in the foregoing embodiments.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be Incorporation may either be integrated into another device, or some features may be omitted, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or may be distributed to multiple different places . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium.
  • the software product is stored in a program product, such as a computer-readable storage medium, and includes several instructions to cause a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) to execute all of the methods described in the various embodiments of the present application. or part of the steps.
  • the aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk and other mediums that can store program codes.
  • the embodiments of the present application may further provide a computer-readable storage medium on which computer program instructions are stored.
  • the electronic device is made to implement the method for intelligently switching the pen type as described in the foregoing embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente demande se rapporte au domaine des dispositifs électroniques, et concerne un procédé et un appareil de commutation intelligente d'un type de stylet, un dispositif et un support de stockage. Le procédé consiste : à obtenir la position d'un point sur lequel une pression a été exercée lorsqu'un utilisateur tient un stylet et un angle d'inclinaison du stylet ; à reconnaître une posture de maintien de stylet de l'utilisateur en fonction de la position du point sur lequel une pression a été exercée lorsque l'utilisateur tient le stylet et de l'angle d'inclinaison du stylet ; et à commuter un type de stylet virtuel du stylet dans un dispositif terminal sur un premier type de stylet correspondant à la posture de maintien de stylet reconnue de l'utilisateur. Au moyen du procédé, lorsque l'utilisateur tient le stylet pour interagir avec le dispositif terminal, la posture de maintien de stylet de l'utilisateur peut être reconnue, et le type de stylet virtuel du stylet dans le dispositif terminal peut être commuté intelligemment en fonction de la posture de maintien de stylet de l'utilisateur.
PCT/CN2022/083827 2021-03-30 2022-03-29 Procédé et appareil de commutation intelligente d'un type de stylet, dispositif et support de stockage WO2022206785A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110343519.X 2021-03-30
CN202110343519.XA CN115145416A (zh) 2021-03-30 2021-03-30 智能化切换笔型的方法、装置、设备及存储介质

Publications (1)

Publication Number Publication Date
WO2022206785A1 true WO2022206785A1 (fr) 2022-10-06

Family

ID=83404221

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/083827 WO2022206785A1 (fr) 2021-03-30 2022-03-29 Procédé et appareil de commutation intelligente d'un type de stylet, dispositif et support de stockage

Country Status (2)

Country Link
CN (1) CN115145416A (fr)
WO (1) WO2022206785A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5696538A (en) * 1995-06-29 1997-12-09 Sharp Kabushiki Kaisha Apparatus for detecting input-pen's inclination, and pen input apparatus equipped with it
CN101334699A (zh) * 2008-08-01 2008-12-31 广东威创视讯科技股份有限公司 一种无线电子笔及其笔迹粗细自调节方法
CN102591481A (zh) * 2011-01-13 2012-07-18 国立成功大学 数字绘图电子笔、数字绘图系统及其使用方法
CN103218065A (zh) * 2013-04-17 2013-07-24 合肥华恒电子科技有限责任公司 一种自动变更笔触类型的手写输入装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5696538A (en) * 1995-06-29 1997-12-09 Sharp Kabushiki Kaisha Apparatus for detecting input-pen's inclination, and pen input apparatus equipped with it
CN101334699A (zh) * 2008-08-01 2008-12-31 广东威创视讯科技股份有限公司 一种无线电子笔及其笔迹粗细自调节方法
CN102591481A (zh) * 2011-01-13 2012-07-18 国立成功大学 数字绘图电子笔、数字绘图系统及其使用方法
CN103218065A (zh) * 2013-04-17 2013-07-24 合肥华恒电子科技有限责任公司 一种自动变更笔触类型的手写输入装置

Also Published As

Publication number Publication date
CN115145416A (zh) 2022-10-04

Similar Documents

Publication Publication Date Title
US11243617B2 (en) Multi-function stylus with sensor controller
WO2020155876A1 (fr) Procédé de commande d'affichage d'écran et dispositif électronique
US10289198B2 (en) Technologies for remotely controlling a computing device via a wearable computing device
US9335835B2 (en) Method and apparatus for providing user interface
US20190004622A1 (en) Systems, Methods, and Devices for Providing a Virtual Reality Whiteboard
JP2006500680A (ja) ３次元手書き認識のための方法及びシステム
KR20130088104A (ko) 비접촉 방식의 인터페이스를 제공하기 위한 휴대 장치 및 방법
TW201447646A (zh) 使用者裝置之物件控制方法及其設備
AU2013228012A1 (en) System for providing a user interface for use by portable and other devices
TW201303655A (zh) 無線傳輸觸控筆與觸控顯示系統
EP3721327B1 (fr) Adaptation d'interaction dynamique d'un dispositif d'encrage numérique
US20170255284A1 (en) Method and apparatus for operating mobile terminal
US11269430B2 (en) Stylus ink parameter setting
US20150109200A1 (en) Identifying gestures corresponding to functions
US10514844B2 (en) Automatically modifying an input area based on a proximity to one or more edges
WO2024087816A1 (fr) Procédé et dispositif de prévention de toucher accidentel
EP2703978B1 (fr) Appareil de mesure de coordonnées et procédé de commande de celui-ci
US11545061B2 (en) Electronic device for displaying screen through display in low-power mode and operating method thereof
US20230350566A1 (en) Electronic apparatus and method for processing input from stylus pen in electronic apparatus
WO2022206785A1 (fr) Procédé et appareil de commutation intelligente d'un type de stylet, dispositif et support de stockage
US20150205360A1 (en) Table top gestures for mimicking mouse control
EP3710910B1 (fr) Dispositif informatique comportant de multiples panneaux et une ou plusieurs structures de couplage magnétique intégrées
WO2023024536A1 (fr) Procédé et appareil de traçage, dispositif informatique et support de stockage
KR102656963B1 (ko) 전자 장치 및 전자 장치의 제어 방법
US9292107B1 (en) Mobile telephone as computer mouse

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22778967

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22778967

Country of ref document: EP

Kind code of ref document: A1