WO2022022387A1 - Procédé, appareil, et système de commande de dispositifs d'entrée d'informations sur un terminal - Google Patents

Procédé, appareil, et système de commande de dispositifs d'entrée d'informations sur un terminal Download PDF

Info

Publication number
WO2022022387A1
WO2022022387A1 PCT/CN2021/107927 CN2021107927W WO2022022387A1 WO 2022022387 A1 WO2022022387 A1 WO 2022022387A1 CN 2021107927 W CN2021107927 W CN 2021107927W WO 2022022387 A1 WO2022022387 A1 WO 2022022387A1
Authority
WO
WIPO (PCT)
Prior art keywords
information input
input device
terminal
frequency
pulse signal
Prior art date
Application number
PCT/CN2021/107927
Other languages
English (en)
Chinese (zh)
Inventor
李小仙
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022022387A1 publication Critical patent/WO2022022387A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0412—Digitisers structurally integrated in a display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/20—Drawing from basic elements, e.g. lines or circles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/20—Drawing from basic elements, e.g. lines or circles
    • G06T11/203—Drawing of straight lines or curves

Definitions

  • the embodiments of the present application relate to the field of communications and the field of terminals, and in particular, to a method, an apparatus, and a system for operating an information input device on a terminal.
  • information input devices are widely used as one of the accessories of smart devices such as mobile phones and tablets.
  • the information input device can enable users to write, draw, and manipulate accurately and quickly on the smart device, and can provide users with a more refined experience than finger operations.
  • information input devices are mainly used with small screen products such as tablets and mobile phones. Therefore, only one pen is considered for writing on one terminal in the design of the scheme, and the scenario of multiple pens writing on the same terminal is not considered.
  • large-sized touch terminals such as tablets, smart TVs, smart screens and other devices will become more and more popular, and there will be more and more scenarios where multiple information input devices write on the same terminal. How to realize simultaneous writing with multiple pens on the same terminal is a worthy research direction in this field.
  • the embodiments of the present application provide a method, an apparatus, and a system for controlling an information input device on a terminal.
  • the terminal can distinguish different information input devices, perform graphics rendering for different information input devices, and display corresponding movement trajectories.
  • an embodiment of the present application provides a method for operating an information input device on a terminal, and the method is applied to a communication system including a terminal, a first information input device, and a second information input device.
  • the method may include: the terminal assigns a first frequency to the first information input device, and assigns a second frequency to the second information input device, the first frequency and the second frequency are different; the first information input device transmits the first frequency a pulse signal, the frequency of the first pulse signal is the first frequency; the second information input device transmits a second pulse signal, the frequency of the second pulse signal is the second frequency; the terminal is at the first position of the screen When the first pulse signal is detected, the first movement track formed by the first position point is displayed on the screen; the first position point includes one or more position points; the terminal detects the second position point on the screen to the second pulse signal, a second movement track formed by the second position point is displayed on the screen; the second position point includes one or more position points; wherein, the first movement track and the second movement track
  • the terminal can distinguish the pulse signals sent by different information input devices by frequency, and display the movement track at the position point where the pulse signals sent by the information input device are received.
  • the appearances of the movement tracks corresponding to different information input devices are different, so that when the user uses multiple information input devices to operate on the same terminal, the user can directly identify which information input device the movement track corresponds to from the appearance.
  • the method distinguishes different information input devices by the frequency of the signal, does not need to send additional information input device ID, and does not affect the reporting rate.
  • the appearance of the movement track may include, but is not limited to: color, thickness, depth, or stroke, and so on.
  • the information input device may directly contact the terminal screen, or may not contact the terminal screen, for example, be close to the terminal screen, which is not limited in this embodiment of the present application. That is to say, as long as the terminal can detect the pulse signal sent by the information input device, the corresponding movement trajectory can be displayed.
  • the terminal can sense the pulse signal sent by the information input device, that is, the movement track can be displayed at the position where the pulse signal is detected. In this way, when the user has a writing intention, the movement track of the corresponding information input device can be displayed, and the function of "0-pressure-sensitive ink ejection" can be realized. This is a better experience for the user.
  • the appearance of the movement track can be determined in the following ways:
  • the terminal is preset. For example, the terminal displays a red moving track at the position where the first pulse signal with the first frequency is detected (ie, the first position), and at the position where the second pulse signal with the second frequency is detected (ie, the first position) The second position point) shows the movement trajectory in blue. In this way, the user can directly distinguish different information input devices from the difference in the appearance of the movement track.
  • the terminal determines the appearance of the movement track corresponding to the information input device, such as thickness, depth, etc., according to the pressure value when the information input device contacts the screen of the terminal. For example, when the pressure value is larger, the color of the movement track corresponding to the information input device is darker or the line is thicker.
  • the information input device can send the pressure value collected when touching the screen of the terminal and the identification of the information input device to the terminal through a wireless connection with the terminal.
  • the terminal can know which information input device the pressure value belongs to through the identifier, and determine the appearance of the movement track of the corresponding information input device according to the pressure value.
  • the terminal can associate and store the first frequency and the first identification, and the first identification is the identification of the first information input device; the first information input device detects the first pressure value, through The first wireless connection with the terminal sends a first message; the first message carries the first pressure value and the first identifier; the terminal receives the first message; wherein, the appearance of the first movement track is determined by The first pressure value in the first message carrying the first identifier is determined.
  • the first message may further include a time point of the collected first pressure value, so that the terminal can determine the pressure value of the first information input device at each time point, and detect the first pulse at the same time point The appearance of the movement trace displayed on the first position point of the signal is determined by the corresponding pressure value.
  • the second information input device can also collect and send the pressure value in the same way, for example, the second information input device can send a second message carrying the second pressure value and the identifier of the second information input device.
  • the terminal can distinguish the pressure values of different information input devices, and reflect the pressure values on the movement trajectory of the corresponding information input device, so as to achieve a fine and accurate display effect.
  • the user can control the appearance of the movement track by controlling the strength, which can bring a good user experience to the user.
  • the information input device can transmit the pressure value in an efficient and timely manner by using wireless communication technology, so that the terminal can render and display the corresponding movement trajectory in real time, so that the information input device has good chirality and can improve the user experience.
  • the terminal determines the appearance of the movement track corresponding to the information input device, such as thickness, depth, etc., according to the intensity of the detected pulse signal. For example, when the intensity of the pulse signal is greater, the color of the movement track corresponding to the information input device is darker or the line is thicker.
  • the appearance of the first movement track can be determined by the intensity of the first pulse signal.
  • the appearance of the second movement trace is determined by the strength of the second pulse signal.
  • the terminal determines, according to the inclination of the information input device, the appearance of the movement track corresponding to the information input device, such as the stroke, thickness, and the like. For example, when the inclination is larger, the line corresponding to the movement track of the information input device is thicker. The slope is determined by the pulse signal detected by the terminal.
  • the terminal can also assign a third frequency to the first information input device, and the third frequency is different from the second frequency; the first information input device transmits a third pulse signal, and the first information input device transmits a third pulse signal.
  • the frequency of the three-pulse signal is the third frequency; the terminal detects the third pulse signal at a third position; wherein, the appearance of the first movement track is determined by the inclination of the first information input device, and the first The inclination of the information input device is determined by the first position point where the first pulse signal is detected, and the third position point where the third pulse signal is detected.
  • the inclination of the first information input device at a certain time point is determined by the first position point at which the first pulse signal is detected at the time point, and the third position point at which the third pulse signal is detected at the time point .
  • the distance between the electrodes 2 of the pulse signal, d2 is the distance between the first position point and the second position point corresponding to the time point.
  • d1 may be pre-stored in the terminal, or may be sent to the terminal by the first information input device through the first wireless connection.
  • the terminal can distinguish the inclination of different information input devices, and reflect the inclination on the movement trajectory of the corresponding information input device, so as to achieve a fine and accurate display effect.
  • the user can control the appearance of the movement track by controlling the inclination, which can bring a good user experience to the user.
  • the working cycle of the terminal includes a plurality of signal detection time periods;
  • the working cycle of the first information input device includes: a plurality of first transmission time periods and a plurality of second transmission time periods;
  • the signal detection period covers the first transmission period and the second transmission period in timing;
  • the first information input device sends the first pulse signal during the first transmission period, and the second transmission period Sending the third pulse signal;
  • the terminal detects the first pulse signal and the third pulse signal in the signal detection period.
  • the first information input device and the terminal can cooperate to complete the transmission of the downlink signal (including the first pulse signal and the second pulse signal), and save the power of both parties to the greatest extent.
  • the terminal when the first transmission time period and the second transmission time period overlap, the first frequency is different from the third frequency; or, in the case of the first transmission time period and the third transmission time period When the two transmission time periods do not overlap, the first frequency and the third frequency are the same. In this way, for the first information input device, the terminal can distinguish the first signal and the second signal transmitted by the first information input device according to the difference in timing or frequency.
  • the second input device and the terminal may also have similar working time periods, which will not be repeated here.
  • the terminal may also send a DSSS signal, and the first information input device may use the first frequency to send the first pulse signal after detecting the DSSS signal.
  • the first information input device can detect the DSSS signal only when it is close to the terminal screen, and then send the first pulse signal, which can save the power consumption of the first information input device.
  • the working period of the terminal includes a signal transmission period; the working period of the first information input device includes a signal detection period; the signal detection period covers the signal transmission period in timing;
  • the DSSS signal is sent during the signal transmission period; the first information input device detects the DSSS signal during the signal detection period.
  • the first information input device and the terminal can cooperate to complete the transmission of the uplink signal (that is, the DSSS signal), and save the power of both parties to the greatest extent.
  • the duty cycle of the terminal and the duty cycle of the first information input device have the same length. In some embodiments, the working cycle of the terminal and the working cycle of the first information input device may also be consistent in timing.
  • the first information input device sends the first message within a first time window; the terminal scans the first message within the first time window.
  • the first information input device can periodically send the detected pressure value, and the terminal can also scan messages periodically, which can save the power consumption of both parties.
  • the terminal allocates a first frequency to the first information input device based on the first wireless connection.
  • the terminal may further allocate a fourth frequency to the first information input device, where the fourth frequency is different from the first frequency and the second frequency.
  • the terminal can perform frequency hopping processing on the first information input device, which can prevent the frequency of the first pulse signal transmitted by the first information input device from being close to the interference signal existing in the space, thereby preventing the terminal from detecting the frequency of the first information input device.
  • the first pulse signal is interfered by other signals in the space, so that the terminal can accurately identify the first pulse signal sent by the first information input device.
  • the terminal may run a first application program, where the first application program provides one or more of the following Function: drawing, office, pattern design, text input or data input. In this way, the terminal can identify different information input devices in scenes such as painting and writing.
  • an embodiment of the present application provides a method for controlling an information input device on a terminal, and the method is applied to the terminal side.
  • the method may include: assigning, by the terminal, a first frequency to the first information input device, and assigning a second frequency to the second information input device, the first frequency and the second frequency being different; the terminal is at a first position on the screen The first pulse signal with the frequency of the first frequency is detected at the point, and the first movement trajectory formed by the first position point is displayed on the screen; the first position point includes one or more position points; the terminal is in the A second pulse signal with a frequency of the second frequency is detected at the second position point of the screen, and a second movement track formed by the second position point is displayed on the screen; the second position point includes one or more position points ; wherein, the appearance of the first movement track and the second movement track are different.
  • an embodiment of the present application provides a method for controlling an information input device on a terminal, and the method is applied to the side of the first information input device.
  • the method may include: the first information input device receives a first frequency assigned by the terminal; the first information input device transmits a first pulse signal, and the frequency of the first pulse signal is the first frequency.
  • an embodiment of the present application provides a method for controlling an information input device on a terminal, and the method is applied to a communication system including a terminal and an information input device.
  • the method may include: the terminal assigns a first frequency to the information input device; the information input device transmits a pulse signal, and the frequency of the pulse signal is the first frequency; the terminal detects the pulse signal at a third position on the screen , and perform the function corresponding to the third position point.
  • the terminal can obtain the point reporting information according to the first pulse signal, and perform corresponding operations according to the reporting point information. For example, when the first information input device clicks on the icon of the application program on the home screen of the terminal, the terminal can start the application program corresponding to the icon. For another example, when the first information input device slides left and right on the home screen, the terminal can refresh the icons of the application programs displayed in the home interface, and the like.
  • an embodiment of the present application provides a terminal, where the terminal includes: a screen, a memory, and one or more processors; the screen and the memory are coupled to the one or more processors, and the The memory is used to store computer program code, the computer program code comprising computer instructions, the one or more processors invoking the computer instructions to cause the terminal to perform the second aspect or any one of the embodiments of the second aspect the method described.
  • an embodiment of the present application provides an information input device, the information input device includes: a memory and one or more processors; the memory is coupled to the one or more processors, and the memory uses to store computer program code, the computer program code comprising computer instructions, the one or more processors invoking the computer instructions to cause the information input device to perform the third aspect or any one of the embodiments of the third aspect the method described.
  • an embodiment of the present application provides a communication system, wherein the communication system includes a terminal and a first information input device, the terminal is the terminal described in the fifth aspect, and the first information input device The device is the information input device described in the sixth aspect.
  • the communication system of the seventh aspect may further include a second information input device.
  • the second information input device is configured to execute the method on the side of the second information input device described in the first aspect or any one of the implementation manners of the first aspect.
  • an embodiment of the present application provides a computer program product containing instructions, when the computer program product runs on an electronic device, the electronic device is made to execute any one of the second aspect or the second aspect The method described in the embodiment.
  • an embodiment of the present application provides a computer-readable storage medium, comprising instructions, wherein when the instructions are executed on an electronic device, the electronic device is caused to execute the second aspect or the second aspect The method described in any one of the embodiments of .
  • an embodiment of the present application provides a computer program product containing instructions, characterized in that, when the computer program product runs on an electronic device, the electronic device is caused to perform the third aspect or the third aspect The method described in any one of the embodiments of .
  • an embodiment of the present application provides a computer-readable storage medium, including instructions, characterized in that, when the instructions are executed on an electronic device, the electronic device is caused to execute the third aspect or the third The method of any one of the embodiments of the aspect.
  • the terminal can distinguish different information input devices, perform graphics rendering for different information input devices, and display the corresponding movement trajectory, that is, the terminal supports multiple simultaneous writing scenarios.
  • the method distinguishes different information input devices by the frequency of the signals, does not need to send additional information input device IDs, and does not affect the reporting rate.
  • the information input device can transmit the pressure value in an efficient and timely manner by using wireless communication technology, so that the terminal can render and display the corresponding movement trajectory in real time, so that the information input device has good chirality and can improve the user experience.
  • FIG. 1 is a schematic structural diagram of a communication system 10 according to an embodiment of the present application.
  • FIG. 2A is a schematic diagram of a hardware structure of a terminal provided by an embodiment of the present application.
  • 2B is a schematic diagram of a software structure of a terminal provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a hardware structure of an information input device provided by an embodiment of the present application.
  • FIG. 4A is a schematic structural diagram of a touch sensor of a terminal according to an embodiment of the present application.
  • FIG. 4B is a geometric diagram when calculating the inclination according to an embodiment of the present application.
  • FIG. 5 is a working time diagram of a terminal and an information input device provided by an embodiment of the present application.
  • FIG. 6 is a schematic flowchart of a method for controlling an information input device on a terminal provided by an embodiment of the present application
  • 7A and 7B are a set of user interfaces implemented on a terminal provided by an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of a wireless message for frequency allocation provided by an embodiment of the present application.
  • FIG. 9 is a working time diagram of each device in the communication system 10 provided by the embodiment of the present application.
  • FIG. 10 is a schematic diagram of a PWM signal 1 and a PWM signal 2 provided by an embodiment of the application;
  • FIG. 11 is a schematic diagram of a terminal displaying movement trajectories of multiple information input devices according to an embodiment of the present application.
  • first and second are only used for descriptive purposes, and should not be construed as implying or implying relative importance or implying the number of indicated technical features. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, the “multiple” The meaning is two or more.
  • GUI graphical user interface
  • Simultaneous writing with multiple strokes refers to a scenario in which multiple information input devices write, draw or manipulate on the same terminal.
  • the terminal needs to correspond to the pressure value, reporting point information and inclination of the same information input device, so that the different multiple information input devices can be used separately.
  • Point-reporting information refers to the location where the terminal senses the information input device, such as the location where the information input device directly touches the screen of the terminal, or the location where the terminal detects a signal when the information input device is close to the terminal.
  • the inclination refers to the inclination angle of the information input device relative to the screen of the terminal.
  • the prior art provides the following two methods for simultaneous writing of multiple strokes.
  • the first method the terminal obtains the pressure value, the reporting point information and the inclination of the information input device through the signal emitted by the pen tip of the information input device. In this way, the terminal can distinguish the pressure value, reporting point information and inclination of different information input devices. However, the transmission rate of the signal emitted by the pen tip is extremely low, resulting in a low point rate.
  • the second method the terminal obtains the point reporting information and the inclination of the information input device through the signal emitted by the pen tip of the information input device, and sends the Bluetooth message based on the Bluetooth low energy (BLE) technology through the information input device. to get the pressure value.
  • BLE Bluetooth low energy
  • the signal emitted by the pen tip needs to have a part (for example, 36 bits) to transmit the identity document (ID) of the information input device.
  • the Bluetooth message also carries the information input device ID, so that the terminal can input the same information into the device. corresponding to the pressure value, reporting point information and inclination.
  • the second method will lose part of the reporting information (for example, 24 reporting information), which affects the reporting rate.
  • the reporting rate is an important factor affecting the writing experience. A low reporting rate will cause the movement trajectory rendered and displayed by the terminal graphics to be inconsistent with the actual movement trajectory of the information input device on the terminal screen, which will affect the chirality.
  • the following embodiments of the present application provide a method, an apparatus, and a system for controlling an information input device on a terminal.
  • this method it is suitable for the scenario where multiple strokes are written at the same time.
  • the terminal may allocate different frequencies to different information input devices.
  • Each information input device can use the frequency assigned by the terminal to send the pulse signal, the terminal can detect the pulse signal on the screen, and display the movement track at the position where the pulse signal is detected, the appearance of the movement track corresponding to the pulse signal of different frequencies is different .
  • the terminal can distinguish pulse signals sent by different information input devices through different frequencies, and display moving trajectories with different appearances for different information input devices. This enables multiple simultaneous writing.
  • the appearance of the movement track may include, but is not limited to: color, thickness, depth, or stroke, and so on.
  • the information input device may directly contact the terminal screen, or may not contact the terminal screen, for example, be close to the terminal screen, which is not limited in this embodiment of the present application. That is to say, as long as the terminal can detect the pulse signal sent by the information input device, the corresponding movement trajectory can be displayed.
  • the terminal can sense the pulse signal sent by the information input device, that is, the movement track can be displayed at the position where the pulse signal is detected. In this way, when the user has a writing intention, the movement track of the corresponding information input device can be displayed, and the function of "0-pressure-sensitive ink ejection" can be realized. This is a better experience for the user.
  • the appearance of the movement track can be determined in the following ways:
  • the terminal is preset. For example, the movement trajectories corresponding to two pulse signals of different frequencies can be displayed in red and the other in blue. In this way, the user can directly distinguish different information input devices from the difference in the appearance of the movement track.
  • the terminal determines the appearance of the movement track corresponding to the information input device, such as thickness, depth, etc., according to the pressure value when the information input device contacts the screen of the terminal. For example, when the pressure value is larger, the color of the movement track corresponding to the information input device is darker or the line is thicker.
  • the information input device can send the pressure value collected when touching the screen of the terminal and the identification of the information input device to the terminal through a wireless connection with the terminal.
  • the terminal can know which information input device the pressure value belongs to through the identifier, and determine the appearance of the movement track of the corresponding information input device according to the pressure value.
  • the terminal can distinguish the pressure values of different information input devices, and reflect the pressure values on the movement trajectory of the corresponding information input device, so as to achieve a fine and accurate display effect.
  • the user can control the appearance of the movement track by controlling the strength, which can bring a good user experience to the user.
  • the terminal determines the appearance of the movement track corresponding to the information input device, such as thickness, depth, etc., according to the intensity of the detected pulse signal. For example, when the intensity of the pulse signal is greater, the color of the movement track corresponding to the information input device is darker or the line is thicker.
  • the terminal determines, according to the inclination of the information input device, the appearance of the movement track corresponding to the information input device, such as the stroke, thickness, and the like. For example, when the inclination is larger, the line corresponding to the movement track of the information input device is thicker.
  • the terminal can distinguish the inclination of different information input devices, and reflect the inclination on the movement trajectory of the corresponding information input device, so as to achieve a fine and accurate display effect.
  • the user can control the appearance of the movement track by controlling the inclination, which can bring a good user experience to the user.
  • the terminal can distinguish different information input devices, perform graphics rendering for different information input devices, and display the corresponding movement trajectory, that is, the terminal supports multiple simultaneous writing scenarios.
  • the method distinguishes different information input devices by the frequency of the signals, does not need to send additional information input device IDs, and does not affect the reporting rate.
  • the information input device can transmit the pressure value in an efficient and timely manner by using wireless communication technology, so that the terminal can render and display the corresponding movement trajectory in real time, so that the information input device has good chirality and can improve the user experience.
  • a scenario in which multiple strokes are written at the same time refers to a scenario in which one or more users use multiple information input devices to write on the same terminal.
  • the scenario of writing with multiple strokes may include, but is not limited to, one or more users using multiple information input devices to draw, work, design patterns, input text or data (eg, signature) on the same terminal, and so on.
  • the content written by the user on the terminal using the information input device may be text, line, drawing or any pattern, which is not limited here.
  • the wireless communication technologies used by the information input device may include but are not limited to: Bluetooth (bluetooth, BT), near field communication (near field communication, NFC), wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (WiFi)), radio frequency identification (radio frequency identification, RFID) or ZigBee and so on.
  • Bluetooth may include Classic Bluetooth or Bluetooth Low Energy BLE.
  • FIG. 1 shows a communication system 10 provided by an embodiment of the present application.
  • the communication system 10 may include: a terminal 400, and one or more information input devices.
  • an information input device 100 , an information input device 200 and an information input device 300 are shown in FIG. 1 .
  • the information input device 100 , the information input device 200 , and the information input device 300 may be manipulated by the same user, or may be manipulated by different users.
  • the information input device 100 can be manipulated by the user 1
  • the information input device 200 can be manipulated by the user 2
  • the information input device 300 can be manipulated by the user 3 .
  • the terminal 400 is configured with a screen. In some embodiments, the terminal 400 may be configured with a larger size screen.
  • the terminal 400 may be a portable electronic device such as a mobile phone, a tablet computer, a personal digital assistant (PDA), a wearable device, and a laptop computer (laptop).
  • portable electronic devices include, but are not limited to, portable electronic devices powered by iOS, android, microsoft, or other operating systems. It should also be understood that, in some other embodiments of the present application, the electronic device may not be a portable electronic device, but a smart TV, smart screen, desktop computer or electronic billboard having a touch-sensitive surface (such as a touch panel). etc.
  • the information input device is an active information input device, such as an active capacitive stylus. It is understandable that the information input device is only a word used in the embodiment of this application, and the meaning it represents is an information input device, and the functions it performs have been recorded in this embodiment, and its name does not affect this embodiment. constitute any restriction. In addition, in some other embodiments of the present application, the information input device may also be referred to as, for example, a stylus pen, an active stylus pen, a signal pen, or other terms.
  • a wireless connection may be established between the terminal 400 and multiple information input devices based on a wireless communication technology, respectively.
  • the terminal 400 may establish BLE connections with multiple information input devices respectively.
  • the terminal 400 can allocate different frequencies to different information input devices based on the wireless connection.
  • the terminal 400 can allocate one or two frequencies to the same information input device.
  • the frequency allocated by the terminal 400 to each information input device is a low frequency, for example, a frequency between 100KHz and 400KHz.
  • the frequency allocated by the terminal 400 to the information input device can be used by the information input device to send signals to the terminal 400 during the writing process subsequently.
  • the terminal 400 may store the correspondence between the respective information input devices and the frequencies allocated to the respective information input devices.
  • the terminal 400 may also send more abundant information based on the wireless connection with each information input device, such as information such as the remaining power of the information input device, whether a button of the information input device is pressed, and the like.
  • the terminal 400 may periodically transmit a signal based on direct sequence spread spectrum (DSSS) (hereinafter referred to as a DSSS signal) through the touch panel.
  • DSSS direct sequence spread spectrum
  • the pen tip of the information input device touches or is about to touch the screen of the terminal 400, it can detect the DSSS signal sent by the terminal 400 to know that the screen of the terminal 400 is nearby, that is, the user has a writing intention.
  • the information input device may transmit a pulse width modulation (PMW) type signal (hereinafter referred to as a PWM signal) to the terminal 400 using the frequency allocated by the terminal 400 .
  • PMW pulse width modulation
  • the information input device can use the frequency to send one PWM signal.
  • the terminal 400 can determine the information input device that transmits the signal according to the frequency of the received PWM signal of the 1 channel, and can also obtain the notification information of the information input device according to the PWM signal of the 1 channel.
  • the information input device can use the two frequencies to send one PWM signal respectively, that is, to send two PWM signals.
  • the terminal 400 can determine the information input device that transmits the signal according to the frequency of the received 2-channel PWM signal, and can also obtain the alarm point information and the inclination of the information input device according to the 2-channel PWM signal.
  • the information input device may continuously send the PWM signal to the screen of the terminal 400 through the pen tip, or may periodically send the signal, which is not limited herein.
  • the information input device can also detect the pressure value when the pen tip touches the screen of the terminal 400, and send a wireless message to the terminal 400 through the wireless connection with the terminal 400, where the wireless message carries the pressure value and the ID of the information input device. After receiving the wireless message, the terminal 400 can determine the pressure value of the information input device corresponding to the information input device ID.
  • the terminal 400 may determine the pressure value, point information and inclination of each information input device, or the terminal 400 may determine the pressure value and point information of each information input device, and perform graphic rendering according to the determined content. Then, the movement track of the corresponding information input device on the upper part of the screen is displayed on the screen.
  • the communication system 10 there are at least three information channels between the terminal 400 and each information input device. in:
  • the first information channel is an uplink channel for the terminal 400 to send a DSSS signal to the information input device.
  • the second information channel is a downlink channel for the information input device to send a PWM signal to the terminal 400 using the allocated frequency.
  • the second information channel may include the first sub-channel.
  • the first sub-channel is used for the information input device to send 1 channel of PWM signal to the terminal using the allocated frequency, and the 1 channel of PWM signal is used for the terminal 400 to obtain the report information of the information input device.
  • the second information channel may further include a second sub-channel, and the second sub-channel is used for the information input device to send a PWM signal to the terminal 400 using the assigned frequency.
  • the two PWM signals transmitted by the second word channel and the first sub-channel are combined for the terminal 400 to know the inclination of the information input device.
  • the third information channel is an uplink and downlink bidirectional channel, used by the terminal 400 to assign frequencies to the information input device, and also used by the information input device to send a wireless message carrying the pressure value and the ID of the information input device to the terminal 400 .
  • This frequency is used for the information input device to send a signal to the terminal 400 through the second information channel.
  • the first information channel and the second information channel may be two unidirectional channels, or may be two transmission directions of a bidirectional channel.
  • Subsequent embodiments will combine the hardware structures of the terminal 400 and the information input device to describe in detail the constitution of the three information channels and the principle of transmitting information, which will not be described here.
  • FIG. 2A exemplarily shows a schematic structural diagram of a terminal 400 provided by an embodiment of the present application.
  • the terminal 400 may include: a processor 110 , an external memory interface 120 , an internal memory 121 , a universal serial bus (USB) interface 130 , a charging management module 140 , a power management module 141 , and a battery 142 , Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Interface 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, Camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
  • a processor 110 an external memory interface 120
  • an internal memory 121 a universal serial bus (USB) interface 130
  • USB universal serial bus
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a touch chip such as a touch panel integrated circuit (TPIC), a graphics processor (graphics processing unit, GPU), image signal processor (image signal processor, ISP), controller, memory, digital signal processor (digital signal processor, DSP), etc.
  • AP application processor
  • TPIC touch panel integrated circuit
  • GPU graphics processor
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • DSP digital signal processor
  • the controller may be the nerve center and command center of the terminal 400 .
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes various functional applications and data processing of the terminal 400 by executing the instructions stored in the internal memory 121 .
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area may store data (such as audio data, phone book, etc.) created during the use of the terminal 400 and the like.
  • the wireless communication function of the terminal 400 may be implemented by the antenna 1, the antenna 2, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in terminal 400 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
  • the wireless communication module 160 may be configured to establish wireless connections with multiple information input devices based on wireless communication technologies, respectively.
  • the wireless connection can be used by the terminal 400 to assign different frequencies to different information input devices.
  • the terminal 400 can allocate 2 frequencies to the same information input device. This frequency can be used by the information input device to send a PWM signal to the terminal 400 in the subsequent writing process.
  • the wireless communication module 160 may also receive a wireless message (eg, BLE message) sent by the information input device during the writing process based on the wireless connection, where the wireless message carries the pressure value detected by the information input device and the ID of the information input device.
  • the wireless message is transmitted to the AP, and the AP determines the pressure value of the information input device corresponding to the information input device ID according to the wireless message. After that, the AP can transmit the pressure value of the information input device to the GPU for subsequent graphics rendering for the information input device.
  • the terminal 400 implements a display function through the GPU, the display screen 194, and the AP.
  • the GPU is a microprocessor for image processing, and connects the display screen 194 and the AP.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the GPU may render graphics according to the pressure value, reporting point information, and inclination of each information input device, and transmit the rendered result to the display screen 194, which displays the corresponding movement trajectory.
  • Display screen 194 is used to display images, videos, and the like. In this embodiment of the present application, the display screen 194 may be used to display the movement trajectories of multiple information input devices respectively.
  • Display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • the terminal 400 may include one or N display screens 194 , where N is a positive integer greater than one.
  • the pressure sensor 180A is used to sense the pressure signal, and can convert the pressure signal into a signal.
  • the pressure sensor 180A may be provided on the display screen 194 .
  • the capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes.
  • the terminal 400 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the terminal 400 detects the intensity of the touch operation according to the pressure sensor 180A.
  • the terminal 400 can also calculate the touched position according to the detection signal of the pressure sensor 180A.
  • touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near it.
  • the touch sensor can communicate the detected touch operation to the AP to determine the touch event type.
  • Visual output related to touch operations may be provided through display screen 194 .
  • the touch sensor 180K may also be disposed on the surface of the terminal 400 , which is different from the position where the display screen 194 is located.
  • the touch sensor 180K can be used to transmit a signal (eg, a DSSS signal) to the information input device, and the signal can be used by the information input device to know that the screen of the terminal 400 is nearby, that is, to know that the user has a writing intention.
  • a signal eg, a DSSS signal
  • the touch sensor 180K may also be used to receive a signal transmitted by the information input device, and the processor 110 may determine the point announcement information and the inclination according to the signal.
  • the working principle of the touch sensor 180K will be described in detail later, which will not be repeated here.
  • the screen of the terminal 400 may refer to a device composed of a protective glass (not shown in the figure), a touch sensor 180K, a display screen 194, a bottom plate (not shown in the figure) and some peripheral circuits.
  • the screen is, from top to bottom, the protective glass, the touch sensor 180K, the display screen 194, and the bottom plate.
  • the terminal 400 may include more or less components than those shown in the drawings, or combine some components, or separate some components, or arrange different components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiments of the present application take an Android system with a layered architecture as an example to exemplarily describe the software structure of the electronic device 100 .
  • FIG. 2B is a block diagram of the software structure of the electronic device 100 according to the embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.
  • the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, and a kernel layer.
  • the application layer can include a series of application packages.
  • the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.
  • Content providers are used to store and retrieve data and make these data accessible to applications.
  • the data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications.
  • a display interface can consist of one or more views.
  • the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide the communication function of the electronic device 100 .
  • the management of call status including connecting, hanging up, etc.).
  • the resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.
  • the notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.
  • Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
  • the core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.
  • a system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • surface manager surface manager
  • media library Media Libraries
  • 3D graphics processing library eg: OpenGL ES
  • 2D graphics engine eg: SGL
  • the Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display drivers, camera drivers, audio drivers, and sensor drivers.
  • FIG. 3 is a schematic structural diagram of an information input device provided by an embodiment of the present application.
  • the information input device may be any information input device in the communication system 100 shown in FIG. 1 , for example, the information input device 100 , the information input device 200 or the information input device 300 .
  • the information input device shown in FIG. 3 may be an active capacitive stylus.
  • the active capacitive stylus may include: a processor 201, a power supply 202, a microcontroller unit (MCU) 203, a direct current-direct current converter (DC/DC) ) 204 , a signal transmission circuit 205 , a signal detection circuit 206 , a pressure sensor 207 and a wireless communication module 208 .
  • MCU microcontroller unit
  • DC/DC direct current-direct current converter
  • the processor 201 may include one or more processing units, for example, the processor 201 may include an application processor (application processor, AP), a controller, a memory, and the like. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • controller controller
  • memory and the like.
  • different processing units may be independent devices, or may be integrated in one or more processors.
  • the power source 202 may be a rechargeable lithium battery or a replaceable standard battery or the like. During operation, the power supply 202 supplies power to the MCU 203, the signal transmission circuit 205, the signal detection circuit 206, the pressure sensor 207 and the wireless communication module 208 through the DC/DC power converter 204.
  • the signal detection circuit 203 can be disposed at the position of the pen tip of the information input device.
  • Signal detection circuit 203 may include one or more electrodes.
  • the signal detection circuit 203 may be used to detect signals (eg, DSSS signals) emitted by the screen of the terminal 400 .
  • the pressure sensor 207 can be disposed at the position of the pen tip of the information input device.
  • the pressure sensor 207 can be used to detect the pressure value that the pen tip of the information input device bears, that is, the pressure value.
  • the wireless communication module 208 can provide a wireless communication technology solution applied on the information input device, for example, a wireless communication solution such as WLAN (such as Wi-Fi), BT, GNSS, FM, NFC, IR, RFID or ZigBee.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 208 can be used together with an antenna (not shown in FIG. 3 ) of the information input device, receives electromagnetic waves via the antenna, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 208 .
  • the wireless communication module 208 can also receive the signal to be sent from the processor 201, perform frequency modulation on it, amplify the signal, and convert it into electromagnetic waves for radiation through the antenna.
  • the wireless communication module 208 may be configured to establish a wireless connection with the terminal 400, and receive the frequency allocated by the terminal 400 for the information input device based on the wireless connection.
  • the wireless communication module 208 may also send a wireless message carrying the pressure value and the ID of the information input device to the terminal 400 based on the wireless connection with the terminal 400 .
  • the MCU 203 Under the control of the clock generated by the internal crystal oscillator, the MCU 203 generates a PWM signal consistent with the frequency allocated by the terminal 400, and drives the signal transmitting circuit 205 to transmit the PWM signal.
  • Signal transmission circuit 205 may include one or more electrodes.
  • the signal transmitting circuit 205 can be disposed at the position of the pen tip of the information input device.
  • the PWM signal transmitted by the signal transmitting circuit 205 is transmitted to the screen of the terminal 400 through the pen tip of the information input device in the form of a high-voltage square wave signal.
  • the signal transmitting circuit 205 can be used to transmit a PWM signal, and the PWM signal is used for the terminal 400 to determine the alarm information of the information input device. In other embodiments, the signal transmitting circuit 205 can be used to transmit two PWM signals, wherein one PWM signal is used for the terminal 400 to determine the reporting point information of the information input device, and the two PWM signals are combined for the terminal 400 to determine the information input device. of inclination.
  • the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the information input device.
  • the information input device may include more or less components than those shown in the figure, such as buttons, LED indicators, or the information input device may also combine some components, or separate some components, Or a different component arrangement.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the third information channel the wireless connection established between the wireless communication module 160 of the terminal 400 and the wireless communication module 208 of the information input device, such as BLE connection, WiFi direct connection, NFC connection, ZigBee connection and so on.
  • the third information channel is used for the terminal 400 to assign a frequency to the information input device, and is also used for the information input device to send a wireless message carrying the pressure value and the ID of the information input device to the terminal 400 .
  • the terminal 400 can assign one or two frequencies to one information input device.
  • the frequency allocated by the terminal 400 for the information input device is used for the pen tip electrode of the information input device to transmit the PWM signal.
  • the second information channel the channel through which the signal transmitting circuit 205 of the information input device transmits the PWM signal to the screen of the terminal 400 using the frequency allocated to it by the terminal 400 .
  • the second information channel may include a first sub-channel, and the first sub-channel is composed of one electrode included in the signal transmitting circuit 205 of the pen tip of the information input device, and the screen of the terminal 400 .
  • the first sub-channel is used for the pen tip electrode of the information input device to transmit a signal PWM signal to the screen of the terminal 400 by using the assigned frequency, and the signal is used for the terminal 400 to obtain the report point information of the information input device. The principle is explained in detail below.
  • the in-screen touch sensor 180K of the terminal 400 may include an X-axis electrode layer and a Y-axis electrode layer.
  • the X-axis electrode layer may include a plurality of transmit (transmit, Tx) electrodes distributed in a matrix
  • the Y-axis electrode layer may include a plurality of receive (receive, Rx) electrodes distributed in a matrix.
  • the Tx electrodes and the Rx electrodes form a crisscross network, and the intersections (ie coordinate points) of the Tx electrodes and the Rx electrodes form a mutual capacitance (ie the capacitance formed by the Tx electrodes and the adjacent Rx electrodes).
  • the touch chip connected to the touch sensor 180K can send an excitation signal to each Tx electrode in turn, and then the touch chip scans the signal received by each receiving Rx electrode, Convert the measured voltage value to digital signal and calculate the capacitance value.
  • the terminal 400 detects the touch operation of the finger, and the principle of detecting the input content of the information input device is different.
  • the finger, the touch sensor 180K and the insulating material between them can form a coupling capacitance, causing a slight change in current and a change in mutual capacitance.
  • the terminal 400 detects the change of the capacitance of the touch point by scanning the X-axis electrode matrix and the Y-axis electrode matrix, and calculates the position of the finger.
  • the terminal 400 may determine the position point at which the PWM signal is received.
  • the terminal 400 enters the information input device detection mode that is, during the signal detection period of the working cycle of the terminal 400
  • the Tx electrode on the touch sensor 180K is converted into an Rx electrode, which alternately senses the X and Y axes with the original Rx electrode.
  • Measure the transmitted signal of information input devices such as active capacitive stylus.
  • the signals received on the Tx electrodes (which have been converted into Rx electrodes) and the original Rx electrodes can be amplified by the amplifying circuit of the touch chip.
  • the numerical envelope composed of the amplitude value of the received signal (or the capacitance value of the X-axis and Y-axis) can be obtained on the X-axis electrode and the Y-axis electrode respectively, and the coordinates (x, y) of the signal receiving point can be obtained by AP calculation. ), that is, reporting point information.
  • a calculation method can be performed by substituting the numerical envelope into the prior information input device envelope model for calculation.
  • the touch chip transforms the signal from time-frequency to frequency domain. For example, by performing fast Fourier transform on the signal, the frequency of the signal sent by the information input device can be obtained.
  • the second information channel may further include a second sub-channel, the second sub-channel is composed of one electrode included in the signal transmitting circuit 205 of the pen tip of the information input device, and the screen of the terminal 400 .
  • the electrodes in the second subchannel are different from the electrodes in the first subchannel.
  • the second sub-channel is used for the pen tip electrode of the information input device to transmit a PWM signal to the screen of the terminal 400 using the assigned frequency.
  • the signal transmitted by the second sub-channel and the signal transmitted by the first sub-channel are jointly used for the terminal 400 to know the inclination of the information input device. The principle is explained in detail below.
  • the signal transmitting circuit 205 of the information input device may include two electrodes: electrode 1 and electrode 2 . Electrode 1 and the screen form the first sub-channel, and electrode 2 and the screen form the second sub-channel.
  • the inclination angle ⁇ is the inclination of the information input device.
  • d1 is the distance between electrode 1 and electrode 2.
  • the terminal 400 may acquire d1 during or after establishing a connection with the information input device.
  • the touch sensor 180K When the information input device is close to the screen, the signals respectively emitted by the electrodes 1 and 2 can be sensed by the touch sensor 180K.
  • the touch chip of the terminal 400 can calculate the capacitance value of each coordinate point of the touch sensor 180K, and report the capacitance value of each coordinate point to the AP. Projection distance d2 between projection points.
  • the envelope model can also be obtained by modeling the signal amplitude envelopes generated by the signals of the electrode 1 and the electrode 2 received at different tilt angles.
  • the terminal 400 may store the envelope model, and after entering the information input device detection mode, substitute the real-time generated signal amplitude envelope into the envelope model to extract the tilt angle.
  • the PWM signal transmitted by the first subchannel may be referred to as PWM signal 1
  • the PWM signal transmitted by the second subchannel may be referred to as PWM signal 2.
  • the first information channel the channel through which the screen of the terminal 400 transmits the DSSS signal to the signal detection circuit 203 of the information input device.
  • the first information channel is composed of the screen of the terminal 400 and one or more receiving electrodes of the signal detection circuit 203 of the information input device.
  • a signal is sent by one or more Tx electrodes on the screen and/or Tx electrodes converted from the Rx electrodes, such as a signal modulated by DSSS, which is received by one or more receiving electrodes of the pen tip of the information input device .
  • the signal can be used for the information input device to know that the terminal screen is nearby, that is, to know that the user has a writing intention.
  • the DSSS signal sent by the terminal 400 to the information input device and the signals (eg PWM signal 1 and PWM signal 2) sent by the information input device to the terminal 400 are all on the terminal 400.
  • the signal transmitted between the screen of the terminal 400 and the pen tip of the information input device needs to be detected or sent by the screen of the terminal 400 or the pen tip of the information input device.
  • the following introduces the screen of the terminal 400 and the mechanism of the pen tip of the information input device for detecting and sending signals.
  • the information input device can continuously transmit the PWM signal, and can also continuously detect the DSSS signal transmitted by the terminal 400 .
  • the information input device may detect and transmit the signal periodically, and the transmission and detection may be separated in timing. That is, the information input device performs signal transmission and signal detection respectively in different time periods of the same cycle. In this way, interference between signals can be avoided, and the power of the information input device can be saved.
  • the terminal 400 can continuously transmit the DSSS signal, and can also continuously detect the PWM signal transmitted by the information input device.
  • terminal 400 may periodically detect and transmit signals, and may perform transmission and detection separately in timing. In this way, interference between signals can be avoided, and power of the terminal 400 can be saved.
  • the information input device transmits two PWM signals (ie, PWM signal 1 and PWM signal 2) in one cycle, the two PWM signals may have overlapping parts in time sequence, or may not overlap in time sequence, the embodiment of this application There is no restriction on this.
  • FIG. 5 exemplarily shows a working time diagram of a terminal 400 and an information input device.
  • the information input device transmits two PWM signals, namely PWM signal 1 and PWM signal 2 .
  • terminal 400 detects and transmits signals periodically, and transmits and detects separately in timing.
  • one duty cycle of the screen detection and signal transmission of the terminal 400 is T.
  • one signal transmission time period and multiple signal detection time periods may be included.
  • the signal transmission time period may be: 120us ⁇ 320us.
  • the multiple signal detection time periods may include: 800us-2800us, 4300us-5600us, 7200us-8400us, 9200us-11200us, 12700us-14000us, 15600us-16800us.
  • the terminal 400 can transmit a signal (for example, a DSSS signal) through the screen during the transmission period, and detect the 2-channel PWM signal transmitted by the information input device during the signal detection period.
  • a signal for example, a DSSS signal
  • the screen of the terminal 400 may also detect the touch input of the finger within the duty cycle T.
  • the terminal 400 can detect the touch input of the finger in the following time periods within the working cycle T of 16800us: 2800us-4300us, 5600us-7200us, 11200us-12700us, 14000us-15600us.
  • the principle of detecting the touch input of the finger by the terminal 400 is different from the principle of detecting the signal emitted by the information input device. Reference may be made to the implementation manner of the prior art and the foregoing related descriptions, which will not be repeated here.
  • one duty cycle of the information input device for detecting and transmitting signals may also be T.
  • it may include one signal detection time period, multiple first transmission time periods, and multiple second transmission time periods.
  • the signal detection time period may be: 120us ⁇ 320us.
  • the multiple first transmission time periods may include: 800us-2800us, 4300us-5600us, 7200us-8400us, 9200us-11200us, 12700us-14000us, 15600us-16800us.
  • the multiple second transmission time periods may include: 1600us-2800us, 4400us-5600us, 7200us-8400us, 1000us-11200us, 12800us-14000us, 15600us-16800us.
  • the information input device can detect the signal (eg DSSS signal) transmitted by the terminal 400 through the signal detection circuit 206 in the signal detection period, transmit the PWM signal 1 through the signal transmission circuit 205 in the first transmission period, and pass the signal in the second transmission period
  • the transmit circuit 205 transmits the PWM signal 2 .
  • the signal detection time period of the information input device covers the transmission time period of the terminal 400; the signal detection time period of the terminal 400 is the same as the first transmission time period of the information input device, and covers the information input device the second launch period.
  • the information input device and the terminal 400 can cooperate to complete the transmission of the uplink signal (eg DSSS signal) and the downlink signal (eg PWM signal), and save the power of both parties to the greatest extent.
  • the uplink signal eg DSSS signal
  • the downlink signal eg PWM signal
  • the information input device may only transmit one PWM signal (ie, PWM signal 1), that is, the working cycle of the information input device does not include the second transmission time period.
  • PWM signal 1 the PWM signal 1
  • the terminal 400 and the information input device may also use other periods and time periods to transmit or detect signals.
  • the terminal 400 shown in FIGS. 2A and 2B Based on the communication system 100 shown in FIG. 1 , the terminal 400 shown in FIGS. 2A and 2B , the information input device shown in FIG. 3 , the working principles of the three information channels described above, and the terminal 400 and the information input device
  • the mechanisms for detecting and sending signals respectively the following describes in detail the method for controlling the information input device on the terminal provided by the embodiments of the present application.
  • the method provided by the embodiment of the present application can be used in a scenario of simultaneous writing of multiple strokes, and the following description is made by taking the implementation of the method provided by the embodiment of the present application in a scenario of simultaneous writing of multiple strokes as an example.
  • FIG. 6 is a schematic flowchart of a method for operating an information input device on a terminal according to an embodiment of the present application.
  • FIG. 6 exemplarily shows the interaction flow between the terminal 400 and the information input device 100 and the information input device 200.
  • the terminal 400 can also interact with more information input devices, for example, the information input device 300. This embodiment of the present application does not limit this.
  • the method may include the following steps:
  • the terminal 400 establishes wireless connections with multiple information input devices respectively.
  • the terminal 400 may establish wireless connections with multiple information input devices (for example, the information input device 100 , the information input device 200 , and the information input device 300 ) respectively, and maintain wireless connections with the multiple information input devices at the same time.
  • the wireless connection may include, but is not limited to, a connection established based on wireless communication technologies such as BT, WLAN (eg, Wi-Fi), GNSS, FM, NFC, IR, RFID, or ZigBee.
  • BT can be classic Bluetooth or BLE.
  • the terminal 400 may establish a BLE connection with a plurality of information input devices respectively based on the BLE protocol stack.
  • the terminal 400 may use a wireless communication technology (eg, BLE) to search for a nearby information input device, and after searching for a nearby information input device, send a connection request to the information input device in response to a received user operation. After the information input device accepts the request, the terminal 400 may establish a wireless connection with the information input device.
  • a wireless communication technology eg, BLE
  • FIG. 7A and FIG. 7B respectively illustrate a manner in which the terminal 400 is connected to the information input device.
  • FIG. 7A shows the user interface 71 displayed on the terminal 400 .
  • the user interface 71 may be provided by a “settings” application installed on the terminal 400 .
  • 'Settings' is an application for managing various functions on the terminal 400 .
  • the user interface 71 includes a Bluetooth switch control 701 , and the state of the Bluetooth switch control in the figure indicates that the Bluetooth function of the terminal 400 is currently enabled.
  • the terminal 400 may use Bluetooth (eg, BLE) to search for other nearby Bluetooth devices (eg, information input devices), and display the names of the searched other Bluetooth devices in the area 702 .
  • the names of the respective Bluetooth devices displayed in the area 702 can monitor user operations (such as finger-input click operations, touch operations), and the terminal 400 can respond to the user operations detected on the names of the Bluetooth devices to the Bluetooth device corresponding to the name.
  • a connection request is sent, and after the Bluetooth device accepts the request, a wireless connection is established with the Bluetooth device.
  • the user may click on the name 702 a of the information input device 100 in the area 702 to trigger the terminal 400 to send a Bluetooth connection request to the information input device 100 .
  • the name of the Bluetooth device may be a media access control (media access control, MAC) address, a user-defined name, a device model, etc., which is not limited in this embodiment of the present application.
  • the user can also trigger the terminal 400 to establish a Bluetooth connection with other nearby information input devices through similar user operations.
  • the terminal 400 establishes a Bluetooth connection with other information input devices, the previously established Bluetooth connection will not be disconnected, that is, the terminal 400 can maintain a Bluetooth connection with multiple information input devices at the same time.
  • FIG. 7B shows the user interface 72 displayed on the terminal 400 .
  • the side of the terminal 400 such as the frame where the volume keys are located, may be provided with a magnetic attraction device (eg, a magnetic strip) for attracting the information input device.
  • the user interface 72 may be that the terminal 400 responds to the operation that the information input device is adsorbed at the magnetic attraction device on the side of the terminal 400, uses a wireless communication technology (such as BLE) to search for nearby information input devices, and after the information input device is found The interface appears on the display.
  • a wireless communication technology such as BLE
  • the user interface 72 includes a window 703 , and the window 703 can be used to indicate the information input device searched by the terminal 400 .
  • the window 703 may include an icon 703a, a device name 703b, a control 703c, and a control 703d.
  • the icon 703a can be used to indicate the device type searched by the terminal 400, for example, the icon 703a can be a picture of the information input device.
  • the device name 703a may be a MAC address, a user-defined name, a device model, and the like.
  • the control 703c can be used to monitor a user operation, and the terminal 400 can stop displaying the window 703 in response to the user operation.
  • the control 703d can be used to monitor the user operation, and the terminal 400 can send a connection request to the information input device corresponding to the device name 703a in response to the user operation, and after the information input device accepts the request, establish a wireless connection with the information input device.
  • the window 703 indicates that the terminal 400 has searched for the information input device 100 , and the user can click on the control 703d to trigger the terminal 400 to send a connection request to the information input device 100 .
  • the user can also trigger the terminal 400 to establish a wireless connection with other nearby information input devices through similar user operations.
  • the terminal 400 may display multiple windows 703 corresponding to the multiple information input devices in the user interface 72; if the terminal 400 searches for multiple information input devices successively device, the window 703 corresponding to the information input device may be displayed in the user interface 72 successively.
  • the terminal 400 when the terminal 400 establishes a wireless connection with other information input devices, the previously successfully established wireless connection will not be disconnected, that is, the terminal 400 can maintain a wireless connection with multiple information input devices at the same time.
  • the window 703 can also be used to indicate that the wireless communication connection is currently being established, for example, the window 703 can output the text "connecting".
  • the window 703 can also be used to indicate that the wireless communication connection has been successfully established. For example, the window 703 can output the text "information input device 100 is connected”.
  • the terminal 400 allocates different frequencies to the multiple information input devices respectively based on the wireless connection with the information input devices.
  • the frequency allocated by the terminal 400 to each information input device may be, for example, a frequency between 100 KHz and 400 KHz.
  • the terminal 400 allocates different frequencies to different information input devices, and allocates one frequency to the same information input device. This frequency can be used by the information input device to send the PWM signal 1 to the terminal 400 using the first sub-channel in the second information channel.
  • the PWM signal 1 can be used for the terminal 400 to acquire the point information of the information input device.
  • the terminal 400 can distinguish the PWM signals 1 sent by different information input devices in the subsequent working process of the information input devices.
  • the terminal 400 may assign f1 to the information input device 100 , f2 to the information input device 200 , and f3 to the information input device 300 . f1, f2 and f3 are different.
  • the terminal 400 allocates different frequencies to different information input devices, and the terminal 400 may allocate two frequencies to the same information input device.
  • One of the frequencies is used for the information input device to send the PWM signal 1 to the terminal 400
  • the other frequency is used for the information input device to send the PWM signal 2 to the terminal 400 .
  • the two frequencies allocated by the terminal 400 to one information input device are different from the two frequencies allocated to another information input device.
  • the terminal 400 can distinguish the PWM signal 1 and the PWM signal 2 sent by different information input devices in the subsequent working process of the information input device.
  • the terminal 400 allocates two frequencies for an information input device, if the signal detection time period of the terminal 400 overlaps with the first transmission time period of the information input device, and, the signal detection time period of the terminal 400 and the information input device overlap.
  • the overlapped part of the second transmission time period of overlaps in timing.
  • the terminal 400 may allocate two different frequencies to the information input device. If the above-mentioned two parts do not overlap in timing, the terminal 400 may allocate the same two frequencies to the information input device. In this way, for the same information input device, the terminal 400 can distinguish the PWM signal 1 and the PWM signal 2 transmitted by the information input device according to the difference in time sequence or frequency.
  • the terminal 400 may allocate two frequencies f1 and f4 to the information input device 100, two frequencies f2 and f5 to the information input device 100, and two frequencies f3 and f6 to the information input device 100.
  • f1-f6 may be respectively: 100KHz, 101.91KHz, 110.34KHz, 112.68KHz, 120.30KHz, and 122.61KHz.
  • the terminal 400 may send a wireless message to the information input device based on the wireless connection with the information input device, and the message carries the indication information of the frequency allocated to the information input device by the terminal 400 .
  • the information input device can parse the message and learn the frequency allocated to it by the terminal 400 .
  • the following describes the format of the BLE message sent by the terminal 400 to the information input device by taking the BLE connection established between the terminal 400 and the information input device as an example.
  • the BLE message may be an ATT command packet in a BLE data packet.
  • FIG. 8 exemplarily shows the format of a protocol data unit (protocol data unit, PDU) in an ATT command packet sent by the terminal 400 to the information input device.
  • PDU protocol data unit
  • the rest of the ATT command packet such as the preamble, the access address, and the cyclic redundancy check (CRC)
  • CRC cyclic redundancy check
  • the PDU of the ATT command packet may include: Opcode, attribute parameters (attribute parameters), and authorization signature (authorization signature).
  • the attribute parameters may include: attribute handle, attribute type, attribute detailed information (attribute value), and attribute read and write permissions (attribute permissions).
  • the detailed information of the attribute can include the following three parts: characteristic (characteristic property), characteristic value index (characteristic value handle), characteristic universally unique identifier (UUID)).
  • a characteristic may occupy 1 octet, an eigenvalue index may occupy 2 octets, and a UUID may occupy 2 or 16 octets.
  • the characteristic value handle may be used to carry the ID of the information input device in the embodiment of the present application and the indication information of the frequency allocated to the information input device by the terminal 400.
  • the indication information of the frequency may include, for example, a frequency value, an index of the frequency value, or information on a frequency division and multiplication value of a crystal oscillator, which is not limited in this embodiment of the present application.
  • the information input device can parse the ATT command packet, obtain the indication information of the frequency from the characteristic value index in the ATT command packet, and learn that the terminal 400 allocates the frequency to itself according to the indication information. Frequency of.
  • the terminal 400 may also store the correspondence between each information input device and the frequency allocated to each information input device. Exemplarily, referring to Table 1, Table 1 exemplarily shows a corresponding relationship stored by the terminal 400 .
  • the terminal 400 enters a writing scene.
  • the writing scene refers to a scene in which one or more users use multiple information input devices to write on the same terminal.
  • the writing scene may include, but is not limited to, drawing, working, designing patterns, inputting text or data, etc. on the same terminal by one or more information input devices.
  • the content written by the information input device on the terminal may be text, lines, drawings, or any pattern, which is not limited here.
  • entering the writing scene by the terminal 400 may specifically mean that the terminal 400 starts or runs an application program or a user interface that provides functions such as drawing, office work, pattern design, text or data input, and the like.
  • the text or data input may include: signature, signature, and the like.
  • the application may be, for example, "Pendo", “Memo”, “Paint”, and the like.
  • the terminal 400 may start the application in response to a user operation detected on the icon of the application on the home screen.
  • the user operation may be, for example, a click operation, a long-press operation, a touch operation, etc. on an icon by a user using a finger or an information input device.
  • the application program that is started when the terminal 400 enters the writing scene may be referred to as the first application program.
  • the terminal 400 enters the writing scene it can notify the information input device through wireless connection with each information input device.
  • the information input device transmits a PWM signal using the frequency allocated to it by the terminal 400.
  • the information input device uses the frequency and transmits the PWM signal 1 through the first sub-channel.
  • the information input device uses one of the frequencies to transmit PWM signal 1 through the first sub-channel, and uses the other frequency to transmit PWM signal 2 through the second sub-channel.
  • the information input device may start to transmit a PWM signal after learning the frequency allocated to it by the terminal 400 or after learning that the terminal 400 has entered a writing scene, which is not limited in this embodiment of the present application.
  • the information input device may continuously transmit the signal using the frequency assigned by the terminal.
  • the information input device may send the PWM signal periodically. This can reduce the power consumption of the information input device.
  • the information input device may transmit the PWM signal 1 using a frequency allocated by the terminal 400 in the first transmission period of each working cycle T.
  • the information input device may also transmit the PWM signal 2 using another frequency allocated by the terminal 400 during the second transmission period.
  • the information input device may store a work schedule similar to that of the information input device shown in FIG. 5 , and after detecting the DSSS signal transmitted by the terminal 400, according to the signal detection time period and the first transmission in the work schedule The relationship between the time period and the second transmission time period determines the first transmission time period and the second transmission time period, and transmits corresponding signals within the time period.
  • the terminal 400 may store a work schedule similar to that of the terminal shown in FIG. 5 , and periodically transmit the DSSS signal during the signal transmission time period within each work cycle T.
  • the information input device can detect the signal. That is, when the information input device has a writing intention, the information input device can detect the signal and start to transmit the signal periodically.
  • the work schedules of different information input devices may be the same or different.
  • the working time of each information input device may be set by default at the factory, or may be negotiated jointly by the terminal 100 and the information input device.
  • the working time period of the information input device 100 may be as shown in FIG. 5 ;
  • the working time period of the information input device 200 may be: the working period T, the signal detection time period, the second transmission time period are the same as the terminal 200, the first transmission time period
  • the segment can include: 900us ⁇ 2800us, 4400us ⁇ 5600us, 7300us ⁇ 8400us, 9300us ⁇ 11200us, 12800us ⁇ 14000us, 15700us ⁇ 16800us;
  • the working time segment of the information input device 300 can be: working cycle T, signal detection time segment, first
  • the transmission time period is the same as that of the terminal 200, and the second transmission time period may include: 1700us-2800us, 4500us-5600us, 7300us-8400us, 1100us-11200us, 12900us-14000us, 15700us-16800us.
  • the working time periods of the information input device 100 , the information input device 200 and the information input device 300 may all be as shown in FIG. 5 .
  • FIG. 9 shows the working time, working frequency and working time of the terminal 400 of each information input device under the same working time period of the information input devices 100 - 300 .
  • both the PWM signal 1 and the PWM signal 2 transmitted by the information input device may be PWM signals generated by the signal transmitting circuit 205 of the MCU 203 driving the pen tip.
  • the transmission frequency of the PWM signal refers to the number of times per second in the PWM signal generated by the information input device from high level to low level and then back to high level
  • the duty cycle of the PWM signal refers to the number of times in one signal cycle.
  • the ratio of the time occupied by the pulse to the total time of the signal period When the PWM signal 1 and the PWM signal 2 are PWM signals, the transmission frequencies of the PWM signal 1 and the PWM signal 2 may refer to the foregoing.
  • the embodiments of the present application do not limit the duty ratios of the PWM signal 1 and the PWM signal 2 .
  • the duty ratios of the PWM signal 1 and the PWM signal 2 sent by different information input devices may be the same or different.
  • the duty ratios of the PWM signal 1 and the PWM signal 2 sent by the same information input device may be the same or different.
  • FIG. 10 exemplarily shows a PWM signal 1 and a PWM signal 2 respectively transmitted by an information input device using the two assigned frequencies.
  • the information input device may be, for example, the information input device 100, the information input device 200 or the information Input device 300 . It can be seen from Figure 10 that the frequencies of the two PWM signals transmitted by the same information input device are different, and the frequency of the PWM signal 2 is higher than the frequency of the PWM signal 1. In FIG. 10 , the duty cycles of PWM signal 1 and PWM signal 2 are the same.
  • the terminal 400 detects the PWM signal sent by each information input device, determines the information input device that sends the PWM signal according to the frequency of the PWM signal, and determines the reporting point information of the information input device according to the PWM signal.
  • the terminal 400 may successively detect the PWM signal sent by the same information input device at one or more position points.
  • the terminal 400 can continuously detect the PWM signals sent by each information input device.
  • the terminal 400 may periodically detect the PWM signal. Specifically, referring to FIG. 9 , the terminal 400 may detect the PWM signal in the signal detection period of each duty cycle T. As shown in FIG. In this way, the power consumption of the terminal 400 can be reduced.
  • the terminal 400 may receive the PWM signal 1 respectively sent by each information input device.
  • the terminal 400 may perform time-frequency domain conversion on each of the received PWM signals 1 , so as to determine the frequency of each of the PWM signals 1 .
  • the terminal 400 may determine the sender of each PWM signal 1 according to the frequency allocated to each information input device.
  • the terminal 400 analyzes each PWM signal 1, and associates the signal point information obtained by the analysis with the information input device. That is, the terminal 400 can respectively determine the reporting point information of each information input device according to the PWM signal 1 sent by each information input device.
  • the terminal 400 determines the reporting point information according to the PWM signal 1, reference may be made to the foregoing related descriptions.
  • the terminal 400 may also receive the PWM signal 2 sent by each information input device respectively.
  • the terminal 400 can perform time-frequency domain conversion on each of the received PWM signals 2 , so as to determine the frequency of each of the PWM signals 2 .
  • the terminal 400 may determine the sender of each PWM signal 2 according to the frequency allocated to each information input device.
  • the terminal 400 may determine the inclination of the information input device according to the PWM signal 1 and the PWM signal 2 of the same information input device.
  • the terminal 400 can determine the inclination of each information input device.
  • the terminal 400 may also record the time points at which each PWM signal 1 or PWM signal 2 is received, so as to determine the reporting point information of each information input device at each time point, and even the inclination of each time point.
  • the method shown in FIG. 6 may further include the following optional steps S160 and S170.
  • the information input device detects the pressure value on the pen tip, and sends a wireless message to the terminal 400 based on the wireless connection with the terminal 400, where the wireless message carries the pressure value and the ID of the information input device.
  • the information input device may continuously detect the pressure value of the pen tip, or may detect periodically, which is not limited in the embodiments of the present application.
  • the wireless message sent by the information input device also carries the time point when the pressure value is detected.
  • the wireless message sent by the information input device may be a BLE data packet.
  • the format of the BLE data packet may be carried based on the data format specified by the BLE protocol stack (for example, the human interface device (HID) protocol), which is not repeated in this embodiment of the present application.
  • the BLE protocol stack for example, the human interface device (HID) protocol
  • the information input device may send a wireless message to the terminal 400 immediately after detecting the pressure value on the pen tip. In this way, the terminal 400 can know the pressure value of the information input device in real time, so as to avoid time delay.
  • the information input device may send a wireless message to the terminal 400 after receiving the notification that the terminal 400 enters the writing scene.
  • the information input device can send pressure-sensitive information to the terminal 400 only in scenarios such as painting and writing that require pressure-sensitive information, thereby reducing the power consumption of the information input device.
  • the information input device may send the detected pressure value to the terminal 400 within the short-range wireless communication time window.
  • the short-range wireless communication time window may occur periodically.
  • the short-range wireless communication time window may be negotiated between the information input device and the terminal 400, or may be set by default by the information input device.
  • the short-range wireless communication time windows of the multiple information input devices may be the same or different, which is not limited in this embodiment of the present application.
  • the information input device can periodically send the detected pressure value, which can save power consumption.
  • the short-range wireless communication time window may be referred to as the first time window.
  • the terminal 400 receives the short-range wireless message carrying the pressure value and the information input device ID sent by each information input device, and determines the pressure value of the information input device corresponding to the information input device ID according to the short-range wireless message.
  • the terminal 400 may turn on the wireless communication module 160 (eg, a Bluetooth module) within the short-range wireless communication time window corresponding to each information input device to receive wireless messages sent by each information input device.
  • the wireless communication module 160 eg, a Bluetooth module
  • the terminal 400 can parse the wireless message, and determine the pressure value of the information input device corresponding to the information input device ID carried in the message according to the analysis result.
  • the message further includes a time point, and the terminal 400 can also learn the pressure value of the information input device at the corresponding time point according to the message.
  • the terminal 400 displays the movement trajectories corresponding to different information input devices on the screen.
  • the terminal 400 can obtain the report point information of each information input device, and at the location of the report point information (that is, it detects the signal transmitted by the information input device)
  • the position of the PWM signal shows the movement track of the corresponding information input device, and the appearance of the movement track of different information input devices is different.
  • the appearance of the movement track of each information input device may be preset by the terminal.
  • the terminal 400 can obtain the inclination value and reporting point information of each information input device, and render it, and display the corresponding frequency on the screen according to the rendering result.
  • the movement trajectory of the information input device Further, the terminal 400 can render the inclination and reporting information of each information input device at each time point, and display the movement track of the corresponding information input device on the screen according to the rendering result, so that the movement can be displayed accurately and in real time. trajectory.
  • the terminal 400 can obtain the pressure value and report point information of each information input device, render it, and display the movement trajectory of the corresponding information input device on the screen according to the rendering result. Further, the terminal 400 can render the pressure value and reporting point information of each information input device at each time point, and display the movement trajectory of the corresponding information input device on the screen according to the rendering result, so that the movement can be displayed accurately and in real time. trajectory.
  • the position of the movement track of the information input device is the position corresponding to the report point information of the information input device, that is, the position where the terminal 400 detects the PWM signal 1 transmitted by the information input device.
  • the appearance of the movement track of the information input device is determined by the inclination and/or the pressure value, and reference may be made to the foregoing related descriptions.
  • the trajectory of the movement trajectory displayed on the screen is the same as the movement trajectory of the pen tip of the information input device on the screen.
  • the greater the pressure exerted by the pen tip of the information input device on the screen the thicker or darker the stroke of the movement track displayed on the screen.
  • the stroke effect of the movement track displayed on the screen is different.
  • FIG. 11 may show a movement track displayed by the terminal 400 on the screen.
  • the user interface shown in FIG. 11 may be provided by a drawing application installed on the terminal 100 .
  • the user interface 1201 may include a movement trajectory 1201 displayed by the terminal 400 according to the pressure value, point information and inclination of the information input device 100 , and a display according to the pressure value, point information and inclination of the information input device 200 . 1202 , the movement trajectory 1203 displayed according to the pressure value, point information and inclination of the information input device 300 , the movement trajectory 1203 displayed according to the pressure value, point information and inclination of the information input device 300 .
  • different information input devices can use different frequencies to send signals to the terminal, and send wireless messages to the terminal based on the wireless communication technology.
  • the terminal can determine the information input device that transmits the signal according to the frequency of the received signal, and learn the reporting point information of the information input device according to the signal.
  • the terminal may also know the inclination of the information input device according to the signal.
  • the wireless message sent by the information input device carries the pressure value and the ID of the information input device, and the terminal can also learn the pressure value of the information input device from the wireless message. That is to say, the terminal can distinguish the pressure value, report point information and inclination of different information input devices, and display the corresponding movement on the screen after rendering graphics according to the pressure value, report point information and inclination of each information input device. trajectory.
  • the method shown in FIG. 6 can distinguish different information input devices by the frequency of the signals, without additionally sending the ID of the information input device, and without affecting the reporting rate.
  • the information input device can transmit the pressure value in an efficient and timely manner by using wireless communication technology, so that the terminal can render and display the corresponding movement trajectory in real time, so that the information input device has good chirality and can improve the user experience.
  • the method shown in FIG. 6 may further include the following steps:
  • the terminal 400 reassigns frequencies to some or all of the multiple information input devices based on the wireless connection with the information input devices.
  • terminal 400 may periodically reallocate frequencies to some or all of the plurality of information input devices.
  • the terminal 400 may reallocate frequencies for some or all of the multiple information input devices when the interference between the received signals is relatively large. Specifically, when there is an interference signal in the space with a frequency similar to that used by the information input device, the terminal 400 cannot distinguish the interference signal from the signal sent by the information input device, that is, the terminal 400 cannot correctly parse the signal transmitted by the information input device. Affects the display of movement tracks. In this case, the terminal 400 may re-allocate frequencies for some or all of the multiple information input devices according to the interference situation, and the frequencies of the respective information input devices are still different after the frequencies are re-allocated.
  • the terminal 400 After the terminal 400 detects the signal (including the interference signal and the signal sent by the information input device), if the signal transmitted by the information input device cannot be analyzed, it can re-allocate the frequency for the information input device using the detected signal frequency. In this way, performing frequency hopping processing on part or all of each information input device can prevent the frequency of the signal transmitted by each information input device from being similar to the interference signal, thereby preventing the terminal 400 from being affected by other signals in the space when detecting the signal transmitted by the information input device. interference, so that the terminal 400 can accurately identify the signals sent by different information input devices.
  • the terminal 400 can reallocate 1 or 2 frequencies to an information input device.
  • each information input device may transmit a signal according to the reassigned frequency.
  • each information input device may also store the frequency assigned to it by the terminal 400 .
  • the information input device may store the identification of the terminal 400 in association with the frequency.
  • the information input device subsequently establishes a wireless connection with the terminal 400 again, it can directly use the stored frequency for transmitting the signal to the terminal 400 last time to transmit the signal. In this way, the process of negotiation frequency between the same terminal and the information input device can be reduced, the power consumption of both parties can be reduced, and the information input device and the terminal can be put into work faster.
  • the display speed of the terminal is faster, and the information Better follow chirality for input devices.
  • the information input device 100 may be referred to as a first information input device, and the information input device 200 may be referred to as a second information input device.
  • the wireless connection established between the terminal 400 and the information input device 100 may be referred to as a first wireless connection.
  • the wireless connection established between the terminal 400 and the information input device 200 may be referred to as a second wireless connection.
  • one frequency (eg f1) allocated by the terminal 400 to the information input device 100 may be referred to as the first frequency, and another frequency (eg f4) may be referred to as the third frequency.
  • One frequency (eg, f2) allocated by the terminal 400 to the information input device 200 may be referred to as a second frequency, and the other frequency (eg, f5) may be referred to as a fourth frequency.
  • the PWM signal 1 sent by the information input device 100 using one frequency allocated by the terminal 400 may be referred to as the first pulse signal, and the PWM signal 2 sent using another frequency allocated by the terminal 400 may be referred to as the third pulse. Signal.
  • the PWM signal 1 transmitted by the information input device 200 using one frequency allocated by the terminal 400 may be referred to as a second pulse signal, and the PWM signal 2 transmitted using another frequency allocated by the terminal 400 may be referred to as a fourth pulse signal.
  • the point announcement information of the information input device 100 determined by the terminal 400 may be referred to as a first position point, and the first position point includes one or more position points where the first pulse signal is detected successively.
  • the announcement point information of the information input device 200 determined by the terminal 400 may be referred to as a second position point, and the second position point includes one or more position points where the second pulse signal is detected successively.
  • the wireless message carrying the pressure value and the ID of the information input device sent by the information input device 100 to the terminal 400 based on the wireless connection may be referred to as a first message.
  • the wireless message carrying the pressure value and the information input device ID sent by the information input device 200 to the terminal 400 based on the wireless connection may be referred to as a second message.
  • the pressure value detected by the information input device 100 may be referred to as a first pressure value, and the pressure value detected by the information input device 200 may be referred to as a second pressure value.
  • the ID of the information input device 100 may be referred to as a first identification, and the ID of the information input device 200 may be referred to as a second identification.
  • the one frequency newly allocated by the terminal 400 to the information input device 100 may be referred to as the fourth frequency.
  • the embodiments of the present application may also be used for common information input device manipulation scenes.
  • the information input device manipulation scene is similar to the finger manipulation scene, for example, the information input device clicks the control, the information input device slides the user interface, and so on.
  • the information input device can only use the frequency allocated by the terminal 400 to send the PWM signal 1, and the PWM signal 2 and the wireless message can be sent or not sent, so that the terminal 400 can know according to the PWM signal 1.
  • Report point information and perform corresponding operations according to the location of the point report information.
  • the terminal according to the detected information input point information determined by the PWM signal 1 sent by the device may be referred to as the third position point.
  • the terminal 400 may start the application program corresponding to the icon.
  • the terminal 400 can refresh the icons of the application programs displayed in the home interface, and so on.
  • the above-mentioned embodiments it may be implemented in whole or in part by software, hardware, firmware or any combination thereof.
  • software it can be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions.
  • the computer program instructions when loaded and executed on a computer, result in whole or in part of the processes or functions described herein.
  • the computer may be a general purpose computer, special purpose computer, computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server, or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line) or wireless (eg, infrared, wireless, microwave, etc.).
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media.
  • the usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk), and the like.
  • the process can be completed by instructing the relevant hardware by a computer program, and the program can be stored in a computer-readable storage medium.
  • the program When the program is executed , which may include the processes of the foregoing method embodiments.
  • the aforementioned storage medium includes: ROM or random storage memory RAM, magnetic disk or optical disk and other mediums that can store program codes.

Abstract

Procédé, appareil et système (10) de commande de dispositifs d'entrée d'informations (100, 200, 300) sur un terminal (400) ; dans le procédé, le terminal (400) peut attribuer différentes fréquences (f1 à f6) à différents dispositifs d'entrée d'informations (100, 200, 300), distinguer les dispositifs d'entrée d'informations (100, 200, 300) au moyen des fréquences (f1 à f6), et mettre en œuvre un rendu graphique et afficher des trajectoires de mouvement correspondantes (1201, 1202, 1203) destinées aux différents dispositifs d'entrée d'informations (100, 200, 300) afin de prendre en charge un scénario d'écriture simultanée à plusieurs frappes. De plus, étant donné que le procédé comprend différents dispositifs d'entrée d'informations (100, 200, 300) étant distingués au moyen de la fréquence (f1 à f6) des signaux, il n'est pas nécessaire de transmettre en outre l'ID des dispositifs d'entrée d'informations (100, 200, 300), de sorte que le taux de rapport n'est pas affecté.
PCT/CN2021/107927 2020-07-27 2021-07-22 Procédé, appareil, et système de commande de dispositifs d'entrée d'informations sur un terminal WO2022022387A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010731534.7 2020-07-27
CN202010731534.7A CN114003137A (zh) 2020-07-27 2020-07-27 信息输入设备在终端上操控的方法、装置及系统

Publications (1)

Publication Number Publication Date
WO2022022387A1 true WO2022022387A1 (fr) 2022-02-03

Family

ID=79920165

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/107927 WO2022022387A1 (fr) 2020-07-27 2021-07-22 Procédé, appareil, et système de commande de dispositifs d'entrée d'informations sur un terminal

Country Status (2)

Country Link
CN (1) CN114003137A (fr)
WO (1) WO2022022387A1 (fr)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101539816A (zh) * 2009-04-16 2009-09-23 台均科技（深圳）有限公司 电磁笔、电磁信号发射方法和处理方法、装置及设备
CN203759658U (zh) * 2014-03-31 2014-08-06 上海华师京城高新技术（集团）有限公司 一种多笔同时书写的电磁感应显示装置
CN105807990A (zh) * 2016-03-01 2016-07-27 京东方科技集团股份有限公司 显示屏、触控笔以及显示模组
CN206684693U (zh) * 2017-04-18 2017-11-28 成都吉锐时代触摸技术有限公司 一种可变发射频率的超声波笔
CN107491210A (zh) * 2017-08-14 2017-12-19 广州视源电子科技股份有限公司 多电磁笔书写区分方法、装置及电子设备
CN109582170A (zh) * 2017-09-29 2019-04-05 乐金显示有限公司 触摸显示装置、触摸电路、笔、触摸系统和多笔感测方法
US20190235647A1 (en) * 2016-03-08 2019-08-01 Egalax_Empia Technology Inc. Stylus and touch control apparatus for detecting tilt angle of stylus and control method thereof
CN110688022A (zh) * 2019-09-30 2020-01-14 京东方科技集团股份有限公司 主动笔及其控制方法和装置、笔迹显示方法和装置
US20200064940A1 (en) * 2013-11-08 2020-02-27 Egalax_Empia Technology Inc. Stylus and Operating Method Thereof for Transmitting Electrical Signals Carrying Pressure Information

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101539816A (zh) * 2009-04-16 2009-09-23 台均科技（深圳）有限公司 电磁笔、电磁信号发射方法和处理方法、装置及设备
US20200064940A1 (en) * 2013-11-08 2020-02-27 Egalax_Empia Technology Inc. Stylus and Operating Method Thereof for Transmitting Electrical Signals Carrying Pressure Information
CN203759658U (zh) * 2014-03-31 2014-08-06 上海华师京城高新技术（集团）有限公司 一种多笔同时书写的电磁感应显示装置
CN105807990A (zh) * 2016-03-01 2016-07-27 京东方科技集团股份有限公司 显示屏、触控笔以及显示模组
US20190235647A1 (en) * 2016-03-08 2019-08-01 Egalax_Empia Technology Inc. Stylus and touch control apparatus for detecting tilt angle of stylus and control method thereof
CN206684693U (zh) * 2017-04-18 2017-11-28 成都吉锐时代触摸技术有限公司 一种可变发射频率的超声波笔
CN107491210A (zh) * 2017-08-14 2017-12-19 广州视源电子科技股份有限公司 多电磁笔书写区分方法、装置及电子设备
CN109582170A (zh) * 2017-09-29 2019-04-05 乐金显示有限公司 触摸显示装置、触摸电路、笔、触摸系统和多笔感测方法
CN110688022A (zh) * 2019-09-30 2020-01-14 京东方科技集团股份有限公司 主动笔及其控制方法和装置、笔迹显示方法和装置

Also Published As

Publication number Publication date
CN114003137A (zh) 2022-02-01

Similar Documents

Publication Publication Date Title
US11521410B2 (en) Electronic device having a biometric sensor
US10372326B2 (en) Mobile terminal device, operation method, program, and storage medium
US10331242B2 (en) Stylus having a plurality of operating portions configured to transmit synchronized signals
US10299110B2 (en) Information transmission method and system, device, and computer readable recording medium thereof
KR102162836B1 (ko) 필드 속성을 이용한 컨텐트를 제공하는 전자 장치 및 방법
JP5931298B2 (ja) 仮想キーボード表示方法、装置、端末、プログラム及び記録媒体
EP2869181A1 (fr) Procédé d'exécution de fonctions en réponse à une entrée tactile et dispositif électronique mettant en oeuvre celui-ci
CN103677711A (zh) 连接移动终端和外部显示器的方法和实现该方法的装置
US20150253968A1 (en) Portable terminal and method of enlarging and displaying contents
EP2927796A1 (fr) Procédé et appareil d'interface utilisateur d'un dispositif électronique pour la réception d'une entrée d'utilisateur
EP4130943A1 (fr) Procédé et dispositif d'opération tactile
CN104423837A (zh) 用于显示控制的方法及其电子设备
JP2022501739A (ja) スタイラスペン検出方法、システムおよび関連装置
CN109144723B (zh) 一种分配存储空间的方法和终端
WO2017128986A1 (fr) Procédé de sélection, dispositif et support de stockage pour un élément de menu multimédia
KR20150051278A (ko) 오브젝트 이동 방법 및 이를 구현하는 전자 장치
CN114428561B (zh) 触控笔的切换方法、系统及触控笔
WO2022022387A1 (fr) Procédé, appareil, et système de commande de dispositifs d'entrée d'informations sur un terminal
CN112654955B (zh) 检测笔相对于电子设备的定位
CN110431518A (zh) 一种输出触控信号的方法和电子设备
WO2022022342A1 (fr) Procédé et système d'appariement de dispositifs, dispositif accessoire et support d'enregistrement lisible par ordinateur
US20150169129A1 (en) Method of displaying touch indicator and electronic device thereof
KR20160144656A (ko) 통신 장치 및 그의 채널 스캔 방법
WO2021197242A1 (fr) Procédé de copier-coller. dispositif électronique et système
CN116661670B (zh) 管理手势导航窗口的方法、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21849132

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21849132

Country of ref document: EP

Kind code of ref document: A1