WO2022022387A1

WO2022022387A1 - Method, apparatus, and system for controlling information input devices on terminal

Info

Publication number: WO2022022387A1
Application number: PCT/CN2021/107927
Authority: WO
Inventors: 李小仙
Original assignee: 华为技术有限公司
Priority date: 2020-07-27
Filing date: 2021-07-22
Publication date: 2022-02-03
Also published as: CN114003137A

Abstract

A method, an apparatus, and a system (10) for controlling information input devices (100, 200, 300) on a terminal (400); in the method, the terminal (400) can allocate different frequencies (f1-f6) to different information input devices (100, 200, 300), distinguish the information input devices (100, 200, 300) by means of the frequencies (f1-f6), and implement graphics rendering and display corresponding motion trajectories (1201, 1202, 1203) for the different information input devices (100, 200, 300) in order to support a multiple stroke simultaneous writing scenario. In addition, as the method comprises different information input devices (100, 200, 300) being distinguished by means of the frequency (f1-f6) of the signals, there is no need to additionally transmit the ID of the information input devices (100, 200, 300), so the the reporting rate is not affected.

Description

Method, device and system for controlling information input device on terminal

This application claims the priority of the Chinese patent application filed on July 27, 2020 with the application number 202010731534.7 and titled "Method, Device and System for Controlling Information Input Devices on Terminals", the entire contents of which are obtained through Reference is incorporated in this application.

technical field

The embodiments of the present application relate to the field of communications and the field of terminals, and in particular, to a method, an apparatus, and a system for operating an information input device on a terminal.

Background technique

With the development of terminal technology, information input devices are widely used as one of the accessories of smart devices such as mobile phones and tablets. The information input device can enable users to write, draw, and manipulate accurately and quickly on the smart device, and can provide users with a more refined experience than finger operations.

At present, information input devices are mainly used with small screen products such as tablets and mobile phones. Therefore, only one pen is considered for writing on one terminal in the design of the scheme, and the scenario of multiple pens writing on the same terminal is not considered. In the future, large-sized touch terminals such as tablets, smart TVs, smart screens and other devices will become more and more popular, and there will be more and more scenarios where multiple information input devices write on the same terminal. How to realize simultaneous writing with multiple pens on the same terminal is a worthy research direction in this field.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a method, an apparatus, and a system for controlling an information input device on a terminal. By implementing the embodiments of the present application, the terminal can distinguish different information input devices, perform graphics rendering for different information input devices, and display corresponding movement trajectories.

In a first aspect, an embodiment of the present application provides a method for operating an information input device on a terminal, and the method is applied to a communication system including a terminal, a first information input device, and a second information input device. The method may include: the terminal assigns a first frequency to the first information input device, and assigns a second frequency to the second information input device, the first frequency and the second frequency are different; the first information input device transmits the first frequency a pulse signal, the frequency of the first pulse signal is the first frequency; the second information input device transmits a second pulse signal, the frequency of the second pulse signal is the second frequency; the terminal is at the first position of the screen When the first pulse signal is detected, the first movement track formed by the first position point is displayed on the screen; the first position point includes one or more position points; the terminal detects the second position point on the screen to the second pulse signal, a second movement track formed by the second position point is displayed on the screen; the second position point includes one or more position points; wherein, the first movement track and the second movement track The traces look different.

By implementing the method of the first aspect, the terminal can distinguish the pulse signals sent by different information input devices by frequency, and display the movement track at the position point where the pulse signals sent by the information input device are received. The appearances of the movement tracks corresponding to different information input devices are different, so that when the user uses multiple information input devices to operate on the same terminal, the user can directly identify which information input device the movement track corresponds to from the appearance. In addition, the method distinguishes different information input devices by the frequency of the signal, does not need to send additional information input device ID, and does not affect the reporting rate.

The appearance of the movement track may include, but is not limited to: color, thickness, depth, or stroke, and so on.

The information input device may directly contact the terminal screen, or may not contact the terminal screen, for example, be close to the terminal screen, which is not limited in this embodiment of the present application. That is to say, as long as the terminal can detect the pulse signal sent by the information input device, the corresponding movement trajectory can be displayed.

When the information input device is close to the screen of the terminal, the terminal can sense the pulse signal sent by the information input device, that is, the movement track can be displayed at the position where the pulse signal is detected. In this way, when the user has a writing intention, the movement track of the corresponding information input device can be displayed, and the function of "0-pressure-sensitive ink ejection" can be realized. This is a better experience for the user.

In this embodiment of the present application, the appearance of the movement track can be determined in the following ways:

1. The terminal is preset. For example, the terminal displays a red moving track at the position where the first pulse signal with the first frequency is detected (ie, the first position), and at the position where the second pulse signal with the second frequency is detected (ie, the first position) The second position point) shows the movement trajectory in blue. In this way, the user can directly distinguish different information input devices from the difference in the appearance of the movement track.

2. The terminal determines the appearance of the movement track corresponding to the information input device, such as thickness, depth, etc., according to the pressure value when the information input device contacts the screen of the terminal. For example, when the pressure value is larger, the color of the movement track corresponding to the information input device is darker or the line is thicker.

The information input device can send the pressure value collected when touching the screen of the terminal and the identification of the information input device to the terminal through a wireless connection with the terminal. The terminal can know which information input device the pressure value belongs to through the identifier, and determine the appearance of the movement track of the corresponding information input device according to the pressure value.

Taking the first information input device as an example, the terminal can associate and store the first frequency and the first identification, and the first identification is the identification of the first information input device; the first information input device detects the first pressure value, through The first wireless connection with the terminal sends a first message; the first message carries the first pressure value and the first identifier; the terminal receives the first message; wherein, the appearance of the first movement track is determined by The first pressure value in the first message carrying the first identifier is determined.

In some embodiments, the first message may further include a time point of the collected first pressure value, so that the terminal can determine the pressure value of the first information input device at each time point, and detect the first pulse at the same time point The appearance of the movement trace displayed on the first position point of the signal is determined by the corresponding pressure value.

It is understandable that the second information input device can also collect and send the pressure value in the same way, for example, the second information input device can send a second message carrying the second pressure value and the identifier of the second information input device.

Through the second method, the terminal can distinguish the pressure values of different information input devices, and reflect the pressure values on the movement trajectory of the corresponding information input device, so as to achieve a fine and accurate display effect. In this way, the user can control the appearance of the movement track by controlling the strength, which can bring a good user experience to the user. In addition, the information input device can transmit the pressure value in an efficient and timely manner by using wireless communication technology, so that the terminal can render and display the corresponding movement trajectory in real time, so that the information input device has good chirality and can improve the user experience.

3. The terminal determines the appearance of the movement track corresponding to the information input device, such as thickness, depth, etc., according to the intensity of the detected pulse signal. For example, when the intensity of the pulse signal is greater, the color of the movement track corresponding to the information input device is darker or the line is thicker.

Taking the first information input device as an example, the appearance of the first movement track can be determined by the intensity of the first pulse signal. Similarly, the appearance of the second movement trace is determined by the strength of the second pulse signal.

4. The terminal determines, according to the inclination of the information input device, the appearance of the movement track corresponding to the information input device, such as the stroke, thickness, and the like. For example, when the inclination is larger, the line corresponding to the movement track of the information input device is thicker. The slope is determined by the pulse signal detected by the terminal.

Taking the first information input device as an example, the terminal can also assign a third frequency to the first information input device, and the third frequency is different from the second frequency; the first information input device transmits a third pulse signal, and the first information input device transmits a third pulse signal. The frequency of the three-pulse signal is the third frequency; the terminal detects the third pulse signal at a third position; wherein, the appearance of the first movement track is determined by the inclination of the first information input device, and the first The inclination of the information input device is determined by the first position point where the first pulse signal is detected, and the third position point where the third pulse signal is detected.

Further, the inclination of the first information input device at a certain time point is determined by the first position point at which the first pulse signal is detected at the time point, and the third position point at which the third pulse signal is detected at the time point . Specifically, the terminal can use the inverse secant function θ=arcsec(d1/d2) to calculate the tilt angle θ at a certain time point, where d1 is the electrode 1 of the first information input device that transmits the first pulse signal and the third electrode that transmits the third pulse signal. The distance between the electrodes 2 of the pulse signal, d2 is the distance between the first position point and the second position point corresponding to the time point. d1 may be pre-stored in the terminal, or may be sent to the terminal by the first information input device through the first wireless connection.

Through the fourth method, the terminal can distinguish the inclination of different information input devices, and reflect the inclination on the movement trajectory of the corresponding information input device, so as to achieve a fine and accurate display effect. In this way, the user can control the appearance of the movement track by controlling the inclination, which can bring a good user experience to the user.

The foregoing first, second, third, and fourth manners may be implemented in any combination, which is not limited in the embodiments of the present application.

With reference to the first aspect, in some embodiments, the working cycle of the terminal includes a plurality of signal detection time periods; the working cycle of the first information input device includes: a plurality of first transmission time periods and a plurality of second transmission time periods; The signal detection period covers the first transmission period and the second transmission period in timing; the first information input device sends the first pulse signal during the first transmission period, and the second transmission period Sending the third pulse signal; the terminal detects the first pulse signal and the third pulse signal in the signal detection period. In this way, the first information input device and the terminal can cooperate to complete the transmission of the downlink signal (including the first pulse signal and the second pulse signal), and save the power of both parties to the greatest extent.

In some embodiments, when the first transmission time period and the second transmission time period overlap, the first frequency is different from the third frequency; or, in the case of the first transmission time period and the third transmission time period When the two transmission time periods do not overlap, the first frequency and the third frequency are the same. In this way, for the first information input device, the terminal can distinguish the first signal and the second signal transmitted by the first information input device according to the difference in timing or frequency.

It is understandable that, similar to the first information input device, the second input device and the terminal may also have similar working time periods, which will not be repeated here.

With reference to the first aspect, in some embodiments, the terminal may also send a DSSS signal, and the first information input device may use the first frequency to send the first pulse signal after detecting the DSSS signal. In this way, the first information input device can detect the DSSS signal only when it is close to the terminal screen, and then send the first pulse signal, which can save the power consumption of the first information input device.

In some embodiments, the working period of the terminal includes a signal transmission period; the working period of the first information input device includes a signal detection period; the signal detection period covers the signal transmission period in timing; The DSSS signal is sent during the signal transmission period; the first information input device detects the DSSS signal during the signal detection period. In this way, the first information input device and the terminal can cooperate to complete the transmission of the uplink signal (that is, the DSSS signal), and save the power of both parties to the greatest extent.

In some embodiments, the duty cycle of the terminal and the duty cycle of the first information input device have the same length. In some embodiments, the working cycle of the terminal and the working cycle of the first information input device may also be consistent in timing.

With reference to the first aspect, in some embodiments, the first information input device sends the first message within a first time window; the terminal scans the first message within the first time window. In this way, the first information input device can periodically send the detected pressure value, and the terminal can also scan messages periodically, which can save the power consumption of both parties.

In conjunction with the first aspect, in some embodiments, the terminal allocates a first frequency to the first information input device based on the first wireless connection.

In combination with the first aspect, in some embodiments, the terminal may further allocate a fourth frequency to the first information input device, where the fourth frequency is different from the first frequency and the second frequency. In this way, the terminal can perform frequency hopping processing on the first information input device, which can prevent the frequency of the first pulse signal transmitted by the first information input device from being close to the interference signal existing in the space, thereby preventing the terminal from detecting the frequency of the first information input device. The first pulse signal is interfered by other signals in the space, so that the terminal can accurately identify the first pulse signal sent by the first information input device.

In combination with the first aspect, in some embodiments, before the terminal displays the first movement trajectory formed by the first position point on the screen, the terminal may run a first application program, where the first application program provides one or more of the following Function: drawing, office, pattern design, text input or data input. In this way, the terminal can identify different information input devices in scenes such as painting and writing.

In a second aspect, an embodiment of the present application provides a method for controlling an information input device on a terminal, and the method is applied to the terminal side. The method may include: assigning, by the terminal, a first frequency to the first information input device, and assigning a second frequency to the second information input device, the first frequency and the second frequency being different; the terminal is at a first position on the screen The first pulse signal with the frequency of the first frequency is detected at the point, and the first movement trajectory formed by the first position point is displayed on the screen; the first position point includes one or more position points; the terminal is in the A second pulse signal with a frequency of the second frequency is detected at the second position point of the screen, and a second movement track formed by the second position point is displayed on the screen; the second position point includes one or more position points ; wherein, the appearance of the first movement track and the second movement track are different.

In the method provided in the second aspect, for an optional embodiment on the terminal side, reference may be made to the implementation on the terminal side in the method provided in the first aspect, and details are not repeated here.

In a third aspect, an embodiment of the present application provides a method for controlling an information input device on a terminal, and the method is applied to the side of the first information input device. The method may include: the first information input device receives a first frequency assigned by the terminal; the first information input device transmits a first pulse signal, and the frequency of the first pulse signal is the first frequency.

In the method provided by the third aspect, for an optional embodiment on the side of the first information input device, reference may be made to the implementation on the side of the first information input device in the method provided by the first aspect, and details are not repeated here.

In a fourth aspect, an embodiment of the present application provides a method for controlling an information input device on a terminal, and the method is applied to a communication system including a terminal and an information input device. The method may include: the terminal assigns a first frequency to the information input device; the information input device transmits a pulse signal, and the frequency of the pulse signal is the first frequency; the terminal detects the pulse signal at a third position on the screen , and perform the function corresponding to the third position point.

By implementing the method of the fourth aspect, the terminal can obtain the point reporting information according to the first pulse signal, and perform corresponding operations according to the reporting point information. For example, when the first information input device clicks on the icon of the application program on the home screen of the terminal, the terminal can start the application program corresponding to the icon. For another example, when the first information input device slides left and right on the home screen, the terminal can refresh the icons of the application programs displayed in the home interface, and the like.

For the first pulse signal mentioned in the fourth aspect, reference may be made to the relevant description of the first aspect, and details are not repeated here.

In a fifth aspect, an embodiment of the present application provides a terminal, where the terminal includes: a screen, a memory, and one or more processors; the screen and the memory are coupled to the one or more processors, and the The memory is used to store computer program code, the computer program code comprising computer instructions, the one or more processors invoking the computer instructions to cause the terminal to perform the second aspect or any one of the embodiments of the second aspect the method described.

In a sixth aspect, an embodiment of the present application provides an information input device, the information input device includes: a memory and one or more processors; the memory is coupled to the one or more processors, and the memory uses to store computer program code, the computer program code comprising computer instructions, the one or more processors invoking the computer instructions to cause the information input device to perform the third aspect or any one of the embodiments of the third aspect the method described.

In a seventh aspect, an embodiment of the present application provides a communication system, wherein the communication system includes a terminal and a first information input device, the terminal is the terminal described in the fifth aspect, and the first information input device The device is the information input device described in the sixth aspect.

In some embodiments, the communication system of the seventh aspect may further include a second information input device. The second information input device is configured to execute the method on the side of the second information input device described in the first aspect or any one of the implementation manners of the first aspect.

In an eighth aspect, an embodiment of the present application provides a computer program product containing instructions, when the computer program product runs on an electronic device, the electronic device is made to execute any one of the second aspect or the second aspect The method described in the embodiment.

In a ninth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions, wherein when the instructions are executed on an electronic device, the electronic device is caused to execute the second aspect or the second aspect The method described in any one of the embodiments of .

In a tenth aspect, an embodiment of the present application provides a computer program product containing instructions, characterized in that, when the computer program product runs on an electronic device, the electronic device is caused to perform the third aspect or the third aspect The method described in any one of the embodiments of .

In an eleventh aspect, an embodiment of the present application provides a computer-readable storage medium, including instructions, characterized in that, when the instructions are executed on an electronic device, the electronic device is caused to execute the third aspect or the third The method of any one of the embodiments of the aspect.

By implementing the method provided by the embodiment of the present application, the terminal can distinguish different information input devices, perform graphics rendering for different information input devices, and display the corresponding movement trajectory, that is, the terminal supports multiple simultaneous writing scenarios. The method distinguishes different information input devices by the frequency of the signals, does not need to send additional information input device IDs, and does not affect the reporting rate. In addition, the information input device can transmit the pressure value in an efficient and timely manner by using wireless communication technology, so that the terminal can render and display the corresponding movement trajectory in real time, so that the information input device has good chirality and can improve the user experience.

Description of drawings

FIG. 1 is a schematic structural diagram of a communication system 10 according to an embodiment of the present application;

2A is a schematic diagram of a hardware structure of a terminal provided by an embodiment of the present application;

2B is a schematic diagram of a software structure of a terminal provided by an embodiment of the present application;

3 is a schematic diagram of a hardware structure of an information input device provided by an embodiment of the present application;

4A is a schematic structural diagram of a touch sensor of a terminal according to an embodiment of the present application;

FIG. 4B is a geometric diagram when calculating the inclination according to an embodiment of the present application;

FIG. 5 is a working time diagram of a terminal and an information input device provided by an embodiment of the present application;

6 is a schematic flowchart of a method for controlling an information input device on a terminal provided by an embodiment of the present application;

7A and 7B are a set of user interfaces implemented on a terminal provided by an embodiment of the present application;

8 is a schematic structural diagram of a wireless message for frequency allocation provided by an embodiment of the present application;

FIG. 9 is a working time diagram of each device in the communication system 10 provided by the embodiment of the present application;

10 is a schematic diagram of a PWM signal 1 and a PWM signal 2 provided by an embodiment of the application;

FIG. 11 is a schematic diagram of a terminal displaying movement trajectories of multiple information input devices according to an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application will be described clearly and in detail below with reference to the accompanying drawings. Wherein, in the description of the embodiments of the present application, unless otherwise specified, “/” means or, for example, A/B can mean A or B; “and/or” in the text is only a description of an associated object The association relationship indicates that there can be three kinds of relationships, for example, A and/or B can indicate that A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of this application , "plurality" means two or more than two.

Hereinafter, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as implying or implying relative importance or implying the number of indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, the "multiple" The meaning is two or more.

The term "user interface (UI)" in the following embodiments of this application is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes the internal form of information and the form acceptable to the user. conversion between. The user interface is the source code written in a specific computer language such as java and extensible markup language (XML). A commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed graphically. It can be text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements displayed on the display screen of the electronic device.

Simultaneous writing with multiple strokes refers to a scenario in which multiple information input devices write, draw or manipulate on the same terminal. In the scenario of simultaneous writing of multiple strokes, in order to provide users with an accurate and real writing experience, the terminal needs to correspond to the pressure value, reporting point information and inclination of the same information input device, so that the different multiple information input devices can be used separately. Perform graphics rendering, and display the corresponding movement trajectories of multiple information input devices.

Point-reporting information refers to the location where the terminal senses the information input device, such as the location where the information input device directly touches the screen of the terminal, or the location where the terminal detects a signal when the information input device is close to the terminal. The inclination refers to the inclination angle of the information input device relative to the screen of the terminal.

The prior art provides the following two methods for simultaneous writing of multiple strokes.

1. The first method: the terminal obtains the pressure value, the reporting point information and the inclination of the information input device through the signal emitted by the pen tip of the information input device. In this way, the terminal can distinguish the pressure value, reporting point information and inclination of different information input devices. However, the transmission rate of the signal emitted by the pen tip is extremely low, resulting in a low point rate.

2. The second method: the terminal obtains the point reporting information and the inclination of the information input device through the signal emitted by the pen tip of the information input device, and sends the Bluetooth message based on the Bluetooth low energy (BLE) technology through the information input device. to get the pressure value. The signal emitted by the pen tip needs to have a part (for example, 36 bits) to transmit the identity document (ID) of the information input device. The Bluetooth message also carries the information input device ID, so that the terminal can input the same information into the device. corresponding to the pressure value, reporting point information and inclination. However, before the pen tip successfully transmits the ID of the information input device, for example, within 90 milliseconds (ms) of transmitting the ID of the 36-bit information input device, the point information cannot be matched with the information input device. Therefore, the second method will lose part of the reporting information (for example, 24 reporting information), which affects the reporting rate.

The reporting rate is an important factor affecting the writing experience. A low reporting rate will cause the movement trajectory rendered and displayed by the terminal graphics to be inconsistent with the actual movement trajectory of the information input device on the terminal screen, which will affect the chirality.

Based on the deficiencies of the prior art, the following embodiments of the present application provide a method, an apparatus, and a system for controlling an information input device on a terminal. In this method, it is suitable for the scenario where multiple strokes are written at the same time.

In the method provided by the embodiment of the present application, the terminal may allocate different frequencies to different information input devices. Each information input device can use the frequency assigned by the terminal to send the pulse signal, the terminal can detect the pulse signal on the screen, and display the movement track at the position where the pulse signal is detected, the appearance of the movement track corresponding to the pulse signal of different frequencies is different . In this way, the terminal can distinguish pulse signals sent by different information input devices through different frequencies, and display moving trajectories with different appearances for different information input devices. This enables multiple simultaneous writing.

1. The terminal is preset. For example, the movement trajectories corresponding to two pulse signals of different frequencies can be displayed in red and the other in blue. In this way, the user can directly distinguish different information input devices from the difference in the appearance of the movement track.

In some embodiments, the information input device can send the pressure value collected when touching the screen of the terminal and the identification of the information input device to the terminal through a wireless connection with the terminal. The terminal can know which information input device the pressure value belongs to through the identifier, and determine the appearance of the movement track of the corresponding information input device according to the pressure value.

Through the second method, the terminal can distinguish the pressure values of different information input devices, and reflect the pressure values on the movement trajectory of the corresponding information input device, so as to achieve a fine and accurate display effect. In this way, the user can control the appearance of the movement track by controlling the strength, which can bring a good user experience to the user.

4. The terminal determines, according to the inclination of the information input device, the appearance of the movement track corresponding to the information input device, such as the stroke, thickness, and the like. For example, when the inclination is larger, the line corresponding to the movement track of the information input device is thicker.

In the following embodiments of the present application, a scenario in which multiple strokes are written at the same time refers to a scenario in which one or more users use multiple information input devices to write on the same terminal. Specifically, the scenario of writing with multiple strokes may include, but is not limited to, one or more users using multiple information input devices to draw, work, design patterns, input text or data (eg, signature) on the same terminal, and so on. In the following embodiments of the present application, the content written by the user on the terminal using the information input device may be text, line, drawing or any pattern, which is not limited here.

In the following embodiments of the present application, the wireless communication technologies used by the information input device may include but are not limited to: Bluetooth (bluetooth, BT), near field communication (near field communication, NFC), wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (WiFi)), radio frequency identification (radio frequency identification, RFID) or ZigBee and so on. Bluetooth may include Classic Bluetooth or Bluetooth Low Energy BLE.

In the following, the communication system provided by the embodiments of the present application is first introduced.

Referring to FIG. 1 , FIG. 1 shows a communication system 10 provided by an embodiment of the present application. As shown in FIG. 1, the communication system 10 may include: a terminal 400, and one or more information input devices. Illustratively, an information input device 100 , an information input device 200 and an information input device 300 are shown in FIG. 1 . The information input device 100 , the information input device 200 , and the information input device 300 may be manipulated by the same user, or may be manipulated by different users. For example, the information input device 100 can be manipulated by the user 1 , the information input device 200 can be manipulated by the user 2 , and the information input device 300 can be manipulated by the user 3 .

The terminal 400 is configured with a screen. In some embodiments, the terminal 400 may be configured with a larger size screen.

The terminal 400 may be a portable electronic device such as a mobile phone, a tablet computer, a personal digital assistant (PDA), a wearable device, and a laptop computer (laptop). Exemplary embodiments of portable electronic devices include, but are not limited to, portable electronic devices powered by iOS, android, microsoft, or other operating systems. It should also be understood that, in some other embodiments of the present application, the electronic device may not be a portable electronic device, but a smart TV, smart screen, desktop computer or electronic billboard having a touch-sensitive surface (such as a touch panel). etc.

The information input device is an active information input device, such as an active capacitive stylus. It is understandable that the information input device is only a word used in the embodiment of this application, and the meaning it represents is an information input device, and the functions it performs have been recorded in this embodiment, and its name does not affect this embodiment. constitute any restriction. In addition, in some other embodiments of the present application, the information input device may also be referred to as, for example, a stylus pen, an active stylus pen, a signal pen, or other terms.

In this embodiment of the present application, a wireless connection may be established between the terminal 400 and multiple information input devices based on a wireless communication technology, respectively. For example, the terminal 400 may establish BLE connections with multiple information input devices respectively.

After the terminal 400 and the information input device establish a wireless connection, the terminal 400 can allocate different frequencies to different information input devices based on the wireless connection. The terminal 400 can allocate one or two frequencies to the same information input device. In some embodiments, the frequency allocated by the terminal 400 to each information input device is a low frequency, for example, a frequency between 100KHz and 400KHz. The frequency allocated by the terminal 400 to the information input device can be used by the information input device to send signals to the terminal 400 during the writing process subsequently.

The terminal 400 may store the correspondence between the respective information input devices and the frequencies allocated to the respective information input devices.

In some other embodiments, the terminal 400 may also send more abundant information based on the wireless connection with each information input device, such as information such as the remaining power of the information input device, whether a button of the information input device is pressed, and the like.

The terminal 400 may periodically transmit a signal based on direct sequence spread spectrum (DSSS) (hereinafter referred to as a DSSS signal) through the touch panel. When the pen tip of the information input device touches or is about to touch the screen of the terminal 400, it can detect the DSSS signal sent by the terminal 400 to know that the screen of the terminal 400 is nearby, that is, the user has a writing intention.

The information input device may transmit a pulse width modulation (PMW) type signal (hereinafter referred to as a PWM signal) to the terminal 400 using the frequency allocated by the terminal 400 .

When the terminal 400 allocates one frequency to the information input device, the information input device can use the frequency to send one PWM signal. The terminal 400 can determine the information input device that transmits the signal according to the frequency of the received PWM signal of the 1 channel, and can also obtain the notification information of the information input device according to the PWM signal of the 1 channel.

When the terminal 400 allocates two frequencies to the information input device, the information input device can use the two frequencies to send one PWM signal respectively, that is, to send two PWM signals. The terminal 400 can determine the information input device that transmits the signal according to the frequency of the received 2-channel PWM signal, and can also obtain the alarm point information and the inclination of the information input device according to the 2-channel PWM signal.

The information input device may continuously send the PWM signal to the screen of the terminal 400 through the pen tip, or may periodically send the signal, which is not limited herein.

The information input device can also detect the pressure value when the pen tip touches the screen of the terminal 400, and send a wireless message to the terminal 400 through the wireless connection with the terminal 400, where the wireless message carries the pressure value and the ID of the information input device. After receiving the wireless message, the terminal 400 can determine the pressure value of the information input device corresponding to the information input device ID.

Therefore, the terminal 400 may determine the pressure value, point information and inclination of each information input device, or the terminal 400 may determine the pressure value and point information of each information input device, and perform graphic rendering according to the determined content. Then, the movement track of the corresponding information input device on the upper part of the screen is displayed on the screen.

To sum up, in the communication system 10, there are at least three information channels between the terminal 400 and each information input device. in:

The first information channel is an uplink channel for the terminal 400 to send a DSSS signal to the information input device.

The second information channel is a downlink channel for the information input device to send a PWM signal to the terminal 400 using the allocated frequency.

The second information channel may include the first sub-channel. The first sub-channel is used for the information input device to send 1 channel of PWM signal to the terminal using the allocated frequency, and the 1 channel of PWM signal is used for the terminal 400 to obtain the report information of the information input device.

In some embodiments, the second information channel may further include a second sub-channel, and the second sub-channel is used for the information input device to send a PWM signal to the terminal 400 using the assigned frequency. The two PWM signals transmitted by the second word channel and the first sub-channel are combined for the terminal 400 to know the inclination of the information input device.

The third information channel is an uplink and downlink bidirectional channel, used by the terminal 400 to assign frequencies to the information input device, and also used by the information input device to send a wireless message carrying the pressure value and the ID of the information input device to the terminal 400 . This frequency is used for the information input device to send a signal to the terminal 400 through the second information channel.

Understandably, the first information channel and the second information channel may be two unidirectional channels, or may be two transmission directions of a bidirectional channel.

Subsequent embodiments will combine the hardware structures of the terminal 400 and the information input device to describe in detail the constitution of the three information channels and the principle of transmitting information, which will not be described here.

Referring to FIG. 2A , FIG. 2A exemplarily shows a schematic structural diagram of a terminal 400 provided by an embodiment of the present application.

As shown in FIG. 2A , the terminal 400 may include: a processor 110 , an external memory interface 120 , an internal memory 121 , a universal serial bus (USB) interface 130 , a charging management module 140 , a power management module 141 , and a battery 142 , Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Interface 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, Camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a touch chip such as a touch panel integrated circuit (TPIC), a graphics processor (graphics processing unit, GPU), image signal processor (image signal processor, ISP), controller, memory, digital signal processor (digital signal processor, DSP), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The controller may be the nerve center and command center of the terminal 400 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the terminal 400 by executing the instructions stored in the internal memory 121 . The internal memory 121 may include a storage program area and a storage data area. The storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area may store data (such as audio data, phone book, etc.) created during the use of the terminal 400 and the like.

The wireless communication function of the terminal 400 may be implemented by the antenna 1, the antenna 2, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal 400 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

Wireless communication module 160QE global navigation satellite system (GNSS), frequency modulation (FM), NFC, infrared technology (infrared, IR), RFID or ZigBee and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .

In this embodiment of the present application, the wireless communication module 160 may be configured to establish wireless connections with multiple information input devices based on wireless communication technologies, respectively. The wireless connection can be used by the terminal 400 to assign different frequencies to different information input devices. The terminal 400 can allocate 2 frequencies to the same information input device. This frequency can be used by the information input device to send a PWM signal to the terminal 400 in the subsequent writing process.

The wireless communication module 160 may also receive a wireless message (eg, BLE message) sent by the information input device during the writing process based on the wireless connection, where the wireless message carries the pressure value detected by the information input device and the ID of the information input device. The wireless message is transmitted to the AP, and the AP determines the pressure value of the information input device corresponding to the information input device ID according to the wireless message. After that, the AP can transmit the pressure value of the information input device to the GPU for subsequent graphics rendering for the information input device.

The terminal 400 implements a display function through the GPU, the display screen 194, and the AP. The GPU is a microprocessor for image processing, and connects the display screen 194 and the AP. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

In this embodiment of the present application, the GPU may render graphics according to the pressure value, reporting point information, and inclination of each information input device, and transmit the rendered result to the display screen 194, which displays the corresponding movement trajectory. .

Display screen 194 is used to display images, videos, and the like. In this embodiment of the present application, the display screen 194 may be used to display the movement trajectories of multiple information input devices respectively. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on. In some embodiments, the terminal 400 may include one or N display screens 194 , where N is a positive integer greater than one.

The pressure sensor 180A is used to sense the pressure signal, and can convert the pressure signal into a signal. In some embodiments, the pressure sensor 180A may be provided on the display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, and the like. The capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The terminal 400 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the terminal 400 detects the intensity of the touch operation according to the pressure sensor 180A. The terminal 400 can also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can communicate the detected touch operation to the AP to determine the touch event type. Visual output related to touch operations may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the terminal 400 , which is different from the position where the display screen 194 is located.

In this embodiment of the present application, the touch sensor 180K can be used to transmit a signal (eg, a DSSS signal) to the information input device, and the signal can be used by the information input device to know that the screen of the terminal 400 is nearby, that is, to know that the user has a writing intention.

In this embodiment of the present application, the touch sensor 180K may also be used to receive a signal transmitted by the information input device, and the processor 110 may determine the point announcement information and the inclination according to the signal. The working principle of the touch sensor 180K will be described in detail later, which will not be repeated here.

In this embodiment of the present application, the screen of the terminal 400 may refer to a device composed of a protective glass (not shown in the figure), a touch sensor 180K, a display screen 194, a bottom plate (not shown in the figure) and some peripheral circuits. Among them, the screen is, from top to bottom, the protective glass, the touch sensor 180K, the display screen 194, and the bottom plate.

It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the terminal 400 . In other embodiments of the present application, the terminal 400 may include more or less components than those shown in the drawings, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiments of the present application take an Android system with a layered architecture as an example to exemplarily describe the software structure of the electronic device 100 .

FIG. 2B is a block diagram of the software structure of the electronic device 100 according to the embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, and a kernel layer.

The application layer can include a series of application packages.

As shown in Fig. 2B, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 2B, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.

Content providers are used to store and retrieve data and make these data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications. A display interface can consist of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide the communication function of the electronic device 100 . For example, the management of call status (including connecting, hanging up, etc.).

The resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.

The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.

Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

The core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.

A system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.

The Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display drivers, camera drivers, audio drivers, and sensor drivers.

Referring to FIG. 3 , FIG. 3 is a schematic structural diagram of an information input device provided by an embodiment of the present application. The information input device may be any information input device in the communication system 100 shown in FIG. 1 , for example, the information input device 100 , the information input device 200 or the information input device 300 .

The information input device shown in FIG. 3 may be an active capacitive stylus. As shown in FIG. 3, the active capacitive stylus may include: a processor 201, a power supply 202, a microcontroller unit (MCU) 203, a direct current-direct current converter (DC/DC) ) 204 , a signal transmission circuit 205 , a signal detection circuit 206 , a pressure sensor 207 and a wireless communication module 208 .

The processor 201 may include one or more processing units, for example, the processor 201 may include an application processor (application processor, AP), a controller, a memory, and the like. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The power source 202 may be a rechargeable lithium battery or a replaceable standard battery or the like. During operation, the power supply 202 supplies power to the MCU 203, the signal transmission circuit 205, the signal detection circuit 206, the pressure sensor 207 and the wireless communication module 208 through the DC/DC power converter 204.

The signal detection circuit 203 can be disposed at the position of the pen tip of the information input device. Signal detection circuit 203 may include one or more electrodes. The signal detection circuit 203 may be used to detect signals (eg, DSSS signals) emitted by the screen of the terminal 400 .

The pressure sensor 207 can be disposed at the position of the pen tip of the information input device. The pressure sensor 207 can be used to detect the pressure value that the pen tip of the information input device bears, that is, the pressure value.

The wireless communication module 208 can provide a wireless communication technology solution applied on the information input device, for example, a wireless communication solution such as WLAN (such as Wi-Fi), BT, GNSS, FM, NFC, IR, RFID or ZigBee. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 208 can be used together with an antenna (not shown in FIG. 3 ) of the information input device, receives electromagnetic waves via the antenna, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 208 . The wireless communication module 208 can also receive the signal to be sent from the processor 201, perform frequency modulation on it, amplify the signal, and convert it into electromagnetic waves for radiation through the antenna.

In some embodiments, the wireless communication module 208 may be configured to establish a wireless connection with the terminal 400, and receive the frequency allocated by the terminal 400 for the information input device based on the wireless connection. The wireless communication module 208 may also send a wireless message carrying the pressure value and the ID of the information input device to the terminal 400 based on the wireless connection with the terminal 400 .

Under the control of the clock generated by the internal crystal oscillator, the MCU 203 generates a PWM signal consistent with the frequency allocated by the terminal 400, and drives the signal transmitting circuit 205 to transmit the PWM signal.

Signal transmission circuit 205 may include one or more electrodes. The signal transmitting circuit 205 can be disposed at the position of the pen tip of the information input device. The PWM signal transmitted by the signal transmitting circuit 205 is transmitted to the screen of the terminal 400 through the pen tip of the information input device in the form of a high-voltage square wave signal.

In some embodiments, the signal transmitting circuit 205 can be used to transmit a PWM signal, and the PWM signal is used for the terminal 400 to determine the alarm information of the information input device. In other embodiments, the signal transmitting circuit 205 can be used to transmit two PWM signals, wherein one PWM signal is used for the terminal 400 to determine the reporting point information of the information input device, and the two PWM signals are combined for the terminal 400 to determine the information input device. of inclination.

It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the information input device. In other embodiments of the present application, the information input device may include more or less components than those shown in the figure, such as buttons, LED indicators, or the information input device may also combine some components, or separate some components, Or a different component arrangement. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The working principles of the three information channels between the terminal 400 and the information input device will be described in detail below with reference to the terminal 400 shown in FIG. 2A and the information input device shown in FIG. 3 .

1. The third information channel: the wireless connection established between the wireless communication module 160 of the terminal 400 and the wireless communication module 208 of the information input device, such as BLE connection, WiFi direct connection, NFC connection, ZigBee connection and so on.

The third information channel is used for the terminal 400 to assign a frequency to the information input device, and is also used for the information input device to send a wireless message carrying the pressure value and the ID of the information input device to the terminal 400 . The terminal 400 can assign one or two frequencies to one information input device. The frequency allocated by the terminal 400 for the information input device is used for the pen tip electrode of the information input device to transmit the PWM signal.

2. The second information channel: the channel through which the signal transmitting circuit 205 of the information input device transmits the PWM signal to the screen of the terminal 400 using the frequency allocated to it by the terminal 400 .

The second information channel may include a first sub-channel, and the first sub-channel is composed of one electrode included in the signal transmitting circuit 205 of the pen tip of the information input device, and the screen of the terminal 400 . The first sub-channel is used for the pen tip electrode of the information input device to transmit a signal PWM signal to the screen of the terminal 400 by using the assigned frequency, and the signal is used for the terminal 400 to obtain the report point information of the information input device. The principle is explained in detail below.

Referring to FIG. 4A , the in-screen touch sensor 180K of the terminal 400 may include an X-axis electrode layer and a Y-axis electrode layer. The X-axis electrode layer may include a plurality of transmit (transmit, Tx) electrodes distributed in a matrix, and the Y-axis electrode layer may include a plurality of receive (receive, Rx) electrodes distributed in a matrix. The Tx electrodes and the Rx electrodes form a crisscross network, and the intersections (ie coordinate points) of the Tx electrodes and the Rx electrodes form a mutual capacitance (ie the capacitance formed by the Tx electrodes and the adjacent Rx electrodes).

When the terminal detects the mutual capacitance of each coordinate point on the touch sensor 180K, the touch chip connected to the touch sensor 180K can send an excitation signal to each Tx electrode in turn, and then the touch chip scans the signal received by each receiving Rx electrode, Convert the measured voltage value to digital signal and calculate the capacitance value.

The terminal 400 detects the touch operation of the finger, and the principle of detecting the input content of the information input device is different.

When a finger touches the screen, the finger, the touch sensor 180K and the insulating material between them (such as the protective glass of the screen) can form a coupling capacitance, causing a slight change in current and a change in mutual capacitance. The terminal 400 detects the change of the capacitance of the touch point by scanning the X-axis electrode matrix and the Y-axis electrode matrix, and calculates the position of the finger.

When the information input device approaches or touches the screen of the terminal 400, the terminal 400 may determine the position point at which the PWM signal is received. When the terminal 400 enters the information input device detection mode, that is, during the signal detection period of the working cycle of the terminal 400, the Tx electrode on the touch sensor 180K is converted into an Rx electrode, which alternately senses the X and Y axes with the original Rx electrode. Measure the transmitted signal of information input devices (such as active capacitive stylus). The signals received on the Tx electrodes (which have been converted into Rx electrodes) and the original Rx electrodes can be amplified by the amplifying circuit of the touch chip. The numerical envelope composed of the amplitude value of the received signal (or the capacitance value of the X-axis and Y-axis) can be obtained on the X-axis electrode and the Y-axis electrode respectively, and the coordinates (x, y) of the signal receiving point can be obtained by AP calculation. ), that is, reporting point information. For example, a calculation method can be performed by substituting the numerical envelope into the prior information input device envelope model for calculation. Those skilled in the art can understand that the calculation method can be a conventional solution in the field, and details are not repeated here. The touch chip transforms the signal from time-frequency to frequency domain. For example, by performing fast Fourier transform on the signal, the frequency of the signal sent by the information input device can be obtained.

In some embodiments, the second information channel may further include a second sub-channel, the second sub-channel is composed of one electrode included in the signal transmitting circuit 205 of the pen tip of the information input device, and the screen of the terminal 400 . The electrodes in the second subchannel are different from the electrodes in the first subchannel. The second sub-channel is used for the pen tip electrode of the information input device to transmit a PWM signal to the screen of the terminal 400 using the assigned frequency. The signal transmitted by the second sub-channel and the signal transmitted by the first sub-channel are jointly used for the terminal 400 to know the inclination of the information input device. The principle is explained in detail below.

For example, referring to FIG. 4B , the signal transmitting circuit 205 of the information input device may include two electrodes: electrode 1 and electrode 2 . Electrode 1 and the screen form the first sub-channel, and electrode 2 and the screen form the second sub-channel.

In some embodiments, the terminal 400 may calculate the inclination angle θ using an arcsecant function θ=arcsec(d1/d2) according to the geometric relationship between the inclination angles θ, d1 and d2. The inclination angle θ is the inclination of the information input device. Among them, d1 is the distance between electrode 1 and electrode 2. The terminal 400 may acquire d1 during or after establishing a connection with the information input device. When the information input device is close to the screen, the signals respectively emitted by the electrodes 1 and 2 can be sensed by the touch sensor 180K. The touch chip of the terminal 400 can calculate the capacitance value of each coordinate point of the touch sensor 180K, and report the capacitance value of each coordinate point to the AP. Projection distance d2 between projection points.

In other embodiments, the envelope model can also be obtained by modeling the signal amplitude envelopes generated by the signals of the electrode 1 and the electrode 2 received at different tilt angles. The terminal 400 may store the envelope model, and after entering the information input device detection mode, substitute the real-time generated signal amplitude envelope into the envelope model to extract the tilt angle.

In the following embodiments of the present application, the PWM signal transmitted by the first subchannel may be referred to as PWM signal 1, and the PWM signal transmitted by the second subchannel may be referred to as PWM signal 2.

3. The first information channel: the channel through which the screen of the terminal 400 transmits the DSSS signal to the signal detection circuit 203 of the information input device.

The first information channel is composed of the screen of the terminal 400 and one or more receiving electrodes of the signal detection circuit 203 of the information input device.

Specifically, a signal is sent by one or more Tx electrodes on the screen and/or Tx electrodes converted from the Rx electrodes, such as a signal modulated by DSSS, which is received by one or more receiving electrodes of the pen tip of the information input device . The signal can be used for the information input device to know that the terminal screen is nearby, that is, to know that the user has a writing intention.

It can be seen from the above that when the information input device writes on the terminal 400, the DSSS signal sent by the terminal 400 to the information input device and the signals (eg PWM signal 1 and PWM signal 2) sent by the information input device to the terminal 400 are all on the terminal 400. The signal transmitted between the screen of the terminal 400 and the pen tip of the information input device needs to be detected or sent by the screen of the terminal 400 or the pen tip of the information input device.

The following introduces the screen of the terminal 400 and the mechanism of the pen tip of the information input device for detecting and sending signals.

In some embodiments, the information input device can continuously transmit the PWM signal, and can also continuously detect the DSSS signal transmitted by the terminal 400 .

In other embodiments, the information input device may detect and transmit the signal periodically, and the transmission and detection may be separated in timing. That is, the information input device performs signal transmission and signal detection respectively in different time periods of the same cycle. In this way, interference between signals can be avoided, and the power of the information input device can be saved.

In some embodiments, the terminal 400 can continuously transmit the DSSS signal, and can also continuously detect the PWM signal transmitted by the information input device.

In other embodiments, terminal 400 may periodically detect and transmit signals, and may perform transmission and detection separately in timing. In this way, interference between signals can be avoided, and power of the terminal 400 can be saved. When the information input device transmits two PWM signals (ie, PWM signal 1 and PWM signal 2) in one cycle, the two PWM signals may have overlapping parts in time sequence, or may not overlap in time sequence, the embodiment of this application There is no restriction on this.

Referring to FIG. 5, FIG. 5 exemplarily shows a working time diagram of a terminal 400 and an information input device. In the example shown in FIG. 5 , the information input device transmits two PWM signals, namely PWM signal 1 and PWM signal 2 .

In the example shown in FIG. 5, terminal 400 detects and transmits signals periodically, and transmits and detects separately in timing. As shown in FIG. 5 , one duty cycle of the screen detection and signal transmission of the terminal 400 is T. In one working cycle T, one signal transmission time period and multiple signal detection time periods may be included. For example, in the working cycle T with a duration of 16800us, the signal transmission time period may be: 120us˜320us. The multiple signal detection time periods may include: 800us-2800us, 4300us-5600us, 7200us-8400us, 9200us-11200us, 12700us-14000us, 15600us-16800us.

The terminal 400 can transmit a signal (for example, a DSSS signal) through the screen during the transmission period, and detect the 2-channel PWM signal transmitted by the information input device during the signal detection period.

In some embodiments, the screen of the terminal 400 may also detect the touch input of the finger within the duty cycle T. For example, the terminal 400 can detect the touch input of the finger in the following time periods within the working cycle T of 16800us: 2800us-4300us, 5600us-7200us, 11200us-12700us, 14000us-15600us. The principle of detecting the touch input of the finger by the terminal 400 is different from the principle of detecting the signal emitted by the information input device. Reference may be made to the implementation manner of the prior art and the foregoing related descriptions, which will not be repeated here.

In the example shown in FIG. 5 , the information input device periodically detects and transmits signals, and the transmission and detection are separated in timing, and the PWM signal 2 transmitted by the information input device is covered by the PWM signal 1 in timing. As shown in FIG. 5 , like the terminal 400 , one duty cycle of the information input device for detecting and transmitting signals may also be T. In one working cycle T, it may include one signal detection time period, multiple first transmission time periods, and multiple second transmission time periods. For example, in the working cycle T with a duration of 16800us, the signal detection time period may be: 120us˜320us. The multiple first transmission time periods may include: 800us-2800us, 4300us-5600us, 7200us-8400us, 9200us-11200us, 12700us-14000us, 15600us-16800us. The multiple second transmission time periods may include: 1600us-2800us, 4400us-5600us, 7200us-8400us, 1000us-11200us, 12800us-14000us, 15600us-16800us.

The information input device can detect the signal (eg DSSS signal) transmitted by the terminal 400 through the signal detection circuit 206 in the signal detection period, transmit the PWM signal 1 through the signal transmission circuit 205 in the first transmission period, and pass the signal in the second transmission period The transmit circuit 205 transmits the PWM signal 2 .

In the example shown in FIG. 5 , the signal detection time period of the information input device covers the transmission time period of the terminal 400; the signal detection time period of the terminal 400 is the same as the first transmission time period of the information input device, and covers the information input device the second launch period. In this way, the information input device and the terminal 400 can cooperate to complete the transmission of the uplink signal (eg DSSS signal) and the downlink signal (eg PWM signal), and save the power of both parties to the greatest extent.

The above example of FIG. 5 is only used to explain the present application, and should not be construed as a limitation. In some other embodiments, the information input device may only transmit one PWM signal (ie, PWM signal 1), that is, the working cycle of the information input device does not include the second transmission time period. In some other embodiments, the terminal 400 and the information input device may also use other periods and time periods to transmit or detect signals.

Based on the communication system 100 shown in FIG. 1 , the terminal 400 shown in FIGS. 2A and 2B , the information input device shown in FIG. 3 , the working principles of the three information channels described above, and the terminal 400 and the information input device The mechanisms for detecting and sending signals respectively, the following describes in detail the method for controlling the information input device on the terminal provided by the embodiments of the present application.

The method provided by the embodiment of the present application can be used in a scenario of simultaneous writing of multiple strokes, and the following description is made by taking the implementation of the method provided by the embodiment of the present application in a scenario of simultaneous writing of multiple strokes as an example.

Referring to FIG. 6 , FIG. 6 is a schematic flowchart of a method for operating an information input device on a terminal according to an embodiment of the present application. FIG. 6 exemplarily shows the interaction flow between the terminal 400 and the information input device 100 and the information input device 200. In a specific implementation, the terminal 400 can also interact with more information input devices, for example, the information input device 300. This embodiment of the present application does not limit this.

As shown in Figure 6, the method may include the following steps:

S110, the terminal 400 establishes wireless connections with multiple information input devices respectively.

In this embodiment of the present application, the terminal 400 may establish wireless connections with multiple information input devices (for example, the information input device 100 , the information input device 200 , and the information input device 300 ) respectively, and maintain wireless connections with the multiple information input devices at the same time. . The wireless connection may include, but is not limited to, a connection established based on wireless communication technologies such as BT, WLAN (eg, Wi-Fi), GNSS, FM, NFC, IR, RFID, or ZigBee. Among them, BT can be classic Bluetooth or BLE. For the specific steps of establishing a wireless connection between the terminal 400 and the information input device, reference may be made to an existing short-range wireless communication protocol, which is not described in detail in this embodiment of the present application.

In a specific example, the terminal 400 may establish a BLE connection with a plurality of information input devices respectively based on the BLE protocol stack.

Specifically, the terminal 400 may use a wireless communication technology (eg, BLE) to search for a nearby information input device, and after searching for a nearby information input device, send a connection request to the information input device in response to a received user operation. After the information input device accepts the request, the terminal 400 may establish a wireless connection with the information input device.

Exemplarily, refer to FIG. 7A and FIG. 7B , which respectively illustrate a manner in which the terminal 400 is connected to the information input device.

FIG. 7A shows the user interface 71 displayed on the terminal 400 . The user interface 71 may be provided by a “settings” application installed on the terminal 400 . 'Settings' is an application for managing various functions on the terminal 400 . As shown in FIG. 7A , the user interface 71 includes a Bluetooth switch control 701 , and the state of the Bluetooth switch control in the figure indicates that the Bluetooth function of the terminal 400 is currently enabled.

The terminal 400 may use Bluetooth (eg, BLE) to search for other nearby Bluetooth devices (eg, information input devices), and display the names of the searched other Bluetooth devices in the area 702 . The names of the respective Bluetooth devices displayed in the area 702 can monitor user operations (such as finger-input click operations, touch operations), and the terminal 400 can respond to the user operations detected on the names of the Bluetooth devices to the Bluetooth device corresponding to the name. A connection request is sent, and after the Bluetooth device accepts the request, a wireless connection is established with the Bluetooth device. Exemplarily, the user may click on the name 702 a of the information input device 100 in the area 702 to trigger the terminal 400 to send a Bluetooth connection request to the information input device 100 . The name of the Bluetooth device may be a media access control (media access control, MAC) address, a user-defined name, a device model, etc., which is not limited in this embodiment of the present application.

In the example shown in FIG. 7A , after the terminal 400 and the information input device 100 successfully establish a Bluetooth connection, the user can also trigger the terminal 400 to establish a Bluetooth connection with other nearby information input devices through similar user operations. When the terminal 400 establishes a Bluetooth connection with other information input devices, the previously established Bluetooth connection will not be disconnected, that is, the terminal 400 can maintain a Bluetooth connection with multiple information input devices at the same time.

FIG. 7B shows the user interface 72 displayed on the terminal 400 . The side of the terminal 400 , such as the frame where the volume keys are located, may be provided with a magnetic attraction device (eg, a magnetic strip) for attracting the information input device. The user interface 72 may be that the terminal 400 responds to the operation that the information input device is adsorbed at the magnetic attraction device on the side of the terminal 400, uses a wireless communication technology (such as BLE) to search for nearby information input devices, and after the information input device is found The interface appears on the display.

As shown in FIG. 7B , the user interface 72 includes a window 703 , and the window 703 can be used to indicate the information input device searched by the terminal 400 . The window 703 may include an icon 703a, a device name 703b, a control 703c, and a control 703d. The icon 703a can be used to indicate the device type searched by the terminal 400, for example, the icon 703a can be a picture of the information input device. The device name 703a may be a MAC address, a user-defined name, a device model, and the like. The control 703c can be used to monitor a user operation, and the terminal 400 can stop displaying the window 703 in response to the user operation. The control 703d can be used to monitor the user operation, and the terminal 400 can send a connection request to the information input device corresponding to the device name 703a in response to the user operation, and after the information input device accepts the request, establish a wireless connection with the information input device. Exemplarily, the window 703 indicates that the terminal 400 has searched for the information input device 100 , and the user can click on the control 703d to trigger the terminal 400 to send a connection request to the information input device 100 .

In the example shown in FIG. 7B , after the terminal 400 and the information input device 100 successfully establish a connection, the user can also trigger the terminal 400 to establish a wireless connection with other nearby information input devices through similar user operations. In some embodiments, if the terminal 400 searches for multiple information input devices at the same time, it may display multiple windows 703 corresponding to the multiple information input devices in the user interface 72; if the terminal 400 searches for multiple information input devices successively device, the window 703 corresponding to the information input device may be displayed in the user interface 72 successively. Here, when the terminal 400 establishes a wireless connection with other information input devices, the previously successfully established wireless connection will not be disconnected, that is, the terminal 400 can maintain a wireless connection with multiple information input devices at the same time.

During the process of establishing a wireless communication connection between the terminal 400 and the information input device, the window 703 can also be used to indicate that the wireless communication connection is currently being established, for example, the window 703 can output the text "connecting". After the terminal 400 and the information input device successfully establish a wireless communication connection, the window 703 can also be used to indicate that the wireless communication connection has been successfully established. For example, the window 703 can output the text "information input device 100 is connected".

S120, the terminal 400 allocates different frequencies to the multiple information input devices respectively based on the wireless connection with the information input devices.

In some embodiments, the frequency allocated by the terminal 400 to each information input device may be, for example, a frequency between 100 KHz and 400 KHz.

In some embodiments, the terminal 400 allocates different frequencies to different information input devices, and allocates one frequency to the same information input device. This frequency can be used by the information input device to send the PWM signal 1 to the terminal 400 using the first sub-channel in the second information channel. The PWM signal 1 can be used for the terminal 400 to acquire the point information of the information input device. By assigning different frequencies to different information input devices, the terminal 400 can distinguish the PWM signals 1 sent by different information input devices in the subsequent working process of the information input devices. Exemplarily, the terminal 400 may assign f1 to the information input device 100 , f2 to the information input device 200 , and f3 to the information input device 300 . f1, f2 and f3 are different.

In other embodiments, the terminal 400 allocates different frequencies to different information input devices, and the terminal 400 may allocate two frequencies to the same information input device. One of the frequencies is used for the information input device to send the PWM signal 1 to the terminal 400 , and the other frequency is used for the information input device to send the PWM signal 2 to the terminal 400 . The two frequencies allocated by the terminal 400 to one information input device are different from the two frequencies allocated to another information input device. By assigning different frequencies to different information input devices, the terminal 400 can distinguish the PWM signal 1 and the PWM signal 2 sent by different information input devices in the subsequent working process of the information input device.

When the terminal 400 allocates two frequencies for an information input device, if the signal detection time period of the terminal 400 overlaps with the first transmission time period of the information input device, and, the signal detection time period of the terminal 400 and the information input device overlap. The overlapped part of the second transmission time period of , overlaps in timing. For example, in the example shown in FIG. 5 , the terminal 400 may allocate two different frequencies to the information input device. If the above-mentioned two parts do not overlap in timing, the terminal 400 may allocate the same two frequencies to the information input device. In this way, for the same information input device, the terminal 400 can distinguish the PWM signal 1 and the PWM signal 2 transmitted by the information input device according to the difference in time sequence or frequency.

Exemplarily, as shown in FIG. 6 , the terminal 400 may allocate two frequencies f1 and f4 to the information input device 100, two frequencies f2 and f5 to the information input device 100, and two frequencies f3 and f6 to the information input device 100. . In a specific embodiment, f1-f6 may be respectively: 100KHz, 101.91KHz, 110.34KHz, 112.68KHz, 120.30KHz, and 122.61KHz.

In a specific implementation, the terminal 400 may send a wireless message to the information input device based on the wireless connection with the information input device, and the message carries the indication information of the frequency allocated to the information input device by the terminal 400 . After receiving the wireless message, the information input device can parse the message and learn the frequency allocated to it by the terminal 400 .

The following describes the format of the BLE message sent by the terminal 400 to the information input device by taking the BLE connection established between the terminal 400 and the information input device as an example. The BLE message may be an ATT command packet in a BLE data packet.

Referring to FIG. 8 , FIG. 8 exemplarily shows the format of a protocol data unit (protocol data unit, PDU) in an ATT command packet sent by the terminal 400 to the information input device. Understandably, the rest of the ATT command packet, such as the preamble, the access address, and the cyclic redundancy check (CRC), can refer to the BLE data specified by the existing Bluetooth protocol. The description in the package will not be repeated here.

As shown in FIG. 8 , the PDU of the ATT command packet may include: Opcode, attribute parameters (attribute parameters), and authorization signature (authorization signature). The attribute parameters may include: attribute handle, attribute type, attribute detailed information (attribute value), and attribute read and write permissions (attribute permissions). The detailed information of the attribute can include the following three parts: characteristic (characteristic property), characteristic value index (characteristic value handle), characteristic universally unique identifier (UUID)). A characteristic may occupy 1 octet, an eigenvalue index may occupy 2 octets, and a UUID may occupy 2 or 16 octets. The characteristic value handle may be used to carry the ID of the information input device in the embodiment of the present application and the indication information of the frequency allocated to the information input device by the terminal 400. The indication information of the frequency may include, for example, a frequency value, an index of the frequency value, or information on a frequency division and multiplication value of a crystal oscillator, which is not limited in this embodiment of the present application.

After receiving the ATT command packet sent by the terminal 400, the information input device can parse the ATT command packet, obtain the indication information of the frequency from the characteristic value index in the ATT command packet, and learn that the terminal 400 allocates the frequency to itself according to the indication information. Frequency of.

In this embodiment of the present application, after the terminal 400 allocates frequencies to each information input device, the terminal 400 may also store the correspondence between each information input device and the frequency allocated to each information input device. Exemplarily, referring to Table 1, Table 1 exemplarily shows a corresponding relationship stored by the terminal 400 .

信息输入设备IDInformation input device ID	频率frequency
信息输入设备100 Information input device 100	f1、f4f1, f4
信息输入设备200 Information input device 200	f2、f5f2, f5
信息输入设备300 Information input device 300	f3、f6f3, f6

Table 1

S130, the terminal 400 enters a writing scene.

In this embodiment of the present application, the writing scene refers to a scene in which one or more users use multiple information input devices to write on the same terminal. Specifically, the writing scene may include, but is not limited to, drawing, working, designing patterns, inputting text or data, etc. on the same terminal by one or more information input devices. In this embodiment of the present application, the content written by the information input device on the terminal may be text, lines, drawings, or any pattern, which is not limited here.

In some embodiments, entering the writing scene by the terminal 400 may specifically mean that the terminal 400 starts or runs an application program or a user interface that provides functions such as drawing, office work, pattern design, text or data input, and the like. Among them, the text or data input may include: signature, signature, and the like. The application may be, for example, "Pendo", "Memo", "Paint", and the like. Specifically, the terminal 400 may start the application in response to a user operation detected on the icon of the application on the home screen. The user operation may be, for example, a click operation, a long-press operation, a touch operation, etc. on an icon by a user using a finger or an information input device. In this embodiment of the present application, the application program that is started when the terminal 400 enters the writing scene may be referred to as the first application program. In some embodiments, after the terminal 400 enters the writing scene, it can notify the information input device through wireless connection with each information input device.

S140, the information input device transmits a PWM signal using the frequency allocated to it by the terminal 400.

Specifically, when the terminal 400 allocates one frequency to the information input device, the information input device uses the frequency and transmits the PWM signal 1 through the first sub-channel. When the terminal 400 allocates two frequencies to the information input device, the information input device uses one of the frequencies to transmit PWM signal 1 through the first sub-channel, and uses the other frequency to transmit PWM signal 2 through the second sub-channel.

The information input device may start to transmit a PWM signal after learning the frequency allocated to it by the terminal 400 or after learning that the terminal 400 has entered a writing scene, which is not limited in this embodiment of the present application.

In some embodiments, the information input device may continuously transmit the signal using the frequency assigned by the terminal.

In other embodiments, the information input device may send the PWM signal periodically. This can reduce the power consumption of the information input device.

Specifically, with reference to FIG. 5 and related descriptions, the information input device may transmit the PWM signal 1 using a frequency allocated by the terminal 400 in the first transmission period of each working cycle T. In some embodiments, the information input device may also transmit the PWM signal 2 using another frequency allocated by the terminal 400 during the second transmission period. Here, the information input device may store a work schedule similar to that of the information input device shown in FIG. 5 , and after detecting the DSSS signal transmitted by the terminal 400, according to the signal detection time period and the first transmission in the work schedule The relationship between the time period and the second transmission time period determines the first transmission time period and the second transmission time period, and transmits corresponding signals within the time period. In some embodiments, the terminal 400 may store a work schedule similar to that of the terminal shown in FIG. 5 , and periodically transmit the DSSS signal during the signal transmission time period within each work cycle T. When the pen tip of the information input device approaches the screen of the terminal 400, the information input device can detect the signal. That is, when the information input device has a writing intention, the information input device can detect the signal and start to transmit the signal periodically.

In the embodiment described in the previous paragraph, the work schedules of different information input devices may be the same or different. The working time of each information input device may be set by default at the factory, or may be negotiated jointly by the terminal 100 and the information input device.

For example, the working time period of the information input device 100 may be as shown in FIG. 5 ; the working time period of the information input device 200 may be: the working period T, the signal detection time period, the second transmission time period are the same as the terminal 200, the first transmission time period The segment can include: 900us～2800us, 4400us～5600us, 7300us～8400us, 9300us～11200us, 12800us～14000us, 15700us～16800us; the working time segment of the information input device 300 can be: working cycle T, signal detection time segment, first The transmission time period is the same as that of the terminal 200, and the second transmission time period may include: 1700us-2800us, 4500us-5600us, 7300us-8400us, 1100us-11200us, 12900us-14000us, 15700us-16800us.

For another example, the working time periods of the information input device 100 , the information input device 200 and the information input device 300 may all be as shown in FIG. 5 . For example, referring to FIG. 9 , FIG. 9 shows the working time, working frequency and working time of the terminal 400 of each information input device under the same working time period of the information input devices 100 - 300 .

In the embodiment of the present application, both the PWM signal 1 and the PWM signal 2 transmitted by the information input device may be PWM signals generated by the signal transmitting circuit 205 of the MCU 203 driving the pen tip. Among them, the transmission frequency of the PWM signal refers to the number of times per second in the PWM signal generated by the information input device from high level to low level and then back to high level, and the duty cycle of the PWM signal refers to the number of times in one signal cycle. , the ratio of the time occupied by the pulse to the total time of the signal period. When the PWM signal 1 and the PWM signal 2 are PWM signals, the transmission frequencies of the PWM signal 1 and the PWM signal 2 may refer to the foregoing. The embodiments of the present application do not limit the duty ratios of the PWM signal 1 and the PWM signal 2 . The duty ratios of the PWM signal 1 and the PWM signal 2 sent by different information input devices may be the same or different. The duty ratios of the PWM signal 1 and the PWM signal 2 sent by the same information input device may be the same or different.

Referring to FIG. 10, FIG. 10 exemplarily shows a PWM signal 1 and a PWM signal 2 respectively transmitted by an information input device using the two assigned frequencies. The information input device may be, for example, the information input device 100, the information input device 200 or the information Input device 300 . It can be seen from Figure 10 that the frequencies of the two PWM signals transmitted by the same information input device are different, and the frequency of the PWM signal 2 is higher than the frequency of the PWM signal 1. In FIG. 10 , the duty cycles of PWM signal 1 and PWM signal 2 are the same.

S150, the terminal 400 detects the PWM signal sent by each information input device, determines the information input device that sends the PWM signal according to the frequency of the PWM signal, and determines the reporting point information of the information input device according to the PWM signal.

The terminal 400 may successively detect the PWM signal sent by the same information input device at one or more position points.

In some embodiments, the terminal 400 can continuously detect the PWM signals sent by each information input device.

In other embodiments, the terminal 400 may periodically detect the PWM signal. Specifically, referring to FIG. 9 , the terminal 400 may detect the PWM signal in the signal detection period of each duty cycle T. As shown in FIG. In this way, the power consumption of the terminal 400 can be reduced.

Specifically, the terminal 400 may receive the PWM signal 1 respectively sent by each information input device. The terminal 400 may perform time-frequency domain conversion on each of the received PWM signals 1 , so as to determine the frequency of each of the PWM signals 1 . Afterwards, the terminal 400 may determine the sender of each PWM signal 1 according to the frequency allocated to each information input device. In this way, the terminal 400 analyzes each PWM signal 1, and associates the signal point information obtained by the analysis with the information input device. That is, the terminal 400 can respectively determine the reporting point information of each information input device according to the PWM signal 1 sent by each information input device. For the specific manner in which the terminal 400 determines the reporting point information according to the PWM signal 1, reference may be made to the foregoing related descriptions.

In some embodiments, the terminal 400 may also receive the PWM signal 2 sent by each information input device respectively. The terminal 400 can perform time-frequency domain conversion on each of the received PWM signals 2 , so as to determine the frequency of each of the PWM signals 2 . Afterwards, the terminal 400 may determine the sender of each PWM signal 2 according to the frequency allocated to each information input device. The terminal 400 may determine the inclination of the information input device according to the PWM signal 1 and the PWM signal 2 of the same information input device. For the specific manner in which the terminal 400 determines the inclination according to the PWM signal 1 and the PWM signal 2, reference may be made to the foregoing related descriptions. That is, the terminal 400 can determine the inclination of each information input device.

In some embodiments, the terminal 400 may also record the time points at which each PWM signal 1 or PWM signal 2 is received, so as to determine the reporting point information of each information input device at each time point, and even the inclination of each time point.

The method shown in FIG. 6 may further include the following optional steps S160 and S170.

S160, the information input device detects the pressure value on the pen tip, and sends a wireless message to the terminal 400 based on the wireless connection with the terminal 400, where the wireless message carries the pressure value and the ID of the information input device.

In the embodiments of the present application, the information input device may continuously detect the pressure value of the pen tip, or may detect periodically, which is not limited in the embodiments of the present application.

In some embodiments, the wireless message sent by the information input device also carries the time point when the pressure value is detected.

In a specific embodiment, the wireless message sent by the information input device may be a BLE data packet. The format of the BLE data packet may be carried based on the data format specified by the BLE protocol stack (for example, the human interface device (HID) protocol), which is not repeated in this embodiment of the present application.

In some embodiments, the information input device may send a wireless message to the terminal 400 immediately after detecting the pressure value on the pen tip. In this way, the terminal 400 can know the pressure value of the information input device in real time, so as to avoid time delay.

In other embodiments, the information input device may send a wireless message to the terminal 400 after receiving the notification that the terminal 400 enters the writing scene. In this way, the information input device can send pressure-sensitive information to the terminal 400 only in scenarios such as painting and writing that require pressure-sensitive information, thereby reducing the power consumption of the information input device.

In other embodiments, the information input device may send the detected pressure value to the terminal 400 within the short-range wireless communication time window. The short-range wireless communication time window may occur periodically. The short-range wireless communication time window may be negotiated between the information input device and the terminal 400, or may be set by default by the information input device. The short-range wireless communication time windows of the multiple information input devices may be the same or different, which is not limited in this embodiment of the present application. Through the short-range wireless communication time window, the information input device can periodically send the detected pressure value, which can save power consumption. The short-range wireless communication time window may be referred to as the first time window.

S170, the terminal 400 receives the short-range wireless message carrying the pressure value and the information input device ID sent by each information input device, and determines the pressure value of the information input device corresponding to the information input device ID according to the short-range wireless message.

The terminal 400 may turn on the wireless communication module 160 (eg, a Bluetooth module) within the short-range wireless communication time window corresponding to each information input device to receive wireless messages sent by each information input device.

Specifically, after receiving the wireless message sent by each information input device, the terminal 400 can parse the wireless message, and determine the pressure value of the information input device corresponding to the information input device ID carried in the message according to the analysis result. In some embodiments, the message further includes a time point, and the terminal 400 can also learn the pressure value of the information input device at the corresponding time point according to the message.

S180, the terminal 400 displays the movement trajectories corresponding to different information input devices on the screen.

If in S120, the terminal 400 only allocates one frequency to the same information input device, then the terminal 400 can obtain the report point information of each information input device, and at the location of the report point information (that is, it detects the signal transmitted by the information input device) The position of the PWM signal) shows the movement track of the corresponding information input device, and the appearance of the movement track of different information input devices is different. The appearance of the movement track of each information input device may be preset by the terminal.

If in S120, the terminal 400 allocates 2 frequencies to the same information input device, the terminal 400 can obtain the inclination value and reporting point information of each information input device, and render it, and display the corresponding frequency on the screen according to the rendering result. The movement trajectory of the information input device. Further, the terminal 400 can render the inclination and reporting information of each information input device at each time point, and display the movement track of the corresponding information input device on the screen according to the rendering result, so that the movement can be displayed accurately and in real time. trajectory.

If the method shown in FIG. 6 includes S160 and S170, the terminal 400 can obtain the pressure value and report point information of each information input device, render it, and display the movement trajectory of the corresponding information input device on the screen according to the rendering result. Further, the terminal 400 can render the pressure value and reporting point information of each information input device at each time point, and display the movement trajectory of the corresponding information input device on the screen according to the rendering result, so that the movement can be displayed accurately and in real time. trajectory.

It is understandable that the position of the movement track of the information input device is the position corresponding to the report point information of the information input device, that is, the position where the terminal 400 detects the PWM signal 1 transmitted by the information input device. The appearance of the movement track of the information input device is determined by the inclination and/or the pressure value, and reference may be made to the foregoing related descriptions.

The trajectory of the movement trajectory displayed on the screen is the same as the movement trajectory of the pen tip of the information input device on the screen. The greater the pressure exerted by the pen tip of the information input device on the screen, the thicker or darker the stroke of the movement track displayed on the screen. When the inclination of the pen tip of the information input device on the screen is different, the stroke effect of the movement track displayed on the screen is different.

For example, referring to FIG. 11 , FIG. 11 may show a movement track displayed by the terminal 400 on the screen. The user interface shown in FIG. 11 may be provided by a drawing application installed on the terminal 100 . As shown in FIG. 11 , the user interface 1201 may include a movement trajectory 1201 displayed by the terminal 400 according to the pressure value, point information and inclination of the information input device 100 , and a display according to the pressure value, point information and inclination of the information input device 200 . 1202 , the movement trajectory 1203 displayed according to the pressure value, point information and inclination of the information input device 300 , the movement trajectory 1203 displayed according to the pressure value, point information and inclination of the information input device 300 .

Through the above steps S110-S180, different information input devices can use different frequencies to send signals to the terminal, and send wireless messages to the terminal based on the wireless communication technology. The terminal can determine the information input device that transmits the signal according to the frequency of the received signal, and learn the reporting point information of the information input device according to the signal. In some embodiments, the terminal may also know the inclination of the information input device according to the signal. The wireless message sent by the information input device carries the pressure value and the ID of the information input device, and the terminal can also learn the pressure value of the information input device from the wireless message. That is to say, the terminal can distinguish the pressure value, report point information and inclination of different information input devices, and display the corresponding movement on the screen after rendering graphics according to the pressure value, report point information and inclination of each information input device. trajectory.

The method shown in FIG. 6 can distinguish different information input devices by the frequency of the signals, without additionally sending the ID of the information input device, and without affecting the reporting rate. In addition, the information input device can transmit the pressure value in an efficient and timely manner by using wireless communication technology, so that the terminal can render and display the corresponding movement trajectory in real time, so that the information input device has good chirality and can improve the user experience.

In some embodiments, the method shown in FIG. 6 may further include the following steps:

S190, the terminal 400 reassigns frequencies to some or all of the multiple information input devices based on the wireless connection with the information input devices.

In some embodiments, terminal 400 may periodically reallocate frequencies to some or all of the plurality of information input devices.

In other embodiments, the terminal 400 may reallocate frequencies for some or all of the multiple information input devices when the interference between the received signals is relatively large. Specifically, when there is an interference signal in the space with a frequency similar to that used by the information input device, the terminal 400 cannot distinguish the interference signal from the signal sent by the information input device, that is, the terminal 400 cannot correctly parse the signal transmitted by the information input device. Affects the display of movement tracks. In this case, the terminal 400 may re-allocate frequencies for some or all of the multiple information input devices according to the interference situation, and the frequencies of the respective information input devices are still different after the frequencies are re-allocated. For example, after the terminal 400 detects the signal (including the interference signal and the signal sent by the information input device), if the signal transmitted by the information input device cannot be analyzed, it can re-allocate the frequency for the information input device using the detected signal frequency. In this way, performing frequency hopping processing on part or all of each information input device can prevent the frequency of the signal transmitted by each information input device from being similar to the interference signal, thereby preventing the terminal 400 from being affected by other signals in the space when detecting the signal transmitted by the information input device. interference, so that the terminal 400 can accurately identify the signals sent by different information input devices.

The terminal 400 can reallocate 1 or 2 frequencies to an information input device.

After S190, each information input device may transmit a signal according to the reassigned frequency.

In some embodiments, each information input device may also store the frequency assigned to it by the terminal 400 . For example, the information input device may store the identification of the terminal 400 in association with the frequency. When the information input device subsequently establishes a wireless connection with the terminal 400 again, it can directly use the stored frequency for transmitting the signal to the terminal 400 last time to transmit the signal. In this way, the process of negotiation frequency between the same terminal and the information input device can be reduced, the power consumption of both parties can be reduced, and the information input device and the terminal can be put into work faster. For the user, the display speed of the terminal is faster, and the information Better follow chirality for input devices.

In this embodiment of the present application, the information input device 100 may be referred to as a first information input device, and the information input device 200 may be referred to as a second information input device.

In the above step S110, the wireless connection established between the terminal 400 and the information input device 100 may be referred to as a first wireless connection. The wireless connection established between the terminal 400 and the information input device 200 may be referred to as a second wireless connection.

In the above step S120, one frequency (eg f1) allocated by the terminal 400 to the information input device 100 may be referred to as the first frequency, and another frequency (eg f4) may be referred to as the third frequency. One frequency (eg, f2) allocated by the terminal 400 to the information input device 200 may be referred to as a second frequency, and the other frequency (eg, f5) may be referred to as a fourth frequency.

In the above step S140, the PWM signal 1 sent by the information input device 100 using one frequency allocated by the terminal 400 may be referred to as the first pulse signal, and the PWM signal 2 sent using another frequency allocated by the terminal 400 may be referred to as the third pulse. Signal. The PWM signal 1 transmitted by the information input device 200 using one frequency allocated by the terminal 400 may be referred to as a second pulse signal, and the PWM signal 2 transmitted using another frequency allocated by the terminal 400 may be referred to as a fourth pulse signal.

In the above step S150, the point announcement information of the information input device 100 determined by the terminal 400 may be referred to as a first position point, and the first position point includes one or more position points where the first pulse signal is detected successively. The announcement point information of the information input device 200 determined by the terminal 400 may be referred to as a second position point, and the second position point includes one or more position points where the second pulse signal is detected successively.

In the above step S160, the wireless message carrying the pressure value and the ID of the information input device sent by the information input device 100 to the terminal 400 based on the wireless connection may be referred to as a first message. The wireless message carrying the pressure value and the information input device ID sent by the information input device 200 to the terminal 400 based on the wireless connection may be referred to as a second message. The pressure value detected by the information input device 100 may be referred to as a first pressure value, and the pressure value detected by the information input device 200 may be referred to as a second pressure value. The ID of the information input device 100 may be referred to as a first identification, and the ID of the information input device 200 may be referred to as a second identification.

In the above step S190, the one frequency newly allocated by the terminal 400 to the information input device 100 may be referred to as the fourth frequency.

Not limited to the writing scene described in the foregoing embodiments, the embodiments of the present application may also be used for common information input device manipulation scenes. The information input device manipulation scene is similar to the finger manipulation scene, for example, the information input device clicks the control, the information input device slides the user interface, and so on. In the information input device manipulation scenario, the information input device can only use the frequency allocated by the terminal 400 to send the PWM signal 1, and the PWM signal 2 and the wireless message can be sent or not sent, so that the terminal 400 can know according to the PWM signal 1. Report point information, and perform corresponding operations according to the location of the point report information. In this scenario, the terminal according to the detected information input point information determined by the PWM signal 1 sent by the device may be referred to as the third position point. For example, when the information input device clicks an icon of an application program on the home screen of the terminal 400, the terminal 400 may start the application program corresponding to the icon. For another example, when the information input device slides left and right on the home screen, the terminal 400 can refresh the icons of the application programs displayed in the home interface, and so on.

The various embodiments of the present application can be arbitrarily combined to achieve different technical effects.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer program instructions, when loaded and executed on a computer, result in whole or in part of the processes or functions described herein. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server, or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk), and the like.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented. The process can be completed by instructing the relevant hardware by a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed , which may include the processes of the foregoing method embodiments. The aforementioned storage medium includes: ROM or random storage memory RAM, magnetic disk or optical disk and other mediums that can store program codes.

In a word, the above descriptions are merely examples of the technical solutions of the present invention, and are not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of the present invention shall be included within the protection scope of the present invention.

Claims

A method for operating an information input device on a terminal, wherein the method is applied to a communication system including the terminal, a first information input device, and a second information input device, and the method includes:

assigning, by the terminal, a first frequency to the first information input device, and assigning a second frequency to the second information input device, the first frequency and the second frequency being different;

The first information input device transmits a first pulse signal, and the frequency of the first pulse signal is the first frequency;

The second information input device transmits a second pulse signal, and the frequency of the second pulse signal is the second frequency;

The terminal detects the first pulse signal at a first position point on the screen, and displays a first movement track formed by the first position point on the screen; the first position point includes one or more position points ;

The terminal detects the second pulse signal at a second position point on the screen, and displays a second movement track formed by the second position point on the screen; the second position point includes one or multiple location points;

Wherein, the appearance of the first movement track and the second movement track are different.
The method according to claim 1, wherein before the terminal displays the first movement track formed by the first position point on the screen, the method further comprises:

The terminal associates and stores the first frequency and the first identifier, and the first identifier is the identifier of the first information input device;

The first information input device detects the first pressure value, and sends a first message through the first wireless connection with the terminal; the first message carries the first pressure value and the first identifier;

the terminal receives the first message;

Wherein, the appearance of the first movement track is determined by the first pressure value in the first message carrying the first identifier.
The method according to claim 1 or 2, characterized in that,

The appearance of the first movement trajectory is determined by the intensity of the first pulse signal.
The method according to any one of claims 1-3, wherein before the terminal displays the first movement track formed by the first position point on the screen, the method further comprises: the terminal is a the first information input device assigns a third frequency, the third frequency and the second frequency are different;

The first information input device transmits a third pulse signal, and the frequency of the third pulse signal is the third frequency;

the terminal detects the third pulse signal at a third position;

Wherein, the appearance of the first movement track is determined by the inclination of the first information input device, and the inclination of the first information input device is determined by the first position point where the first pulse signal is detected, And, the third position point at which the third pulse signal is detected is determined.
The method according to claim 4, wherein the working cycle of the terminal includes a plurality of signal detection time periods; the working cycle of the first information input device includes: a plurality of first transmission time periods, a plurality of first Two transmission time periods; the signal detection time period covers the first transmission time period and the second transmission time period in timing;

The first information input device sends the first pulse signal during the first transmission period, and sends the third pulse signal during the second transmission period;

The terminal detects the first pulse signal and the third pulse signal in the signal detection period.
The method of claim 5, wherein:

In the case where the first transmission time period and the second transmission time period overlap, the first frequency is different from the third frequency; or,

In the case where the first transmission time period and the second transmission time period have no overlapping portion, the first frequency and the third frequency are the same.
The method according to any one of claims 1-6, wherein the method further comprises:

The terminal re-allocates a fourth frequency to the first information input device, where the fourth frequency is different from the first frequency and the second frequency.
The method according to any one of claims 1-7, wherein, before the terminal displays the first movement track formed by the first position point on the screen, the method further comprises:

The terminal runs a first application program, and the first application program provides one or more of the following functions: painting, office, pattern design, text input or data input.
A method for operating an information input device on a terminal, wherein the method is applied to the terminal, and the method includes:

assigning, by the terminal, a first frequency to the first information input device, and assigning a second frequency to the second information input device, the first frequency and the second frequency being different;

The terminal detects a first pulse signal with a frequency of the first frequency at a first position point of the screen, and displays a first movement track formed by the first position point on the screen; the first position point includes one or more location points;

The terminal detects a second pulse signal with the frequency of the second frequency at the second position point of the screen, and displays a second movement track formed by the second position point on the screen; Two location points include one or more location points;

Wherein, the appearance of the first movement track and the second movement track are different.
The method according to claim 9, wherein before the terminal displays the first movement track formed by the first position point on the screen, the method further comprises:

The terminal associates and stores the first frequency and the first identifier, and the first identifier is the identifier of the first information input device;

receiving, by the terminal through a first wireless connection with the first information input device, a first message, where the first message carries the first pressure value and the first identifier;

Wherein, the appearance of the first movement track is determined by the first pressure value in the first message carrying the first identifier.
The method according to claim 9 or 10, characterized in that,

The appearance of the first movement trajectory is determined by the intensity of the first pulse signal.
The method according to any one of claims 9-11, wherein before the terminal displays the first movement track formed by the first position point on the screen, the method further comprises:

assigning, by the terminal, a third frequency to the first information input device, where the third frequency is different from the second frequency;

The terminal detects a third pulse signal with a frequency of the third frequency at a third position;

Wherein, the appearance of the first movement track is determined by the inclination of the first information input device, and the inclination of the first information input device is determined by the first position point where the first pulse signal is detected, And, the third position point at which the third pulse signal is detected is determined.
The method according to claim 12, wherein the working cycle of the terminal includes a plurality of signal detection time periods; the working cycle of the first information input device includes: a plurality of first transmission time periods, a plurality of first Two transmission time periods; the signal detection time period covers the first transmission time period and the second transmission time period in timing;

The first pulse signal is sent by the first information input device during the first transmission time period, and the third pulse signal is sent by the first information input device during the second transmission time period;

The terminal detects the first pulse signal and the third pulse signal in the signal detection period.
The method of claim 13, wherein:

In the case where the first transmission time period and the second transmission time period overlap, the first frequency is different from the third frequency; or,

In the case where the first transmission time period and the second transmission time period have no overlapping portion, the first frequency and the third frequency are the same.
The method according to any one of claims 9-14, wherein the method further comprises:

The terminal re-allocates a fourth frequency to the first information input device, where the fourth frequency is different from the first frequency and the second frequency.
The method according to any one of claims 9-15, wherein before the terminal displays the first movement track formed by the first position point on the screen, the method further comprises:

The terminal runs a first application program, and the first application program provides one or more of the following functions: painting, office, pattern design, text input or data input.
A terminal, characterized in that the terminal includes: a screen, a memory, and one or more processors; the screen and the memory are coupled to the one or more processors, and the memory is used to store computer programs code, the computer program code comprising computer instructions invoked by the one or more processors to cause the terminal to perform the method of any of claims 9-16.
A computer program product comprising instructions, characterized in that, when the computer program product is run on an electronic device, the electronic device is caused to perform the method according to any one of claims 9-16.
A computer-readable storage medium comprising instructions, characterized in that, when the instructions are executed on an electronic device, the electronic device is caused to perform the method according to any one of claims 9-16.
A communication system, characterized in that the communication system comprises: a terminal, a first information input device and a second information input device, the terminal is configured to execute the method according to any one of claims 9-16, and the The first information input device is used for transmitting a first pulse signal, and the second information input device is used for transmitting a second pulse signal.