WO2020019616A1 - Touch control data processing method and device, intelligent device and storage medium - Google Patents

Abstract

The invention relates to a touch control data processing method and a device, an intelligent device and a storage medium, which are applied to the field of intelligent devices. The method comprises: detecting a touch event of a writing pen on a touch screen, wherein the writing pen is a device which is in accordance with USB HID category; recognizing the number of the writing pens; if the number is greater than or equal to 2, using the HID multi-touch protocol to encapsulate touch control data which is data triggered by the touch event; sending the encapsulated touch data to an operating system, the operating system is an operating system of the intelligent device subordinated to the current display signal of the touch screen. The embodiment of the present invention solves the problem of writing recognition errors due to simultaneous use of two or more writing pens, and improves the recognition accuracy when several writing pens are used simultaneously.

Description

Method, device, smart device and storage medium for touch data processing Technical field

The present invention relates to the technical field of smart devices, and in particular, to a method, an apparatus, a smart device, and a storage medium for processing touch data.

Background technique

With the popularity of smart devices, many smart devices have touch functions. Correspondingly, the screen of such smart devices usually consists of a display screen and a touch screen. Through the touch screen, not only can it detect and recognize the touch operation of the user's finger on the display screen, It can also detect and recognize touch operations such as tapping and writing on the screen by the corresponding writing pen.

In the process of implementing the present invention, the inventors found that the following problems exist in the prior art. In many application scenarios, two or more writing pens are required to perform touch operations on the screen of a smart device at the same time, such as electronics used in teaching fields. Tablet, in the classroom interactive teaching, multiple students need to answer the question on the screen of the same electronic tablet at the same time, that is, multiple students write on the touch screen of the same electronic tablet at the same time; Writing pens write on the screen at the same time, so when two or more writing pens write on the screen at the same time, writing recognition errors often occur.

Summary of the Invention

Based on this, it is necessary to provide a method, a device, a smart device, and a storage medium for processing touch data in response to the problem of writing recognition errors when two or more writing pens are writing simultaneously.

According to a first aspect of the present invention, a method for processing touch data is provided, including:

A touch event of the stylus on the touch screen is detected;

Identifying the number of the writing pens;

If the number is greater than or equal to 2, use HID multi-touch protocol to encapsulate the touch data, and the touch data is data caused by the touch event;

The encapsulated touch data is sent to an operating system, which is the operating system of the smart device to which the touch screen currently displays signals.

In one of the embodiments, it further includes:

If the number is less than 2, the touch data is encapsulated using a HID pen protocol.

In one embodiment, the identifying the quantity of the writing pen includes:

Acquiring touch data caused by the touch event;

The number of the writing pens is identified by the touch data.

In one embodiment, the acquiring touch data caused by the touch event includes:

Obtaining a touch algorithm corresponding to the touch screen,

The touch algorithm is used to obtain touch data caused by the touch event.

In one embodiment, the touch data includes at least one of position coordinates of the touch point, pressure value of the touch point, area value of the touch point, pen rotation angle, and key operation information;

The keys are keys on a writing pen.

In one embodiment, the smart device includes an interactive smart tablet;

The touch screen includes a capacitive screen, an electromagnetic screen, and / or an infrared screen.

In one embodiment, the operating system includes at least one of a window system and an Android system;

And / or, the writing pen is a device conforming to the USB HID class.

According to a second aspect of the present invention, a device for processing touch data is provided, including:

A touch detection module for detecting a touch event of the stylus on the touch screen;

A quantity identification module, configured to identify the quantity of the writing pen;

A first data encapsulation module, configured to encapsulate touch data using a HID multi-touch protocol if the number is greater than or equal to 2, the touch data is data caused by the touch event;

And, a data transmission module is configured to send the packaged touch data to an operating system, where the operating system is an operating system of a smart device to which the current display signal of the touch screen belongs.

In one of the embodiments, it further includes:

A second data encapsulation module is configured to encapsulate the touch data using a HID pen protocol if the number is less than two.

In one embodiment, the writing pen is a USB HID device;

and / or,

The quantity identification module includes:

A data acquisition unit, configured to acquire touch data caused by the touch event;

An identification unit is configured to identify the number of the writing pens by using the touch data.

According to a third aspect of the present invention, there is provided a smart device including: a touch screen, a touch screen control board, and a motherboard, wherein the motherboard is equipped with an operating system,

The touch screen control board includes:

A touch detection module for detecting a touch event of the stylus on the touch screen;

A quantity identification module, configured to identify the quantity of the writing pen;

A first data encapsulation module, configured to encapsulate touch data using a HID multi-touch protocol if the number is greater than or equal to 2, the touch data is data caused by the touch event;

And a data transmission module for sending the packaged touch data to the operating system;

The motherboard includes:

The analysis and response module is configured to parse the received touch data and respond to the touch event.

In one embodiment, the touch screen control board further includes:

A second data encapsulation module is configured to encapsulate the touch data using a HID pen protocol if the number is less than two.

According to a fourth aspect of the present invention, there is provided a computer device including a memory and a processor, where the memory is used to store a computer program,

When the computer program is executed by the processor, the processor is caused to implement the steps of any one of the above methods.

According to a fifth aspect of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program, and when the computer program is executed by the processor, causing the processor to implement any one of the methods described above step

In the embodiment provided by the present invention, when a touch event of the stylus pen on the touch screen is detected, the number of stylus pens currently written on the screen is first recognized; if the number of stylus pens currently written is greater than or equal to 2, the touch screen is recognized The control board shields the HID-pen protocol to encapsulate the touch data, but uses the HID multi-touch protocol to encapsulate the touch data of the current touch event; then the encapsulated The touch data is sent to the operating system. Therefore, on the one hand, the touch screen control board can automatically switch between hid-pen and hid-multitouch native protocols based on the number of writing pens to achieve the packaging and transmission of touch data; another In terms of the operating system, the touch data can be parsed through the native driver without the need to define a separate driver, and the compatibility is better.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a system architecture diagram applicable to a method for processing touch data in an embodiment; FIG.

2 is a schematic flowchart of a method for processing touch data according to an embodiment;

3 is a schematic flowchart of a touch data processing method according to another embodiment;

4 is a diagram illustrating an application scenario of a method for processing touch data according to an embodiment;

5 is a schematic flowchart of a touch data processing method according to still another embodiment;

6 is a schematic structural diagram of a touch data processing apparatus according to an embodiment;

7 is a schematic structural diagram of a smart device according to an embodiment;

FIG. 8 is an internal structural diagram of a computer device in one embodiment.

detailed description

In order to make the objectives, technical solutions, and advantages of the present invention clearer, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

Reference to "an embodiment" herein means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The appearances of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are they independent or alternative embodiments that are mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

In practical applications, in smart devices with touch functions, the operating system (such as window system, Android system, etc.) only supports single-stroke writing. For example, for electromagnetic screens, if there are multiple electromagnetic pens writing on the screen, the cursor points Will switch back and forth between the writing positions of multiple electromagnetic pens, and the situation of "grabbing coordinates" will appear; for the same reason, for a capacitive screen, if there are multiple capacitive pens writing on the screen, the cursor will be written on multiple capacitive pens. The position is switched back and forth, and the situation of "grabbing coordinates" also appears; therefore, the recognition accuracy of the writing results of multiple writing pens is low.

To avoid the situation of “grabbing coordinates”, it is necessary to make the operating system of the smart device support more than two writing pens to write on the screen of the smart device at the same time. Existing related technologies generally use a custom private protocol to encapsulate and analyze touch data triggered by two or more writing pens. For example, the touch screen control board can use the custom USB protocol to encapsulate touch data triggered by each writing pen into the same data package and report it to the operating system of the motherboard. However, this custom USB protocol is not Window, The native description protocols of operating systems such as Android, it is difficult for the operating system to automatically parse the encapsulated data packets, and it is necessary to add a parsing protocol corresponding to the custom USB protocol. Therefore, this type of solution that supports multiple pens to operate at the same time has great limitations. Generally, it can only be used in applications developed by developers, it is difficult to be compatible with applications developed by third parties (third-party applications), and it is difficult to get popularized applications.

In order to support more than two writing pens to write on the screen of a smart device at the same time and to be compatible with third-party applications, the present invention provides the following embodiments of a method for processing touch data.

The method for processing touch data provided by the embodiment of the present invention can be applied to the system architecture shown in FIG. 1. These include a writing pen 100, a touch screen device 200, and a host device 300. The touch screen device 200 includes a touch screen and a touch screen control board. The touch screen and the touch screen control board can be connected through FPC. The host device 300 is equipped with an operating system, and the operating system includes a touch driver. The operating system also supports the USB HID protocol. The touch screen control board is also connected to the host device 300 through a data transmission bus, such as a USB / 12C data bus. The number of writing pens 100 may be one or more.

In the embodiment of the present invention, the host device 300 may refer to a host of a smart device or a component for implementing a touch response in the host, such as a motherboard. The touch screen device 200 may refer to a touch input device independent of the smart device, or may refer to an installation device. Touch input widget on a smart device.

For the host device 300, the writing pen 100 is a device conforming to the USB HID class; HID is the abbreviation of Human Interface Device, which belongs to human-computer interactive operation devices, but HID devices do not necessarily have human-machine interfaces, as long as they meet the HID category The standard equipment is HID equipment. The USB HID class is a standard device class for USB devices. One of the advantages of using USB HID devices is that, in general, the operating system of the host device 300 has built-in drivers for the HID device. Users do not need to develop drivers. Applications in the host device 300 can directly use these drivers. To communicate with USB HID devices.

When the touch screen device 200 and the host device 300 are components of the same smart device, the smart device may be a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, a smart writing device, Email devices, game consoles, tablet computers, wearables, smart locomotives, driverless cars, smart refrigerators, other smart home devices, or a combination of any of these devices. The smart writing device may be an interactive smart tablet.

Various applications can be installed in the above smart devices, such as text editing applications, document presentation applications, instant messaging applications, image editing applications, social applications, e-commerce applications, and search applications Programs, browser applications, and more. Among them, text editing applications such as electronic whiteboard applications, electronic blackboard applications, presentation applications such as wireless projection applications, and instant messaging applications such as video conference applications.

In the embodiment, the interactive smart tablet is described as an example of a smart device. The interactive smart tablet may be an integrated device that uses touch technology to control the content displayed on the display tablet and implement human-computer interaction operations. One or more functions such as projector, whiteboard, curtain, sound, TV, and video conference terminal. In the interactive smart tablet, the host device 300 refers to a main board of the interactive smart tablet, and the touch screen device 200 refers to a touch screen and a touch screen control board installed on the interactive smart tablet.

In an embodiment, the touch screen of the interactive smart tablet may include: a capacitive screen, an electromagnetic screen, or an infrared screen. Generally speaking, the touch screen can receive a touch operation input by a user through a finger or an input device. The input device includes, but is not limited to, a capacitive pen, an electromagnetic pen, and / or an infrared pen.

In one embodiment, as shown in FIG. 2, a method for processing touch data is provided. The method is applied to the above-mentioned touch screen control panel as an example for description, and includes the following steps S11 to S14, as follows:

S11. A touch event of the writing pen on the touch screen is detected.

The writing pen includes, but is not limited to, a capacitive pen, an electromagnetic pen, or an infrared pen, and the touch screen includes, but is not limited to, a capacitive screen, an electromagnetic screen, or an infrared screen. The touch events of the stylus pen on the touch screen include, but are not limited to, click events and writing events. The writing event can be either a character writing event or a graphic drawing event.

In the embodiment of the present invention, for the operating system of the smart device, the writing pen is a device conforming to the USB HID class. The benefits of using the writing pen conforming to the USB HID class include that the operating system of the smart device to which the touch screen belongs generally has a built-in HID Device drivers, so there is no need for user-defined drivers to ensure compatibility with third-party applications.

S12. Identify the number of the writing pens.

This step refers to identifying the number of writing pens currently in contact with the touch screen at the same time. The recognition method can adopt any writing pen recognition method that developers can think of, for example, identifying the number of writing pens currently writing on the touch screen by acquiring real-time images. Or, based on the detected touch data, the number of writing pens currently touching the touch screen at the same time is identified. The specific identification method can be selected according to the actual situation.

S13. If the number is greater than or equal to 2, HID-multitouch protocol is used to encapsulate touch data, and the touch data is data caused by the touch event.

When it is determined that the number of writing pens currently writing on the touch screen is two or more, the traditional method is to use the HID pen protocol to encapsulate and transmit the touch data corresponding to the touch event, and there is a problem of “grabbing coordinates”. In the embodiment of the present invention, in this case, the hid-pen protocol can be used to encapsulate the touch data corresponding to the touch event, and the hid-multitouch protocol is used to encapsulate the touch data. For the touch screen control board, the hid-multitouch protocol is a native protocol. After receiving the packaged touch data, operating systems such as Window and Android can parse it by themselves without adding a custom private USB protocol.

S14. Send the packaged touch data to an operating system, where the operating system is an operating system of a smart device to which the touch screen currently displays signals.

If the current display signal of the touch screen belongs to the signal of the Windows operating system of the smart device, the encapsulated touch data is sent to the Windows operating system; if the current display signal of the touch screen belongs to the signal of the Android operating system of the smart device, the encapsulated touch is Control data is sent to the Android operating system.

After receiving the touch data, the operating system can treat it as ordinary hid-multitouch packaged data, that is, through the driver of the HID device, and analyze it in the way corresponding to ordinary hid-multitouch packaged data. No custom data analysis protocol is required. System compatibility is good. Based on this, it can effectively respond to the touch events of multiple writing pens writing at the same time, for example, multiple writing pens corresponding to their own writing handwriting are displayed on the display screen of the smart device.

Through the above embodiments, touch data transmission can be realized through the native protocol of the touch screen control board, and there is no need to separately define a touch data transmission protocol, which is beneficial to compatibility with third-party applications.

In addition, in an embodiment, if it is recognized that the number of writing pens written on the touch screen is less than 2, the touch data triggered by the writing pen is encapsulated by using a hid-pen protocol. The hid-pen protocol is a standard protocol for touch screen control boards to support single-pen input, that is, in this case, touch data is processed in a traditional manner.

Based on this, based on the number of writing pens currently writing on the touch screen, the touch screen control board can adaptively switch between two native protocols (hid-multitouch protocol and hid-pen protocol). The number of writing pens can be switched automatically between hid-pen and hid-multitouch native protocols to achieve the packaging and transmission of touch data. On the other hand, for operating systems, touch data can be realized through native drivers. Parsing, no need to define a separate driver, good compatibility. Further, the smart device with a touch function can not only support multiple writing pens writing at the same time, overcome the problem of “grabbing coordinates”, but also support the traditional single writing pen writing.

In some examples, the touch data triggered by more than two stylus pens can be mapped into the body of the same data packet according to the hid-multitouch descriptor. Specifically, according to the hid-multitouch protocol, the touch data triggered by each writing pen can be first encoded into data that meets the format specified by the hid-multitouch protocol, and then all the encoded touch data is packed into the same data packet. In the package body, the encoded touch data triggered by a writing pen in the data package corresponds to one touch point. For example, for the touch data of multiple electromagnetic pens, the touch data can be mapped to the package of the USB HID multi-touch protocol in the format shown in Table 1 below:

Table 1:

Byte number	effect
0	Message ID (0x03)
1	The first point status (0x03: pressed; 0x02: raised; 0x00: no touch)
2	First point ID (0x00)
3	X-coordinate low byte data of the first point
4	X-coordinate high byte data of the first point
5	Low byte data of the Y coordinate of the first point
6	Y point high byte data of the first point
7	The first point pressure low byte data
8	The first point pressure high byte data
9 ～ 16	Second point data
17	Effective points

As shown in Table 1, the touch data triggered by the first electromagnetic pen is encoded as data corresponding to the first point of multi-touch, including status, ID, X, Y, and Pressure information, corresponding to byte numbers 1 to 8; The touch data of the two pens is encoded as the data corresponding to the second point of the multi-touch, including status ID, X, Y, and Pressure information, corresponding to byte numbers 9 to 16; byte number 17 indicates that the current data packet has Several touch points (several pens). The ID indicates the number of the electromagnetic pen, which is used to distinguish multiple electromagnetic pens currently writing, and the Pressure information indicates the pressure value of the electromagnetic pen contacting the touch screen.

For touch data encapsulated according to the hid-multitouch protocol, the touch screen control board can transmit the encapsulated touch data to the operating system through the USB port corresponding to the hid-multitouch descriptor, and the USB port is compatible with the multi-touch protocol of the touch screen.

In some examples, for touch data triggered by a single electromagnetic pen, the touch data triggered by a single writing pen can be mapped into a data packet body by a hid-pen descriptor. For example, for the touch data of a single electromagnetic pen, the touch data can be mapped to the package of the USB HID protocol in the format shown in Table 2:

Table 2:

Byte number	effect
0	Message ID (0x10)

1	Function key (5bit for Tip / Barrel / Eraser / Invert / In Range, other 3bit reserved)
2	Point X coordinate low byte data
3	Point X coordinate high byte data
4	Point Y coordinate low byte data
5	Point Y coordinate high byte data
6	Point pressure low byte data
7	Point pressure high byte data

For touch data encapsulated according to the hid-pen protocol, the touch screen control board can transmit the encapsulated touch data to the operating system through the USB port corresponding to the hid-pen descriptor.

After the operating system receives the packaged touch data sent by the touch screen control board, it can use hid-multitouch or hid-pen corresponding native driver to analyze the touch data, parse the touch data triggered by the writing pen, and then convert For the corresponding input event, then take the action corresponding to the input event.

In an embodiment, a specific way of identifying the number of writing pens currently written on the touch screen may be: acquiring touch data caused by the touch event, and identifying the number of writing pens by the touch data. For example: acquiring a touch algorithm corresponding to the touch screen, and using the touch algorithm to determine touch data caused by the touch event.

The touch data may include at least one of coordinates of a touch point position, a touch pressure value, a touch point area value, a pen rotation angle, and key operation information; wherein the keys are keys on a writing pen. Based on the difference between the acquired touch data, the number of writing pens currently writing on the touch screen can be identified. For example, the number of writing pens can be determined by the number of touch point position coordinates included in the touch data; the number of writing pens can be determined by the number of touch pressure values included in the touch data Determining the number of the writing pens by the number of touch point area values included in the touch data.

With reference to the above embodiment, the following describes the method for processing touch data with an interactive smart tablet as an example. The touch screen of the interactive smart tablet includes a capacitive screen, an electromagnetic screen, and / or an infrared screen. The operating system of the interactive smart tablet includes a window system. , At least one of the Android system. When a pen or a finger is touched on the touch screen, the corresponding touch data processing is shown in FIG. 3 respectively.

When touching on the touch screen with a stylus pen, the corresponding touch data processing includes processing on the side of the touch screen control board, and processing on the side of the main board, as shown in FIG. 3, as follows.

On the side of the touch screen control panel:

In step S31, a touch event of the writing pen on the touch screen is detected by the touch control software.

The touch control software can detect any touch operation event of the stylus on the touch screen, such as a screen click event of the stylus, or a character writing event, or a graphic drawing event. At present, it can also be a touch event triggered by another stylus.

Step S32: Acquire a touch algorithm corresponding to the touch screen.

Different touch screens have different touch algorithms. For example, capacitive screens, electromagnetic screens, and infrared screens correspond to different touch algorithms. Touch algorithms are used to obtain touch data on the touch screen. For the specific types of touch algorithms, developers can see what they need. The setting is not limited to the embodiment of the invention.

In step S33, touch data caused by a current touch event is detected by a touch algorithm.

For the touch event of the writing pen, the touch data includes coordinates of the touch point position, touch pressure, area value of the touch point, pen rotation angle, key operation information, and the like.

In step S34, the number of the writing pens is identified through the touch data.

Generally, when multiple users use a stylus to write on a touch screen, the touch data triggered by each stylus will be different. Based on this, the number of styluses currently triggering the touch screen can be identified. For example, the number of writing pens can be determined by the number of touch point position coordinates included in the touch data; or the number of writing pens can be determined by the number of touch point sizes included in the touch data; Alternatively, the number of writing pens is determined by the number of touch pressure values included in the touch data.

In step S35, it is determined whether the number of writing pens is greater than or equal to two. If yes, the next step is performed, otherwise, step S37 is performed.

In step S36, the touch data is encapsulated by using a hid-multitouch protocol, and the process jumps to step S38.

In step S37, the touch data is encapsulated by using a hid-pen protocol.

Step S38: Send the packaged touch data to the operating system.

On the motherboard side:

In step S39, the touch data may be analyzed by the touch driver included in the operating system to respond to the touch event.

In addition, in order to respond to a touch event, the touch driver can send the parsed touch data to an input subsystem (input_device) in the operating system. The input subsystem can be composed of a device driver layer, an input core layer, and an event processing layer. Among them, the device driver layer can convert the underlying hardware input into a unified event form and report to the input core layer. The input core layer can link up and down, register and operate the device input interface for the hardware driver layer, and notify the event processing layer to perform the event. deal with. Figure 4 shows the response of several writing pens when writing at the same time.

In the scenario shown in FIG. 4, an interactive smart tablet can be installed on a podium in a classroom. The interactive smart tablet is provided with a touch screen control board and a motherboard. The former is used to detect information on the touch screen; the latter is equipped with an operating system and can respond to touch events on the touch screen through a touch driver. The teacher may select multiple students to answer the question through the electronic whiteboard running in the interactive smart tablet, such as Student Wang and Student Zhang shown in Figure 4. These two students need to write the English word "English" at the same time as instructed by the teacher After the two students contacted the electronic whiteboard through their own writing pens and started writing, the touch screen control board could detect the touch data triggered by each writing pen, and encapsulate the detected touch data according to the hid-multitouch protocol. , And upload it to the motherboard through the USB port included in the drive interface of the touch screen control board. After the motherboard analyzes the touch data, it controls the electronic whiteboard to display the corresponding writing content. For example, if the student Wang writes correctly "English" and the student Zhang writes incorrectly "Englich", the motherboard controls the electronic whiteboard to display the content of the student Wang writing as "English" and the content of the student Xiao Zhang's writing as "Englich".

As shown in Figure 5, when a finger is touched on the touch screen, the corresponding touch data is processed as follows:

On the side of the touch screen control panel:

In step S41, a touch event of a finger on the touch screen may be detected by the touch control software.

The touch control software can detect any touch operation event of the finger on the touch screen, such as a finger screen click event, a drag event, a slide event, or a character writing event, or a graphic drawing event. Currently, it can also be triggered by other fingers. Touch events.

Step S42: Acquire a touch algorithm corresponding to the touch screen.

Different touch screens have different touch algorithms. For example, capacitive screens, electromagnetic screens, and infrared screens correspond to different touch algorithms. Touch algorithms are used to obtain touch data on the touch screen. For the specific types of touch algorithms, developers can see what they need. The setting is not limited to the embodiment of the invention.

In step S43, touch data caused by a current touch event is detected by a touch algorithm.

For a finger touch event, the touch data includes the coordinates of the touch point position, the touch pressure, and the area value of the touch point.

Generally speaking, when multiple users touch the touch screen with their fingers, or when multiple fingers of the same user touch the touch screen, the touch data triggered by each finger will be different. Based on this, it can be identified that the touch screen is currently triggered. Number of fingers. The embodiment of the present invention does not limit this.

In step S44, the hid-multitouch protocol is used to encapsulate touch data triggered by a finger.

Step S45: Send the packaged touch data to the operating system.

On the motherboard side:

In step S46, touch data may be analyzed by a touch driver included in the operating system, and a touch event may be responded to.

It should be understood that, for the foregoing method embodiments, although the steps in the flowchart are sequentially displayed according to the directions of the arrows, these steps are not necessarily performed in the order indicated by the arrows. Unless explicitly stated in this document, the execution of these steps is not strictly limited, and these steps can be performed in other orders. Moreover, at least a part of the steps in the flowchart of the method embodiment may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily performed at the same time, but may be performed at different times. These sub-steps Or the order of execution of the stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

Based on the same idea as the method for processing touch data in the above embodiments, a device for processing touch data is also provided herein.

In one embodiment, as shown in FIG. 6, the device for processing touch data in this embodiment includes a touch detection module 510, a quantity identification module 520, a first data packaging module 530, and a data transmission module 540, and each module is described in detail. as follows:

The touch detection module 510 is configured to detect a touch event of the writing pen on the touch screen.

In one embodiment, the writing pen is a USB HID device.

A quantity identification module 520 is configured to identify the quantity of the writing pen.

The first data encapsulation module 530 is configured to encapsulate the touch data using the HID multi-touch protocol hid-multitouch if the number is greater than or equal to 2, and the touch data is data caused by the touch event.

And, a data transmission module 540 is configured to send the packaged touch data to an operating system, where the operating system is an operating system of a smart device to which the current display signal of the touch screen belongs.

In one embodiment, the device for processing touch data further includes a second data packaging module for packaging the touch data using a HID pen protocol hid-pen if the number is less than two.

In an embodiment, the quantity identification module 520 includes a data acquisition unit and an identification unit, wherein the data acquisition unit is configured to acquire touch data caused by the touch event; the identification unit is configured to pass the touch The control data identifies the number of the writing pens.

In an embodiment, the data obtaining unit is specifically configured to obtain a touch algorithm corresponding to the touch screen, and use the touch algorithm to obtain touch data caused by the touch event.

In one embodiment, the touch data includes at least one of: position coordinates of the touch point, pressure value of the touch point, area value of the touch point, pen rotation angle, and key operation information; wherein the keys are on a writing pen Button.

For specific limitations on the device for processing touch data, refer to the foregoing limitation on the method for processing touch data, and details are not described herein again.

Referring to FIG. 7, the present invention further provides an embodiment of a smart device. The smart device includes a touch screen, a touch screen control board, and a motherboard, and the motherboard is equipped with an operating system.

The touch screen control board includes:

The touch detection module is configured to detect a touch event of the writing pen on the touch screen.

In one embodiment, the writing pen is a device conforming to the USB HID class;

A quantity identification module, configured to identify the quantity of the writing pen;

A first data packaging module for packaging touch data using the HID multi-touch protocol hid-multitouch if the number is greater than or equal to 2, the touch data is data caused by the touch event;

And a data transmission module for sending the packaged touch data to the operating system;

The motherboard includes:

The analysis and response module is configured to parse the received touch data and respond to the touch event.

In an embodiment, the touch screen control board further includes: a second data packaging module for packaging the touch data using a HID pen protocol hid-pen if the number is less than two.

In the above embodiments of the device and the smart device, each module may be implemented in whole or in part by software, hardware, and a combination thereof. The above-mentioned modules may be embedded in the hardware form or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor calls and performs the operations corresponding to the above modules.

In addition, in the embodiments of the above devices and smart devices, the logical division of each program module is only an example. In actual applications, the above functions may be allocated according to needs, for example, due to the consideration of the configuration requirements of the corresponding hardware or the convenience of software implementation. Completed by different program modules.

In one embodiment, a computer device is provided, and the internal structure diagram of the computer device may be as shown in FIG. 8. The computer equipment includes a processor, a memory, a network interface, a touch display screen, and an input device connected through a system bus. The processor is used to provide computing and control capabilities. The memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory is a non-volatile storage medium. The operating system and the computer program run to provide the environment; the network interface is used to communicate with external terminals through a network connection; the computer program is executed by the processor to implement a method of touch data processing; the touch display can be a liquid crystal display Or an electronic ink display screen; the input device may be a touch layer covered on the display screen, or a button, a trackball, or a touchpad provided on the shell of a computer device, or an external keyboard, touchpad, or mouse.

Those skilled in the art can understand that the structure shown in FIG. 8 is only a block diagram of a part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer equipment to which the scheme of the present application is applied. The specific computer equipment may be Include more or fewer parts than shown in the figure, or combine certain parts, or have a different arrangement of parts.

In one embodiment, a computer device is provided, which includes a memory and a processor. The memory stores a computer program. When the processor executes the computer program, the steps of the method embodiment of the method for processing touch data of any of the foregoing embodiments are implemented. .

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method embodiment of the touch data processing of any of the foregoing embodiments are implemented.

A person of ordinary skill in the art can understand that all or part of the processes in the methods of the foregoing embodiments can be implemented by using a computer program to instruct related hardware. The computer program can be stored in a non-volatile computer-readable storage. In the medium, the computer program, when executed, may include the processes of the embodiments of the methods described above. Wherein, any reference to the memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Synchlink DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the above embodiments can be arbitrarily combined. In order to make the description concise, all possible combinations of the technical features in the above embodiments have not been described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered to be the range described in this specification. The description of each of the foregoing embodiments has different focuses. For a part that is not described in detail in an embodiment, reference may be made to related descriptions in other embodiments.

The terms "including" and "having" and any variations thereof in the examples are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device containing a series of steps or (module) units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optional The ground also includes other steps or units inherent to these processes, methods, products or equipment.

The "plurality" mentioned in the examples means two or more. "And / or" describes the association relationship of the associated objects, and indicates that there can be three kinds of relationships. For example, A and / or B can mean that there are three cases in which A exists alone, A and B exist, and B exists alone. The character "/" generally indicates that the related objects are an "or" relationship.

The "first \ second" mentioned in the embodiment is only a difference between similar objects, and does not represent a specific ordering of objects. Understandably, "first \ second" can be interchanged with specific ones if allowed. Sequential or sequential. It should be understood that the objects of the "first \ second" distinction are interchangeable where appropriate, so that the embodiments described herein can be implemented in an order other than those illustrated or described herein.

The above embodiments only express several implementation manners of the present invention, but cannot be understood as limiting the scope of the invention patent. It should be noted that, for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the protection scope of this application patent shall be subject to the appended claims.

Claims (14)

1. A method for processing touch data, comprising:

   A touch event of the stylus on the touch screen is detected;

   Identifying the number of the writing pens;

   If the number is greater than or equal to 2, use HID multi-touch protocol to encapsulate the touch data, and the touch data is data caused by the touch event;

   The encapsulated touch data is sent to an operating system, which is the operating system of the smart device to which the touch screen currently displays signals.
2. The method according to claim 1, further comprising:

   If the number is less than 2, the touch data is encapsulated using a HID pen protocol.
3. The method according to claim 1, wherein the identifying the number of the writing pens comprises:

   Acquiring touch data caused by the touch event;

   The number of the writing pens is identified by the touch data.
4. The method according to claim 3, wherein the acquiring touch data caused by the touch event comprises:

   Obtaining a touch algorithm corresponding to the touch screen,

   The touch algorithm is used to identify touch data caused by the touch event.
5. The method according to claim 3 or 4, characterized in that:

   The touch data includes at least one of position coordinate of touch point, pressure value of touch point, area value of touch point, pen rotation angle, and key operation information;

   The keys are keys on a writing pen.
6. The method according to any one of claims 1 to 4, wherein:

   The smart device includes an interactive smart tablet; and / or,

   The touch screen includes a capacitive screen, an electromagnetic screen, and / or an infrared screen.
7. The method according to claim 5, wherein:

   The operating system includes at least one of a window system and an Android system; and / or,

   The writing pen is a device conforming to the USB HID class.
8. A device for processing touch data is characterized in that it includes:

   A touch detection module for detecting a touch event of the stylus on the touch screen;

   A quantity identification module, configured to identify the quantity of the writing pen;

   A first data encapsulation module, configured to encapsulate touch data using a HID multi-touch protocol if the number is greater than or equal to 2, the touch data is data caused by the touch event;

   And, a data transmission module is configured to send the packaged touch data to an operating system, where the operating system is an operating system of a smart device to which the current display signal of the touch screen belongs.
9. The device according to claim 8, further comprising:

   A second data encapsulation module is configured to encapsulate the touch data using a HID pen protocol if the number is less than two.
10. The device according to claim 8 or 9, wherein the writing pen is a device conforming to a USB HID class;

    and / or,

    The quantity identification module includes:

    A data acquisition unit, configured to acquire touch data caused by the touch event;

    An identification unit is configured to identify the number of the writing pens by using the touch data.
11. A smart device, comprising: a touch screen, a touch screen control board, and a main board, wherein the main board is equipped with an operating system,

    The touch screen control board includes:

    A touch detection module for detecting a touch event of the stylus on the touch screen;

    A quantity identification module, configured to identify the quantity of the writing pen;

    A first data encapsulation module, configured to encapsulate touch data using a HID multi-touch protocol if the number is greater than or equal to 2, the touch data is data caused by the touch event;

    And a data transmission module for sending the packaged touch data to the operating system of the motherboard;

    The motherboard includes:

    The analysis and response module is configured to parse the received touch data and respond to the touch event.
12. The smart device according to claim 11, wherein the writing pen is a device conforming to a USB HID class;

    and / or,

    The touch screen control board further includes:

    A second data encapsulation module is configured to encapsulate the touch data using a HID pen protocol if the number is less than two.
13. A computer device includes a memory and a processor, where the memory is used to store a computer program, and is characterized in that:

    When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.
14. A computer-readable storage medium having stored thereon a computer program, characterized in that when the program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images