WO2019161691A1

WO2019161691A1 - Method and apparatus for self-adaptively parsing touch data, and device and storage medium

Info

Publication number: WO2019161691A1
Application number: PCT/CN2018/118578
Authority: WO
Inventors: 杨起源
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2018-02-24
Filing date: 2018-11-30
Publication date: 2019-08-29
Also published as: CN108388372B; CN108388372A

Abstract

A method and apparatus for self-adaptively parsing touch data, and a device and a storage medium. The method comprises: establishing a touch data parsing model according to a device descriptor of a touch device and a report descriptor of a USB HID (S110); and parsing out touch data of the touch device by means of the touch data parsing model, and processing and forwarding the touch data (S120).

Description

Method, device, device and storage medium for adaptively analyzing touch data

The present application claims priority to Chinese Patent Application No. 20110115729, filed on Jan.

Technical field

The embodiments of the present invention relate to the field of adaptive parsing touch device forwarding technologies, for example, to a method, an apparatus, a device, and a storage medium for adaptively analyzing touch data.

Background technique

The smart tablet controls the content displayed on the display panel through the touch technology. FIG. 1 is a flowchart of processing the forwarding data by the smart tablet touch device provided by the related art. As shown in FIG. 1 , the touch device 10 sends the touch data to the main control chip 20 through a proprietary custom protocol. The main control chip 20 parses the received touch data and processes it through a touch area mask or the like and then switches through the universal serial bus. The device 30 (Universal Serial Bus Switch 30, USB Switch 30) is further forwarded to a computer (Personal Computer, PC) module 40, an Android module 50, and an output device (OUT) module 60.

However, if the touch device is to be replaced, the supplier of the touch device must be required to modify the USB proprietary customized communication protocol, or modify the communication protocol of the chip to adapt to the communication protocol of the new touch frame, and cannot directly change to other touch devices. It is precisely because the communication protocol between the touch device and the chip is a proprietary customized protocol, and the USB protocol of the general touch device supplier is not the same, so it cannot be directly used. For example, the communication protocol of the touch device A is protocol A, the communication protocol of the touch device B is protocol B, and the communication protocol customized by the master control chip is protocol C, then the master control chip must use touch device A and touch device B to make touch The communication protocol of device A and touch device B is modified to C for use.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The present application provides a method, an apparatus, a device, and a storage medium for adaptively analyzing touch data, so that the touch device can be adaptively adapted and recognized to parse touch data, and the touch device can be quickly imported or changed without modifying the software code. .

In a first aspect, an embodiment of the present application provides a method for adaptively analyzing touch data, including: a device identifier of a touch device and a universal serial bus human interface device (USB HID) The report descriptor establishes a touch data analysis model; the touch data of the touch device is parsed by the touch data analysis model for processing and forwarding.

In a second aspect, the embodiment of the present application further provides an apparatus for adaptively analyzing touch data, the apparatus comprising: a model establishing module, configured to establish a touch data analysis model according to a device descriptor of a touch device and a report descriptor of a USB HID; And a touch data forwarding module configured to parse and touch the touch data of the touch device by using the touch data analysis model.

In a third aspect, an embodiment of the present application further provides an apparatus, including a memory, a processor, and a computer program stored on the memory and operable on the processor, where the processor implements any one of the applications A method of adaptively analyzing touch data as described in the embodiments.

In a fourth aspect, the embodiment of the present application further provides a computer readable storage medium, where the computer program is stored, and when the program is executed by the processor, the method for adaptively analyzing touch data according to any one of the embodiments of the present application is implemented. .

The embodiment of the present application processes and forwards the touch data by establishing a touch data analysis model according to the touch device, so that the touch device can be adaptively adapted and recognized to parse the touch data, and the software code can be quickly imported or changed without modifying the software code. device.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

DRAWINGS

FIG. 1 is a flowchart of processing a forwarding data by a smart tablet touch device provided by the related art;

2 is a flowchart of a method for adaptively analyzing touch data according to Embodiment 1 of the present application;

3 is a flowchart of a method for adaptively analyzing touch data according to Embodiment 2 of the present application;

4 is a structural diagram of an apparatus for adaptively analyzing touch data according to Embodiment 3 of the present application;

FIG. 5 is a schematic structural diagram of hardware of a device according to Embodiment 4 of the present application.

Detailed ways

The specific embodiments of the present application are further described in detail below with reference to the accompanying drawings. It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.

It should also be noted that, for the convenience of description, only some, but not all, of the contents related to the present application are shown in the drawings. Before discussing the exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as a process or method depicted as a flowchart. Although the flowcharts describe various operations (or steps) as a sequential process, many of the operations can be implemented in parallel, concurrently or concurrently. In addition, the order of operations can be rearranged. The process may be terminated when its operation is completed, but may also have additional steps not included in the figures. The processing may correspond to methods, functions, procedures, subroutines, subroutines, and the like.

Embodiment 1

2 is a flowchart of a method for adaptively analyzing touch data according to Embodiment 1 of the present application. This embodiment is applicable to a case where touch data is accessed by a touch device, and the method can adaptively analyze touch data. The device is executed, and specifically includes step S110 and step S120.

In step S110, a touch data analysis model is established based on the device descriptor of the touch device and the report descriptor of the USB HID.

The USB descriptors fall into three categories: standard descriptors, HID descriptors, and (Hub) descriptors. The standard descriptors are further divided into device descriptors, configuration descriptors, string descriptors, interface descriptors, endpoint descriptors, device definition descriptors, and other rate configuration descriptors, and these seven descriptors have similar formats.

The device descriptor describes the complete information of the device, and corresponds to the device itself. One device has only one device descriptor. When the touch device is accessed, the first thing to do is to obtain the device descriptor to have a complete understanding of the device.

A large class of USB devices is the HID device, which is Human Interface Devices, which is mainly used for humans to interact with computers. The HID device is one of the earliest supported devices of the USB protocol. The HID device can be used as a low-speed, full-speed, high-speed device. Since the HID device requires the user input to receive a timely response, the transmission mode is usually interrupted. HID devices support five of the USB standard descriptors: device descriptors, configuration descriptors, interface descriptors, endpoint descriptors, and string descriptors. In addition, HID devices have three special descriptors: HID descriptors, report descriptors, and physical descriptors. A USB device can only support one HID descriptor, but can support multiple report descriptors, while physical descriptors may or may not be available. In the USB protocol, the definition of the HID device is placed in the interface descriptor, and the device descriptor and configuration descriptor of the USB do not contain the information of the HID device. Therefore, for some specific HID devices, multiple interfaces can be defined, only One of the interfaces is the HID device class.

Among them, the USB HID report descriptor is a data report, which is mainly used to define the data exchange format between the HID device and the USB host. The HID Device Report Descriptor uses a custom data structure for transmitting specific data packets, transmitting data through reports, reporting input reports and output reports. The input report is sent by the USB device to the host. For example, the USB mouse returns information such as mouse movement and mouse click to the computer, and the keyboard returns the button data to the computer; the output report is sent by the host to the USB device, such as a numeric keypad on the keyboard. Lock lights and uppercase letter lock lights, etc. The report is a data packet containing the data to be transmitted. The report descriptor is a description of a report and what is used in the report. The report descriptor can be used to analyze the meaning of the data in the report, that is, the purpose of the data in the report of these transmissions. .

Specifically, the touch device does not require the device vendor to replace the customized protocol, and only needs to implement the universal touch protocol of the standard multi-touch device. When the main control chip detects the touch device access, the first control chip needs to obtain the device descriptor to have a complete understanding of the device, and then parse the touch data according to the obtained USB HID report descriptor, that is, according to The report in the report descriptor parses the touch data in the data packet carried by the report descriptor, that is, it is equivalent to establishing a simulated touch data analysis model by the device descriptor of the touch device and the report descriptor of the USB HID.

In step S120, the touch data of the touch device is parsed by the touch data analysis model for processing and forwarding.

Specifically, after the touch data of the touch device analyzed by the touch data analysis model is acquired, the obtained touch data is processed according to the touch data processing algorithm, and the processed touch data is forwarded. The touch data processing algorithm uses a conventional touch data processing algorithm, such as an algorithm such as touch area masking.

The embodiment of the present application processes and forwards the touch data by establishing a touch data analysis model according to the touch device, so as to implement an adaptive recognition touch device that can be adaptively parsed, to parse the touch data, and to quickly import or change the touch without modifying the software code. device.

Embodiment 2

FIG. 3 is a flowchart of a method for adaptively analyzing touch data according to Embodiment 2 of the present application. The embodiment is refined based on the foregoing embodiment. In this implementation, the step is further refined according to the device descriptor of the touch device and the USB HID report descriptor to form a touch data analysis model: detecting touch device access And reading a device descriptor of the touch device and a USB HID report descriptor from a register of the touch device; establishing a touch data parsing model based on the device descriptor and the USB HID report descriptor according to a general protocol specification. In an embodiment, the step of parsing the touch data of the touch device by the touch data analysis model for processing and forwarding is further refined to: the touch data analysis model is parsed byte by byte and is generalized in the touch device. Touch data corresponding to the touch protocol; the touch data is processed and forwarded by a touch data processing algorithm. In addition, the method further includes: forwarding the parsed touch data of the touch device to at least one of the first system module, the second system module, and the output module by using a USB switch.

The method in this embodiment specifically includes steps S210 to S220.

In step S210, when it is detected that there is a touch device access, the device descriptor of the touch device and the USB HID report descriptor are read from the register of the touch device.

In step S220, a touch data analysis model based on the device descriptor and the USB HID report descriptor is established according to a general protocol specification.

Wherein, the general protocol specification is a general specification of a USB communication protocol issued by the USB Association. The touch protocol of the touch device is adapted by the vendor of each touch device according to the general protocol specification, but the touch protocols corresponding to the touch devices produced by the vendors of different touch devices are different. In the technical solution of the present application, the supplier of the touch device does not need to modify the touch protocol of the touch device, and only needs to adapt the universal touch protocol of the standard multi-touch device in advance, and obtain the location when the touch control device is detected by the main control chip. Describe the device descriptor and the USB HID report descriptor, and adaptively dynamically build a touch data parsing model to parse the touch data.

In step S230, the touch data analysis model parses the touch data corresponding to the universal touch protocol in the touch device byte by byte.

Specifically, on the basis of the general protocol specification, the touch data parsing model analyzes the meaning of each byte of the touch data byte by byte, for example, the first to the first digits represent the X axis and the first digits The first digit represents the Y-axis and the digits to the digits represent certain information. The information is parsed out of the touch device byte by byte according to the data carried in the USB HID report descriptor and the report in the report descriptor. Touch data corresponding to the universal touch protocol.

In step S240, the touch data is processed and forwarded by a touch data processing algorithm.

In step S250, the parsed touch data of the touch device is forwarded to at least one of the first system module, the second system module, and the output module through the USB switch.

The first system module may be a PC module (usually adopting a Windows operating system), the second system module may be an Android module, and the output module may be an OUT module, configured to access other external devices and output touch data. It is to be noted that the embodiment of the present application does not impose any limitation here.

When detecting the access of the touch device, the embodiment of the present application reads the device descriptor of the touch device and the USB HID report descriptor from the register of the touch device, and establishes the device descriptor based on the device descriptor according to the general protocol specification. a touch data analysis model of the USB HID report descriptor, which parses the touch data corresponding to the universal touch protocol in the touch device byte by byte, processes and forwards the touch data, and passes the parsed touch data of the touch device The USB switcher forwards to at least one of the first system module, the second system module, and the output module. In this way, it can be compatible with almost all touch devices on the market without modifying the program on the main control chip, or let the touch device supplier modify the firmware to adapt to the main control chip, so that the touch can be adaptively adapted and recognized. The device dynamically builds a touch data parsing model to parse the touch data, and does not need to modify the software code to quickly import or transform the touch device.

Embodiment 3

4 is a structural diagram of an apparatus for adaptively analyzing touch data according to Embodiment 3 of the present application. This embodiment is applicable to a case where touch data is accessed by a touch device, and the system can adaptively analyze touch data. The way to execute.

As shown in FIG. 4, the apparatus includes: a model establishing module 310 and a touch data forwarding module 320.

The model establishing module 310 is configured to establish a touch data parsing model according to the device descriptor of the touch device and the report descriptor of the USB HID.

The touch data forwarding module 320 is configured to parse out the touch data of the touch device by using the touch data analysis model, and process and forward the touch data.

An embodiment of the present application provides an apparatus for adaptively parsing touch data, which processes and forwards touch data by establishing a touch data analysis model according to the touch device, so as to adaptively adapt and recognize the touch device to parse the touch data. No need to modify the software code to quickly import or transform touch devices.

On the basis of the foregoing embodiments, the model establishing module 310 includes: a descriptor reading unit configured to read the device of the touch device from a register of the touch device when detecting that a touch device is accessed Descriptor and USB HID report descriptor; a model building unit configured to establish a touch data parsing model based on the device descriptor and the USB HID report descriptor according to a general protocol specification.

On the basis of the foregoing embodiments, the touch data forwarding module 320 includes: a touch data parsing unit, configured to parse out the touch data corresponding to the universal touch protocol in the touch device byte by byte according to the touch data parsing model. a touch data forwarding unit configured to process and forward the touch data by a touch data processing algorithm.

On the basis of the foregoing embodiments, the device further includes: a USB switch forwarding module, configured to forward the touch data of the touch device to the first system module, the second system module, and At least one of the output modules.

The apparatus for adaptively analyzing touch data provided by each of the above embodiments may perform the method for adaptively analyzing touch data provided by any embodiment of the present application, and has a function module corresponding to a method for performing adaptive analysis of touch data.

Embodiment 4

FIG. 5 is a schematic diagram of a hardware structure of a device according to an embodiment of the present application. As shown in FIG. 5, the device includes: at least one processor 410, and one processor 410 is taken as an example in FIG. 5; .

The device may also include an input device 430 and an output device 440.

The processor 410, the memory 420, the input device 430, and the output device 440 in the device may be connected by a bus or other means, and the bus connection is taken as an example in FIG.

The memory 420 is a non-transitory computer readable storage medium, and can be configured to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to a method for adaptively analyzing touch data in the embodiment of the present application. (For example, the model building module 310 and the touch data forwarding module 320 shown in FIG. 4). The processor 410 executes various functional applications and data processing of the device by executing software programs, instructions, and modules stored in the memory 420, that is, a method for adaptively analyzing touch data by implementing the above method embodiments.

The memory 420 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the device, and the like. In addition, memory 420 can include high speed random access memory, and can also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 420 can include memory remotely located relative to processor 410, which can be connected to the terminal device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

Input device 430 can be configured to receive input digital or character information and to generate key signal inputs related to user settings and function control of the device. Output device 440 can include a display device such as a display screen.

Embodiment 5

The embodiment of the present application further provides a storage medium including computer executable instructions that, when executed by a computer processor, are configured to perform a method of adaptively analyzing touch data, the method comprising:

Establishing a touch data analysis model according to the device descriptor of the touch device and the report descriptor of the USB HID;

The touch data of the touch device is parsed by the touch data analysis model for processing and forwarding.

In an embodiment, the computer-executable instructions, when executed by a computer processor, can also be used to implement a method for adaptively analyzing touch data provided by any embodiment of the present application.

Through the above description of the embodiments, those skilled in the art can clearly understand that the present application can be implemented by using software and necessary general hardware, and of course, can also be implemented by hardware, but in many cases, the former is adopted as an implementation manner. Based on such understanding, the technical solution of the present application, which is essential or contributes to the related art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer, Read-Only Memory (ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (can be a personal computer, The server, or network device, etc.) performs the methods described in various embodiments of the present application.

Claims

A method for adaptively analyzing touch data, comprising:

Establishing a touch data analysis model according to the device descriptor of the touch device and the report descriptor of the universal serial bus human interface device USB HID;

The touch data of the touch device is parsed by the touch data analysis model, and the touch data is processed and forwarded.
The method of claim 1, wherein the establishing a touch data parsing model according to the device descriptor of the touch device and the USB HID report descriptor comprises:

When detecting that a touch device is accessed, reading a device descriptor of the touch device and a USB HID report descriptor from a register of the touch device;

A touch data parsing model based on the device descriptor and the USB HID report descriptor is established according to a general protocol specification.
The method of claim 1, wherein the parsing the touch data of the touch device by the touch data parsing model for processing and forwarding comprises:

The touch data analysis model parses the touch data corresponding to the universal touch protocol in the touch device byte by byte;

The touch data is processed and forwarded by a touch data processing algorithm.
The method of claim 1 further comprising:

The parsed touch data of the touch device is forwarded to at least one of the first system module, the second system module, and the output module through the USB switch.
An apparatus for adaptively analyzing touch data, comprising:

a model establishing module, configured to establish a touch data parsing model according to a device descriptor of the touch device and a report descriptor of the USB HID;

The touch data forwarding module is configured to parse out the touch data of the touch device by using the touch data analysis model, and process and forward the touch data.
The apparatus of claim 5, wherein the model building module comprises:

a descriptor reading unit configured to read a device descriptor of the touch device and a USB HID report descriptor from a register of the touch device when detecting that a touch device is accessed;

A model establishing unit is configured to establish a touch data parsing model based on the device descriptor and the USB HID report descriptor according to a general protocol specification.
The device of claim 5, wherein the touch data forwarding module comprises:

The touch data parsing unit is configured to parse out the touch data corresponding to the universal touch protocol in the touch device byte by byte according to the touch data parsing model;

The touch data forwarding unit is configured to process and forward the touch data by a touch data processing algorithm.
The apparatus of claim 5, the apparatus further comprising:

The USB switch forwarding module is configured to forward the touch data of the touched touch device to at least one of the first system module, the second system module, and the output module through the USB switch.
An apparatus comprising a memory, a processor, and a computer program stored on the memory and operative on the processor, the processor executing the program to implement the method of any of claims 1-4.
A computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the method of any of claims 1-4.