WO2022222384A1

WO2022222384A1 - Touch data processing method and interaction tablet

Info

Publication number: WO2022222384A1
Application number: PCT/CN2021/122175
Authority: WO
Inventors: 陈玉香
Original assignee: 广州创知科技有限公司
Priority date: 2021-04-22
Filing date: 2021-09-30
Publication date: 2022-10-27
Also published as: WO2022222385A1

Abstract

A touch data processing method and an interaction tablet. Infrared touch data generated when a touch object touches a touch-control detection region of an interaction tablet is detected by means of an infrared touch frame, an elastic wave signal generated when the touch object touches a display screen is detected by means of an elastic wave detection apparatus, and a medium type is determined according to touch position information and/or touch parameter information in the infrared touch data, and the elastic wave signal. A medium type is determined by means of combining infrared touch data with an elastic wave signal, thereby improving the recognition precision of a touch object. In addition, medium type information containing the medium type of the touch object is sent to a processing device, such that the processing device can execute different response operations according to different medium types of the touch object. The operation is simple, and the efficiency is high.

Description

Touch data processing method and interactive tablet

technical field

The present disclosure relates to the technical field of electronic device control, and in particular, to a touch data processing method and an interactive tablet.

Background technique

Using the infrared touch frame to perform touch operations on the display screen is one of the commonly used touch methods for interactive tablets. The infrared touch frame includes infrared transmitters and infrared receivers installed around the display screen of the interactive tablet, or on the top, bottom or left and right sides. The touch operation on the display screen is recognized by the infrared transmitter and the infrared receiver, and the corresponding infrared touch data is obtained and sent to the processor of the interactive tablet. The interactive tablet performs corresponding operations according to the infrared touch data, such as displaying a corresponding writing track on the display screen of the interactive tablet according to the movement track of the touch object.

During the use of the interactive tablet, the response to the touch operation is basically only based on the specific input judgment of the touch track, such as track input based on the touch track or simple command reception. When the input effect of the touch track needs to be changed or the implementation is more complicated When the control command is used, the target control needs to be realized according to the combination of multiple touch inputs. For example, for the writing process, when setting the display attribute of the writing track or switching the operation mode of writing and erasing, it requires more complicated Only the touch operation combination can achieve the setting target, the operation is more complicated and the efficiency is low.

SUMMARY OF THE INVENTION

The present disclosure provides a touch data processing method and an interactive tablet, so as to solve the technical problems in the prior art that the interactive tablet requires a relatively complex touch operation combination to achieve the setting target, the operation is cumbersome and the efficiency is low.

In a first aspect, the present disclosure provides a touch data processing method applied to an interactive tablet, the interactive tablet includes a display screen, a processing device and an infrared touch frame, the interactive tablet further includes an elastic wave detection device, the method include:

The infrared touch frame detects infrared touch data, and the infrared touch data is generated when a touch object performs a touch operation in the touch detection area of the interactive tablet; the infrared touch data includes touch position information and/or touch parameters information;

The processing device receives the infrared touch data sent by the infrared touch frame;

The elastic wave detection device receives the infrared touch data, wherein the infrared touch data is sent to the elastic wave detection device by the infrared touch frame or the processing device;

The elastic wave detection device detects an elastic wave signal; the elastic wave signal is generated when the touch object contacts the display screen of the interactive tablet;

The elastic wave detection device determines the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal;

The elastic wave detection apparatus sends medium type information to the processing device, where the medium type information includes a medium type corresponding to the touch object.

The present disclosure uses the infrared touch frame to detect the infrared touch data generated when the touch object touches the touch detection area of the interactive tablet, and uses the elastic wave detection device to detect the elastic wave signal generated when the touch object touches the display screen. The location information and/or touch parameter information, and the elastic wave signal determine the medium type. By combining the infrared touch data and the elastic wave signal to determine the medium type, the recognition accuracy of the touch object is improved, and the medium type of the medium type of the touch object is included. The information is sent to the processing device, so that the processing device can perform different response operations according to different media types of the touch object, and the operation is simple and the efficiency is high.

In a second aspect, the present disclosure provides a touch data processing method applied to an interactive tablet, the interactive tablet includes a display screen, a processing device and an infrared touch frame, the interactive tablet further includes an elastic wave detection device, the method include:

The elastic wave detection device sends medium type information to the processing device, where the medium type information includes a medium type corresponding to the touch object;

After receiving the medium type information, the processing device starts a response to the received infrared touch data according to the medium type.

The present disclosure uses the infrared touch frame to detect the infrared touch data generated when the touch object touches the touch detection area of the interactive tablet, and uses the elastic wave detection device to detect the elastic wave signal generated when the touch object touches the display screen. The location information and/or touch parameter information, and the elastic wave signal determine the medium type. By combining the infrared touch data and the elastic wave signal to determine the medium type, the recognition accuracy of the touch object is improved, and the medium type of the medium type of the touch object is included. The information is sent to the processing device, so that the processing device can initiate a response to the received infrared touch data according to the medium type, so that the processing device can perform different response operations according to different media types of the touched object, with simple operation and high efficiency. Moreover, the processing device starts to process and respond to the received infrared touch data after receiving the medium type, ignores the infrared touch data generated before the touch object touches the display screen, and only processes the infrared touch data generated after the touch object touches the display screen. The timing of processing and responding to infrared touch data is consistent with the position and timing of the touch object touching the display screen, and the user's touch operation gets more accurate feedback. For example, when the user uses the touch object to write on the display screen, the writing The position and timing of the track are consistent with the position and timing of the touch object touching the display screen to achieve zero height of writing.

In a third aspect, the present disclosure provides a touch data processing method, applied to an interactive tablet, the interactive tablet includes a display screen, a processing device and an infrared touch frame, the interactive tablet further includes an elastic wave detection device, the method include:

The processing device responds to the received infrared touch data before receiving the medium type information;

After receiving the medium type information, the processing device starts a response to the received infrared touch data.

The present disclosure uses the infrared touch frame to detect the infrared touch data generated when the touch object touches the touch detection area of the interactive tablet, and uses the elastic wave detection device to detect the elastic wave signal generated when the touch object touches the display screen. The location information and/or touch parameter information, and the elastic wave signal determine the medium type. By combining the infrared touch data and the elastic wave signal to determine the medium type, the recognition accuracy of the touch object is improved, and the medium type of the medium type of the touch object is included. The information is sent to the processing device, so that the processing device can initiate a response to the received infrared touch data according to the medium type, so that the processing device can perform different response operations according to different media types of the touched object, with simple operation and high efficiency. Moreover, before receiving the medium type sent by the elastic wave detection device, the processing device directly responds to the received infrared touch data, so as to ensure the normal response to the infrared touch data. When the communication between the elastic wave detection devices is abnormal, it cannot be Error correction processing of normal response infrared touch data. The processing device starts to process and respond to the received infrared touch data after receiving the medium type, ignores the infrared touch data generated before the touch object touches the display screen, and only processes the infrared touch data generated after the touch object touches the display screen. The timing of infrared touch data processing and response is consistent with the position and timing of the touch object touching the display screen, and the user's touch operation gets more accurate feedback.

In a fourth aspect, the present disclosure provides an interactive tablet, including a display screen, a processing device, an infrared touch frame, and an elastic wave detection device, wherein the display screen, the infrared touch frame, and the elastic wave detection device are all related to the connection of the processing equipment;

The infrared touch frame is used to detect infrared touch data and send the infrared touch data to the processing device, wherein the infrared touch data is performed by a touch object in the touch detection area of the interactive tablet when a touch operation is performed generating, the infrared touch data includes touch position information and/or touch parameter information;

the elastic wave detection device for detecting elastic wave signals, wherein the elastic wave signals are generated when the touch object contacts the display screen of the interactive tablet; and

After receiving the infrared touch data sent by the processing device, determine the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal, and sending media type information to the processing device, where the media type information includes a media type corresponding to the touch object;

The processing equipment is used for:

receiving the infrared touch data sent by the infrared touch frame, and sending the infrared touch data to the elastic wave detection device; and

The medium type information sent by the elastic wave detection device is received.

The present disclosure uses the infrared touch frame to detect the infrared touch data generated when the touch object touches the touch detection area of the interactive tablet. The infrared touch frame sends the infrared touch data to the elastic wave detection device through the processing device, and the elastic wave detection device detects that the touch object touches the display screen. After receiving the infrared touch data sent by the processing device, the elastic wave detection device determines the medium type according to the touch position information and/or touch parameter information in the infrared touch data and the elastic wave signal, and combines the infrared The touch data and the elastic wave signal determine the medium type, which improves the recognition accuracy of the touch object, and sends the medium type information of the medium type containing the touch object to the processing device, so that the processing device can perform different operations according to different media types of the touch object. The response operation is simple and efficient.

In a fifth aspect, the present disclosure provides an interactive tablet, including a display screen, a processing device, an infrared touch frame, and an elastic wave detection device, wherein the display screen, the infrared touch frame, and the elastic wave detection device are all related to the the processing device is connected, and the infrared touch frame is connected to the elastic wave detection device;

The infrared touch frame is used to detect infrared touch data, send the infrared touch data to the elastic wave detection device, and send the infrared touch data to the processing device, wherein the infrared touch data is generated by the touch object Generated when a touch operation is performed in the touch detection area of the interactive tablet, and the infrared touch data includes touch position information and/or touch parameter information;

the elastic wave detection device for detecting elastic wave signals, the elastic wave signals are generated when the touch object contacts the display screen of the interactive tablet; and

After receiving the infrared touch data sent by the infrared touch frame, determine the media type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal , and send media type information to the processing device, where the media type information includes the media type corresponding to the touch object;

The processing equipment is used for:

receiving the infrared touch data sent by the infrared touch frame; and

The present disclosure uses the infrared touch frame to detect the infrared touch data generated when the touch object touches the touch detection area of the interactive tablet, the infrared touch frame directly sends the infrared touch data to the elastic wave detection device, and the elastic wave detection device detects that the touch object touches the display screen and generates the infrared touch data. After receiving the infrared touch data sent by the infrared touch frame, the elastic wave detection device determines the medium type according to the touch position information and/or touch parameter information in the infrared touch data and the elastic wave signal, and combines the infrared touch data with the elastic wave signal. The data and the elastic wave signal determine the medium type, which improves the recognition accuracy of the touching object, and sends the medium type information of the medium type containing the touching object to the processing device, so that the processing device can perform different processing according to different media types of the touching object. Responsive operation, simple operation and high efficiency.

Description of drawings

FIG. 1 is a schematic structural diagram of an interactive tablet provided by the present disclosure;

FIG. 2 is a flowchart of a touch data processing method provided by the present disclosure;

3 is a schematic diagram of a detection principle of an infrared touch frame provided by the present disclosure;

4 is a schematic diagram of the hardware structure of an interactive tablet provided by the present disclosure;

FIG. 5 is a logic diagram of a touch data processing provided by the present disclosure;

FIG. 6 is another logic diagram of touch data processing provided by the present disclosure;

FIG. 7 is an operation schematic diagram of a touch operation provided by the present disclosure;

8 is a schematic diagram showing a writing track provided by the present disclosure;

FIG. 9 is a flowchart of another touch data processing method provided by the present disclosure;

10 is a structural block diagram of an interactive tablet provided by the present disclosure;

FIG. 11 is a structural block diagram of an interactive tablet provided by the present disclosure.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present disclosure more clear, the specific embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present disclosure, but not to limit the present disclosure. For convenience of description, the accompanying drawings show only some but not all contents related to the present disclosure. Before discussing the exemplary embodiments in greater detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts various operations (or steps) as a sequential process, many of the operations may be performed in parallel, concurrently, or concurrently. Additionally, the order of operations can be rearranged. The process may be terminated when its operation is complete, but may also have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, subroutines, and the like.

It should be noted that in this disclosure, relational terms such as first and second are only used to distinguish one entity or operation or object from another entity or operation or object, and do not necessarily require or imply these Entities or operations or objects precede any such actual relationship or order. For example, "first" and "second" for a first media type and a second media type are used to distinguish two different media types, such as the tip and tail of a writing pen. For those of ordinary skill in the art, the specific meanings of the above terms in the present disclosure can be understood according to specific situations. Also, in the description of the present disclosure, unless stated otherwise, "plurality" means two or more. "And/or", which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are an "or" relationship.

For ease of understanding, the embodiment takes the interactive tablet as the actual carrier, and exemplarily describes the detailed process of detecting the touch operation, judging the touch operation, and displaying the response of the touch operation when the touch data processing method is implemented. For the interactive tablet, it can be an integrated device that controls the content displayed on the display panel and realizes human-computer interaction through touch technology. one or more functions.

FIG. 1 is a schematic structural diagram of an interactive tablet provided by the present disclosure. As shown in FIG. 1 , the interactive tablet 100 includes at least one display screen 500 . In addition, the interactive tablet 100 further includes a processing device 200 , an infrared touch frame 300 and an elastic In the wave detection device 400 , the infrared touch frame 300 is disposed around the interactive tablet 100 to form a touch detection area of the interactive tablet 100 . The touch detection area is an area for detecting a touch operation that occurs on the interactive tablet 100 , and is an area in a physical sense. If the frame of the interactive tablet 100 is relatively narrow and the display screen 500 is close to the frame of the interactive tablet 100, the infrared touch frame 300 can be regarded as being arranged around the display screen 500. In specific applications, it can be set according to the actual area to be detected. The position of the infrared touch frame 300 may be set only around the display screen 500 , or may be set around the entire interactive tablet 100 . The infrared touch frame 300 can detect the infrared touch data generated by the touch operation of the touch object at any position on the touch detection area. The infrared touch frame 300 and the elastic wave detection device 400 are connected to the processing device 200 through a serial port connection. In 1, when the processing device 200 has only one serial port and needs to be connected to the infrared touch frame 300 and the elastic wave detection device 400 at the same time, a port transceiver (HUB) is set to expand the connection port, so as to realize the connection with the infrared touch frame 300 and the elastic wave detection device 400. communication connection. The infrared touch frame 300 and the elastic wave detection device 400 can also be connected through a serial port to directly perform data exchange.

The user can use a finger or a writing pen and other similar objects as a touch object, and the touch object can click or move on the display screen of the interactive tablet to realize a touch operation. Correspondingly, the infrared touch frame 300 detects that the touch object is touching. The touch operation in the detection area generates corresponding infrared touch data and sends it to the interactive tablet. After the interactive tablet receives the infrared touch data, it responds according to the touch position represented by the infrared touch data to realize the touch function. For example, if there is a control at the touch position represented by the infrared touch data, the interactive tablet responds to the control, or the touch position represented by the infrared touch data is a track, and the interactive tablet generates a corresponding writing track according to the infrared touch data. Here, controls refer to elements of the graphical interface of application software or operating systems, such as page-turning controls, minimize controls, etc. By touching the controls, the application software or operating system of the interactive tablet can perform predefined functions, such as After clicking the page turning control, the application software of the interactive tablet will perform page turning processing accordingly. Typically, the interactive tablet is installed with at least one operating system, wherein the operating system includes, but is not limited to, an Android system, a Linux system, and a Windows system. As an embodiment, the interactive tablet can be installed with at least one application program with a writing function. The application program may be an application program that comes with the operating system, and at the same time, an application program downloaded from a third-party device or server is also installed. Optionally, in addition to the writing function based on touch operation, the application program also has other editing functions, such as inserting a table, inserting a picture, illustrating a graph, drawing a table, drawing a graph, and the like.

The graphic interface displayed on the display screen of the interactive tablet corresponds to the projected area of the touch detection area for detecting user operations on the display screen (ie, the touch detection area is in front of the graphic interface). When a touch operation is performed in the touch detection area, such as touching the display screen of the interactive tablet with a writing pen or a finger, the infrared touch frame of the display screen can sense the change of infrared light, and obtain a touch signal containing the coordinates of the touch position and the touch signal. The trigger time of the signal, according to the coordinates of the touch position and the trigger time of the touch signal, can obtain the infrared touch data that reflects the writing track input from the writing pen or the user's finger each time it falls into the writing process to the lifting stop writing process. According to the infrared touch data The writing track input by the user is displayed in real time on the graphical interface of the display screen. Of course, the writing process is not limited to writing, and any input process implemented on the display screen of the interactive tablet for displaying the operation track can be regarded as a writing process. In addition, according to the different display elements at the location where the touch operation occurs, the touch operation may respond to operations such as clicking, dragging, and the like by the user. The underlying coordinate processing methods of these different response methods are the same, which will eventually lead to the change of the picture displayed on the display screen visually. Based on the hardware implementation of basic functions such as touch and display, various interactive display designs of the interactive tablet can be realized.

The graphic interface presented during the use of the whiteboard application, that is, the touch operation performed in the interface of the whiteboard application is used as an example for description. As mentioned above, a whiteboard application refers to an application for users to perform operations such as writing and displaying. It can be used to generate handwriting according to the user's writing operation (touch operation) on the interface of the whiteboard application, and can also be used in the interface of the whiteboard application. Insert and display multimedia elements, which may include graphics, images, tables, documents, audio files, and/or video files. In the interface of the whiteboard application, users can implement operations such as writing, drawing, and erasing similar to the physical blackboard, and further have better digital functions such as moving, saving, zooming, inserting pictures, color adjustment, and stroke thickness setting. In practical application, the whiteboard application can also be named as writing application, electronic whiteboard application, collaborative whiteboard application, etc. No matter how the name is changed, as long as the application used to realize the above functions is equivalent to the whiteboard application of the present disclosure.

As an embodiment, the elastic wave detection device provided in this solution can be arranged on the display screen, and is used to detect the elastic wave signal generated when the touch object touches the display screen of the interactive tablet. For example, the elastic wave detection device includes an elastic wave collection plate and at least one elastic wave sensor, and a piezoelectric elastic wave sensor is installed at the frame of the display screen or inside the cover plate. The characteristic elastic wave signal, the elastic wave signal starts from the contact point and propagates around the display screen, or propagates to the inside of the display screen. The piezoelectric elastic wave sensor located at the frame of the display screen or inside the cover can convert the elastic wave signal into a voltage signal, and send the voltage signal to the elastic wave acquisition board, and transmit the voltage signal to the elastic wave acquisition board with temperature compensation. Amplification is performed in the IC chip of the circuit, and is converted into a digital elastic wave signal through an analog-to-digital conversion circuit. It should be noted that this solution does not specifically limit the location of the elastic wave detection device, as long as the elastic wave signal generated by the touch object touching the display screen of the interactive tablet can be detected.

For the mechanical vibration below the audio frequency, the sound in the audio frequency range, and the ultrasonic wave beyond the audio frequency, these are all wave phenomena of gas, liquid, solid and other media. Compared with light and electromagnetic waves, this wave phenomenon is called elastic wave. For the detection of elastic wave signals, the elastic wave sensor is used to complete the elastic wave sensor. The elastic wave sensor is specifically installed in the position where the vibration of the display screen can be transmitted, so as to realize the event that the touch object on the display screen touches the display screen, without necessarily being installed. where the vibration occurs. For example, elastic wave sensors can be arranged at the four corners of the display screen, of course, other arrangements are also possible, such as setting at the midpoint of each side of the rectangular frame of the display screen, and the number can also be other numbers, such as 2, 5 As long as the elastic wave sensor can detect the vibration of the touch object in contact with the display screen during the touch operation, the number of specific arrangements can be set according to the size and detection accuracy of the display screen. Generally speaking, the size of the display screen The larger the detection accuracy, the higher the number of elastic wave sensor settings. The elastic wave sensor can be directly installed on the surface of the display screen, for example, directly installed on the upper surface of the display screen or the lower surface of the display screen, so as to receive the vibration transmitted by the display screen and improve the accuracy of touch detection. The elastic wave sensor can also be installed within the frame of the display screen, reducing the impact on the internal mechanism and reducing the common mode noise interference from the display screen. Of course, the elastic wave sensor can also be installed on other components in contact with the display screen, and receive vibrations that occur on the display screen through the transmission of other components.

As far as the source of elastic waves is concerned, it includes various noise-generating components (such as motors, speakers, fans, etc.) During the process, the interactive tablet will generate elastic waves that are not intended by the user to control. Through the category of the component, you can confirm the way that the component generates noise. For example, the noise generated by the speaker mainly comes from the elastic wave generated in the overall medium of the interactive flat panel when it emits sound. For the elastic wave sensor, it can be detected at any time. to various elastic wave signals, but many of them are not from the touch operation itself.

FIG. 2 is a flowchart of a touch data processing method provided by the present disclosure. The touch data processing method provided by the present disclosure is applied to an interactive tablet. The interactive tablet may be composed of two or more physical entities, or one Physical entity composition. For example, the interactive tablet can be a conference tablet, a teaching tablet, an industrial control computer, etc., for realizing content display and interactive response in the process of human-computer interaction.

Referring to FIG. 2 , the touch data processing method provided by the present disclosure includes:

S101: The infrared touch frame detects infrared touch data, and the infrared touch data is generated when a touch object performs a touch operation in a touch detection area of the interactive tablet.

Exemplarily, in order to realize the touch function of the display screen, an infrared touch frame is arranged around the surface of the display screen. When the touch object touches the display screen, the infrared touch frame scans the touch object through optical signals to detect that the touch object is on the display screen. Infrared touch data generated when a touch operation is performed. Specifically, the infrared touch frame includes an infrared transmitter and an infrared receiver, the infrared transmitter is used for emitting infrared light, and the infrared receiver is used for receiving infrared light, and a beam grid is formed by densely distributed infrared light in different directions to locate the touch point. Exemplarily, M infrared transmitters are arranged on one side of the horizontal direction of the display screen, and N infrared emitters are arranged on one side of the vertical direction. Correspondingly, M infrared receivers are arranged on the other side in the horizontal direction, and N infrared receivers are arranged on the other side in the vertical direction. An infrared receiver, the infrared transmitter emits infrared light at a certain frequency, and the corresponding infrared receiver receives infrared light at a certain frequency. When the touch object touches the display screen, the touch object will completely or partially block one or more vertical and horizontal infrared lights, and then an M*N infrared light intensity pixel map is obtained. First, find a position on the infrared light intensity pixel map that is greater than the first light intensity threshold. The first light intensity threshold represents a real and effective touch, rather than noise or when the object is close to but not completely touched, it is measured when the infrared light is partially blocked. The actual touch position is the touch position when the touch object is in contact with the display screen. Further, find the position in the vicinity of the real touch position that is greater than the second light intensity threshold, and the second light intensity threshold is greater than the noise value, which can represent the extension of the real touch area, and the adjacent area of the real touch position is greater than The position of the second light intensity threshold is marked as an effective touch area, and the area of the touch area is the contact position of the touch object and the display screen. When the touch object moves on the display screen, the continuous infrared light intensity pixel map of multiple frames records the contact position and contact area of the touch object on the display screen, and the touch object can be obtained from the contact position and contact area recorded in consecutive frames Movement speed on the display. When the touch object leaves the display screen, the occlusion of the touch object to infrared light becomes smaller. If the contact position in the previous frame of infrared light intensity pixel map, the relative position in the current infrared light intensity pixel map and the adjacent area do not exceed For pixels with a third light intensity threshold, it is determined that the relationship between the touch object and the display screen at this time is out of touch, and the third light intensity threshold represents the maximum light intensity when out of touch. Understandably, when the user touches the display screen through a touch object, the infrared light transmission path between the infrared transmitter and the infrared receiver installed on the display screen will be blocked by the touch object, and the infrared touch frame will output a corresponding infrared blocked signal. , the contact area between the touch object and the display screen, the moving speed of the touch object on the display screen and the touch position when the touch object is in contact with the display screen can be measured according to the infrared blocked signal, and the corresponding infrared touch data can be obtained. Wherein, the infrared touch data includes touch state information (including DOWN state, MOVE state and UP state), touch position information and/or touch parameter information. It should be noted that, in the process of calculating the touch position information and touch parameter information according to the collected data, each collected data will have a flag bit, which can be combined with the flag bit to obtain the touch state information. Generally, when the infrared touch frame determines that valid collection data has been collected, the flag bit is 01. When it is determined that valid collection data has not been received, the flag bit is 00. When the flag bit changes from the original 00 to 01, it can be determined that the touch The state is DOWN state; the flag bit changes from the original 01 to 00, the touch state can be determined to be the UP state; the flag bit remains 01, the touch state can be determined to be the MOVE state. Finally, infrared touch data is generated based on the touch state information, the touch position information and the touch parameter information.

Figure 3 shows a schematic diagram of the detection principle of an infrared touch frame. It needs to be explained that there has always been a long-term technical problem in the industry to realize the touch function of the interactive tablet through the infrared touch sensor, that is, zero writing Highly technical issue. The so-called zero writing height means that when a touch object (such as a hand or a writing pen) writes on the display screen, the writing track is generated when the touch object touches the surface of the display screen, and the touch object is in contact with the surface of the display screen when the writing produces handwriting. The spacing is zero. In order to better understand the zero writing height, with reference to FIG. 3 for further explanation, the infrared touch frame 300 transmits or receives light signals in a certain height range, thereby forming a touch detection area in the vertical direction relative to the display screen 500 , Its height is H. During the process of falling and lifting the touch object, there may be a situation where the touch object is located in the touch detection area, but does not touch the surface of the display screen 500, and the infrared touch data will still be detected at this time. .

In a touch operation, the touch object will go through states 131-137 in FIG. 3 , in which the state 131 , state 132 to state 133 describe the process of the touch object from starting the touch operation to starting to contact the display screen 500 . From state 131 to state 132, when the touch object just enters the touch detection area, the infrared touch frame detects the first frame of touch data, and the touch state of the touch object at this time is the touch drop state. In state 131, the touch object is in touch. Above the control detection area, no infrared touch data will be generated. In state 132, if the touch object is in the touch detection area, but does not touch the surface of the display screen 500, infrared touch data will be generated (generated during this process). The first frame of infrared touch data is the first frame of touch data). In state 133, the touch object is in the touch detection area and has touched the display screen 500, and infrared touch data will be generated.

From state 133, state 134 to state 135, describe the process that the touch object touches the display screen 500 and moves on the display screen 500. During this process, the touch state of the touch object is always the touch movement state. In the touch movement state, the touch The object continues to touch the display screen 500, and at the same time, infrared touch data is generated.

From state 135, state 136 to state 137, describe the process of the touch object being lifted from the display screen 500 to leaving the touch detection area. From state 136 to state 137, when the touch object just leaves the touch detection area, the infrared touch frame detects To the last frame of touch data, and the touch state of the touch object is the touch up state at this time, in state 136, the touch object is in the touch detection area and does not touch the display screen 500, and infrared touch data will be generated. In state 137, the touch object is above the touch detection area, and no infrared touch data is generated. It can be understood that, in one touch operation, the infrared touch data generated during the process from state 132 to state 136 is continuous infrared touch data. The infrared touch data between the first frame of touch data and the last frame of touch data is intermediate touch data.

When the touch object performs a touch operation in the touch detection area of the interactive tablet, the infrared touch frame will generate an infrared sensing signal, so that the calculation is performed according to the infrared sensing signal, and after correspondingly generating infrared touch data, the infrared touch data is sent to the processing equipment. Here, the infrared touch data generated by the infrared touch frame is continuous data, which is embodied as data including multiple frames.

As an embodiment, the infrared touch data provided by the present disclosure includes touch state information, touch position information, and touch parameter information. It can be understood that the touch state information is used to represent the touch state of the corresponding touch object in the current touch operation, and the touch state includes a touch down state (DOWN), a touch move state (MOVE), and a touch up state (UP). The touch position information is used to reflect the touch position of the touch object on the display screen, which can be represented by the XY coordinate points on the display screen, and the touch parameter information at least reflects the touch area of the touch point when the touch object touches the display screen, which is It can be represented by the width and height corresponding to the touch area, or by the radius or diameter corresponding to the touch area. The data format of the infrared touch data can be determined according to the communication method between the infrared touch frame and the processing device and/or the elastic wave detection device. The data format of the data is shown in Table 1:

Table 1

字节号 byte number		作用effect
00	报文IDmessage ID
11	点IDpoint ID
22	点状态point status
33	点的X坐标低字节数据Point's X coordinate low byte data
44	点的X坐标高字节数据Point's X coordinate high byte data
55	点的Y坐标低字节数据Point's Y coordinate low byte data
66	点的Y坐标高字节数据Point's Y coordinate high byte data
77	触摸面积W低字节数据Touch area W low byte data
88	触摸面积W高字节数据Touch area W high byte data
99	触摸面积H低字节数据Touch area H low byte data
1010	触摸面积H高字节数据Touch area H high byte data
......	......

In the above table, the point state represents the touch state in the infrared touch data. In addition, the infrared touch data generated in one touch operation includes the first frame of touch data, the middle touch data and the last frame of touch data. The touch state information in the first frame of touch data indicates that the touch state of the touch object is the touch falling state, and the middle touch data The touch state information in the touch data indicates that the touch state of the touch object is a touch moving state, and the touch state information in the touch data of the last frame indicates that the touch state of the touch object is a touch lift state.

S102: The processing device receives the infrared touch data sent by the infrared touch frame.

In this embodiment of the present invention, in order to further solve the problem of zero writing height, when the processing device receives the infrared touch data sent by the infrared touch frame, it needs to determine when to respond to the received infrared touch data. The so-called response, in this embodiment of the present invention, refers to whether the processing device processes the infrared touch data as valid data. In the embodiment of the present invention, in order to solve the problem of zero writing height, the processing device needs to process the continuously received infrared touch data as valid data, and a precondition is required, that is: the processing device confirms the touch object that triggers the infrared touch data, and The display screen of the interactive tablet is in contact. How the processing device confirms that the touch object that triggers the infrared touch data is in contact with the display screen of the interactive tablet is also a technical problem to be solved in this embodiment.

Specifically, in the embodiment of the present invention, an elastic wave detection device is set in the interactive tablet, the vibration signal (ie elastic wave signal) generated on the display screen of the interactive tablet is detected by the elastic wave detection device, and the elastic wave detection device is installed The communication hardware and communication protocol with the processing device of the interactive tablet enable the elastic wave detection device to send the information confirming that the touch object that triggers the infrared touch data is in contact with the display screen of the interactive tablet to the processing device, helping the processing device to obtain the judgment ability .

As an embodiment, when the processing device receives the infrared touch data sent by the infrared touch frame, but does not receive the information sent by the elastic wave detection device confirming that the touch object that triggers the infrared touch data is in contact with the display screen of the interactive tablet, the processing The device may not respond to received infrared touch data.

Specifically, in a touch operation, when the touch object is approaching but not touching the display screen, during this process, the infrared transmitter and infrared receiver at the corresponding position detect the blocking of infrared rays by the touch object, and the infrared touch frame starts Infrared touch data is detected, but no elastic wave signal is detected by the elastic wave detection device. Since the touch object does not touch the display screen at this time, the infrared touch data generated in this process does not need to be processed, the infrared touch data can be discarded, and the corresponding writing track does not need to be displayed on the display screen.

S103: The elastic wave detection apparatus receives infrared touch data, wherein the infrared touch data is sent to the elastic wave detection apparatus by the infrared touch frame or the processing device.

In this embodiment of the present invention, in order to diversify the response of the interactive tablet to the user's touch operation, different media types based on the touch objects can be designed to implement responses or implementations corresponding to the media types. In order to achieve this goal, first of all, the processor of the interactive tablet must accurately identify the media type of the touch object. Accurately identifying the media type of the touch object is also a long-standing technical problem in the industry, and various algorithms have been generated to solve this problem. However, the algorithm for accurately identifying the medium type of the touch object has a great relationship with the environment and application scenario where the touch object is located. In the embodiment of the present invention, combined with the special use scene of the interactive tablet and the infrared touch data recognition capability of the interactive tablet, a more accurate method for identifying the medium type of the touch object is creatively proposed, that is, introducing infrared touch data . Different from the prior art, firstly, the embodiment of the present invention realizes the identification of the touch object medium through the elastic wave detection device; secondly, the embodiment of the present invention enables the elastic wave detection device to obtain infrared touch data. Therefore, the elastic wave detection device can identify the medium type of the touched object in combination with the obtained infrared touch data, thereby improving the identification accuracy.

Specifically, the embodiment of the present invention designs a new communication hardware circuit and communication protocol between the infrared touch frame and the elastic wave detection device, so that when the infrared touch frame detects infrared touch data, it can send infrared touch data to the elastic wave detection device, thereby In a subsequent step, the elastic wave detection device may identify the medium type of the touched object by combining the touch position information and/or touch parameter information in the infrared touch data.

Optionally, the processing device may also send infrared touch data to the elastic wave detection device.

Specifically, when the infrared touch frame is communicatively connected to the elastic wave detection device, the infrared touch frame directly sends the data to the elastic wave detection device, that is, when the infrared touch frame receives continuous infrared touch data, it directly sends the number of infrared touches to the elastic wave detection device. Wave detection device, while sending continuous infrared touch data to the processing device. When the infrared touch frame is not in communication connection with the elastic wave detection device, when the infrared touch frame detects continuous infrared touch data, it sends continuous infrared touch data to the processing device, and the processing device sends the infrared touch data to the elastic wave detection device.

In a possible embodiment, the elastic wave detection apparatus provided by the present disclosure receives infrared touch data, wherein the infrared touch data is sent to the elastic wave detection apparatus by an infrared touch frame or a processing device; specifically:

The elastic wave detection device receives the first frame of touch data of the infrared touch data, wherein the first frame of touch data of the infrared touch data is sent to the elastic wave detection device by the infrared touch frame or the processing device; the touch state information in the first frame of touch data indicates the touch The touch state of the object is the touch drop state. The first frame of touch data reflects the touch position of the effective touch when the touch object initially enters the touch detection area.

In other embodiments, the infrared touch data received by the elastic wave detection device may also be the first frame or the second frame of touch data in which the touch state information indicates that the touch state of the touch object is the touch movement state. It can be understood that the touch data of the first frame or the second frame of the touch moving state is closer to the touch position when the touch object first enters the touch detection area. The second frame of touch data can also accurately determine and correct the medium type of the touch object.

S104: The elastic wave detection device detects an elastic wave signal; the elastic wave signal is generated when the touch object contacts the display screen of the interactive tablet.

When the touch object touches the display screen of the interactive tablet, a characteristic elastic wave signal will be generated. The elastic wave signal starts from the contact point between the touch object and the display screen and propagates around the display screen, or propagates to the inside of the display screen. Therefore, the elastic wave detection device will detect the elastic wave signal. After detecting the elastic wave signal, the elastic wave detection device buffers the elastic wave signal.

S105: The elastic wave detection device determines the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal.

As mentioned above, in order to diversify the response of the interactive tablet to the user's touch operation, in this embodiment of the present disclosure, the response of the interactive tablet to the user's touch operation is associated with the medium type of the touch object used by the user, so , it is necessary to accurately identify the medium type of the touch object. How to accurately identify the medium type of the touching object based on the elastic wave signal is a long-standing technical problem in the industry. Type recognition accuracy. However, in the application scenario of the interactive tablet, various interference sources may exist, resulting in a relatively large noise signal in the elastic wave signal detected by the elastic wave detection device. Only by improving the recognition algorithm, although the recognition accuracy can be improved to a certain extent, this method still directly uses the elastic wave signal to identify the medium type of the touched object. When the noise signal has a great influence on the elastic wave signal, the high The accurate identification algorithm may also cause errors in the identified medium type, which affects the response effect of the interactive panel. For example, in the process of playing audio and video, the interactive tablet specifically converts the audio signal into an acoustic signal through the speaker. Specifically, the speaker makes its paper cone or diaphragm vibrate and resonate with the surrounding air through electromagnetic, piezoelectric or electrostatic effects. (resonance) to produce sound, that is to say, in the process of sounding by the speaker, a vibration signal will also be generated, and the elastic wave detection device will also collect the vibration signal. Therefore, when the interactive tablet is playing audio and video, if the user uses a touch object to perform a touch operation on the display screen of the interactive tablet, the elastic wave signal detected by the elastic wave detection device will be the actual elastic wave of the touch operation of the touch object. A superimposed signal of the signal and the vibration signal caused by the audio playback. At this time, the elastic wave signal detected by the elastic wave detection device has a relatively large noise signal, and the existing solution only recognizes the medium type of the touched object based on the elastic wave signal, which makes it difficult to accurately recognize even the high-precision recognition algorithm. The media type of the touch object. Therefore, the present invention proposes a method for identifying the medium type of the touch object with higher accuracy in combination with the specific usage scenario of the interactive tablet, adding infrared touch data as a parameter for identifying the medium type of the touching object, and by adding the infrared touch data of the interactive tablet The infrared touch data generated by the frame is sent to the elastic wave detection device in a direct or indirect way. The elastic wave detection device combines the infrared touch data to identify the medium type of the touched object, which can reduce the influence of noise signals on the recognition result and improve the impact of the touch object. The recognition accuracy of the media type.

Specifically, the elastic wave detection device does not combine all infrared touch data generated by the infrared touch frame to identify the medium type of the object to be touched. After the elastic wave detection device receives the first frame of touch data of the infrared touch data, and elastic wave signals, determine the media type corresponding to the touch object, and send the media type information of the touch object to the processing device; wherein, the first frame of touch data of the infrared touch data is sent by the infrared touch frame or the processing device to the elastic wave detection device . When the touch object performs a touch operation in the touch detection area of the interactive tablet, the infrared touch frame first detects that the infrared rays are blocked, and then performs the corresponding conversion calculation, and calculates the specific touch position information, touch area and other touches according to the blocked situation. Parameter information. In this process, the elastic wave detection device detects the elastic wave signal, but may not receive the infrared touch data sent by the infrared touch frame. Therefore, it needs to wait for the infrared touch data to be received, and then combine the infrared touch data and the elastic wave signal. Determine the media type of the touch object.

In the present disclosure, steps S101, S102, S103, and S104 are not in a definite sequence. Here, steps are numbered only for convenience of description. In the actual execution process, S101 and S102 may be sequential or synchronous. In the process of executing S104, in fact, since the touch object is still operating, S101 is also executed synchronously. Moreover, during the execution of step S105, S101 and S102 may also be executed synchronously.

After receiving the infrared touch data, the elastic wave detection device determines the medium type corresponding to the touched object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal. In one embodiment, the present disclosure determines the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the first frame of touch data in the infrared touch data, and the elastic wave signal. It can be understood that the first frame of touch data reflects the initial touch position of the touch object for the touch operation. According to the first frame of touch data combined with the elastic wave signal, the interference of the non-touch position on the elastic wave signal can be eliminated, which can be more accurate. Determine the media type corresponding to the touch object.

Exemplarily, the touch position information is used to represent the position information of the touch point corresponding to the touch operation, which can be represented by X and Y coordinate values, and the touch parameter information includes information used to represent the area of the touch point corresponding to the touch operation, which can be It is represented by the width value and height value of the contact area or contact point. When the elastic wave detection device identifies the medium type corresponding to the touch object, it is specifically: after acquiring the first frame of touch data, firstly combine the information in the time domain and frequency domain of the elastic wave signal, including the information that exceeds the set signal-to-noise ratio threshold in the time domain The absolute value and relative value of the energy at the characteristic frequency point in the small-band time-frequency analysis can be obtained, and the starting point of the elastic wave signal can be judged accordingly. The method of judging the starting point may be a threshold method (determining whether the signal-to-noise ratio or signal quantity exceeds a preset threshold), or a zero-crossing rate (determining whether the signal is a non-random vibration signal).

Wherein, when the elastic wave detection device uses multiple elastic wave sensors to detect the elastic wave signal, the elastic wave detection device can determine or calculate the effective elasticity according to the touch position information and/or touch parameter information of the first frame of touch data, etc. wave signal (signal used for medium identification), so as to determine the starting point of the effective elastic wave signal. Specifically, the elastic wave sensor that is closest to the touch point can be determined according to the touch position information in the infrared touch data. Since the signal intensity it generates is the highest and the signal-to-noise ratio of the signal it generates is the largest, the elastic wave sensor generated by the elastic wave sensor has the highest signal-to-noise ratio. wave signal as an effective elastic wave signal. In addition, weighting processing can also be performed on the elastic wave signals of each elastic wave sensor according to the touch position information of the infrared touch data, and the result obtained by the weighting processing can be regarded as an effective elastic wave signal, and the corresponding weight of each elastic wave sensor can be a predetermined value. The set value can also be a function that is negatively related to the distance of the touch position, for example, the weight is the reciprocal of the distance or the square of the reciprocal, etc.

After the starting point is determined, the signal before the starting point is analyzed and obtained, and the signal before the starting point is used as the noise estimation value, and the signal after the starting point is identified accordingly, and the signal after the starting point is identified as the elastic wave material. identification signal. As an embodiment, signal processing is performed on the identification signal. The signal processing includes algorithms such as time-frequency conversion, windowing and smoothing, multi-channel fusion, noise reduction, etc., to obtain a fused elastic wave frequency domain signal, and the elastic wave frequency The domain signal is placed in the setting algorithm (including statistical learning, machine learning, deep learning and other model algorithms, or eigenvalue comparison algorithms) to obtain the ID of the material and its confidence interval, and report the material ID and confidence interval to the Handling equipment. Optionally, it can be determined whether the determined media type needs to be corrected according to the comparison between the confidence interval and the preset confidence threshold. For example, the ID of the material type is 01, the confidence interval is 85%, and the confidence threshold is set to 80. %, it means that the material 01 is the medium type corresponding to the touch object. On the contrary, if the confidence interval is 75%, the medium type needs to be corrected, and the correction can be performed by referring to various methods described later in the present disclosure.

As an alternative embodiment, after receiving the first frame or the second frame of touch data in which the touch state information indicates that the touch state of the touch object is the touch movement state (that is, the touch state information is MOVE), the elastic wave detection device also adopts the same The steps to carry out the material recognition of the touch object. Compared with the first frame of touch data using infrared touch data, the first frame of touch data or the second frame of touch data whose touch state is the touch movement state will increase the delay of one frame of data or two frames of data, but the relative Compared with the original solution that only determines the medium type of the touch object based on the elastic wave signal, the interference of the non-touch position on the elastic wave signal can also be excluded, and the medium type corresponding to the touch object can be determined more accurately.

After determining the medium type corresponding to the touch object, the elastic wave detection device reports the medium type to the processing device. Optionally, the elastic wave detection device may report the medium type to the processing device several times in a row (for example, four times) to ensure that the medium type is correctly transmitted to the processing device. After the medium type is successfully reported, the elastic wave detection device will not report other data until a new touch operation is detected before determining that the touch-up state of the touch object is received. The touch-up state of the touch object is also represented by the infrared touch data. The processing device or the infrared touch frame sends the frame data whose touch state is the touch-up state to the elastic wave detection device, and the elastic wave detection device is based on the touch state of the frame data. Determines the touch-up state of the received touch object.

In a possible embodiment, after detecting the elastic wave signal, the elastic wave detection device buffers the elastic wave signal until receiving the infrared touch data, and then according to the touch position information and/or touch parameter information of the infrared touch data, And the elastic wave signal to determine the medium type corresponding to the touch object.

Specifically, after detecting the elastic wave signal, the elastic wave detection device buffers the elastic wave signal and waits for the arrival of infrared touch data. When receiving the infrared touch data, the elastic wave detection device determines the medium type corresponding to the touched object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal, and sends the medium type to the processing device. Optionally, if the elastic wave detection device has not received the infrared touch data within the preset time threshold, all currently buffered elastic wave signals are cleared. In this way, the influence of the interference signal can be filtered out, the elastic wave detection device can avoid unnecessary processing steps, and the processing efficiency can be improved.

In a possible embodiment, when the elastic wave detection device detects the elastic wave signal, it waits for the arrival of the first frame of touch data, and before the first frame of touch data arrives, the elastic wave signal may be generated by an interference source. Based on this, the touch data processing method provided by the present disclosure further includes: the elastic wave detection device determines that the first frame of touch data is not received within a preset time threshold, and clears the buffered elastic wave signal.

Specifically, when the elastic wave detection device detects and buffers the elastic wave signal, it waits for the arrival of the first frame of touch data. If the elastic wave detection device receives the first frame of touch data within the preset time threshold, it will perform the steps of determining the media type corresponding to the touch object according to the first frame of touch data and the elastic wave signal, and sending the media type to the processing device. If the elastic wave detection device has not received the first frame of touch data within the preset time threshold, all the currently buffered elastic wave signals are cleared. In this way, the influence of the interference signal can be filtered out, the elastic wave detection device can avoid unnecessary processing steps, and the processing efficiency can be improved.

In the specific implementation of this solution, the feature identification model can be used to determine the medium type. Correspondingly, step S105 includes steps S1051 and S1052:

S1051: After receiving the infrared touch data, the elastic wave detection device reads touch position information and/or touch parameter information in the infrared touch data.

Specifically, the infrared touch data sent by the present disclosure to the elastic wave detection device is the first frame of touch data. Based on this, the elastic wave detection device reads the touch position information and/or touch data in the first frame of touch data after receiving the first frame of touch data. Parameter information.

S1052: Input the touch position information and the elastic wave signal into the trained feature recognition model to obtain the medium type corresponding to the touch object.

In one embodiment, the infrared touch data provided by the present disclosure includes touch state information, touch position information and touch parameter information, and the elastic wave detection device reads out the first frame of touch data after receiving the first frame of touch data in the infrared touch data. The touch position information in the data can be understood as the touch position of the touch object on the display screen.

As an embodiment, the elastic wave detection device inputs the touch position information and the elastic wave signal into the trained feature recognition model, and the feature recognition model analyzes and processes the touch position information and the elastic wave signal to determine the corresponding touch object media type. The feature recognition model can determine the touch position information and the medium type corresponding to the elastic wave signal by means of a neural network. For example, a feature recognition model can be built based on a neural network, and the training is performed based on elastic wave signals and touch position information as input and the corresponding medium type as output. Add touch position information and/or touch parameter information as features to the feature recognition model for training, which can be the most original input feature of the feature recognition model, or it can be an additional feature of a certain layer in the network of the feature recognition model , and the recognition results are directly output by the feature recognition model. In one embodiment, S1052 may also input the touch parameter information, touch position information and elastic wave signal into the trained feature recognition model to obtain the medium type corresponding to the touch object. Therefore, the touch parameter information is also used as a recognition parameter of the feature recognition model.

In one embodiment, there are multiple elastic wave signals, and the elastic wave detection device determines the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal, including:

After receiving the infrared touch data, the elastic wave detection device reads the touch position information in the infrared touch data;

Integrate multiple elastic wave signals to obtain preprocessed signals;

Input the touch position information and preprocessing signal into the trained feature recognition model to obtain the media type corresponding to the touch object.

An embodiment of the fusion process is: based on the preset position information of multiple elastic wave sensors, combined with the touch position information, calculate the distances S1, S2, . . . between the touch point represented by the touch position information and different elastic wave sensors. Sn (n is a natural number), and then based on the calculated distance, the elastic wave signals collected by multiple elastic wave sensors are fused to obtain a preprocessing result. For example, a possible implementation case is that after weighting the signal of each sensor by 1/(Sn)^2, the weighted result is used as the preprocessing result.

When the solution is specifically implemented, the feature database can also be used to determine the medium type. Correspondingly, step S105 may further include steps S1053-S1055:

S1053: After the elastic wave detection device performs feature extraction on the elastic wave signal, the infrared touch data is received.

S1054: Correct the extracted features according to the touch position information in the infrared touch data.

In one embodiment, the elastic wave detection device receives the first frame of touch data after performing feature extraction on the elastic wave signal; according to the touch position information and/or touch parameter information in the first frame of touch data, the extracted features are Correction.

S1055: Comparing the corrected feature with a preset feature database to obtain a medium type corresponding to the touch object.

A feature database is preset in the elastic wave detection device, and the feature database records the correspondence between preset features and preset medium types. The corresponding relationship between the preset feature and the preset medium type may be recorded in the form of a key-value pair.

Specifically, after detecting and buffering the elastic wave signal, the elastic wave detection device extracts the buffered elastic wave signal, and performs feature extraction on the elastic wave signal. After the feature extraction of the elastic wave signal, the first frame of touch data sent from the infrared touch frame or the processing device is received, and the touch position information and/or touch parameter information in the first frame of touch data is read out. According to the touch position information and/or touch parameter information to correct the extracted features. After the correction of the features is completed, the corrected features are matched and compared in the preset feature database, and when the preset features that are consistent or the similarity reaches the set similarity requirement are matched, the preset features correspond to the preset features. The preset media type is determined as the media type corresponding to the touch object.

In one embodiment, the elastic wave detection device needs to wait for the arrival of the first frame of touch data before correcting the extracted features. Correspondingly, step S1053 specifically includes: after the elastic wave detection device performs feature extraction on the elastic wave signal , determine that no infrared touch data is received, then wait to receive infrared touch data until infrared touch data is received.

Specifically, after the elastic wave detection device performs feature extraction on the elastic wave signal and determines that the first frame of touch data has not been received, it waits to receive the first frame of touch data until the first frame of touch data is received.

Specifically, after the elastic wave detection device performs feature extraction on the elastic wave signal, if the first frame of touch data has not yet been received, it does not directly compare the extracted features with the preset feature database, but waits to receive the first frame of touch data. data until the first frame of touch data is received. After the feature is corrected, it is compared with the preset feature database to ensure the correctness of the final determined medium type and reduce the influence of the interference source on the determination of the medium type.

As before, when the elastic wave detection device obtains the medium type of the touching object through the feature recognition model or the feature database, it also obtains the confidence interval corresponding to the medium type. Wherein, the medium types determined by the elastic wave detection device may be one or more types. When a medium type is uniquely determined according to the first frame of touch data and the elastic wave signal, and the confidence interval of the medium type is higher than the set confidence threshold, the medium type can be directly determined as the medium type corresponding to the touch object. When two or more media types are obtained, if there is a media type whose confidence interval is higher than the set confidence threshold, the media type is used as the media type corresponding to the touch object.

In a possible embodiment, in the step of obtaining the media type corresponding to the touch object, at least two media types are obtained, and the confidence interval corresponding to each media type is lower than the set confidence threshold. Based on this, the touch data processing method provided by the present disclosure further includes:

S1056: Determine one of at least two medium types as the medium type corresponding to the touch object according to the touch parameter information of the infrared touch data.

Step S1056 may be performed by the elastic wave detection device, or may be performed by a processing device. The process performed by the processing device is: the processing device receives the medium type information sent by the elastic wave detection device; the medium type information includes at least two kinds of media type; and then the processing device determines one of at least two medium types as the medium type corresponding to the touch object according to the touch parameter information of the infrared touch data.

The elastic wave detection device obtains two or more medium types through the feature identification model or feature database, and when the confidence interval corresponding to each medium type is lower than the set confidence threshold, these medium types are corrected, and one of them is determined. media type as the media type corresponding to the touch object.

In one embodiment, according to touch parameter information of the infrared touch data, one of at least two medium types is determined as the medium type corresponding to the touch object, which specifically includes:

Obtain touch parameter information in infrared touch data;

obtaining a preset threshold interval corresponding to at least two medium types; the preset threshold interval is used to characterize the numerical range of the touch parameter of the medium type;

determining the first preset threshold interval closest to the touch parameter information among the preset threshold intervals;

The medium type corresponding to the first preset threshold interval is used as the medium type corresponding to the touch object.

Specifically, the present disclosure modifies the medium type according to touch parameter information (eg, touch area) in the infrared touch data, and determines the medium type corresponding to the touch object according to the matching degree between the touch parameter information and each medium type. Taking the touch parameter information as touch area information as an example, the elastic wave detection device or processing device records the area ranges corresponding to different media types (that is, the aforementioned preset threshold interval, where the preset threshold interval is used to represent the area parameter of the medium type. Numerical range), when the obtained medium types are at least two and the confidence interval corresponding to each medium type is lower than the set confidence threshold, the elastic wave detection device or processing device determines the preset area range corresponding to each medium type, And obtain the touch parameter information in the infrared contact data, determine the touch area of the current touch object touching the display screen, and determine the area range that is closer to the touch area and the corresponding medium according to the matching degree or area gap between the touch area and each area range. type, and use the media type as the media type corresponding to the touch object. For example, set the confidence threshold to 90%. When the confidence interval of the media type is greater than 90%, the media type can be used as the media type corresponding to the touch object. When two media types are obtained, and the two types are: Material 1 , the confidence interval is 51%; for material 2, the confidence interval is 49%. If the confidence intervals of the two media types are both lower than the set confidence thresholds, the preset area ranges corresponding to Material 1 and Material 2 are obtained. Assuming that the touch area is combined with the touch area in the touch parameter information, confirm that the touch area is closer to the area range of Material 1. , then it is determined that the medium type determined after the correction is Material 1, and Material 1 is used as the medium type corresponding to the touch object. More specifically, when the user operates with a finger on the display screen of the interactive tablet, the medium types identified by the elastic wave detection device may be: finger, with a confidence interval of 51%; brush, with a confidence interval of 49%. Since the confidence interval of the finger and the brush are both set with a confidence threshold of 90%, it is necessary to obtain the touch area in the touch parameter information. Suppose that the obtained touch area (represented by the width value and the height value) is (7,7), and The preset area range of the finger is (6±2, 6±2), and the preset area range of the brush is (5±1, 4±1.5), then it is judged that (7, 7) is closer to the preset area of the finger. The area range is (6±2, 6±2), so the finger is used as the medium type corresponding to the touch object.

It can be understood that step S1056 may be processed by an elastic wave detection device or a processing device, wherein the infrared touch data may be the aforementioned first frame of touch data, or may be the next frame or any frame of infrared touch data after the first frame of touch data. Touch Data. The present disclosure corrects the obtained medium type through infrared touch data, determines the medium type corresponding to the touch object, reduces the deviation caused by the interference source to determine the medium type, and ensures the accuracy of the medium type determination.

In a possible embodiment, in the step of obtaining the medium type corresponding to the touch object, the obtained confidence interval of the medium type is lower than the set confidence threshold, and the touch data processing method provided by the present disclosure further includes:

S1057: The processing device determines, according to the touch position information of the infrared touch data, whether the current touch operation is associated with the last lifted touch operation, and if so, obtains the media type corresponding to the last touch operation as the touch operation the corresponding medium type.

When the confidence interval of the medium type obtained by the elastic wave detection device is lower than the set confidence threshold, the processing device determines the medium type corresponding to the touch object according to whether the current touch operation is related to the previous touch operation. For example, the processing device determines whether the time and distance thresholds between the start point of the current touch operation and the end point of the previous touch operation are within the set time and distance thresholds; associated with the touch operation.

Specifically, the processing device obtains the touch position information in the first frame of touch data of this touch operation, and according to the touch position information is the pen drop position of this touch operation, and uses the corresponding timestamp of the first frame of touch data as Pen down time, and obtain the touch position information in the infrared touch data when the last touch operation was lifted, the touch position information is the pen lift position of the last touch operation, and the corresponding timestamp of the infrared touch data as a pen time. As an implementation, calculate the distance interval ΔS between the pen-down position and the pen-up position, and the time distance ΔT between the pen-up time, to determine whether the pen-down position is near the pen-up position of the last touch operation, and the pen-down time Whether it is near the pen-down time of the last touch operation, that is, it is judged whether (ΔS, ΔT) is within the time and distance thresholds (S0, T0). associated with a lift touch action. The time and distance thresholds include a time threshold T0 and a distance threshold S0, and the time threshold T0 and the distance threshold S0 may be two fixed values or values with a linear or non-linear relationship.

As an implementation manner, when it is determined that the current touch operation is associated with the last lifted touch operation, the medium type corresponding to the last touch operation is acquired as the medium type corresponding to the touch object. When it is determined that the current touch operation is not related to the last lifted touch operation, the corresponding writing track can be displayed on the display screen directly according to the infrared touch data, without updating the infrared touch data by the medium type. It can be understood that when the confidence interval of the medium type is lower than the set confidence threshold, after the processing device performs error correction of the medium type according to the relationship between the current touch operation and the touch operation that was lifted last time, there is no need to correct the error of the medium type. The error result is sent to the elastic wave detection device to improve the data processing efficiency. The present disclosure corrects the media type by using the correlation relationship between the current touch operation and the last lifted touch operation, determines the media type corresponding to the touch object, reduces the deviation caused by the interference source to the determination of the media type, and ensures the determination of the media type. degree of accuracy.

S106: The elastic wave detection apparatus sends medium type information to the processing device, where the medium type information includes the medium type corresponding to the touch object. The medium type information refers to the information containing the medium type corresponding to the touch object sent by the elastic wave detection device to the processing device. Other information, in which the media type is integrated, is sent to the processing device.

After determining the medium type corresponding to the touch object, the elastic wave detection device generates corresponding medium type information based on the medium type, and sends the medium type information to the processing device. The present disclosure determines the medium type corresponding to the touch object by using the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal, and feeds back the corresponding medium type information to the processing device. Accurately determine the media types corresponding to different touch positions, and can respond differently to touch operations at the corresponding touch positions for different media types, enriching the interactive experience of the interactive tablet.

In a possible embodiment, the touch data processing method provided by the present disclosure further includes:

S107: After receiving the medium type information, the processing device starts a response to the received infrared touch data according to the medium type.

Specifically, in the embodiment of the present invention, an elastic wave detection device is set in the interactive tablet, the vibration signal generated on the display screen of the interactive tablet is detected by the elastic wave detection device, and the elastic wave detection device and the processing equipment of the interactive tablet are installed The communication hardware and communication protocol, so that the elastic wave detection device can send the information (such as the aforementioned medium type information) used to confirm that the touch object that triggers the infrared touch data is in contact with the display screen of the interactive tablet to the processing device, so as to help the processing device obtain the ability to judge.

As an embodiment, when the processing device receives the infrared touch data sent by the infrared touch frame, but does not receive the information sent by the elastic wave detection device to confirm that the touch object that triggers the infrared touch data is in contact with the display screen of the interactive tablet , the processing device may not respond to the received infrared touch data.

Specifically, after receiving the medium type information returned by the elastic wave device, the processing device determines the medium type corresponding to the touch object according to the medium type information, and processes and responds to the subsequently received infrared touch data according to the determined medium type. The processing and response to the subsequently received infrared touch data may be to update the subsequently received infrared touch data and respond accordingly (for example, to display the writing track) according to the medium type, or it may be to update the subsequently received infrared touch data according to the medium type and respond accordingly (for example, to display the writing track). The received infrared touch data performs a touch response (for example, a click operation, a long-press operation, etc. are performed according to the medium type). The processing device processes and responds to the subsequently received infrared touch data after receiving the medium type, ignores the infrared touch data generated before the touch object touches the display screen, and only processes the infrared touch data generated after the touch object touches the display screen. The timing of infrared touch data processing and response is consistent with the position and timing of the touch object touching the display screen, and the user's touch operation gets more accurate feedback. The timing is consistent to achieve zero height of writing.

In a possible embodiment, step S107 is specifically: after receiving the medium type information, the processing device starts a response to the received infrared touch data, and outputs a response result associated with the medium type of the touch object. More specifically, it includes steps S1071-S1072:

S1071: After receiving the medium type information, the processing device starts to update the received infrared touch data according to the medium type.

Wherein, starting to update the received infrared touch data refers to updating the infrared touch data received after the time when the medium type information is received. For example, if the time when the medium type is received is t1, the infrared touch data received after the time t1 is updated. In the specific implementation process, it may be processed by recording the receiving time. It is also possible to update the data of a preset flag bit after receiving the medium type, for example, from 00 to 01, so that in subsequent processing, as long as the flag bit is 01, the read infrared touch data is updated.

S1072: The processing device displays the corresponding writing track on the display screen according to the updated infrared touch data.

After the processing device receives the medium type information, it starts to cache the infrared touch data sent by the received infrared touch frame; and reads the cached infrared touch data in turn, updates the received infrared touch data according to the medium type, and updates the received infrared touch data according to the updated The corresponding infrared touch data will be displayed on the display screen. Specifically, after receiving the medium type reported by the elastic wave detection device, the processing device starts to cache the infrared touch data sent by the infrared touch frame. Optionally, after determining that the medium type reported by the elastic wave detection device is received, the processing device notifies the elastic wave detection device that the medium type has been successfully received. The processing device starts to cache the infrared touch data after receiving the medium type, ignoring the infrared touch data generated before the touch object touches the display screen (when these infrared touch data are generated, the touch object just enters the touch detection area and does not touch the display screen. screen), only the infrared touch data is generated after the touch object touches the display screen, and the position and timing of displaying the writing track are consistent with the position and timing of the touch object touching the display screen, so as to achieve zero height of writing. Moreover, the infrared touch data generated before the touch object touches the display screen is not cached, which saves the processing resources of the processing device. In the updating process of this step, the processing device sequentially reads the buffered infrared touch data in the order of first-in, first-out, and updates the read infrared touch data according to the medium type.

In this step, the corresponding writing track is drawn according to the updated infrared touch data, and displayed on the display screen, for example, the corresponding writing track is drawn according to the display attributes (thickness, color, line type, etc.) represented by the updated infrared touch data. The writing track is displayed on the display screen, so as to achieve the purpose of displaying different writing handwriting according to different media types of touch objects.

Figure 4 provides a schematic diagram of the hardware structure of an interactive tablet. As shown in Figure 4, a system layer and an application layer are set in the processing device, wherein the system layer is used to perform data processing at the data level, such as for the received sensor Data analysis and processing, the application layer is used to perform data processing at the application level, such as analysis and processing according to application task requirements. After the system layer completes data processing, it sends the data processing results to the application layer through the data interface, and the application layer passes the data through the data interface. The interface is distributed to a specific application, and further processing is performed by the specific application. Correspondingly, in the present disclosure, the cached infrared touch data is read in sequence, and the step of updating the infrared touch data according to the medium type is processed at the system layer, and the corresponding writing track is displayed on the display screen according to the updated infrared touch data. The steps are handled at the application layer. That is, after the system layer completes the update of the infrared touch data, it reports the updated infrared touch data to the application layer, and the application layer distributes the updated infrared touch data to the whiteboard application, and the whiteboard application executes the subsequent display of the writing track. step. More specifically, the system layer can run the driver of the processing device, and the application layer can run the application installed on the processing device, including the aforementioned whiteboard application, the annotation application of the interactive tablet, or other writing applications. The driver reads the cached infrared touch data in sequence according to the first-in, first-out order, updates the read infrared touch data according to the medium type, and sends the updated infrared touch data to the application layer, which then sends the updated infrared touch data to the application layer. The infrared touch data is sent to the application program, and after the application program receives the updated infrared touch data, it responds, draws a corresponding writing track, and displays it on the display screen.

In the specific implementation of this solution, corresponding standard touch parameter information (including standard touch height information and standard touch width information) is determined in advance for different media types, and accordingly, infrared touch data is updated according to the media type, which specifically includes steps S10721-S10722 :

S10721: Determine the standard touch parameter information of the medium type.

S10722: Update touch parameter information of the infrared touch data to standard touch parameter information to obtain updated infrared touch data.

Specifically, after receiving the medium type, the processing device determines the standard touch parameter information corresponding to the medium type, and updates the touch parameter information in the infrared touch data obtained from the cache to the standard touch parameter information, for example, changing the touch parameter information in the touch parameter information The height information and width information are replaced with the standard touch height information and standard touch width information in the standard touch parameter information, so as to obtain the updated infrared touch data. By updating the touch parameter information in the infrared touch data to the standard touch parameter information of the medium type, the medium type can be subsequently determined according to the standard touch parameter information, so as to display the corresponding handwriting or perform the corresponding operation.

In the specific implementation of this solution, different IDs can be set according to different media types, and accordingly, the infrared touch data is updated according to the media type, which specifically includes step S10723:

S10723: Write the ID corresponding to the medium type into the data packet of the infrared touch data, and update the infrared touch data.

Specifically, IDs corresponding to different media types are recorded in the processing device, and the IDs are used to represent different media types. After receiving the medium type, the processing device obtains the ID corresponding to the medium type, reads the buffered infrared touch data, and writes the ID into the infrared touch data to update the infrared touch data. After updating the infrared touch data, the system layer in the processing device sends the updated infrared touch data to the application layer, and the application layer can read the ID in the infrared touch data to determine the corresponding medium type, so as to display the corresponding handwriting or execute Corresponding operations, for example, draw the corresponding handwriting through the preset display attributes (color, handwriting thickness, line type, etc.) of the medium type associated with the ID. By writing the ID corresponding to the medium type into the infrared touch data, there is no need to update the touch parameter information, that is, the touch area of the infrared touch data is retained, but an ID is added to characterize the medium type. When the data shows the writing track, the handwriting of the corresponding attribute can be drawn according to the actual touch area, and the display of the writing track is more accurate.

In a possible embodiment, the display attribute of the writing track can be determined based on the infrared touch data. Correspondingly, according to the updated infrared touch data, the corresponding writing track is displayed on the display screen, which specifically includes step S10724:

S10724: Read the touch state information, touch position information and touch parameter information of each frame of the updated infrared touch data, when the touch state information indicates that the touch state is a touch movement state, according to the display attribute corresponding to the touch parameter information, in Touch the position indicated by the position information to display the corresponding writing track.

Specifically, display attributes corresponding to different touch parameters are recorded in the application layer, and the display attributes include the thickness, color, and line type (dotted line, solid line, style, etc.) corresponding to the writing track when drawing and displaying the writing track. For example, when the touch parameter is (5,5), it corresponds to writing white handwriting, and when the touch parameter is (3,3), it corresponds to writing red handwriting. The system layer, after updating the infrared touch data according to the medium type, reports the updated infrared touch data to the application layer that needs to use the infrared touch data to display the writing track. The application layer continuously reads the updated infrared touch data, and determines the touch state information, touch position information and touch parameter information of each frame of data in the infrared touch data, so as to draw the writing track according to the display attribute corresponding to the touch parameter information. Different touch parameter information is generated by different media types, the display properties of the writing track can be quickly determined, and the display properties can be set quickly by touching objects of different media types. The operation process is simple and efficient, and the interaction efficiency of the interactive tablet is improved.

In a possible embodiment, the writing track is displayed according to the continuously obtained infrared touch data until the infrared touch data is not obtained. Correspondingly, according to the updated infrared touch data, the corresponding writing track is displayed on the display screen. Specifically, step S1065 is included:

S10725: Continue to acquire the updated infrared touch data, and display a corresponding writing track on the display screen according to the updated infrared touch data, until it is confirmed that no infrared touch data is acquired.

Specifically, after updating the infrared touch data according to the medium type, the system layer reports the updated infrared touch data to the application layer that needs to use the infrared touch data to display the writing track. The application layer continuously acquires the updated infrared touch data, and displays the corresponding writing track on the display screen according to the updated infrared touch data, until it is determined that no infrared touch data is acquired, and the current touch operation is determined to be completed.

In a possible embodiment, step S107 is specifically as follows: after the processing device receives the medium type information, determines the controls operated by the touch object according to the infrared touch data, and responds to the controls in combination with the medium type of the touch object. For example, the infrared touch data indicates that the touch position is an annotation control, and when the processing device presets touch objects of different media types to click the annotation control, different annotation programs are invoked. Then, when the infrared touch data feedbacks the touch object to click on the annotation control, the processing device responds according to the medium type of the touch object, and calls the corresponding annotation program.

In a possible embodiment, after sending the medium type to the processing device, the elastic wave detection device suspends work until receiving the touch data of the last frame of the infrared touch frame or the infrared touch data sent by the processing device, and clears the buffered elasticity wave signal and continue to work. The touch state information in the touch data of the last frame indicates that the touch state of the touch object is a touch-up state.

Specifically, after determining the medium type, the elastic wave device reports the medium type to the processing device, and after successfully reporting the medium type, the elastic wave detection device suspends work until it receives the touch data of the last frame sent by the infrared touch frame or the processing device. . The suspension of operation of the elastic wave detection device can be understood as the steps of suspending the buffering of the elastic wave signal, and determining the medium type corresponding to the touched object according to the first frame of touch data and the elastic wave signal, and sending the medium type to the processing device.

The infrared touch frame or the processing device determines whether the touch data of the last frame is received according to the touch state information in the infrared touch data, and determines that the touch data of the last frame is received when the touch state information indicates that the touch state of the touch object is the touch-up state. As an implementation manner, after the infrared touch frame or the processing device confirms that the touch data of the last frame of the infrared touch data is received, it sends the touch data of the last frame to the elastic wave detection device.

After determining that the last frame of touch data is received, the elastic wave detection device clears the previously buffered elastic wave signal and continues to work, that is, continues to buffer the elastic wave signal, and determines the corresponding touch object according to the first frame of touch data and the elastic wave signal. the media type and send the media type to the processing device. The elastic wave detection device suspends work after reporting the medium type to the processing equipment, no longer buffers or processes newly generated elastic wave signals, filters the influence of interference signals, avoids unnecessary processing steps by the elastic wave detection device, improves processing efficiency, and After receiving the touch data of the last frame, continue to work after clearing the buffered elastic wave signal, so as to avoid unnecessary influence on the determination of the next medium type and ensure the accuracy of medium type identification.

Fig. 5 shows a logic diagram of touch data processing provided by the present disclosure. As shown in Fig. 5, taking the processing device sending the first frame of touch data to the elastic wave detection device as an example, where T is the time span of the touch operation, from The time between TOUCH (time T1) and DOWN (time T3) is the time when the touch object approaches the display screen. Assuming the vibration generated by the interference source during this time (starting from time T2 in the figure), the elastic wave detection device detects the elastic The wave signal is buffered (from time T2 to time T4 in the figure). TOUCH in the figure represents the time point when the touch object starts to perform touch operation but does not enter the touch detection area. DOWN is the time when the touch object starts to enter the touch detection area. The time point at which the touch box reports the infrared touch data after detecting the infrared touch data. The infrared touch data reported at this time is the first frame of touch data. At the same time, the infrared touch box reports the first frame of touch data to the processing device at the time of T3, and the processing device sends the data to the elastic wave. The detection device sends the first frame of touch data (time T4), and after receiving the first frame of touch data, the elastic wave detection device feeds back to the processing device to confirm receipt of the first frame of touch data (time T5 in the figure). From DOWN to UP (that is, from time T1 to time T12), the infrared touch frame will continue to send infrared touch data to the processing device. In actual processing, there will be a time gap of several frames of infrared touch data between the infrared touch frame detecting the infrared touch data and reporting the infrared touch data. It is dust and other noise points), but after continuous calculation of more than two frames of infrared touch data, it is determined that there is a real touch operation, and then the infrared touch data is reported. Here, the first frame of infrared touch data reported to the processing device is referred to as the first frame of infrared touch data, that is, the first frame of infrared touch data may be the second, third, or fourth frame of infrared touch data calculated by the infrared touch frame. The data, and which frame to report, is determined by the working characteristics of the infrared touch frame.

After receiving the first frame of touch data, the elastic wave detection device determines the media type corresponding to the touch object (from T4 to T7 in the figure) according to the first frame of touch data and the elastic wave signal, and uploads the media type to the processing device (T7 in the figure). time), after receiving the medium type, the processing device can feed back to the elastic wave detection device to confirm the received medium type (time T8 in the figure). Meanwhile, the elastic wave detection device suspends work after sending the medium type to the processing equipment.

After receiving the medium type, the processing device starts to cache the received infrared touch data sent by the infrared touch frame (infrared touch data after time T9 in the figure). At the same time, the processing device sequentially reads the cached infrared touch data, updates the infrared touch data according to the medium type (time T10 in the figure), and displays the corresponding writing track on the display screen (from T11 in the figure) according to the updated infrared touch data time begins). Finally, after receiving the touch data of the last frame reported by the infrared touch frame (time T12 in the figure), the processing device sends the touch data of the last frame to the elastic wave detection device, and the elastic wave detection device will clear the buffered elastic waves in response to the touch data of the last frame signal and continue working.

FIG. 6 shows another touch data processing logic diagram provided by the present disclosure. As shown in FIG. 6 , taking the infrared touch frame sending the first frame of touch data to the elastic wave detection device as an example, the difference between the rest of the above touch data processing logic is that , when the infrared touch frame detects the first frame of touch data in the infrared touch data, it directly sends the first frame of touch data to the elastic wave detection device, instead of sending the first frame of touch data to the elastic wave detection device through the processing device (times T3 and T4 in Figure 6, Time T12 and time T13 are at the same time). When the infrared touch frame detection detects the touch data of the last frame in the infrared touch data, it directly sends the touch data of the last frame to the elastic wave detection device, instead of sending it to the elastic wave detection device through the processing device. For the touch data processing logic at other time points, reference may be made to the touch data processing logic provided above, which will not be repeated here.

FIG. 7 is an operation schematic diagram of a touch operation provided by the present disclosure, and FIG. 8 is a display schematic diagram of a writing track provided by the present disclosure. As shown in FIG. 7 , it is assumed that a writing pen is used as a touch object to perform a touch operation on the display screen, and the direction of the arrow in FIG. 7 is the moving direction of the writing pen. In this writing operation, a pen-down event, a writing event and a pen-up event will occur in sequence, corresponding to the touch-down state, the touch-moving state and the touch-up state of the writing pen on the display screen. The track A in FIG. 8 is the operation track of the writing pen, and the operation track is divided into A1, A2 and A3 according to the moving direction of the writing pen, corresponding to the touch drop state of the writing pen on the display screen (corresponding to the DOWN point), the touch moving state corresponds to the DOWN point to the UP point in Figures 5 and 6), and the touch lift state corresponds to the UP point in Figures 5 and 6). During the writing process, the writing pen did not touch the display screen, and the elastic wave detection device failed to detect the touch operation of the writing pen on the display screen. When entering the writing stage, the writing pen touched the display screen, and the elastic wave detection device Elastic wave signal detected. The infrared touch frame can detect infrared touch data during the entire process of pen down, move and up. The elastic wave detection device buffers the elastic wave signal in the A1 stage, determines the medium type according to the elastic wave signal and the first frame of touch data, reports it to the processing device, and stops working after reporting the medium type. The processing device displays the writing track to the display screen according to the medium type and infrared touch data in the A2 stage. After receiving the touch data of the last frame in the A3 stage, the elastic wave detection device clears the buffered elastic wave signal and continues to work. The writing track finally displayed on the display screen is shown as track B in FIG. 8 , wherein track B is divided into B2 and B3, corresponding to A2 and A3 respectively.

It can be understood that, in the present disclosure, when the processing device does not receive the medium type reported by the elastic wave detection device, it discards the received infrared touch data and does not respond to the currently received infrared touch data. When the medium type is not determined, the infrared touch data is not responded to, but the infrared touch data is processed only after the medium type is determined, and the infrared touch data cached at this time can be determined to be when the touch object actually touches the display screen. For the generated infrared touch data, the writing track displayed on the display screen is closer to the actual touch track of the touch object on the display screen. In addition, since the infrared touch data generated before the touch object actually touches the display screen is not processed, the writing track will not be displayed when the touch object touches the display screen, but the writing track will be displayed after the medium type is determined. When tracking, it is determined that the touch object has contacted the display screen, and the zero writing height of the writing operation is realized.

In the above, the infrared touch data generated when the touch object touches the touch detection area of the interactive tablet is detected by the infrared touch frame, and the elastic wave signal generated when the touch object touches the display screen is detected by the elastic wave detection device. The location information and/or touch parameter information, and the elastic wave signal determine the medium type, start to cache the continuously received infrared touch data after the medium type is determined, and update the infrared touch data according to the medium type, and display the infrared touch data according to the updated infrared touch data. The corresponding writing track is displayed on the screen, and the medium type is determined by combining the infrared touch data and elastic wave signal, which improves the recognition accuracy of the touched object. After the medium type is determined, the infrared touch data is cached and responded to, and the displayed writing track is the same as the one. The actual touch track of the touch object on the display screen is closer, and at the same time, the writing track is displayed when it is determined that the touch object has touched the display screen, rather than before the touch object actually touches the display screen (although the touch object has entered the touch detection at this time). area and generate infrared touch data) to display the writing track, the timing of the display of the writing track is closer to the timing when the touch object touches the display screen, the display of the writing track is more accurate, the zero writing height of the writing operation is realized, and the medium type can quickly The display properties of the writing track are determined, and the display properties can be quickly modified by touching objects of different media types, and the differentiated display of writing handwriting with different display properties is realized. The operation process is simple and efficient, and the interaction efficiency of the interactive tablet is improved.

In a possible embodiment, after the processing device receives the infrared touch data sent by the infrared touch frame or sends the first frame of touch data to the elastic wave detection device, the processing device waits for receiving the medium type within a preset time threshold, correspondingly, the touch The data processing method further includes step S1081:

S1081: The processing device determines that the medium type sent by the elastic wave detection device has not been received within the preset time threshold, and directly displays the corresponding writing track on the display screen according to the infrared touch data.

Specifically, after receiving the infrared touch data sent by the infrared touch frame or sending the first frame of touch data to the elastic wave detection device, the processing device waits for the elastic wave detection device to send the medium type to it. Generally speaking, after the elastic wave detection device receives the infrared touch data, it takes 13-20ms to obtain the medium type in combination with the infrared touch data and report it to the processing device. Therefore, a preset time threshold (for example, 20ms) can be set as the waiting time for the elastic wave. Detecting device feedback time. If the processing device determines that the medium type sent by the elastic wave detection device is not received within the preset time threshold (for example, 20ms), it is considered that the elastic wave signal is generated by an interference source, a false alarm event caused by a false touch, or a system Or the communication is abnormal, the corresponding writing track is displayed on the display screen directly according to the infrared touch data, that is, the step of updating the infrared touch data according to the medium type is not performed, but the corresponding writing track is displayed on the display screen according to the original infrared touch data. Writing track. If the processing device determines that the medium type is received within the preset time threshold, step S107 is executed to update the infrared touch data according to the medium type, and display the corresponding writing track on the display screen according to the updated infrared touch data. When the processing device does not receive the medium type sent by the elastic wave detection device within the preset time threshold, it directly displays the writing track on the display screen according to the infrared touch data, so as to avoid failure to display due to false alarm events, system or communication abnormalities The situation of the writing track ensures the user's writing experience.

In a possible embodiment, after the processing device receives the infrared touch data sent by the infrared touch frame or sends the first frame of touch data to the elastic wave detection device, the processing device waits for receiving the medium type within a preset time threshold, correspondingly, the touch The data processing method further includes step S1082:

S1082: The processing device determines that the medium type sent by the elastic wave detection device has not been received within the preset time threshold, obtains the medium type last sent by the elastic wave detection device, updates the infrared touch data according to the medium type, and updates the infrared touch data according to the updated infrared Touch the data to display the corresponding writing track on the display.

Specifically, after receiving the infrared touch data sent by the infrared touch frame or sending the first frame of touch data to the elastic wave detection device, the processing device waits for the elastic wave detection device to send the medium type to it. If the processing device determines that the medium type sent by the elastic wave detection device has not been received within a preset time threshold (for example, 20ms), it is considered that a false alarm event occurred in the elastic wave detection device or the system or communication is abnormal, and the elastic wave detection device is obtained. The media type sent last time, update the infrared touch data according to the media type, and display the corresponding writing track on the display screen according to the updated infrared touch data. At this time, the display properties of the writing track are the same as the display properties of the last touch operation. same. If the processing device determines that the medium type is received within the preset time threshold, step S107 is executed to update the infrared touch data according to the medium type, and display the corresponding writing track on the display screen according to the updated infrared touch data. When the processing device does not receive the medium type sent by the elastic wave detection device within the preset time threshold, according to the infrared touch data and the last medium type, the writing track is displayed on the display screen to avoid false alarm events, system or communication If an exception occurs, the writing track cannot be displayed, so as to ensure the user's writing experience.

S109: Before receiving the medium type information, the processing device responds to the received infrared touch data.

Before receiving the medium type sent by the elastic wave detection device, the processing device does not process the subsequent infrared touch data, but directly responds to the received infrared touch data, for example, directly obtains the cached infrared touch data and displays the corresponding data on the display screen. Before receiving the medium type sent by the elastic wave detection device, it is not necessary to update the infrared touch data, but directly display the corresponding writing trajectory on the display screen according to the infrared touch data until the medium type is received, and then The infrared touch is updated according to the medium type, to ensure the normal response to the infrared touch data, and to realize the error correction of the failure to display the writing track normally when the communication between the elastic wave detection devices is abnormal.

On the basis of the above-mentioned embodiment, FIG. 9 shows a flowchart of another touch data processing method provided by the present disclosure, and the touch data processing method is an embodiment of the above-mentioned touch data processing method. Referring to FIG. 9, the touch data processing method includes:

S201: The infrared touch frame detects infrared touch data, and the infrared touch data is generated when a touch object performs a touch operation in a touch detection area of the interactive tablet.

S202: The elastic wave detection device detects an elastic wave signal; the elastic wave signal is generated when the touch object contacts the display screen of the interactive tablet.

S203: The processing device receives the infrared touch data sent by the infrared touch frame.

S204: After receiving the first frame of touch data of the infrared touch data, the elastic wave detection device determines the medium type corresponding to the touch object according to the first frame of touch data and the elastic wave signal, and sends the medium type to the processing device; wherein, the infrared touch data The first frame of touch data is sent to the elastic wave detection device by the infrared touch frame or the processing device.

S205: After receiving the medium type information, the processing device starts to cache the received infrared touch data sent by the infrared touch frame.

S206: The processing device sequentially reads the buffered infrared touch data, updates the infrared touch data according to the medium type, and displays a corresponding writing track on the display screen according to the updated infrared touch data.

S207: After receiving the second medium type sent by the elastic wave detection device, the processing device sequentially reads the cached infrared touch data, updates the infrared touch data according to the second medium type, and erases the infrared touch data according to the updated infrared touch data The writing track corresponding to the data.

Specifically, the interactive tablet provided by the present disclosure is configured with a writing pen, the writing pen includes a pen tip and a pen tail, wherein the media type of the pen tip is the first media type, and the media type of the pen tail is the second media type. Generally, the touch operation performed with the tip of the pen can be considered as a writing operation performed on the display screen, and the touch operation performed with the tail of the pen can be considered as an erase operation performed on the display screen.

After receiving the infrared touch data sent by the infrared touch frame or sending the first frame of touch data to the elastic wave detection device, the processing device waits for the elastic wave detection device to send the medium type to it. The elastic wave detection device reads the buffered elastic wave signal, and then determines the medium type corresponding to the touched object in combination with the first frame of touch data sent to it by the infrared touch frame or the processing device. When the touch object is the tip of a writing pen, the medium type sent by the elastic wave detection device to the processing device is the first medium type, and the aforementioned step 206 is performed, and when the touch object is the pen end of the writing pen, the medium sent to the processing device is The type is the second medium type, and the foregoing step 207 is performed.

After receiving the first medium type sent by the elastic wave detection device, the processing device will update the infrared touch data according to the first medium type, and display the corresponding writing track on the display screen according to the updated infrared touch data. After receiving the second medium type sent by the elastic wave detection device, the processing device sequentially reads the cached infrared touch data, updates the infrared touch data according to the second medium type, and erases the display screen according to the updated infrared touch data. The writing track corresponding to the infrared touch data. For the application layer, different touch parameter information is associated with different display attributes. When the pen tail is writing, it can be understood that the display attribute is to eliminate handwriting. By presetting the standard touch parameter information of the pen tail and setting it in the application layer , then the application layer will correspondingly erase the corresponding handwriting when receiving the infrared touch data representing the operation of the pen tail.

The head and tail of the writing pen are respectively made of materials corresponding to different types of touch media. Based on different media types in different parts, the operation of a writing pen at different positions can directly complete the corresponding touch operation in some cases, without the need to operate the function control multiple times in the touch detection area to hit the desired Triggered control action. Adapting to the user's operating habits when writing on paper, in this solution, the media types of the pen head and the pen tail are respectively corresponding to different touch operations. The second medium type characterizing the end of the pen corresponds to an erasing operation that corrects the existing writing track. Of course, through a touch operation on a specific track or a touch operation on a specific area, the pen head and the pen tail can also correspond to touch control operations.

In the above, the infrared touch data generated when the touch object touches the touch detection area of the interactive tablet is detected by the infrared touch frame, and the elastic wave signal generated when the touch object touches the display screen is detected by the elastic wave detection device. The location information and/or touch parameter information, and the elastic wave signal determine the medium type. By combining the infrared touch data and the elastic wave signal to determine the medium type, the recognition accuracy of the touch object is improved, and the medium type of the medium type of the touch object is included. The information is sent to the processing device, so that the processing device can initiate a response to the received infrared touch data according to the medium type, so that the processing device can perform different response operations according to different media types of the touched object, with simple operation and high efficiency. Moreover, the processing device starts to process and respond to the received infrared touch data after receiving the medium type, ignores the infrared touch data generated before the touch object touches the display screen, and only processes the infrared touch data generated after the touch object touches the display screen. The timing of processing and responding to infrared touch data is consistent with the position and timing of the touch object touching the display screen, and the user's touch operation gets more accurate feedback. For example, when the user uses the touch object to write on the display screen, the writing The position and timing of the track are consistent with the position and timing of the touch object touching the display screen to achieve zero height of writing, and the display properties of the writing track can be quickly determined by the medium type, and the display can be quickly realized by touching objects of different media types. The modification of attributes realizes the differentiated display of writing handwriting with different display attributes, the operation process is simple and efficient, and the interactive efficiency of the interactive tablet is improved.

FIG. 10 is a structural block diagram of an interactive tablet provided by the present disclosure. Referring to FIG. 10 , the interactive tablet can be used to execute the touch data processing method in the embodiment of FIG. 2 . The interactive tablet includes a display screen, a processing device, an infrared touch frame and an elastic wave detection device. The infrared touch frame is arranged around the display screen to The touch detection area of the interactive tablet is formed, and the display screen, the infrared touch frame and the elastic wave detection device are all connected with the processing equipment.

The infrared touch frame is used to detect infrared touch data and send the infrared touch data to the processing device, wherein the infrared touch data is generated when the touch object performs a touch operation in the touch detection area of the interactive tablet, and the infrared touch data includes touch position information and / or touch parameter information;

an elastic wave detection device for detecting an elastic wave signal, wherein the elastic wave signal is generated when a touch object contacts the display screen of the interactive tablet; and

After receiving the infrared touch data sent by the processing device, according to the touch position information and/or touch parameter information of the infrared touch data, as well as the elastic wave signal, determine the medium type corresponding to the touch object, and send the medium type information to the processing device. The type information includes the media type corresponding to the touch object;

Processing equipment for:

receiving infrared touch data sent by the infrared touch frame, and sending the infrared touch data to the elastic wave detection device; and

Receive the medium type information sent by the elastic wave detection device.

In the above, the infrared touch data generated when the touch object touches the touch detection area of the interactive tablet is detected by the infrared touch frame, and the elastic wave signal generated when the touch object touches the display screen is detected by the elastic wave detection device. The location information and/or touch parameter information, and the elastic wave signal determine the medium type. By combining the infrared touch data and the elastic wave signal to determine the medium type, the recognition accuracy of the touch object is improved, and the medium type of the medium type of the touch object is included. The information is sent to the processing device, so that the processing device can initiate a response to the received infrared touch data according to the medium type, so that the processing device can perform different response operations according to different media types of the touched object, with simple operation and high efficiency. Moreover, the processing device starts to process and respond to the received infrared touch data after receiving the medium type, ignores the infrared touch data generated before the touch object touches the display screen, and only processes the infrared touch data generated after the touch object touches the display screen. The timing of processing and responding to infrared touch data is consistent with the position and timing of the touch object touching the display screen, and the user's touch operation gets more accurate feedback. For example, when the user uses the touch object to write on the display screen, the writing The position and timing of the track are consistent with the position and timing of the touch object touching the display screen to achieve zero height of writing, and the display properties of the writing track can be quickly determined by the medium type, and the display can be quickly realized by touching objects of different media types. The modification of attributes realizes the differentiated display of writing handwriting with different display attributes, the operation process is simple and efficient, and the interactive efficiency of the interactive tablet is improved. For the specific technical details and technical effects of the interactive tablet provided by this solution, reference may be made to the foregoing embodiments (eg, the touch data processing method in the embodiment of FIG. 2 ), which will not be repeated in this disclosure.

FIG. 11 is a structural block diagram of an interactive tablet provided by the present disclosure. Referring to FIG. 11 , the interactive tablet can be used to execute the touch data processing method in the embodiment of FIG. 9 , the interactive tablet includes a display screen, a processing device, an infrared touch frame and an elastic wave detection device, and the infrared touch frame is arranged around the display screen to The touch detection area of the interactive tablet is formed, the display screen, the infrared touch frame and the elastic wave detection device are all connected with the processing equipment, and the infrared touch frame is connected with the elastic wave detection device.

The infrared touch frame is used to detect infrared touch data, send the infrared touch data to the elastic wave detection device, and send the infrared touch data to the processing device, wherein the infrared touch data is touched by the touch object in the touch detection area of the interactive tablet When generated, the infrared touch data includes touch position information and/or touch parameter information;

an elastic wave detection device for detecting elastic wave signals, the elastic wave signals are generated when a touch object touches the display screen of the interactive tablet; and

After receiving the infrared touch data sent by the infrared touch frame, according to the touch position information and/or touch parameter information of the infrared touch data, and the elastic wave signal, determine the medium type corresponding to the touch object, and send the medium type information to the processing device, The medium type information includes the medium type corresponding to the touch object;

Processing equipment for:

Receive infrared touch data sent by the infrared touch frame; and

Receive the medium type information sent by the elastic wave detection device.

In the above, the infrared touch data generated when the touch object touches the touch detection area of the interactive tablet is detected by the infrared touch frame, and the elastic wave signal generated when the touch object touches the display screen is detected by the elastic wave detection device. The location information and/or touch parameter information, and the elastic wave signal determine the medium type. By combining the infrared touch data and the elastic wave signal to determine the medium type, the recognition accuracy of the touch object is improved, and the medium type of the medium type of the touch object is included. The information is sent to the processing device, so that the processing device can initiate a response to the received infrared touch data according to the medium type, so that the processing device can perform different response operations according to different media types of the touched object, with simple operation and high efficiency. Moreover, the processing device starts to process and respond to the received infrared touch data after receiving the medium type, ignores the infrared touch data generated before the touch object touches the display screen, and only processes the infrared touch data generated after the touch object touches the display screen. The timing of processing and responding to infrared touch data is consistent with the position and timing of the touch object touching the display screen, and the user's touch operation gets more accurate feedback. For example, when the user uses the touch object to write on the display screen, the writing The position and timing of the track are consistent with the position and timing of the touch object touching the display screen to achieve zero height of writing, and the display properties of the writing track can be quickly determined by the medium type, and the display can be quickly realized by touching objects of different media types. The modification of attributes realizes the differentiated display of writing handwriting with different display attributes, the operation process is simple and efficient, and the interactive efficiency of the interactive tablet is improved. For the specific technical details and technical effects of the interactive tablet provided by this solution, reference may be made to the foregoing embodiments (eg, the touch data processing method in the embodiment of FIG. 9 ), which will not be repeated in this disclosure.

The present disclosure also provides a readable storage medium containing computer-executable instructions, when executed by a computer processor, the computer-executable instructions are used to execute the touch data processing method provided by the above embodiments.

storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROMs, floppy disks, or tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc. ; non-volatile memory, such as flash memory, magnetic media (eg hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network such as the Internet. The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations (eg, in different computer systems connected by a network). The storage medium may store program instructions (eg, embodied as a computer program) executable by one or more processors.

Of course, a readable storage medium containing computer-executable instructions provided by the present disclosure is not limited to the above-mentioned touch data processing method, and can also execute any of the touch data processing methods provided in any embodiment of the present disclosure. related operations.

The interactive tablet and storage medium provided in the above embodiments can perform the touch data processing method provided by any embodiment of the present disclosure. For technical details not described in detail in the above embodiments, please refer to the touch data provided by any embodiment of the present disclosure. Approach.

The above are only the preferred embodiments of the present disclosure and the applied technical principles. The present disclosure is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present disclosure. Therefore, although the present disclosure has been described in detail through the above embodiments, the present disclosure is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present disclosure. The scope is determined by the scope of the claims.

Claims

A touch data processing method is applied to an interactive tablet, the interactive tablet includes a display screen, a processing device and an infrared touch frame, the interactive tablet further includes an elastic wave detection device, and the method includes:

The infrared touch frame detects infrared touch data, and the infrared touch data is generated when a touch object performs a touch operation in the touch detection area of the interactive tablet; the infrared touch data includes touch position information and/or touch parameters information;

The processing device receives the infrared touch data sent by the infrared touch frame;

The elastic wave detection device receives the infrared touch data, wherein the infrared touch data is sent to the elastic wave detection device by the infrared touch frame or the processing device;

The elastic wave detection device detects an elastic wave signal; the elastic wave signal is generated when the touch object contacts the display screen of the interactive tablet;

The elastic wave detection device determines the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal;

The elastic wave detection apparatus sends medium type information to the processing device, where the medium type information includes a medium type corresponding to the touch object.
A touch data processing method is applied to an interactive tablet, the interactive tablet includes a display screen, a processing device and an infrared touch frame, the interactive tablet further includes an elastic wave detection device, and the method includes:

The infrared touch frame detects infrared touch data, and the infrared touch data is generated when a touch object performs a touch operation in the touch detection area of the interactive tablet; the infrared touch data includes touch position information and/or touch parameters information;

The processing device receives the infrared touch data sent by the infrared touch frame;

The elastic wave detection device receives the infrared touch data, wherein the infrared touch data is sent to the elastic wave detection device by the infrared touch frame or the processing device;

The elastic wave detection device detects an elastic wave signal; the elastic wave signal is generated when the touch object contacts the display screen of the interactive tablet;

The elastic wave detection device determines the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal;

The elastic wave detection device sends medium type information to the processing device, where the medium type information includes a medium type corresponding to the touch object;

After receiving the medium type information, the processing device starts a response to the received infrared touch data.
A touch data processing method is applied to an interactive tablet, the interactive tablet includes a display screen, a processing device and an infrared touch frame, the interactive tablet further includes an elastic wave detection device, and the method includes:

The infrared touch frame detects infrared touch data, and the infrared touch data is generated when a touch object performs a touch operation in the touch detection area of the interactive tablet; the infrared touch data includes touch position information and/or touch parameters information;

The processing device receives the infrared touch data sent by the infrared touch frame;

The elastic wave detection device receives the infrared touch data, wherein the infrared touch data is sent to the elastic wave detection device by the infrared touch frame or the processing device;

The elastic wave detection device detects an elastic wave signal; the elastic wave signal is generated when the touch object contacts the display screen of the interactive tablet;

The elastic wave detection device determines the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal;

The elastic wave detection device sends medium type information to the processing device, where the medium type information includes a medium type corresponding to the touch object;

The processing device responds to the received infrared touch data before receiving the medium type information;

After receiving the medium type information, the processing device starts a response to the received infrared touch data.
The touch data processing method according to claim 2 or 3, wherein after receiving the medium type information, the processing device starts a response to the received infrared touch data, which is specifically:

After receiving the medium type information, the processing device starts a response to the received infrared touch data, and outputs a response result associated with the medium type of the touch object.
The touch data processing method according to claim 4, wherein after receiving the medium type information, the processing device starts a response to the received infrared touch data, and outputs an output related to the medium type of the touch object The response results of the link, including:

After receiving the medium type information, the processing device starts to update the received infrared touch data according to the medium type;

The processing device displays a corresponding writing track on the display screen according to the updated infrared touch data.
The touch data processing method according to claim 4, wherein after receiving the medium type information, the processing device starts a response to the received infrared touch data, and outputs an output related to the medium type of the touch object The response results of the link, including:

After receiving the medium type information, the processing device determines the control operated by the touch object according to the infrared touch data, and responds to the control in combination with the medium type of the touch object.
The touch data processing method according to any one of claims 1 to 3, wherein the infrared touch data further includes touch state information.
The touch data processing method according to claim 7, wherein the elastic wave detection device receives the infrared touch data, wherein the infrared touch data is sent by the infrared touch frame or the processing device to the Elastic wave detection device; specifically:

The elastic wave detection device receives the first frame of touch data of the infrared touch data, wherein the first frame of touch data of the infrared touch data is sent to the elastic wave detection device by the infrared touch frame or the processing device ; The touch state information in the first frame of touch data indicates that the touch state of the touch object is a touch falling state.
The touch data processing method according to claim 7, wherein the infrared touch data received by the elastic wave detection device is: the touch state information indicates that the touch state of the touch object is the first touch movement state. frame or second frame of touch data.
The touch data processing method according to any one of claims 1 to 3, wherein after the elastic wave detection device detects the elastic wave signal, the elastic wave signal is buffered until the infrared touch data is received. , and then determine the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal.
The touch data processing method according to claim 7, wherein the method further comprises:

After sending the medium type to the processing device, the elastic wave detection device suspends work until receiving the touch data of the last frame of the infrared touch data sent by the infrared touch frame or the processing device, Clear the buffered elastic wave signal and continue working;

The touch state information in the touch data of the last frame indicates that the touch state of the touch object is a touch-up state.
The touch data processing method according to claim 11, wherein the method further comprises:

After confirming that the last frame of touch data of the infrared touch data is received, the processing device sends the last frame of touch data to the elastic wave detection device.
The touch data processing method according to claim 8, wherein the method further comprises:

The elastic wave detection device determines that the first frame of touch data has not been received within a preset time threshold, and clears the buffered elastic wave signal.
The touch data processing method according to claim 5, wherein the corresponding writing track is displayed on the display screen according to the updated infrared touch data, which is specifically:

Read the touch state information, touch position information and touch parameter information of each frame of the updated infrared touch data, and when the touch state information indicates that the touch state is a touch movement state, according to the touch parameter information corresponding The display attribute is to display the corresponding writing track at the position indicated by the touch position information.
The touch data processing method according to any one of claims 1-3, wherein the elastic wave detection device determines, according to touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal, The media type corresponding to the touch object includes:

After receiving the infrared touch data, the elastic wave detection device reads touch position information in the infrared touch data;

The touch position information and the elastic wave signal are input into the trained feature recognition model to obtain the medium type corresponding to the touch object.
The touch data processing method according to any one of claims 1-3, wherein there are multiple elastic wave signals, and the elastic wave detection device is based on touch position information and/or touch information of the infrared touch data The parameter information and the elastic wave signal determine the medium type corresponding to the touch object, including:

After receiving the infrared touch data, the elastic wave detection device reads touch position information in the infrared touch data;

Integrate multiple elastic wave signals to obtain preprocessed signals;

The touch position information and the preprocessing signal are input into the trained feature recognition model to obtain the medium type corresponding to the touch object.
The touch data processing method according to any one of claims 1-3, wherein the elastic wave detection device determines, according to touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal, The media type corresponding to the touch object includes:

The elastic wave detection device is performing feature extraction on the elastic wave signal to obtain a first feature;

The elastic wave detection device receives the infrared touch data;

The elastic wave detection device corrects the first feature according to the touch position information in the infrared touch data;

Comparing the modified first feature with a preset feature database to obtain the medium type corresponding to the touch object.
The touch data processing method according to claim 17, wherein the step of receiving the infrared touch data by the elastic wave detection device comprises:

After the elastic wave detection device performs feature extraction on the elastic wave signal, it is determined that the infrared touch data is not received, and then waits to receive the infrared touch data until the infrared touch data is received.
The touch data processing method according to claim 15 or 16, wherein in the step of obtaining the medium type corresponding to the touch object, the obtained medium types are at least two, and the confidence interval corresponding to each medium type is below a set confidence threshold; the method further includes:

The elastic wave detection device determines, according to the touch parameter information of the infrared touch data, one of the at least two medium types as the medium type corresponding to the touch object;

or

The processing device receives the medium type information sent by the elastic wave detection device; the medium type information includes the at least two medium types;

The processing device determines, according to the touch parameter information of the infrared touch data, one of the at least two medium types as the medium type corresponding to the touch object.
The touch data processing method according to claim 19, wherein, according to the infrared touch data, determining one of the at least two medium types as the medium type corresponding to the touch object is specifically:

acquiring touch parameter information in the infrared touch data;

obtaining a preset threshold interval corresponding to the at least two media types; the preset threshold interval is used to characterize the numerical range of the touch parameter of the media type;

determining a first preset threshold interval closest to the touch parameter information among the preset threshold intervals;

The medium type corresponding to the first preset threshold interval is used as the medium type corresponding to the touch object.
The touch data processing method according to claim 15 or 16, wherein the touch parameter information includes information used to represent the area of the touch point corresponding to the touch operation.
The touch data processing method according to claim 15 or 16, wherein, in the step of obtaining the medium type corresponding to the touch object, a confidence interval of the obtained medium type is lower than a set confidence threshold, and the method further include:

The processing device determines, according to the touch position information of the infrared touch data, whether the current touch operation is associated with the last lifted touch operation, and if so, obtains the media type corresponding to the last touch operation, as the medium type corresponding to the touch object.
The touch data processing method according to claim 5, wherein the updating the infrared touch data according to the medium type is specifically:

determining standard touch parameter information for the medium type;

The touch parameter information of the infrared touch data is updated to the standard touch parameter information to obtain the updated infrared touch data.
The touch data processing method according to claim 5, wherein the updating of the infrared touch data according to the medium type is specifically:

The ID corresponding to the medium type is written into the data packet of the infrared touch data, and the infrared touch data is updated.
The touch data processing method according to claim 5, wherein the displaying a corresponding writing track on the display screen according to the updated infrared touch data comprises:

The updated infrared touch data is continuously acquired, and a corresponding writing track is displayed on the display screen according to the updated infrared touch data, until it is confirmed that the infrared touch data is not acquired.
The touch data processing method according to claim 5, wherein the interactive tablet is configured with a writing pen, the writing pen comprises a pen tip and a pen tail, the medium type of the pen tip is a first medium type, and the pen end has a medium type. The medium type is the second medium type, and the method further includes:

After receiving the second medium type sent by the elastic wave detection device, the processing device updates the infrared touch data according to the second medium type, and erases the infrared touch data according to the updated infrared touch data Touch the writing track corresponding to the data.
The touch data processing method according to claim 5, wherein the method further comprises:

The processing device determines that the medium type sent by the elastic wave detection device has not been received within a preset time threshold, and directly displays the corresponding writing track on the display screen according to the infrared touch data.
The touch data processing method according to claim 5, wherein the method further comprises:

The processing device determines that the medium type sent by the elastic wave detection device has not been received within a preset time threshold, acquires the medium type last sent by the elastic wave detection device, and updates the infrared touch according to the medium type. data, and display the corresponding writing track on the display screen according to the updated infrared touch data.
An interactive tablet comprising a display screen, a processing device, an infrared touch frame and an elastic wave detection device, wherein the display screen, the infrared touch frame and the elastic wave detection device are all connected to the processing device;

The infrared touch frame is used to detect infrared touch data and send the infrared touch data to the processing device, wherein the infrared touch data is performed by a touch object in the touch detection area of the interactive tablet when a touch operation is performed generating, the infrared touch data includes touch position information and/or touch parameter information;

the elastic wave detection device for detecting elastic wave signals, wherein the elastic wave signals are generated when the touch object contacts the display screen of the interactive tablet; and

After receiving the infrared touch data sent by the processing device, determine the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal, and sending media type information to the processing device, where the media type information includes a media type corresponding to the touch object;

The processing equipment is used for:

receiving the infrared touch data sent by the infrared touch frame, and sending the infrared touch data to the elastic wave detection device; and

The medium type information sent by the elastic wave detection device is received.
The interactive tablet according to claim 29, wherein the processing device is further configured to, after receiving the medium type information, initiate a response to the received infrared touch data according to the medium type.
The interactive tablet of claim 29, wherein the processing device is further configured to respond to the received infrared touch data before receiving the medium type information.
An interactive tablet comprising a display screen, a processing device, an infrared touch frame and an elastic wave detection device, wherein the display screen, the infrared touch frame and the elastic wave detection device are all connected to the processing device, and the infrared touch frame is connected to the processing device. the frame is connected to the elastic wave detection device;

The infrared touch frame is used to detect infrared touch data, send the infrared touch data to the elastic wave detection device, and send the infrared touch data to the processing device, wherein the infrared touch data is generated by the touch object Generated when a touch operation is performed in the touch detection area of the interactive tablet, the infrared touch data includes touch position information and/or touch parameter information;

the elastic wave detection device for detecting elastic wave signals, the elastic wave signals are generated when the touch object contacts the display screen of the interactive tablet; and

After receiving the infrared touch data sent by the infrared touch frame, determine the media type corresponding to the touch object according to the touch position information and/or touch parameter information of the infrared touch data and the elastic wave signal , and send media type information to the processing device, where the media type information includes the media type corresponding to the touch object;

The processing equipment is used for:

receiving the infrared touch data sent by the infrared touch frame; and

The medium type information sent by the elastic wave detection device is received.
The interactive tablet according to claim 32, wherein the processing device is further configured to, after receiving the medium type information, initiate a response to the received infrared touch data according to the medium type.
The interactive tablet of claim 32, wherein the processing device is further configured to respond to the received infrared touch data before receiving the media type information.