CN111694451B

CN111694451B - Method, device, equipment and storage medium for processing operation data

Info

Publication number: CN111694451B
Application number: CN202010444382.2A
Authority: CN
Inventors: 邱伟波
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2020-05-22
Filing date: 2020-05-22
Publication date: 2024-02-06
Anticipated expiration: 2040-05-22
Also published as: CN111694451A

Abstract

The embodiment of the application discloses an operation data processing method, device, equipment and storage medium, which relate to the technical field of interactive intelligent flat panels and comprise the following steps: processing first operation data currently obtained based on a touch pen; the second operation data received at present are forbidden, the second operation data and the first operation data have at least one same data generation moment, and the distance between a second touch coordinate contained in the second operation data and a first touch coordinate contained in the first operation data is smaller than a preset threshold; after the first operation data is processed, processing third operation data received currently, wherein the third operation data and the second operation data have the same type of operation main body and correspond to different touch operation. By adopting the method, the technical problem that the interactive intelligent tablet performs error processing due to the fact that the hand touches the screen by mistake when a user uses the touch pen in the prior art can be solved.

Description

Method, device, equipment and storage medium for processing operation data

Technical Field

The embodiment of the application relates to the technical field of interactive intelligent flat panels, in particular to an operation data processing method, an operation data processing device, operation data processing equipment and a storage medium.

Background

With the development of intelligent technology, interactive intelligent devices are widely applied to various scenes of daily life. The interactive intelligent panel is widely applied to offices, teaching and other scenes as one of important applications in the interactive intelligent equipment so as to improve the working efficiency and the learning efficiency of people. At present, with the development of touch technology, the interactive intelligent tablet can realize multi-point touch, and touch means are diversified, for example, a user can realize touch operation through a touch pen, and also can realize touch operation through a finger.

The inventors have found that the following drawbacks exist in the prior art in the process of implementing the present invention: when a user uses a stylus to perform touch operation, the situation that the hand of the user is unintentionally touched to the screen occurs due to the limitation of the way of holding the stylus by the user, at this time, the interactive intelligent tablet can detect the touch action of the hand of the user and mistakenly identify the touch action as the touch operation sent by the user, and then mistakenly process the touch operation.

In summary, how to avoid the mishandling condition caused by the mistouching of the screen by the hand of the user when the user uses the stylus is a technical problem to be solved.

Disclosure of Invention

The application provides an operation data processing method, device, equipment and storage medium, which are used for solving the technical problem that in the prior art, when a user uses a touch pen, an interactive intelligent panel performs error processing due to the fact that a hand touches a screen by mistake.

In a first aspect, an embodiment of the present application provides an operation data processing method, including:

processing first operation data received currently, wherein the first operation data are operation data obtained based on a touch pen;

disabling second operation data received currently, wherein the second operation data and the first operation data have at least one same data generation moment, and the distance between a second touch coordinate contained in the second operation data and a first touch coordinate contained in the first operation data is smaller than a preset threshold;

and after the first operation data is processed, processing third operation data which are received currently, wherein the third operation data and the second operation data have operation main bodies of the same category and correspond to different touch control operations.

Further, the disabling the second operation data currently received includes:

receiving second operation data;

Determining a corresponding forbidden processing flow according to the second operation data;

and processing the second operation data according to the forbidden processing flow.

Further, the determining the corresponding disabling process flow according to the second operation data includes:

acquiring a second touch coordinate contained in the second operation data;

and when the second touch control coordinates are determined to fall into the forbidden coordinate area, determining to adopt a first forbidden processing flow.

Further, when the processing is performed on the currently received first operation data, the method further includes:

and determining forbidden coordinate area information according to the first touch coordinates contained in the first operation data.

Further, the first touch coordinate is a hover coordinate when the stylus hovers or a touch coordinate when the stylus touches a display screen.

Further, the determining the forbidden coordinate region information according to the first touch coordinate included in the first operation data includes:

acquiring a first touch coordinate contained in the first operation data;

and generating forbidden coordinate area information according to the preset area size, wherein the first touch coordinate falls into a forbidden coordinate area corresponding to the forbidden coordinate area information.

Further, the method further comprises the following steps:

and when the second touch control coordinates are determined not to fall into the forbidden coordinate area, determining to adopt a second forbidden processing flow.

Further, the disabling process flow is a second disabling process flow,

the processing the second operation data according to the disabling process flow includes:

acquiring a contact identifier corresponding to the second operation data;

determining whether the contact identification is in a disabled state;

and discarding the second operation data if the contact identifier is in a disabled state.

Further, if the contact identifier is in the disabled state, discarding the second operation data includes:

if the contact mark is in a forbidden state, determining whether the second operation data belongs to a new touch drop event or not;

and discarding the second operation data if the touch event does not belong to the new touch event.

Further, the method further comprises the following steps:

and if the contact mark is not in a disabled state, normally processing the second operation data.

Further, the disabling process flow is a first disabling process flow,

Setting a contact mark corresponding to the second operation data to be in a disabled state;

determining whether the supplementary lifting event data packet completes setting of a mark;

discarding the second operation data if the completion flag is set;

if the setting of the mark is not finished, generating a new supplementary lifting event data packet aiming at the second operation data, and finishing the setting of the mark;

and processing the new patch lift event data packet.

Further, when the second operation data currently received is disabled, the method further includes:

and reserving the displayed processing result, wherein the processing result is a display result after the received second operation data is processed before the second operation data is forbidden.

Further, the method further comprises the following steps:

and deleting the forbidden coordinate area information after stopping receiving the first operation data.

Further, the second operation data is operation data obtained based on the hand of the user.

In a second aspect, embodiments of the present application further provide an operation data processing apparatus, including:

the first processing module is used for processing first operation data received currently, wherein the first operation data are operation data obtained based on a touch control pen;

the data disabling module is used for disabling second operation data which are received currently, the second operation data and the first operation data have at least one same data generation moment, and the distance between a second touch coordinate contained in the second operation data and a first touch coordinate contained in the first operation data is smaller than a preset threshold;

And the second processing module is used for processing third operation data received currently after the first operation data are processed, wherein the third operation data and the second operation data have the same type of operation main body and correspond to different touch operation.

In a third aspect, embodiments of the present application further provide an operation data processing apparatus, including:

one or more processors;

a memory for storing one or more programs;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the operational data processing method as described in the first aspect.

In a fourth aspect, embodiments of the present application also provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of processing operational data as described in the first aspect.

According to the operation data processing method, the device, the equipment and the storage medium, the first operation data obtained based on the touch pen is processed, and the received second operation data are forbidden in the processing process, wherein the second operation data and the first operation data have at least one same data generation time, the distance between corresponding touch coordinates is smaller than the preset threshold, and then the technical means of normally processing third operation data with the same type of operation main body as the second operation data after the first operation data are processed can be solved, so that the technical problem that when a user uses the touch pen, the interactive intelligent tablet is subjected to error processing due to the fact that the user touches the screen by hand errors in the prior art can be solved. In the process of processing the first operation data, disabling the second operation data close to the touch pen can effectively avoid error processing caused by error touching of the display screen by the hand, and only disabling the second operation data close to the touch pen by setting a preset threshold value of the distance between touch coordinates, so that the remote operation data can be normally processed, and further correct response of touch operation is ensured when a user uses fingers and the touch pen to perform multi-point touch at the same time. And then, after the first operation data is processed, normally processing third operation data, wherein the third operation data and the second operation data have the same type of operation main body, so that the touch operation sent by the operation main body can be ensured to be correctly responded.

Further, when the second operation data is disabled, a touch lifting event of the hand of the user is simulated in a mode of generating a UP supplementing event data packet, so that an application program of current human-computer interaction responds to the touch lifting event, the UP supplementing event data packet is recorded in a mode of setting a mark, when the second operation data is subsequently received, the second operation data is directly discarded according to the setting of the mark, and further the second operation data is disabled and the logic rationality of the second operation data is ensured to be disabled.

Further, when the second touch coordinate does not fall into the disabled coordinate area, whether the second operation data is disabled can be determined according to the disabled state of the point id, so that when the user moves out of the disabled coordinate area, the response to the touch operation of the user hand is still abandoned, whether the second operation data is disabled is further determined by determining whether the second operation data corresponds to a new touch falling event, the accuracy of processing the second operation data can be guaranteed, and the use experience of the user is improved.

Drawings

FIG. 1 is a flow chart of a method of processing operational data according to one embodiment of the present application;

FIG. 2 is a flow chart of a method of processing operational data according to another embodiment of the present application;

FIG. 3 is a schematic view of stylus hovering provided by an embodiment of the present application;

FIG. 4 is a first schematic diagram of a disabled coordinate area provided in an embodiment of the present application;

FIG. 5 is a second schematic diagram of a disabled coordinate area provided in an embodiment of the present application;

FIG. 6 is a third schematic diagram of a disabled coordinate area provided in an embodiment of the present application;

fig. 7 is a first schematic diagram of a user performing a touch operation using a stylus according to an embodiment of the present application;

fig. 8 is a second schematic diagram of a user performing a touch operation using a stylus according to an embodiment of the present application;

fig. 9 is a third schematic diagram of a user performing a touch operation using a stylus according to an embodiment of the present application;

FIG. 10 is a schematic diagram of an operation data processing device according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of an operation data processing apparatus according to an embodiment of the present application.

Detailed Description

The present application is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are for purposes of illustration and not limitation. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present application are shown in the drawings.

It should be noted that in this document, relational terms such as first and second are used solely to distinguish one entity or action or object from another entity or action or object without necessarily requiring or implying any actual such relationship or order between such entities or actions or objects. For example, "first" and "second" of the first operation data and the second operation data are used to distinguish between two different operation data.

The method for processing operation data provided in the embodiments of the present application may be performed by an operation data processing device, where the operation data processing device may be implemented by software and/or hardware, and the operation data processing device may be configured by two or more physical entities or may be configured by one physical entity. For example, the operational data processing device may be a smart device such as a computer, a cell phone, a tablet, or an interactive smart tablet.

For ease of understanding, the exemplary description of the embodiments is presented in terms of an interactive smart tablet operating a data processing device. The interactive intelligent panel can be integrated equipment for controlling the content displayed on the display panel and realizing man-machine interactive operation through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, sound equipment, a television, a video conference terminal and the like.

Generally, interactive smartpads include at least one display screen. Typically, a display screen of an interactive intelligent panel configuration refers to a touch screen, a touch screen and a touch panel with a touch function, and is an inductive liquid crystal display device. According to the working principle of the display screen and the medium for transmitting information, the display screen can be divided into four types: resistive, capacitive, electromagnetic, and infrared induction. The touch module arranged in the display screen bears the touch detection work. When a user touches the display screen by using a hand or a stylus, parameters acquired by the electrical elements corresponding to the touch positions detected in the touch module are changed, the touch positions can be determined according to the parameter change conditions, and further operation data are generated and reported to the processor of the interactive intelligent flat panel, so that the interactive intelligent flat panel processor processes the operation data. In an embodiment, the display screen may be a single touch screen or a combined touch screen, where the combined touch screen refers to a display screen including at least two types of touch modules, and further, a combination mode embodiment of the touch modules is not limited, for example, a combination mode of an infrared touch module+an electromagnetic touch module, an electromagnetic touch module+a capacitive touch module, and the like is adopted. Typically, for a touch operation, the interactive intelligent tablet may generate a DOWN event and an UP event according to operation data, where the DOWN event refers to an event that a user hand or a stylus touches the display screen, i.e., a touch DOWN event, and the UP event refers to an event that the user hand or the stylus leaves the display screen, i.e., a touch UP event, through which a touch operation can be identified. It can be appreciated that in the prior art, when the user's hand or stylus is close to the display screen and has not yet contacted the display screen, the touch module can detect the user's hand or stylus, and therefore, the DOWN event can also refer to an event that the user's hand or stylus is close to the display screen and can be detected. If the user's hand or stylus is still moving in the display after touching the display, the interactive smart tablet may generate a MOVE event, which may also be understood as a MOVE event.

Further, the interactive smart tablet is installed with at least one type of operating system, wherein the operating system includes, but is not limited to, an android system, a Linux system, and a Windows system. Further, the interactive smart tablet may install at least one application based on the operating system. For example, an electronic whiteboard application is installed in the interactive smart board to implement the electronic whiteboard function. The application program may be an application program of the operating system, or may be an application program downloaded from a third party device or a server. When a user selects an application program as an application program of the current man-machine interaction, if the user performs touch operation, a processor of the interactive intelligent tablet receives operation data generated by the touch module, processes the operation data (such as generating a data packet corresponding to a DOWN event, a MOVE event or an UP event) and sends the operation data to the application program of the current man-machine interaction, and the application program processes according to the received data packet and displays a corresponding processing result in a display screen.

Specifically, fig. 1 is a flowchart of a method for processing operation data according to an embodiment of the present application. The present embodiment is not limited to the application program of the current man-machine interaction. Referring to fig. 1, the operation data processing method includes the steps of:

Step 110, processing first operation data currently received, where the first operation data is operation data obtained based on a stylus.

In one embodiment, the stylus is an active pen, which may also be understood as an active pen. The touch pen can perform touch operation on the interactive intelligent tablet, and when the touch pen performs touch operation, if the display screen is configured with the electromagnetic touch module, the electromagnetic touch module can receive a touch signal emitted by the touch pen, so as to receive touch operation of the touch pen relative to the touch signal; if the display screen is provided with the infrared touch module, the infrared touch module can identify the touch position corresponding to the touch pen through blocking the infrared signal by the touch pen, and further receive touch operation corresponding to the touch position; if the display screen is provided with the capacitive touch module, the capacitive touch module can identify the touch position of the touch pen through the capacitance change brought by the touch pen during contact, and further receive touch operation corresponding to the touch position; if the display screen is configured with the voltage type touch module, the voltage type touch module can identify the touch position of the touch pen through the voltage generated when the touch pen contacts, and further receive touch operation corresponding to the touch position.

After the touch module detects touch operation, operation data are generated and reported to the processor of the interactive intelligent panel for subsequent processing. In an embodiment, operation data obtained based on the stylus is recorded as first operation data. The embodiment of the data interface used when reporting the first operation data is not limited. Typically, the content of the first operation data may be set according to the actual situation, and in one embodiment, the first operation data includes at least a touch position and a data generation time. The touch position may be embodied by means of touch coordinates. Specifically, a coordinate system is established in the display screen, and the numerical range embodiment of the coordinate system is not limited. Correspondingly, the touch module stores relevant data of the coordinate system, the position of each coordinate point in the coordinate system can be detected, when the touch pen executes touch operation, the touch module can acquire the touch coordinate and acquire corresponding data generation time, and then the touch coordinate and the data generation time are written into the first operation data. The above-mentioned data generation time may also be understood as time when a touch operation is detected, and since the touch module detects the touch operation according to a certain frequency, when the touch operation is detected, multiple frames of first operation data are generated according to the detection frequency, and at this time, each frame of first operation data corresponds to one data generation time. When the touch pen continuously performs the touch operation, the interactive intelligent flat panel processor continuously receives multi-frame first operation data until the touch operation is finished. The first operation data mentioned in the embodiment may be understood as one frame of operation data generated at the current data generation time during one touch operation of the stylus.

Typically, after receiving the first operation data, the first operation data is processed, that is, the touch operation corresponding to the first operation data is responded. For example, when the stylus is currently in the writing process, after the first operation data is received, the touch coordinates and the data generation time in the first operation data are acquired, and then the corresponding MOVE event data packet is generated according to the touch coordinates and the data generation time. And then sequentially sending the MOVE event data packets to an application program of the current man-machine interaction, and displaying a writing track at a position corresponding to the touch coordinate by the application program according to the MOVE event data packets.

It should be noted that the stylus may also be in data communication with the interactive smart tablet, for example, by bluetooth or wireless means. The specific content embodiment of the data communication is not limited, and for example, when the stylus is paired with the interactive smart tablet, the unique identifier of the device may be transmitted. For another example, when the stylus performs a touch operation, data such as an inclination angle may be sent to the interactive smart tablet.

Step 120, disabling second operation data currently received, where the second operation data and the first operation data have at least one same data generation time, and a distance between a second touch coordinate included in the second operation data and a first touch coordinate included in the first operation data is smaller than a preset threshold.

The second operation data is operation data generated by the user by erroneously touching the display screen when using the stylus. In general, the touch position when the user touches the display screen by mistake is very close to the current touch position of the stylus, and therefore, the second operation data may also be understood as operation data generated by a touch operation closer to the touch position of the stylus. Typically, the operation subject of the second operation data may be a user's hand, or may be another subject. The operation main body is a main body capable of performing touch operation on the interactive intelligent tablet. Optionally, the operation subject of the second operation data excludes the stylus to distinguish the second operation data from the first operation data.

In one embodiment, the description is given taking an operation body of the second operation data as an example of a user hand, where the second operation data is operation data obtained based on the user hand, that is, the second operation data is operation data generated by the touch module when the user hand touches the display screen. It can be understood that, in a single touch process, the touch module generates at least one frame of second operation data. The second operation data at least comprises touch coordinates and data generation time. Further, when the user touches the display screen multiple times, each touch corresponds to a set of second operation data, and each set of second operation data may include multiple frames of second operation data, each frame of second operation data corresponds to one data generation time. The second operation data mentioned in the embodiment refers to one frame of second operation data generated at the current data generation time in the process of one touch of the hand of the user.

In general, touch operations of a stylus and a hand can be distinguished by a hover distance or a touch area. For example, taking a capacitive touch module as an example, when a stylus hovers 1cm from a display screen, the capacitive touch module may detect the presence of the stylus, where hovering may be understood as the stylus approaching the display screen but not touching the display screen. When the hand of the user hovers 3mm away from the display screen, the capacitive touch module can detect the existence of the hand of the user, and at the moment, the hand of the user and the touch pen can be distinguished according to the hovering distance. For another example, the area of the pen tip of the stylus is limited and smaller than the area of the fingers and the palm of the user, and when the stylus contacts the display screen, the area of the touch coordinates occupied by the stylus is smaller than the area of the touch coordinates occupied by the hand of the user when the hand of the user contacts the display screen, so that the hand of the user and the stylus can be distinguished according to the touch area. Further, the touch module adopts different data interfaces to upload the operation data of the hand of the user and the operation data of the touch pen, so that the processor of the interactive intelligent tablet can distinguish the two operation data according to the data interfaces.

Specifically, if a user touches the display screen by mistake when using the stylus, the touch module detects two types of touch operations at the same time and generates first operation data and second operation data respectively, so that an intersection exists between the second operation data and the data generation time of the first operation data. In practical application, when a user uses a stylus, if the hand of the user touches the display screen by mistake, three situations can occur: the user's hand touches the display screen before the stylus, the user's hand touches the display screen with the stylus at the same time, and the user's hand touches the display screen after the stylus. In either case, the multi-frame first operation data and the multi-frame second operation data may include at least one identical data generation timing.

Further, when the user uses the stylus, the operation of the false touch display screen is generally located near the touch position of the stylus, and thus, whether or not the false touch operation exists can be determined in a distance-limited manner. Taking the example of mistakenly touching the display screen by the hand of the user, when the user holds the touch pen, if the hand of the user does not touch the display screen by any intention, the distance between the touch position corresponding to the hand of the user and the touch position of the touch pen is relatively short, so that whether the second operation data is the operation data generated by the fact that the user does not touch the display screen by any intention can be determined by confirming the distance between the first touch coordinate and the second touch coordinate, wherein the first touch coordinate is the touch coordinate corresponding to the touch pen, and the second touch coordinate is the touch coordinate corresponding to the hand of the user. In one embodiment, if the distance between the second touch coordinate and the first touch coordinate is smaller than the preset threshold, it may be determined that the second operation data is operation data generated by the user unintentionally touching the display screen. The specific value of the preset distance can be set according to actual conditions. Optionally, when determining whether the distance between the second touch coordinate and the first touch coordinate is smaller than the preset threshold, calculating the distance between the first touch coordinate and the second touch coordinate corresponding to the current data generation time, and comparing the distance with the preset threshold, where it is required to explain that if only the first touch coordinate or the second touch coordinate exists at the current data generation time, it is not necessary to calculate the distance or directly determine that the distance is larger than the preset threshold; the method may further include generating a coordinate area based on the first touch coordinate, where the size and the embodiment of the generation rule of the coordinate area are not limited, and in the embodiment, the area is marked as a forbidden coordinate area. It will be appreciated that when the first touch coordinates change, the disabled coordinate area follows the change. If the second touch coordinate corresponding to the current data generation time falls into the forbidden coordinate region corresponding to the current data generation time, it can be determined that the distance between the second touch coordinate and the first touch coordinate is smaller than a preset threshold.

It is understood that the second operation data and the first operation data have at least one same data generation time, and the disabling determination condition of the second operation data may also be understood that the distance between the second touch coordinate included in the second operation data and the first touch coordinate included in the first operation data is smaller than the preset threshold. For example, when the second operation data and the first operation data are currently received at the same data generation time and the distance between the touch coordinates is smaller than the preset threshold, it may be determined that the second operation data currently received meets the disabling determination condition, that is, the second operation data is operation data generated by the user by not touching the display screen, and the second operation data is disabled. Optionally, after the disabling determination condition is met, it may also be directly determined that the disabling determination condition is met, that is, the subsequently received second operation data is disabled, for the subsequently received second operation data. Optionally, after the disabling determination condition is met, it is determined that all second operation data generated in the current touch process meets the disabling determination condition, that is, all second operation data received this time are disabled.

Further, disabling the second operation data means that the processing result related to the second operation data is not displayed in the display screen. Optionally, disabling the second operation data includes two data processing methods, one for discarding the second operation data and one for generating a UP event packet based on the second operation data. Discarding the second operation data may also be understood as discarding the second operation data, where the application program of the current human interaction does not receive any data packets related to the second operation data. Generating the UP supplement event data packet based on the second operation data refers to simulating touch operation corresponding to the second operation data as an UP event when the second operation data is processed, generating a corresponding UP supplement event data packet, then sending the UP supplement event data packet to an application program of current man-machine interaction, and then the application program responds to the UP supplement event data packet, namely, whether a user finishes the false touch operation or not in actual situations, and the application program determines that the user finishes the false touch operation. Optionally, in the process of the user error touch operation, if the multi-frame second operation data is generated, the multi-frame second operation data can be disabled by combining the two modes of generating the UP event data packet and discarding the second operation data. For example, for the second operation data of the first frame, when the second operation data meets the disabling judgment condition, a UP supplementing event data packet is generated, so that the application program of the current man-machine interaction determines that the user mistakenly touches the operation end. Then, as the application program of the current man-machine interaction already determines that the user error touch operation is finished, for the second operation data received subsequently, the processor of the interactive intelligent tablet can directly discard the second operation data.

It can be understood that when the user continues to perform the false touch operation, the processor of the interactive intelligent tablet may continuously receive the multi-frame second operation data, and at this time, process each frame of second operation data in sequence, that is, determine whether each frame of second operation data meets the disabling determination condition in sequence, and discard the second operation data or generate the corresponding UP supplement event data packet when the disabling determination condition is met. Optionally, since there may be second operation data that does not satisfy the disabling condition in the multi-frame second operation data, it may be set that all the second operation data in the current touch process are disabled when any frame of the second operation data in the multi-frame second operation data that is continuously received satisfies the disabling condition. Alternatively, for the continuously received multi-frame second operation data, only the operation data satisfying the disable determination condition is disabled. Or, if the second operation data of a certain frame is the second operation data of which the first frame satisfies the disabling judgment condition, disabling the frame and the second operation data received after the frame, and at this time, performing normal processing on the second operation data before the frame. In the embodiment, description is made taking, as an example, the second operation data received before the normal processing satisfies the disabling determination condition, at this time, if the processing result related to the second operation data has been displayed in the display screen before the second operation data is disabled, the processing result may be retained. I.e., disable the received second operation data, further comprising: and reserving the displayed processing result, wherein the processing result is a display result after the received second operation data is processed before the second operation data is forbidden. For example, when the user uses the stylus, the user's hand touches the display screen before the stylus touches the display screen, at this time, the interactive intelligent tablet first processes the touch operation of the user's hand, the corresponding processing result is that the eraser is displayed, and the writing track on the moving path of the eraser is erased, after that, when the touch operation of the stylus is detected, it is determined that the first operation data currently corresponding to the stylus and the second operation data currently corresponding to the eraser have the same data generation time, and the distance between the second touch coordinate included in the second operation data and the first touch coordinate included in the first operation data is smaller than the preset threshold, at this time, the current second operation data and the second operation data received subsequently begin to be disabled, and because the second operation data is already disabled, the touch operation of the hand no longer corresponds to the eraser function, so the displayed eraser is deleted. In contrast, since the second operation data has been processed before the first operation data is received and the processing result is that part of the writing track is deleted, the current processing result is preserved when the second operation data is disabled.

It can be understood that if the second operation data does not meet the disabling determination condition, the second operation data is processed normally, and at this time, the user's hand and the stylus may be considered to control the interactive smart tablet at the same time.

It should be noted that, during the process of using the stylus by the user, multiple false touch operations may occur, and at this time, the second operation data generated by touching the display screen each time is disabled. In addition, in the process that the user uses the touch pen, multi-point touch control can be simultaneously performed, at the moment, the interactive interaction panel can simultaneously receive a plurality of second operation data, and whether each second operation data needs to be disabled or not can be sequentially determined.

And 130, after the first operation data is processed, processing third operation data which are received currently, wherein the third operation data and the second operation data have the same type of operation main body and correspond to different touch operation.

The third operation data has the same type of operation subject as the second operation data, for example, when the second operation data is the operation data obtained based on the hand of the user, then the third operation data is also the operation data obtained based on the hand of the user. The same operation subject category does not mean that the second operation data and the third operation data belong to the same operation subject. Taking a hand of a user as an example, the second operation data and the third operation data may be operation data generated by performing touch operations on hands of different users or different fingers of the same user.

After the first operation data is processed, confirming that the touch pen leaves the display screen. At this time, if the touch module detects the touch operation with the same operation main body as the second operation data again, the operation data is generated and sent to the processor of the interactive intelligent tablet, and then the processor receives the operation data corresponding to the touch operation and processes the operation data normally. In the embodiment, the operation data having the same operation subject as the second operation data received again is noted as the third operation data. It will be appreciated that the third operation data may also be considered as operation data corresponding to a new DOWN event, i.e. the third operation data and the second operation data are generated for different touch operations. The generation manner of the third operation data is the same as that of the second operation data, and will not be described here.

It can be understood that if the touch operation of the stylus is detected again during the process of processing the third operation data, and the third operation data meets the disable determination condition, the third operation data is disabled continuously.

Optionally, after the first operation data is processed. If the second operation data can be received, the second operation data is continuously disabled until the second operation data is not received.

According to the technical means, the first operation data obtained based on the touch pen is processed, and the received second operation data is forbidden in the processing process, wherein the second operation data and the first operation data have at least one same data generation time, the distance between corresponding touch coordinates is smaller than the preset threshold, and after the first operation data are processed, the third operation data with the same operation main body as the second operation data are normally processed, so that the technical problem that in the prior art, when a user uses the touch pen, the interactive intelligent tablet is subjected to error processing due to the fact that the user touches the screen by hand errors can be solved. In the process of processing the first operation data, disabling the second operation data close to the touch pen can effectively avoid error processing caused by error touching of the display screen by the hand, and only disabling the second operation data close to the touch pen by setting a preset threshold value of the distance between touch coordinates, so that the remote operation data can be normally processed, and further, when a user performs touch operation by using a finger and the touch pen at the same time, correct response of the touch operation is ensured. After the first operation data is processed, the touch operation newly sent by the operation main body corresponding to the second operation data is processed normally, so that the correct response to the touch operation can be ensured, and the use experience of a user is improved.

Fig. 2 is a flowchart of a method for processing operation data according to another embodiment of the present application. The operation data processing method provided in the present embodiment is embodied on the basis of the above embodiment, and is specifically embodied for the processing means of the operation data. In this embodiment, the second operation data is operation data obtained based on the hand of the user. Referring to fig. 2, the operation data processing method specifically includes:

step 210, processing first operation data currently received, and determining forbidden coordinate area information according to first touch coordinates contained in the first operation data, wherein the first operation data is operation data obtained based on a touch pen.

In one embodiment, the first touch coordinate is a hover coordinate when the stylus hovers or a touch coordinate when the stylus touches a display screen. Specifically, when the perpendicular distance between the stylus and the display screen is smaller than or equal to the maximum sensing distance, the interactive intelligent tablet can still detect the stylus even if the stylus does not touch the display screen, and at this time, the stylus can be considered to be in a hovering state. For example, fig. 3 is a schematic view of a hovering touch pen provided in an embodiment of the present application, and referring to fig. 3, the touch pen 2 is not currently in contact with the interactive smart tablet 1. The distance between the stylus 2 and the display screen of the interactive smart tablet 1 is denoted by L, and when L is less than or equal to the maximum sensing distance, the interactive smart tablet 1 considers that the stylus 2 is in a hovering state. The maximum sensing distance can be set according to practical situations, for example, the maximum sensing distance is 1cm, and at this time, when the perpendicular line distance between the stylus pen point and the display screen is smaller than or equal to 1cm, the interactive intelligent flat panel detects that the stylus is close, and the corresponding hovering coordinate can be confirmed. The hover coordinate may be understood as a touch coordinate corresponding to an electrical component in the touch module that detects proximity of the stylus. It can be appreciated that when the stylus hover position changes, the hover coordinate sync changes. Typically, when the stylus touches the display screen, the touch coordinates may be determined according to the touch position corresponding to the touch operation. It can be appreciated that the touch coordinates change synchronously with the change in touch position. The interactive smart tablet can obtain the first operational data whether the stylus is in a hover state or in a touch state with the display screen.

Further, when the first operation data is processed, forbidden coordinate area information can be obtained according to the first touch coordinate. It can be understood that each data generation time corresponds to one forbidden coordinate region information, that is, the forbidden coordinate region information is generated in real time according to the current first touch coordinate. And when the first touch coordinates are changed, disabling synchronous change of the coordinate area information. It should be noted that, by disabling the coordinate area information, a coordinate area may be obtained in the display screen, where the coordinate area is an area that is easily touched by a user by mistake when using the stylus.

The forbidden coordinate area generated according to the forbidden coordinate area information comprises corresponding first touch coordinates, and a specific generation rule of the forbidden coordinate area information can be set according to actual conditions. In an embodiment, in order to reduce the data processing amount, the disabled coordinate area is set to have a fixed size and shape. At this time, the setting of the forbidden coordinate area information according to the first touch coordinate included in the first operation data includes steps 211-212:

step 211, obtaining a first touch coordinate included in the first operation data.

Specifically, a first touch coordinate obtained at the current data generation moment in the first operation data is obtained.

And 212, generating forbidden coordinate area information according to a preset area size, wherein the first touch coordinate falls into a forbidden coordinate area corresponding to the forbidden coordinate area information.

Specifically, the preset area size may be set according to the actual situation. The size and shape of the forbidden coordinate region may be defined by a preset region size, i.e., specific parameters of the size and shape in the forbidden coordinate region information are defined. The forbidden coordinate area is an area obtained in a display screen coordinate system according to the forbidden coordinate area information. For example, a preset area size is set to be a circular area and a radius is set to be 20cm, and correspondingly, the parameter of the shape in the forbidden coordinate area information is set to be a circle, and the parameter of the size is set to be a radius of 20cm.

When the forbidden coordinate region information is generated according to the preset region size, the position of the first touch coordinate can be referred to, so that the corresponding forbidden coordinate region can be ensured to contain the first touch coordinate. For example, fig. 4 is a first schematic diagram of a forbidden coordinate region provided in the embodiment of the present application, referring to fig. 4, the first touch coordinate 11 is taken as the center of the forbidden coordinate region, and then forbidden coordinate region information corresponding to the forbidden coordinate region 12 is generated according to a preset region size (a circle in fig. 4). For another example, fig. 5 is a second schematic diagram of a disabled coordinate area provided in an embodiment of the present application. Referring to fig. 5, the first touch coordinates 11 are taken as left boundary points of the forbidden coordinate regions, and then forbidden coordinate region information corresponding to the forbidden coordinate regions 12 is generated according to a preset region size (circular shape in fig. 5). As another example, fig. 6 is a third schematic diagram of a disabled coordinate area provided in an embodiment of the present application. Referring to fig. 6, the first touch coordinate 11 is taken as the left vertex of the forbidden coordinate region, and then forbidden coordinate region information corresponding to the forbidden coordinate region 12 is generated according to a preset region size (rectangle in fig. 6). It can be appreciated that in practical application, the first touch coordinate may be set as any point in the forbidden coordinate region according to the requirement. In practical application, the forbidden coordinate area may not be displayed in the display screen, that is, the interactive intelligent tablet only needs to generate forbidden coordinate area information, and does not need to display the corresponding forbidden coordinate area in the display screen.

It will be appreciated that the forbidden coordinate area information exists in real time during operation of the stylus. And correspondingly, deleting the forbidden coordinate region information after stopping receiving the first operation data. Specifically, after the touch pen is confirmed to finish the touch operation, namely after the first operation data is no longer received, the current forbidden coordinate area information is deleted. And after detecting a new touch operation of the stylus, generating the forbidden coordinate area information again. Optionally, considering that in practical application, the touch pen leaves the display screen first and the hand holding the pen is still on the display screen, in this case, in order to ensure accurate processing of the second operation data, it may be necessary to continue to use the forbidden coordinate area information to determine the second operation data. Therefore, after confirming that the first operation data is stopped being received, whether the second operation data is continuously received is determined, if the second operation data is not received, the hands of the user are confirmed to leave the display screen, and the forbidden coordinate area information is deleted. If the second operation data is received, confirming that the hand of the user does not leave the display screen, continuing to use the forbidden coordinate area information, and deleting the forbidden coordinate area information after stopping receiving the second operation data. At this time, the disabled coordinate area information that is continuously used is disabled coordinate area information corresponding to the time when the last data of the first operation data was generated.

Step 220, receive the second operation data.

And continuously receiving a plurality of frames of second operation data in the process that the hand of the user touches the display screen.

And 230, determining a corresponding forbidden processing flow according to the second operation data.

The disabling process flow refers to a process flow adopted when the second operation data is disabled. Specifically, the disabling process flow may be preset, and the disabling process flow may be directly used when the second operation data is disabled.

In practical applications, there may be a case where the second touch coordinate is located outside the disabled coordinate area, at this time, the second operation data may still need to be disabled, for example, after the user's hand moves from the inside of the disabled coordinate area to the outside of the disabled coordinate area, the second operation data may still need to be disabled. Therefore, a different disabling process flow is required to ensure that the accuracy of the second operational data is disabled. Accordingly, in one embodiment, step 230 specifically includes steps 231-234:

step 231, obtaining a second touch coordinate included in the second operation data.

And acquiring the second touch coordinates corresponding to each data generation moment in real time.

And 232, judging whether the second touch coordinate falls into a forbidden coordinate area. And when the second touch coordinate is determined to fall into the forbidden coordinate area, executing step 233. When it is determined that the second touch coordinate does not fall into the disabled coordinate area, step 234 is performed.

Because the user's hand has a certain area, the second touch coordinates corresponding to the current data generation time may include one or more touch coordinates. If the second touch coordinate comprises a touch coordinate, determining whether the touch coordinate falls into a forbidden coordinate region. If the disabled coordinate area is fallen, step 233 is executed, otherwise step 234 is executed. If the second touch coordinate comprises a plurality of touch coordinates, determining whether the touch coordinates falling into the forbidden coordinate area exist in the plurality of touch coordinates. If yes, it is determined that the second touch coordinate falls within the forbidden coordinate region, step 233 is executed, and if not, it is determined that the second touch coordinate does not fall within the forbidden coordinate region, step 234 is executed.

Typically, since the forbidden coordinate area information accompanies the operation process of the stylus, after the second operation data is received, it is determined whether a forbidden coordinate area corresponding to the forbidden coordinate area information exists, and if the forbidden coordinate area exists, it is confirmed that the second operation data and the first operation data have the same data generation time. Then, whether the second touch coordinate falls into the disabled coordinate area is determined, if so, it is indicated that the distance between the second touch coordinate and the first touch coordinate corresponding to the same data generation time is smaller than a preset threshold, and step 233 is executed at this time. If no forbidden coordinate region exists, it may be determined that the second operation data does not fall within the forbidden coordinate region, and step 234 is performed.

Step 233, determining to employ a first disabling process.

If the second touch coordinates fall into the forbidden coordinate area, the second operation data corresponding to the current data generation time is the operation data generated by the error touch of the display screen by the hand of the user, so that the second operation data is determined to be processed by adopting the first forbidden processing flow. The first disabling process is mainly used for defining how to disable the second operation data falling in the disabled coordinate area.

Step 234, determining to employ a second disabling process.

The second disabling process is applicable to the case that the second touch coordinate does not fall into the disabling coordinate area, and is mainly used for prescribing how to process the second operation data when the second operation data does not fall into the disabling coordinate area, so as to achieve the purpose of accurately disabling the second operation data.

It will be appreciated that while the reception of multiple frames of second operation data continues, it is necessary to determine the disabling process flow of each frame of second operation data in turn.

And 240, processing the second operation data according to the forbidden processing flow.

After determining the disabling process flow, the second operational data may be processed according to the disabling process flow.

In one embodiment, under the first disabling process, the processing manner adopted to disable the second operation data includes: discarding the second operation data or generating the UP event data packet, and the interactive intelligent tablet may select an accurate processing manner according to the first disabling process flow, so when the disabling process flow is the first disabling process flow, step 240 includes steps 241-245:

And 241, setting a contact identifier corresponding to the second operation data to be in a disabled state.

Specifically, when the user hand performs the touch operation, the touch operation has a corresponding contact identifier. In general, operation data generated by one touch operation has the same contact identifier. The rule for generating the contact identifier may be set according to the actual situation, for example, if the user performs only one touch operation at a time, the same contact identifier may be corresponding to each touch operation. For example, the user performs writing operation on the hand, and at this time, the interactive intelligent tablet detects that a writing track is currently written, and sets the contact identifier corresponding to the writing track to 0. After the writing is finished, the interactive intelligent flat plate detects a new writing track again, and then the contact mark corresponding to the writing track can be set to be 0. If the user hand simultaneously sends out a plurality of touch operations, the touch operations correspond to different contact marks so as to realize the distinction of different touch operations. For example, the user performs writing operation on the hand, and at this time, the interactive intelligent tablet detects that a writing track is currently written, and sets the contact identifier corresponding to the writing track to 0. After that, when the writing is not finished, the interactive intelligent tablet detects a new writing track, and then the contact mark corresponding to the writing track can be set to be 1 so as to distinguish two writing tracks which are performed simultaneously. For another example, the contact identifiers are set according to the touch sequence, and adjacent touch operations correspond to different contact identifiers. For example, when the contact identifier corresponding to the currently received touch operation is 0 and the contact identifier of the subsequently received touch operation is 1, and then the touch operation is received again after the first touch operation is finished, the corresponding touch identifier may be set to 0. In one embodiment, the point id is used to represent the contact identifier, and the point id is generated when the touch module detects the touch operation of the hand of the user, and at this time, the second operation data of each frame further includes the corresponding point id. It should be noted that, the embodiment is not limited to whether the corresponding point id exists in the touch operation sent by the stylus.

And when the second touch coordinate falls into the forbidden coordinate area, acquiring the current point id. Thereafter, the point id is set to a disabled state, wherein the disabled state may be represented by a set character, for example, the disabled state is represented by 1, and at this time, the disabled state corresponding to the current point id is set to 1. After the disabled state is set, if second operation data of other frames are received subsequently, the disabled state can be directly determined according to the point id.

Step 242, determining whether the supplemental lift event packet is complete with flag set. If the completion flag is set, step 243 is performed. If the incomplete flag is set, step 244 is performed.

The UP event data packet may be recorded as a UP event data packet, where the UP event data packet is generated in the same manner as the UP event data packet is generated when the UP event is detected by the interactive intelligent tablet, and details are not described herein. In practical application, when the user touches the display screen, the user moves the hand from the outside of the forbidden coordinate area to the inside of the forbidden coordinate area, and at this time, the interactive intelligent tablet should forbid the second operation data generated by the user hand. Therefore, when it is confirmed that the hand moves from outside the disabled coordinate area to inside the disabled coordinate area, that is, when it is determined that the hand reaches the boundary coordinates of the disabled coordinate area, a UP event data packet needs to be generated to notify the application program of man-machine interaction that the hand of the user has left the display screen currently. I.e., the UP event data package functions to simulate UP events for the user's hands off the display screen. It can be understood that, only if the user hand leaves the display screen, the application program of the current man-machine interaction confirms that the touch operation ends and stops responding to the corresponding touch operation, that is, only after the UP event that simulates the user hand leaves the display screen, the application program of the current man-machine interaction determines that the user hand leaves the display screen, and then, for the second operation data received subsequently, the processor of the interactive intelligent tablet can directly discard the second operation data.

The flag is set to indicate whether a UP event packet has been generated. The completion flag is set, which indicates that the UP event packet has been generated for the current touch operation, i.e. the UP event that the user's hand has left the display screen has been simulated, so the second operation data currently received may be directly discarded, i.e. step 243 is performed. If the incomplete flag is set, it indicates that the UP event that the user's hand left the display has not been simulated, and therefore, step 244 is performed.

Step 243, discarding the second operation data.

Discarding the second operation data may also be understood as not processing the second operation data any more, at this time, the interactive smart tablet may not send any data packet to the application program of the current human-computer interaction based on the second operation data, i.e. may not instruct the application program of the current human-computer interaction to perform any response.

Step 244, generating a new patch lift event data packet for the second operation data, and completing setting a flag. Step 245 is performed.

Since there is currently no UP event that simulates the user's hand leaving the display screen, it is necessary to simulate the UP event, i.e., generate a new supplemental lift event package. And, a flag needs to be set to directly discard the subsequent received second operation data.

The specific operation sequence embodiment for generating the new lift-off event packet and setting the flag for the new lift-off event packet is not limited.

Step 245, processing the new lift-off event data packet.

Specifically, a new supplementary lifting event data packet is sent to the current man-machine interaction application program, so that the current man-machine interaction application program stops responding to the touch operation corresponding to the second operation data, namely after the current man-machine interaction application program receives the new supplementary lifting event data packet, the touch operation corresponding to the second operation data is determined to be finished, and only the previous processing result of the second operation data is reserved.

It will be appreciated that the process flow shown in steps 241-245 is specific to what is specified for the first disabling process flow.

In one embodiment, under the second disabling process, the second operation data is disabled in a processing manner of discarding the second operation data, so when the disabling process is the second disabling process, step 240 includes steps 246-248:

step 246, obtaining a contact identifier corresponding to the second operation data.

In practical applications, there are situations where the user's hand moves from inside the disabled coordinate area to outside the disabled coordinate area, for which case it is still necessary to disable the corresponding second operation data. Alternatively, the stylus may leave the display first and leave the display after the user's hand, at which point the second operation data generated based on the user's hand touch still needs to be disabled. Therefore, when the fact that the second touch coordinate does not fall into the forbidden coordinate area is confirmed, the contact point identification corresponding to the second operation data of the current frame is acquired first.

Step 247, determining whether the contact identification is in a disabled state. If the contact identification is in a disabled state, step 248 is performed. If the contact identification is not in a disabled state, step 249 is performed.

It is confirmed whether the contact identification belongs to a disabled state. If the contact identifier is in the disabled state, it indicates that the second touch coordinates included in the second operation data of the previous frame having the same contact identifier once fall within the disabled coordinate area, so that the current second operation data needs to be disabled, i.e. step 248 is performed. If the contact identifier is not in the disabled state, it indicates that the second touch coordinate included in the second operation data of the previous frame having the same contact identifier does not fall into the disabled coordinate area, and at this time, step 249 is performed.

Step 248, discarding the second operation data.

Typically, considering that in practical application, after the generation rule of the contact identifier is set, there is a case that two touch operations performed by the user's hand have the same contact identifier, at this time, if the contact identifier corresponding to the previously received touch operation belongs to the disabled state, the response of the interactive smart tablet to the subsequently received touch operation will be affected, so, in an embodiment, in order to prevent the occurrence of the foregoing situation, the setting step 248 includes steps 2481-2482:

Step 2481 is executed to determine whether the second operation data belongs to a new touch down event. If the new touch down event is not included, step 2482 is performed. If the new touch down event is included, step 249 is performed.

The touch DOWN event may also be understood as a DOWN event. Specifically, it is determined whether the currently received second operation data belongs to a new touch DOWN event, that is, whether the current frame second operation data is second operation data generated based on a DOWN event, wherein whether the current second operation data belongs to the new DOWN event may be determined by comparing a data generation time between the current second operation data and the previous frame second operation data and a second touch coordinate. Further, if the second operation data is the second operation data generated based on the DOWN event, it is indicated that the second operation data belongs to a new touch drop event, that is, the second operation data is operation data corresponding to a touch operation performed by the user's hand newly. Thus, step 249 is performed. Optionally, after determining the new touch drop event, the point id may be modified to a non-disabled state, and when it is determined that the touch coordinate corresponding to the new touch drop event falls within the disabled coordinate area again, the point id is modified to the disabled state. If the second operation data is not the second operation data generated based on the DOWN event, that is, it is confirmed that the second operation data is still the sub-operation data generated based on the MOVE event (MOVE event after the UP event has been simulated), at this time, it may be considered that the user's hand has not left the display screen, and thus, step 2482 needs to be performed.

Step 2482, discarding the second operation data.

Step 249, the second operation data is processed normally.

The normal processing of the second operation data may be understood as sending a data packet (such as a UP event data packet, or a DOWN event data packet, a MOVE event data packet, etc. generated according to a new touch drop event) corresponding to the current second operation data to the application program of the current man-machine interaction, so that the application program responds according to the data packet.

It will be appreciated that the process flows shown in steps 246-248 are specific to what is specified for the first disabling process flow.

Step 250, after the first operation data is processed, processing the third operation data currently received, where the third operation data and the second operation data have the same type of operation main body and correspond to different touch operations.

According to the technical means, the first operation data obtained based on the touch pen are processed, the forbidden coordinate area information is determined according to the first operation data in the processing process, whether the second touch coordinate contained in the second operation data falls into the forbidden coordinate area corresponding to the forbidden coordinate area information is determined, if the second touch coordinate falls into the forbidden coordinate area, the first forbidden processing flow is adopted to disable the second operation data obtained based on the hand of the user, after the first operation data are processed, the corresponding third operation data are normally processed for new touch operation sent by the hand of the user, and the technical problem that in the prior art, when the user uses the touch pen, the interactive intelligent flat panel is subjected to error processing due to error touch of the hand can be solved. In the process of processing the first operation data, the second operation data corresponding to the hand of the user close to the touch pen is forbidden in a mode of setting the forbidden coordinate area, so that mishandling caused by mistouching of the display screen by the hand can be effectively prevented. Further, when the second operation data is disabled, a touch lifting event of the hand of the user is simulated by generating a supplementary UP event data packet, so that an application program of current man-machine interaction responds to the touch lifting event, and the supplementary UP event data packet is recorded by setting a flag, so that when the second operation data is subsequently received, the second operation data is directly discarded according to the setting of the flag, and the logic rationality of disabling the second operation data can be ensured. Further, when the second touch coordinate does not fall into the disabled coordinate area, the second disabling process flow may collect the second operation data, that is, determine whether to disable the second operation data according to the disabled state of the point id, so as to still discard the response to the touch operation of the hand of the user when the hand of the user moves out of the disabled coordinate area, and further determine whether to disable the second operation data by determining whether the second operation data corresponds to the new DOWN event, so that accuracy of processing the second operation data can be ensured, and use experience of the user is improved.

The following exemplarily describes an operation data processing method provided in an embodiment of the present application:

fig. 7 is a schematic diagram of a user performing a touch operation using a stylus according to an embodiment of the present disclosure. Referring to fig. 7, the interactive smart tablet 1 starts an electronic whiteboard application as an application of the current man-machine interaction. The user holds the stylus 2 by the hand 3 and performs a touch operation in the display screen 4 of the interactive smart tablet 1. At this time, it is detected that the user's hand 3 touches the display screen 4 at the same time. Further, the first operation data and the second operation data are received, a forbidden coordinate area 13 is determined according to the first touch coordinate included in the first operation data, and meanwhile, the second touch coordinate in the second operation data is acquired, and the second touch coordinate is determined to be located in the forbidden coordinate area 13. And then, processing the first operation data, setting the point id corresponding to the touch operation of the hand 3 into a disabled state, and then, confirming that the mark of the incomplete UP supplementing event data packet is set. Further, a new UP supplement event data packet is generated and marked, and then the UP supplement event data packet is sent to the electronic whiteboard application to inform the electronic whiteboard application that the hand of the user leaves the display screen, that is, the touch operation of the hand 13 is not responded. Then, during the operation of the stylus 2, if the user's hand 3 does not leave the display screen, the first operation data and the second operation data are continuously received, and when the first operation data are processed, it is determined that the second touch coordinate corresponding to the current second operation data is located in the disabled coordinate area 13, then the point id corresponding to the touch operation is set to a disabled state, and it is confirmed that the setting of the flag is completed, and at this time, the second operation data are discarded.

Further, when it is detected that the stylus 2 has left the display screen 4 but the user hand 3 has not left the display screen 4, at this time, the second operation data is continuously received, and it is determined that the second touch coordinates corresponding to the current second operation data do not fall into the disabled coordinate area 13, after that, it is confirmed that the point id corresponding to the touch operation is in the disabled state, and the second operation data do not belong to the operation data generated by the new DOWN event, so that the second operation data are discarded.

Fig. 8 is a second schematic diagram of a user performing a touch operation using a stylus according to an embodiment of the present disclosure. Referring to fig. 8, the interactive smart tablet 1 starts an electronic whiteboard application as an application of the current man-machine interaction. The hand 3 of the left hand of the user touches the display screen 4, and the eraser function is invoked according to the touch operation, namely the corresponding mark 14 of the eraser is displayed. Meanwhile, the user holds the stylus 2 by the right hand and performs writing operations in the display screen 4 of the interactive smart tablet 1. Fig. 9 is a third schematic diagram of a user performing a touch operation using a stylus according to the embodiment of the present application, which is a schematic diagram corresponding to a certain moment in the writing process of the stylus 2. Referring to fig. 9, when the stylus 2 moves to the current first touch coordinate, the hand 3 of the left hand of the user is located in the disabled coordinate area 13, at this time, the point id corresponding to the touch operation performed by the hand 3 of the left hand of the user is set to the disabled state, and the flag setting of the incomplete UP event packet is confirmed. Further, a new UP supplement event data packet is generated and marked, and then the UP supplement event data packet is sent to the electronic whiteboard application program to inform the electronic whiteboard application program that the hand of the user leaves the display screen. At this point, the electronic whiteboard application will determine that the user's hand has left the display screen and delete the corresponding logo 14 of the eraser. Then, during the operation of the stylus 2, if the hand 3 of the left hand of the user still does not leave the display screen 4, the second operation data is continuously received, and if it is determined that the second touch coordinate corresponding to the current second operation data is located in the disabled coordinate area 13, the point id corresponding to the touch operation is set to be in a disabled state, and it is confirmed that the flag setting is completed, so that the second operation data is discarded. If it is determined that the second touch coordinate corresponding to the current second operation data does not fall into the disabled coordinate area 13, it is further determined that the point id corresponding to the second operation data is in a disabled state, and it is determined that the second operation data does not belong to the operation data generated by the new DOWN event, and then the second operation data is discarded.

The above example can effectively inhibit the response to the hand operation falling near the touch pen during the operation process of the touch pen, and further effectively prevent the hand from touching the display screen by mistake.

Fig. 10 is a schematic structural diagram of an operation data processing device according to an embodiment of the present application. Referring to fig. 10, the operation data processing apparatus includes: a first processing module 301, a data disabling module 302, a second processing module 303.

The first processing module 301 is configured to process first operation data currently received, where the first operation data is operation data obtained based on a stylus; a data disabling module 302, configured to disable second operation data currently received, where the second operation data and the first operation data have at least one same data generation time, and a distance between a second touch coordinate included in the second operation data and a first touch coordinate included in the first operation data is smaller than a preset threshold; and the second processing module 303 is configured to process third operation data currently received after the first operation data is processed, where the third operation data and the second operation data have the same type of operation body and correspond to different touch operations.

According to the technical means, the technical means that after the first operation data are processed, the third operation data with the same operation main body as the second operation data are normally processed, and the technical problem that when a user uses the touch pen, the interaction intelligent panel performs error processing due to the fact that the hand touches the screen by mistake in the prior art can be solved. In the process of processing the first operation data, disabling the second operation data close to the touch pen can effectively avoid error processing caused by error touching of the display screen by the hand, and only disabling the second operation data close to the touch pen by setting a preset threshold value of the distance between touch coordinates, so that the remote operation data can be normally processed, and further, when a user performs touch operation by using a finger and the touch pen at the same time, correct response of the touch operation is ensured. After the first operation data is processed, the touch operation newly sent by the operation main body corresponding to the second operation data is processed normally, so that the correct response to the touch operation sent by the hand of the user can be ensured, and the use experience of the user is improved.

Based on the above embodiment, the data disabling module 302 includes: a data receiving unit configured to receive second operation data; a flow determining unit, configured to determine a corresponding disabling process flow according to the second operation data; and the flow execution unit is used for processing the second operation data according to the forbidden processing flow.

On the basis of the above embodiment, the flow determination unit includes: the first coordinate acquisition subunit is used for acquiring second touch coordinates contained in the second operation data; and the first forbidden flow path determining subunit is used for determining to adopt a first forbidden processing flow path when determining that the second touch control coordinates fall into the forbidden coordinate area.

On the basis of the foregoing embodiment, the first processing module 301 is further configured to determine the forbidden coordinate area information according to a first touch coordinate included in the first operation data.

On the basis of the above embodiment, the first touch coordinate is a hover coordinate when the stylus hovers or a touch coordinate when the stylus touches a display screen.

On the basis of the above embodiment, the first processing module 301 includes: the data processing unit is used for processing the first operation data received currently; the second coordinate acquisition unit is used for acquiring first touch coordinates contained in the first operation data; and the area generating unit is used for generating forbidden coordinate area information according to a preset area size, and the first touch coordinate falls into a forbidden coordinate area corresponding to the forbidden coordinate area information.

On the basis of the above embodiment, the operation data processing apparatus further includes: and the second forbidden flow path determining module is used for determining to adopt a second forbidden processing flow path when the second touch control coordinates are determined not to fall into the forbidden coordinate area.

On the basis of the foregoing embodiment, the disabling process flow is a second disabling process flow, and the flow executing unit includes: the identifier acquisition subunit is used for acquiring the contact identifier corresponding to the second operation data; a disabled state validation subunit configured to determine whether the contact identifier is in a disabled state; and the disabling subunit is used for discarding the second operation data if the contact identifier is in a disabled state.

On the basis of the above embodiment, the disabling subunit includes: a falling judging unit, configured to determine whether the second operation data belongs to a new touch falling event if the contact identifier is in a disabled state; and the data discarding grandchild unit is used for discarding the second operation data if the second operation data does not belong to the new touch dropping event.

On the basis of the above embodiment, the operation data processing apparatus further includes: and the third processing module is used for normally processing the second operation data if the contact mark is not in a disabled state.

On the basis of the foregoing embodiment, the disabling process flow is a first disabling process flow, and the flow executing unit includes: a disabled state setting subunit, configured to set a contact identifier corresponding to the second operation data to a disabled state; a flag setting confirmation subunit, configured to determine whether the flag setting is completed for the supplemental lifting event packet; an operation data discarding subunit, configured to discard the second operation data if the completion flag is set; a data packet generating subunit, configured to generate a new supplemental lifting event data packet for the second operation data if the flag is not set, and complete the flag setting; and the data packet processing subunit is used for processing the new supplemental lifting event data packet.

Based on the above embodiment, the data disabling module 302 includes: the data disabling unit is used for disabling second operation data received currently, the second operation data and the first operation data have at least one same data generation moment, and the distance between a second touch coordinate contained in the second operation data and a first touch coordinate contained in the first operation data is smaller than a preset threshold; and the processing result retaining unit is used for retaining the displayed processing result, wherein the processing result is the display result after the received second operation data is processed before the second operation data is forbidden.

On the basis of the above embodiment, the operation data processing apparatus further includes: and the region deleting module is used for deleting the forbidden coordinate region information after stopping receiving the first operation data.

On the basis of the above embodiment, the second operation data is operation data obtained based on the hand of the user.

The operation data processing device provided by the above-mentioned embodiment can be used for executing the operation data processing method provided by any of the above-mentioned embodiments, and has corresponding functions and beneficial effects.

It should be noted that, in the above embodiment of the operation data processing apparatus, each unit and module included are only divided according to the functional logic, but are not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present invention.

Fig. 11 is a schematic structural diagram of an operation data processing apparatus according to an embodiment of the present application. In this embodiment, description will be made taking an interactive smart tablet as an example for operating a data processing apparatus. As shown in fig. 11, the interactive smart tablet 40 includes at least one processor 41, at least one network interface 42, a user interface 43, a memory 44, and at least one communication bus 45.

Wherein a communication bus 45 is used to enable connected communication between these components.

The user interface 42 may include a display screen, a camera, and the optional user interface 43 may also include a standard wired interface, a wireless interface, among others. The display screen is an inductive liquid crystal display device, which is configured with at least one type of touch module (not shown).

The network interface 42 may optionally include a standard wired interface, a wireless interface (e.g., wi-Fi interface), among others.

Wherein processor 41 may comprise one or more processing cores. Processor 41 connects the various portions of the overall interactive smart tablet 40 using various interfaces and lines to perform various functions of the interactive smart tablet 40 and process data by executing or executing instructions, programs, code sets, or instruction sets stored in processor 41, and invoking data stored in memory 44. Alternatively, the processor 41 may be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable logic arrays, PLA). The processor 41 may integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), and a modem, etc. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display screen; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 41 and may be implemented by a single chip.

The Memory 44 may include a random access Memory (Random Access Memory, RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 44 includes a non-transitory computer readable medium (non-transitory computer-readable storage medium). Memory 44 may be used to store instructions, programs, code, sets of codes, or instruction sets. The memory 44 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, etc.; the storage data area may store data or the like referred to in the above respective method embodiments. The memory 44 may alternatively be at least one memory device located remotely from the aforementioned processor 41. As shown in FIG. 11, an operating system, a network communication module, a user interface module, and an operating application of the interactive smart tablet may be included in memory 44, which is a type of computer storage medium.

In the interactive smart tablet 40 shown in fig. 11, the user interface 43 is mainly used for providing an input interface for a user, and acquiring data input by the user; and processor 41 may be used to invoke the interactive smart tablet operating application stored in memory 44 and to specifically perform the relevant operations in the operating data processing method of the above-described embodiment.

The interactive intelligent tablet can be used for executing any operation data processing method and has corresponding functions and beneficial effects.

In addition, the embodiment of the present invention further provides a storage medium containing computer executable instructions, where the computer executable instructions are used for executing relevant operations in the operation data processing method provided in any embodiment of the present application when executed by a computer processor, and have corresponding functions and beneficial effects.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product.

Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.

Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.

Claims

1. A method of processing operational data, comprising:

disabling second operation data currently received, wherein the second operation data and the first operation data have at least one same data generation moment, the distance between a second touch coordinate contained in the second operation data and a first touch coordinate contained in the first operation data is smaller than a preset threshold, the second operation data are operation data obtained based on a hand of a user, and the operation data of the hand and the operation data of a touch pen correspond to different data interfaces to be distinguished;

after the first operation data is processed, processing third operation data received currently, wherein the third operation data and the second operation data have operation main bodies of the same category and correspond to different touch operations;

the disabling the currently received second operation data includes:

receiving second operation data;

processing the second operation data according to the forbidden processing flow;

The determining a corresponding disabling process flow according to the second operation data includes:

acquiring a second touch coordinate contained in the second operation data;

when the second touch control coordinates are determined to fall into the forbidden coordinate area, a first forbidden processing flow is determined to be adopted;

the disabling process flow is a first disabling process flow, and the processing the second operation data according to the disabling process flow includes:

discarding the second operation data if the completion flag is set;

processing the new patch lift event data packet;

the method further comprises the steps of:

when the second touch control coordinates are determined not to fall into the forbidden coordinate area, a second forbidden processing flow is determined to be adopted;

the disabling process flow is a second disabling process flow, and the processing the second operation data according to the disabling process flow includes:

acquiring a contact identifier corresponding to the second operation data;

Determining whether the contact identification is in a disabled state;

2. The operation data processing method according to claim 1, wherein when the currently received first operation data is processed, further comprising:

3. The operation data processing method according to claim 1 or 2, wherein the first touch coordinate is a hover coordinate when the stylus hovers or a touch coordinate when the stylus touches a display screen.

4. The operation data processing method according to claim 2, wherein the determining the forbidden coordinate region information according to the first touch coordinate included in the first operation data includes:

acquiring a first touch coordinate contained in the first operation data;

5. The method of claim 1, wherein discarding the second operational data if the contact identification is in a disabled state comprises:

6. The operation data processing method according to claim 1, characterized by further comprising:

7. The operation data processing method according to claim 1, wherein when the second operation data currently received is disabled, further comprising:

8. The operation data processing method according to claim 2, characterized by further comprising:

9. An operation data processing apparatus, comprising:

The data disabling module is used for disabling second operation data which are currently received, the second operation data and the first operation data have at least one same data generation moment, the distance between second touch coordinates contained in the second operation data and first touch coordinates contained in the first operation data is smaller than a preset threshold, the second operation data are operation data obtained based on a hand of a user, and the operation data of the hand and the operation data of a touch pen correspond to different data interfaces to be distinguished;

the second processing module is used for processing third operation data received currently after the first operation data are processed, wherein the third operation data and the second operation data have the same type of operation main body and correspond to different touch operation;

the data disabling module includes: a data receiving unit configured to receive second operation data; a flow determining unit, configured to determine a corresponding disabling process flow according to the second operation data; a flow execution unit, configured to process the second operation data according to the disabling process flow;

the flow determination unit includes: the first coordinate acquisition subunit is used for acquiring second touch coordinates contained in the second operation data; a first disabling flow determining subunit, configured to determine to use a first disabling processing flow when determining that the second touch coordinate falls into a disabling coordinate area;

The disabling process flow is a first disabling process flow, and the flow executing unit includes: a disabled state setting subunit, configured to set a contact identifier corresponding to the second operation data to a disabled state; a flag setting confirmation subunit, configured to determine whether the flag setting is completed for the supplemental lifting event packet; an operation data discarding subunit, configured to discard the second operation data if the completion flag is set; a data packet generating subunit, configured to generate a new supplemental lifting event data packet for the second operation data if the flag is not set, and complete the flag setting; a data packet processing subunit, configured to process the new patch lift event data packet;

the apparatus further comprises: the second forbidden flow path determining module is used for determining to adopt a second forbidden processing flow path when the second touch control coordinates do not fall into the forbidden coordinate area;

the disabling process flow is a second disabling process flow, and the flow executing unit includes: the identifier acquisition subunit is used for acquiring the contact identifier corresponding to the second operation data; a disabled state validation subunit configured to determine whether the contact identifier is in a disabled state; and the disabling subunit is used for discarding the second operation data if the contact identifier is in a disabled state.

10. An operational data processing apparatus, comprising:

one or more processors;

a memory for storing one or more programs;

when executed by the one or more processors, causes the one or more processors to implement the operational data processing method of any of claims 1-8.

11. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the operational data processing method according to any one of claims 1-8.