CN111694451A

CN111694451A - Operation data processing method, device, equipment and storage medium

Info

Publication number: CN111694451A
Application number: CN202010444382.2A
Authority: CN
Inventors: 邱伟波
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2020-05-22
Filing date: 2020-05-22
Publication date: 2020-09-22
Anticipated expiration: 2040-05-22
Also published as: CN111694451B

Abstract

The embodiment of the application discloses an operation data processing method, an operation data processing device, operation data processing equipment and a storage medium, which relate to the technical field of interactive intelligent panels and comprise the following steps: processing first operation data obtained currently based on a touch pen; disabling currently received second operation data, wherein the second operation data and the first operation data have at least one same data generation moment, and the distance between a second touch coordinate contained in the second operation data and a first touch coordinate contained in the first operation data is smaller than a preset threshold; and processing currently received third operation data after the first operation data is processed, wherein the third operation data and the second operation data have the same category of operation bodies and correspond to different touch operations. By adopting the method, the technical problem that the interactive intelligent tablet carries out error processing due to the fact that the screen is touched by the hand by mistake when a user uses the touch pen in the prior art can be solved.

Description

Operation data processing method, device, equipment and storage medium

Technical Field

The embodiment of the application relates to the technical field of interactive intelligent tablets, in particular to an operation data processing method, device, equipment and storage medium.

Background

With the development of intelligent technology, interactive intelligent devices are widely applied to various scenes of daily life. The interactive intelligent tablet is one of important applications in the interactive intelligent equipment, and is widely applied to scenes such as office work, teaching and the like so as to improve the working efficiency and the learning efficiency of people. At present, with the development of touch technology, the interactive smart tablet can implement multi-point touch, and the touch means are diversified, for example, a user can implement touch operation by a stylus or by a finger.

In the process of implementing the invention, the inventor finds that the prior art has the following defects: when a user uses the touch pen to perform touch operation, the situation that the hand of the user unintentionally touches the screen can occur due to the limitation of the pen holding mode of the user, at the moment, the interactive intelligent tablet can detect the touch action of the hand of the user and mistakenly identify the touch operation sent by the user, and then the touch operation is mistakenly processed.

In summary, when a user uses a touch pen, how to avoid the mishandling situation caused by the user's hand touching the screen by mistake becomes a technical problem that needs to be solved urgently.

Disclosure of Invention

The application provides an operation data processing method, device, equipment and storage medium, and aims to solve the technical problem that when a user uses a touch pen in the prior art, the interactive smart tablet carries out error processing due to the fact that a hand touches a screen by mistake.

In a first aspect, an embodiment of the present application provides an operation data processing method, including:

processing currently received first operation data, wherein the first operation data is operation data obtained based on a touch pen;

disabling currently received second operation data, wherein the second operation data and the first operation data have at least one same data generation time, and the distance between a second touch coordinate contained in the second operation data and a first touch coordinate contained in the first operation data is smaller than a preset threshold;

and after the first operation data is processed, processing currently received third operation data, wherein the third operation data and the second operation data have the same category of operation bodies and correspond to different touch operations.

Further, the disabling the currently received second operation data includes:

receiving second operation data;

determining a corresponding forbidden processing flow according to the second operation data;

and processing the second operation data according to the forbidden processing flow.

Further, the determining a corresponding disabled processing flow according to the second operation data includes:

acquiring a second touch coordinate contained in the second operation data;

and when the second touch coordinate is determined to fall into the forbidden coordinate area, determining to adopt a first forbidden processing flow.

Further, when processing the currently received first operation data, the method further includes:

and determining forbidden coordinate area information according to a first touch coordinate contained in the first operation data.

Further, the first touch coordinate is a hovering coordinate when the stylus is hovering or a touch coordinate when the stylus touches the display screen.

Further, the determining the forbidden coordinate area information according to the first touch coordinate included in the first operation data includes:

acquiring a first touch coordinate contained in the first operation data;

and generating forbidden coordinate area information according to a preset area size, wherein the first touch coordinate falls into a forbidden coordinate area corresponding to the forbidden coordinate area information.

Further, the method also comprises the following steps:

and when the second touch coordinate does not fall into the forbidden coordinate area, determining to adopt a second forbidden processing flow.

Further, the disabling process flow is a second disabling process flow,

the processing the second operation data according to the disabled processing flow comprises:

acquiring a contact identifier corresponding to the second operation data;

determining whether the contact identification is in a disabled state;

and if the contact point identification is in a forbidden state, discarding the second operation data.

Further, if the contact identifier is in a disabled state, discarding the second operation data includes:

if the contact mark is in a forbidden state, determining whether the second operation data belongs to a new touch falling event;

and if the touch control falling event does not belong to the new touch control falling event, discarding the second operation data.

Further, the method also comprises the following steps:

and if the contact point identification is not in the forbidden state, the second operation data is processed normally.

Further, the disabling process flow is a first disabling process flow,

setting a contact mark corresponding to the second operation data to be in a forbidden state;

determining whether the completion flag of the supplement and raise event data packet is set;

if the completion flag is set, discarding the second operation data;

if the incomplete flag is set, generating a new complementary uplift event data packet aiming at the second operation data, and setting the complete flag;

and processing the new complementary uplift event data packet.

Further, when disabling the currently received second operation data, the method further includes:

and reserving the displayed processing result, wherein the processing result is the display result after the received second operation data is processed before the second operation data is forbidden.

Further, the method also comprises the following steps:

and deleting the forbidden coordinate area information after the first operation data is stopped being received.

Further, the second operation data is operation data obtained based on a hand of the user.

In a second aspect, an embodiment of the present application further provides an operation data processing apparatus, including:

the first processing module is used for processing currently received first operation data, and the first operation data is operation data obtained based on a touch pen;

the data disabling module is used for disabling currently received second operation data, the second operation data and the first operation data have at least one same data generation moment, and the distance between a second touch coordinate contained in the second operation data and a first touch coordinate contained in the first operation data is smaller than a preset threshold;

and the second processing module is used for processing currently received third operation data after the first operation data is processed, and the third operation data and the second operation data have the same type of operation bodies and correspond to different touch operations.

In a third aspect, an embodiment of the present application further provides an operation data processing device, including:

one or more processors;

a memory for storing one or more programs;

when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the operational data processing method according to the first aspect.

In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the operation data processing method according to the first aspect.

According to the operation data processing method, the device, the equipment and the storage medium, the technical problem that the interactive intelligent panel carries out error processing due to the fact that a hand touches a screen by mistake when a user uses the touch pen in the prior art can be solved by processing first operation data obtained based on the touch pen and forbidding received second operation data in the processing process, wherein the second operation data and the first operation data have at least one same data generation moment, and the distance between corresponding touch coordinates is smaller than a preset threshold value. In the process of processing the first operation data, the second operation data close to the touch pen is forbidden, so that the error processing caused by the fact that a hand mistakenly touches the display screen can be effectively avoided, in addition, the second operation data close to the touch pen can be forbidden only by setting the preset threshold value of the distance between the touch coordinates, the remote operation data can be processed normally, and then when a user uses fingers and the touch pen to perform multi-point touch at the same time, the correct response of touch operation is ensured. And then, after the first operation data is processed, normally processing third operation data, wherein the third operation data and the second operation data have operation bodies of the same category, so that correct response to the touch operation sent by the operation bodies can be ensured.

Furthermore, when the second operation data is forbidden, a touch lifting event of a user hand is simulated by generating a supplementary UP event data packet, so that the current man-machine interaction application program responds to the touch lifting event, the supplementary UP event data packet is recorded by a mark setting mode, and the second operation data is directly discarded according to the mark setting when the second operation data is subsequently received, so that the second operation data is forbidden and the logic rationality of the forbidden second operation data is ensured.

Further, when the second touch coordinate does not fall into the forbidden coordinate area, whether to forbid the second operation data can be determined according to the forbidding state of the point id, so that when the hand of the user moves out of the forbidden coordinate area, the response to the touch operation of the hand of the user is still abandoned, and whether to forbid the second operation data is further determined by determining whether the second operation data corresponds to a new touch falling event, so that the accuracy of processing the second operation data can be ensured, and the use experience of the user is improved.

Drawings

FIG. 1 is a flow chart of a method for processing operation data according to an embodiment of the present application;

FIG. 2 is a flow chart of a method for processing operation data according to another embodiment of the present application;

FIG. 3 is a schematic diagram of a stylus hover provided by an embodiment of the present application;

FIG. 4 is a first diagram illustrating a forbidden coordinate region provided by an embodiment of the present application;

FIG. 5 is a second diagram illustrating forbidden coordinate regions provided by embodiments of the present application;

FIG. 6 is a third schematic diagram of a forbidden coordinate region provided by an embodiment of the present application;

fig. 7 is a first schematic diagram illustrating a user performing a touch operation with a stylus according to an embodiment of the present disclosure;

fig. 8 is a second schematic diagram illustrating a user performing a touch operation with a stylus according to an embodiment of the present disclosure;

fig. 9 is a third schematic view illustrating a user performing a touch operation with a stylus according to an embodiment of the present disclosure;

FIG. 10 is a block diagram of an operational data processing apparatus according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of an operation data processing device according to an embodiment of the present application.

Detailed Description

The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are for purposes of illustration and not limitation. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action or object from another entity or action or object without necessarily requiring or implying any actual such relationship or order between such entities or actions or objects. For example, "first" and "second" of the first operation data and the second operation data are used to distinguish two different operation data.

The operation data processing method provided in the embodiment of the present application may be executed by an operation data processing device, the operation data processing device may be implemented in a software and/or hardware manner, and the operation data processing device may be formed by two or more physical entities or may be formed by one physical entity. For example, the operation data processing device may be a smart device such as a computer, a mobile phone, a tablet or an interactive smart tablet.

For ease of understanding, the interactive smart tablet is exemplarily described in the embodiments as operating the data processing device. The interactive intelligent panel can be integrated equipment for controlling contents displayed on the display panel and realizing man-machine interaction operation through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound box, a television, a video conference terminal and the like.

Generally, an interactive smart tablet includes at least one display screen. Typically, the display screen configured by the interactive smart tablet refers to a touch screen, and a touch panel having a touch function, and is an inductive liquid crystal display device. According to the working principle of the display screen and the medium for transmitting information, the display screen can be divided into four types: resistive, capacitive, electromagnetic, and infrared. And the touch module configured in the display screen undertakes the work of touch detection. When a user touches the display screen by using a hand or a touch pen, parameters collected by an electrical element detecting a corresponding touch position in the touch module can be changed, the touch position can be determined according to the parameter change condition, and then operation data is generated and reported to a processor of the interactive intelligent flat plate, so that the interactive intelligent flat plate processor processes the operation data. In an embodiment, the display screen may be a single touch screen or a combined touch screen, where the combined touch screen refers to a display screen including at least two types of touch modules, and further, the embodiment of the combination mode of the touch modules is not limited, for example, the combination mode of the infrared touch module + the electromagnetic touch module, the electromagnetic touch module + the capacitive touch module, and the like is adopted. Typically, for one touch operation, the interactive smart tablet may generate a DOWN event and an UP event according to the operation data, where the DOWN event refers to an event that a user hand or a stylus touches the display screen, i.e., a touch DOWN event, and the UP event refers to an event that the user hand or the stylus leaves the display screen, i.e., a touch UP event, and one touch operation may be identified through the DOWN event and the UP event. It can be understood that, in the prior art, when the user's hand or the stylus is close to the display screen and has not yet contacted the display screen, the touch module may detect the user's hand or the stylus, and therefore, the DOWN event may also indicate that the user's hand or the stylus is close to the display screen and is in a detectable event. If the user's hand or stylus MOVEs within the display screen after touching the display screen, the interactive smart tablet may generate a MOVE event, wherein the MOVE event may also be understood as a movement event.

Further, the interactive smart tablet is installed with at least one type of operating system, wherein the operating system includes but is not limited to an android system, a Linux system, and a Windows system. Further, the interactive smart tablet may install at least one application based on the operating system. For example, an electronic whiteboard application is installed in the interactive smart tablet to implement an electronic whiteboard function. The application program may be an application program carried by an operating system, or an application program downloaded from a third-party device or a server. When a user selects a certain application program as a current man-machine interaction application program, if the user executes touch operation, the processor of the interactive intelligent tablet receives operation data generated by the touch module, then the operation data is processed (such as generating a data packet corresponding to a DOWN event, a MOVE event or an UP event) and sent to the current man-machine interaction application program, and the application program processes according to the received data packet and displays a corresponding processing result in the display screen.

Specifically, fig. 1 is a flowchart of an operation data processing method according to an embodiment of the present application. The present embodiment is not limited to the current man-machine interaction application program. Referring to fig. 1, the operation data processing method includes the steps of:

and step 110, processing currently received first operation data, wherein the first operation data is operation data obtained based on a touch pen.

In one embodiment, the stylus is an active pen, which may also be understood as an active pen. The touch control pen can perform touch control operation on the interactive intelligent panel, and when the touch control pen performs touch control operation, if the display screen is provided with the electromagnetic touch module, the electromagnetic touch module can receive touch control signals transmitted by the touch control pen so as to receive touch control operation of the touch control pen relative to the touch control signals; if the display screen is provided with the infrared touch module, the infrared touch module can identify a touch position corresponding to the touch pen through the blocking of the infrared signal by the touch pen, and then receive touch operation relative to the touch position; if the display screen is provided with the capacitive touch module, the capacitive touch module can identify the touch position of the stylus through capacitance change caused by contact of the stylus, and then receive touch operation relative to the touch position; if the display screen is configured with the voltage type touch module, the voltage type touch module can identify the touch position of the stylus through the voltage generated when the stylus is contacted, and then receive the touch operation relative to the touch position.

And after the touch module detects the touch operation, generating operation data, and reporting the operation data to a processor of the interactive intelligent panel for subsequent processing. In an embodiment, operation data obtained based on a stylus is recorded as first operation data. The embodiment of the data interface used when reporting the first operation data is not limited. Typically, the content of the first operation data may be set according to actual conditions, and in one embodiment, the first operation data at least includes a touch position and a data generation time. The touch position can be embodied in a touch coordinate mode. Specifically, a coordinate system is established in the display screen, and the embodiment of the numerical range of the coordinate system is not limited. Correspondingly, the touch module stores relevant data of the coordinate system, can detect the position of each coordinate point in the coordinate system, and can acquire touch coordinates and acquire corresponding data generation time when the stylus performs touch operation, and then write the touch coordinates and the data generation time into the first operation data. The data generation time can also be understood as the time when the touch operation is detected, and the touch module detects the touch operation according to a certain frequency, so that when the touch operation is detected, multiple frames of first operation data can be generated according to the detection frequency, and at the moment, each frame of first operation data corresponds to one data generation time. When the touch pen continuously performs the touch operation, the interactive intelligent panel processor continuously receives multiple frames of first operation data until the touch operation is finished. The first operation data mentioned in the embodiments may be understood as one frame of operation data generated at the current data generation time during one touch operation of the stylus.

Typically, after receiving the first operation data, the first operation data is processed, that is, the touch operation corresponding to the first operation data is responded. For example, when the stylus is currently in a writing process, after receiving the first operation data, obtaining the touch coordinate and the data generation time in the first operation data, and then generating a corresponding MOVE event data packet according to the touch coordinate and the data generation time. And then, sequentially sending the MOVE event data packets to a current man-machine interaction application program, wherein the application program indicates the display screen to display a writing track at a position corresponding to the touch coordinate according to the MOVE event data packets.

It should be noted that the stylus pen may also perform data communication with the interactive smart tablet, for example, data communication may be performed through bluetooth or wireless. The specific content embodiment of the data communication is not limited, for example, when the touch pen is paired with the interactive smart tablet, the unique device identifier may be transmitted. For another example, when the stylus performs a touch operation, data such as an inclination angle may be sent to the interactive smart tablet.

Step 120, disabling currently received second operation data, where the second operation data and the first operation data have at least one same data generation time, and a distance between a second touch coordinate included in the second operation data and a first touch coordinate included in the first operation data is smaller than a preset threshold.

The second operation data is operation data generated by a user touching the display screen by mistake when using the stylus pen. In general, the touch position when the user erroneously touches the display screen is close to the current touch position of the stylus pen, and therefore, the second operation data may also be understood as operation data generated by a touch operation close to the touch position of the stylus pen. Typically, the operation subject of the second operation data may be a hand of the user, or another subject. The operation subject refers to a subject capable of performing touch operation on the interactive smart tablet. Optionally, the operation body of the second operation data excludes the stylus pen, so as to distinguish the second operation data from the first operation data.

In one embodiment, the operation body of the second operation data is taken as an example of a hand of a user, and in this case, the second operation data is operation data obtained based on the hand of the user, that is, the second operation data refers to operation data generated by the touch module when the hand of the user touches the display screen. It can be understood that, in the process of one touch by the user, the touch module generates at least one frame of second operation data. The second operation data at least comprises touch coordinates and data generation time. Further, when the user touches the display screen for multiple times, each touch corresponds to one group of second operation data, each group of second operation data may include multiple frames of second operation data, and each frame of second operation data corresponds to one data generation time. The second operation data mentioned in the embodiment refers to one frame of second operation data generated at the current data generation time in the process of one touch of the user's hand.

In general, the touch operations of the stylus and the hand may be distinguished by a hover distance or a touch area. For example, taking the capacitive touch module as an example, when the stylus hovers 1cm away from the display screen, the capacitive touch module may detect the presence of the stylus, where hovering may be understood as the stylus approaching the display screen but not touching the display screen. When the user hand hovers 3mm from the display screen, the capacitive touch module can detect the hand of the user, and at the moment, the hand of the user and the touch pen can be distinguished according to the hovering distance. For another example, the pen tip area of the stylus is limited and smaller than the area of the finger and the palm of the user, and when the stylus contacts the display screen, the area occupied by the stylus coordinate is smaller than the area occupied by the hand of the user when the hand of the user contacts the display screen, so that the hand of the user and the stylus can be distinguished according to the touch area. Furthermore, the touch module adopts different data interfaces to upload the operation data of user's hand and the operation data of touch-control pen, consequently, the dull and stereotyped treater of interactive intelligence can distinguish two kinds of operation data according to data interface.

Specifically, if the user touches the display screen by mistake when using the stylus pen, the touch module may detect two touch operations at the same time, and generate the first operation data and the second operation data respectively, so that an intersection exists between the second operation data and the data generation time of the first operation data. In practical application, when a user uses a touch pen, if the user touches the display screen by mistake, three situations can occur: the user's hand touches the display screen before the stylus, the user's hand touches the display screen simultaneously with the stylus, and the user's hand touches the display screen after the stylus. In any case, the multi-frame first operation data and the multi-frame second operation data include at least one identical data generation time.

Further, when the user uses the stylus pen, the operation of erroneously touching the display screen is usually located near the touch position of the stylus pen, and therefore, whether there is an erroneous touch operation can be determined in a distance-limited manner. Taking the example of the display screen being touched by the hand of the user by mistake, when the user holds the touch pen, if the hand of the user does not touch the display screen, the touch position corresponding to the hand of the user is closer to the touch position of the touch pen, and therefore, whether the second operation data is the operation data generated by the user unintentionally touching the display screen can be determined by confirming the distance between the first touch coordinate and the second touch coordinate, wherein the first touch coordinate is the touch coordinate corresponding to the touch pen, and the second touch coordinate is the touch coordinate corresponding to the hand of the user. In one embodiment, if the distance between the second touch coordinate and the first touch coordinate is smaller than a preset threshold, it may be determined that the second operation data is operation data generated by the user unintentionally touching the display screen. The specific value of the preset distance can be set according to the actual situation. Optionally, when determining whether the distance between the second touch coordinate and the first touch coordinate is smaller than a preset threshold, calculating the distance between the first touch coordinate and the second touch coordinate corresponding to the current data generation time, and comparing the distance with the preset threshold, it needs to be described that if only the first touch coordinate or the second touch coordinate exists at the current data generation time, the distance does not need to be calculated or the distance is directly determined to be larger than the preset threshold; the first touch coordinate may be used to generate a coordinate area, where the size of the coordinate area and the embodiment of the generation rule are not limited, and in the embodiment, the area is marked as a forbidden coordinate area. It can be appreciated that when the first touch coordinate changes, the forbidden coordinate region follows the change. If the second touch coordinate corresponding to the current data generation time falls within the forbidden coordinate region corresponding to the current data generation time, it may be determined that the distance between the second touch coordinate and the first touch coordinate is less than a preset threshold.

It can be understood that the second operation data and the first operation data have at least one same data generation time, and the disable determination condition of the second operation data can also be understood when the distance between the second touch coordinate included in the second operation data and the first touch coordinate included in the first operation data is smaller than the preset threshold. For example, when the currently received second operation data and the first operation data are the same data generation time, and the distance between the touch coordinates of the currently received second operation data and the first operation data is smaller than the preset threshold, it may be determined that the currently received second operation data satisfies the disable determination condition, that is, the second operation data is operation data generated by the user unintentionally touching the display screen, and the second operation data is disabled. Optionally, after the disabling determination condition is satisfied, it may also be directly determined that the disabling determination condition is satisfied for the subsequently received second operation data, that is, the subsequently received second operation data is disabled. Optionally, after the forbidden determination condition is met, it is determined that all the second operation data generated in the touch process meet the forbidden determination condition, that is, all the second operation data received this time are forbidden.

Further, disabling the second operation data means not displaying the processing result related to the second operation data in the display screen. Optionally, the disabling of the second operation data includes two data processing manners, that is, discarding the second operation data, and generating a complementary UP event data packet based on the second operation data. Discarding the second operation data may also be understood as abandoning processing the second operation data, when the current human-machine interaction application does not receive any data packet related to the second operation data. Generating the UP event supplement data packet based on the second operation data means that when the second operation data is processed, touch operation corresponding to the second operation data is simulated as an UP event, the UP event supplement data packet corresponding to the second operation data is generated, then the UP event supplement data packet is sent to an application program of current human-computer interaction, and then the application program responds to the UP event supplement data packet, namely whether the user finishes the false touch operation or not in an actual situation, the application program determines that the user finishes the false touch operation. Optionally, in the process of the user error touch operation, if multiple frames of second operation data are generated, the multiple frames of second operation data may be disabled by combining two ways of generating a complementary UP event data packet and discarding the second operation data. For example, for the first frame of second operation data, when the second operation data meets the disable determination condition, a complementary UP event data packet is generated, so that the application program of the current human-computer interaction determines that the user mistakenly touches the operation end. Then, since the current human-computer interaction application program already determines that the user mistakenly touches the operation end, for the subsequently received second operation data, the processor of the interactive smart tablet may directly discard the second operation data.

It can be understood that when the user continuously performs the false touch operation, the processor of the interactive smart tablet continuously receives multiple frames of second operation data, and at this time, each frame of second operation data may be sequentially processed, that is, whether each frame of second operation data satisfies the forbidden determination condition is sequentially determined, and when the forbidden determination condition is satisfied, the second operation data is discarded or a corresponding complementary UP event data packet is generated. Optionally, since there may be second operation data that does not satisfy the disable determination condition in the multiple frames of second operation data, it may be set that all second operation data in the touch process is disabled when any one frame of second operation data in the multiple frames of second operation data that is continuously received satisfies the disable determination condition. Alternatively, for the continuously received multi-frame second operation data, only the operation data satisfying the disabling determination condition is disabled. Or, in the continuously received multiple frames of second operation data, if a certain frame of second operation data is the second operation data whose first frame meets the disable determination condition, the frame and the second operation data received after the frame are disabled, and at this time, the second operation data before the frame is normally processed. In the embodiment, the second operation data received before the normal processing satisfies the disable determination condition is taken as an example for description, and at this time, if the processing result related to the second operation data is already displayed in the display screen before the second operation data is disabled, the processing result may be retained. Namely forbidding the received second operation data, the method further comprises the following steps: and reserving the displayed processing result, wherein the processing result is the display result after the received second operation data is processed before the second operation data is forbidden. For example, when the user uses the touch pen, the user's hand touches the display screen before the touch pen, at this time, the interactive smart tablet processes the touch operation of the user's hand first, the corresponding processing result is to display the eraser, erase the writing track on the moving path of the eraser, and then, when the touch operation of the stylus is detected, determining that first operation data currently corresponding to the stylus and second operation data currently corresponding to the eraser have the same data generation time and that a distance between a second touch coordinate included in the second operation data and a first touch coordinate included in the first operation data is smaller than a preset threshold, and at this time, starting to disable the current second operation data and subsequently received second operation data, since the second operation data has been disabled, the touch operation of the hand no longer corresponds to the eraser function, so that the displayed eraser is deleted. In contrast, since the second operation data has been processed before the first operation data is received and the processing result is that a part of the writing trace is deleted, the current processing result is retained when the second operation data is disabled.

It can be understood that, if the second operation data does not satisfy the forbidden determination condition, the second operation data is normally processed, and at this time, it may be considered that the user's hand and the stylus pen simultaneously control the interactive smart tablet.

It should be noted that, during the process of using the stylus pen by the user, multiple false touch operations may occur, and at this time, the second operation data generated by the touch display screen is disabled every time. In addition, in the process that the user uses the stylus, multi-point touch can be performed simultaneously, at this time, the interactive tablet can receive a plurality of second operation data simultaneously, and can determine whether each second operation data needs to be disabled in sequence.

Step 130, after the first operation data is processed, processing currently received third operation data, where the third operation data and the second operation data have the same category of operation subject and correspond to different touch operations.

The third operation data is an operation subject having the same category as the second operation data, for example, when the second operation data is operation data obtained based on a hand of a user, the third operation data is also operation data obtained based on the hand of the user. It should be noted that the same category of the operation subject does not mean that the second operation data and the third operation data belong to the same operation subject. Taking the hand of the user as an example, the second operation data and the third operation data may be operation data generated by performing touch operations on hands of different users or different fingers of the same user.

And after the first operation data is processed, confirming that the touch pen leaves the display screen. At this time, if the touch module detects the touch operation with the same operation subject as the second operation data again, the operation data is generated and sent to the processor of the interactive smart tablet, and then the processor receives the operation data corresponding to the touch operation and normally processes the operation data. In the embodiment, the operation data having the same operation subject as the second operation data and received again is recorded as the third operation data. It is to be understood that the third operation data may also be considered as operation data corresponding to a new DOWN event, that is, the third operation data and the second operation data are generated for different touch operations. The generation manner of the third operation data is the same as that of the second operation data, and is not described herein.

It is to be understood that, if the touch operation of the stylus is detected again during the processing of the third operation data, and the third operation data satisfies the disable determination condition, the disabling of the third operation data is continued.

Optionally, after the first operation data is processed. And if the second operation data can be received, continuously forbidding the second operation data until the second operation data can not be received.

The technical problem of error processing of the interactive intelligent tablet due to the fact that a hand touches a screen by mistake when a user uses the stylus in the prior art can be solved by processing first operation data obtained based on the stylus and disabling received second operation data in the processing process, wherein the second operation data and the first operation data have at least one same data generation time and the distance between corresponding touch coordinates is smaller than a preset threshold, and then normally processing third operation data which have the same operation main body with the second operation data after the first operation data is processed. In the process of processing the first operation data, the second operation data close to the touch pen is forbidden, so that the error processing caused by the fact that a hand mistakenly touches the display screen can be effectively avoided, in addition, the second operation data close to the touch pen can be forbidden only by setting the preset threshold value of the distance between the touch coordinates, the remote operation data can be processed normally, and then when a user uses the finger and the touch pen to perform touch operation at the same time, the correct response of the touch operation is ensured. After the first operation data is processed, the touch operation newly sent by the operation main body corresponding to the second operation data is processed normally, so that correct response to the touch operation can be ensured, and the use experience of a user is improved.

Fig. 2 is a flowchart of an operation data processing method according to another embodiment of the present application. The operation data processing method provided by the present embodiment is embodied on the basis of the above-described embodiments, and is embodied specifically for the processing means of the operation data. In this embodiment, the second operation data is operation data obtained based on the hand of the user. Referring to fig. 2, the operation data processing method specifically includes:

step 210, processing currently received first operation data, and determining forbidden coordinate area information according to a first touch coordinate included in the first operation data, where the first operation data is operation data obtained based on a stylus.

In one embodiment, the first touch coordinate is a hover coordinate when the stylus is hovering or a touch coordinate when the stylus is touching a display screen. Specifically, when the distance between the stylus and the display screen is less than or equal to the maximum sensing distance, the interactive smart tablet can still detect the stylus even if the stylus does not touch the display screen, and at this time, the stylus can be considered to be in a hovering state. For example, fig. 3 is a schematic diagram of a stylus hovering mode provided in an embodiment of the present application, and referring to fig. 3, a stylus 2 is not currently in contact with the interactive smart tablet 1. The distance between the stylus 2 and the display screen of the interactive smart tablet 1 is represented by L, and when L is less than or equal to the maximum sensing distance, the interactive smart tablet 1 considers that the stylus 2 is in a hovering state. The maximum sensing distance can be set according to actual conditions, for example, the maximum sensing distance is 1cm, and at this time, when the perpendicular distance between the stylus pen point and the display screen is smaller than or equal to 1cm, the interactive smart tablet detects that the stylus pen is close to the display screen, and can confirm the corresponding hovering coordinate. The hovering coordinate can be understood as a touch coordinate corresponding to an electrical component in the touch module, which is detected to be close to the stylus. It can be appreciated that as the stylus hover position changes, the hover coordinates change synchronously. Typically, when the stylus touches the display screen, touch coordinates can be determined according to a touch position corresponding to the touch operation. It can be understood that the touch coordinates are changed synchronously according to the change of the touch position. No matter the stylus is in a hovering state or a state of contacting the display screen, the interactive smart tablet can obtain first operation data.

Further, when the first operation data is processed, the forbidden coordinate area information can be obtained according to the first touch coordinate. It can be understood that each data generation time corresponds to one forbidden coordinate region information, that is, one forbidden coordinate region information is generated in real time according to the current first touch coordinate. When the first touch coordinate changes, the coordinate area information is forbidden to change synchronously. It should be noted that a coordinate area can be obtained in the display screen by disabling the coordinate area information, and the coordinate area is an area that is easily touched by a user by mistake when using a stylus pen.

The forbidden coordinate region generated according to the forbidden coordinate region information includes the corresponding first touch coordinate, and a specific generation rule of the forbidden coordinate region information can be set according to an actual situation. In an embodiment, in order to reduce the data processing amount, the forbidden coordinate region is set to have a fixed size and shape. At this time, the step 211 of setting the information of determining the forbidden coordinate area according to the first touch coordinate included in the first operation data includes the step 212 of:

step 211, obtaining a first touch coordinate included in the first operation data.

Specifically, a first touch coordinate obtained at the current data generation time in the first operation data is obtained.

Step 212, forbidden coordinate area information is generated according to a preset area size, and the first touch coordinate falls into a forbidden coordinate area corresponding to the forbidden coordinate area information.

Specifically, the preset area size may be set according to actual conditions. The size and shape of the forbidden coordinate region can be defined by the preset region size, i.e. the specific parameters of size and shape in the forbidden coordinate region information are defined. The forbidden coordinate area is an area obtained in a display screen coordinate system according to the forbidden coordinate area information. For example, the preset area size is set to be a circular area and the radius is 20cm, and correspondingly, the parameter of the shape in the forbidden coordinate area information is circular and the parameter of the size is 20 cm.

When the forbidden coordinate area information is generated according to the preset area size, the position of the first touch coordinate can be referred to, so that the corresponding forbidden coordinate area is ensured to contain the first touch coordinate. For example, fig. 4 is a first schematic diagram of a forbidden coordinate area provided in the embodiment of the present application, and referring to fig. 4, a first touch coordinate 11 is taken as a center of the forbidden coordinate area, and then forbidden coordinate area information corresponding to the forbidden coordinate area 12 is generated according to a preset area size (a circle in fig. 4). For another example, fig. 5 is a second schematic diagram of the forbidden coordinate region provided in the embodiment of the present application. Referring to fig. 5, the first touch coordinate 11 is used as a left boundary point of the forbidden coordinate region, and then forbidden coordinate region information corresponding to the forbidden coordinate region 12 is generated according to a preset region size (a circle in fig. 5). As another example, fig. 6 is a third schematic diagram of a forbidden coordinate region provided in this embodiment of the application. Referring to fig. 6, the first touch coordinate 11 is used as a left vertex of the disabled coordinate area, and then, disabled coordinate area information corresponding to the disabled coordinate area 12 is generated according to a preset area size (a rectangle in fig. 6). It can be understood that, in practical applications, the first touch coordinate may be set as any point in the forbidden coordinate area according to requirements. In addition, in practical application, the forbidden coordinate region may not be displayed in the display screen, that is, the interactive smart tablet only needs to generate the information of the forbidden coordinate region, and does not need to display the corresponding forbidden coordinate region in the display screen.

It will be appreciated that the forbidden coordinate area information exists in real time during operation of the stylus. Correspondingly, after the first operation data is stopped being received, the forbidden coordinate area information is deleted. Specifically, after it is confirmed that the stylus pen ends the touch operation, that is, the first operation data is no longer received, the current information of the forbidden coordinate area is deleted. And after detecting a new touch operation of the stylus, generating the forbidden coordinate area information again. Optionally, in consideration of the fact that in practical application, the stylus leaves the display screen first and the hand holding the stylus is still on the display screen, at this time, in order to ensure accurate processing of the second operation data, it may be necessary to continue to use the information of the forbidden coordinate region to determine the second operation data. Therefore, after the first operation data is confirmed to be stopped being received, whether the second operation data is continuously received is determined, if the second operation data is not received, the fact that the hand of the user leaves the display screen is confirmed, and the forbidden coordinate area information is deleted. And if the second operation data is received and the hand of the user is confirmed not to leave the display screen, continuing to use the forbidden coordinate area information, and deleting the forbidden coordinate area information after the second operation data is stopped being received. At this time, the forbidden coordinate region information to be continuously used is the forbidden coordinate region information corresponding to the last data generation time of the first operation data.

Step 220, receiving second operation data.

And continuously receiving the second operation data of multiple frames in the process of touching the display screen by the hand of the user.

And step 230, determining a corresponding forbidden processing flow according to the second operation data.

The disabling process flow refers to a process flow adopted when the second operation data is disabled. Specifically, the disabling process flow may be set in advance, and may be used directly when the second operation data is disabled.

In practical applications, the second touch coordinate may be located outside the disabled coordinate region, and at this time, the second operation data may still need to be disabled, for example, after the hand of the user moves from inside the disabled coordinate region to outside the disabled coordinate region, the second operation data still needs to be disabled. Therefore, different disabling process flows need to be employed to ensure the accuracy of disabling the second operation data. Accordingly, in one embodiment, step 230 specifically includes steps 231-234:

and 231, acquiring a second touch coordinate included in the second operation data.

And acquiring a second touch coordinate corresponding to each data generation moment in real time.

And step 232, judging whether the second touch coordinate falls into a forbidden coordinate area. When it is determined that the second touch coordinate falls within the disabled coordinate area, step 233 is executed. When it is determined that the second touch coordinate does not fall within the disabled coordinate area, step 234 is executed.

Since the hand of the user has a certain area, the second touch coordinate corresponding to the current data generation time may include one or more touch coordinates. And if the second touch coordinate comprises a touch coordinate, determining whether the touch coordinate falls into the forbidden coordinate area. If it falls within the forbidden coordinate region, step 233 is performed, otherwise, step 234 is performed. And if the second touch coordinate comprises a plurality of touch coordinates, determining whether the touch coordinates in the forbidden coordinate area exist in the plurality of touch coordinates. If yes, the second touch coordinate is determined to fall within the forbidden coordinate area, step 233 is executed, and if not, the second touch coordinate is determined not to fall within the forbidden coordinate area, step 234 is executed.

Typically, since the forbidden coordinate region information is associated with the operation process of the stylus, after receiving the second operation data, it is determined whether the forbidden coordinate region corresponding to the forbidden coordinate region information exists, and if the forbidden coordinate region exists, it is determined that the same data generation time exists between the second operation data and the first operation data. Then, it is determined whether the second touch coordinate falls into the forbidden coordinate region, and if the second touch coordinate falls into the forbidden coordinate region, it indicates that the distance between the second touch coordinate and the first touch coordinate corresponding to the same data generation time is smaller than a preset threshold, and at this time, step 233 is executed. If there is no forbidden coordinate region, it may be determined that the second operation data does not fall within the forbidden coordinate region, and step 234 is performed.

Step 233, determine to adopt the first disabled process flow.

If the second touch coordinate falls into the forbidden coordinate area, it indicates that the second operation data corresponding to the current data generation time is the operation data generated by the user mistakenly touching the display screen by the hand, and therefore, the first forbidden processing flow is determined to be adopted for processing the second operation data. The first disabling process flow is mainly for specifying how to disable the second operation data falling within the disabled coordinate region.

Step 234, determining to adopt a second disabled process flow.

The second disabling processing flow is applicable to the case that the second touch coordinate does not fall within the disabled coordinate region, and is mainly used for stipulating how to process the second operation data when the second operation data does not fall within the disabled coordinate region, so as to achieve the purpose of accurately disabling the second operation data.

It can be understood that, when multiple frames of second operation data are continuously received, the disabled processing flow of each frame of second operation data needs to be determined in turn.

And step 240, processing the second operation data according to the forbidden processing flow.

After determining to disable the process flow, the second operation data may be processed according to the disabled process flow.

In one embodiment, under the first disabling process flow, the processing manner for disabling the second operation data includes: discarding the second operation data or generating a complementary UP event data packet, and the interactive smart tablet may select an accurate processing manner according to the first forbidden processing flow, so that when the forbidden processing flow is the first forbidden processing flow, step 240 includes steps 241-245:

and 241, setting the contact point identification corresponding to the second operation data to be in a forbidden state.

Specifically, when the user performs a touch operation, the touch operation has a corresponding touch point identifier. Generally, the operation data generated by one touch operation has the same touch point identification. The generation rule of the contact point identifier may be set according to actual conditions, for example, if the user only performs one touch operation at a time, each touch operation may correspond to the same contact point identifier. For example, a user performs writing operation with a hand, at this time, the interactive smart tablet detects that a writing track is currently written in, and sets a contact identifier corresponding to the writing track to 0. After this writing is finished, the interactive intelligent tablet detects a new writing track again, and the contact point identifier corresponding to the writing track can be set to be 0. If the user hands send out a plurality of touch operations at the same time, the touch operations correspond to different contact identifiers, so that different touch operations are distinguished. For example, a user performs writing operation with a hand, at this time, the interactive smart tablet detects that a writing track is currently written in, and sets a contact identifier corresponding to the writing track to 0. Then, when the writing is not finished, the interactive intelligent tablet detects a new writing track, and the contact mark corresponding to the writing track can be set to be 1, so that two writing tracks which are performed simultaneously are distinguished. For another example, the touch point identifiers are set according to the touch sequence, and the adjacent touch operations correspond to different touch point identifiers. For example, the touch point identifier corresponding to the currently received touch operation is 0, the touch point identifier of the subsequently received touch operation is 1, and then, when the touch operation is received again after the first touch operation is finished, the corresponding touch point identifier may be set to 0. In one embodiment, the point id is used for representing the contact point identifier, and the point id is generated when the touch module detects the touch operation of the hand of the user, and at this time, each frame of second operation data further includes the corresponding point id. It should be noted that, the embodiment is not limited to whether there is a corresponding point id for the touch operation sent by the stylus pen.

And when the second touch coordinate falls into the forbidden coordinate area, acquiring the current point id. After that, the point id is set to the disabled state, wherein the disabled state can be represented by a set character, for example, 1, and at this time, the disabled state corresponding to the current point id is set to 1. After the forbidden state is set, if second operation data of other frames are received subsequently, the forbidden state can be directly determined according to the point id.

And step 242, determining whether the completion flag of complementing the lift event data packet is set. If the done flag is set, step 243 is executed. If the outstanding flag is set, go to step 244.

The supplementary UP event data packet may also be recorded as a supplementary UP event data packet, and the generation manner of the supplementary UP event data packet is the same as the generation manner of the UP event data packet when the interactive smart tablet detects a UP event, which is not described herein again. In practical application, when the hand of the user touches the display screen, the hand may be moved from the outside of the forbidden coordinate region to the inside of the forbidden coordinate region, and at this time, the interactive smart tablet should disable the second operation data generated by the hand of the user. Therefore, when it is confirmed that the hand moves from the outside of the forbidden coordinate area to the inside of the forbidden coordinate area, that is, when it is determined that the hand of the user reaches the boundary coordinates of the forbidden coordinate area, a supplementary UP event data packet needs to be generated to inform the man-machine interaction application program that the hand of the user currently leaves the display screen. That is, the supplemental UP event data packet functions to simulate an UP event in which the user's hand leaves the display screen. It can be understood that, only when the hand of the user leaves the display screen, the current application program of the human-computer interaction may determine that the touch operation is finished and stop responding to the corresponding touch operation, that is, only after the UP event that the hand of the user leaves the display screen is simulated, the current application program of the human-computer interaction determines that the hand of the user leaves the display screen, and then, for the subsequently received second operation data, the processor of the interactive smart tablet may directly discard the second operation data.

The flag is set to indicate whether a complimentary UP event packet has currently been generated. If the completion flag is set, it indicates that a supplementary UP event data packet has been generated for the current touch operation, i.e. an UP event that simulates that the user has left the display screen by hand, and therefore, the currently received second operation data may be directly discarded, i.e. step 243 is executed. If the incomplete flag is set, it indicates that the UP event that the user's hand leaves the display screen has not been simulated, so step 244 is executed.

Step 243, discarding the second operation data.

Discarding the second operation data may also be understood as no longer processing the second operation data, and at this time, the interactive smart tablet may not send any data packet to the current human-computer interaction application program based on the second operation data, that is, may not instruct the current human-computer interaction application program to perform any response.

And 244, generating a new complement and lift-off event data packet according to the second operation data, and setting a completion flag. Step 245 is performed.

Because the UP event that the user leaves the display screen by hands is not simulated at present, the UP event needs to be simulated, namely, a new data packet of the complementary lift-off event is generated. And, a flag needs to be set to directly discard the subsequently received second operation data.

It should be noted that the specific operation sequence embodiment for generating a new complementary lift-off event packet and setting the flag of the new complementary lift-off event packet is not limited.

And step 245, processing the new complement and lift-off event data packet.

Specifically, a new complementary uplift event data packet is sent to the current human-computer interaction application program, so that the current human-computer interaction application program stops responding to the touch operation corresponding to the second operation data, that is, after the current human-computer interaction application program receives the new complementary uplift event data packet, it is determined that the touch operation corresponding to the second operation data is finished, and only the previous processing result of the second operation data is reserved.

It will be appreciated that the process flows illustrated in steps 241-245 are specific to the first disabled process flow.

In one embodiment, under the second disable processing flow, the processing manner adopted for disabling the second operation data is to discard the second operation data, and accordingly, when the disable processing flow is the second disable processing flow, step 240 includes steps 246 to 248:

and step 246, acquiring a contact identification corresponding to the second operation data.

In practical applications, there may be a case where the hand of the user moves from inside the disabled coordinate region to outside the disabled coordinate region, and for this case, it is still necessary to disable the corresponding second operation data. Alternatively, the stylus may leave the display screen first, and the user may leave the display screen after the user's hand, and the second operation data generated based on the user's hand touch still needs to be disabled. Therefore, when it is determined that the second touch coordinate does not fall into the forbidden coordinate area, the touch point identifier corresponding to the second operation data of the current frame is obtained first.

Step 247, determining whether the contact identifier is in a disabled state. If the contact identifier is in the disabled state, step 248 is performed. If the contact identifier is not in the disabled state, step 249 is executed.

Confirming whether the contact identification belongs to the forbidden state. If the touch point identifier is in the disabled state, it indicates that the second touch coordinate included in the previous frame of second operation data having the same touch point identifier once falls within the disabled coordinate region, and therefore, the current second operation data needs to be disabled, i.e., step 248 is executed. If the touch point identifier is not in the disabled state, it indicates that the second touch coordinate included in the previous frame of second operation data having the same touch point identifier does not fall within the disabled coordinate region, and at this time, step 249 is executed.

Step 248, discarding the second operation data.

Typically, in practical applications, after the generation rule of the touch point identifier is set, there is a case that two touch operations performed by the user's hand have the same touch point identifier, and at this time, if the touch point identifier corresponding to the previously received touch operation belongs to the disabled state, the response of the interactive smart tablet to the subsequently received touch operation will be affected, and therefore, in an embodiment, in order to prevent the above case, the setting step 248 includes steps 2481-2482:

and 2481, determining whether the second operation data belongs to a new touch drop event. If the touch down event does not belong to the new touch down event, step 2482 is executed. If the touch down event is a new touch down event, step 249 is executed.

The touch DOWN event can also be understood as a DOWN event. Specifically, it is determined whether the currently received second operation data belongs to a new touch DOWN event, that is, whether the current frame of second operation data is the second operation data generated based on the DOWN event, where it may be determined whether the current second operation data belongs to the new DOWN event by comparing the data generation time between the current second operation data and the previous frame of second operation data with the second touch coordinate. Further, if the second operation data is generated based on the DOWN event, it is determined that the second operation data belongs to a new touch drop event, that is, the second operation data is operation data corresponding to a touch operation newly performed by a hand of the user. Accordingly, step 249 is performed. Optionally, after determining a new touch drop event, the point id may be modified to a non-disabled state, and when it is determined again that the touch coordinate corresponding to the new touch drop event falls within the disabled coordinate region, the point id is modified to the disabled state. If the second operation data is not the second operation data generated based on the DOWN event, that is, it is determined that the second operation data is still the sub-operation data generated based on the MOVE event (the MOVE event after the UP event has been simulated), at this time, it may be considered that the hand of the user has not left the display screen, and therefore, step 2482 needs to be executed.

Step 2482, discarding the second operation data.

And step 249, normally processing the second operation data.

The normal processing of the second operation data may be understood as sending a data packet (such as a complementary UP event data packet, or a DOWN event data packet, a MOVE event data packet, and the like generated according to a new touch drop event) corresponding to the current second operation data to the current human-computer interaction application program, so that the application program responds according to the data packet.

It will be appreciated that the process flows illustrated in steps 246-248 are specific to the first disabled process flow.

Step 250, after the first operation data is processed, processing currently received third operation data, where the third operation data and the second operation data have the same category of operation subject and correspond to different touch operations.

The technical problem that the interactive intelligent tablet carries out error processing due to the fact that the hand touches the screen by mistake when a user uses the touch pen in the prior art can be solved through the technical means that the first operation data obtained based on the touch pen is processed, forbidden coordinate area information is determined according to the first operation data in the processing process, then whether a second touch coordinate contained in the second operation data falls into a forbidden coordinate area corresponding to the forbidden coordinate area information is determined, if the second touch coordinate falls into the forbidden coordinate area, the second operation data obtained based on the hand of the user is forbidden by the first forbidden processing flow, and then new touch operation sent by the hand of the user is processed by the first operation data. In the process of processing the first operation data, the second operation data corresponding to the user hand close to the touch pen is forbidden by setting the forbidden coordinate area, so that the error processing caused by the fact that the hand touches the display screen by mistake can be effectively prevented. Furthermore, when the second operation data is forbidden, a touch lifting event of a user hand is simulated by generating a supplementary UP event data packet, so that the current man-machine interaction application program responds to the touch lifting event, the supplementary UP event data packet is recorded by a flag setting mode, the second operation data is directly discarded according to the flag setting when the second operation data is subsequently received, and the logic rationality of the forbidden second operation data can be ensured. Further, when the second touch coordinate does not fall into the forbidden coordinate region, the second operation data processed by the second forbidden processing flow may be collected, that is, it is determined whether to forbid the second operation data according to the forbidden state of the point id, so that when the user hand moves out of the forbidden coordinate region, the response to the user hand touch operation is still abandoned, and it is further determined whether to forbid the second operation data by determining whether the second operation data corresponds to a new DOWN event, so that the accuracy of processing the second operation data may be ensured, and the user experience may be improved.

The following describes an exemplary operation data processing method provided in an embodiment of the present application:

fig. 7 is a first schematic diagram of a user performing a touch operation by using a stylus according to an embodiment of the present application. Referring to fig. 7, the interactive smart tablet 1 starts an electronic whiteboard application as an application for the current human-computer interaction. The user holds the touch pen 2 by the hand 3 and performs touch operation in the display screen 4 of the interactive smart tablet 1. At this time, it is detected that the user's hand 3 simultaneously touches the display screen 4. Further, the first operation data and the second operation data are received, a forbidden coordinate area 13 is determined according to the first touch coordinate contained in the first operation data, meanwhile, the second touch coordinate in the second operation data is obtained, and the second touch coordinate is determined to be located in the forbidden coordinate area 13. And then, processing the first operation data, setting the point id corresponding to the touch operation of the hand 3 to be in a forbidden state, and then confirming that the mark of the incomplete complement UP event data packet is set. Further, a new UP event data packet is generated and flag setting is performed, and then the UP event data packet is sent to the electronic whiteboard application program to notify the electronic whiteboard application program that the user has left the display screen with his hand, that is, no response is made to the touch operation of the hand 13. Then, in the operation process of the stylus 2, if the user's hand 3 does not leave the display screen yet, the first operation data and the second operation data are continuously received, and it is determined that the second touch coordinate corresponding to the current second operation data is located in the forbidden coordinate area 13 when the first operation data is processed, then the point id corresponding to the touch operation is set to the forbidden state, and it is confirmed that the flag setting has been completed, and at this time, the second operation data is discarded.

Further, when it is detected that the stylus 2 has left the display screen 4 but the hand 3 of the user has not left the display screen 4, the second operation data continues to be received, and it is determined that the second touch coordinate corresponding to the current second operation data does not fall within the disabled coordinate area 13, and then it is determined that the point id corresponding to the touch operation is in the disabled state, and the second operation data does not belong to the operation data generated by the new DOWN event, so that the second operation data is discarded.

Example two, fig. 8 is a second schematic diagram of a user performing a touch operation by using a stylus according to an embodiment of the present application. Referring to fig. 8, the interactive smart tablet 1 starts an electronic whiteboard application as an application for the current human-computer interaction. The hand 3 of the left hand of the user touches the display screen 4, and the eraser function is called according to the touch operation, namely, the mark 14 corresponding to the eraser is displayed. Meanwhile, the user holds the stylus pen 2 with the right hand and performs writing operation in the display screen 4 of the interactive smart tablet 1. Fig. 9 is a third schematic view illustrating a user performing a touch operation by using a stylus according to an embodiment of the present disclosure, where the third schematic view corresponds to a certain time during a writing process of the stylus 2. Referring to fig. 9, when the stylus 2 moves to the current first touch coordinate, the hand 3 of the left hand of the user is located in the disabled coordinate area 13, and at this time, the point id corresponding to the touch operation performed by the hand 3 of the left hand of the user is set to the disabled state, and the flag setting of the incomplete UP event data packet is confirmed. And further, generating a new supplementary UP event data packet, setting a mark, and then sending the supplementary UP event data packet to the electronic whiteboard application program to inform the electronic whiteboard application program that the user leaves the display screen. At this point, the electronic whiteboard application will determine that the user has left the display screen and delete the indicia 14 corresponding to the eraser. Then, in the operation process of the stylus 2, if the hand 3 of the left hand of the user still does not leave the display screen 4, the second operation data is continuously received, and if it is determined that the second touch coordinate corresponding to the current second operation data is located in the forbidden coordinate area 13, the point id corresponding to the touch operation is set to the forbidden state, and it is determined that the flag is set, and the second operation data is discarded. If it is determined that the second touch coordinate corresponding to the current second operation data does not fall within the forbidden coordinate region 13, it is further determined that the point id corresponding to the second operation data is in a forbidden state, and it is determined that the second operation data does not belong to operation data generated by a new DOWN event, so that the second operation data is discarded.

The above example can effectively prohibit the response to the hand operation falling nearby the touch pen in the operation process of the touch pen, and further effectively prevent the hand from mistakenly touching the display screen.

Fig. 10 is a schematic structural diagram of an operation data processing apparatus according to an embodiment of the present application. Referring to fig. 10, the operation data processing apparatus includes: a first processing module 301, a data disabling module 302, a second processing module 303.

The first processing module 301 is configured to process currently received first operation data, where the first operation data is operation data obtained based on a stylus; a data disabling module 302, configured to disable currently received second operation data, where the second operation data and the first operation data have at least one same data generation time, and a distance between a second touch coordinate included in the second operation data and a first touch coordinate included in the first operation data is smaller than a preset threshold; a second processing module 303, configured to process currently received third operation data after the first operation data is processed, where the third operation data and the second operation data have operation bodies of the same category and correspond to different touch operations.

The technical problem of error processing of the interactive intelligent tablet due to the fact that a hand touches a screen by mistake when a user uses the stylus in the prior art can be solved by processing first operation data obtained based on the stylus and disabling currently received second operation data in the processing process, wherein the second operation data and the first operation data have at least one same data generation time and the distance between corresponding touch coordinates is smaller than a preset threshold value, and then processing the first operation data and the third operation data which have the same operation main body with the second operation data normally. In the process of processing the first operation data, the second operation data close to the touch pen is forbidden, so that the error processing caused by the fact that a hand mistakenly touches the display screen can be effectively avoided, in addition, the second operation data close to the touch pen can be forbidden only by setting the preset threshold value of the distance between the touch coordinates, the remote operation data can be processed normally, and then when a user uses the finger and the touch pen to perform touch operation at the same time, the correct response of the touch operation is ensured. After the first operation data is processed, the touch operation newly sent by the operation main body corresponding to the second operation data is processed normally, so that the correct response of the touch operation sent by the hand of the user can be ensured, and the use experience of the user is improved.

On the basis of the above embodiment, the data disabling module 302 includes: a data receiving unit for receiving second operation data; the flow determining unit is used for determining a corresponding forbidden processing flow according to the second operation data; and the flow execution unit is used for processing the second operation data according to the forbidden processing flow.

On the basis of the above embodiment, the flow determination unit includes: the first coordinate acquisition subunit is used for acquiring a second touch coordinate contained in the second operation data; and the first forbidden process determining subunit is used for determining to adopt a first forbidden processing process when determining that the second touch coordinate falls into a forbidden coordinate area.

On the basis of the foregoing embodiment, the first processing module 301 is further configured to determine the forbidden coordinate area information according to the first touch coordinate included in the first operation data.

On the basis of the above embodiment, the first touch coordinate is a hovering coordinate when the stylus is hovering or a touch coordinate when the stylus touches the display screen.

On the basis of the above embodiment, the first processing module 301 includes: the data processing unit is used for processing the currently received first operation data; the second coordinate acquisition unit is used for acquiring a first touch coordinate contained in the first operation data; and the area generating unit is used for generating forbidden coordinate area information according to a preset area size, and the first touch coordinate falls into a forbidden coordinate area corresponding to the forbidden coordinate area information.

On the basis of the above embodiment, the operation data processing apparatus further includes: and the second forbidding process determining module is used for determining to adopt a second forbidding processing process when the second touch coordinate does not fall into the forbidding coordinate area.

On the basis of the foregoing embodiment, the disabling process flow is a second disabling process flow, and the process execution unit includes: the identification obtaining subunit is used for obtaining the contact identification corresponding to the second operation data; a disabled state confirmation subunit, configured to determine whether the contact identifier is in a disabled state; and the forbidden subunit is used for discarding the second operation data if the contact point identifier is in a forbidden state.

On the basis of the above embodiment, the disabling subunit includes: a drop judging unit, configured to determine whether the second operation data belongs to a new touch drop event if the contact identifier is in a disabled state; and the data discarding grandchild unit is used for discarding the second operation data if the new touch drop event does not belong to the new touch drop event.

On the basis of the above embodiment, the operation data processing apparatus further includes: and the third processing module is used for normally processing the second operation data if the contact identification is not in the forbidden state.

On the basis of the foregoing embodiment, the disabling process flow is a first disabling process flow, and the process execution unit includes: the forbidden state setting subunit is used for setting the contact point identification corresponding to the second operation data to be in a forbidden state; the flag setting confirming subunit is used for determining whether the completion of the flag setting of the complement and raise event data packet is finished; an operation data discarding subunit, configured to discard the second operation data if the completion flag is set; a data packet generating subunit, configured to generate a new complementary uplift event data packet for the second operation data if the incomplete flag is set, and set the complete flag; and the data packet processing subunit is used for processing the new complementary uplift event data packet.

On the basis of the above embodiment, the data disabling module 302 includes: the data disabling unit is used for disabling currently received second operation data, the second operation data and the first operation data have at least one same data generation moment, and the distance between a second touch coordinate contained in the second operation data and a first touch coordinate contained in the first operation data is smaller than a preset threshold; and the processing result retaining unit is used for retaining the displayed processing result, and the processing result is the display result after the received second operation data is processed before the second operation data is forbidden.

On the basis of the above embodiment, the operation data processing apparatus further includes: and the area deleting module is used for deleting the forbidden coordinate area information after the first operation data is stopped being received.

In addition to the above embodiment, the second operation data is operation data obtained based on a hand of the user.

The operation data processing device provided by the above can be used for executing the operation data processing method provided by any of the above embodiments, and has corresponding functions and advantages.

It should be noted that, in the above-mentioned embodiment of the operation data processing apparatus, the included units and modules are merely divided according to functional logic, but are not limited to the above-mentioned division as long as the corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.

Fig. 11 is a schematic structural diagram of an operation data processing device according to an embodiment of the present application. In this embodiment, an interactive smart tablet is taken as an example to operate a data processing device for description. As shown in fig. 11, the interactive smart tablet 40 includes at least one processor 41, at least one network interface 42, a user interface 43, a memory 44, and at least one communication bus 45.

Wherein a communication bus 45 is used to enable the connection communication between these components.

The user interface 42 may comprise a display screen and a camera, and the optional user interface 43 may comprise a standard wired interface and a wireless interface. The display screen is an inductive liquid crystal display device, which is configured with at least one type of touch module (not shown).

The network interface 42 may optionally include a standard wired interface, a wireless interface (e.g., a Wi-Fi interface), among others.

Processor 41 may include one or more processing cores, among others. Processor 41 interfaces with various components throughout interactive intelligent tablet 40 using various interfaces and lines to perform various functions of interactive intelligent tablet 40 and to process data by executing or executing instructions, programs, code sets or instruction sets stored within processor 41 and invoking data stored within memory 44. Alternatively, the processor 41 may be implemented in at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 41 may integrate one or a combination of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display screen; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 41, but may be implemented by a single chip.

The Memory 44 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 44 includes a non-transitory computer-readable medium. The memory 44 may be used to store instructions, programs, code sets or instruction sets. The memory 44 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, and the like; the storage data area may store data and the like referred to in the above respective method embodiments. The memory 44 may alternatively be at least one memory device located remotely from the aforementioned processor 41. As shown in fig. 11, the memory 44, which is a type of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an operating application of the interactive smart tablet.

In the interactive smart tablet 40 shown in fig. 11, the user interface 43 is mainly used for providing an input interface for the user to obtain data input by the user; and the processor 41 may be configured to call the operation application of the interactive smart tablet stored in the memory 44, and specifically perform the relevant operations in the operation data processing method in the above embodiment.

The interactive intelligent tablet can be used for executing any operation data processing method and has corresponding functions and beneficial effects.

In addition, the embodiment of the present invention further provides a storage medium containing computer-executable instructions, which are used for performing relevant operations in the operation data processing method provided in any embodiment of the present application when executed by a computer processor, and have corresponding functions and advantages.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product.

Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. An operational data processing method, comprising:

2. The method according to claim 1, wherein said disabling currently received second operation data comprises:

receiving second operation data;

3. The method according to claim 2, wherein the determining a corresponding disabled process flow from the second operation data comprises:

acquiring a second touch coordinate contained in the second operation data;

4. The method according to claim 3, wherein the processing the currently received first operation data further comprises:

5. The operation data processing method according to claim 1 or 4, wherein the first touch coordinate is a hover coordinate when the stylus is hovering or a touch coordinate when the stylus is touching a display screen.

6. The method for processing operation data according to claim 4, wherein the determining forbidden coordinate area information according to the first touch coordinate contained in the first operation data comprises:

acquiring a first touch coordinate contained in the first operation data;

7. The operational data processing method according to claim 3, further comprising:

8. The operational data processing method according to claim 7, wherein the disabled process flow is a second disabled process flow,

acquiring a contact identifier corresponding to the second operation data;

determining whether the contact identification is in a disabled state;

9. The method of claim 8, wherein discarding the second operation data if the contact identifier is in a disabled state comprises:

10. The operational data processing method according to claim 8, further comprising:

11. The operational data processing method according to claim 3, wherein the disabled process flow is a first disabled process flow,

if the completion flag is set, discarding the second operation data;

and processing the new complementary uplift event data packet.

12. The method according to claim 1, wherein the step of disabling the currently received second operation data further comprises:

13. The operational data processing method according to claim 4, further comprising:

14. The operation data processing method according to claim 1, wherein the second operation data is operation data obtained based on a hand of a user.

15. An operational data processing apparatus, comprising:

16. An operational data processing apparatus, comprising:

one or more processors;

a memory for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the operational data processing method of any one of claims 1-14.

17. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of processing operational data according to any one of claims 1 to 14.