CN110045840B

CN110045840B - Writing track association method, device, terminal equipment and storage medium

Info

Publication number: CN110045840B
Application number: CN201910301042.1A
Authority: CN
Inventors: 吴佳宝
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shizhen Information Technology Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shizhen Information Technology Co Ltd
Priority date: 2019-04-15
Filing date: 2019-04-15
Publication date: 2023-07-18
Anticipated expiration: 2039-04-15
Also published as: CN110045840A

Abstract

The embodiment of the invention discloses a writing track association method, a writing track association device, terminal equipment and a storage medium. The method comprises the following steps: acquiring track data of a current writing track corresponding to writing operation by receiving the writing operation, wherein the track data comprises coordinate data and time data; confirming the position relation and the time relation between the current writing track and the existing writing track according to the coordinate data and the time data; and establishing an association between writing tracks meeting the preset position relation and the preset time relation. Based on the writing track association relation established by the position relation and the time relation, soft binding of writing tracks with logic relation in the writing process is realized, the writing tracks with soft binding relation can be rapidly selected, and the operation efficiency of target selection by secondary processing of the writing tracks is improved.

Description

Writing track association method, device, terminal equipment and storage medium

Technical Field

The embodiment of the invention relates to the technical field of intelligent interaction tablets, in particular to a writing track association method, a writing track association device, terminal equipment and a storage medium.

Background

With the development of intelligent technology, the variety of electronic products contacted by people in daily life is increasingly rich, wherein the interactive electronic products realized based on the touch technology show a comprehensive function integration trend as good man-machine interaction experience. The intelligent interaction panel is representative integrated equipment, is suitable for group interaction occasions such as conferences, teaching, business display and the like, integrates various functions such as projectors, video conferences and the like, can effectively improve communication environment, presents multimode content and improves group communication efficiency.

Handwriting input serves as an important function of the intelligent interaction panel, writing tracks with predefined shape characteristics such as forms, rectangles and circles can be integrally selected and edited during secondary processing, and when other writing tracks are subjected to secondary editing, batch processing can only be performed or the range covered by the control moving process can be processed after the control (such as deleting the control) is activated, so that the secondary processing target selection operation of the existing writing tracks is complicated.

Disclosure of Invention

The invention provides a method, a device, terminal equipment and a storage medium for determining writing track association, which are used for solving the technical problem of complicated target selection operation of the existing writing track in the prior art.

In a first aspect, an embodiment of the present invention provides a method for associating writing tracks, including:

receiving writing operation, and acquiring track data of a current writing track corresponding to the writing operation, wherein the track data comprises coordinate data and time data;

confirming the position relation and the time relation between the current writing track and the existing writing track according to the coordinate data and the time data;

and establishing an association between writing tracks meeting the preset position relation and the preset time relation.

The establishing the association between writing tracks meeting the preset position relationship and the preset time relationship comprises the following steps:

judging whether a current writing track has a preamble writing track or not, wherein the current writing track and the preamble writing track meet a preset position relation and a preset time relation;

if the current writing track has the preamble writing track, adding the current writing track into a virtual container where the preamble writing track is located;

if the current writing track does not have the preamble writing track, adding the current writing track into the newly-built virtual container;

wherein the writing tracks in a single virtual container are integrally associated.

Wherein the virtual container is provided with a time tag; the time data includes an end time; the time tag is the end time of the newly added written track.

Wherein the time data includes a start time;

judging whether the current writing track has a preamble writing track or not, wherein the current writing track and the preamble writing track meet a preset position relation and a preset time relation, and the method comprises the following steps:

acquiring a time tag of an existing virtual container, and confirming the time interval between the current writing track and the time tag;

generating an external rectangle of the existing virtual container, and confirming the minimum distance between the current writing track and the external rectangle;

if the time interval between the existing virtual container and the current writing track is within the threshold range and the minimum distance is within the threshold range, confirming that the current writing track has the preamble writing track; otherwise, confirming that the current writing track does not have the preamble writing track.

Wherein the circumscribed rectangle is a parallel circumscribed rectangle or a minimum circumscribed rectangle;

and two adjacent sides of the parallel circumscribed rectangle are respectively parallel to two coordinate axes of a coordinate system where the coordinate data are located.

The track data further comprises pen touch feature identifiers, and the pen touch feature identifiers of writing tracks in the single virtual container are the same;

correspondingly, the step of obtaining the time label of the existing virtual container and confirming the time interval between the current writing track and the time label comprises the following specific steps:

And acquiring a time tag of the existing virtual container with the same pen touch characteristic identification as the current writing track, and confirming the time interval between the current writing track and the time tag.

Wherein, the pen touch characteristic mark of the writing track in the virtual container is recorded by the pen touch label of the virtual container.

Wherein the method further comprises:

when the erasing operation is detected, the time label of the virtual container where the writing track corresponding to the erasing operation is located is updated.

If the current writing track does not have the preamble writing track, adding the current writing track to the newly-built virtual container, and then further comprising:

the time stamp of the virtual container preceding the newly created virtual container is deleted.

In a second aspect, an embodiment of the present invention further provides a device for associating writing tracks, including:

the track detection unit is used for receiving writing operation and obtaining track data of a current writing track corresponding to the writing operation, wherein the track data comprises coordinate data and time data;

the constraint confirming unit is used for confirming the position relation and the time relation between the current writing track and the existing writing track according to the coordinate data and the time data;

The association establishing unit is used for establishing association between writing tracks meeting the preset position relation and the preset time relation.

Wherein the association establishing unit includes:

the track judging module is used for judging whether a preamble writing track exists in the current writing track or not, and the current writing track and the preamble writing track meet the preset position relation and the preset time relation;

the first adding module is used for adding the current writing track to a virtual container where the preamble writing track is located if the preamble writing track exists in the current writing track;

the second adding module is used for adding the current writing track to the newly-built virtual container if the current writing track does not have the preamble writing track;

Wherein the time data includes a start time;

the track judging module comprises:

the label acquisition sub-module is used for acquiring the time label of the existing virtual container and confirming the time interval between the current writing track and the time label;

The rectangle generation sub-module is used for generating an external rectangle of the existing virtual container and confirming the minimum distance between the current writing track and the external rectangle;

the track confirming sub-module is used for confirming that the current writing track has a preamble writing track if the time interval between the existing virtual container and the current writing track is within a threshold range and the minimum distance is within the threshold range; otherwise, confirming that the current writing track does not have the preamble writing track.

correspondingly, the tag obtaining sub-module is specifically configured to:

Wherein the apparatus further comprises:

and the erasing updating unit is used for updating the time label of the virtual container where the writing track corresponding to the erasing operation is located when the erasing operation is detected.

Wherein, the device still includes:

and the tag deleting unit is used for deleting the time tag of the virtual container before the newly-built virtual container.

In a third aspect, an embodiment of the present invention further provides a terminal device, where the terminal device includes:

one or more processors;

a memory for storing one or more programs;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of writing trace association as described in any of the first aspects.

In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the writing trace associating method according to any one of the first aspects.

The method, the device, the terminal equipment and the storage medium for associating the writing track acquire track data of the current writing track corresponding to the writing operation by receiving the writing operation, wherein the track data comprises coordinate data and time data; confirming the position relation and the time relation between the current writing track and the existing writing track according to the coordinate data and the time data; and establishing an association between writing tracks meeting the preset position relation and the preset time relation. Based on the writing track association relation established by the position relation and the time relation, soft binding of writing tracks with logic relation in the writing process is realized, the writing tracks with soft binding relation can be rapidly selected, and the operation efficiency of target selection by secondary processing of the writing tracks is improved.

Drawings

FIG. 1 is a flowchart of a method for associating writing tracks according to a first embodiment of the present invention;

fig. 2 is an interface schematic diagram of touch input of an intelligent interaction panel according to a first embodiment of the present invention;

FIG. 3 is a flowchart of a method for associating writing tracks according to a second embodiment of the present invention;

FIG. 4 is a schematic diagram of a circumscribed rectangle according to a second embodiment of the present invention;

FIG. 5 is a schematic diagram of a variation of a circumscribed rectangle according to a second embodiment of the present invention;

FIG. 6 is a flowchart for determining a trace of a preamble writing according to a second embodiment of the present invention;

FIGS. 7-12 are schematic diagrams of an exemplary implementation provided in a second embodiment of the present invention;

fig. 13 is a schematic structural diagram of a device for associating writing tracks according to a third embodiment of the present invention;

fig. 14 is a schematic structural diagram of a terminal device according to a fourth embodiment of the present invention.

Detailed Description

The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are for purposes of illustration and not of limitation. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.

Example 1

The method for associating writing tracks provided in the embodiment may be performed by a writing track-associated device, where the writing track-associated device may be implemented by software and/or hardware, and the writing track-associated device may be formed by two or more physical entities or may be formed by one physical entity. For example, the device associated with the writing track may be a cell phone, an industrial control computer, or the like.

For easy understanding, in the embodiment, the detailed process of writing and touch data processing is described in an exemplary manner when the method of writing track association is implemented by using the intelligent interaction panel as an actual carrier. The intelligent interaction panel can be integrated equipment for controlling the content displayed on the display panel and realizing man-machine interaction operation through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, sound equipment, a television, a video conference terminal and the like.

Generally, the smart interactive tablet includes at least one display screen. For example, the smart interactive tablet 1 shown in fig. 2 is configured with a display screen 2 having a touch function, and the display screen 2 may be a capacitive screen, a resistive screen, or an electromagnetic screen. Further, the user can realize touch operation by touching the display screen 2 with a finger or a stylus, and accordingly, the intelligent interaction panel 1 detects a touch position and responds according to the touch position to realize a touch function.

Typically, the intelligent interactive tablet is installed with at least one operating system, wherein the operating system includes, but is not limited to, an android system, a Linux system, and a Windows system. Further, the intelligent interactive tablet may install at least one application program having a writing function. The application program can be an application program of an operating system, and meanwhile, the application program downloaded from a third party device or a server is also installed. Optionally, the application program has other editing functions besides writing functions, such as form insertion, picture insertion, form drawing, figure drawing, and the like. Wherein, the drawn table or graph is a computer drawing standard element. A computer drawing standard element may be understood as a printed standard element drawn by an intelligent interactive tablet, which is distinguished from an element written by a user.

Specifically, referring to fig. 1, the method for associating writing tracks specifically includes:

step S110, receiving writing operation, and obtaining track data of a current writing track corresponding to the writing operation, wherein the track data comprises coordinate data and time data.

The method comprises the steps that a writing area for displaying input content in response to writing operation of a user is arranged on a touch screen configured by intelligent handwriting equipment such as an electronic whiteboard, an electronic blackboard, a digital tablet, an intelligent conference tablet and the like, when the writing area is used for writing, for example, a touch pen or a finger is contacted with the touch screen, the touch screen can sense change of infrared rays, change of current, change of voltage or change of magnetic flux (corresponding to specific setting types of the infrared touch screen, the capacitive touch screen, the resistive touch screen or the electromagnetic touch screen), a touch signal containing coordinates of a touch position and trigger time of the touch signal are obtained, track data of a writing track input in the process of each pressing and writing of the touch pen or the finger of the user to lifting and stopping writing can be obtained according to the coordinates and time of each writing point of the writing track, and then the writing track input by the user is displayed in real time in the writing area of the touch screen according to the track data. Of course, the writing process is not limited to writing, and any input process for displaying an operation track implemented on the touch screen of the smart handwriting device may be regarded as the writing process.

And step 120, confirming the position relation and the time relation between the current writing track and the existing writing track according to the coordinate data and the time data.

The data relationship of the track data corresponding to each track point generated in the writing process is generally described from two levels. Firstly, determining whether two track points belong to the same writing track according to the coordinate data and time data of the two track points in a basic processing mode, thereby determining coordinate sets of all track points in one writing track and further displaying the writing track; and secondly, carrying out character recognition according to the relation among the writing tracks, for example, the position relation among the writing tracks in the plane, and further converting the handwriting input characters into a standard drawing font of the intelligent interaction panel for display.

In the scheme, the advanced treatment of the writing track is derived from the interaction requirement of carrying out secondary treatment on the writing track, and on the basis of the interaction requirement, the attention point of the advanced treatment of the writing track in the scheme is not in recognition of the substantial content expressed by the writing track, but in spatial association and time association in the process of generating the writing track, and thus, the relationship between the writing tracks is confirmed. Specifically, if the spatial correlation degree and the temporal correlation degree generated by the two writing tracks are sufficiently high, the two writing tracks are considered to belong to the same group of operations; further, if there are a sufficiently high spatial association degree and a sufficiently high temporal association degree between two adjacent writing tracks for two or more continuous writing tracks, it is considered that two or more continuous writing tracks all belong to the same group of operations, and when the secondary processing is performed, the writing tracks corresponding to the same group of operations can be integrally hit and operated as a whole. The spatial association is characterized by a positional relationship (mainly distance), and the temporal association is characterized by a temporal relationship (mainly interval duration).

For example, when handwriting annotation is performed on an electronic whiteboard, as shown in fig. 2, handwriting input "error" is performed in the upper left corner of the display screen 2, and handwriting input "error" is performed in the lower right corner, both of which are composed of a plurality of writing tracks. For a single word, the writing track has a compact structure, the time interval between the single writing tracks is short, and the spatial association degree and the time association degree of the writing tracks can be found to be high when the calculation is performed based on the coordinate data and the time data. In the handwriting input content shown in fig. 2, the distance between the last writing track of the "error" and the first writing track of the "error" is longer, and the time for moving the stylus or the finger by the distance is also relatively longer, that is, the time for ending the last writing track of the "error" and starting the interval between the first writing track of the "error" is longer, and the position relationship and the time relationship between the two writing tracks can be found by respectively calculating the coordinate data and the time data, so that the space association degree and the time association degree of the two writing tracks are relatively lower.

When the position relationship and the time relationship of the two continuous writing tracks are calculated specifically, the position relationship can be confirmed based on the coordinate data of the last track point of the previous writing track and the coordinate data of the first track point of the subsequent writing track, and the time relationship can be confirmed based on the time data of the last track point of the previous writing track and the time data of the first track point of the subsequent writing track. As shown in fig. 2, the point a of the "wrong" character is the last trace point of the first writing trace "the same as" the first trace point of the second writing trace "the first", and the point B is the first trace point of the second writing trace "the first", and when confirming the position relationship and the time relationship of the "the first" and the "the second", the calculation can be performed based on the coordinate data and the time data of the point a and the point B, that is, the position relationship and the time relationship of the "the first" and the "the second" are represented by the position relationship and the time relationship of the point a and the point B.

In addition to the point-based relationship determination, there are other ways of confirming the positional relationship and the temporal relationship based on another layer. The overall implementation goal of the scheme is to realize the overall association of the writing track, so that the confirmation of the position relationship and the time relationship can be based on the overall confirmation of the current writing track and the existing writing track. With continued reference to fig. 2, the first writing trace "horizontal" already exists as a whole, and when confirming the relationship between the second writing trace "horizontal" and the second writing trace "vertical" is determined, only the nearest distance between the point B in "horizontal" and the trace point in "vertical" is needed to be calculated (the point is located at the upper position of the middle part of the "vertical", and the distance calculation between the two points is the conventional calculation in the rectangular coordinate system); in confirming the time relationship of "a" and "an" and "the" is, the difference between the start time of "a" and the end time of "a" is calculated directly. By using the mode of integrally judging the position relationship, the association judgment with better adaptability can be realized aiming at more variable contents in the actual writing process.

Different ways of confirming the positional relationship may have different results for the same two writing tracks. For example, in a certain touch drawing process, two parallel lines which are distributed up and down and are closer to each other need to be drawn in one component, and the parallel lines which are distributed up and down are generally drawn from left to right according to a general drawing habit. If the position relationship is confirmed based on the coordinate data of the last track point and the first track point, the two track points for relationship judgment are respectively positioned at two different ends on two parallel lines, at this time, the distance between the two track points is likely to be larger than the length of the parallel lines, and the two parallel lines are likely to confirm that no association relationship exists. If the method based on the whole writing track confirmation is adopted, the first one of the two parallel lines exists as a whole, and the distance between the second one of the two parallel lines and the first one, namely the nearest distance between the first track point of the second one and the first one, namely the distance between the two parallel lines, namely the whole confirmation is adopted in the scene, so that the height of the space relevance can be improved, and the method is more in line with the user behavior logic of the actual writing operation.

Step S130, establishing association between writing tracks meeting the preset position relation and the preset time relation.

If the position relation and the time relation of the current writing track and the existing writing track reach the set standard for establishing association, namely reach the preset position relation and the preset time relation respectively, the association of the current writing track and the existing writing track is established. A simple preset positional relationship is that the distance is within an absolute distance range, e.g. a number of pixels, and the preset temporal relationship may be that the time interval is within a certain duration, e.g. a number of seconds. In addition, the preset position relationship can also be within a relative distance range, the relative distance can be confirmed based on the size of the screen, for example, a plurality of times of the height or width of the screen, the relative distance setting based on the size of the screen can enable the finally associated writing tracks to be suitable for the current display size, and the number of tracks in a group of mutually associated writing tracks is controlled, so that the number of writing tracks selected in secondary processing is more friendly to a user in the current display interface. The definition of a specific distance range and the definition of a time range are not innovative emphasis on the present solution, and are not intended to be limiting of specific numerical values.

The association record that establishes the associated writing trace may be implemented by a data structure for processing a plurality of data, such as an array, a collection, or a dictionary. If an array or set mode is adopted, each group of associated writing tracks can be respectively stored through one array or set, that is, if a plurality of groups of associated writing tracks exist in the current display page, the same number of arrays or sets need to be maintained, that is, one page needs to maintain a plurality of arrays or sets. If a dictionary mode is adopted, a dictionary can be maintained for each display page, a group of associated writing tracks in one display page can be stored in one page of the dictionary, and when the associated writing tracks are operated in secondary processing, only a corresponding page in the dictionary needs to be maintained. In the scheme, the dictionary is adopted as the data structure for realizing the maintenance corresponding to the association maintenance strategy of the discrete writing track in the display page, so that the complexity of writing track data maintenance can be effectively reduced, and the realization of the bottom data processing process is simpler.

The method comprises the steps that track data of a current writing track corresponding to writing operation are obtained through receiving the writing operation, wherein the track data comprise coordinate data and time data; confirming the position relation and the time relation between the current writing track and the existing writing track according to the coordinate data and the time data; and establishing an association between writing tracks meeting the preset position relation and the preset time relation. Based on the writing track association relation established by the position relation and the time relation, soft binding of writing tracks with logic relation in the writing process is realized, the writing tracks with soft binding relation can be rapidly selected, and the operation efficiency of target selection by secondary processing of the writing tracks is improved.

Example two

Fig. 3 is a flowchart of a method for associating writing tracks according to a second embodiment of the present invention. The present embodiment is embodied on the basis of the above embodiment.

Specifically, referring to fig. 3, the method for associating writing tracks provided in this embodiment specifically includes:

step S210, receiving writing operation, and obtaining track data of a current writing track corresponding to the writing operation, wherein the track data comprises coordinate data and time data.

In intelligent interactive flat panel, the display screen actually includes display module and touch module, and display and touch are realized through display module and touch module respectively, and corresponding, there is a set of locate mode respectively in display module and touch module, when carrying out display control and touch detection, the locate mode that actually adopts is different, only display and touch are realized in the coplanar generally to adopt same coordinate system or set for the coordinate mapping mode, lead to not seeing the difference from the vision between them, for example write the orbit, just after drawing in the picture of display in visual effect corresponds the orbit that has generated and has been similar to the pen and draw on paper. In essence, the touch signal detected in the touch module can calculate the coordinates and time of the touch operation occurring in the touch module, and then the coordinates are displayed corresponding to the same position in the display module. The coordinate system in the display module is usually with the top point of the upper left corner as the origin, the horizontal direction as the horizontal axis, the right digital increment, the vertical direction as the vertical axis, the downward digital increment, and the relative azimuth relationship (up, down, left, right, horizontal and vertical) described herein takes the display direction of the display screen 2 in the intelligent interaction device 1 in fig. 2 as a reference. In this scheme, the coordinate data refers to coordinates corresponding to the coordinate system in the display module, and the time data is the time of occurrence of the touch operation.

And step 220, confirming the position relation and the time relation between the current writing track and the existing writing track according to the coordinate data and the time data.

For the calculation of the positional relationship, besides the calculation based on the distance between the last track point and the first track point and the calculation based on the closest distance between the first track point and the existing writing track described in the previous embodiment, the calculation based on the circumscribed rectangle of the existing writing track may be adopted, and it should be noted that, the existing writing track herein does not refer to all writing tracks displayed on the current page, but uses the association relationship as a unit, and each group of writing tracks having an independent association relationship corresponds to one circumscribed rectangle.

There are various implementations of the bounding rectangle, for example, the smallest bounding rectangle, which can describe the area where a set of associated writing tracks is located most finely, as shown in fig. 4, where the writing track 10 is the first pen (dot line) of "wrong" word, and the bounding rectangle 11 of "right" in fig. 2 is the smallest bounding rectangle, where the blank space is small, but as the associated writing track increases, the shape of the smallest bounding rectangle changes relatively more, and the computation of the bounding rectangle also becomes relatively more complex. As shown in FIG. 5, the writing track 10 includes a first pen and a second pen of "wrong" character, and the outer rectangle 11 still adopts the minimum outer rectangle, and the slope of each side of the outer rectangle 11 in FIG. 4 is obviously changed. Besides the minimum circumscribed rectangle, a parallel circumscribed rectangle mode can be adopted, two adjacent sides of the parallel circumscribed rectangle are respectively parallel to two coordinate axes of a coordinate system where the coordinate data are located, calculation of the circumscribed rectangle in the mode is simple, and as shown in fig. 7 and 8, the circumscribed rectangles 11 corresponding to the writing tracks 10 are all parallel circumscribed rectangles, at the moment, only the coordinate data of the uppermost, lowermost, leftmost and rightmost track points of a group of associated writing tracks 10 in the coordinate system can be confirmed, and the coordinate data of the four vertexes of the parallel circumscribed rectangle can be obtained only by confirming the larger and smaller coordinate data of the uppermost, lowermost, leftmost and rightmost track points. In this embodiment, the explanation is mainly based on parallel circumscribed rectangles.

Step S230, judging whether a preamble writing track exists in the current writing track, wherein the current writing track and the preamble writing track meet a preset position relation and a preset time relation.

A group of associated handwriting data is stored through a virtual container, and the data structure actually adopted by the virtual container can be an array, a collection, a dictionary and the like. The time data for each written trace may be recorded in a virtual container for use in determining the time relationship. In the actual processing process, when judging whether the writing track between the current writing track and the existing virtual container is associated or not, the time judgment only needs to be compared with the time data of the last track point, so that a time tag is directly set for the virtual container, the time data of the writing track comprises the ending time, namely the detection time of the last track point in the latest added writing track, the data processing of a single writing track can be reduced based on the time recording mode of the time tag, and the time data of the virtual container for reference can be quickly obtained. As a basis for the comparison, the start time of the current written track needs to be recorded. Based on the setting of the time stamp in the virtual container, referring to fig. 6, step S230 may further include the following steps:

Step S231, obtaining a time label of the existing virtual container, and confirming the time interval between the current writing track and the time label.

The time interval is obtained by calculating the difference between the time stamp of the existing virtual container and the start time in the time data of the current written track.

For part of intelligent interaction tablet, it can realize that a plurality of users write the operation simultaneously, and the track of writing that just produces can come from a plurality of different sources of writing. Such a writing scenario may show that the positional relationship and the temporal relationship of a certain writing track corresponding to two or more users are very close, but such writing tracks should obviously not be added to the same virtual container. The prior art can realize the identification and differentiation of different writing sources (especially writing based on a smart pen), and the writing tracks generated by different user writing operations can be distinguished from display attributes (such as color, thickness and the like) when displayed.

In the scheme, multi-user writing is realized in a complex state, track data is provided with coordinate data and time data, and the corresponding virtual container is provided with a pen touch label besides a time label, wherein the pen touch label is used for recording the pen touch characteristic identification of the writing track, and the pen touch characteristic identification of the writing track in the single virtual container is the same. Of course, the virtual container is not required to be provided with a pen touch tag alone, and the pen touch feature identifier is stored along with the writing track.

If the writing track carries the pen-touch feature identifier, it is necessary to determine whether the pen-touch feature identifier is the same when executing step S231, and only obtain the time stamp of the virtual container with the same pen-touch feature identifier. The specific judgment mode depends on the recording mode of the pen touch characteristic mark in the virtual container. If the pen touch characteristic identification is stored along with the writing track, the pen touch characteristic identification is read from the writing track for comparison, and if the pen touch characteristic identification is stored in the pen touch label of the virtual container, the pen touch characteristic identification is read from the pen touch label for comparison.

Specifically, in the case of multi-writing, the implementation procedure of step S231 is adaptively adjusted to:

And step 232, generating an external rectangle of the existing virtual container, and confirming the minimum distance between the current writing track and the external rectangle.

The minimum distance between the current writing track and the circumscribed rectangle can be calculated in an accurate mode or in a rapid mode. The accurate calculation mode is equivalent to setting a round rectangle outside the circumscribed rectangle, the shortest distance from any point on the round rectangle to the circumscribed rectangle is the same, the calculation mode is equivalent to the track point in the ring enclosed by the circumscribed rectangle and the round rectangle, and the track point is regarded as being associated with the writing track in the circumscribed rectangle. The quick calculation mode is to directly expand the circumscribed rectangle by a set distance to obtain a peripheral rectangle, and track points falling in a ring formed by the circumscribed rectangle and the peripheral rectangle are all regarded as being related to writing tracks in the circumscribed rectangle. In the present embodiment, description is mainly made based on the peripheral rectangle.

Step S233, if the time interval between the existing virtual container and the current writing track is within a threshold range and the minimum distance is within the threshold range, confirming that the current writing track has a preamble writing track; otherwise, confirming that the current writing track does not have the preamble writing track.

Based on the calculation results in step S231 and step S232, comparing the current writing track with a preset distance threshold and a preset time threshold, and if both the current writing track and the preset time threshold meet the requirements, confirming that the current writing track has a preamble track.

In addition, the above judgment of the distance is only aimed at the constraint of the maximum range outside the circumscribed rectangle, and if the constraint is the point within the circumscribed rectangle, the association relationship is directly confirmed. In addition, the steps S231, S232 and S233 are not strictly sequential, but only based on the description of the adaptive use of numbers in the flowchart, the implementation of the process of performing the calculation twice and then judging is not a constraint on the execution sequence, and may be actually that the time interval is calculated first and whether the time interval is within the time threshold range or whether the minimum distance is calculated first and whether the time interval is within the distance threshold range is judged first, which is to be understood that the steps S231, S232 and S233 are only text-expressed sequential, and exist as a whole in fact as a complete judging process.

Step S240, if the current writing track has the preamble writing track, adding the current writing track into a virtual container where the preamble writing track is located.

And step S250, if the current writing track does not have the preamble writing track, adding the current writing track into the newly-built virtual container.

Step S240 is similar to the operation in step S250, if an array or collection mode is adopted, the current writing track is required to be added into an array or collection storing the corresponding preamble writing track in step S240, and the time label is correspondingly updated according to the time data of the current writing track; in step S250, an array or a set needs to be newly created, and then the current writing track is added to the newly created array or set, and a time tag is correspondingly set according to the time data of the current writing track. If the dictionary mode is adopted, in step S240, the current writing track needs to be added to the page storing the corresponding preamble writing track in the dictionary, and the time tag of the page is correspondingly updated according to the time data of the current writing track; in step S250, the current writing track needs to be added to a new page in the dictionary, and the time tag of the page is set correspondingly according to the time data of the current writing track.

The writing tracks in the single virtual container are integrally associated, and particularly when the input writing tracks are processed for the second time, the selection of the single writing track can trigger the selection of the combination of all writing tracks in the associated virtual container.

If the writing is just started in the whole display page, that is, the first writing track does not have the preamble writing track, the first writing track is directly added to the newly-built virtual container, and the time tag is added.

And step S260, when the erasing operation is detected, updating the time label of the virtual container where the writing track corresponding to the erasing operation is located.

The erase operation is also an update to the existing written track, the time at which the erase operation ends last being the new time stamp for the virtual container. In terms of operation logic, the erasing operation is highly likely to receive a new handwriting track, and if a new time tag exists, the new handwriting track is likely to be added to the virtual container which just performs the deleting operation based on the implementation process of the scheme.

In another detailed implementation, after the virtual container is created, the time stamp of the virtual container before the created virtual container may be deleted. The inherent logic of this processing mode is that if a new virtual container is already created, it is described that it is impossible to build a connection with an earlier created virtual container even if a new handwriting track is created, and only the latest virtual container is reserved, if implementation of the detail excludes implementation of step S260, when the time relation is judged, the judgment is directly performed based on the virtual container with the time tag, so that the data processing amount can be effectively reduced, and especially when the number of virtual containers is large, the effect is obvious. Even if the implementation of the details is performed simultaneously with step S260, the data processing amount can be reduced to some extent.

Referring specifically to fig. 7-12, the present embodiment is exemplarily described based on fig. 7-12. The display page is initially blank, a first pen with a ' wrong ' word is input in fig. 7, a writing track 10 ' is formed, a ' horizontal stroke ' is directly added to a newly built virtual container, and a time tag is added, for the virtual container, an external rectangle 11 can be constructed according to endpoints of the ' horizontal stroke ' in four directions in a coordinate system, the external rectangle 11 is a parallel external rectangle, a peripheral rectangle 12 can be obtained after the external rectangle expands outwards by a distance R in four directions, and if a subsequent writing track falls into a closed area surrounded by the peripheral rectangle 12 in a set time range, the association with the ' horizontal stroke ' needs to be established. In fig. 8, a writing trace 10 "one" is quickly input, and based on the foregoing determination of the positional relationship and the time relationship, "one" needs to be added to the virtual container where "bar" is located, at which time a new circumscribed rectangle 11 and a surrounding rectangle 12 can be formed. The input continues until the input of the writing trace 10 of the "wrong" and "wrong" two words is completed.

In fig. 9, a fine adjustment can be made on the association relationship, based on the circumscribed rectangle 11 and the peripheral rectangle 12 shown in fig. 9, a virtual container should be newly built after the input of "kan", but if the input speed is fast enough, a pen after "kan" may simultaneously satisfy the association relationship with the virtual container where "error" is located and the virtual container where "kan" is located, at this time, the virtual containers may be all associated with the same virtual container, that is, if there are a plurality of preceding writing tracks in different virtual containers in the current writing track, the writing tracks in these virtual containers and the current writing track are associated and added into the same virtual container, and finally, the relationship between the writing tracks as in fig. 10 is realized, that is, all writing tracks 10 based on "error" and "error" confirm the circumscribed rectangle 11 and the peripheral rectangle 12. If the "wrong" and "wrong" distances are far enough as shown in fig. 11, then in addition to the virtual containers constructed by the "wrong" writing trace 10a (corresponding to the circumscribed rectangle 11a and the peripheral rectangle 12 can be confirmed), there are virtual containers constructed by the "wrong" writing trace 10b (corresponding to the circumscribed rectangle 11b can be confirmed), based on fig. 11, and further there are the circumscribed rectangle 11a and the peripheral rectangle 12a confirmed by the "wrong" writing trace 10a, and the circumscribed rectangle 11b and the peripheral rectangle 12b confirmed by the "wrong" writing trace 10b shown in fig. 12. It should be noted that, the abstract results of the bottom layer calculation are only the various rectangles in fig. 4, 5 and 7-12, and do not represent the actual display effect, and even after a new virtual container is formed in the "wrong" handwriting input process, the virtual container confirmed by the "wrong" writing track will hardly perform the related calculation of the circumscribed rectangle and the peripheral rectangle.

Example III

Fig. 13 is a schematic structural diagram of a device for associating writing tracks according to a third embodiment of the present invention. Referring to fig. 13, the writing trace associating apparatus includes: a trajectory detection unit 310, a constraint confirmation unit 320, and an association establishment unit 330. The track detection unit 310 is configured to receive a writing operation, and obtain track data of a current writing track corresponding to the writing operation, where the track data includes coordinate data and time data; a constraint confirming unit 320, configured to confirm a positional relationship and a time relationship between a current writing track and an existing writing track according to the coordinate data and the time data; the association establishing unit 330 is configured to establish an association between writing tracks that satisfy a preset positional relationship and a preset time relationship.

On the basis of the above embodiment, the association establishing unit 330 includes:

On the basis of the embodiment, the virtual container is provided with a time tag; the time data includes an end time; the time tag is the end time of the newly added written track.

On the basis of the above embodiment, the time data includes a start time;

the track judging module comprises:

On the basis of the embodiment, the circumscribed rectangle is a parallel circumscribed rectangle or a minimum circumscribed rectangle;

On the basis of the embodiment, the track data further comprises pen touch characteristic identifiers, and the pen touch characteristic identifiers of the writing tracks in the single virtual container are the same;

correspondingly, the tag obtaining sub-module is specifically configured to:

On the basis of the embodiment, the pen touch feature identification of the writing track in the virtual container is recorded by a pen touch label of the virtual container.

The above embodiment is based on the foregoing embodiment, wherein the apparatus further includes:

On the basis of the above embodiment, the apparatus further includes:

The device for associating the writing tracks provided by the embodiment of the invention is contained in the device for associating the writing tracks, can be used for executing the method for associating the writing tracks provided by any embodiment, and has corresponding functions and beneficial effects.

Example IV

Fig. 14 is a schematic structural diagram of a terminal device according to a fourth embodiment of the present invention, where the terminal device is a specific hardware presentation scheme of the device related to the track and the track. As shown in fig. 14, the terminal device includes a processor 410, a memory 420, an input means 430, an output means 440, and a communication means 450; the number of processors 410 in the terminal device may be one or more, one processor 410 being taken as an example in fig. 14; the processor 410, memory 420, input means 430, output means 440, and communication means 450 in the terminal device may be connected by a bus or other means, for example by a bus connection in fig. 14.

The memory 420 is used as a computer readable storage medium for storing a software program, a computer executable program, and modules, such as program instructions/modules corresponding to the method of writing trace association in the embodiment of the present invention (for example, the trace detecting unit 310, the constraint confirming unit 320, and the association establishing unit 330 in the apparatus for writing trace association). The processor 410 executes various functional applications and data processing of the writing trace-associated device by running software programs, instructions and modules stored in the memory 420, i.e., implements the method of writing trace association described above.

Memory 420 may include primarily a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application program required for functionality; the storage data area may store data created from the use of the device associated with the written track, and the like. In addition, memory 420 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 420 may further include memory remotely located with respect to processor 410, which may be connected to the writing trace-associated device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input device 430 may be used to receive entered numeric or character information and to generate key signal inputs related to user settings and function control of the device associated with the writing trace. The output 440 may include a display device such as a display screen. The communication device 450 is used for data communication with the image capturing module.

The terminal equipment comprises the writing track association device, can be used for executing any writing track association method, and has corresponding functions and beneficial effects.

Example five

Embodiments of the present invention also provide a storage medium containing computer-executable instructions for performing a method of writing trace association when executed by a computer processor, the method comprising:

Of course, the storage medium containing the computer executable instructions provided in the embodiments of the present invention is not limited to the method operations described above, and may also perform the related operations in the method for associating writing tracks provided in any embodiment of the present invention.

From the above description of embodiments, it will be clear to a person skilled in the art that the present invention may be implemented by means of software and necessary general purpose hardware, but of course also by means of hardware, although in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, etc., and include several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments of the present invention.

It should be noted that, in the embodiment of the apparatus for writing trace association, each unit and module included are only divided according to the functional logic, but not limited to the above-mentioned division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present invention.

Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.

Claims

1. A method of writing trace association, comprising:

establishing association between writing tracks meeting a preset position relation and a preset time relation;

wherein the writing tracks in a single virtual container are integrally associated;

wherein the virtual container is provided with a time tag; the time data includes an end time; the time tag is used for recording the ending time of the latest added writing track;

wherein the time data includes a start time;

2. The method of claim 1, wherein the bounding rectangle is a parallel bounding rectangle or a minimum bounding rectangle;

3. The method of claim 1, wherein the trajectory data further comprises a stroke feature identification, the stroke feature identification of the writing trajectory in a single virtual container being the same;

4. A method according to claim 3, wherein the stroke characteristic of the writing track in the virtual container is recorded by a stroke tag of the virtual container.

5. The method according to claim 1, wherein the method further comprises:

6. The method according to claim 1, wherein if the current writing track does not have the preamble writing track, adding the current writing track to the newly created virtual container further comprises:

7. The method of claim 1, wherein the association of the written tracks is recorded by an array, collection, or dictionary.

8. The method according to claim 1, wherein the method further comprises:

receiving a selection operation of a single writing track;

and acquiring the writing tracks selected by the selection operation, and acquiring all writing tracks in the virtual container associated with the writing tracks as all writing tracks selected by the selection operation.

9. An apparatus for writing trace association, comprising:

the association establishing unit is used for establishing association between writing tracks meeting the preset position relation and the preset time relation;

wherein the association establishing unit includes:

wherein the virtual container is provided with a time tag; the time data includes an end time; the time tag is the ending time of the newly added writing track;

wherein the time data includes a start time;

the track judging module comprises:

10. A terminal device, characterized in that the terminal device comprises:

one or more processors;

a memory for storing one or more programs,

when executed by the one or more processors, causes the one or more processors to implement the method of writing trace association as recited in any one of claims 1-8.

11. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the writing trace association method as claimed in any one of claims 1-8.