CN116185269A

CN116185269A - Element selection method, element selection device, storage medium and electronic equipment

Info

Publication number: CN116185269A
Application number: CN202111435323.XA
Authority: CN
Inventors: 吴诗乐
Original assignee: Guangzhou Shiyuan Innovation Technology Co ltd; Guangzhou Shiyuan Electronics Thecnology Co Ltd
Current assignee: Guangzhou Shiyuan Innovation Technology Co ltd; Guangzhou Shiyuan Electronics Thecnology Co Ltd
Priority date: 2021-11-29
Filing date: 2021-11-29
Publication date: 2023-05-30

Abstract

The embodiment of the application provides an element selection method, an element selection device, a storage medium and electronic equipment, wherein the element selection method comprises the following steps: in a writing state, responding to a first touch operation on the canvas, and generating writing handwriting corresponding to the first touch operation; if the writing handwriting is in a preset circle shape and the second touch operation is not monitored within a preset time, acquiring a first area corresponding to the writing handwriting; if the element completely located in the first area exists, determining the element completely located in the first area as a target element; and responding to a third touch operation on the canvas, acquiring a touch drop point corresponding to the third touch operation, entering a selected state if the touch drop point is in a second area corresponding to the writing handwriting, and selecting a target element, so that the current state is switched without an additional manual switching button, the continuity of the application of the whiteboard by a user is maintained, and the user experience is improved. Compared with long-press double-click operation, false touch is less likely to occur.

Description

Element selection method, element selection device, storage medium and electronic equipment

Technical Field

The embodiment of the application relates to the technical field of electronic whiteboards, in particular to an element selection method, an element selection device, a storage medium and electronic equipment.

Background

With the development of computer technology, computer devices are widely used in various scenes of daily life. For example, intelligent devices such as tablet computers and televisions with electronic whiteboards are widely used in offices, teaching and other scenes. The electronic whiteboard generally has a writing state and a selection state, and a touch event response in the writing state is writing; the touch event in the selected state responds by selecting one or more elements. Generally, the writing state and the selection state are mutually exclusive, and a user can only use one of them at a time. In the related art, two switching modes of the two states exist, and the first mode is that the states are switched through a control, for example, different buttons are clicked to switch the states; the second way is to trigger a selection state by long pressing or double clicking elements, etc.

At least the following problems exist in the above related art: by means of the control switching state, the user needs to pay attention to the state of the current control, and the switching action interrupts the use fluency of the user. In addition, the action capacity such as long press or double click conflicts with other click functions, and is easy to trigger by mistake.

Disclosure of Invention

In order to overcome the problems in the related art, the application provides an element selection method, an element selection device, a storage device and an electronic device, which can maintain consistency of whiteboard application use and reduce false triggering of selection elements.

According to a first aspect of embodiments of the present application, there is provided an element selection method, including the steps of:

in a writing state, responding to a first touch operation on a canvas, and generating writing handwriting corresponding to the first touch operation; at least one element is displayed on the canvas;

if the writing trace is in a preset circle selection shape and the second touch operation is not monitored within a preset time, a first area corresponding to the writing trace is obtained;

if the element completely located in the first area exists, determining the element completely located in the first area as a target element, entering a pre-selected middle state, and changing the writing handwriting corresponding to the first touch operation and the display state of the target element;

responding to a third touch operation on the canvas, and acquiring a touch drop point corresponding to the third touch operation;

and if the touch drop point is in a second area corresponding to the writing handwriting, entering a selected state, and selecting the target element in the first area.

According to a second aspect of embodiments of the present application, there is provided an element selection apparatus, including:

the writing handwriting generating module is used for responding to a first touch operation on the canvas in a writing state to generate writing handwriting corresponding to the first touch operation; at least one element is displayed on the canvas;

the region acquisition module is used for acquiring a first region corresponding to the writing handwriting if the writing handwriting is in a preset circle selection shape and the second touch operation is not monitored within a preset time;

the target element acquisition module is used for determining the element completely located in the first area as a target element if the element completely located in the first area exists, entering a preselected intermediate state, and changing the writing handwriting corresponding to the first touch operation and the display state of the target element;

the touch drop point acquisition module is used for responding to a third touch operation on the canvas and acquiring a touch drop point corresponding to the third touch operation;

and the element selection module is used for entering a selected state if the touch falling point is in a second area corresponding to the writing handwriting, and selecting the target element in the first area.

According to a third aspect of embodiments of the present application, there is provided an electronic device comprising a processor and a memory; the memory stores a computer program adapted to be loaded by the processor and to perform the element selection method as described above.

According to the method, in a writing state, a first touch operation on a canvas is responded, and writing handwriting corresponding to the first touch operation is generated; at least one element is displayed on the canvas; if the writing trace is in a preset circle selection shape and the second touch operation is not monitored within a preset time, a first area corresponding to the writing trace is obtained; if the element completely located in the first area exists, determining the element completely located in the first area as a target element, entering a pre-selected middle state, and changing the writing handwriting corresponding to the first touch operation and the display state of the target element; responding to a third touch operation on the canvas, and acquiring a touch drop point corresponding to the third touch operation; if the touch drop point is in the second area corresponding to the writing trace, entering a selected state, and selecting the target element in the first area, so that the writing trace can be directly drawn in the writing state to determine the selected element range to select the element, the current state does not need to be switched by additionally going to a manual switching button, the state of the switching button does not need to be concerned, the continuity of the user in using the whiteboard application is maintained, and the user experience is improved. The user selection intention is identified by directly drawing the ring-shaped handwriting, and compared with long-press double-click operation and the like, false touch is less likely to occur.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

For a better understanding and implementation, the present invention is described in detail below with reference to the drawings.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic diagram of an application environment of an element selection method shown in one embodiment of the present application;

FIG. 2 is a flow chart of an element selection method shown in one embodiment of the present application;

FIG. 3 is a schematic illustration of the location of a writing trace, a first region, and a second region, as shown in one embodiment of the present application;

FIG. 4 is a schematic diagram of a canvas in a written state, as shown in one embodiment of the present application;

FIG. 5 is a schematic illustration of writing generated in response to a first touch operation based on FIG. 4;

FIG. 6 is a schematic view of the semi-transparent display state set on the basis of FIG. 5;

FIG. 7 is a schematic illustration of selected elements based on FIG. 6;

FIG. 8 is a schematic block diagram of an element selection apparatus shown in one embodiment of the present application;

fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the following detailed description of the embodiments of the present application will be given with reference to the accompanying drawings.

It should be understood that the described embodiments are merely some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the embodiments of the present application, are within the scope of the embodiments of the present application.

When the following description refers to the accompanying drawings, like numerals refer to the same or similar elements throughout the various drawings unless otherwise indicated. In the description of this application, it should be understood that the terms "first," "second," "third," and the like are used merely to distinguish between similar objects and are not necessarily used to describe a particular order or sequence, nor should they be construed to indicate or imply relative importance. The specific meaning of the terms in this application will be understood by those of ordinary skill in the art as the case may be. As used in this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. The word "if"/"if" as used herein may be interpreted as "at … …" or "at … …" or "in response to a determination".

Furthermore, in the description of the present application, unless otherwise indicated, "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.

Referring to fig. 1, a schematic diagram of an application environment of an element selection method according to an embodiment of the present application is shown. The application environment of the element selection method in one embodiment of the present application includes an element selection device 1.

The element selection apparatus 1 may be implemented by software and/or hardware, and the element selection apparatus 1 may be configured by two or more physical entities or may be configured by one physical entity. From a hardware level, the hardware to which the element selection device 1 is directed is essentially a computer device having the performance of a personal computer or the like, and is a hardware apparatus having a central processing unit (including an operator and a controller), a memory, an input device, and an output device, which are essential components disclosed by von neumann's principle; the computer program is stored in the memory, and the central processing unit calls the computer program stored in the memory to run, executes instructions in the computer program and interacts with the input and output equipment, thereby completing specific functions. Wherein the element selection device 1 is further provided with a touch screen on which a display area 2 is provided for providing display data. Alternatively, the element selection device 1 may be a computer, a mobile phone, or an interactive tablet.

For ease of understanding, the exemplary description is given in the embodiment with the interactive tablet as the element selection device 1. The interactive flat board can be integrated equipment for controlling the content displayed on the interactive flat board and realizing man-machine interaction operation through a touch technology, and one or more functions of a projector, an electronic whiteboard, a curtain, sound equipment, a television, a video conference terminal and the like are integrated.

Generally, the interactive tablet includes at least one touch screen. The touch screen may be a capacitive screen, a resistive screen, or an electromagnetic screen. In an embodiment, a user can realize touch operation by touching the touch screen with a finger or a touch pen, and the interactive tablet detects a touch position correspondingly, determines a response scheme according to display content corresponding to the touch position, and then responds to realize a touch function. For example, the corresponding control with the display content as a certain function is determined according to the touch position, and at this time, the response scheme is to execute the function. It can be understood that in practical application, the user can also realize control operation by means of a keyboard, a mouse, physical keys and the like.

Typically, the interactive tablet is installed with at least one type of operating system, including, but not limited to, android systems, linux systems, and Windows systems. In one embodiment, the interactive tablet may install at least one application based on the operating system, in an embodiment described by way of example with an application having writing functionality. For example, an electronic whiteboard application having a writing function is installed in the interactive tablet. The electronic whiteboard application may be an application program of the operating system, or may be an application program downloaded from a third party device or a server, and the element selection device 1 may also be an application program itself. Optionally, the electronic whiteboard application has other editing functions besides writing functions, such as drawing, inserting forms, inserting pictures, inserting multimedia, inserting graphics, drawing forms, selecting pictures, and selecting handwriting.

Illustratively, a writing area is provided in an application interface of the electronic whiteboard application, and the writing area can be recorded as a canvas through which an interactive interface for drawing or editing can be displayed to a user. Optionally, the display position of the canvas may be set according to actual requirements. It is understood that the size of the canvas may be set according to the actual situation, and may be limited or unlimited. Wherein, the canvas is infinite in size, which means that the canvas can infinitely reduce or enlarge the area according to the actual demands of users. When writing on the canvas, such as by a stylus or finger touching the touch screen, the touch screen may detect the touch location and display the writing trace entered by the user in real time on the canvas according to the touch location. Of course, the writing process is not limited to writing, and any entry process for displaying an operation trace implemented on a touch screen may be regarded as the writing process. In addition, the touch operation may be responsive to a click, a drag, or the like operation by the user according to a difference in a position where the touch operation occurs. These different response patterns are identical in the underlying coordinate processing pattern. In general, the canvas where the touch writing occurs coincides with the area where the element selection device 1 is displayed, i.e., the display area 2 shown in fig. 1.

In one embodiment, the objects drawn on the canvas are marked as elements, which may be text, graphics, text boxes, forms, scripts, etc., drawn by the user, or graphics, pictures, etc., inserted by the user. After drawing the element, the user may select the element to edit, such as adjusting the element position, element size, element color, and the like. After drawing the elements, the elements are generally independent of each other, that is, when a user performs a control operation on one element, if there is no particular limitation, the other elements are not synchronously controlled. In the embodiment of the application, an element selection method is described by taking an electronic whiteboard application with a writing function as an example.

Example 1

The following describes in detail the element selection method provided in the embodiment of the present application with reference to fig. 2 to 7.

Referring to fig. 2, a flowchart of an element selection method according to an embodiment of the present application is shown. The element selection method provided by the embodiment of the application comprises the following steps:

step S101: in a writing state, responding to a first touch operation on a canvas, and generating writing handwriting corresponding to the first touch operation; at least one element is displayed on the canvas.

A writing area is arranged in an application interface of the electronic whiteboard application program, the writing area can be recorded as a canvas, and the canvas can display drawing for a user or receive touch editing operation of the user. The application interface refers to an interactive interface for receiving and/or displaying information, for example, an application of video playing type, and the interactive interface is mainly used for displaying changed video pictures; the interactive interface of the application of the real-time communication type is mainly used for receiving the content input by the near-end user and displaying the content input by the far-end user; the application of the file editing class is mainly used for receiving and displaying the content input by the user; the interactive interface of the browser application is mainly used for receiving keywords input by users and displaying webpage contents obtained based on the keywords. It will be appreciated that the canvas may also be a writing area provided by other applications, and the present application is not limited.

In this embodiment, the specific canvas refers to an interactive interface, i.e. canvas, for displaying drawings or editing by a user in the use process of the whiteboard application. As previously described, the canvas refers to an application for a user to write, display, etc., and may be used to draw text, graphics, text boxes, tables, etc., on the canvas, or to insert other multimedia elements, such as graphics, pictures, tables, etc., on the canvas. In the canvas, the user can realize writing, drawing, erasing and other operations similar to the physical blackboard, and further has better digital functions of moving, saving, zooming, inserting pictures, adjusting colors, setting stroke weights and the like. In practical applications, the whiteboard application may also be named as a whiteboard application, a whiteboard writing application, a writing application, an electronic whiteboard application, a collaborative whiteboard application, or the like, regardless of the change in the names, as long as the application for realizing the above functions is equivalent to the whiteboard application of the present application.

In using a whiteboard application, the canvas is typically displayed full screen, i.e., the canvas fills the display area 2 in fig. 1. The application implementation marks objects drawn on an application interface of an electronic whiteboard application as elements. Obviously, the element can be characters, figures, text boxes, tables, handwriting and the like drawn by a user, and can also be figures, pictures and the like inserted by the user. In general, a whiteboard application has a writing state and a selection state; in a writing state, the whiteboard application responds to touch operations of drawing characters, figures, text boxes, tables, inserting figures, pictures or tables and other elements on the whiteboard application page to generate writing writings or display pictures; in the selected state, the whiteboard application changes the state of the selected element in response to a touch operation performed on the whiteboard application page to move, zoom, color adjust, or stroke weight adjust the selected element of the text, image, text box, form, insertion graphic, picture, form, or the like.

In a writing state, when the touch pen or the finger contacts the touch screen corresponding to the canvas, the touch screen responds to a first touch operation on the canvas, and can induce current change, voltage change or magnetic flux change (corresponding to specific setting types of the capacitive touch screen, the resistive touch screen or the electromagnetic touch screen), a touch signal containing coordinates of a touch position and trigger time of the touch signal are obtained, and according to the touch signal containing the coordinates of the touch position and the trigger time of the touch signal, track data of a writing track input in the process of each pressing writing to lifting and stopping writing of the touch pen or the finger of a user and time of pressing writing and lifting and stopping writing can be obtained, and the writing track input by the user is displayed in real time in a writing area according to the track data.

Step S102: and if the writing trace is in a preset circle selection shape and the second touch operation is not monitored within a preset time, acquiring a first area corresponding to the writing trace.

The preset time can be adjusted according to actual use conditions, and the application is not limited. In this embodiment of the present application, the preset time is a time counted from when the first touch operation is ended, for example, when the first touch operation is an operation generated by touching the touch screen by a user with a hand, the preset time is a time counted when the first touch operation is lifted by a user with a hand; when the first touch operation is an operation generated by a user touching the touch screen with the stylus, the preset time is the time for starting timing when the stylus is lifted corresponding to the first touch operation.

The preset circle shape may be a regular shape or an irregular shape with a certain radian, which may form a closed area, and it is understood that the preset circle shape may be closed or not, and correspondingly, the writing trace may be a closed curve or an unclosed curve. Specifically, the preset circle selection shape may be an irregular shape such as a non-closed circle, a quasi-circle, an ellipse, a quasi-ellipse, a rectangle, a triangle, a shape possibly drawn by a user during circle selection, or a regular shape such as a closed circle, an ellipse, a rectangle, a triangle, etc.

It is understood that the first area and the second area corresponding to the writing trace are two different areas. Optionally, the first area may be an circumscribed rectangular area, an circumscribed circular area, etc. corresponding to the writing trace; or the first area is an area where the regular shape identified by the preset circled shape corresponding to the writing trace is located, or the first area is an external rectangular area corresponding to the regular shape identified by the preset circled shape corresponding to the writing trace, and the like.

In one embodiment, the step of acquiring the first area corresponding to the writing in step S102 if the writing is in the preset circle shape and the second touch operation is not monitored within the preset time includes steps S10211-S10213:

step S10211: acquiring label information corresponding to a preset circle selection shape; the label information is used for indicating a regular circle selection graph corresponding to the preset circle selection shape.

The tag information is used for indicating a regular circle selection graph corresponding to the preset circle selection shape, specifically, the tag information is used for indicating a regular closed shape closest to the preset circle selection shape, for example, if the regular shape closest to the preset circle selection shape is a circle, the tag information comprises the circle center and the radius of the closest circle; if the regular shape with the closest preset circle shape is an ellipse, the label information includes a focus, a major axis and a minor axis of the closest ellipse.

Step S10212: and obtaining a regular circle selection graph corresponding to the writing handwriting according to the label information.

The preset circling shape is a regular shape or an irregular shape, and label information is correspondingly marked, so that a regular circling pattern corresponding to the writing handwriting can be obtained according to the label information. It can be appreciated that the present application stores a plurality of preset circle selection shapes, compares the writing handwriting with the plurality of preset circle selection shapes, and uses the circle selection shape with the largest similarity as the circle selection shape corresponding to the writing handwriting. Further, the label information of the rule corresponding to the circle selection shape is used for obtaining the corresponding rule circle selection graph. For example, if the circle shape corresponding to the writing trace is an unclosed circle, and the label information corresponding to the unclosed circle identifier includes the center and the radius of the circle, the regular circle may be determined in the writing trace according to the circle and the radius, so as to obtain the regular circle pattern corresponding to the writing trace.

Step S10213: and taking the minimum circumscribed rectangle corresponding to the regular circled shape as a first area.

Specifically, as shown in fig. 3, the irregular solid line 10 is writing, the triangle 20 with the solid line is an element, the oval 30 with the dotted line is a regular circled pattern corresponding to the writing, the smallest circumscribed triangle 40 area outside the oval 30 with the dotted line is taken as a first area, and then whether the element is inside is detected according to the first area, for example, whether the triangle 20 with the solid line is completely inside is detected, so as to determine whether the triangle 20 is taken as a target element.

The method comprises the steps of obtaining label information corresponding to a preset circle selection shape; according to the label information, a regular circle selection graph corresponding to the writing handwriting is obtained, and the minimum circumscribed rectangle corresponding to the regular circle selection shape is used as a first area, so that whether the minimum circumscribed rectangle is used as a detection element or not is detected, and the detection efficiency and the detection accuracy can be improved.

Step S103: if the element completely located in the first area exists, determining the element completely located in the first area as a target element, entering a pre-selected intermediate state, and changing the writing handwriting corresponding to the first touch operation and the display state of the target element.

Wherein the writing and the display state of the target element may be altered to be highlighted; or changing the writing handwriting and the target element into a semitransparent display state; or changing the writing handwriting and the target element to preset bright colors, adding preset tracing, preset broken lines or adding display states such as animation and the like to prompt a user.

In the embodiment of the application, the writing handwriting and the target element are changed into a semitransparent display state. By setting to the semi-transparent display state, the user can be intuitively prompted about to trigger the operation of the selected element and about to select which elements.

Optionally, a color of a brush corresponding to the writing trace may be set, and the color of the brush is set to a certain transparency, so that the corresponding writing trace is refreshed, and the writing trace is set to a semitransparent display state. When the element in the ring-shaped area is also writing, the element may also be set to a semitransparent display state in the same manner. When the elements in the ring-shaped area are pictures or tables, a picture format can be set, the pictures are set to be of a certain transparency, and then the pictures are refreshed, so that the pictures are set to be in a semitransparent display state.

It can be understood that if there is no element completely located in the first area, the element selection method in the embodiment of the application is exited, and the corresponding touch function is executed according to the subsequent third touch operation.

Step S104: and responding to a third touch operation on the canvas, and acquiring a touch drop point corresponding to the third touch operation.

When the touch screen is contacted again by the stylus or the finger, the touch screen responds to a third touch operation on the canvas, and can induce the change of current, voltage or magnetic flux (corresponding to the specific setting type of the capacitive touch screen, the resistive touch screen or the electromagnetic touch screen), so that a touch signal of the coordinate of the touch position when the stylus or the finger of a user presses writing can be obtained, and further, a touch drop point corresponding to the third touch operation can be obtained.

Step S105: and if the touch drop point is in a second area corresponding to the writing handwriting, entering a selected state, and selecting the target element in the first area.

The step of determining the second area is not limited in this application, and optionally, in the step of acquiring the first area corresponding to the writing trace in step S102 if the writing trace is in a preset circle shape and the second touch operation is not monitored within a preset time: and acquiring a second area corresponding to the writing trace, and determining the minimum circumscribed rectangle of the writing trace as the second area.

Optionally, if there is an element completely located in the first area in step S103, determining the element completely located in the first area as a target element, entering a pre-selected middle state, and changing the writing handwriting corresponding to the first touch operation and the display state of the target element: and acquiring a second area corresponding to the writing trace, and determining the minimum circumscribed rectangle of the writing trace as the second area.

Alternatively, the smallest bounding rectangle of the writing trace may be determined as the second region. As shown in fig. 3, the dashed line of the outermost layer is the smallest circumscribed rectangle 50, which is the second region. It will be appreciated that the second region may also be a minimum circumscribing triangle, circle, etc. of the writing trace.

According to the method and the device for detecting the third touch drop point, the minimum circumscribed rectangle of the writing trace is determined to be the second area, and whether the subsequent third touch drop point is located inside the second area or not is detected through the minimum circumscribed rectangle, so that detection efficiency can be improved.

Optionally, the position coordinate of the touch drop point relative to the touch screen may be obtained, so as to obtain the position coordinate of the second area relative to the touch screen, and further, by comparing the position coordinate of the touch drop point with the position coordinate of the second area, whether the touch drop point is located in the second area may be determined.

Optionally, there may be one element or more than one element completely located in the first area, and in this embodiment of the present invention, all the elements located in the completely located first area may be selected and further switched to a selection state, so that a transformation operation in the selection state is further performed on the selected element, for example, when switching to the selection state, a selection control toolbar may be popped up, and operations such as moving, zooming, color adjustment or stroke weight adjustment are performed on the selected element through a selection control on the selection control toolbar.

In a writing state, responding to a first touch operation on a canvas, and generating writing handwriting corresponding to the first touch operation; at least one element is displayed on the canvas; if the writing trace is in a preset circle selection shape and the second touch operation is not monitored within a preset time, a first area and a second area corresponding to the writing trace are obtained; if the element completely located in the first area exists, determining the element completely located in the first area as a target element, entering a pre-selected middle state, and changing the writing handwriting corresponding to the first touch operation and the display state of the target element; responding to a third touch operation on the canvas, and acquiring a touch drop point corresponding to the third touch operation; the touch drop point is in a second area corresponding to the writing handwriting, and the target element is selected, so that the writing handwriting can be directly drawn to determine the selected element range to select the element in the writing state, the current state does not need to be switched by additionally going to a manual switching button, the state of the switching button does not need to be concerned, the continuity of the user in using the whiteboard application is maintained, and the user experience is improved. The user selection intention is identified by directly drawing the ring-shaped handwriting, and compared with long-press double-click operation and the like, false touch is less likely to occur.

In one embodiment, in step S102, the writing trace may be input to a trained loop recognition model to determine whether the writing trace is in a preset loop shape. In the embodiment of the application, point data of various circle-selected shape notes are collected as a data set, and a machine learning method is adopted to train a model, for example, the point data of the various circle-selected shape notes are collected and input into a neural network model for training, and a trained circle-shaped recognition model is obtained.

Specifically, in step S102, if the writing trace is in the preset circle shape and the second touch operation is not monitored within the preset time, the step of obtaining the first area corresponding to the writing trace includes steps S10221-S10223:

step S10221: and acquiring a plurality of corresponding touch point coordinates when the handwriting is generated in the first touch operation process.

Step S10222: and inputting the coordinates of the touch points into a trained ring-shaped recognition model, and judging whether the writing trace is in a preset ring shape or not.

Step S10223: and when the writing handwriting is in a preset circle selection shape, acquiring a first area corresponding to the writing handwriting.

According to the method and the device for identifying the shape of the handwriting, whether the handwriting is in the preset ring shape or not is judged by adopting the trained ring shape identification model, so that the accuracy of shape identification can be improved, and the accuracy of subsequent element selection is further improved.

In one embodiment, in step S102, if the writing trace is in a preset circle shape and the second touch operation is not monitored within a preset time, the step of obtaining the first area corresponding to the writing trace includes:

step S10231: triggering timing when the ending touch event corresponding to the first touch operation is monitored, and determining that the second touch operation is not monitored within the preset time when the second touch operation is not monitored within the time period of the timing time.

Optionally, in the Android operating system, when the ending touch event corresponding to the first touch operation is monitored, a timer may be triggered to count by a method such as sending a delay message by a timer task or a Handler, which is not limited in this application.

The fact that the second touch operation is not monitored after the timing time of the timer is up indicates that no subsequent writing needs exist after the first touch operation, therefore, the current user can be considered to be likely to need to switch to the selection state, and elements can be selected quickly.

In one embodiment, the step of determining the element completely located in the first area as the target element in step S103 if there is an element completely located in the first area includes steps S1031-S1032:

Step S1031: traversing all elements on the canvas, and calculating a minimum circumscribed rectangle corresponding to each element;

step S1032: if all the four vertexes of the minimum bounding rectangle are located in the first area, determining that the element corresponding to the minimum bounding rectangle is located in the first area completely, and determining the element corresponding to the minimum bounding rectangle as a target element.

As shown in fig. 3, for the triangle 20 element, the smallest bounding rectangle 60 is obtained, and four vertices of the smallest bounding rectangle 60 are all located in the first area 10, and it is determined that the triangle 20 element is completely located in the first area 10, and the triangle 20 element is determined as the target element.

According to the method and the device, whether the element is completely located in the first area is rapidly and accurately judged through the position relation between the four vertexes of the minimum circumscribed rectangle corresponding to the element and the first area, and accordingly the target element completely located in the first area is rapidly and accurately obtained.

In one embodiment, after the step of selecting the target element, the touch drop point in step S105 is in the second area corresponding to the writing trace, the method further includes: step S106: and removing the writing handwriting corresponding to the first touch operation so as to avoid the influence of redundant writing handwriting on subsequent operations.

In one embodiment, the element selection method further includes steps S107 to S108 as follows:

step S107: the type of the target element is obtained.

Step S108: and displaying a selection control corresponding to the type of the target element according to the mapping relation between the preset element type and the selection control, so as to control the selected element to execute the corresponding function through the selection control.

The types of the elements can be set according to actual needs, for example, the elements can be divided into a text element type, a graphic element type, a picture element type and the like; different element control controls may be provided for different element types to cause the different elements to perform corresponding functions. For example, for a text element type, element control controls may be provided for text font size selection, font beautification, font color selection, search text, and the like; for graphic element types, element control controls for frame setting, filling colors, etc. can be provided; for picture element types, element control controls such as clipping images, image vectorization, flipping and the like can be provided. Of course, for all types of elements, common element control controls may also be provided, such as, for example, set-top, clone, delete, etc., element control controls to enable further control and processing of selected elements.

In one embodiment, the element selection method further comprises: step S109: and the touch drop point is not in the second area corresponding to the writing trace, and the display state of the writing trace corresponding to the first touch operation and the target element is restored. And when the touch drop point is not in the second area corresponding to the writing handwriting, restoring the display states of the writing handwriting corresponding to the first touch operation and the target element, and intuitively prompting the user to exit the element selection operation.

In one embodiment, the element selection method further includes step S110: and if the touch drop point is not in the second area corresponding to the writing handwriting, generating the writing handwriting corresponding to the third touch operation. If the touch drop point is not in the second area corresponding to the writing trace, the fact that the user possibly triggers the selected operation by mistake in the writing state is indicated, so that the thought of the user is prevented from being interrupted by generating the writing trace corresponding to the third touch operation, the user can use the writing trace smoothly and continuously, and the user experience is improved.

The following illustrates the element selection method of the present application by way of specific examples, which are specifically as follows:

In the written state, the canvas displays elements as shown in FIG. 4; when the user makes a first touch operation on the canvas, such as circling on the handwriting element "Test", the circumference of the handwriting "Test" will display the circled handwriting as shown in fig. 5. When the writing is recognized to be in a preset circle shape and the second touch operation is not monitored within the preset time and the writing element 'Test' is judged to be in the circle shape area, the circle shape writing and the writing element 'Test' can be switched to a semitransparent display state as shown in fig. 6, so that the selected writing and the writing element 'Test' can be visually displayed. If the touch drop point corresponding to the third touch operation on the canvas is within the minimum circumscribed rectangle corresponding to the handwriting element Test, as shown in fig. 7, the selected handwriting element Test is popped up to select the control toolbar, and at this time, the user can perform operations such as moving, zooming, color adjustment or stroke weight adjustment on the selected element through selecting a function control on the control toolbar. If the touch drop point corresponding to the third touch operation on the canvas is not in the minimum circumscribed rectangle corresponding to the handwriting element 'Test', the semitransparent display state of the writing handwriting of the circle and the handwriting element 'Test' is canceled, the writing state is returned,

Example 2

The following are examples of apparatus that may be used to perform the method of example 1 of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method in embodiment 1 of the present application.

Referring to fig. 8, an element selecting apparatus 200 disclosed in an embodiment of the present application includes:

the writing handwriting generating module 201 is configured to respond to a first touch operation on a canvas in a writing state, and generate writing handwriting corresponding to the first touch operation; at least one element is displayed on the canvas;

the region obtaining module 202 is configured to obtain a first region corresponding to the writing trace if the writing trace is in a preset circle shape and the second touch operation is not monitored within a preset time;

a target element obtaining module 203, configured to determine an element that is completely located in the first area as a target element if there is an element that is completely located in the first area, enter a pre-selected middle state, and change a writing trace corresponding to the first touch operation and a display state of the target element;

a touch drop point obtaining module 204, configured to respond to a third touch operation on the canvas, and obtain a touch drop point corresponding to the third touch operation;

And the element selection module 205 is configured to enter a selected state if the touch drop point is in a second area corresponding to the writing trace, and select the target element in the first area.

In a writing state, responding to a first touch operation on a canvas, and generating writing handwriting corresponding to the first touch operation; at least one element is displayed on the canvas; if the writing trace is in a preset circle selection shape and the second touch operation is not monitored within a preset time, a first area corresponding to the writing trace is obtained, if an element completely located in the first area exists, the element completely located in the first area is determined to be a target element, a preselected intermediate state is entered, and the writing trace corresponding to the first touch operation and the display state of the target element are changed; responding to a third touch operation on the canvas, and acquiring a touch drop point corresponding to the third touch operation; if the touch drop point is in the second area corresponding to the writing trace, entering a selected state, and selecting the target element in the first area, so that the writing trace can be directly drawn in the writing state to determine the selected element range to select the element, the current state does not need to be switched by additionally going to a manual switching button, the state of the switching button does not need to be concerned, the continuity of the user in using the whiteboard application is maintained, and the user experience is improved. The user selection intention is identified by directly drawing the ring-shaped handwriting, and compared with long-press double-click operation and the like, false touch is less likely to occur.

In one embodiment, the shape region acquisition module 202 includes:

the shape tag information acquisition module is used for acquiring tag information corresponding to a preset circle selection shape; the label information is used for indicating a regular circle selection graph corresponding to the preset circle selection shape;

the circle selection area acquisition module is used for acquiring a regular circle selection graph corresponding to the writing handwriting according to the label information;

and the first region acquisition module is used for taking the minimum circumscribed rectangle corresponding to the regular circled shape as a first region.

In one embodiment, the shape region acquisition module 202 includes:

and the second region acquisition module is used for determining the minimum circumscribed rectangle of the writing handwriting as a second region.

In one embodiment, the shape region acquisition module 202 includes:

and the touch point coordinate acquisition module is used for acquiring a plurality of touch point coordinates corresponding to the handwriting generated in the first touch operation process.

The shape judging module is used for inputting the coordinates of the touch points into the trained ring-shaped recognition model and judging whether the writing handwriting is in a preset ring shape or not.

The circling area acquisition module is used for acquiring a first area corresponding to the writing handwriting when the writing handwriting is in a preset circling shape.

In one embodiment, the target element acquisition module 203 includes:

the minimum circumscribed rectangle acquisition module is used for traversing all elements on the canvas and calculating the minimum circumscribed rectangle corresponding to each element;

and the target element determining module is used for determining that the element corresponding to the minimum bounding rectangle is completely located in the first area if the four vertexes of the minimum bounding rectangle are all located in the first area, and determining the element corresponding to the minimum bounding rectangle as a target element.

In one embodiment, the element selection apparatus 200 further includes:

and the handwriting removing module is used for removing the handwriting corresponding to the first touch operation.

In one embodiment, the element selection apparatus 200 further includes:

and the type acquisition module is used for acquiring the type of the target element.

And the control display module is used for displaying the selection control corresponding to the type of the target element according to the mapping relation between the preset element type and the selection control so as to control the selected element to execute the corresponding function through the selection control.

Example 3

The following are device embodiments of the present application that may be used to perform the method of embodiment 1 of the present application. For details not disclosed in the apparatus embodiments of the present application, please refer to the method in embodiment 1 of the present application.

Referring to fig. 9, the present application further provides an electronic device 300, where the electronic device 300 may be specifically a computer, a mobile phone, a tablet computer, an interactive tablet, etc., and in an exemplary embodiment of the present application, the electronic device 300 is an MOS transistor on-state loss obtaining device, and the electronic device 300 may include: at least one processor 310, at least one memory 320, at least one display 330, at least one network interface 340, a user interface 350, and at least one communication bus 360.

The user interface 350 is mainly used for providing an input interface for a user, and acquiring data input by the user. Optionally, the user interface 350 may also include a standard wired interface, a wireless interface.

The network interface 340 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), among others.

Wherein the communication bus 360 is used to enable connection communications between these components.

Wherein the processor 310 may include one or more processing cores. The processor 310 utilizes various interfaces and lines to connect various portions of the overall electronic device 300, perform various functions of the electronic device 300, and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 320, and invoking data stored in the memory 320. Alternatively, the processor 310 may be implemented in hardware in at least one of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic Array, PLA). The processor 310 may integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), and a modem, etc. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display layer; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 310 and may be implemented by a single chip.

The Memory 320 may include a random access Memory (Random Access Memory, RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 320 includes a non-transitory computer readable medium (non-transitory computer-readable storage medium). Memory 320 may be used to store instructions, programs, code sets, or instruction sets. The memory 320 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the above-described various method embodiments, etc.; the storage data area may store data or the like referred to in the above respective method embodiments. Memory 320 may also optionally be at least one storage device located remotely from the aforementioned processor 310. As shown in fig. 8, an operating system, a network communication module, a user may be included in the memory 320 as one type of computer storage medium.

The processor 310 may be configured to invoke an application program of the element selection method stored in the memory 320, and specifically execute the method steps of the embodiment 1 shown above, and the specific execution process may refer to the specific description shown in embodiment 1, which is not repeated herein.

Example 4

The present application further provides a computer readable storage medium, on which a computer program is stored, where the instructions are adapted to be loaded by a processor and execute the method steps of the above-described embodiment 1, and the specific execution process may refer to the specific description shown in the embodiment, which is not repeated herein. The storage medium can be an electronic device such as a personal computer, a notebook computer, a smart phone, a tablet personal computer and the like.

For the device embodiments, reference is made to the description of the method embodiments for the relevant points, since they essentially correspond to the method embodiments. The above-described apparatus embodiments are merely illustrative, wherein the components illustrated as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purposes of the present application. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks and/or block diagram block or blocks.

In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.

The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.

Claims

1. An element selection method, characterized by comprising the steps of:

2. The element selection method according to claim 1, characterized in that: the method further comprises the steps of:

and if the touch drop point is not in the second area corresponding to the writing trace, restoring the display states of the writing trace corresponding to the first touch operation and the target element.

3. The element selection method according to any one of claims 1 or 2, characterized in that: the method further comprises the steps of:

Acquiring the type of the target element;

and displaying a selection control corresponding to the type of the target element according to the mapping relation between the preset element type and the selection control, so as to control the target element to execute the corresponding function through the selection control.

4. A method of element selection according to any one of claims 1 to 3, characterized in that:

the step of obtaining the first area corresponding to the writing trace if the writing trace is in a preset circle shape and the second touch operation is not monitored within a preset time includes:

acquiring label information corresponding to a preset circle selection shape; the label information is used for indicating a regular circle selection graph corresponding to the preset circle selection shape;

acquiring a regular circle selection graph corresponding to the writing handwriting according to the label information;

and taking the minimum circumscribed rectangle corresponding to the regular circled shape as a first area.

5. The element selection method according to any one of claims 1 to 4, characterized in that:

if the writing trace is in a preset circle shape and the second touch operation is not monitored within a preset time, the step of obtaining the first area corresponding to the writing trace further comprises:

And acquiring a second area corresponding to the writing trace, and determining the minimum circumscribed rectangle of the writing trace as the second area.

6. The element selection method according to any one of claims 1 to 4, characterized in that:

if the element completely located in the first area exists, determining the element completely located in the first area as a target element, entering a pre-selected middle state, and changing the writing handwriting corresponding to the first touch operation and the display state of the target element, wherein the method further comprises the steps of:

7. The element selection method according to any one of claims 1 to 6, characterized in that:

the step of determining the element completely located in the first area as the target element if the element completely located in the first area exists includes:

traversing all elements on the canvas, and calculating a minimum circumscribed rectangle corresponding to each element;

if all the four vertexes of the minimum bounding rectangle are located in the first area, determining that the element corresponding to the minimum bounding rectangle is located in the first area completely, and determining the element corresponding to the minimum bounding rectangle as a target element.

8. The element selection method according to any one of claims 1 to 7, characterized in that:

triggering timing when the ending touch event corresponding to the first touch operation is monitored, and determining that the second touch operation is not monitored within the preset time when the second touch operation is not monitored within the time period of the timing time.

9. The element selection method according to any one of claims 1 to 7, characterized in that:

acquiring a plurality of corresponding touch point coordinates when generating the writing handwriting in the first touch operation process;

inputting a plurality of touch point coordinates into a trained ring-shaped recognition model, and judging whether the writing trace is in a preset ring shape or not;

and when the writing handwriting is in a preset circle selection shape, acquiring a preset first area corresponding to the writing handwriting.

10. The element selection method according to any one of claims 1 to 7, characterized in that:

and if the touch drop point is in the second area corresponding to the writing handwriting, selecting the target element, and further comprising:

and removing the writing handwriting corresponding to the first touch operation.

11. The element selection method according to any one of claims 1 to 7, characterized in that: the method also comprises the following steps:

and if the touch drop point is not in the second area corresponding to the writing handwriting, generating the writing handwriting corresponding to the third touch operation.

12. The element selection method according to any one of claims 1 to 7, characterized in that:

the changing the writing handwriting corresponding to the first touch operation and the display state of the target element comprises the following steps:

and changing the writing handwriting corresponding to the first touch operation and the target element into a semitransparent display state.

13. An element selection apparatus, comprising:

14. An electronic device includes a processor and a memory; the memory stores a computer program adapted to be loaded by the processor and to perform the element selection method according to any one of claims 1 to 12.

15. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the element selection method according to any one of claims 1 to 12.