CN115202553A

CN115202553A - Control method and device for whiteboard application and electronic equipment

Info

Publication number: CN115202553A
Application number: CN202110402792.5A
Authority: CN
Inventors: 李梅; 夏李玮
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2021-04-14
Filing date: 2021-04-14
Publication date: 2022-10-18
Anticipated expiration: 2041-04-14
Also published as: CN115202553B

Abstract

The invention discloses a whiteboard application control method and device and electronic equipment. Wherein, the method comprises the following steps: receiving writing operation generated on a whiteboard application interface, and generating corresponding writing handwriting according to the writing operation, wherein the whiteboard application interface comprises at least one thinking guide picture; acquiring a first stroke point of writing operation; determining whether the writing handwriting falls in the thinking guide picture according to the position of the first stroke point; in the case that the writing script falls in the mind map, whether to adjust the layout of the mind map is determined according to the writing script, wherein the layout of the mind map is used for representing the sizes of nodes in the mind map and the positions of the nodes in the mind map. The invention solves the technical problem that in the prior art, only text content can be typed in the mind map, and the layout is carried out after all the text content is typed, so that the input content is inconvenient.

Description

Control method and device for whiteboard application and electronic equipment

Technical Field

The invention relates to the field of computers, in particular to a whiteboard application control method and device and electronic equipment.

Background

At present, after the thought graph function is added to the whiteboard application, the thought graph can be added to the whiteboard application, and operations such as generating the thought graph (fig. 1 a), adding nodes (fig. 1 b), and retracting nodes (fig. 1 c) can be performed on the thought graph, but in the current scheme, when content needs to be input into the nodes of the thought graph, the input needs to be performed through an entity or a virtual keyboard, and the layout needs to be performed again after all texts are input, so that the user is inconvenient to use the thought graph.

Aiming at the problem that in the prior art, only text content can be typed in a mind map, and the layout is carried out after all the text content is typed, so that the input content is inconvenient, an effective solution is not provided at present.

Disclosure of Invention

The embodiment of the invention provides a whiteboard application control method, a whiteboard application control device and electronic equipment, which are used for at least solving the technical problem that in the prior art, only text content can be typed in a thought guide picture, and layout is performed after all the text content is typed, so that the input content is inconvenient.

According to an aspect of the embodiments of the present invention, there is provided a method for controlling a whiteboard application, including: receiving writing operation generated on a whiteboard application interface, and generating corresponding writing handwriting according to the writing operation, wherein the whiteboard application interface comprises at least one thinking guide picture; acquiring a first stroke point of writing operation; determining whether the handwriting falls in the thinking guide picture according to the position of the first stroke point; in the case that the handwriting falls within the mind map, determining whether to adjust a layout of the mind map according to the handwriting, wherein the layout of the mind map is used for representing sizes of nodes in the mind map and positions of the nodes in the mind map.

According to another aspect of the embodiments of the present invention, there is also provided a control apparatus for a whiteboard application, including: the whiteboard system comprises a receiving module, a display module and a display module, wherein the receiving module is used for receiving writing operation generated on a whiteboard application interface and generating corresponding writing handwriting according to the writing operation, and the whiteboard application interface comprises at least one thinking guide picture; the acquisition module is used for acquiring a first stroke point of the writing operation; the determining module is used for determining whether the handwriting falls in the thinking guide picture according to the position of the first stroke point; and the layout module is used for determining whether to adjust the layout of the mind map according to the handwriting under the condition that the handwriting falls into the mind map, wherein the layout of the mind map is used for representing the size of the nodes in the mind map and the positions of the nodes in the mind map.

According to another aspect of embodiments of the present invention, there is also provided a computer storage medium having stored thereon a plurality of instructions adapted to be loaded by a processor and to carry out any of the method steps as defined in any of the above.

According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of any of the above.

The method includes the steps that writing operation generated on a whiteboard application interface is received, and corresponding writing handwriting is generated according to the writing operation, wherein the whiteboard application interface comprises at least one thinking guide graph; acquiring a first stroke point of writing operation; determining whether the handwriting falls in the thinking guide picture according to the position of the first stroke point; in the case that the handwriting falls within the mind map, determining whether to adjust a layout of the mind map according to the handwriting, wherein the layout of the mind map is used for representing sizes of nodes in the mind map and positions of the nodes in the mind map. That is, in the above-mentioned scheme of the present application, whether the written handwriting belongs to the thought-chart is judged, so as to realize that the content is filled into the nodes in the thought-chart by handwriting, and after the user generates a written handwriting each time, when the handwriting is determined to be the handwriting for filling into the nodes of the thought-chart, whether the thought-chart needs to be rearranged is judged in real time, thereby solving the technical problem that in the prior art, only the text content can be typed in the thought-chart, and the layout is performed after all the typing is finished, so that the input content is inconvenient, further realizing the effect of adjusting the layout of the thought-chart according to the handwriting written by the user in real time, not only being convenient for the user to use, but also improving the aesthetic property of the thought-chart.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:

FIG. 1a is a schematic diagram of a prior art thought graph generating node;

FIG. 1b is a schematic diagram of a prior art thought graph adding node;

FIG. 1c is a schematic diagram of a prior art thought graph packing node;

fig. 2 is a flowchart of a method of controlling a whiteboard application according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a mind map according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of determining a node to which a first handwriting point belongs according to an embodiment of the application;

FIG. 5 is a schematic diagram illustrating expanding a node according to an embodiment of the invention;

FIG. 6 is a schematic diagram of an adjusted mind map layout according to an embodiment of the present invention;

fig. 7 is a schematic diagram of a control arrangement for a whiteboard application according to an embodiment of the present invention.

Detailed Description

In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example 1

The thinking guide picture is a mode of using pictures and texts to repeat, and the relationship of themes at all levels is expressed by mutual subordination and related hierarchical pictures, thereby realizing an effective thinking tool for divergent thinking. The thinking graph comprises a plurality of nodes, and each node is connected through a line, so that the hierarchical relationship between the nodes is represented. For example, a plurality of child nodes are diverged from one root node, brother nodes of the same level are formed among the child nodes, other child nodes can be further diverged from the child nodes, and the like, so that the final thought-guidance graph can be obtained.

At present, in whiteboard application, the content in the thought guidance picture can only be typed in through a physical keyboard or a virtual keyboard, the writing function of the whiteboard can not be used for writing the content in the thought guidance picture, and the operation is very inconvenient. In light of this problem, the present invention provides an embodiment of a method of controlling a whiteboard application, it being noted that the steps illustrated in the flow chart of the drawings may be carried out in a computer system such as a set of computer executable instructions, and that while a logical sequence is illustrated in the flow chart, in some cases the steps illustrated or described may be carried out in a different sequence than here.

Fig. 2 is a flowchart of a method for controlling a whiteboard application according to an embodiment of the present invention, as shown in fig. 2, the method includes the following steps:

and S102, receiving writing operation generated on the whiteboard application interface, and generating corresponding writing handwriting according to the writing operation, wherein the whiteboard application interface comprises at least one thinking guide picture.

Specifically, the whiteboard application interface may be an interface provided when the whiteboard application is run on the smart interactive tablet, and the interface may have multiple functions such as writing. In the whiteboard application interface of the above scheme, at least one generated mind map is included.

The thinking graph comprises a plurality of nodes, and the connection relationship of the nodes through lines represents the hierarchical relationship of the nodes. Each node has a default size so that it can be written within the node. The nodes of the mind map may be rectangular, or rounded rectangles, the size of which is the default size each time a new node is generated when the mind map is created.

The thought-derivative graph shows the concrete contents by diverging from the root node to the child node, wherein the direction in which the root node extends to the child node may be a horizontal direction or a vertical direction, and in the following embodiments, the distance in the direction in which the root node extends to the child node is referred to as a width, and the distance in the arrangement direction of sibling nodes in the same hierarchy is referred to as a height.

The writing operation may be an operation performed on the device by using a writing pen or using a finger, and after the device detects the writing operation, the device generates writing handwriting according to the writing operation and displays the writing handwriting.

And step S104, acquiring a first stroke point of the writing operation.

The first stroke point of the writing operation is the pen falling point of the handwriting. When the equipment records the writing operation, the points generated by the writing operation are recorded in a down-move-move-up mode, wherein the point recorded as 'down' is the first trace point, the point recorded as 'move' is a moving point of the handwriting, and the point recorded as 'up' is a point lifted by the handwriting, namely the last trace point.

And S106, determining whether the writing handwriting falls into the thinking guide picture according to the position of the first handwriting point.

In the scheme, whether the handwriting falls in the mind map is determined according to the position of the first stroke point.

In an alternative embodiment, when the first trace point falls into any one node of the thought-guide graph, the written handwriting is determined to fall into the thought-guide graph, and the written handwriting is determined to fall into the node where the first trace point is located, that is, the written handwriting is determined to be used for filling the node of the thought-guide graph. And when the first stroke point does not fall into any node of the thought guide graph, determining that the writing does not fall into the thought guide graph, namely the writing is not used for filling the node of the thought guide graph.

And S108, in the case that the writing is in the thinking graph, determining whether to adjust the layout of the thinking graph according to the writing, wherein the layout of the thinking graph is used for representing the size of the node in the thinking graph and the position of the node in the thinking graph.

In the above scheme, in the case that the writing is determined to fall within the mind map, the writing may be bound with the node where the writing falls.

If the handwriting completely belongs to the node to which the handwriting belongs, namely the handwriting does not exceed the range of the node to which the handwriting belongs, the size of the node to which the handwriting belongs is proper, the size of the node does not need to be adjusted, and correspondingly, the layout of the thinking guide graph does not need to be adjusted; if the handwriting exceeds the range of the node to which the handwriting belongs, the size of the node to which the handwriting belongs is not appropriate, the expansion is needed, and correspondingly, the layout of the thought guide graph is also needed to be adjusted.

The layout of the thought-leading graph can be adjusted by adjusting the size of the nodes and the positions of the nodes in the thought-leading graph, so that the nodes can be connected according to a preset connection mode and a preset distance can be kept, and the display effect of the thought-leading graph is better.

In the related art, the nodes of the mind map are filled with contents by typing through a physical keyboard or a virtual keyboard, and the mind map is also rearranged, but the arrangement mode is that after a user inputs a text, the mind map is triggered to be rearranged by pressing a key such as 'confirm'. The embodiment of the application receives writing operation generated on the whiteboard application interface and generates corresponding writing handwriting according to the writing operation, wherein the whiteboard application interface comprises at least one thinking map; acquiring a first stroke point of writing operation; determining whether the handwriting falls in the thinking guide picture according to the position of the first stroke point; in the case that the handwriting falls within the mind map, determining whether to adjust a layout of the mind map according to the handwriting, wherein the layout of the mind map is used for representing sizes of nodes in the mind map and positions of the nodes in the mind map. That is, in the above-mentioned scheme of the present application, whether the written handwriting belongs to the thought-chart is judged, so as to realize that the content is filled into the nodes in the thought-chart by handwriting, and after the user generates a written handwriting each time, when the handwriting is determined to be the handwriting for filling into the nodes of the thought-chart, whether the thought-chart needs to be rearranged is judged in real time, thereby solving the technical problem that in the prior art, only the text content can be typed in the thought-chart, and the layout is performed after all the typing is finished, so that the input content is inconvenient, further realizing the effect of adjusting the layout of the thought-chart according to the handwriting written by the user in real time, not only being convenient for the user to use, but also improving the aesthetic property of the thought-chart.

As an alternative embodiment, the thought-graph includes a plurality of nodes, determining the area occupied by the nodes on the whiteboard application interface as a first range of the nodes, determining the minimum rectangular area including the nodes and all the sub-nodes of the nodes as a second range of the nodes, and determining whether the handwriting falls within the thought-graph according to the position of the first stroke point, including:

step 1061, judging whether the first trace point falls into a second range of the current node, wherein the initial current node is a root node of the thinking guide graph;

step 1062, under the condition that the first stroke point does not fall into the second range of the current node, if the current node does not have a brother node, determining that the writing handwriting does not fall into the thinking guide graph, and if the current node has a brother node, judging whether the first stroke point falls into the brother node of the current node;

step 1063, under the condition that the first handwriting point falls into the second range of the current node, judging whether the first handwriting point falls into the first range of the current node;

step 1064, determining that the writing handwriting falls into the current node under the condition that the first handwriting point falls into the first range of the current node;

and step 1065, under the condition that the first stroke point does not fall into the first range of the current node, if the current node does not have a child node, determining that the writing stroke does not fall into the thinking guide graph, and if the current node has a child node, judging whether the first stroke point falls into the child node of the current node.

Fig. 3 is a schematic diagram of a mind map according to an embodiment of the present invention, and the first range and the second range of the nodes are described below with reference to fig. 3. In the above arrangement, the first range of nodes is used to represent the area occupied by the node itself on the whiteboard application interface. Taking fig. 3 as an example, 301 is an area occupied by the node 0 itself in the whiteboard application interface, that is, the first range of the node 0. For node 1, its child nodes include node 0, node 0', and node 302 includes node 1, node 0, and node 0', and is the minimum bounding rectangle of node 1, node 0, and node 0, so that node 302 is the second range corresponding to node 1. Similarly, 303 is the second range for

node

2 and 304 is the second range for node 4. As can be seen from the above description, the first and second scopes of the endmost node of the mind map are the same, and the second scope of the root node of the mind map includes all nodes of the mind map.

Under the above definitions, the judgment of whether the handwriting falls within the mind map will be described. In the above scheme, it is determined whether the handwriting falls within the mind map based on the position of the first stroke point of the handwriting. If the first trace point falls outside the thought guide diagram, the writing handwriting is determined to fall outside the thought guide diagram, and if the first trace point falls on a certain node in the thought guide diagram, the writing handwriting is determined to fall on the node, which is specifically explained below.

First, a current node is determined (when the determination is made in the first execution step S1061, the root node is determined to be the current node), and whether the first tracing point falls within the second range of the current node is determined. If not, determining that the first handwriting is no longer in the current node and all child nodes thereof, and thus proceeding to step S1062, and determining in the sibling node of the current node, specifically, determining whether the first handwriting point falls into the second range of the next sibling node of the current node. And when judging whether the first handwriting point falls into the next brother node of the current node or not, under the condition that the current node does not comprise the brother node, determining that the writing handwriting does not fall into the thinking guide diagram. It should be noted that, when step S1061 is performed for the first time, the root node is determined to be the current node, and since the root node has no sibling node, when step S1062 is performed for the first time, if the first stroke point does not fall into the second range of the current node, the written handwriting does not necessarily fall into the thought guide diagram.

And if the result of judging whether the first handwriting point falls into the second range of the current node is yes, determining that the first handwriting point possibly falls into the current node or a child node thereof, and sequentially judging. Step S1063 is firstly entered, it is judged that the first trace point does not fall into the first range of the current node, if the judgment result is yes, step S1064 is entered, the node where the first trace point falls is determined, the node is the node to which the handwriting belongs, if the judgment result is no, step S1065 is entered, and judgment is performed in the child nodes of the current node, specifically, whether the first trace point falls into the second range of the child nodes in the current node is judged. In the above solution, under the condition that the first trace point does not fall within the first range of the current node, if the current node does not include any child node, it indicates that the first trace point does not fall within the thought guide graph, and if the current node includes a child node, the first child node is taken as the current node, so as to enter step S1061 again.

As an alternative embodiment, if the current node has a sibling node, determining whether the first stroke point falls within the sibling node of the current node includes: and taking the next brother node of the current node as the current node, and entering the step of judging whether the first stroke point falls into the second range of the current node.

If the current node includes a sibling node, the next sibling node of the current node is set as the current node and the process proceeds to step S1061 again to determine. After the determination is performed for multiple times, after each brother node of the current node has performed step S1061, there is no brother node that is not the current node, and it is determined that the written handwriting does not fall into the thought-derivative graph.

As an optional embodiment, if the current node has a child node, determining whether the first trace point falls into the child node of the current node includes: and taking the first child node of the current node as the current node, and entering a step of judging whether the first stroke point falls into the second range of the current node.

In the above scheme, if the current node includes a child node, the first child node of the current node is taken as the current node, so that the process proceeds to step S1061 again.

As an optional embodiment, before determining whether the first trace point falls within the second range of the current node, the method further includes: judging whether the first trace point falls on a node to which the previous handwriting belongs; if the judgment result is yes, determining the node to which the previous handwriting belongs as the range to which the first handwriting point belongs; and under the condition that the judgment result is negative, the step of judging whether the first handwriting point falls into the second range of the current node is carried out.

In the above scheme, if the first trace point of the current handwriting and the first trace point of the previous handwriting belong to the first range of the same node, the step S1061 is not required to be performed for judgment, but the node where the first trace point of the previous handwriting is located is directly determined to be the node to which the first trace point of the current handwriting belongs. Because continuous writing can be performed on the same node, the judging steps are added, so that each handwriting does not need to be searched for the node to which the handwriting belongs from the root node, and the node determining speed can be increased.

Fig. 4 is a schematic diagram of determining a node to which a first trace point belongs according to an embodiment of the present application, and as shown in fig. 4, it is first determined that the first trace point of the current trace does not fall within a first range of a node to which a last trace belongs (i.e., a node to which the first trace point of the last trace belongs), if the determination result is yes, the node to which the last trace belongs is directly determined as the node to which the current written trace belongs, and if the determination result is no, the root node is taken as the current node, and the next stage is entered.

In the stage, judging whether the first trace point is in the second range of the current node, if so, judging whether the first trace point is in the first range of the current node, and if so, determining that the first trace point falls on the current node; if the first handwriting point is not in the first range of the current node, the current node is updated to be a child node of the current node, judgment is continued, and the first handwriting point is determined to fall outside the thinking guide graph under the condition that the child node does not exist in the current node.

And if the first handwriting point is not in the second range of the current node, updating the current node as the brother node of the current node to continue judging, and determining that the first handwriting point falls outside the thinking guide graph under the condition that no unjudged brother node exists in the current node.

As an alternative embodiment, in the case that the writing is in the mind map, determining whether to adjust the layout of the mind map according to the writing includes: under the condition that the writing handwriting exceeds the area occupied by the first target node, expanding the capacity of the first target node to enable the first target node to comprise the writing handwriting, wherein the first target node is a node where a first handwriting point of the writing handwriting is located; and adjusting the layout of the mind map according to the expanded first target node.

In the above scheme, under the condition that the writing trace falls into the mind map, if the writing trace exceeds the area occupied by the first target node (i.e. the first range of the first target node), the capacity expansion needs to be performed on the first target node, so that the first target node includes the writing trace. After the first target node is expanded, the mind map needs to be rearranged to achieve a better display effect.

It should be noted that the adjustment of the mind map layout is performed in real time, that is, once a writing script is generated on the whiteboard application interface, it is required to determine whether the writing script causes the expansion of the node to which the writing script belongs, and perform the layout of the mind map in real time on the basis that the writing script causes the expansion of the node, without waiting for the user to write the whole object (for example, a complete word or word), and without the need for the user to perform other operations to trigger the adjustment of the mind map layout.

It should be further noted that, in the above-mentioned solution, the expansion of the first target node and the adjustment of the mind map may be performed together in one layout, that is, the effect seen by the user is that the expansion of the first target node and the adjustment of the mind map are completed after the mind map is changed once.

As an alternative embodiment, adjusting the layout of the mind map according to the expanded first target node includes: acquiring size parameters of the first target node and size information of other nodes after capacity expansion, wherein the other nodes are nodes in the thought graph except the first target node, and the size information includes: height and width; determining an origin according to the position of a root node of the mind map, and determining a position parameter of each node in the mind map relative to the origin after adjusting the layout according to the origin, the size parameter of the first target node, the size information of the other nodes and a preset interval parameter, wherein the interval parameter comprises: the distance between adjacent brother nodes and the distance between adjacent father and son nodes; determining a displacement parameter of the first target node according to the position parameter of the first target node after the layout is adjusted and the position parameter of the first target node before the layout is adjusted; and adjusting all nodes in the mind map to move reversely according to the displacement parameters.

After the first target node is expanded, if the layout of the mind map is not adjusted, the distances between the first target node and the father node, the child nodes and the brother nodes are all possibly reduced.

In the above scheme, the mind map needs to be rearranged due to the expansion of the first target node, so that the mind map is firstly rearranged The height and width of the first target node after expansion needs to be determined. The method for expanding the capacity of the first target node may be that StatorAnd the minimum circumscribed rectangle of the handwriting in the area beyond the first target node is enlarged so that the area occupied by the first target node contains the minimum circumscribed rectangle.

Fig. 5 is a schematic diagram of expanding the volume of a node according to an embodiment of the present invention, and as shown in fig. 5, in the writing process, the volume expansion layout is based on the node where the pen drop is located and the handwriting therein. The range of the rectangle framed by the original handwriting of the node is 501, the range of the rectangle framed by the newly added handwriting is 502, and the range of the rectangle combined by the original handwriting and the newly added handwriting is 503, so that the writing range of the current node is expanded from 501 to 503.

The origin is determined according to the root node of the mind map, and the midpoint of one side (the side opposite to the direction of the child node) of the root node may be used as the origin. The preset interval parameters include: the distance between the preset adjacent brother nodes in the arrangement direction of the brother nodes and the distance between the preset adjacent parent-child nodes in the arrangement direction of the parent-child nodes.

Referring to fig. 3, in the mental diagram, all nodes have a width of x and a height of y, distances between nodes of the same level are B (i.e., distances between the adjacent brother nodes), and distances between nodes of upper and lower levels are B (i.e., distances between the adjacent parent and child nodes).

Therefore, the occupied height of the node at which the node 0 is located is y.

Node 0 is parent node 1, and node 1 occupies a height that includes the heights of all its children nodes, as well as the distances between the various children nodes. Then node 1 occupies a height h1=2 x y + b;

node 1 parent node is node 2, and node 2 occupies the height including the height of all its children nodes, as well as the distance between the various children nodes. Then node 2 occupies a height of h2= y + b + y + b + h1=2 × y +2 × b + h1;

node 3 occupies a height h3=2 x y + b;

the parent node of the

nodes

2 and 3 is the root node 4, the height occupied by the node 4 comprises the heights of all the child nodes and the distance between the child nodes, and then the height occupied by the node 4 is h4= h3+ h2+ b.

Assuming that the coordinate of the left midpoint P4 of the root node (node 4) is (0, 0), the left midpoint coordinates of all other nodes can be determined according to the above contents, for example, the left midpoint P3 of the node 3 is (x + B, h4/2-h 3/2), the left midpoint P2 of the node 2 is (x + B, h2/2-h 4/2), the left midpoint P1 of the node 1 is (2 × x + 2B, h1/2-h 4/2), and so on.

In practice, the width and height of the nodes are not always the same, but the occupied height of each node may be obtained from the last child node, and then the coordinates, i.e., the relative position, of the node with respect to the root node may be obtained.

As can be seen from the above, based on the constraints of the width and height of each node in the mind map, the distance between nodes at the same level, and the distance between nodes at upper and lower levels, the position parameter of each node relative to the origin can be determined. When the mind map is rearranged, the coordinates of the root node can be specified, the relative position of the child nodes is calculated, and the deviation and the display are carried out, so that the arrangement of the mind map can be completed.

After the position parameter of each node in the thought graph relative to the origin is determined through the steps, the position parameter of the first target node after layout can be obtained, and the position parameter of the first target node after layout is subtracted from the position parameter before layout, so that the displacement parameter of the first target node can be obtained. For example, the first target node is (3, 2) at the position before the layout and (3, 1) as the position parameter after the layout, and thus it can be determined that the displacement parameter of the first target node is (0, -1).

Since the writing is currently performed on the first target node, in order to achieve a better display effect, the above scheme desirably needs the rearranged mind map to enable the absolute position of the first target node not to change, so after determining the position parameters of all the child nodes relative to the origin, the above steps also adjust all the nodes in the mind map to move in the reverse direction according to the displacement parameters. For example, still taking the displacement parameter of the first target node as (0, -1) as an example, all nodes of the mind map move according to (0, 1), so that the absolute position of the first target node is unchanged, that is, the position of the first target node being written does not change for the user, but the whole mind map completes the new layout.

Fig. 6 is a schematic diagram of a mind map layout adjustment according to an embodiment of the present invention, and with reference to fig. 6, the width and height of a node are respectively increased by a width and height difference between a rectangle 501 and a rectangle 503 in fig. 5, because the node 601 is a root node, the left center of the node 601 is determined as an origin, and the positions of the left centers of the

nodes

602, 603, and 604 relative to the origin are determined according to the original widths and heights of the

nodes

602, 603, and 604 and the preset distances between nodes of the same level and the node as well as between nodes of upper and lower levels and the node. Since the first target node 601 in this example is the root node, and the first target node 601 has not moved, that is, the displacement parameter is (0, 0), the whole thought graph does not need to move reversely, so as to obtain the result after the rearrangement as shown in fig. 6.

The layout method proposed by the scheme comprises the steps of firstly re-determining coordinates of all nodes in a thought-derivative graph relative to a root node according to the root node, keeping the root node still, carrying out position adjustment on all child nodes, and recording displacement parameters of a first target node; and then moving the whole mind map direction by the displacement parameter, thereby achieving the purpose of re-laying the mind map but not changing the absolute position of the first target node operated by the user.

As an alternative embodiment, the method further includes: receiving a handwriting dragging operation, wherein the dragging operation is used for dragging a preset dragging handwriting to a second target node; under the condition that the dragged handwriting exceeds the area occupied by the second target node, expanding the capacity of the second target node so as to enable the second target node to comprise the dragged handwriting; and adjusting the layout of the mind map according to the expanded second target node.

The handwriting dragging operation can be to drag a handwriting out of the mind map into the mind map, and can also be to drag a handwriting in the mind map from a point to another node. The drag-in operation for the handwriting may be a set multiple operation, for example, a frame selects and moves after dragging the handwriting, a double-click moves after dragging the handwriting, and the like, and is not limited herein.

If the dragged handwriting does not exceed the area occupied by the second target node after being dragged to the second target node, the mind map does not need to be rearranged, and if the dragged handwriting exceeds the area occupied by the second target node after being dragged to the second target node, the second target node needs to be expanded and the layout of the mind map needs to be adjusted.

As an optional embodiment, the method further includes: receiving a handwriting dragging-out operation, wherein the dragging-out operation is used for dragging a preset dragging-out handwriting out of a third target node, and the third node occupies an area larger than a default node area by the dragging-out handwriting; and shrinking the third target node, and adjusting the layout of the mind map according to the shrunk third target node.

The handwriting dragging operation can be that the handwriting is dragged out from the third target node to other nodes, or the handwriting is dragged out of the thinking guide graph from the second target node. The operation of dragging out the handwriting can also be started in various ways according to the setting, for example, the operation of moving after the handwriting is dragged in by frame selection, the operation of moving after the handwriting is dragged in by double click, and the like, and the operation is not limited here.

If the third target node does not cause the area occupied by the third target node to be larger than the default node area, the dragging of the third node does not cause the contraction of the third target node. In the above solution, the third node occupies an area larger than the default node area when the handwriting is dragged out, so that the third target node needs to be contracted and the layout of the mind map needs to be adjusted correspondingly after the handwriting is dragged out.

It should be noted that, for the operation of dragging the handwriting from one node to another node in the mind map, one node executes the handwriting dragging-out step, and the other node executes the handwriting dragging-in step, so that the actions can be completed.

It should be noted that, for the operation of dragging the handwriting from one node to another node in the mind map, one node may be contracted while the other node is expanded, in this case, the layout operation may be performed only once to ensure that the position of the handwriting is unchanged, and the other part of the mind map is laid out based on the handwriting and the node.

It should be noted that, the manner of re-laying the whole mind map according to the contracted third target node in the above steps is similar to the manner of re-laying the whole mind map according to the expanded first target node in the above embodiment, and is not described herein again.

Example 2

The present invention provides an embodiment of a control device for a whiteboard application, and fig. 7 is a schematic diagram of a control device for a whiteboard application according to an embodiment of the present invention, as shown in fig. 7, the device includes:

the receiving module 70 is configured to receive a writing operation generated on the whiteboard application interface, and generate corresponding writing handwriting according to the writing operation, where the whiteboard application interface includes at least one mind map.

And the obtaining module 72 is used for obtaining the first track point of the writing operation.

And the determining module 74 is used for determining whether the writing handwriting falls in the mind map according to the position of the first stroke point.

And a layout module 76 for determining whether to adjust the layout of the mind map according to the handwriting in case the handwriting falls within the mind map, wherein the layout of the mind map is used for representing the size of the nodes in the mind map and the positions of the nodes in the mind map.

As an alternative embodiment, the thought graph includes a plurality of nodes, the area occupied by the nodes on the whiteboard application interface is determined as a first range of the nodes, the minimum rectangular area including the nodes and all the sub-nodes of the nodes is determined as a second range of the nodes, and the determining module includes:

the first judgment submodule is used for judging whether the first stroke point falls into a second range of the current node or not, wherein the initial current node is a root node of the thinking guide graph;

the first determining submodule is used for determining that the handwriting does not fall into the thinking guide graph if the current node does not have the brother node under the condition that the first stroke point does not fall into the second range of the current node, and judging whether the first stroke point falls into the brother node of the current node if the current node has the brother node;

the second judgment submodule is used for judging whether the first handwriting point falls into the first range of the current node or not under the condition that the first handwriting point falls into the second range of the current node;

the second determining submodule is used for determining that the writing handwriting falls into the current node under the condition that the first handwriting point falls into the first range of the current node;

and the third determining submodule is used for determining that the handwriting does not fall into the thinking graph if the current node does not have the child node under the condition that the first stroke point does not fall into the first range of the current node, and judging whether the first stroke point falls into the child node of the current node if the current node has the child node.

As an alternative embodiment, the first determination submodule includes: and the first determining unit is used for taking the next brother node of the current node as the current node and entering the step of judging whether the first stroke point falls into the second range of the current node.

As an alternative embodiment, the third determination submodule includes: and the second determining unit is used for taking the first child node of the current node as the current node and entering the step of judging whether the first stroke point falls into the second range of the current node.

As an optional embodiment, the apparatus further comprises: before judging whether the first trace point falls into the second range of the current node, a third judgment submodule is used for judging whether the first trace point falls into the node to which the previous trace belongs; the fourth determining submodule is used for determining the node to which the previous handwriting belongs as the range to which the first handwriting point belongs under the condition that the judgment result is yes; and the entering submodule is used for entering the step of judging whether the first handwriting point falls into the second range of the current node or not under the condition that the judgment result is negative.

As an alternative embodiment, the layout module comprises: the capacity expansion sub-module is used for expanding the capacity of the first target node under the condition that the writing handwriting exceeds the area occupied by the first target node, so that the first target node comprises the writing handwriting, wherein the first target node is a node where the first handwriting point of the writing handwriting is located; and the first adjusting submodule is used for adjusting the layout of the thinking map according to the expanded first target node.

As an alternative embodiment, the expansion sub-module comprises: an obtaining unit, configured to obtain a size parameter of the first target node after capacity expansion and size information of other nodes, where the other nodes are nodes in the thought graph except for the first target node, and the size information includes: height and width; a third determining unit, configured to determine an origin according to a location of a root node of the mind map, and determine, according to the origin, the size parameter of the first target node, the size information of the other nodes, and a preset interval parameter, a location parameter of each node in the mind map relative to the origin after the layout is adjusted, where the interval parameter includes: the distance between adjacent brother nodes and the distance between adjacent father and son nodes; a fourth determining unit, configured to determine a displacement parameter of the first target node according to the position parameter of the first target node after the layout adjustment and the position parameter of the first target node before the layout adjustment; and the adjusting unit is used for adjusting all the nodes in the thinking map to move reversely according to the displacement parameters.

As an alternative embodiment, the apparatus further comprises: the system comprises a dragging operation receiving module, a writing operation receiving module and a writing operation processing module, wherein the dragging operation receiving module is used for receiving handwriting dragging operation, and the dragging operation is used for dragging preset dragging handwriting to a second target node; the capacity expansion module is used for expanding the capacity of the second target node under the condition that the dragged handwriting exceeds the area occupied by the second target node, so that the second target node comprises the dragged handwriting; and the adjusting module is used for adjusting the layout of the thinking guide graph according to the expanded second target node.

As an alternative embodiment, the method further includes: the system comprises a dragging-out operation receiving module, a first node setting module and a second node setting module, wherein the dragging-out operation receiving module is used for receiving handwriting dragging-out operation, the dragging-out operation is used for dragging a preset dragging-out handwriting out of a third target node, and the dragging-out handwriting enables the area occupied by the third node to be larger than a default node area; and the contraction module is used for contracting the third target node and adjusting the layout of the mind map according to the contracted third target node.

Example 3

An embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, where the instructions are suitable for being loaded by a processor and executing the method steps in the embodiments shown in fig. 1 to 6, and a specific execution process may refer to specific descriptions of the embodiments shown in fig. 1 to 6, which are not described herein again. The device on which the storage medium is located may be a smart interactive tablet.

Example 4

According to an embodiment of the present application, there is also provided an electronic device, including: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of embodiment 1.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art to which the present application pertains. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A method of controlling a whiteboard application, comprising:

receiving writing operation generated on a whiteboard application interface, and generating corresponding writing handwriting according to the writing operation, wherein the whiteboard application interface comprises at least one thinking guide picture;

acquiring a first stroke point of the writing operation;

determining whether the handwriting falls into the thinking guide picture according to the position of the first stroke point;

and determining whether to adjust the layout of the mind map according to the writing handwriting under the condition that the writing handwriting falls in the mind map, wherein the layout of the mind map is used for representing the sizes of the nodes in the mind map and the positions of the nodes in the mind map.

2. The method as claimed in claim 1, wherein the mind map comprises a plurality of nodes, determining the area occupied by the nodes themselves on the whiteboard application interface as a first range of the nodes, determining the smallest rectangular area comprising the nodes and all sub-nodes of the nodes as a second range of the nodes, and determining whether the writing trace falls within the mind map according to the position of the first trace point comprises:

judging whether the first stroke point falls into a second range of the current node or not, wherein the initial current node is a root node of the thinking guide graph;

under the condition that the first stroke point does not fall into the second range of the current node, if the current node does not have a brother node, determining that the writing handwriting does not fall into the thinking map, and if the current node has a brother node, judging whether the first stroke point falls into the brother node of the current node;

under the condition that the first handwriting point falls into the second range of the current node, judging whether the first handwriting point falls into the first range of the current node or not;

determining that the writing trace falls into the current node under the condition that the first trace point falls into a first range of the current node;

and under the condition that the first stroke point does not fall into the first range of the current node, if the current node does not have a child node, determining that the writing handwriting does not fall into the thinking graph, and if the current node has a child node, judging whether the first stroke point falls into the child node of the current node.

3. The method according to claim 2, wherein if the current node has a sibling node, determining whether the first point falls within the sibling node of the current node comprises:

and taking the next brother node of the current node as the current node, and entering a step of judging whether the first stroke point falls into a second range of the current node.

4. The method of claim 2, wherein if the current node has a child node, determining whether the first trace point falls within the child node of the current node comprises:

and taking the first child node of the current node as the current node, and entering a step of judging whether the first stroke point falls into a second range of the current node.

5. The method of claim 2, wherein prior to determining whether the first waypoint falls within the second range of the current node, the method further comprises:

judging whether the first trace point falls on a node to which the previous handwriting belongs;

if the judgment result is yes, determining the node to which the previous handwriting belongs as the range to which the first handwriting point belongs;

and if the judgment result is negative, the step of judging whether the first stroke point falls into the second range of the current node is carried out.

6. The method of claim 1, wherein determining whether to adjust the layout of the mind map based on the writing when the writing falls within the mind map comprises:

when the writing handwriting exceeds the area occupied by a first target node, expanding the capacity of the first target node so that the first target node comprises the writing handwriting, wherein the first target node is a node where a first trace point of the writing handwriting is located;

and adjusting the layout of the mind map according to the expanded first target node.

7. The method of claim 6, wherein adjusting the layout of the mind map according to the expanded first target node comprises:

obtaining size parameters of the first target node after capacity expansion and size information of other nodes, where the other nodes are nodes in the mind map except the first target node, and the size information includes: height and width;

determining an origin according to the position of a root node of the mind map, and determining a position parameter of each node in the mind map relative to the origin after adjusting the layout according to the origin, the size parameter of the first target node, the size information of the other nodes and a preset interval parameter, wherein the interval parameter comprises: the distance between adjacent brother nodes and the distance between adjacent father and son nodes;

determining a displacement parameter of the first target node according to the position parameter of the first target node after the layout is adjusted and the position parameter of the first target node before the layout is adjusted;

and adjusting all nodes in the mind map to move reversely according to the displacement parameters.

8. The method of claim 1, further comprising:

receiving a handwriting dragging operation, wherein the dragging operation is used for dragging a preset dragging handwriting to a second target node;

under the condition that the dragged handwriting exceeds the area occupied by a second target node, expanding the capacity of the second target node so as to enable the second target node to comprise the dragged handwriting;

and adjusting the layout of the mind map according to the expanded second target node.

9. The method of claim 1, further comprising:

receiving a handwriting dragging-out operation, wherein the dragging-out operation is used for dragging a preset dragging-out handwriting out of a third target node, and the dragging-out handwriting enables an area occupied by the third node to be larger than a default node area;

and shrinking the third target node, and adjusting the layout of the mind map according to the shrunk third target node.

10. A control device for a whiteboard application, comprising:

the whiteboard system comprises a receiving module, a processing module and a display module, wherein the receiving module is used for receiving writing operation generated on a whiteboard application interface and generating corresponding writing handwriting according to the writing operation, and the whiteboard application interface comprises at least one thinking map;

the acquisition module is used for acquiring a first stroke point of the writing operation;

the determining module is used for determining whether the writing handwriting falls into the thinking guide picture according to the position of the first handwriting point;

and the layout module is used for determining whether to adjust the layout of the mind map according to the handwriting under the condition that the handwriting falls into the mind map, wherein the layout of the mind map is used for representing the sizes of the nodes in the mind map and the positions of the nodes in the mind map.

11. A computer storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to perform the method steps of any of claims 1 to 9.

12. An electronic device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of any of claims 1 to 9.