CN108304132B

CN108304132B - Graph display method, device, equipment and storage medium

Info

Publication number: CN108304132B
Application number: CN201810053481.0A
Authority: CN
Inventors: 张维元
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shizhen Information Technology Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shizhen Information Technology Co Ltd
Priority date: 2018-01-19
Filing date: 2018-01-19
Publication date: 2021-03-02
Anticipated expiration: 2038-01-19
Also published as: CN108304132A

Abstract

The invention discloses a graphic display method, a device, equipment and a storage medium, relating to the technical field of electronic whiteboards and specifically comprising the following steps: recognizing a touch track comprising a character writing track and a line connecting track on a display screen; and displaying the characters identified from the character writing track in the text box, and connecting the text box with the connecting line generated corresponding to the adjacent line connecting track. By adopting the technical scheme, the technical problem that the graph with the connection relation cannot be drawn under the function of the electronic whiteboard in the prior art can be solved, the corresponding connection relation is established for the touch track under the function of the electronic whiteboard, especially under a conference scene, when a user needs to draw connection graphs such as a flow chart or an organizational chart, the connection graphs do not need to be additionally led in, the user only needs to draw by using the electronic whiteboard, and the use experience of the user is improved.

Description

Graph display method, device, equipment and storage medium

Technical Field

The present invention relates to the field of electronic whiteboard technology, and in particular, to a method, an apparatus, a device and a storage medium for displaying a graphic.

Background

With the development of intellectualization, various devices with touch functions appear in various scenes of people's life. For example, in a conference scene, the original projector is replaced by the device with the large-size display screen, so that the conference content can be displayed in the device, and the device can also serve as an electronic whiteboard to perform writing operation through the display screen.

If a graph with a connection relation needs to be displayed in a display screen, like a flow chart in Visio, the prior art generally utilizes the writing function of an electronic whiteboard to draw the graph. In the process of implementing the invention, the inventor finds that the prior art has the following defects: since the drawn graph is the graph obtained based on writing, a connection relation is not really established between the parts, that is, the graph with the connection relation is not obtained. In summary, the prior art cannot realize the graph drawing with the connection relation under the function of the electronic whiteboard.

Disclosure of Invention

In view of this, embodiments of the present invention provide a method, an apparatus, a device, and a storage medium for displaying a graph, so as to solve the technical problem that the prior art cannot implement graph drawing with a connection relationship under the function of an electronic whiteboard.

In a first aspect, an embodiment of the present invention provides a method for displaying a graph, including:

recognizing a touch track comprising a character writing track and a line connecting track on a display screen;

and displaying the characters identified from the character writing track in a text box, and connecting the text box with a connecting line generated corresponding to the adjacent line connecting track.

In a second aspect, an embodiment of the present invention further provides a graphic display device, including:

the recognition module is used for recognizing a touch track comprising a character writing track and a line connecting track on the display screen;

and the connecting module is used for displaying the characters identified from the character writing tracks in a text box and connecting the text box with a connecting line generated corresponding to the adjacent line connecting tracks.

In a third aspect, an embodiment of the present invention further provides an apparatus, including:

the display screen is used for displaying a touch track comprising a character writing track and a line connecting track, and the one or more processors;

a memory for storing one or more programs;

when the one or more programs are executed by the one or more processors, the one or more processors implement the graphic display method according to the embodiment of the present invention.

In a fourth aspect, the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are used for executing the graphic display method according to the present invention.

According to the graphic display method, the device, the equipment and the storage medium, when the touch track in the display screen comprises the character writing track and the line connecting track, characters identified by the character writing track are displayed in the corresponding text boxes, and the connecting lines generated by the line connecting track are connected with the adjacent text boxes, so that the corresponding connection relation is established for the touch track under the function of the electronic whiteboard, especially under a conference scene, when a user needs to draw a flow chart, an organization chart and other connecting charts, the connecting chart does not need to be additionally led in, the user only needs to draw by using the electronic whiteboard, and the use experience of the user is improved.

Drawings

Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments made with reference to the following drawings:

fig. 1 is a flowchart of a graphic display method according to an embodiment of the present invention;

fig. 2 is a flowchart of a graphic display method according to a second embodiment of the present invention;

FIG. 3 is a schematic view of a first display interface of the display screen;

FIG. 4 is a schematic view of a second display interface of the display screen;

FIG. 5 is a schematic view of a third display interface of the display screen;

FIG. 6 is a diagram illustrating a fourth display interface of the display screen;

FIG. 7 is a diagram of a fifth display interface of the display screen;

FIG. 8 is a flowchart illustrating a method for displaying a graphic according to a third embodiment of the present invention;

FIG. 9 is a sixth display interface diagram of the display screen;

FIG. 10 is a seventh interface diagram of the display screen;

FIG. 11 is a diagram illustrating an eighth display interface of the display screen;

FIG. 12 is a diagram illustrating a ninth display interface of the display screen;

fig. 13 is a schematic structural diagram of a graphic display device according to a fourth embodiment of the present invention;

fig. 14 is a schematic structural diagram of an apparatus according to a fifth embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings.

Example one

Fig. 1 is a flowchart of a graphic display method according to an embodiment of the present invention. The graphic display method provided by the embodiment can be executed by a graphic display device, which is implemented by software and/or hardware and integrated in the equipment. In this embodiment, an interactive smart tablet is described as an example of a device for executing a graphic display method, where the interactive smart tablet is an integrated device that controls content displayed on a display tablet and implements human-computer interaction operations through a touch technology, and integrates multiple functions of a projector, an electronic whiteboard, a curtain, a sound, a television, a video conference terminal, and the like. Referring to fig. 1, the method for displaying a graphic provided by this embodiment includes:

and S110, recognizing a touch track comprising a character writing track and a line connecting track on the display screen.

In this embodiment, the display screen is a touch display screen. The user can write, control and the like on the display screen through a finger or an associated intelligent pen. Specifically, the electronic whiteboard function is set, a user can write a touch track into the display screen after starting the electronic whiteboard function, and the interactive intelligent panel recognizes and displays the touch track in real time. The touch track is obtained by arranging a series of touch points according to a writing time sequence. Specifically, the touch trajectory includes: a text writing track and/or a line connecting track. The character writing track is a touch track generated when a user writes text data, and the line connecting track is a line-shaped touch track, such as a line segment or a broken line. In this embodiment, the linear touch tracks in the default display screen are all linear connection tracks.

Optionally, a connection establishment mode is set, and after the connection establishment mode is started, when the interactive intelligent panel displays a touch track, the touch track is synchronously identified so as to determine whether the interactive intelligent panel is a character writing track or a line connection track. Optionally, after the display area is detected to be defined by the user, the interactive intelligent tablet identifies all touch tracks in the display area to determine whether the touch tracks are character writing tracks or line connection tracks. Optionally, the interactive intelligent tablet recognizes the touch trajectory in real time to determine whether the touch trajectory is a text writing trajectory or a line connecting trajectory, and compared with the two types of manners, the manner is relatively large in calculation amount.

Further, when the touch trajectory is recognized as a character writing trajectory or a line connecting trajectory, the touch trajectories may be classified based on a position relationship and a writing timing sequence between the touch trajectories, intersecting touch trajectories or touch trajectories whose distance is smaller than a set threshold are classified into one type, and each type of touch trajectory is recognized to determine whether the touch trajectory is a character writing trajectory or a line connecting trajectory. The distance and the set threshold value can be represented by the number of the pixel points, and the number of the pixel points corresponding to the set threshold value can be set according to actual conditions. The method can also be used for establishing a track recognition model in a machine learning mode, sending all touch tracks to the track recognition model, and recognizing the touch tracks as character writing tracks or line connection tracks through the track recognition model. When it is detected that the touch trajectory includes both the text writing trajectory and the line connecting trajectory, S120 is performed.

And S120, displaying the characters identified from the character writing tracks in the text box, and connecting the text box with the connecting lines generated corresponding to the adjacent line connecting tracks.

Optionally, the touch trajectory further includes a boundary trajectory, where the boundary trajectory is a trajectory surrounding the writing trajectory. And when the boundary track is detected to exist, identifying the specific shape of the boundary track, reshaping the boundary track according to the identified shape, and displaying a graph obtained by reshaping in a display screen. Taking the boundary track as a rectangle as an example, after the user inputs the boundary track by handwriting, the interactive recognition flat panel recognizes that the boundary track is a rectangle, at this time, the length and the width of the rectangle are determined based on the boundary track, then, the corresponding standard rectangle is displayed as a text box according to the length and the width, and the boundary track written into the user is erased. And then, shaping the character writing track inside the boundary track, specifically, determining characters corresponding to the character writing track, and displaying the print characters with set fonts in a text box. At this time, the operation of writing the trace of the character is completed.

Further, text boxes closest to the two ends of the line connecting track are determined, and connecting lines corresponding to the line connecting track are connected with the corresponding text boxes. In order to prevent the situation of wrong connection, a maximum distance is set, if the distance between a certain end point of a line connection track and the text box closest to the end point is greater than the set distance, the end point is determined not to be connected with the corresponding text box, and corresponding connection is established when other text boxes closest to the end point are detected in the follow-up process. The advantage of doing so is that when the user only writes into the line connection track and the characters writing track of its one end, has not yet written into the text writing track of the other end, when the mutual intelligent flat board detects characters writing track and line connection track, can establish corresponding connection. Or, it may be set that, when the distance between the text writing track and a certain end point of the line connecting track is smaller than the distance threshold, and the text writing track is located on the extension line of the line segment where the end point is located, the corresponding connection relationship is determined to be established.

The connecting lines are standard line types generated based on the line connecting tracks. For example, if the line connecting trace is a non-smooth line segment written by the user, a standard line segment is generated at the position of the line segment, and the written line segment is erased. In another example, if the line connecting track is an uneven fold line written by the user, a corresponding standard fold line is generated at the position of the fold line, and the written fold line is erased.

In practical application, a user can write only a character writing track and a line connecting track without writing a boundary track, and at the moment, the interactive intelligent tablet can automatically determine a corresponding text box based on the character writing track. The method comprises the following steps: and setting the shape of a default text box, further determining the display position and the number of characters corresponding to the character writing track, further determining the size and the display position of the text box, and then displaying the text box.

In general, if the displayed graphic of the text box is a diamond shape, the connecting line is connected to the vertex of the text box which is closest to the display graphic, and if the displayed graphic of the text box is a rectangle or a rounded rectangle, the connecting line is connected to the border line of the text box which is closest to the display graphic, preferably to the midpoint of the border line. The setting text box in this embodiment includes four border lines. Optionally, when the connection relationship is established, the connection lines or the text boxes are adaptively adjusted, so that the displayed connection graph is more neat and attractive. For example, automatically align text boxes.

Optionally, the text box may automatically adjust the size information according to the number of words it displays. Or when the size information of the text box cannot be automatically modified, the font size information of the characters can be automatically adjusted. Generally, the priority level that the user manually adjusts is greater than the priority level that the text box automatically adjusts.

Typically, after the connection relationship between the text box and the connection line is established, the connection graph displayed in the display screen is similar to a flow chart or an organizational chart drawn by professional drawing software (such as Visio). Furthermore, a flow chart mode and an organization structure chart mode are set, and in the flow chart mode, after the interactive intelligent flat plate establishes connection, a flow chart is generated. And in the organizational chart mode, after the interactive intelligent panel establishes connection, a flow chart is generated. Or the interactive intelligent tablet determines to generate a flow chart or an organizational chart intelligently according to the text content and the specific connection relation.

Optionally, when the operation of touching or dragging the text box is detected, the shape and/or size information of the text box is adjusted, and at this time, the connection point between the connection line and the text box is adaptively adjusted. Optionally, when the length or the line type of the connecting line is detected to be dragged or modified, the connecting point corresponding to the adjusted connecting line is determined again.

Optionally, an arrow is provided for the connection line, and the arrow direction is set by the writing timing of each touch point in the line connection track. For example, if the line connecting tracks are written from top to bottom, the arrow direction is from top to bottom.

The technical scheme that this embodiment provides, when including the writing orbit of characters and lines connecting trace through the touch orbit that discerns in the discernment display screen, the characters that writing the orbit of characters discerned are shown in the text box that corresponds, and the connecting wire that the line connecting trace generated carries out the technological means of being connected with adjacent text box, realized under the whiteboard function, establish corresponding connection for the touch orbit, especially under the meeting scene, when the user need draw connection pictures such as flow chart or organizational chart, need not to introduce the connection picture in addition, only need use whiteboard to draw, user's use experience has been promoted.

Example two

Fig. 2 is a flowchart of a graphic display method according to a second embodiment of the present invention. The present embodiment is embodied on the basis of the above-described embodiments. Specifically, in this embodiment, the setting of the display screen includes a text writing track and a line connecting track. Referring to fig. 2, the method for displaying a graph provided in this embodiment specifically includes:

s201, recognizing a touch track comprising a character writing track and a line connecting track on a display screen.

S202, whether the distance between the character writing track and the adjacent line connecting track is smaller than a distance threshold value or not is confirmed. If the distance between the character writing track and the adjacent line connecting track is less than the distance threshold value, S203 is executed. Otherwise, return to execute S201.

In order to ensure the accuracy of connection establishment, the distance between the character writing track and the adjacent line connecting track is calculated, if the distance is smaller than a distance threshold value, the line connecting track is used for being connected with the current character writing track, otherwise, the line connecting track is not suitable for being connected with the character writing track. The distance threshold value can be set according to actual conditions.

Specifically, the distance between the writing track of the character and the adjacent line connecting track may be calculated as follows: and selecting the touch point with the closest distance between the two touch points, and taking the distance as the distance between the character writing track and the adjacent line connecting track. And if the distance between more than two line connecting tracks and the text writing track is smaller than the distance threshold value, considering the more than two line connecting tracks as the connection between the more than two line connecting tracks and the current text writing track.

S203, determining the character content corresponding to the character writing track, and selecting a corresponding text box according to the text content.

Wherein the text box comprises at least one of a rectangular text box, a diamond text box and a rounded rectangular text box.

Specifically, the characters corresponding to the writing tracks of the characters are determined in advance, semantic recognition is performed on the basis of the characters, and then the corresponding character contents are determined. The specific manner of semantic recognition is not limited in this embodiment. And if the text writing track is determined to correspond to the judgment or selection context based on the semantic recognition, determining that the text box is in a diamond shape. If it is determined that the text writing trajectory corresponds to a non-judgment or non-selection context based on semantic recognition, the text box is determined to be a rectangle or a rounded rectangle. Alternatively, keywords such as "whether", "judgment", and the like are set. And if detecting that the corresponding key words exist in the text content, confirming that the text box is in a diamond shape. Otherwise, determining that the text box is a rectangle or a rounded rectangle.

As another alternative: default text boxes are preset and displayed on the display screen. And setting a shape modification triggering condition, and determining to modify the display shape of the text box when the shape modification triggering condition is met. The specific content of the shape modification trigger condition is not limited.

And S204, displaying the characters identified from the character writing track in the text box, and connecting the text box with the connecting line generated corresponding to the adjacent line connecting track.

For example, fig. 3 is a schematic view of a first display interface of a display screen. The display interface comprises a first text writing track 21, a line connecting track 22 and a second text writing track 23. At this time, the corresponding first text box is determined to be a diamond shape according to the first text writing track 21, and the corresponding second text box is determined to be a rectangle according to the second text writing track 23. Further, it is determined that the distance between the first end point 221 of the line connecting trajectory 22 and the first text writing trajectory 21 is less than the distance threshold, and the distance between the second end point 222 and the second text writing trajectory 23 is also less than the distance threshold. At this time, the characters corresponding to the first text writing trajectory 21 and the second text writing trajectory 23 are displayed in the corresponding text boxes, and the text boxes are connected to the connecting lines corresponding to the line connecting trajectory 22. FIG. 4 is a diagram of a second display interface of the display screen. Referring to fig. 4, a display screen shows the result of shaping the display content of fig. 3 and establishing a connection relationship.

S205, adjusting the text box based on the touch operation aiming at the text box.

Specifically, the user is set to adjust the text box by using the touch characteristic of the display screen. And presetting adjustment contents corresponding to different touch operations, and adjusting the corresponding text box according to the adjustment contents. Wherein the adjustment content comprises at least one of: adjusting the display shape, the length-width ratio or zooming the text box, etc.

In general, it is recognized that the initial touch point of the touch operation is on the border line of the text box, and the touch operation is determined to be an effective touch operation for adjusting the text box. Further, the step at least comprises one of the following schemes:

in the first scheme, if the touch operation is a pressing operation for a text box border line, the display shape of the text box is adjusted.

Specifically, the embodiment is not limited to a specific form of the pressing operation. For example, when a border line is detected to be clicked, double-clicked, or long-pressed (e.g., for more than 2 seconds), it is determined that a valid pressing operation is received, and the display shape of the text box is adjusted. Optionally, the display shapes are prioritized, and when a pressing operation is received, the display shapes are sequentially replaced according to the priority order. Optionally, when the pressing operation is received, a list of current selectable shapes is popped up, and after a selection instruction of the user is received, the text box is adjusted to the display shape selected by the user.

Optionally, after the display shape is changed, the connection position of the connection line and the text box is changed. For example, when the text box is a diamond text box, the connecting line is connected to the lower vertex of the diamond text box. If the text box is changed to a rectangular text box, the rectangular text box contains two lower vertices, and it cannot be determined to which lower vertex the connecting line is connected. In order to ensure accurate connection and beautiful figure, after the setting that if the touch operation is a press operation for the frame line of the text box, the display shape of the text box is adjusted, the method further comprises the following steps: and changing the connection point of the corresponding connecting line and the adjusted text box corresponding to the adjusted text box.

Wherein the connection point comprises the vertex of the adjusted text box or the middle point of the border line of the text box. Specifically, if the rectangular text box is changed to the diamond text box, the vertex of the diamond text box closest to the end point of the connecting line is used as the connecting point. And if the diamond text box is changed into the rectangular text box, taking the middle point of the frame line which is closest to the end point of the connecting line in the rectangular text box as the connecting point.

If the text box corresponds to a plurality of connecting lines, the connecting points can be set according to actual conditions. If a certain border line of a certain text box is connected with 3 connecting lines after the display shape is changed, the 3 connecting lines can share one connecting point, and at the moment, the connecting point is set as the midpoint of the border line. It is also possible to divide 3 points on the border line as connection points. For example, a first midpoint between the two endpoints, the first midpoint and a second midpoint between the two endpoints are determined, and the first midpoint and the two second midpoints are determined as the connection point.

For example, refer to the display interface of FIG. 4, where text box 24 is a diamond text box. When it is detected that the frame line of the text box 24 receives a pressing operation, the display shape of the text box is modified to be rectangular. And the connection points of the connecting lines to the text box border lines 24 are adapted. FIG. 5 is a diagram of a third display interface of the display screen. Referring to fig. 5, a display screen shows a display result after dragging the display shape of the text box in fig. 4.

And secondly, if the touch operation is a dragging operation aiming at the frame line of the text frame, adjusting the length-width ratio of the text frame.

Specifically, when it is detected that the initial touch point of the touch operation is on a certain border line of the text box and it is determined that the changed touch point is continuously obtained, it is determined that the drag operation for the border line is received. If the text box is rectangular, the frame line and the opposite frame line are ensured to synchronously and relatively move along the touch track, other frame lines are adaptively adjusted, the length-width ratio of the text box is changed after the frame lines are adjusted, and the frame lines are set to move along the vertical line direction of the frame lines. If the text box is a diamond shape, determining the moving direction of the touch trajectory, wherein the moving direction comprises upward, downward, leftward and rightward. And taking the frame line as the upper right frame line or the lower right frame line and the touch track moving rightwards as an example, controlling the left vertex and the right vertex to synchronously move relatively, wherein the left vertex moves leftwards and the right vertex moves rightwards. Wherein the frame line is set to move along the direction of the connecting line of the left and right vertexes.

For example, refer to the display interface of FIG. 4, where text box 24 is a diamond text box. When it is detected that the upper right frame wire 241 has received the drag operation, if it is determined that the drag operation is rightward, the vertex between the frame wire 241 and the frame wire 243 is controlled to move in parallel rightward along the connection 242, and the vertex between the frame wire 244 and the frame wire 245 is controlled to move in parallel leftward along the connection 242. FIG. 6 is a diagram of a fourth display interface of the display screen. Referring to fig. 6, a display screen shows a display result after dragging a border line of the text box in fig. 4.

And thirdly, if the touch operation is a drag operation aiming at the vertex of the text box, zooming and adjusting the text box.

Specifically, the intersection of two border lines is a vertex, and the text box typically includes 4 vertices. When the initial touch point of the touch operation is detected to be on a certain vertex of the text box and the changed touch point is determined to be continuously acquired, determining that the zooming operation aiming at the text box is received. In general, the vertices can only move in diagonal directions. Further, the vertex is adaptively moved according to the moving direction and the moving length of the touch operation, and other vertices are adaptively adjusted to achieve the zooming of the text box after the vertex adjustment.

For example, refer to the display interface of FIG. 4, where text box 26 is a rectangular text box. When it is detected that the lower left vertex a receives the drag operation, if the drag direction is downward and the current touch point B is right below the vertex a, the vertex a is controlled to move downward along the direction of the diagonal 27, so that the straight line of the lower line where the vertex a is located includes the touch point B, and the vertex C and the vertex D are adaptively adjusted. Fig. 7 is a schematic diagram of a fifth display interface of the display screen. Referring to fig. 7, a display screen shows a display result after dragging the vertex of the text box in fig. 4.

S206, storing the connected graph obtained by connection into an editable graph format.

In order to facilitate subsequent editing of a user, after the connection graph is obtained, the connection graph is stored in real time, and the format is guaranteed to be an editable graph format. Alternatively, when an end instruction is received, the connection graph is saved in an editable graph format. The embodiment is not limited to the naming rule and the storage location for storing the text.

According to the technical scheme provided by the embodiment, by identifying that the touch track in the display screen comprises a character writing track and a line connecting track, and when the distance between the character writing track and the line connecting track is determined to be smaller than a distance threshold, determining the text box corresponding to the character writing track, displaying the characters identified by the character writing track in the text box, further, connecting the connecting line generated by the line connecting track with the adjacent text box, adjusting the text box based on the touch operation aiming at the text box, and storing the text box as the technical scheme of the editable graphic format, the technical scheme realizes that the corresponding connection relation is established for the touch track under the function of the electronic whiteboard, and particularly under a conference scene, when a user needs to draw connection graphs such as a flow chart or an organization chart, the user does not need to additionally start professional drawing software for drawing, and does not need to introduce the connection graphs, meanwhile, modification and storage are facilitated, and the use experience of a user is improved.

EXAMPLE III

Fig. 8 is a flowchart of a graphic display method according to a third embodiment of the present invention. The present embodiment is embodied on the basis of the above-described embodiments. Specifically, in this embodiment, the setting of the display screen includes a text writing track, a boundary track, and a line connection track. Referring to fig. 8, the method for displaying a graph provided in this embodiment specifically includes:

s301, recognizing that the display screen comprises a character writing track, a boundary track corresponding to the character writing track and a touch track of a line connecting track.

Wherein the boundary trace is a handwriting trace of the text box, which generally surrounds the text writing trace. The boundary trace may be a closed figure or an approximately closed figure. Since the drawn boundary trace may not be completely closed during the handwriting process of the user, an approximately closed graph surrounding the text writing trace is also determined as the boundary trace.

Specifically, the method comprises the following steps:

s3011, identifying a first touch track corresponding to a writing track of characters in the display screen.

Specifically, a touch trajectory of a text writing trajectory in the display screen is recorded as a first touch trajectory. In the track recognition process, a first touch track is recognized in advance.

And S3012, recognizing a second touch track surrounding the first touch track as a frame track of the character writing track.

Illustratively, in the set range of the first touch track, whether a second touch track surrounding the first touch track exists is determined, if yes, the second touch track is recognized as a frame track, otherwise, the character writing track is determined not to exist as the frame track. Generally, the area surrounded by each frame track only contains a writing track and does not contain a line connecting track.

And S3013, identifying the line type third touch track as a line connection track.

Further, the remaining line type third touch trajectory is recognized as a line connection trajectory.

S302, whether the distance between the character writing track and the adjacent line connecting track is smaller than a first distance threshold value or not is confirmed. If the distance between the text writing track and the adjacent line connecting track is less than the first distance threshold, S303 is executed. Otherwise, return to execute S301.

And S303, determining a corresponding text box according to the boundary track.

Specifically, the boundary trajectory is shaped to obtain a corresponding text box. For example, if the boundary trajectory is determined to be a non-smooth rectangle, the display pattern of the text box is determined to be a rectangle. Furthermore, the font size information of the displayed text is preset, the number of the characters corresponding to the current character writing track is determined, and then the rectangular area required by the characters in the number of the characters is determined, so that the size information of the text box is obtained.

S304, displaying the characters identified from the character writing tracks in the text box, and connecting the text box with the connecting lines generated corresponding to the adjacent line connecting tracks.

For example, fig. 9 is a schematic view of a sixth display interface of the display screen. The display interface comprises a first text writing track 31, a first boundary track 32, a line connecting track 33, a second text writing track 34 and a second boundary track 35. At this time, the shape and size of the text box corresponding to the first boundary trace 32 and the shape and size of the text box corresponding to the second boundary trace 35 are determined. Further, it is determined that the first end point 331 of the line connecting trajectory 33 is less than the distance threshold from the first text writing trajectory 31, and the second end point 332 is also less than the distance threshold from the second text writing trajectory 34. At this time, the characters corresponding to the first text writing trajectory 31 and the second text writing trajectory 34 are displayed in the corresponding text boxes, and the text boxes are connected to the connecting lines corresponding to the line connecting trajectory 33. Fig. 10 is a schematic view of a seventh display interface of the display screen. Referring to fig. 10, a display screen shows the result of shaping the display contents in fig. 9 and establishing a connection relationship.

S305, counting the number of characters, and adjusting the display parameters of the text box or the characters based on the number of the characters.

The text box can not reasonably display the characters due to the fact that the number of the corresponding characters changes when the user modifies the characters. Therefore, the display parameters for setting the text box or the characters can be automatically adjusted according to the number of the characters. The display parameters include, but are not limited to, font size information.

Specifically, the method comprises at least two schemes as follows:

and a first scheme is that the number of characters is counted, and the size information of the text box is adjusted based on the number of the characters.

And when the user modifies the characters, counting the current number of the characters in real time. If the number of characters is larger than the maximum number of characters displayed in the current text box, the text box is scaled based on the current number of characters or the length of one relative border line is prolonged on the premise that the length of the other relative border line is not changed.

For example, referring to FIG. 10, where the maximum number of words displayed in the text box 36 is 4, and the current number of words is determined to be 6, the length of the top and bottom border lines 361 is extended. Fig. 11 is a schematic view of an eighth display interface of the display screen. Referring to fig. 11, a display screen shows a display result after adjusting the size information of the text box in fig. 10.

And secondly, counting the number of characters, and adjusting the font size information of the characters displayed in the text box based on the number of the characters.

And when the user modifies the characters, counting the current number of the characters in real time. If the number of the characters is larger than the maximum number of the displayed characters in the current text box, the word size information of the displayed characters is reduced on the premise that the size of the text box is not changed.

For example, referring to fig. 10, where the maximum number of displayed characters in the text box 36 is 4, the number of current characters is determined to be 6, and at this time, the font size information of the characters in the text box 36 is narrowed. Fig. 12 is a schematic view of a ninth display interface of the display screen. Referring to fig. 12, a display screen shows a display result after adjusting the size information of the text box in fig. 10.

It should be noted that, the minimum font size is set, and if the characters cannot be completely displayed after the minimum font size is adjusted, at this time, the size information of the text box can be increased to ensure complete display of the characters.

Generally, when the number of characters displayed in the text box is too small, the font size information may be adaptively increased or the text box may be reduced in the same manner as when the number of characters is too large, which is not described herein again.

S306, storing the connected graph obtained by connection into an editable graph format.

According to the technical scheme provided by the embodiment, when the touch track in the display screen comprises a character writing track, a boundary track and a line connecting track, a corresponding text box is determined based on the boundary track, when the distance between the character writing track and the line connecting track is smaller than a distance threshold, characters identified by the character writing track are displayed in the text box, further, a connecting line generated by the line connecting track is connected with an adjacent text box, the size information of the text box or the character size information of characters displayed in the text box is adjusted in real time based on the number of the characters, and a connecting graph is stored as a technical scheme capable of editing a graph format, so that the corresponding connection relation is established for the touch track under the function of an electronic whiteboard, particularly under a meeting scene, when a user needs to draw a connection graph such as a flow chart or an organization chart, need not to open professional drawing software in addition and draw, also need not to introduce the connection diagram, be convenient for simultaneously modify and save, promoted user's use experience.

Example four

Fig. 13 is a schematic structural diagram of a graphic display device according to a fourth embodiment of the present invention. Referring to fig. 13, the present embodiment provides a graphic display device including: an identification module 401 and a connection module 402.

The recognition module 401 is configured to recognize a touch track including a text writing track and a line connection track on the display screen; a connecting module 402, configured to display the text recognized from the text writing trajectory in a text box, and connect the text box with a connecting line generated corresponding to an adjacent line connecting trajectory.

According to the technical scheme, when the touch track in the display screen comprises the character writing track and the line connecting track, characters recognized by the character writing track are displayed in the corresponding text boxes, and the connecting line generated by the line connecting track is connected with the adjacent text boxes, so that the connection relation is established for the touch track with the connection relation under the function of the electronic whiteboard, especially in a meeting scene, when a user needs to draw connection graphs such as a flow chart or an organizational chart, professional drawing software does not need to be started to draw, the connection graphs do not need to be led in, and the use experience of the user is improved.

On the basis of the above embodiment, the method further includes: and the first text box determining module is used for determining the text content corresponding to the character writing track before the characters identified from the character writing track are displayed in the text box, and selecting the corresponding text box according to the text content. The text box comprises at least one of a rectangular text box, a diamond text box and a rounded rectangular text box.

On the basis of the foregoing embodiment, the identification module 401 is specifically configured to: recognizing a touch track comprising a character writing track, a boundary track corresponding to the character writing track and a line connecting track in a display screen. Correspondingly, the method also comprises the following steps: and the text box second determining module is used for displaying the characters identified from the character writing tracks in the text box, and determining the corresponding text box according to the boundary track before connecting the text box with the connecting line generated by the connecting track corresponding to the adjacent lines.

On the basis of the foregoing embodiment, the identification module 401 specifically includes: the first recognition unit is used for recognizing a first touch track corresponding to a writing track of characters in the display screen; a second recognition unit, configured to recognize a second touch trajectory surrounding the first touch trajectory as a frame trajectory of the text writing trajectory; and the third identification unit is used for identifying the line type third touch track as a line connection track.

On the basis of the above embodiment, the method further includes: and the distance judgment module is used for displaying the characters identified from the character writing track in a text box, and confirming that the distance between the character writing track and the adjacent line connecting track is smaller than a distance threshold value before the text box is connected with the connecting line generated corresponding to the adjacent line connecting track.

On the basis of the above embodiment, the method further includes: the first adjusting module is used for counting the number of characters, adjusting the size information of the text box based on the number of the characters, or adjusting the font size information of the characters displayed in the text box based on the number of the characters.

On the basis of the above embodiment, the method further includes: a second adjusting module for adjusting the text box based on the touch operation for the text box.

On the basis of the foregoing embodiment, the second adjustment module is specifically configured to: if the touch operation is a pressing operation aiming at the frame line of the text box, adjusting the display shape of the text box; and/or if the touch operation is the dragging operation aiming at the frame line of the text frame, adjusting the length-width ratio of the text frame; and/or scaling the text box if the touch operation is a drag operation aiming at the vertex of the text box.

On the basis of the above embodiment, the method further includes: and the connection point adjusting module is used for changing the connection point of the corresponding connection line and the adjusted text box corresponding to the adjusted text box after the display shape of the text box is adjusted if the touch operation is the pressing operation aiming at the frame line of the text box. The connection points include the vertices of the adjusted text box or the midpoints of the border lines of the text box.

On the basis of the above embodiment, the method further includes: and the storage module is used for displaying the characters identified from the character writing tracks in a text box, connecting the text box with a connecting line generated corresponding to the adjacent line connecting track, and then storing the connected connecting graph into an editable graph format.

The graphic display device provided by the embodiment is used for executing the graphic display method provided by any embodiment, and has corresponding functions and beneficial effects.

EXAMPLE five

Fig. 14 is a schematic structural diagram of an apparatus according to a fifth embodiment of the present invention. As shown in fig. 14, the apparatus includes a processor 50, a memory 51, an input device 52, an output device 53, and a display 54; the number of processors 50 in the device may be one or more, and one processor 50 is taken as an example in fig. 14; the processor 50, the memory 51, the input device 52, the output device 53 and the display 54 in the apparatus may be connected by a bus or other means, and the bus connection is exemplified in fig. 14.

The memory 51 is a computer-readable storage medium for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the graphic display method according to any embodiment of the present invention (for example, the identification module 401 and the connection module 402 in the graphic display apparatus). The processor 50 executes various functional applications of the device and data processing, i.e., implements the above-described graphic display method, by executing software programs, instructions, and modules stored in the memory 51.

The memory 51 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory 51 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 51 may further include memory located remotely from the processor 50, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input device 52 is operable to receive input numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 53 may include audio equipment such as a speaker and a buzzer. The display screen 54 is used for displaying a touch trajectory including a text writing trajectory and a line connecting trajectory on the display screen, and is also used for receiving a touch operation.

The device provided by the embodiment can be used for executing the graphic display method provided by any embodiment, and has corresponding functions and beneficial effects.

EXAMPLE six

Embodiments of the present invention also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, perform a graphical display method, the graphical display method comprising:

Of course, the storage medium provided by the embodiment of the present invention includes computer-executable instructions, and the computer-executable instructions are not limited to the operations of the graphic display method described above, and may also perform related operations in the graphic display method provided by any embodiment of the present invention, and have corresponding functions and advantages.

From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes instructions for enabling a computer device (which may be a robot, a personal computer, a server, or a network device) to execute the graphic display method according to any embodiment of the present invention.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A graphical display method, comprising;

confirming that the distance between the character writing track and the adjacent line connecting track is smaller than a distance threshold value;

determining the text content corresponding to the text writing track, and selecting a corresponding text box according to the semantics or keywords corresponding to the text content;

displaying the characters identified from the character writing tracks in the text box, and connecting the text box with a connecting line generated corresponding to the adjacent line connecting tracks;

adjusting the text box based on the touch operation for the text box.

2. The graphic display method according to claim 1,

the text box comprises at least one of a rectangular text box, a diamond text box and a rounded rectangular text box.

3. The graphic display method according to claim 1, further comprising:

and counting the number of characters, and adjusting the size information of the text box based on the number of the characters, or adjusting the font size information of the characters displayed in the text box based on the number of the characters.

4. The graphic display method according to claim 1, wherein the adjusting the text box based on the touch operation for the text box comprises:

if the touch operation is a pressing operation aiming at the frame line of the text box, adjusting the display shape of the text box; and/or the presence of a gas in the gas,

if the touch operation is the dragging operation aiming at the text box frame line, adjusting the length-width ratio of the text box; and/or the presence of a gas in the gas,

and if the touch operation is a drag operation aiming at the vertex of the text box, zooming and adjusting the text box.

5. The graphic display method according to claim 4, further comprising, after adjusting a display shape of the text box if the touch operation is a press operation for the text box border line:

and changing the connection point of the corresponding connection line and the adjusted text box corresponding to the adjusted text box, wherein the connection point comprises the vertex of the adjusted text box or the middle point of the border line of the text box.

6. The graphic display method according to claim 1, wherein after the displaying the text recognized from the text writing trace in a text box and connecting the text box with a connecting line generated corresponding to an adjacent line connecting trace, further comprising:

and storing the connected graph obtained by connection into an editable graph format.

7. A graphic display device, comprising;

the distance judgment module is used for confirming that the distance between the character writing track and the adjacent line connecting track is smaller than a distance threshold value;

the first text box determining module is used for determining the text content corresponding to the writing track of the text and selecting the corresponding text box according to the semantics or the keywords corresponding to the text content;

the connecting module is used for displaying the characters identified from the character writing tracks in the text box and connecting the text box with the connecting lines generated corresponding to the adjacent line connecting tracks;

a second adjusting module for adjusting the text box based on the touch operation for the text box.

8. An apparatus, comprising:

a memory for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement a graphical display method as claimed in any one of claims 1 to 6.

9. A storage medium containing computer-executable instructions for performing the graphical display method of any one of claims 1-6 when executed by a computer processor.