CN108920057B

CN108920057B - Method, device, equipment and storage medium for controlling connection nodes of electronic whiteboard

Info

Publication number: CN108920057B
Application number: CN201810758671.2A
Authority: CN
Inventors: 陈天龙
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2018-07-11
Filing date: 2018-07-11
Publication date: 2021-04-06
Anticipated expiration: 2038-07-11
Also published as: CN108920057A

Abstract

The invention discloses a method, a device, equipment and a storage medium for controlling a connecting node of an electronic whiteboard, wherein an element selection operation is received, the element selection operation is used for selecting a target element, and the target element is a currently displayed user input element; displaying a connecting node adding button, wherein the connecting node adding button is determined according to the target element; receiving a button selection operation, the button selection operation acting on the connection node addition button; the connecting line generated aiming at the target element is displayed, and the connecting node is displayed on the connecting line, and the connecting node has the technical scheme of editability, so that the technical problems that an element connection establishing mode is too single and not flexible in the prior art can be solved. The method and the device have the advantages that the connecting nodes are added to the target elements, the specific types of the elements are not limited, the connecting nodes can be added to any element, the application range of the connecting nodes is expanded, and the use experience of a user is improved.

Description

Method, device, equipment and storage medium for controlling connection nodes of electronic whiteboard

Technical Field

The present invention relates to the field of electronic drawing technologies, and in particular, to a method, an apparatus, a device, and a storage medium for controlling a connection node of an electronic whiteboard.

Background

At present, various intelligent devices are widely applied to daily life and work of people. Generally, various types of application software are installed in the intelligent device to meet the actual requirements of people in different fields. For example, text editing software can meet writing and recording requirements of users, courseware editing software can meet teaching courseware making requirements of users, drawing editing software can meet drawing requirements of users, and the like.

Generally, for an editing application, a user can insert and display different types of elements, such as graphics, tables, etc., according to his actual needs during the use process. In the process of implementing the invention, the inventor finds that the prior art has the following defects: if a user wants to establish a connection relationship between two elements, the two elements must be graphs or tables, and meanwhile, the connection relationship can only be embodied through a connection line, so that the existing connection establishment mode of the elements is too single and not flexible enough.

Disclosure of Invention

In view of this, embodiments of the present invention provide a method, an apparatus, a device, and a storage medium for controlling a connection node of an electronic whiteboard, so as to solve the technical problem in the prior art that an element connection establishment method is too single and not flexible enough.

In a first aspect, an embodiment of the present invention provides a method for controlling a connection node of an electronic whiteboard, including:

receiving an element selection operation, wherein the element selection operation is used for selecting a target element, and the target element is a currently displayed user input element;

displaying a connecting node adding button, wherein the connecting node adding button is determined according to the target element;

receiving a button selection operation, the button selection operation acting on the connection node addition button;

and displaying a connecting line generated aiming at the target element, and displaying a connecting node on the connecting line, wherein the connecting node has editability.

Further, the displaying a connection line generated for the target element and after a connection node is displayed on the connection line, further includes:

receiving a node selection operation, the node selection operation acting on the connecting node;

popping up a node editing menu, wherein the node editing menu comprises a plurality of entrance controls, and each entrance control corresponds to a function;

receiving a function selection operation, wherein the function selection operation is used for selecting any entrance control;

and executing a target function aiming at the connecting node, wherein the target function corresponds to the selected entrance control.

Further, the entry control includes at least one of:

the system comprises an entrance control of a copying function, an entrance control of a cutting function, an entrance control of a pasting function, an entrance control of a multimedia adding function and an entrance control of a remarking adding function.

Further, the function selecting operation selects an entry control of the add multimedia function;

the performing a target function for the connecting node comprises:

displaying a file selection window, wherein the file selection window comprises at least one multimedia file to be selected;

receiving a file selection operation, wherein the file selection operation is used for selecting any at least one multimedia file;

in the connecting node, file identifications are displayed, which correspond to the selected multimedia files.

Further, after the file identifier is displayed in the connection node, the method further includes:

receiving a file editing operation;

and editing the file identification according to the file editing operation.

Further, the file editing operation includes: file identification renaming operation and/or file identification arrangement position adjusting operation.

receiving an identification selection operation, wherein the identification selection operation is used for selecting any file identification;

creating a new display window;

displaying a target multimedia file in the new display window, wherein the target multimedia file is a multimedia file corresponding to the selected file identifier;

receiving a file playing operation;

and playing the target multimedia file.

Further, the target multimedia file comprises a plurality of sub multimedia files;

the displaying the target multimedia file in the new display window comprises:

according to the arrangement sequence of the plurality of sub multimedia files, taking the sub multimedia file positioned at the forefront as the current sub multimedia file and displaying the current sub multimedia file in a new display window;

receiving a backward page turning instruction;

updating a next sub multimedia file positioned in the current sub multimedia file into the current sub multimedia file according to the arrangement sequence, and displaying the current sub multimedia file in a new display window;

receiving a forward page turning instruction;

and updating the previous sub multimedia file positioned in the current sub multimedia file into the current sub multimedia file according to the arrangement sequence, and displaying the current sub multimedia file in a new display window.

Further, when the target multimedia file is displayed in the new display window, the method further includes:

and displaying the total page number of the sub multimedia files and the page number corresponding to the current sub multimedia file.

Further, after the playing the target multimedia file, the method further includes:

receiving annotation operation;

adding annotation content in the target multimedia file, wherein the annotation content is determined according to annotation operation

Further, the function selecting operation selects the entry control for adding the remark function;

the performing a target function for the connecting node comprises:

displaying a remark input box;

receiving a remark input operation, and confirming remark content according to the remark input operation;

and displaying a remark icon in the connection node.

Further, after the displaying the remark icon in the connection node, the method further includes:

receiving a remark icon selection operation;

and displaying the remark content.

confirming that at least one element corresponding to the connecting node is in an undisplayed state;

and hiding and displaying the connecting line and the connecting node.

receiving a target element movement operation;

moving the target element;

and updating the position layout of the connecting lines and the connecting nodes.

receiving a target element deleting instruction;

deleting the target element;

and deleting all connecting lines and all connecting nodes corresponding to the target elements.

Further, the displaying a connection node addition button includes:

and confirming that the number of the target elements is less than or equal to the set number, and displaying a connecting node adding button.

Further, the number of the target elements is two,

the displaying a connection line generated for the target element and having a connection node displayed on the connection line includes:

determining the position layout of connecting lines and connecting nodes according to the display position of the target element;

and displaying the connecting lines and the connecting nodes according to the position layout.

The number of the target elements is one,

receiving a position selection operation;

confirming the end position according to the position selection operation;

determining the position layout of connecting lines and connecting nodes according to the display position and the end point position of the target element;

In a second aspect, an embodiment of the present invention further provides a connection node control device for an electronic whiteboard, including:

a first receiving module, configured to receive an element selection operation, where the element selection operation is used to select a target element, and the target element is a currently displayed user input element;

the first display module is used for displaying a connecting node adding button, and the connecting node adding button is determined according to the target element;

a second receiving module, configured to receive a button selection operation, where the button selection operation acts on the connection node addition button;

and the second display module is used for displaying the connecting line generated aiming at the target element, and displaying a connecting node on the connecting line, wherein the connecting node has editability.

Further, the method also comprises the following steps:

a third receiving module, configured to receive a node selection operation after a connection line generated for the target element is displayed and a connection node is displayed on the connection line, where the node selection operation acts on the connection node;

the third display module is used for popping up a node editing menu, the node editing menu comprises a plurality of entrance controls, and each entrance control corresponds to a function;

a fourth receiving module, configured to receive a function selection operation, where the function selection operation is used to select any entry control;

and the function execution module is used for executing a target function aiming at the connecting node, and the target function corresponds to the selected entrance control.

In a third aspect, an embodiment of the present invention further provides a connection node control device for an electronic whiteboard, including: a memory, a display screen, and one or more processors;

the memory for storing one or more programs;

the display screen is used for displaying a connecting node adding button, a connecting line generated aiming at the target element and a connecting node positioned on the connecting line;

when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the method for controlling a connection node of an electronic whiteboard according to the first aspect.

In a fourth aspect, embodiments of the present invention further provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the method for controlling a connection node of an electronic whiteboard according to the first aspect.

The method, the device, the equipment and the storage medium for controlling the connecting nodes of the electronic whiteboard, which are provided by the above, realize the addition of the connecting nodes for the target elements by receiving the element selection operation acting on the target elements, displaying the connecting node adding buttons according to the target elements selected by the element selection operation, receiving the button selection operation acting on the connecting node adding buttons, and displaying the connecting lines and the connecting nodes generated aiming at the target elements according to the button selection operation, are not limited to the specific types of the elements, can ensure the addition of the connecting nodes for any elements, expand the application range of the connecting nodes, improve the use experience of users, and simultaneously realize the multi-functionalization of the connection relationship by setting the connecting nodes and editing the connecting nodes, such as adding multimedia files or remarks, playing multimedia files or remarks, the display content is enriched.

Drawings

Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments made with reference to the following drawings:

fig. 1 is a flowchart of a method for controlling a connection node of an electronic whiteboard according to an embodiment of the present invention;

FIG. 2 is a content diagram of elements that may be entered;

FIG. 3 is a first schematic view of a display interface;

FIG. 4 is a second schematic view of a display interface;

FIG. 5 is a third schematic view of a display interface;

FIG. 6 is a fourth diagram of a display interface;

fig. 7 is a flowchart of a method for controlling a connection node of an electronic whiteboard according to a second embodiment of the present invention;

FIG. 8 is a fifth diagram of a display interface;

FIG. 9 is a sixth schematic view of a display interface;

FIG. 10 is a seventh schematic view of a display interface;

FIG. 11 is an eighth schematic view of a display interface;

FIG. 12 is a ninth diagram of a display interface;

FIG. 13 is a tenth schematic view of a display interface;

FIG. 14 is an eleventh schematic view of a display interface;

FIG. 15 is a twelfth schematic view of a display interface;

FIG. 16 is a thirteenth schematic view of a display interface;

FIG. 17 is a fourteenth schematic diagram of a display interface;

FIG. 18 is a fifteenth schematic view of a display interface;

FIG. 19 is a sixteenth schematic view of a display interface;

FIG. 20 is a seventeenth schematic view of a display interface;

FIG. 21 is an eighteenth schematic view of a display interface;

fig. 22 is a schematic structural diagram of a connection node control device of an electronic whiteboard according to a third embodiment of the present invention;

fig. 23 is a schematic structural diagram of a connection node control device of an electronic whiteboard according to a fourth embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings.

Example one

Fig. 1 is a flowchart of a method for controlling a connection node of an electronic whiteboard according to an embodiment of the present invention. The connection node control method of the electronic whiteboard provided in the embodiments may be executed by a connection node control device of the electronic whiteboard, where the connection node control device of the electronic whiteboard may be implemented in a software and/or hardware manner, and the connection node control device of the electronic whiteboard may be formed by two or more physical entities, or may be formed by one physical entity. Generally, the connection node control device of the electronic whiteboard has an electronic whiteboard function, and may be a computer, a mobile phone, a tablet, an intelligent interactive tablet, or the like.

For convenience of understanding, in the embodiment, the intelligent interactive tablet is taken as a connection node control device of the electronic whiteboard for exemplary description. The intelligent interactive panel can be an integrated device which controls the content displayed on the display panel and realizes man-machine interaction operation through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound box, a television, a video conference terminal and the like. In general, the display screen of the smart interactive tablet may be a capacitive screen, a resistive screen, or an electromagnetic screen. The user can perform touch operation on the intelligent interaction panel through a finger or a touch pen.

Furthermore, the intelligent interactive tablet is provided with application software carried by an operating system, and simultaneously is also provided with application software downloaded from a third-party device or a server, wherein the specific type and content of the application software can be set according to actual conditions, and generally, the application software has an electronic whiteboard function, and can be realized through the electronic whiteboard function: writing, drawing, commenting, courseware making, displaying and playing. The electronic whiteboard function set in the embodiment has an element drawing and editing function. The elements are elements which can be displayed after a certain operation is input by a user in the intelligent interactive tablet, and have occupation space and editability. For example, fig. 2 is a schematic content diagram of elements that can be input, and referring to fig. 2, an element column 10 indicates elements that can be currently input by a user, which includes: text, graphical shapes, multimedia, forms, classroom activities, mind maps, pinyin, chinese characters, and subject tools. The discipline tool can be a function editor, a formula and the like. It is understood that the specific contents of the toolbar 10 can be set and changed according to practical situations, and the embodiment is not limited thereto. Further, the embodiment of the specific generation mode of the element is not limited. In this embodiment, at least one element that has been displayed in application software is used as a scene for description. Generally, application software is provided with an operation window through which a user can perform operations such as drawing, inserting, and editing elements.

Specifically, referring to fig. 1, the method specifically includes:

and S110, receiving an element selection operation, wherein the element selection operation is used for selecting a target element, and the target element is a currently displayed user input element.

In general, a target element refers to an element that is currently displayed and selected by an element selection operation, which has an arbitrary nature. Specifically, the specific type of the element is not limited, and may be any type of element, such as an image, an editable graph, a table, a histogram, audio, video, a text box, multimedia, a character, a function editor, a mind map, a geometric figure, a formula, and the like, that is, the target element is a currently displayed user input element, and may be any type of element. The target element may be one or more, and the embodiment is not limited thereto.

Specifically, the embodiment of the specific receiving mode of the element selecting operation is not limited. For example, when it is detected that one or more elements receive a click operation, it is determined that an element selection operation is received, and the element receiving the click operation is determined as a target element. The user can click the element by using a finger or a touch pen in a touch manner, so that the intelligent interaction panel receives the element selection operation. Or, the user may click the element in a key manner through an external device connected to the smart interactive tablet, so that the smart interactive tablet receives the element selection operation. The external device includes, but is not limited to, a mouse, etc. In the embodiment, a mode of mouse key control will be described as an example. It should be noted that, in the embodiment, other operations besides the element selection operation may also be performed in a touch or key manner, and all the operations are described by taking a mouse key manner as an example. Optionally, after receiving the element selection operation, the target element may be highlighted to prompt the user that the element selection was successful. The specific rule embodiment highlighted is not limited.

And S120, displaying a connecting node adding button, wherein the connecting node adding button is determined according to the target element.

Specifically, after the element selection operation is received, a display connection node addition button is set to prompt the user whether to add a connection node. The connection node is a connection node located on the connection line when the connection relationship is established for the target element. The connecting node has editability and has functions of adding multimedia, remarking and the like so as to enrich the functional characteristics of the connection relation.

Further, the specific display position and display form embodiment of the connection node adding button is not limited. For example, a virtual key indicating a connected node addition button is displayed at a set position around the target element.

Optionally, since multiple connection relationships may be determined among at least three target elements, which may cause a situation that the smart interactive tablet may not clearly specify the connection relationship that the user desires to establish, in the embodiment, it is set that, when the number of the target elements is 1 or 2, the connection node addition button is displayed.

Alternatively, the connection node establishment mode may be preset, for example, a button of the connection node mode is displayed in a screen, when it is detected that the button is clicked, it is confirmed that the connection node establishment mode is entered, and then, after an element selection operation is received, it is confirmed that a connection node addition button is displayed. For another example, the button for setting the connection node mode is canceled, and when an element selection operation is received, the connection node establishment mode is entered by default, and at this time, not only the connection node addition button but also the exit button are displayed. And when the exit button is detected to be clicked, confirming that the connection node establishment mode exits, and canceling the display of the connection node adding button.

And S130, receiving a button selection operation, wherein the button selection operation is used for adding a button to the connection node.

Specifically, the button selection operation is sent by the user and is used for instructing the intelligent interactive tablet to add the connection node. The specific receiving form of the button selection operation is not limited. For example, it is determined that a button selection operation is received after the connected node addition button is detected to be clicked.

And S140, displaying the connecting line generated aiming at the target element, and displaying a connecting node on the connecting line, wherein the connecting node has editability.

Illustratively, upon receiving a button selection operation, it is confirmed to enter a connected node drawing mode, and thereafter, a connected line and a connected node generated for the target element are displayed. The connecting line refers to a line generated for the target element and used for indicating the connection relation of the target element. Generally, a connection node is displayed on the connection line, and the display position and display mode of the connection node are not limited. Optionally, one or more connection nodes on the same connection line may be provided, and in the embodiment, one is taken as an example for description.

Specifically, the calculation mode of the position layout of the connecting line may be set according to the actual situation. Wherein. The position layout of the connecting lines refers to the position layout of pixel points for displaying the connecting lines in the screen. The connecting line can be a curve or a broken line, and the specific display shape and parameters can be set according to the actual situation.

For example, when the number of the target elements is 1, the position layout of the connecting line may be such that the position of the target element is a starting position, the current position of the mouse is an ending position, a curve connecting the starting position and the ending position is calculated, and the curve is used as the connecting line. Wherein the radian of the curve can be preset. The start and end positions may be considered pixel point positions. In general, since the target element is displayed by a plurality of pixel points, its position is not unique. Therefore, the starting point position may be the center position of the circumscribed rectangle where the target element is located, or may be the position of the pixel point closest to the end position in the target element. In an embodiment, the preferred starting point position is a central position of a circumscribed rectangle in which the target element is located. The circumscribed rectangle refers to the smallest rectangle that contains the target element. Further, when the end point position is determined, whether an element exists in the current position of the mouse cursor is determined through a hit test, if the element exists in the current position of the mouse cursor, whether the element and the target element are the same element is determined, if the element is not the same element, the position where the element is located is used as the end point position, and at the moment, the calculation mode of the end point position is the same as that of the start point position. If the element is the same, it is confirmed that the connection line is not generated. Further, if no element exists in the current position of the mouse cursor, the current position of the mouse cursor is directly used as the end point position. For another example, when the number of the target elements is 2, the positions of the two target elements are directly used as the starting position and the ending position, respectively. The starting position and the ending position are calculated in the same manner. Furthermore, when the connecting lines are displayed according to the position layout of the connecting lines, arrows can be added to the connecting lines. The arrow direction may have a starting point position pointing to an ending point position to indicate a particular connection.

Typically, after the connecting line is determined, a connecting node is added to the connecting line, and the related information of the connecting node is recorded in the connecting node list. The connection node list records the relevant information of all the connection nodes of the current display page. Further, the related information includes, but is not limited to: node number, node position, and element corresponding to the node, etc. Wherein, if the connecting wire at connected node place only has one end to have the element, then, the element that the node corresponds has one, if the both ends of the connecting wire at connected node place all have the element, then, the element that the node corresponds has two. Generally, the connecting lines and the connecting nodes are displayed simultaneously or disappear simultaneously, and the display and the disappearance of the connecting lines and the connecting nodes depend on their corresponding elements. For example, when the display position of the element corresponding to the node is changed, the positional layout of the connection line and the connection node is changed in synchronization. For another example, when at least one element corresponding to a node is deleted, the connecting line and the connecting node disappear in the screen in synchronization.

Optionally, the specific numerical value of the display parameter of the connection node and the connection line is not limited. The display parameters of the connection node include, but are not limited to: node box size, node name, color of the node box, color of the box interior, etc. The display parameters of the connecting line include, but are not limited to: line color, line thickness, line type, and the like.

Further, after the connection node is displayed in the connection line, it is confirmed that the connection node is added to the target element. At this time, the user can edit the connection node according to the actual requirement of the user. For example, adding multimedia files in a connecting node, adding notes to a connecting node, copying a connecting node, cutting a connecting node, etc. Furthermore, when the multimedia file is added to the connection node, the user can selectively play the multimedia file according to the actual requirement.

According to the technical scheme provided by the embodiment, the connecting node is added to the target element without being limited to the specific type of the element by receiving the element selection operation acting on the target element, displaying the connecting node adding button according to the target element selected by the element selection operation and receiving the button selection operation acting on the connecting node adding button and displaying the connecting line and the connecting node generated aiming at the target element according to the button selection operation, so that the connecting node can be ensured to be added to any element, the application range of the connecting node is expanded, and the use experience of a user is improved.

On the basis of the above embodiment, it is considered that there is a case where an element corresponding to the connection node may be hidden in practical application. Therefore, in the embodiment, after setting and displaying the connection line generated for the target element and displaying the connection node on the connection line, the method further includes:

s150, confirming that at least one element corresponding to the connecting node is in an undisplayed state.

Specifically, the element corresponding to the connection node may be understood as an element corresponding to a node recorded in the connection node list. The element is in the non-display state, which means that the element is not displayed in the current screen due to some factors, and it can also be understood that the element is hidden. In general, an element is not deleted when it is hidden. Further, the specific generation mode of the non-display state can be set according to the actual situation. For example, when an element is completely covered by another element, it is confirmed that the element is in an undisplayed state. In another example, when an element is set to transparency of 100 or a hidden element is selected, the element is confirmed to be in an undisplayed state. For another example, during the showing process, two elements of a certain connection node have a sequential display order, and at this time, when the first element is displayed, the second element is in a non-display state.

Further, the smart interactive tablet detects all current elements in real time to confirm whether the elements are in an undisplayed state. And traversing the connection node list to confirm whether the element has a corresponding connection node or not after confirming that the element is in the undisplayed state. And if the corresponding connection node exists, acquiring all the connection nodes corresponding to the element, and confirming the connection line where the connection node is located.

And S160, hiding the display connecting line and the connecting node.

Illustratively, all connecting lines and connecting line nodes corresponding to elements in an undisplayed state are set to be hidden and displayed, so that synchronous hiding of the elements and the connecting nodes is realized. The specific embodiment of the hidden display is not limited. For example, the transparency of the connection node and the connection line is set to 100. As another example, the connection nodes and the connection lines are placed on the bottom layer to cover the connection nodes and the connection lines by other elements. It should be noted that, at this time, the connection line and the connection node are not deleted, and the connection node can still be found in the connection node list.

Optionally, when the elements in the non-display state are restored to the display state, the connecting lines and the connecting nodes may be displayed again. The embodiment of the specific method for restoring the element to the display state is not set. For example, the element is set to be at the topmost layer, and at this time, the smart interactive tablet detects all current elements in real time to confirm whether any element changes from the non-display state to the display state. And traversing the connection node list after the element is confirmed to be changed into the display state so as to confirm whether the element has a corresponding connection node. And if the corresponding connection nodes exist, acquiring all the corresponding connection nodes, selecting the connection nodes of which the corresponding elements of the nodes are all in the display state from all the corresponding connection nodes, and displaying the selected connection nodes and the connection lines.

For example, fig. 3 is a first schematic diagram of a display interface. Wherein a connection line 14 and a connection node 15 are established between the element 11 and the element 12, a connection line 16 and a connection node 17 are established between the element 12 and the element 13, and a connection line 18 and a connection node 19 are also established between the element 13. Further, the element 11 is changed to the non-display state, and at this time, the display interface becomes fig. 4. FIG. 4 is a second schematic view of a display interface. Referring to fig. 4, when the element 11 is hidden, the connection line 14 and the connection node 15 corresponding to the element 11 are also hidden. Further, the connecting line 14 and the connecting line 15 can be displayed in the screen synchronously after the element 11 is displayed on the screen again. At this point, the display interface is changed back to fig. 3.

On the basis of the above embodiment, it is considered that there is a case where the element corresponding to the connection node may be moved in the actual application. Therefore, in the embodiment, after setting and displaying the connection line generated for the target element and displaying the connection node on the connection line, the method further includes:

and S170, receiving a target element moving operation.

The movement operation refers to an operation of moving the display position of the element. The specific operation mode can be set according to the actual situation. For example, when it is detected that a certain element receives a drag operation, it is confirmed that a move operation for the element is received. It should be noted that, in practical applications, the moving operation may be directed to any one element or multiple elements currently displayed, and the embodiment is convenient to describe, taking the moving operation directed to the target element as an example.

And S180, moving the target element.

Specifically, the end position of the movement of the target element may be determined according to the end position of the movement operation. For example, the end position of the move operation is set as the center point position of the circumscribed rectangle of the target element, and the target element is moved to the end position.

And S190, updating the position layout of the connecting lines and the connecting nodes.

For example, the smart interactive tablet detects whether there is an element being moved currently in real time, or automatically acquires an element movement event when an element is moved. Furthermore, after the elements are confirmed to be moved, a refreshing event of the connecting nodes is triggered, and the position layout of the connecting nodes and the connecting lines corresponding to the moved elements is refreshed.

Specifically, taking a moving target element as an example, further, after it is determined that the target element is moved, traversing the connection node list to determine all connection nodes corresponding to the target element. And then, recalculating the position layout of the connecting lines and the connecting nodes according to the moved position of the target element and the position of the other end of the connecting line where the connecting nodes are located, so as to update the display positions of the connecting lines and the connecting nodes according to the calculated position layout, and further realize that the connecting nodes move synchronously along with the target element. The other end position of the connecting line refers to the position of one end of the non-moving element. The positional layout of the connecting lines and the connecting nodes is calculated in the same manner as when the positional layout of the connecting lines and the connecting nodes is generated. When the display position of the target element is changed, it is considered that the position of one end of the connecting line connected to the target element is changed, and the position of the other end of the connecting line is not changed.

For example, fig. 3 is a first schematic diagram of a display interface. Wherein element 13 is the target element. Further, a moving operation for the element 13 is received, and the display position of the element 13 is updated according to the moving operation. At this time, the display interface becomes fig. 5. FIG. 5 is a third schematic view of a display interface. Referring to fig. 5, when the display position of the element 13 is updated, the position layouts of the connection line 16, the connection node 17, the connection line 18, and the connection node 19 corresponding to the element 13 are updated synchronously.

On the basis of the above embodiment, it is considered that there is a case where an element corresponding to the connection node may be deleted in an actual application. Therefore, in the embodiment, after setting and displaying the connection line generated for the target element and displaying the connection node on the connection line, the method further includes:

s1100, receiving a target element deleting instruction.

The deleting operation refers to an operation of deleting a certain element in the display interface. The specific operation mode can be set according to the actual situation. For example, when an element is detected to receive a double-click operation, it is confirmed that a deletion operation for the element is received. For another example, after detecting a double-click operation on a certain element, pop up a menu list of the element, and confirm that a deletion option in the menu list is clicked, confirm that a deletion operation on the element is received. Wherein, the menu list may further include: copy, paste, cut, display format, etc. It should be noted that, in practical applications, the deletion operation may be directed to any one element or multiple elements currently displayed, and the embodiment is convenient to describe, taking the deletion operation directed to the target element as an example.

And S1110, deleting the target element.

Specifically, the target element is deleted in the display interface. The specific implementation manner of deletion is not limited in the embodiments.

And S1120, deleting all connecting lines and all connecting nodes corresponding to the target element.

For example, the smart interactive tablet detects whether an element is deleted currently in real time, or when the element is deleted, the smart interactive tablet automatically acquires an element deletion event. Further, after the element is deleted, whether a connection node corresponding to the element exists is determined, and if the connection node exists, the connection node and a connection line where the connection node is located are deleted synchronously, so that the connection node is deleted synchronously along with the element.

Specifically, taking the deletion of the target element as an example, further, after the target element is confirmed to be deleted, the connection node list is traversed to determine all connection nodes corresponding to the target element. And then, removing the related information of all the connection nodes corresponding to the target element in the connection node list. And simultaneously, deleting the connecting node and the connecting line in the display interface.

For example, fig. 3 is a first schematic diagram of a display interface. Wherein element 12 is the target element. Further, a deletion operation for the element 12 is received, and the element 12 in the display interface is deleted according to the deletion operation. At this time, the display interface becomes fig. 6. FIG. 6 is a fourth diagram of a display interface. Referring to fig. 6, when the element 12 is deleted, the connecting line 14, the connecting node 15, the connecting line 16, and the connecting node 17 corresponding to the element 12 are deleted in synchronization.

Example two

Fig. 7 is a flowchart of a method for controlling a connection node of an electronic whiteboard according to a second embodiment of the present invention. The present embodiment is embodied on the basis of the above-described embodiments. Specifically, referring to fig. 7, the method for controlling a connection node of an electronic whiteboard according to the embodiment specifically includes:

and S210, receiving element selection operation.

Wherein the element selection operation is used to select a target element, which is a currently displayed user input element.

S220, whether the number of the target elements is smaller than or equal to the set number is confirmed. And if the number of the confirmed target elements is larger than the set number, ending the operation. If the number of the confirmation target elements is less than or equal to the set number, S230 is performed.

Specifically, the set number is the maximum number of elements required to generate the connection relationship. In the embodiment, the connection node is used to be added between two elements or to be added for only one element, and therefore, the value of the number is set to 2 in the embodiment.

Further, after the element selection operation is received, the selected target elements are determined, then the number of the target elements is determined, if the number of the target elements is greater than 2, it is determined that the connection nodes cannot be added to the target elements, that is, the connection relationship cannot be established, and at this time, the operation is ended. Optionally, after finishing the operation, the user may be prompted to reselect target elements no greater than 2. If the number of the target elements is less than or equal to 2, it is determined that a connection node can be added to the target element, and at this time, S230 is performed.

And S230, displaying a connecting node adding button.

Wherein the connection node adding button is determined according to the target element.

And S240, receiving a button selection operation.

Wherein the button selection operation acts on the connected node addition button.

And S250, displaying a connecting line generated aiming at the target element, and displaying a connecting node on the connecting line.

Wherein the connecting node has editability.

In particular, as can be seen from the foregoing, the number of target elements may be one or two. Therefore, when calculating the position layout of the connecting lines and the connecting nodes in the embodiment, two cases can be distinguished. The method comprises the following specific steps:

when the number of target elements is two, this step may specifically include S251-S252:

and S251, determining the position layout of the connecting lines and the connecting nodes according to the display position of the target element.

Specifically, when there are two target elements, the display positions of the two target elements are determined. The display position refers to the position of the center point of the circumscribed rectangle of the element. Further, according to the selection sequence of the two target elements, the display position of the target element selected first is used as a starting position, the display position of the target element selected later is used as an end position, and a connecting node is determined to be generated. Then, the position layout of the connecting line connecting the start position and the end position is calculated depending on the start position and the end position. The specific calculation method can be set according to actual conditions. For example, an arc line connecting the start position and the end position is drawn using preset arc parameters, and the arc line position is determined as the position layout of the connecting line. Further, after the position layout of the connecting line is determined, the position layout of the connecting node, that is, the display position of the connecting node on the connecting line, is determined. The position layout of the connection nodes may be set according to actual conditions, for example, the midpoint position of the connection line is used as the center point position of the circumscribed rectangle of the connection nodes, and then the position layout of the connection nodes is obtained.

Optionally, after determining the position layouts of the connection lines and the connection nodes, recording the relevant information of the connection nodes into a connection node list.

And S252, displaying the connecting lines and the connecting nodes according to the position layout.

Specifically, after the position layout of the connecting lines and the connecting nodes is determined, the connecting lines and the connecting nodes are displayed in a display interface according to the position layout. In general. The display hierarchy of the connecting line is lower than the display hierarchy of the target element.

When the number of target elements is one, this step may specifically include S253-S256:

and S253, receiving position selection operation.

Specifically, the position selecting operation refers to an operation for selecting an end position. The specific receiving mode embodiment is not limited. For example, after receiving the button selection operation, if it is determined that any display position of the display interface receives the click operation, it is confirmed that the position selection operation is received.

Optionally, in the process that the user selects the end point position, the smart interactive tablet may display a mouse cursor in the display interface, so that the user specifies the end point position to be currently selected.

And S254, confirming the end position according to the position selection operation.

Specifically, the position of the pixel point receiving the position selection operation is determined, and the position of the pixel point is used as the end point position. Here, the end position may be regarded as an end position of the connection line.

Further, if the end point position has an element, the element is determined as the selected element, and the position of the center point of the circumscribed rectangle of the element is determined as a new end point position. And if the element is the same as the target element, confirming that the operation is invalid. Optionally, after the operation is determined to be invalid, the user may be prompted to reselect the end point position. If no element is present at the end position, the end position is selected directly.

And S255, determining the position layout of the connecting lines and the connecting nodes according to the display position and the end point position of the target element.

Specifically, the position of the central point of the circumscribed rectangle of the target element is determined according to the display position of the target element, the position of the central point is determined as a starting point position, and then the position layout of the connecting line and the connecting node is determined according to the starting point position and the end point position. The calculation method of the position layout of the connecting lines and the connecting nodes is the same as that in S251, and is not described herein again. Optionally, after determining the position layouts of the connection lines and the connection nodes, recording the relevant information of the connection nodes into a connection node list.

Optionally, before receiving the position selection operation, it may be determined whether an element exists in the position through a hit test according to the position of the mouse cursor in real time, and if the element exists, the element is set to the selected state. And if the mouse cursor moves out of the position of the element, canceling the selected state of the element. The selected state is used for prompting the user of the currently selected element, and a specific display rule of the selected state can be set according to an actual situation, for example, a circumscribed rectangle of the displayed element, so as to determine that the element is the selected state.

Optionally, before receiving the position selection operation, the position where the mouse cursor is located may be used as an end position in real time to generate and display the connection line in real time, and at this time, the generated connection line may be regarded as a preview line of the connection node to prompt the user of a specific shape of the connection line that can be generated based on the current position of the mouse cursor.

For example, fig. 8 is a fifth schematic view of a display interface. Referring to fig. 8, the element 21 in the display interface is determined as the target element according to the element selection operation. At the same time, it is confirmed that the current position of the mouse cursor is located on the element 22, and at this time, the element 22 is determined to be in the selected state, and the preview line 23 generated based on the element 21 and the element 22 is displayed. For another example, fig. 9 is a sixth schematic diagram of a display interface. Referring to fig. 9, the element 21 in the display interface is determined as the target element according to the element selection operation. Meanwhile, it is confirmed that the current position of the mouse cursor is located at the position 24 and there is no element at the position 24, a preview line 25 generated based on the element 21 and the position 24 is displayed to prompt the user for a connection line position layout.

And S256, displaying the connecting lines and the connecting nodes according to the position layout.

Taking fig. 8 as an example, when it is determined that the position selection operation is applied to the position of the element 22, the connection line and the connection node are generated based on the

elements

21 and 22 and displayed. At this time, the display interface becomes fig. 10. Fig. 10 is a seventh schematic view of the display interface. Referring to fig. 10, a connection line 26 and a connection node 27 are added between the

elements

21 and 22.

And S260, receiving node selection operation.

Wherein the node selection operation acts on the connecting node.

Specifically, after the connection nodes are displayed, the user can edit the connection nodes according to the actual requirements of the user. At this time, the intelligent interactive tablet can determine that the user needs to edit the connection node through the receiving node selection operation. Further, the specific receiving mode of the node selection operation can be set according to the actual situation. For example, after a certain connection node is determined to receive a click operation, the connection node is determined to be selected, and then, if a key-in signal of a right mouse button is received, the node selection operation is determined to be received.

And S270, popping up a node editing menu.

The node editing menu comprises a plurality of entrance controls, and each entrance control corresponds to one function. Specifically, the node edit menu may be understood as a control list, where each control in the control list may be regarded as an entry control, and when the entry control is selected, the entry control is determined to call a function corresponding to the entry control.

For example, the current display interface is as shown in fig. 10, and further, when it is confirmed that the node selection operation is received, the display interface becomes fig. 11. At this time, fig. 11 is an eighth schematic view of the display interface. Referring to fig. 11, a node edit menu 28 pops up at an arbitrary position in the periphery of the connection node 27.

Optionally, the entry control comprises at least one of: the system comprises an entrance control of a copying function, an entrance control of a cutting function, an entrance control of a pasting function, an entrance control of a multimedia adding function and an entrance control of a remarking adding function. And the entrance control of the copy function calls the copy function to copy the connection node when the entrance control is selected. And the entry control of the shearing function indicates that when the entry control is selected, the shearing function is called to shear the connection node. And the entry control of the paste function indicates that when the entry control is selected, the paste function is called to paste the connection node. The entry control for adding the multimedia function means that when the entry control is selected, the multimedia file is added in the connection node. The entry control for adding the remark function indicates that when the entry control is selected, the remark is added in the connection node.

It should be noted that, in addition to popping up the node editing menu, in practical applications, different node editing functions may also be started through other setting manners. For example: and after the connecting node receives the double-click operation, determining to enter the character editing function of the connecting node, and editing characters displayed in the connecting node. For example, when the display of the connection node is set, the text displayed in the default connection node is "connection node". At this time, the user can call up the character editing function by executing the double-click operation, and further modify the characters displayed in the connection node.

And S280, receiving function selection operation.

Wherein the function selection operation is for selecting any of the entry controls.

Specifically, when the intelligent interactive tablet determines that any entrance control in the node editing menu receives a click operation, it is determined that a function selection operation is received, and the entrance control receiving the click operation is recorded as a target entrance control.

S290, executing target functions aiming at the connection nodes.

And the target function corresponds to the selected entrance control.

Illustratively, the function that the target entry control can call is determined and noted as the target function. Furthermore, the intelligent interactive panel responds to the target function to realize the calling of the function.

Specifically, in the embodiment, the target entry control is taken as an entry control for adding a multimedia function or an entry control for adding a remark function, and the execution of the target function is described in detail.

When the function selecting operation selects the entry control for adding the multimedia function, S290 specifically includes S291-S293:

and S291, displaying a file selection window.

The file selection window comprises at least one multimedia file to be selected.

Specifically, the file selection window is a display window of a certain set folder, and when it is determined that the entry control for adding the multimedia function is selected, the display window of the set folder is popped up in the current display interface. Wherein, the setting folder comprises at least one multimedia file. Each multimedia file can be selected by the user, and therefore, the multimedia files included in the folder can also be marked as the multimedia files to be selected.

The specific display mode and display position of the file selection window are not limited. For example, fig. 12 is a ninth schematic view of the display interface. Referring to fig. 12, the multimedia files to be selected are listed in the file selection window 29, and the file selection window 29 is located above the connecting lines, the connecting nodes and the elements, i.e., the file selection window 29 has the highest display level.

Optionally, if the setting folder corresponding to the currently displayed file selection window is not the folder that the user wishes to open, the user may replace the setting folder, where a specific replacement method embodiment is not limited.

S292, receiving a file selection operation.

Wherein the file selection operation is for selecting any at least one multimedia file.

Specifically, if it is detected that any multimedia file in the file selection window receives a click operation, it is determined that a file selection operation is received, and it is determined that the multimedia file is selected by the file selection operation. Alternatively, the user may select at least one multimedia file at a time. When a plurality of multimedia files need to be selected, the intelligent interaction panel determines that long-press operation is received in the file selection window, and the mouse cursor moves in the long-press process, so that the plurality of multimedia files covered by the mouse cursor can be considered as the selected multimedia files in the moving process of the intelligent interaction panel.

And S293, displaying the file identification in the connection node.

Wherein the file identification corresponds to the selected multimedia file.

Specifically, after the multimedia file is selected, the file name and the path of the multimedia file are determined, a file identifier is further generated, and the file identifier of the multimedia file is displayed on the connecting node. Wherein, the file identification may include: the file type of the multimedia file and the file name of the multimedia file. Optionally, specific display parameters of the file identifier, such as font, color, size, etc., may be set according to actual conditions.

For example, fig. 13 is a tenth schematic diagram of the display interface. Fig. 13 is a schematic view of a display interface after editing the connection node 27 in fig. 10. Referring to fig. 13, three file identifiers are contained in the connecting node 27. The first indicator 2701 is a multimedia file of an audio type, and the file name of the multimedia file is: AAA. The second identifier 2702 is a multimedia file of a picture type, and the file name of the multimedia file is: BBB. The third indicator 2703 is a multimedia file of a video type, and the file name of the multimedia file is: CCC.

Furthermore, after the connecting node is edited, that is, the file identifier of the multimedia file is added to the connecting node, the file identifier can be further edited. Specifically, after S293, S294 to S295 may be further included:

s294, receiving a file editing operation.

The file editing operation refers to an operation of editing a file identifier. In an embodiment, setting the file editing operation includes: file identification renaming operation and/or file identification arrangement position adjusting operation. And the receiving modes corresponding to different file identification operations are different. For example, when the mouse cursor is detected to be floating on a certain file identifier, a renaming button is displayed, and after the renaming button is confirmed to be clicked, the file identifier renaming operation is determined to be received. For another example, when it is detected that a certain file identifier receives a dragging operation, it is determined that a file identifier arrangement position adjustment operation is received.

And S295, editing the file identification according to the file editing operation.

For example, upon receiving a file identification rename operation, a text edit box is displayed. The received text is displayed in the text edit box, and the determination button is set in the text bounding box. And when the fact that the confirm button is clicked is detected, determining the file name renamed by taking the text in the text edit box as the file identifier. For example, fig. 14 is an eleventh schematic view of a display interface. Fig. 14 is a schematic diagram of a display interface after a file identifier renaming operation is received for the second identifier 2702 in fig. 13. Where the text edit box 27021 may display the file name entered by the user. When it is detected that the decision button 27022 is clicked, the text in the text edit box 27021 is made the file name of the file identification 2702. At this time, fig. 15 is a twelfth schematic view of the display interface. Referring to fig. 15, the file name of file identification 2702 is changed to DDD.

For another example, when a file identifier arrangement position adjustment operation is received, a position preview line after the file identifier adjustment is displayed according to the current position of the mouse cursor, so as to prompt a user to drag the file identifier to the position. Further, after the dragging operation is detected to be finished, the file identification is adjusted to the position preview line corresponding to the end position, so that the adjustment of the arrangement position of the file identification is realized. For example, fig. 16 is a thirteenth schematic diagram of the display interface, and fig. 16 is a schematic diagram of the display interface when the third indicator 2703 in fig. 13 receives the operation of adjusting the arrangement position of the file indicator. Referring to fig. 16, a location preview line 27031 represents the location where the third indicator 2703 is dragged to the second indicator 2702. Specifically, when it is detected that the operation of adjusting the arrangement position of the file identifiers is completed, the third identifier 2703 is displayed at the position of the second identifier 2702, and at the same time, the second identifier 2702 is sequentially moved down by one position. At this time, the display interface is replaced with fig. 17, wherein fig. 17 is a fourteenth schematic diagram of the display interface.

Furthermore, after the file identifier of the multimedia file is added to the connection node, the multimedia file can be played. Specifically, after S293, S296 — S2910 may be further included:

and S296, receiving an identification selection operation.

The identifier selection operation is used to select any file identifier, and the selected file identifier can be understood as a multimedia file corresponding to the file identifier that needs to be played, and at this time, the multimedia file can be marked as a target multimedia file. Specifically, after it is detected that any file identifier receives a click operation, it is determined that a file identifier selection operation is received.

S297, a new display window is created.

Wherein a new display window pops up on the current display interface. The new display window is used for playing the multimedia file corresponding to the file identifier. It is understood that the specific display position, size and attribute of the new display window can be set according to actual conditions. Specifically, the target multimedia file is loaded into a new display window in an element mode according to the file path, and the new display window is displayed. For example, if the new display window corresponds to a whiteboard software display window, loading the target multimedia file into the new display window may be understood as inserting an element such as a picture, audio, or video into the whiteboard software.

And S298, displaying the target multimedia file in the new display window.

And the target multimedia file is the multimedia file corresponding to the selected file identifier.

Specifically, for example, when the target multimedia file is a picture, the picture may be directly displayed on the new display window. When the target multimedia file is an audio or video file, a playing window of the audio or video file may be displayed, optionally, the audio or video file may be automatically played, or the audio or video file may be determined to be played after the audio or video playing window is detected to receive a click operation. In the embodiment, when the multimedia file is audio or video, the playing window of the audio or video is displayed, and the audio or video is not automatically played.

In particular, each picture may be considered as a sub-multimedia file, considering that a plurality of sub-multimedia files may be included in a multimedia file, for example, a plurality of pictures constitute one multimedia file. For another example, a plurality of videos constitute a multimedia file, and each video may be considered a sub multimedia file. It should be noted that the sub multimedia files included in the same multimedia file may be different types of multimedia files or the same type of multimedia files. When a multimedia file containing a sub multimedia file is selected for play, it is necessary that the user makes sure that there are a plurality of sub multimedia files currently. Accordingly, in the embodiment, when the target multimedia file includes a plurality of sub multimedia files, S298 specifically includes S2981-S2985:

s2981, according to the arrangement sequence of the plurality of sub multimedia files, taking the sub multimedia file positioned at the forefront as the current sub multimedia file, and displaying the current sub multimedia file in a new display window.

Specifically, the arrangement sequence is a playing sequence of the sub multimedia files, which can be preset. The specific arrangement rule of the arrangement sequence can be set according to the actual situation. Further, when the sub multimedia files are determined to be displayed, the sub multimedia files are sequentially displayed from front to back according to the arrangement sequence. Therefore, when it is determined that the sub multimedia files need to be displayed, the sub multimedia file located at the top of the arrangement order is taken as the current sub multimedia file and displayed in the new display window. Wherein, the current sub multimedia file refers to the currently displayed sub multimedia file.

S2982, a page backward turning instruction is received.

Specifically, in order to make the user clearly understand that a plurality of sub multimedia files currently exist, it is set that when the current sub multimedia file is played, a page turning component is displayed in a new display window. Wherein, page turning subassembly includes: a previous page turning component and a next page turning component. The specific display form and display position of the page turning component are not limited. Specifically, when the user views the page turning assembly, the user can clearly determine that a plurality of sub multimedia files exist currently, and then the current sub multimedia file is replaced through the page turning assembly.

Illustratively, the page backward instruction acts on a page backward component for instructing the intelligent interactive tablet to page backward the child multimedia file. The specific receiving form of the backward page turning instruction can be set according to the actual situation. For example, when it is detected that the page turning component of the next page receives the click operation, it is determined that a page turning instruction is received.

Generally speaking, when receiving a page backward turning instruction, the intelligent interactive tablet determines whether the current sub-multimedia file is the last sub-multimedia file in the arrangement sequence, if so, the intelligent interactive tablet does not respond to the page backward turning instruction, otherwise, the intelligent interactive tablet executes S2983.

S2983, updating the next sub multimedia file located in the current sub multimedia file to the current sub multimedia file according to the arrangement sequence, and displaying the current sub multimedia file in the new display window.

Specifically, after a backward page turning instruction is received, a next sub-multimedia file behind the current sub-multimedia file is determined according to the arrangement sequence, the current sub-multimedia file is replaced by the next sub-multimedia file, and then the current sub-multimedia file is displayed in a new display window.

S2984, receiving a page forward instruction.

Illustratively, the page forward instruction acts on a previous page flip component for instructing the smart interactive tablet to page forward the child multimedia file. The specific receiving form of the forward page turning instruction can be set according to the actual situation. For example, when the previous page turning component is detected to receive the clicking operation, the forward page turning instruction is determined to be received.

Generally speaking, when receiving a page forward turning instruction, the intelligent interactive tablet determines whether the current sub-multimedia file is the most front sub-multimedia file in the arrangement sequence, if so, the intelligent interactive tablet does not respond to the page forward turning instruction, otherwise, the intelligent interactive tablet executes S2985.

And S2985, updating the previous sub multimedia file located in the current sub multimedia file into the current sub multimedia file according to the arrangement sequence, and displaying the current sub multimedia file in a new display window.

Specifically, after a forward page turning instruction is received, a previous sub multimedia file of the current sub multimedia file is determined according to the arrangement sequence, the current sub multimedia file is replaced by the previous sub multimedia file, and then the current sub multimedia file is played in a new display window.

Optionally, in order to make the user clarify the number of the sub multimedia files, in the embodiment, when executing S2981-S2985, the following steps are also executed synchronously: and displaying the total page number of the sub multimedia files and the page number corresponding to the current sub multimedia file.

The total number of pages refers to the total number of the sub multimedia files, and the number of pages of the current sub multimedia file refers to the position of the current sub multimedia file in the arrangement sequence. Specifically, the display rule of the total number of pages and the number of pages of the current sub-media file can be set according to the actual situation. The user can be made to know that the current sub multimedia file is located at a specific position in the arrangement sequence through the total number of pages and the number of pages of the current sub media file.

For example, fig. 18 is a fifteenth schematic view of a display interface. Referring to fig. 18, a sub multimedia file is displayed in a display window 2101, and a previous page flip assembly 21011, a next page flip assembly 21012, and a page number control 21013 are displayed in the lower right corner of the display window 2101. Specifically, the page number control 21013 is shown as "1/3," which indicates that the number of pages corresponding to the current sub multimedia file is the first page, and the total number of pages of the sub multimedia file is 3. Further, when a page backward instruction to the next page flip element 21012 is received, the display interface of the display window becomes fig. 19. Fig. 19 is a sixteenth schematic view of the display interface, and referring to fig. 19, the sub multimedia file is displayed in the display window 2101. At this time, the page number control 21013 is displayed as "2/3" indicating that the number of pages corresponding to the current sub multimedia file is the second page. Further, when a page forward instruction to the previous page flip element 21011 is received, the display interface of the display window is changed from fig. 19 back to fig. 18.

And S299, receiving file playing operation.

Specifically, due to the setting in the embodiment, when the target multimedia file is an audio or video, the audio or video playing window is displayed, and the audio or video is not automatically played. Then, when the user wants to play the target multimedia file, the user can select the target multimedia file through the file playing operation. And the file playing operation is used for indicating the intelligent interactive flat panel to play the target multimedia file. The specific receiving method of the file playing operation is not limited. For example, after detecting that a play key in a play window of a target multimedia file receives a click operation, determining that a file play operation is received. For example, after the play button 21014 of the audio play window in fig. 18 receives a click operation, it is determined that a file play operation is received.

S2910, playing the target multimedia file.

Specifically, after the file playing operation is received, the target multimedia file corresponding to the file playing operation is played.

Optionally, in consideration of the fact that in practical application, a user needs to annotate the multimedia file, the embodiment sets that the multimedia file can be annotated. Specifically, after the target multimedia file is played, the setting further includes S2911-2912:

s2911, receiving annotation operation.

Optionally, the annotation operation is used to instruct the smart interactive tablet to add an annotation to the multimedia file. And after entering the annotating mode, determining that the received operation is the annotating operation. For example, after a long-press operation for the target multimedia file is detected, the entry into the annotation mode is confirmed. For another example, a set of control bars is displayed in the new display window, the control bars including: a selection control and an annotation control. When the target multimedia file is played, the selected control in the default control bar is in a trigger state, and at the moment, the target multimedia file is in a playing mode. And when the annotation control is detected to receive the clicking operation, determining to enter an annotation mode. In the embodiment, a description is given by taking an example in which a group of control bars is displayed in a new display window.

Further, after entering the annotating mode, confirming that the touch operation or the key operation received by the new display window is the annotating operation.

S2912, adding annotation content in the target multimedia file.

The annotation content is determined according to the annotation operation, and the annotation content can be formed by an annotation track. Specifically, an operation position of the annotation operation is determined, and the operation position is displayed, so that an annotation track is displayed, and the annotation content is added to the target multimedia file. Wherein, the display parameters can be set according to the actual situation. For example, after the annotation control in the control column receives a long-press operation, a display parameter setting interface pops up, and a user can determine the thickness and the color of an annotation track through the display parameter setting interface. Meanwhile, files such as patterns and the like can be inserted into the annotation content.

Optionally, after displaying the annotation content, the user may insert and remove the annotation content according to the actual situation. Specifically, an erasing control is added in the control bar. And when the erasing control is confirmed to be clicked, determining to enter an annotation content erasing mode. At this time, an erasing operation is received, and the annotation content on the position corresponding to the erasing operation is erased.

For example, fig. 20 is a seventeenth schematic view of a display interface. Referring to fig. 20, a control field 2103 is displayed in the new display window 2102. Control field 2103 includes, among other things, a select control 21031, an annotation control 21032, and an erase control 21033. Currently in annotation mode, i.e., annotation control 21032 is in the triggered state. Further, after receiving the long-press operation, the annotation control 21032 displays the display parameter setting interface 2104. The display parameter setting interface 2104 includes, among other things, a thickness option 21041 and a color option 21042. Further comprising: pattern insertion option 21043. When the pattern insertion option 21043 is clicked, a picture insertion window can pop up to insert a picture in the annotation content.

When the function selecting operation selects the entry control for adding the remark function, S290 specifically includes S2913-S2915:

and S2913, displaying a remark input box.

Specifically, after determining that the entry control for adding the remark function is selected, displaying a remark input box in the current display interface. The display position and the display content of the remark input box can be set according to the actual situation.

S2914, receiving a remark input operation, and confirming the remark content according to the remark input operation.

Specifically, the remark input box is provided with a text input box, and a user can input remark content in the remark input box. Here, the operation of inputting the memo content may be regarded as a memo input operation. Specifically, the user may input the remark input operation by handwriting or by keying. Furthermore, the intelligent interactive tablet determines the remark content according to the remark input operation and displays the remark content in the remark input box. Furthermore, a confirmation button can be set in the remark input box, when the intelligent interaction panel detects that the confirmation button is clicked, the remark content is confirmed to be input completely, and the remark content is stored in association with the connection node. I.e. adding remark elements in the connection nodes. And meanwhile, closing the remark input box.

And S2915, displaying a remark icon in the connection node.

Specifically, in order to make the user clear that a remark element exists in the connection node, a remark icon is displayed in the connection node. The specific display mode and display position of the remark icon are not limited.

At this time, only the remark icon is displayed in the connection node, and the specific remark content is not displayed. Further, after displaying the remark icon, the corresponding remark content can be called out through the remark icon, specifically, after the remark icon is displayed in the connection node, the method further includes: S2916-S2917:

and S2916, receiving a remark icon selection operation.

Specifically, the note icon selection operation is used to select the note icon, and the specific receiving mode can be set according to the actual situation. For example, after the remark icon is detected to be clicked, the remark icon selection operation is determined to be received.

And S2917, displaying remark content.

Specifically, the remark contents are displayed at the peripheral position of the connection node, so that the user can view the specific remark contents. Further, after displaying the remark content, the user may modify the remark content, for example, after detecting that the remark content receives a double-click operation, determine to enter a modification mode of the remark content, and at this time, display a remark input box containing the remark content.

For example, fig. 21 is an eighteenth schematic view of a display interface. Referring to fig. 21, a remark icon 2106 is displayed in the connection node 2105. When a remark icon selection operation for the remark icon 2106 is received, remark contents 2107 are displayed.

Optionally, after the remark content is displayed, when it is detected that the remark icon receives the click operation again, closing the remark content is determined. Optionally, after the remark content is displayed, after it is detected that any position of other non-remark content receives a click operation, closing the remark content is determined. Optionally, a close button is set in the remark content, and after it is detected that the close button receives a click operation, the remark content is determined to be closed.

In the technical solution provided in this embodiment, after receiving an element selection operation, when determining that the number of target elements is less than or equal to a set number, displaying a connection node adding button, and after receiving the button selection operation, determining a position layout of a connection line and a connection node according to a specific number of the target elements, and further displaying the connection line and the connection node according to the position layout, further, after receiving the node selection operation, popping up a node editing menu, further selecting an entry control in the selected node editing menu according to a function, and executing a target function corresponding to the entry control, thereby implementing a technical solution in which a connection node is added between any one element or two elements, and at the same time, editing the connection node, such as adding a multimedia file or a comment, and editing or displaying the added multimedia file or comment again, the flexibility of the connection node is improved, the display content is enriched, and the use experience of the user is improved.

EXAMPLE III

Fig. 22 is a schematic structural diagram of a connection node control device of an electronic whiteboard according to a third embodiment of the present invention. Referring to fig. 22, the connection node control apparatus of the electronic whiteboard includes: a first receiving module 301, a first display module 302, a second receiving module 303, and a second display module 304.

The first receiving module 301 is configured to receive an element selection operation, where the element selection operation is used to select a target element, and the target element is a currently displayed user input element; a first display module 302, configured to display a connection node adding button, where the connection node adding button is determined according to the target element; a second receiving module 303, configured to receive a button selection operation, where the button selection operation is performed on the connection node addition button; and a second display module 304, configured to display the connecting line generated for the target element, and display a connecting node on the connecting line, where the connecting node has editability.

Further, the method also comprises the following steps: a third receiving module, configured to receive a node selection operation after a connection line generated for the target element is displayed and a connection node is displayed on the connection line, where the node selection operation acts on the connection node; the third display module is used for popping up a node editing menu, the node editing menu comprises a plurality of entrance controls, and each entrance control corresponds to a function; a fourth receiving module, configured to receive a function selection operation, where the function selection operation is used to select any entry control; and the function execution module is used for executing a target function aiming at the connecting node, and the target function corresponds to the selected entrance control.

Further, the entry control includes at least one of: the system comprises an entrance control of a copying function, an entrance control of a cutting function, an entrance control of a pasting function, an entrance control of a multimedia adding function and an entrance control of a remarking adding function.

Further, the function selecting operation selects the entry control for adding the multimedia function, and the function executing module includes: the system comprises a window display unit, a file selection unit and a file selection unit, wherein the window display unit is used for displaying a file selection window, and the file selection window comprises at least one multimedia file to be selected; a selected operation receiving unit, configured to receive a file selecting operation, where the file selecting operation is used to select any at least one of the multimedia files; and the identification display unit is used for displaying the file identification in the connecting node, wherein the file identification corresponds to the selected multimedia file.

Further, the method also comprises the following steps: the fifth receiving module is used for receiving the file editing operation after the file identification is displayed in the connecting node; and the identifier editing module is used for editing the file identifier according to the file editing operation.

Further, the method also comprises the following steps: a sixth receiving module, configured to receive, after displaying a file identifier in a connection node, an identifier selection operation, where the identifier selection operation is used to select any file identifier; the window creating module is used for creating a new display window; the multimedia display module is used for displaying a target multimedia file in the new display window, wherein the target multimedia file is a multimedia file corresponding to the selected file identifier; a seventh receiving module, configured to receive a file playing operation; and the file playing module is used for playing the target multimedia file.

Further, the target multimedia file comprises a plurality of sub multimedia files; the multimedia display module specifically comprises: the first file display unit is used for taking the sub multimedia file positioned at the forefront as the current sub multimedia file according to the arrangement sequence of the plurality of sub multimedia files and displaying the current sub multimedia file in a new display window; the first instruction receiving unit is used for receiving a page turning-back instruction; the second file display unit is used for updating a next sub multimedia file positioned in the current sub multimedia file into the current sub multimedia file according to the arrangement sequence and displaying the current sub multimedia file in a new display window; the second instruction receiving unit is used for receiving a forward page turning instruction; and the third file display unit is used for updating the previous sub multimedia file positioned in the current sub multimedia file into the current sub multimedia file according to the arrangement sequence and displaying the current sub multimedia file in a new display window.

Further, the target multimedia file includes a plurality of sub multimedia files, and the multimedia display module is further configured to: and when the target multimedia file is displayed in the new display window, displaying the total page number of the sub multimedia file and the page number corresponding to the current sub multimedia file.

Further, the method also comprises the following steps: the eighth receiving module is used for receiving annotation operation after the target multimedia file is played; and the annotation adding module is used for adding annotation content in the target multimedia file, and the annotation content is determined according to annotation operation.

Further, the function selecting operation selects the entry control for adding the remark function, and the function executing module includes: the input frame display unit is used for displaying a remark input frame; the remark confirming unit is used for receiving the remark input operation and confirming the remark content according to the remark input operation; and the remark icon display unit is used for displaying the remark icon in the connecting node.

Further, the ninth receiving module is configured to receive a note icon selection operation after the note icon is displayed in the connection node; and the remark content display module is used for displaying the remark content.

Further, the method also comprises the following steps: a display state confirmation module, configured to display a connection line generated for the target element, and after a connection node is displayed on the connection line, confirm that at least one element corresponding to the connection node is in an undisplayed state; and the hiding module is used for hiding and displaying the connecting line and the connecting node.

Further, the method also comprises the following steps: a tenth receiving module, configured to display a connection line generated for the target element, and receive a target element movement operation after a connection node is displayed on the connection line; a moving module for moving the target element; and the updating module is used for updating the position layout of the connecting lines and the connecting nodes.

Further, the method also comprises the following steps: an eleventh receiving module, configured to display a connection line generated for the target element, and receive a target element deletion instruction after a connection node is displayed on the connection line; the element deleting module is used for deleting the target element; and the node deleting module is used for deleting all connecting lines and all connecting nodes corresponding to the target element.

Further, the first display module 302 is specifically configured to: and confirming that the number of the target elements is less than or equal to the set number, and displaying a connecting node adding button.

Further, the number of the target elements is two, and the second display module 304 specifically includes: the first position determining unit is used for determining the position layout of the connecting lines and the connecting nodes according to the display position of the target element; and the first node display unit is used for displaying the connecting lines and the connecting nodes according to the position layout.

Further, the number of the target elements is one, and the second display module 304 specifically includes: an operation receiving unit for receiving a position selecting operation; the terminal position determining unit is used for determining a terminal position according to the position selecting operation; the second position determining unit is used for determining the position layout of the connecting line and the connecting node according to the display position and the end point position of the target element; and the second node display unit is used for displaying the connecting lines and the connecting nodes according to the position layout.

The connection node control device of the electronic whiteboard provided in this embodiment may be used to execute the connection node control method of the electronic whiteboard provided in any of the above embodiments, and has corresponding functions and beneficial effects.

Example four

Fig. 23 is a schematic structural diagram of a connection node control device of an electronic whiteboard according to a fourth embodiment of the present invention. This connected node control equipment of whiteboard includes: a processor 40, a memory 41, a display 42, an input device 43, and an output device 44. The number of the processors 40 in the connected node control device of the electronic whiteboard may be one or more, and one processor 40 is taken as an example in fig. 23. The number of the memories 41 in the connected node control device of the electronic whiteboard may be one or more, and one memory 41 is taken as an example in fig. 23. The processor 40, the memory 41, the display 42, the input device 43, and the output device 44 of the connection node control apparatus of the electronic whiteboard may be connected by a bus or other means, and the bus connection is exemplified in fig. 23. In an embodiment, the connection node control device of the electronic whiteboard may be a computer, a mobile phone, a tablet, an interactive smart tablet, or the like.

The memory 41 serves as a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the connection node control device of the electronic whiteboard according to any embodiment of the present invention (for example, the first receiving module 301, the first display module 302, the second receiving module 303, and the second display module 304 in the connection node control apparatus of the electronic whiteboard). The memory 41 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory 41 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 41 may further include memory located remotely from processor 40, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The display screen 42 may be a touch-enabled display screen 42, which may be a capacitive screen, an electromagnetic screen, or an infrared screen. In general, the display screen 42 is used for displaying data according to instructions of the processor 40, such as displaying a connection node adding button, a connection line generated for the target element, a connection node located on the connection line, and the like, and is also used for receiving a touch operation applied to the display screen 42 and sending a corresponding signal to the processor 40 or other devices.

The input means 43 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the connected node control apparatus, and may also be a camera for acquiring images and a sound pickup apparatus for acquiring audio data. The output device 44 may include an audio device such as a speaker. It should be noted that the specific composition of the input device 43 and the output device 44 can be set according to actual conditions.

The processor 40 executes various functional applications of the device and data processing by running software programs, instructions and modules stored in the memory 41, i.e. implements the above-described connection node control method of the electronic whiteboard.

The connection node control device of the electronic whiteboard provided above can be used to execute the connection node control method of the electronic whiteboard provided in any of the above embodiments, and has corresponding functions and beneficial effects.

EXAMPLE five

An embodiment of the present invention further provides a storage medium containing computer-executable instructions, where the computer-executable instructions are executed by a computer processor to perform a method for controlling a connection node of an electronic whiteboard, where the method includes:

receiving an element selection operation, wherein the element selection operation is used for selecting a target element, and the target element is any type of element which is displayed currently;

Of course, the storage medium containing the computer-executable instructions provided in the embodiments of the present invention is not limited to the operations of the connected node control method described above, and may also perform related operations in the connected node control method of the electronic whiteboard provided in any embodiments of the present invention, and has corresponding functions and advantages.

From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, and the computer software product may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions to enable a computer device (which may be a robot, a personal computer, a server, or a network device) to execute the method for controlling a connection node of an electronic whiteboard according to any embodiment of the present invention.

It should be noted that, in the above-mentioned connection node control device of the electronic whiteboard, each included unit and module are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.

It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for controlling a connection node of an electronic whiteboard is characterized by comprising the following steps:

displaying a connecting line generated aiming at the target element, and displaying a connecting node on the connecting line, wherein the connecting node has editability;

executing a target function aiming at the connecting node, wherein the target function corresponds to the selected entrance control;

wherein the entry control comprises an entry control to add multimedia functionality;

the function selection operation selects an entry control of the add multimedia function;

the performing a target function for the connecting node comprises:

displaying, in a connection node, a file identification, the file identification corresponding to a selected multimedia file;

creating a new display window;

receiving a file playing operation;

playing the target multimedia file;

receiving annotation operation;

and adding annotation content in the target multimedia file, wherein the annotation content is determined according to annotation operation.

2. The method of claim 1, wherein the portal control further comprises at least one of:

the system comprises an entrance control of a copying function, an entrance control of a cutting function, an entrance control of a pasting function and an entrance control of an adding remark function.

3. The method according to claim 1, wherein after displaying the file identifier in the connection node, the method further comprises:

receiving a file editing operation;

and editing the file identification according to the file editing operation.

4. The method according to claim 3, wherein the file editing operation comprises: file identification renaming operation and/or file identification arrangement position adjusting operation.

5. The method according to claim 1, wherein the target multimedia file comprises a plurality of sub multimedia files;

the displaying the target multimedia file in the new display window comprises:

receiving a backward page turning instruction;

receiving a forward page turning instruction;

6. The method according to claim 5, wherein when displaying the target multimedia file in the new display window, the method further comprises:

7. The method according to claim 2, wherein the function selection operation selects the entry control for adding the remark function;

the performing a target function for the connecting node comprises:

displaying a remark input box;

and displaying a remark icon in the connection node.

8. The method according to claim 7, wherein after the displaying the remark icon in the connection node, the method further comprises:

receiving a remark icon selection operation;

and displaying the remark content.

9. The method according to claim 1, wherein the displaying a connection line generated for the target element and after a connection node is displayed on the connection line, further comprises:

and hiding and displaying the connecting line and the connecting node.

10. The method according to claim 1, wherein the displaying a connection line generated for the target element and after a connection node is displayed on the connection line, further comprises:

receiving a target element movement operation;

moving the target element;

11. The method according to claim 1, wherein the displaying a connection line generated for the target element and after a connection node is displayed on the connection line, further comprises:

receiving a target element deleting instruction;

deleting the target element;

12. The method according to claim 1, wherein the displaying a connected node adding button comprises:

13. The method of controlling connection nodes of an electronic whiteboard according to claim 1, wherein the number of the target elements is two,

and displaying the connecting lines and the connecting nodes according to the position layout, wherein the connecting nodes have editability.

14. The method of controlling connection nodes of an electronic whiteboard according to claim 1, wherein the number of the target elements is one,

receiving a position selection operation;

confirming the end position according to the position selection operation;

15. A connection node control device of an electronic whiteboard, comprising:

the second display module is used for displaying a connecting line generated aiming at the target element, and displaying a connecting node on the connecting line, wherein the connecting node has editability;

the function execution module is used for executing a target function aiming at the connecting node, and the target function corresponds to the selected entrance control;

the function selection operation selects an entry control of the add multimedia function, and the function execution module includes:

the system comprises a window display unit, a file selection unit and a file selection unit, wherein the window display unit is used for displaying a file selection window, and the file selection window comprises at least one multimedia file to be selected;

a selected operation receiving unit, configured to receive a file selecting operation, where the file selecting operation is used to select any at least one of the multimedia files;

an identifier display unit for displaying a file identifier in the connection node, the file identifier corresponding to the selected multimedia file;

a sixth receiving module, configured to receive, after displaying a file identifier in a connection node, an identifier selection operation, where the identifier selection operation is used to select any file identifier;

the window creating module is used for creating a new display window;

the multimedia display module is used for displaying a target multimedia file in the new display window, wherein the target multimedia file is a multimedia file corresponding to the selected file identifier;

a seventh receiving module, configured to receive a file playing operation;

the file playing module is used for playing the target multimedia file;

the eighth receiving module is used for receiving annotation operation after the target multimedia file is played;

and the annotation adding module is used for adding annotation content in the target multimedia file, and the annotation content is determined according to annotation operation.

16. A connected node control apparatus of an electronic whiteboard, characterized by comprising: a memory, a display screen, and one or more processors;

the memory for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the method of connection node control of an electronic whiteboard of any of claims 1-14.

17. A storage medium containing computer-executable instructions for performing the method of controlling a connection node of an electronic whiteboard according to any one of claims 1 to 14 when executed by a computer processor.