CN108958608B

CN108958608B - Interface element operation method and device of electronic whiteboard and interactive intelligent equipment

Info

Publication number: CN108958608B
Application number: CN201810753757.6A
Authority: CN
Inventors: 陈天龙
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2018-07-10
Filing date: 2018-07-10
Publication date: 2022-07-15
Anticipated expiration: 2038-07-10
Also published as: WO2020010775A1; CN108958608A

Abstract

The invention discloses an interface element operation method and device of an electronic whiteboard and interactive intelligent equipment. Wherein, the method comprises the following steps: displaying an interface element inserted with the selected multimedia on the current interface, wherein the interface element comprises at least one of the following: graphs, tables, and mind maps; responding to the operation of opening the multimedia, displaying a playing interface of the multimedia, wherein a functional control for editing the multimedia is arranged on the upper layer of the playing interface of the multimedia; and responding to the operation of the function control, and displaying the multimedia interface after the operation corresponding to the function control is executed. The invention solves the technical problem that the interface elements with multimedia inserted in the related technology can not be edited according to the requirements of users.

Description

Interface element operation method and device of electronic whiteboard and interactive intelligent equipment

Technical Field

The invention relates to the field of interactive intelligent equipment, in particular to an interface element operation method and device of an electronic whiteboard and interactive intelligent equipment.

Background

Various interface elements can be displayed in the displayed application program, wherein the interface elements refer to interface elements with content in the file, such as shapes, tables, thinking diagrams and the like. In the prior art, only text information can be inserted into an interface element, and the interface element is displayed through the inserted text information, for example, the interface element is annotated. However, since text information can only simply display text contents, the interface elements inserted into the text information have poor expression and are not practical.

In view of the above problems, no effective solution has been proposed.

Disclosure of Invention

The embodiment of the invention provides an interface element operation method and device of an electronic whiteboard and interactive intelligent equipment, which at least solve the technical problem that interface elements with multimedia inserted in the related technology cannot be edited according to user requirements.

According to an aspect of the embodiments of the present invention, there is provided an interface element operating method for an electronic whiteboard, including: displaying an interface element inserted with the selected multimedia on the current interface, wherein the interface element comprises at least one of the following: graphs, tables, and mind maps; responding to the operation of opening the multimedia, displaying a multimedia playing interface, wherein a functional control for editing the multimedia is arranged on the upper layer of the multimedia playing interface; and responding to the operation of the function control, and displaying the multimedia interface after the operation corresponding to the function control is executed.

Optionally, before the current interface displays the interface element into which the selected multimedia is inserted, the method includes: responding to the operation of displaying the interface elements, and displaying the interface elements to be inserted into the multimedia; and responding to the operation of selecting the multimedia needing to be inserted into the interface element, and displaying the multimedia to be selected.

Optionally, the functionality control includes at least one of: the system comprises a painting brush function control, an eraser function control, a position moving function control, an area scaling function control, a page turning function control, a font conversion function control, a graphic conversion function control, a table display function control, an organization structure display function control, a color function control and a circle selection function control.

Optionally, in a case that the function control is a brush function control, in response to an operation on the brush function control, displaying a multimedia interface after the operation corresponding to the brush function control is performed includes: and responding to a painting brush operation on an operation layer on an upper layer of the playing interface, and displaying handwriting corresponding to the painting brush operation on the multimedia playing interface.

Optionally, in response to a brush operation on the operation layer, displaying a handwriting corresponding to the brush operation on the multimedia playing interface includes: responding to the operation of a brush parameter of a brush corresponding to the brush function control, and setting the color and the thickness of the brush; and responding to a painting brush operation of the painting brush on the operation layer, and displaying a handwriting corresponding to the painting brush operation on a playing interface of the multimedia, wherein the handwriting is generated according to the set painting brush parameters.

Optionally, in a case that the function control is an eraser function control, in response to an operation on the eraser function control, displaying the multimedia interface after the operation corresponding to the eraser function control is performed includes: and responding to the erasing operation executed by the eraser function control, and displaying an erasing track corresponding to the erasing operation on a playing interface of the multimedia.

Optionally, in a case that the function control is a position movement function control, responding to an operation on the position movement function control, and displaying the multimedia interface after the operation corresponding to the position movement function control is performed includes: and responding to the operation of the mobile multimedia position executed by the position mobile function control, and displaying the multimedia after the mobile multimedia position on the multimedia playing interface.

Optionally, in a case that the function control is an area zoom function control, in response to the operation on the area zoom function control, displaying the multimedia interface after the operation on the area zoom function control is performed includes: and responding to the operation of zooming the multimedia executed by the area zooming function control, and displaying the zoomed multimedia on a playing interface of the multimedia.

Optionally, in a case that the function control is a page turning function control, responding to the operation of the page turning function control, and displaying the multimedia interface after the operation of the page turning function control is performed includes: and responding to the page turning operation executed by the page turning function control, and displaying the corresponding multimedia after page turning on the multimedia playing interface.

Optionally, in a case that the function control is a circle-selected function control, responding to the operation on the circle-selected function control, and displaying the multimedia interface after the operation on the circle-selected function control is performed includes: responding to the range selection operation executed by the selection function control, and displaying the multimedia with the selected range on the playing interface of the multimedia.

Optionally, in a case that the function control is a font conversion function control, in response to the operation on the font conversion function control, displaying the multimedia interface after the operation on the font conversion function control is performed includes: responding to a character touch track of the font conversion function control, and displaying characters corresponding to the character touch track, wherein the characters support at least one of the following operations: zoom, move, and rotate; and responding to the operation of confirming the text insertion, and displaying the inserted text on the multimedia playing interface.

Optionally, in a case that the function control is a graphic conversion function control, in response to an operation on the graphic conversion function control, displaying the multimedia interface after the operation on the graphic conversion function control is performed includes: responding to a graph touch track of the graph conversion function control, and displaying a graph corresponding to the graph touch track, wherein the graph supports at least one of the following operations: zooming, moving, and rotating, the graphics supporting at least one of: changing color and inserting characters; and responding to the operation of confirming the graphics to be inserted, and displaying the inserted graphics on the playing interface of the multimedia.

Optionally, before the current interface displays the interface element into which the selected multimedia is inserted, the method further includes: in response to the operation of inserting the selected multimedia into the interface element, displaying attribute information of the selected multimedia to be inserted into the interface element; and responding to the operation of modifying the attribute information of the multimedia, and displaying modified information obtained after modifying the attribute information.

Optionally, in response to the operation of modifying the attribute information of the multimedia, displaying modification information obtained by modifying the attribute information includes: responding to the operation of selecting the multimedia to be inserted into the interface element, and displaying a list item corresponding to the multimedia; and displaying attribute information of the multimedia in the list item, wherein the attribute information comprises the type of the multimedia and/or the name of the multimedia.

Optionally, before displaying the attribute information of the multimedia in the list item, the method includes: and responding to the modification operation of the attribute information, and displaying the modified information obtained after modifying the attribute information, wherein the attribute information is the name of the multimedia, and the modified information is the modified updated name.

According to another aspect of the present invention, there is provided a processor for executing a program, wherein the program executes to perform the method of any one of the above.

According to another aspect of the present invention, there is provided an interface element operating apparatus for an electronic whiteboard, including: a first display module, configured to display, on a current interface, an interface element into which a selected multimedia is inserted, where the interface element includes at least one of: graphs, tables, and mind maps; the second display module is used for responding to the operation of opening the multimedia and displaying a multimedia playing interface, and a functional control used for editing the multimedia is arranged on the upper layer of the multimedia playing interface; and the third display module is used for responding to the operation of the functional control and displaying the multimedia interface after the operation corresponding to the functional control is executed.

Optionally, the apparatus further comprises: the fourth display module is used for responding to the operation of displaying the interface elements and displaying the interface elements to be inserted with multimedia; and the fifth display module is used for responding to the operation of selecting the multimedia needing to be inserted into the interface element and displaying the multimedia to be selected.

Optionally, the third display module includes: and the first display unit is used for responding to a painting brush operation on an operation layer on an upper layer of the playing interface and displaying the handwriting corresponding to the painting brush operation on the multimedia playing interface.

Optionally, the first display unit includes: the first determining subunit is configured to set a color and a thickness of the brush in response to an operation on a brush parameter of the brush corresponding to the brush function control; the first display subunit is configured to display, on the multimedia play interface, a handwriting corresponding to the brush operation in response to the brush operation of the brush on the operation layer, where the handwriting is generated according to the set brush parameter.

Optionally, the third display module includes: and the second display unit is used for responding to the erasing operation executed by the eraser function control under the condition that the function control is the eraser function control and displaying an erasing track corresponding to the erasing operation on the multimedia playing interface.

Optionally, the third display module includes: and the third display unit is used for responding to the position of the mobile multimedia operation executed by the position mobile function control and displaying the multimedia after the position of the mobile multimedia on the multimedia playing interface under the condition that the function control is the position mobile function control.

Optionally, the third display module includes: and the fourth display unit is used for responding to the multimedia zooming operation executed by the area zooming function control and displaying the zoomed multimedia on the multimedia playing interface under the condition that the function control is the area zooming function control.

Optionally, the third display module includes: and the fifth display unit is used for responding to the page turning operation executed by the page turning function control and displaying the multimedia corresponding to the turned page on the multimedia playing interface under the condition that the function control is the page turning function control.

Optionally, the third display module includes: and the sixth display unit is used for responding to the range selection operation executed by the selection-circled function control under the condition that the function control is the selection-circled function control, and displaying the multimedia with the circled range on the multimedia playing interface.

Optionally, the third display module includes: a seventh display unit, configured to, in a case that the function control is a font conversion function control, respond to a text touch trajectory of the font conversion function control, and display a text corresponding to the text touch trajectory, where the text supports at least one of the following operations: zoom, move, and rotate; and the eighth display unit is used for responding to the operation of confirming the insertion of the characters and displaying the inserted characters on the multimedia playing interface.

Optionally, the third display module includes: a ninth display unit, configured to, in a case that the function control is a graph conversion function control, respond to a graph touch trajectory of the graph conversion function control, and display a graph corresponding to the graph touch trajectory, where the graph supports at least one of the following operations: zooming, moving, and rotating, the graphics supporting at least one of: changing color and inserting characters; a tenth display unit for displaying the inserted graphics on the multimedia play interface in response to an operation of confirming the insertion of the graphics.

Optionally, the apparatus further comprises: a sixth display module, configured to display attribute information of the selected multimedia to be inserted into the interface element in response to an operation of inserting the selected multimedia into the interface element; and the seventh display module is used for responding to the operation of modifying the attribute information of the multimedia and displaying the modified information obtained after modifying the attribute information.

Optionally, the seventh display module includes: the eleventh display unit is used for responding to the operation of selecting the multimedia to be inserted into the interface element and displaying a list item corresponding to the multimedia; and displaying attribute information of the multimedia in the list item, wherein the attribute information comprises the type of the multimedia and/or the name of the multimedia.

Optionally, the seventh display module further includes: a twelfth display unit, configured to display modification information obtained by modifying the attribute information in response to a modification operation on the attribute information, where the attribute information is a name of the multimedia, and the modification information is an updated name after modification.

According to another aspect of the present invention, an interactive intelligent device is provided, wherein the interactive intelligent device comprises: the electronic whiteboard comprises a man-machine interaction device and a display device, wherein the display device comprises an interface element operating device of the electronic whiteboard.

Through the steps, the interface element inserted with the selected multimedia is displayed on the current interface, wherein the interface element comprises at least one of the following components: graphs, tables, and mind maps; responding to the operation of opening the multimedia, displaying a multimedia playing interface, wherein a functional control for editing the multimedia is arranged on the upper layer of the multimedia playing interface; and responding to the operation of the function control, and displaying the operated multimedia interface of the function control. Because the multimedia has vivid characteristics, compared with the prior art that only text information can be inserted into interface elements, the multimedia has stronger expressive force, and the multimedia which is being played can be edited in a multimedia playing interface, so that the purposes of editing the multimedia according to the requirements of users and improving the flexibility of multimedia insertion and playing are achieved, thereby realizing the purpose of enhancing the expressive force of the interface elements, meeting the technical effects of various requirements of the users by editing the multimedia, and further solving the technical problem that the interface elements into which the multimedia is inserted can not be edited according to the requirements of the users in the prior art.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:

fig. 1 is a flowchart of an operation method of an interface element of an electronic whiteboard according to an embodiment of the present invention;

fig. 2 is a flowchart of an interface element operating method of an electronic whiteboard according to a second embodiment of the present invention;

fig. 3 is a flowchart of an interface element operating method of an electronic whiteboard according to a third embodiment of the present invention;

fig. 4 is a flowchart of a method for operating interface elements of an electronic whiteboard according to a third preferred embodiment of the present invention;

fig. 5 is a flowchart of a method of operating interface elements of an electronic whiteboard according to a third preferred embodiment of the present invention;

fig. 6 is a flowchart of an interface element operating method of an electronic whiteboard according to a fourth embodiment of the present invention;

fig. 7 is a flowchart of an operation method of an interface element of an electronic whiteboard according to a fourth preferred embodiment of the present invention;

fig. 8 is a flowchart of a method for operating interface elements of an electronic whiteboard according to a fourth preferred embodiment of the present invention;

fig. 9 is a flowchart of a method for operating interface elements of an electronic whiteboard according to a fourth preferred embodiment of the present invention;

Fig. 10 is a flowchart of a method of operating an interface element of an electronic whiteboard according to a fourth preferred embodiment of the present invention;

fig. 11 is a flowchart of a method of operating an interface element of an electronic whiteboard according to a fourth preferred embodiment of the present invention;

fig. 12 is a flowchart of a method of operating an interface element of an electronic whiteboard according to a fifth embodiment of the present invention;

fig. 13 is a flowchart of a method of operating an interface element of an electronic whiteboard according to a sixth embodiment of the present invention;

FIG. 14 is a diagram illustrating a menu of selectable interface elements according to a sixth embodiment of the invention;

fig. 15 is a diagram of an alternative multimedia selection window according to a sixth embodiment of the invention;

figure 16 is a schematic diagram of a selectable multimedia list item according to a sixth embodiment of the present invention;

figure 17 is a schematic diagram of an edit box of a selectable multimedia list item in accordance with a sixth embodiment of the present invention;

FIG. 18 is a diagram illustrating an alternative edited multimedia list item according to a sixth embodiment of the present invention;

FIG. 19 is a diagram of an alternative picture according to a sixth embodiment of the present invention;

FIG. 20 is a schematic illustration of an alternative audio according to a sixth embodiment of the invention;

fig. 21 is a diagram of an alternative picture-based brush function control, according to a sixth embodiment of the present invention;

FIG. 22 is a pictorial diagram illustrating an edited picture with an optional picture-based position functionality control in accordance with a sixth embodiment of the present invention;

FIG. 23 is a diagram illustrating an edited picture with an optional picture-based area functionality control, according to a sixth embodiment of the present invention;

fig. 24 is a diagram illustrating an alternative picture-based multimedia switching functionality control in accordance with a sixth embodiment of the present invention;

fig. 25 is a schematic diagram illustrating an alternative picture-based multimedia switching function control after multimedia switching is performed according to a sixth embodiment of the present invention;

fig. 26 is a schematic structural diagram of an interface element operating apparatus of an electronic whiteboard according to a seventh embodiment of the present invention.

Detailed Description

In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in other sequences than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The intelligent interactive panel, also called an interactive intelligent panel, may be an integrated device that controls content displayed on a display panel and implements human-computer interaction operations through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound, a television, a video conference terminal, and the like.

The display screen, in the embodiments of the present specification, refers to a touch screen, and a touch panel, and is an inductive liquid crystal display device, when a graphical button on the screen is touched, the tactile feedback system on the screen can drive various connecting devices according to a pre-programmed program, so as to replace a mechanical button panel and produce a vivid video effect by the liquid crystal display screen. Distinguishing touch screens from technical principles can be divided into five basic categories: a vector pressure sensing technology touch screen, a resistance technology touch screen, a capacitance technology touch screen, an infrared technology touch screen and a surface acoustic wave technology touch screen. Touch screens can be classified into four categories according to their operating principles and the media used to transmit information: resistive, capacitive, infrared, and surface acoustic wave.

When a user touches the screen with a finger or a pen, the point coordinate is positioned, so that the control of the intelligent processing system is realized, and then different functional applications are realized through software built in the intelligent processing system.

The screen and the large screen mentioned in the application all refer to the display screen of the intelligent interactive panel; the intelligent interaction panel displays a certain interface, namely the display screen of the intelligent interaction panel displays the interface.

The method for operating interface elements of an electronic whiteboard provided in the embodiments of the present invention may be applied to an intelligent interactive device, where the intelligent interactive device may be the above-mentioned intelligent interactive tablet, and may be executed by a writing display device of the above-mentioned intelligent interactive tablet, where the writing display device may be implemented in a software and/or hardware manner, and the writing display device may be formed by two or more physical entities, or may be formed by one physical entity. The writing display device can be a computer, a mobile phone, a flat panel, a projector and the like. In the following embodiments, the interactive smart tablet may be an integrated device that controls content displayed on a display tablet and implements human-computer interaction operations through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound box, a television, a video conference terminal, and the like.

Example one

According to a first embodiment of the present invention, there is provided an embodiment of a method for operating an interface element of an electronic whiteboard, wherein the steps illustrated in the flowchart of the attached drawings can be executed in a computer system, such as a set of computer-executable instructions, and although a logical order is illustrated in the flowchart, in some cases, the steps illustrated or described may be executed in an order different from that shown.

Fig. 1 is a flowchart of a method for operating an interface element of an electronic whiteboard according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:

step S102, displaying the interface elements inserted with the selected multimedia on the current interface, wherein the interface elements comprise at least one of the following elements: graphs, tables, and mind maps;

step S104, responding to the operation of opening the multimedia, displaying a playing interface of the multimedia, wherein a functional control for editing the multimedia is arranged on the upper layer of the playing interface of the multimedia;

and step S106, responding to the operation of the function control, and displaying the multimedia interface after the operation of the function control is executed.

Through the steps, the interface element inserted with the selected multimedia is displayed on the current interface, wherein the interface element comprises at least one of the following components: graphs, tables, and mind maps; responding to the operation of opening the multimedia, displaying a playing interface of the multimedia, wherein a functional control for editing the multimedia is arranged on the upper layer of the playing interface of the multimedia; and responding to the operation of the function control, and displaying the multimedia interface after the operation of the function control is executed. Because the multimedia has vivid characteristics, compared with the prior art that only text information can be inserted into interface elements, the multimedia has stronger expressive force, and the multimedia which is being played can be edited in a multimedia playing interface, so that the purposes of editing the multimedia according to the requirements of users and improving the flexibility of multimedia insertion and playing are achieved, thereby realizing the purpose of enhancing the expressive force of the interface elements, meeting the technical effects of various requirements of the users by editing the multimedia, and further solving the technical problem that the interface elements into which the multimedia is inserted can not be edited according to the requirements of the users in the prior art.

The interface element inserted with the selected multimedia in the current interface display may include multiple types, for example, when the interface element is an interface element in a whiteboard tool, the interface element refers to a geometric figure, a table, a mind map, or a flowchart in the whiteboard tool. And selecting the interface element in a display interface, and entering a user editing interface of the interface element, wherein the display interface is the current interface for displaying the interface element to be inserted with the multimedia. And then, entering a user editing window of the interface element, and performing multimedia insertion operation in the user editing window. For example, a right-click operation is performed on the desktop of the whiteboard tool, a user editing window is entered, and then operation options that can be performed by the user on the interface element are displayed in the user editing window, where the operation options may include an option of inserting multimedia, and one or more multimedia are added under the option of inserting multimedia.

When the user edits the window to insert the multimedia, the multimedia selection interface displaying the multimedia to be selected is entered according to the operation options, and the inserted multimedia is selected from the multimedia selection interface. For example, the multimedia selection interface may be a storage path for finding a target multimedia to be added, and when a multimedia selection interface corresponding to the storage path for displaying the multimedia to be inserted into the interface element is found, the selected multimedia is inserted into the interface element from the multimedia selection interface.

It should be noted that the interface element into which the selected multimedia is inserted and the interface element into which the multimedia is to be inserted may be displayed on the same display interface or different display interfaces. For example, the interface element inserted with the selected multimedia is different from the interface element to be inserted with the multimedia, for example, the interface element inserted with the selected multimedia may enter a playing page of the multimedia, and the multimedia inserted before the playing page is played.

After a user executes an operation of opening a multimedia, the multimedia is skipped to enter a multimedia playing page, the playing page can also be a playing window, and a plurality of controls, such as a painting brush function control, an eraser function control, a position moving function control, an area zooming function control, a page turning function control, a font conversion function control, a graphic conversion function control, a table display function control, an organization structure display function control, a color function control and a circle selection function control, are arranged on the media playing interface. It should be noted that, when the brush function control and the circle selection function control perform a brush operation or a circle selection operation of a user, the operation is performed on the operation layer, and after the operation is completed on the operation layer, the operation is displayed on the multimedia playing interface. The operation layer may be a transparent operation layer and an upper layer of the multimedia playing page.

Example two

According to a second embodiment of the present invention, an embodiment of a method for operating an interface element of an electronic whiteboard is provided, and fig. 2 is a flowchart of the method for operating the interface element of the electronic whiteboard according to the second embodiment of the present invention; as shown in fig. 2, it should be noted that the present embodiment is specifically refined based on the first embodiment, wherein in step S102, the following steps are further included before the interface element inserted with the selected multimedia is displayed on the current interface:

step S202, responding to the operation of displaying interface elements, and displaying the interface elements of the multimedia to be inserted;

and step S204, responding to the operation of selecting the multimedia needing to be inserted into the interface element, and displaying the multimedia to be selected.

The operation of displaying the interface element is the operation that a user clicks or selects the interface element and needs to display the interface element, and the interface element is displayed in response to the operation, wherein the interface element is the interface element into which the multimedia is to be inserted. The operation of inserting multimedia into an interface element means that an insertion instruction of a user or a background is received, for example, the user right clicks the interface element in a whiteboard tool, and selects the inserted multimedia in a menu bar. And responding to the operation of inserting the multimedia in the interface element, and displaying the interface element into which the multimedia is to be inserted. The operation of selecting the multimedia needing to be inserted into the interface element refers to an instruction of automatic jump of the system or an instruction input by a user. Generally, when there are a plurality of selectable multimedia, the operation of selecting the multimedia requiring insertion of the interface element may be that a user manually selects the multimedia requiring insertion of the interface element from the plurality of multimedia.

And when the multimedia of the interface element needs to be viewed, clicking the interface element, and entering a multimedia playing interface, namely displaying the interface of the multimedia inserted into the selected multimedia interface element. And entering a playing window for playing the multimedia through a file list corresponding to the multimedia, wherein the file list is provided with a playing window entry link for entering the playing window. And playing the multimedia in the playing window according to the playing sequence. It should be noted that the playing order of the multimedia and the inserting order of the multimedia can be the same. In addition, in this embodiment, the insertion order of multimedia can be changed at any time.

When a playing interface (i.e. an interface displaying multimedia) displays multimedia, there are often dynamic playing states and static non-playing states due to the multimedia. When the multimedia is in a playing state, the data of the multimedia is in a dynamic state, and the editing is difficult. Therefore, in this embodiment, it is preferable that the multimedia is edited by the function control when the multimedia is in a static non-playing state. That is, when the multimedia is in a static non-playing state, the function control for editing the multimedia is displayed on the playing interface. And after the functional control edits the multimedia, directly displaying the edited multimedia on a playing page.

EXAMPLE III

According to a third embodiment of the present invention, an embodiment of an interface element operating method of an electronic whiteboard is provided, and fig. 3 is a flowchart of an interface element operating method of an electronic whiteboard according to the third embodiment of the present invention; as shown in fig. 3, it should be noted that the embodiment is specifically refined on the basis of the first embodiment, wherein in step S300, the function control includes at least one of the following:

the system comprises a painting brush function control, an eraser function control, a position moving function control, an area zooming function control, a page turning function control, a font conversion function control, a graphic conversion function control, a form display function control, an organization structure display function control, a color function control and a circle selection function control.

It should be noted that, when the brush function control and the selection function control execute a brush operation or a selection operation of a user, the operation is executed on the operation layer, and after the operation is completed on the operation layer, the operation is displayed on the multimedia playing interface. The operation layer can be a transparent operation layer and can also be an upper layer of a multimedia playing page.

Fig. 4 is a flowchart of a method for operating interface elements of an electronic whiteboard according to a third preferred embodiment of the present invention; as shown in fig. 4, in a case that the function control is a brush function control, in response to an operation on the brush function control, displaying the multimedia interface after the operation of the brush function control includes:

And S402, responding to a painting brush operation on an operation layer on the upper layer of the playing interface, and displaying handwriting corresponding to the painting brush operation on the multimedia playing interface.

Responding to a brush operation on an operation layer on an upper layer of the playing interface, and comprising the following steps: in response to an instruction of selecting the brush function control, calling an operation layer of the brush function control on a playing interface for displaying the multimedia, and displaying an operation window of the brush function control; and responding to the painting brush operation on the operation layer, and displaying the handwriting edited by the painting brush function control on a multimedia playing interface. The painting operation generates painting brush handwriting. The operation layer may be a transparent operation layer where the function control is located, or may be a transparent operation layer different from the layer where the function control is located.

And displaying the multimedia edited by the brush function control under the condition that the function control is the brush function control for editing the multimedia. The brush pen function control can edit information such as texts, graphs and symbols on multimedia, can edit characters, simple geometric figures or irregular graphic symbols, and can select a brush pen for editing character information. In a specific operation process, the brush editing control is generally edited in a transparent layer different from the layer where the multimedia is located, and can be edited and erased randomly in the editing process, so that the content of the multimedia is not affected and changed.

And the user performs touch operation on the transparent operation layer, and the operation is different due to the thickness, the color and the drawing track of the brush. In a time period from when editing is started to before editing is determined to be completed, undo processing and the like can be performed on the edited content, and after editing completion is determined, the transparent operation layer where the edited content is located and the layer where the multimedia is located are merged. It should be noted that, although the merging may not be performed, the processing performed on different multimedia is different. For example, if a multimedia picture is to be viewed by using a picture viewer, layers of the picture are merged, so that the advantages of effectively reducing memory, preventing data distortion and the like are achieved; if the picture editor of the patent is used for editing the picture, for example, photoshop, the two different layers are reserved, which is beneficial to editing later. And responding to the touch operation on the transparent operation layer, and displaying the playing interface of the multimedia edited by the brush function control.

Optionally, for the foregoing step, in response to a brush operation on the operation layer, displaying handwriting corresponding to the brush operation on the multimedia play interface includes: responding to the operation of a painting brush parameter of a painting brush corresponding to the painting function control, and setting the color and the thickness of the painting brush; and responding to the painting brush operation of the painting brush on the operation layer, and displaying the handwriting corresponding to the painting brush operation on a multimedia playing interface, wherein the handwriting is generated according to the set painting brush parameters.

Fig. 5 is a flowchart of a method of operating interface elements of an electronic whiteboard according to a third preferred embodiment of the present invention; as shown in fig. 5, in the case that the function control is an eraser function control, in response to an operation of the eraser function control, displaying the multimedia interface after the operation of the eraser function control includes:

and step S502, responding to the erasing operation executed by the eraser function control, and displaying an erasing track corresponding to the erasing operation on a multimedia playing interface.

And displaying the multimedia edited by the eraser function control under the condition that the function control is the eraser function control for editing the multimedia. And the multimedia played on the multimedia playing interface is erased through the erasing operation executed by the eraser function control. It should be noted that, in the embodiment, the eraser function control may erase contents of all layers, including contents of the layer where the transparent operation layer and the multimedia are located, and contents of edited layers of other function controls. In the specific operation process, different layers can be selected according to requirements, the selected layer is edited by using the eraser function control, and when the selected layer is edited, the unselected layer is not changed. Therefore, in the embodiment, the eraser function control has an erasing effect on the transparent operation layer and the content on the multimedia playing interface at the same time.

The user performs a touch operation, which is different depending on the shape, thickness, and trajectory of the eraser. In the time period from the start of editing to the time period before the completion of editing is determined, undo processing and the like may be performed on the editing, and after the completion of editing is confirmed, the edited content and the layer where the multimedia is located are merged. It should be noted that, although the merging may not be performed, the processing performed on different multimedia is different. For example, if a multimedia picture is to be viewed by using a picture viewer, layers of the picture are merged, so that the advantages of effectively reducing memory, preventing data distortion and the like are achieved; if the picture editor of the patent is used for editing the picture, the two different layers are reserved, and the subsequent editing is facilitated.

It should be noted that the above-mentioned use case where the function control is a brush function control and the use case where the function control is an eraser function control may be separate work use cases or may be combined into the same work use case at will. For example, the interface element is an interface element in a whiteboard tool. The embodiment can be applied to various occasions, such as web pages, files, documents and the like, and the preferred embodiment is applied to the whiteboard tool, so that the whiteboard tool is more convenient to use, and the user experience is stronger. In the whiteboard tool, a brush function control and an eraser function control can be called simultaneously to edit the multimedia.

Example four

According to a fourth embodiment of the present invention, an embodiment of a method for operating an interface element of an electronic whiteboard is provided, and fig. 6 is a flowchart of the method for operating an interface element of an electronic whiteboard according to the fourth embodiment of the present invention; as shown in fig. 6, it should be noted that this embodiment is specifically refined on the basis of the third embodiment, where in a case that the functionality control is a position movement functionality control, in response to an operation on the position movement functionality control, displaying a multimedia interface after the operation on the position movement functionality control includes:

step S602, in response to the operation of the mobile multimedia location executed by the location moving function control, displaying the multimedia after the mobile multimedia location on the multimedia playing interface.

It should be noted that, in this embodiment, when the function control is a position moving function control, the position moving function control may be selected in the multimedia playing interface, so that the position of the multimedia played on the multimedia playing interface is moved through an operation performed by the position moving function control to move the position of the multimedia, that is, editing the multimedia by the position moving function control.

The position function control can move the display position of the multimedia in the playing window, the multimedia can be moved by dragging the mouse, and the movement range of the multimedia can be limited by the position function control. For example, it can be defined that multimedia must be displayed in a page, and the integrity of the multimedia can be guaranteed without affecting the interpretation and use of the user.

It should be noted that, in this embodiment, the position function control may be called in a certain control form, and an operation window corresponding to the position function control may not be displayed in the play interface. For example, the position function control is called and controlled by dragging a cursor in a mouse control playing interface, zooming or moving a shortcut key of a keyboard or a combination of the two to the multimedia. And the position of the multimedia can be edited.

Fig. 7 is a flowchart of a method of operating an interface element of an electronic whiteboard according to a fourth preferred embodiment of the present invention; as shown in fig. 7, in a case that the functionality control is an area zoom functionality control, in response to the operation on the area zoom functionality control, displaying the multimedia interface after the operation on the area zoom functionality control includes:

step S702, in response to the operation of scaling the multimedia executed by the area scaling function control, displaying the multimedia after scaling on the playing interface of the multimedia.

It should be noted that, in this embodiment, when the function control is an area scaling function control, scaling the multimedia through the area scaling function control, so that the size of the multimedia played on the multimedia playing interface is scaled, and the scaled multimedia is displayed on the multimedia playing interface.

The area function control can enlarge or reduce the multimedia, the multimedia can be reduced through the operation of a user on the touch screen, for example, the double fingers are combined and slide, and the multimedia can be enlarged through the double fingers which are opened and slide. The zoom range of the multimedia may also be defined by the area functionality control. For example, the multimedia can be limited to be displayed in a page at most, or the minimum value of the multimedia can not exceed one tenth of the screen, the readability of the multimedia can be ensured, and the interpretation and the use of a user are not influenced.

It should be noted that, in this embodiment, the area function control may be invoked in a certain control form, and an operation window corresponding to the area function control may not be displayed in the play interface. For example, the area function control is called and controlled by dragging a cursor in a mouse control playing interface, zooming or moving a shortcut key of a keyboard or a combination of the two to the multimedia. The area of the multimedia can be edited.

Fig. 8 is a flowchart of a method for operating interface elements of an electronic whiteboard according to a fourth preferred embodiment of the present invention; as shown in fig. 8, in a case that the function control is a page turning function control, in response to an operation on the page turning function control, the displaying of the multimedia interface after the operation on the page turning function control includes:

Step S802, responding to the page turning operation executed by the page turning function control, and displaying the corresponding multimedia after page turning on the multimedia playing interface.

The page turning operation of the multimedia played on the multimedia playing interface is realized through the page turning operation executed by the page turning function control, so that a plurality of multimedia can be conveniently browsed.

Before the operation pages of the multimedia switching function control are displayed in the playing interface, whether the number of the multimedia is multiple needs to be judged, and if the number of the multimedia is multiple, the operation pages of the multimedia switching function control are displayed in the playing window; and under the condition that multimedia switching is needed, switching is carried out through the operation page of the multimedia switching function control. If the number of the multimedia is one, the page turning function control can be displayed and disabled, or the page turning function control is not displayed.

It should be noted that, in this embodiment, the page turning function control may be called in a certain control form, and an operation window corresponding to the page turning function control may not be displayed in the play interface. For example, the page turning function control is called and controlled by dragging a cursor in a mouse control playing interface, zooming or moving a shortcut key of a keyboard or a combination of the cursor and the shortcut key to the multimedia. The display condition of a plurality of multimedia can be edited.

Fig. 9 is a flowchart of a method of operating an interface element of an electronic whiteboard according to a fourth preferred embodiment of the present invention; as shown in fig. 9, in a case that the function control is a circle-selected function control, in response to an operation on the circle-selected function control, displaying the multimedia interface after the operation of the circle-selected function control includes:

and step S902, responding to the range selection operation executed by the selection function control, and displaying the multimedia with the selected range on the multimedia playing interface.

The circle selection function control can determine a certain circle selection range through certain actions. For example, the circle selection action may be a closed track operation on a transparent operation layer where the brush function control performs editing. The shape of the selected range may be the closed track shape or a predetermined fixed shape. For example, circular, star-shaped, heart-shaped, and other fixed shapes.

It should be noted that, in this embodiment, the circle-selected function control may be called in a certain control form, and an operation window corresponding to the circle-selected function control may not be displayed in the play interface. For example, the circle-selection function control is called and controlled by dragging a cursor in a mouse control playing interface, zooming or moving a shortcut key of a keyboard or a combination of the two to the multimedia. The display condition of a plurality of multimedia can be edited.

Fig. 10 is a flowchart of a method of operating an interface element of an electronic whiteboard according to a fourth preferred embodiment of the present invention; as shown in fig. 10, in a case that the functionality control is a font conversion functionality control, in response to an operation on the font conversion functionality control, displaying the multimedia interface after the operation of the font conversion functionality control includes:

step S1002, in response to the text touch trajectory of the font conversion function control, displaying a text corresponding to the text touch trajectory, where the text supports at least one of the following operations: zoom, move, and rotate;

step S1004, in response to the operation of confirming the insertion of the text, displaying the inserted text on the multimedia playing interface.

Through the operation of the font conversion function control, a character touch track corresponding to the operation is obtained, characters are generated according to the obtained character touch track, and the generated characters are inserted into a multimedia playing interface, so that the characters can be flexibly and conveniently inserted into the multimedia playing interface.

In addition, through the font conversion function control, the handwriting written on the intelligent interactive flat panel by the user is converted into characters with standard fonts. For example, the scribble script written by the user is converted into characters in fonts such as song style, regular script and clerical script.

It should be noted that, in this embodiment, the font conversion function control may be called in a certain control form, and an operation window corresponding to the font conversion function control may not be displayed in a play interface. For example, the font conversion function control is called and controlled by dragging a cursor in a mouse control playing interface, zooming or moving a shortcut key of a keyboard or a combination of the two to the multimedia. And editing a plurality of multimedia is realized.

Fig. 11 is a flowchart of a method of operating an interface element of an electronic whiteboard according to a fourth preferred embodiment of the present invention; as shown in fig. 11, in a case that the function control is a graphic conversion function control, in response to an operation on the graphic conversion function control, displaying the multimedia interface after the operation on the graphic conversion function control includes:

step S1102, responding to a graph touch track of the graph conversion function control, displaying a graph corresponding to the graph touch track, where the graph supports at least one of the following operations: zooming, moving, and rotating, the graphics supporting at least one of: changing color and inserting characters;

in step S1104, in response to the operation of confirming the insertion of the graphic, the inserted graphic is displayed on the play interface of the multimedia.

And obtaining a graph touch track corresponding to the operation by operating the graph conversion function control, generating a graph according to the obtained graph touch track, and inserting the generated graph into a multimedia playing interface, so that the graph can be flexibly and conveniently inserted into the multimedia playing interface.

That is, through the similar operation of the graphic conversion function control and the text conversion function control, the geometric figure corresponding to the graphic track can be determined according to the graphic track input by the user. For example, through the graphic conversion function control, the handwriting written on the intelligent interactive tablet by the user is converted into a shape of triangle, five-pointed star, regular polygon, circle, ellipse and the like.

It should be noted that, in this embodiment, the graphical conversion function control may be called in a certain control form, and an operation window corresponding to the graphical conversion function control may not be displayed in a play interface. For example, the above-mentioned graphical conversion function control is called and controlled by dragging a cursor in a mouse control playing interface, zooming or moving a shortcut key of a keyboard or a combination of the two to the multimedia. And editing a plurality of multimedia is realized.

The use condition that the function control is the brush function control, the use condition that the function control is the position function control, the use condition that the function control is the area function control and the use condition that the function control is the multimedia switching function control can be independent work use conditions or the same work use condition in any combination. For example, the interface element is an interface element in a whiteboard tool. The embodiment can be applied to various occasions such as web pages, files, documents and the like, and the preferred embodiment is applied to the whiteboard tool, so that the whiteboard tool is more convenient to use, and the user experience is stronger. In the whiteboard tool, the position moving function control and the character conversion function control can be simultaneously called to edit the multimedia.

It should be noted that, in the embodiment of the present invention, multiple function controls may also be used, for example:

and after the play exiting function control is triggered, the intelligent interactive panel exits from playing and returns to a system default interface.

After the annotation function control is triggered, the intelligent interactive panel starts an annotation function, a user can annotate on the screen-throwing interface, and the annotation content can be stored.

After the screen capture function control is triggered, the intelligent interactive panel captures the screen of the interface which is displayed by the intelligent interactive panel, and stores the picture obtained by screen capture.

After the recording function control is triggered, the intelligent interactive panel records the sound and stores the recording content after the recording is finished.

After the screen recording function control is triggered, the intelligent interaction panel records the screen, and the screen recording content is stored after the screen recording is finished.

And after the timing function control is triggered, the intelligent interactive panel starts a timing function.

EXAMPLE five

According to a fifth embodiment of the present invention, an embodiment of a method for operating an interface element of an electronic whiteboard is provided, and fig. 12 is a flowchart of the method for operating an interface element of an electronic whiteboard according to the fifth embodiment of the present invention; as shown in fig. 12, it should be noted that the present embodiment is specifically detailed based on the first embodiment, wherein in step S102, an interface element inserted with the selected multimedia is displayed on the current interface, where the interface element includes at least one of the following elements: graphs, tables, and mind maps; the method comprises the following steps:

step S1202, responding to the operation of inserting the selected multimedia into the interface element, and displaying the attribute information of the selected multimedia to be inserted into the interface element;

And step S1204, responding to the operation of modifying the attribute information of the multimedia, and displaying the modified information obtained after modifying the attribute information.

When displaying the multimedia to be selected, determining the multimedia to be inserted into the interface element, and before inserting the multimedia into the interface element, changing the information of the multimedia. In this embodiment, in a display interface for displaying multimedia to be selected, the selected multimedia is determined, and attribute information of the selected multimedia is obtained, where the attribute information includes a type of the multimedia, a name of the multimedia, a size of the multimedia, or other detailed information of the multimedia. And then the attribute information of the multimedia is changed according to the requirement. And after the attribute information of the multimedia is modified, displaying the modified multimedia attribute information.

Optionally, in response to the operation of modifying the attribute information of the multimedia, displaying the modified information obtained by modifying the attribute information includes: responding to the operation of selecting the multimedia to be inserted into the interface element, and displaying a list item corresponding to the multimedia; the attribute information of the multimedia is displayed in the list item, wherein the attribute information comprises the type of the multimedia and/or the name of the multimedia.

Before displaying the attribute information of the multimedia in the list item, the method comprises the following steps: and responding to the modification operation of the attribute information, and displaying the modified information obtained after modifying the attribute information, wherein the attribute information is the name of the multimedia, and the modified information is the modified updated name.

And establishing a list item corresponding to the multimedia according to the added multimedia, wherein the attribute information of the multimedia is stored in the list item. It should be noted that the list item may be in various forms, and may be in various diagrams such as a list shape, a tree diagram shape, a block diagram shape, and the like. The attribute information includes the type of multimedia, the name of the multimedia, the size of the multimedia, or other detailed information of the multimedia. When modifying the attribute information, firstly determining a list item of which the attribute information needs to be modified; editing the attribute information of the multimedia in the list items into the updating information of the multimedia; the update information is updated in the list items. Optionally, after the attribute information of the multimedia is modified, the modified update information of the multimedia may be displayed.

Optionally, the displaying of the modified information obtained by modifying the attribute information includes: and displaying the updated name after the multimedia name is modified. It is generally of no practical significance to modify the type, size or other details of the multimedia, so in this embodiment it is preferred to modify the name of the multimedia. And after the name of the multimedia is modified, displaying the modified updated name of the multimedia.

Example six

According to a sixth embodiment of the present invention, there is provided a preferred embodiment of a method for operating an interface element of an electronic whiteboard, and fig. 13 is a flowchart of the method for operating an interface element of an electronic whiteboard according to the sixth embodiment of the present invention; as shown in fig. 13, the method includes the steps of:

step 1301: FIG. 14 is a diagram illustrating a menu of selectable interface elements according to a sixth embodiment of the invention; fig. 15 is a diagram of an alternative multimedia selection window according to a sixth embodiment of the invention; as shown in fig. 14 and fig. 15, in an interface displaying interface elements to be inserted with multimedia, interface elements having contents, that is, the interface elements described above, for example: the shape, the form, the mind map and the like enter a multimedia selection window, namely the interface for displaying the multimedia to be selected by clicking a button or a right-click menu (a menu interface appears after right-clicking the interface element); selecting corresponding multimedia, and clicking for confirmation;

step 1302: fig. 16 is a schematic diagram of a selectable multimedia list item according to a sixth embodiment of the present invention, as shown in fig. 16, according to the multimedia selected in step 1301, obtaining a name and a path of the multimedia, generating a new list item, and displaying in the list item according to the selected multimedia type: icons of pictures, audio, video, and display multimedia names; figure 17 is a schematic diagram of an edit box of a selectable multimedia list item in accordance with a sixth embodiment of the present invention; fig. 18 is a schematic diagram of an optional edited multimedia list item according to a sixth embodiment of the present invention, and as shown in fig. 17 and fig. 18, when a cursor of a mouse is hovering over an interface range of the multimedia list item for a certain length, a "rename" button is triggered and displayed; clicking the renaming button to display a text editing box, inputting a name in the text editing box, namely modifying and updating the original file name, and clicking to confirm, setting the display name of the list item as the name input again by the user;

Step 1303: fig. 19 is a schematic diagram of an alternative picture according to a sixth embodiment of the invention; FIG. 20 is a schematic illustration of an alternative audio according to a sixth embodiment of the invention; as shown in fig. 19 and 20, clicking a list item of multimedia, creating a new window, that is, the above-mentioned interface displaying multimedia inserted into the interface element of the selected multimedia, and loading the corresponding multimedia into the window in the form of interface element (picture, audio, video can be inserted into the whiteboard), and displaying the window. The displayed multimedia can play corresponding audio and video by clicking;

step 1304: the following operations may be supported in the multimedia window:

step 13041: writing and erasing: fig. 21 is a diagram illustrating an alternative picture-based brush function control, in accordance with a sixth embodiment of the present invention; as shown in fig. 21, when a multimedia list item is clicked in an open mode in a lecture mode, the lecture mode is a case where a function control is a brush function control for editing a multimedia text, a window is displayed, and tool bars of handwriting and eraser, that is, an operation window of the brush function control, are loaded; the handwriting mode is entered when the handwriting is clicked, the handwriting can be directly written, and the color and thickness of the handwriting can be selected; the corresponding click on the eraser enters an eraser mode, and the handwriting can be erased;

Step 13042: moving: FIG. 22 is a pictorial diagram illustrating an edited picture with an optional picture-based position functionality control in accordance with a sixth embodiment of the present invention; as shown in fig. 22, a point down clicked by a mouse is obtained, a coordinate MovePoint corresponding to the mouse point is obtained when the mouse is dragged, a Vector-MovePoint-down is calculated, that is, a position variation of the mouse is obtained, a corresponding multimedia is shifted according to the Vector to complete the movement of the multimedia, and then the point down is changed into MovePoint; continuing to finish the movement of the multimedia according to the movement condition of the mouse;

step 13043: zooming in and out: FIG. 23 is a diagram illustrating an edited picture with an optional picture-based area functionality control, according to a sixth embodiment of the present invention; as shown in fig. 23, when the mouse wheel is scrolled, the magnification and reduction times are calculated according to the scrolling numerical value and applied to multimedia; similarly, when the two fingers zoom, the times of the multimedia zooming are calculated according to the moving distance of the two fingers and applied to the multimedia;

step 1305: FIG. 24 is a diagram of an alternative picture-based multimedia switching functionality control, in accordance with a sixth embodiment of the present invention; as shown in fig. 24, if a plurality of multimedia list items exist in one multimedia interface element, when a multimedia window is displayed in a lecture mode, the lecture mode is a case where a brush function control and a multimedia switching function control are simultaneously used, a page turning component (previous page/next page) is displayed, and before the window is displayed, all multimedia is loaded into the window, and according to currently clicked multimedia, the number of pages displaying the multimedia is obtained, and the clicked multimedia page and the current number of pages are displayed on an operation page of the multimedia switching function control. Fig. 25 is a schematic diagram illustrating an alternative picture-based multimedia switching function control after switching multimedia according to a sixth embodiment of the present invention; as shown in fig. 25, when the previous page button is clicked, it is determined whether the currently displayed multimedia is the first multimedia in the list, if so, the operation is not in effect, otherwise, the page number is switched to the previous page, and the previous multimedia is displayed; similarly, when the next page button is clicked, whether the currently displayed multimedia is the last multimedia in the multimedia is judged, and if so, the operation is not effective; otherwise, the page number is switched to the next page, and the next multimedia is displayed.

This scheme may be used when a user needs to add multimedia to interface elements such as shapes, brain diagrams, tables, etc.

The preferred embodiment solves the problem that common interface elements (e.g., shapes, tables, mind maps, etc.) with content cannot be added with multimedia. In the related scheme, multimedia data such as pictures, audio and video cannot be added to interface elements such as shapes or tables. The interface elements cannot complete the addition of multimedia data and only can simply display the text content. The use scenario of adding multimedia to the interface element is not considered. The preferred embodiment provides a scheme for inserting multimedia into the interface element and playing the multimedia, so that the user can insert the multimedia interface element at will, and the user experience is improved.

EXAMPLE seven

According to a seventh embodiment of the present invention, an embodiment of an interface element operating apparatus of an electronic whiteboard is provided, and fig. 26 is a schematic structural diagram of an interface element operating apparatus of an electronic whiteboard according to the seventh embodiment of the present invention; as shown in fig. 26, the interface element operating device 260 of the electronic whiteboard includes: a first display module 262, a second display module 264 and a third display module 266, which will be described in detail below with respect to the interface element operating device 260 of the electronic whiteboard.

A first display module 262, configured to display the interface element into which the selected multimedia is inserted on the current interface, where the interface element includes at least one of: graphs, tables, and mind maps; a second display module 264, connected to the first display module 262, configured to display a multimedia playing interface in response to an operation of opening the multimedia, where a function control for editing the multimedia is arranged on an upper layer of the multimedia playing interface; and a third display module 266, connected to the second display module 264, configured to, in response to the operation on the function control, display the multimedia interface after the operation on the function control is performed.

Through the interface element operating device 260 of the electronic whiteboard, the first display module 262 displays the interface element inserted with the selected multimedia on the current interface, where the interface element includes at least one of the following: graphs, tables, and mind maps; the second display module 264 responds to the operation of opening the multimedia, and displays a playing interface of the multimedia, wherein a functional control for editing the multimedia is arranged on the playing interface of the multimedia; the third display module 266 displays the operated multimedia interface of the function control in response to the operation of the function control. Because the multimedia has vivid characteristics, compared with the prior art that only text information can be inserted into interface elements, the multimedia has stronger expressive force, and the multimedia which is being played can be edited in a multimedia playing interface, so that the purposes of editing the multimedia according to the requirements of users and improving the flexibility of multimedia insertion and playing are achieved, thereby realizing the purpose of enhancing the expressive force of the interface elements, meeting the technical effects of various requirements of the users by editing the multimedia, and further solving the technical problem that the interface elements into which the multimedia is inserted can not be edited according to the requirements of the users in the prior art.

The interface element operating apparatus 260 of the electronic whiteboard further includes: the fourth display module is used for responding to the operation of displaying the interface elements and displaying the interface elements of the multimedia to be inserted; and the fifth display module is used for responding to the operation of selecting the multimedia needing to be inserted into the interface element and displaying the multimedia to be selected.

The function control of the interface element operating device 260 of the electronic whiteboard includes at least one of the following: the system comprises a painting brush function control, an eraser function control, a position moving function control, an area scaling function control, a page turning function control, a font conversion function control, a graphic conversion function control, a table display function control, an organization structure display function control, a color function control and a circle selection function control.

In a case where the function control is a brush function control, the third display module 266 includes: the first display unit is used for responding to a painting brush operation on an operation layer on an upper layer of a playing interface and displaying handwriting corresponding to the painting brush operation on the multimedia playing interface.

The first display unit of the third display module 266 includes: the first determining subunit is used for responding to the operation of a painting brush parameter of a painting brush corresponding to the painting function control and setting the color of the painting brush and the thickness of the painting brush; and the first display subunit is used for responding to the painting brush operation of the painting brush on the operation layer and displaying the handwriting corresponding to the painting brush operation on the multimedia playing interface, wherein the handwriting is generated according to the set painting brush parameters.

In the case where the functionality control is an eraser functionality control, the third display module 266 comprises: and the second display unit is used for responding to the erasing operation executed by the eraser function control under the condition that the function control is the eraser function control and displaying an erasing track corresponding to the erasing operation on a multimedia playing interface.

In the case that the functionality control is a position-shifting functionality control, the third display module 266 comprises: and the third display unit is used for responding to the position of the mobile multimedia executed by the position mobile function control under the condition that the function control is the position mobile function control and displaying the multimedia after the position of the mobile multimedia on a multimedia playing interface.

In the case where the functionality control is an area zoom functionality control, the third display module 266 comprises: and the fourth display unit is used for responding to the multimedia zooming operation executed by the area zooming function control and displaying the zoomed multimedia on the multimedia playing interface under the condition that the function control is the area zooming function control. In a case that the function control is a page turning function control, the third display module 266 includes: and the fifth display unit is used for responding to the page turning operation executed by the page turning function control under the condition that the function control is the page turning function control and displaying the corresponding multimedia after page turning on a multimedia playing interface.

In a case that the functionality control is a select-by-circle functionality control, the third display module 266 includes: and the sixth display unit is used for responding to the range circling operation executed by the circling function control and displaying the multimedia with the circled range on the multimedia playing interface under the condition that the function control is the circling function control.

In a case where the functionality control is a font conversion functionality control, the third display module 266 includes: a seventh display unit, configured to, in response to a text touch trajectory of the font conversion function control when the function control is the font conversion function control, display a text corresponding to the text touch trajectory, where the text supports at least one of the following operations: zoom, move, and rotate; and the eighth display unit is used for responding to the operation of confirming the inserted characters and displaying the inserted characters on the multimedia playing interface.

In the case that the functionality control is a graphical transition functionality control, the third display module 266 comprises: a ninth display unit, configured to, in a case that the function control is a graph conversion function control, respond to a graph touch trajectory of the graph conversion function control, display a graph corresponding to the graph touch trajectory, where the graph supports at least one of the following operations: zooming, moving and rotating, the graphics supporting at least one of: changing color and inserting characters; a tenth display unit for displaying the inserted graphics on the multimedia play interface in response to an operation of confirming the insertion of the graphics.

The interface element operating apparatus 260 of the electronic whiteboard further includes: the sixth display module is used for responding to the operation of inserting the selected multimedia into the interface element and displaying the attribute information of the selected multimedia to be inserted into the interface element; and the seventh display module is used for responding to the operation of modifying the attribute information of the multimedia and displaying the modified information obtained after modifying the attribute information.

The seventh display module of the interface element operating apparatus 260 of the electronic whiteboard includes: the eleventh display unit is used for responding to the operation of selecting the multimedia to be inserted into the interface element and displaying a list item corresponding to the multimedia; the list item displays attribute information of the multimedia, wherein the attribute information comprises the type of the multimedia and/or the name of the multimedia.

The seventh display module of the interface element operating apparatus 260 of the electronic whiteboard further includes: and the twelfth display unit is used for responding to the modification operation of the attribute information and displaying the modified information obtained after the attribute information is modified, wherein the attribute information is the name of the multimedia, and the modified information is the modified updated name.

Example eight

According to an eighth embodiment of the present invention, there is provided a processor, where the processor is configured to execute a program, where when the program is executed during running, the processor is configured to execute the method for operating an interface element of an electronic whiteboard, where the method includes: displaying an interface element inserted with the selected multimedia on the current interface, wherein the interface element comprises at least one of the following: graphs, tables, and mind maps; responding to the operation of opening the multimedia, displaying a multimedia playing interface, wherein a functional control for editing the multimedia is arranged on the upper layer of the multimedia playing interface; and responding to the operation of the function control, and displaying the multimedia interface after the operation of the function control.

Optionally, the processing may further include program code for performing the following steps: before the current interface displays the interface element inserted with the selected multimedia: responding to the operation of displaying the interface elements, and displaying the interface elements of the multimedia to be inserted; and responding to the operation of selecting the multimedia needing to be inserted into the interface element, and displaying the multimedia to be selected.

Optionally, the processing may further include program code for performing the following steps: the functionality control comprises at least one of: the system comprises a painting brush function control, an eraser function control, a position moving function control, an area scaling function control, a page turning function control, a font conversion function control, a graphic conversion function control, a table display function control, an organization structure display function control, a color function control and a circle selection function control.

Optionally, the processing may further include program code for performing the following steps: under the condition that the functional control is the painting brush functional control, responding to the operation of the painting brush functional control, and displaying the multimedia interface after the operation corresponding to the painting brush functional control is executed comprises the following steps: and responding to a painting brush operation on an operation layer on an upper layer of the playing interface, and displaying handwriting corresponding to the painting brush operation on the multimedia playing interface.

Optionally, the processing may further include program code for performing the following steps: responding to a painting brush operation on the operation layer, and displaying handwriting corresponding to the painting brush operation on a multimedia playing interface comprises the following steps: responding to the operation of a painting brush parameter of a painting brush corresponding to the painting function control, and setting the color and the thickness of the painting brush; and responding to the painting brush operation of the painting brush on the operation layer, and displaying the handwriting corresponding to the painting brush operation on a multimedia playing interface, wherein the handwriting is generated according to the set painting brush parameters.

Optionally, the processing may further include program code for performing the following steps: under the condition that the function control is the eraser function control, responding to the operation of the eraser function control, and displaying the multimedia interface after the operation corresponding to the eraser function control is executed comprises the following steps: and responding to the erasing operation executed by the eraser function control, and displaying an erasing track corresponding to the erasing operation on a multimedia playing interface.

Optionally, the processing may further include program code for performing the following steps: under the condition that the function control is the position moving function control, responding to the operation of the position moving function control, and displaying the multimedia interface after the operation corresponding to the position moving function control is executed comprises the following steps: and responding to the operation of the mobile multimedia position executed by the position mobile function control, and displaying the multimedia after the mobile multimedia position on a multimedia playing interface.

Optionally, the processing may further include program code for performing the following steps: under the condition that the function control is the area zooming function control, responding to the operation on the area zooming function control, and displaying the multimedia interface after the operation on the area zooming function control is executed comprises the following steps: and responding to the operation of zooming the multimedia executed by the area zooming function control, and displaying the zoomed multimedia on a playing interface of the multimedia.

Optionally, the processing may further include program code for performing the following steps: under the condition that the function control is the page turning function control, responding to the operation of the page turning function control, and displaying the multimedia interface after the operation of the page turning function control is executed comprises the following steps: and responding to the page turning operation executed by the page turning function control, and displaying the multimedia corresponding to the turned page on a multimedia playing interface.

Optionally, the processing may further include program code for performing the following steps: under the condition that the function control is the selection-by-circle function control, responding to the operation of the selection-by-circle function control, and displaying the multimedia interface after the operation of the selection-by-circle function control is performed comprises the following steps: and responding to the range selection operation executed by the selection function control, and displaying the multimedia with the selected range on the multimedia playing interface.

Optionally, the processing may further include program code for performing the following steps: under the condition that the function control is the font conversion function control, responding to the operation of the font conversion function control, and displaying the multimedia interface after the operation of the font conversion function control comprises the following steps: responding to a character touch track of the font conversion function control, and displaying characters corresponding to the character touch track, wherein the characters support at least one of the following operations: zoom, move, and rotate; and responding to the operation of confirming the text insertion, and displaying the inserted text on the multimedia playing interface.

Optionally, the processing may further include program code for performing the following steps: under the condition that the function control is the graphic conversion function control, responding to the operation of the graphic conversion function control, and displaying the multimedia interface after the operation of the graphic conversion function control is executed comprises the following steps: responding to a graph touch track of the graph conversion function control, and displaying a graph corresponding to the graph touch track, wherein the graph supports at least one of the following operations: zooming, moving and rotating, the graphics supporting at least one of: changing color and inserting characters; and displaying the inserted graphics on a playing interface of the multimedia in response to the operation of confirming the graphics to be inserted.

Optionally, the processing may further include program code for performing the following steps: before the current interface displays the interface element inserted with the selected multimedia, the method further comprises the following steps: responding to the operation of inserting the selected multimedia into the interface element, and displaying the attribute information of the selected multimedia to be inserted into the interface element; and responding to the operation of modifying the attribute information of the multimedia, and displaying the modified information obtained after modifying the attribute information.

Optionally, the processing may further include program code for performing the following steps: responding to the operation of modifying the attribute information of the multimedia, and displaying the modified information obtained after modifying the attribute information, wherein the modified information comprises the following steps: responding to the operation of selecting the multimedia to be inserted into the interface element, and displaying a list item corresponding to the multimedia; the attribute information of the multimedia is displayed in the list item, wherein the attribute information comprises the type of the multimedia and/or the name of the multimedia.

Optionally, the processing may further include program code for performing the following steps: before displaying the attribute information of the multimedia in the list item, the method comprises the following steps: and responding to the modification operation of the attribute information, and displaying the modified information obtained after modifying the attribute information, wherein the attribute information is the name of the multimedia, and the modified information is the modified updated name.

Example nine

According to a ninth embodiment of the present invention, there is provided an interactive intelligent device, including: a human-computer interaction device and a display device, wherein the display device comprises the interface element operating device 260 of any one of the electronic whiteboards.

From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly can be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention or portions thereof contributing to the prior art may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a robot, a personal computer, a server, or a network device, etc.) to execute the annotation display method according to any embodiment of the present invention.

It should be noted that, in the annotation display device, each unit and each module included in the annotation display device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be implemented; in addition, the specific names of the functional units are only for the convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.

It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof.

In the above embodiments, various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following technologies, which are well known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

In the description of the specification, reference to the description of "one embodiment," "some embodiments," "an example," "a specific example," or "some examples" or the like means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

It is to be noted that the foregoing description is only exemplary of the invention and that the principles of the technology may be employed. Those skilled in the art will appreciate that the present invention is not limited to the particular embodiments described herein, and that various obvious changes, rearrangements and substitutions will now be apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in some detail by the above embodiments, the invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the invention, and the scope of the invention is determined by the scope of the appended claims.

Claims

1. An interface element operation method of an electronic whiteboard is characterized by comprising the following steps:

displaying an interface element inserted with the selected multimedia on the current interface, wherein the interface element comprises at least one of the following: graphs, tables, and mind maps;

responding to the operation of opening the multimedia, displaying a multimedia playing interface, wherein a functional control for editing the multimedia is arranged on the upper layer of the multimedia playing interface;

responding to the operation of the function control, and displaying a multimedia interface after the operation corresponding to the function control is executed;

In response to an operation of selecting multimedia requiring insertion of the interface element, displaying the multimedia to be selected includes: entering a user editing window of the interface element, displaying operation options of the user on the interface element in the user editing window, and entering a multimedia selection interface for displaying multimedia to be selected according to the operation options;

before the current interface displays the interface element inserted with the selected multimedia, the method further comprises the following steps: in response to the operation of inserting the selected multimedia into the interface element, displaying attribute information of the selected multimedia to be inserted into the interface element; responding to the operation of modifying the attribute information of the multimedia, and displaying modified information obtained after modifying the attribute information;

under the condition that the functional control is a brush functional control, responding to the operation of the brush functional control, and displaying the multimedia interface after the operation corresponding to the brush functional control is executed comprises the following steps: responding to a painting brush operation on an operation layer on an upper layer of the playing interface, and displaying handwriting corresponding to the painting brush operation on the playing interface of the multimedia;

Responding to a painting brush operation on an operation layer on an upper layer of the playing interface, and displaying handwriting corresponding to the painting brush operation on the multimedia playing interface comprises the following steps: responding to an operation of selecting a brush parameter of a brush corresponding to the brush function control, and setting the color and the thickness of the brush; and responding to a painting brush operation of the painting brush on the operation layer, and displaying a handwriting corresponding to the painting brush operation on a playing interface of the multimedia, wherein the handwriting is generated according to the set painting brush parameters.

2. The method of claim 1, wherein prior to the current interface displaying the interface element into which the selected multimedia is inserted, comprising:

responding to the operation of displaying the interface elements, and displaying the interface elements to be inserted into the multimedia;

and responding to the operation of selecting the multimedia needing to be inserted into the interface element, and displaying the multimedia to be selected.

3. The method of claim 1, wherein the functionality control comprises at least one of:

the system comprises a painting brush function control, an eraser function control, a position moving function control, an area scaling function control, a page turning function control, a font conversion function control, a graphic conversion function control, a table display function control, an organization structure display function control, a color function control and a circle selection function control.

4. The method of claim 3, wherein in the case that the function control is an eraser function control, in response to an operation on the eraser function control, displaying the multimedia interface after the operation corresponding to the eraser function control is performed comprises:

and responding to the erasing operation executed by the eraser function control, and displaying an erasing track corresponding to the erasing operation on a playing interface of the multimedia.

5. The method of claim 3, wherein in a case that the functionality control is a position movement functionality control, in response to an operation on the position movement functionality control, displaying the multimedia interface on which the operation corresponding to the position movement functionality control is performed comprises:

and responding to the operation of the mobile multimedia position executed by the position mobile function control, and displaying the multimedia after the mobile multimedia position on the multimedia playing interface.

6. The method of claim 3, wherein in response to the operation of the area zoom functionality control, displaying the multimedia interface after the operation of the area zoom functionality control is performed in the case that the functionality control is an area zoom functionality control comprises:

And responding to the operation of zooming the multimedia executed by the area zooming function control, and displaying the zoomed multimedia on a playing interface of the multimedia.

7. The method according to claim 3, wherein, in a case that the function control is a page-turning function control, in response to the operation of the page-turning function control, displaying the multimedia interface after the operation of the page-turning function control is performed comprises:

and responding to the page turning operation executed by the page turning function control, and displaying the corresponding multimedia after page turning on the multimedia playing interface.

8. The method according to claim 3, wherein in a case that the function control is a circle-selected function control, in response to the operation of the circle-selected function control, displaying the multimedia interface after the operation of the circle-selected function control is performed comprises:

and responding to the selection operation executed by the selection function control, and displaying the multimedia attached with the selection handwriting corresponding to the selection operation on the playing interface of the multimedia.

9. The method of claim 3, wherein, in response to the operation of the font conversion functionality control in the case that the functionality control is a font conversion functionality control, displaying the multimedia interface after performing the operation of the font conversion functionality control comprises:

Responding to a character touch track of the font conversion function control, and displaying characters corresponding to the character touch track, wherein the characters support at least one of the following operations: zoom, move, and rotate;

and responding to the operation of confirming the text insertion, and displaying the inserted text on the multimedia playing interface.

10. The method of claim 3, wherein, in the case that the functionality control is a graphical conversion functionality control, displaying, in response to the operation of the graphical conversion functionality control, the multimedia interface after the operation of the graphical conversion functionality control is performed comprises:

responding to a graph touch track of the graph conversion function control, and displaying a graph corresponding to the graph touch track, wherein the graph supports at least one of the following operations: zooming, moving, rotating, changing color, inserting characters;

and responding to the operation of confirming the graphics to be inserted, and displaying the inserted graphics on the playing interface of the multimedia.

11. The method of claim 1, wherein, in response to the operation of modifying the attribute information of the multimedia, displaying modification information obtained by modifying the attribute information comprises:

Responding to the operation of selecting the multimedia to be inserted into the interface element, and displaying a list item corresponding to the multimedia; and displaying attribute information of the multimedia in the list item, wherein the attribute information comprises the type of the multimedia and/or the name of the multimedia.

12. The method of claim 11, wherein prior to displaying the attribute information of the multimedia in the list item, comprising:

and responding to the modification operation of the attribute information, and displaying the modified information obtained after modifying the attribute information, wherein the attribute information is the name of the multimedia, and the modified information is the modified updated name.

13. A processor configured to run a program, wherein the program when executed performs the method of any one of claims 1 to 12.

14. An interface element operating apparatus of an electronic whiteboard, comprising:

a first display module, configured to display, on a current interface, an interface element into which a selected multimedia is inserted, where the interface element includes at least one of: graphs, tables, and mind maps;

The second display module is used for responding to the operation of opening the multimedia and displaying a multimedia playing interface, and a functional control used for editing the multimedia is arranged on the upper layer of the multimedia playing interface;

the third display module is used for responding to the operation of the functional control and displaying the multimedia interface after the operation corresponding to the functional control is executed;

the device further comprises: a sixth display module, configured to display attribute information of the selected multimedia to be inserted into the interface element in response to an operation of inserting the selected multimedia into the interface element; a seventh display module, configured to display modification information obtained by modifying the attribute information in response to an operation of modifying the attribute information of the multimedia;

the third display module includes: the first display unit is used for responding to a painting brush operation on an operation layer on an upper layer of the playing interface and displaying handwriting corresponding to the painting brush operation on the multimedia playing interface under the condition that the function control is the painting brush function control;

The first display unit includes: the first determining subunit is configured to set a color and a thickness of the brush in response to an operation on a brush parameter of the brush corresponding to the brush function control; the first display subunit is configured to display, on the multimedia play interface, a handwriting corresponding to the brush operation in response to the brush operation of the brush on the operation layer, where the handwriting is generated according to the set brush parameter.

15. The apparatus of claim 14, further comprising:

the fourth display module is used for responding to the operation of displaying the interface elements and displaying the interface elements to be inserted with multimedia;

and the fifth display module is used for responding to the operation of selecting the multimedia needing to be inserted into the interface element and displaying the multimedia to be selected.

16. The apparatus of claim 14, wherein the functionality control comprises at least one of:

17. The apparatus of claim 16, wherein the third display module comprises:

and the second display unit is used for responding to the erasing operation executed by the eraser function control under the condition that the function control is the eraser function control and displaying an erasing track corresponding to the erasing operation on the multimedia playing interface.

18. The apparatus of claim 16, wherein the third display module comprises:

and the third display unit is used for responding to the position operation of the mobile multimedia executed by the position mobile function control under the condition that the function control is the position mobile function control, and displaying the multimedia after the mobile multimedia position on the multimedia playing interface.

19. The apparatus of claim 16, wherein the third display module comprises:

and the fourth display unit is used for responding to the operation of zooming the multimedia executed by the area zooming function control and displaying the zoomed multimedia on the playing interface of the multimedia under the condition that the function control is the area zooming function control.

20. The apparatus of claim 16, wherein the third display module comprises:

And the fifth display unit is used for responding to the page turning operation executed by the page turning function control under the condition that the function control is the page turning function control and displaying the corresponding multimedia after page turning on the multimedia playing interface.

21. The apparatus of claim 16, wherein the third display module comprises:

and the sixth display unit is used for responding to the range selection operation executed by the selection-circled function control under the condition that the function control is the selection-circled function control, and displaying the multimedia with the circled range on the multimedia playing interface.

22. The apparatus of claim 16, wherein the third display module comprises:

a seventh display unit, configured to, in response to a text touch trajectory of the font conversion function control when the function control is the font conversion function control, display a text corresponding to the text touch trajectory, where the text supports at least one of the following operations: zoom, move, and rotate;

and the eighth display unit is used for responding to the operation of confirming the text insertion and displaying the inserted text on the multimedia playing interface.

23. The apparatus of claim 16, wherein the third display module comprises:

a ninth display unit, configured to, in response to a graph touch trajectory of the graph conversion function control when the function control is the graph conversion function control, display a graph corresponding to the graph touch trajectory, where the graph supports at least one of the following operations: zooming, moving, rotating, changing color, inserting characters;

a tenth display unit, configured to display the inserted graphics on the multimedia playback interface in response to an operation of confirming the insertion of a graphic.

24. The apparatus of claim 14, wherein the seventh display module comprises:

the eleventh display unit is used for responding to the operation of selecting the multimedia to be inserted into the interface element and displaying a list item corresponding to the multimedia; and displaying attribute information of the multimedia in the list item, wherein the attribute information comprises the type of the multimedia and/or the name of the multimedia.

25. The apparatus of claim 14, wherein the seventh display module further comprises:

A twelfth display unit, configured to display modification information obtained by modifying the attribute information in response to a modification operation on the attribute information, where the attribute information is a name of the multimedia, and the modification information is an updated name after modification.

26. An interactive smart device, the interactive smart device comprising: a human-computer interaction device and a display apparatus comprising the interface element operating apparatus of an electronic whiteboard of claim 14 or 25.