WO2021068412A1 - Procédé et appareil d'interaction associés à une tablette d'interaction intelligente, dispositif terminal et support d'informations - Google Patents

Procédé et appareil d'interaction associés à une tablette d'interaction intelligente, dispositif terminal et support d'informations Download PDF

Info

Publication number
WO2021068412A1
WO2021068412A1 PCT/CN2019/126815 CN2019126815W WO2021068412A1 WO 2021068412 A1 WO2021068412 A1 WO 2021068412A1 CN 2019126815 W CN2019126815 W CN 2019126815W WO 2021068412 A1 WO2021068412 A1 WO 2021068412A1
Authority
WO
WIPO (PCT)
Prior art keywords
display window
file display
file
label
association
Prior art date
Application number
PCT/CN2019/126815
Other languages
English (en)
Chinese (zh)
Inventor
古意昌
Original Assignee
广州视源电子科技股份有限公司
广州视臻信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视臻信息科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2021068412A1 publication Critical patent/WO2021068412A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Definitions

  • This application relates to the technical field of smart interactive tablets, for example, to interactive methods, devices, terminal devices, and storage media of smart interactive tablets.
  • the intelligent interactive tablet is one of the representative integrated devices, which is suitable for group interaction occasions such as conferences, teaching, and commercial exhibitions. This kind of equipment integrates multiple functions such as projectors and video conferences.
  • the whiteboard application is a very frequently used application on the smart interactive tablet.
  • This application refers to the user interface presented during the use of the whiteboard application as the whiteboard Application interface
  • the whiteboard application can be used to obtain the operation of the user's finger or writing pen on the whiteboard application interface, and obtain multiple touch points according to the user's operation, and generate the user's writing handwriting based on the touch points. It can also be used on the whiteboard application interface Insert graphics, pictures, tables and other multimedia elements.
  • there are often third-party files that display different types of files through the file display window such as image files, table files, multimedia files, etc.
  • the third-party files displayed in the file display window are usually used for display during the event Activity focus, and based on the file display window to perform corresponding activity recording on the whiteboard application interface.
  • each file display window serves as an independent display element to display different third-party files, it is adapted to the activity record during the activity.
  • the display position of the writing range of each is adjusted, and there are more operations in the adjustment process.
  • This application provides an interactive method, device, terminal device, and storage medium for an intelligent interactive tablet to solve the technical problem that the position adjustment operation of the file display window during the use of the related technology whiteboard application has a large number of operations.
  • this application provides an interactive method for a smart interactive tablet, including:
  • the moving operation moves the file display window, and when the file display window after the move is over overlaps the associated tag, establish the file display window and the associated tag
  • the association relationship of the associated label is described, and the same association identifier is displayed correspondingly.
  • the interaction method further includes:
  • the associated label includes a preview control
  • the interaction method further includes:
  • the thumbnail of the file display window currently associated with the associated label is displayed.
  • the interaction method further includes:
  • the interaction method further includes:
  • the display layout of the file display window currently associated with the associated label is adjusted according to the layout mode selected by the layout operation.
  • the associated identification is a color identification.
  • the color identification is displayed on the frame and/or the shadow of the frame of the file display window and the associated label.
  • Each associated label corresponds to a different associated identifier.
  • this application provides an interactive device for a smart interactive tablet, including:
  • the associated operation receiving unit is configured to receive window associated operations that occur on the whiteboard application interface, where the whiteboard application interface displays a file display window for displaying third-party files;
  • An associated label display unit configured to display an associated label on the whiteboard application interface
  • the association relationship establishment unit is configured to receive a moving operation on the file display window, the moving operation moves the file display window, and establishes when the file display window after the movement is over overlaps the associated label
  • the associated relationship between the file display window and the associated label is correspondingly displayed with the same associated identifier.
  • the interaction device further includes:
  • the associated moving unit is configured to move the associated tag and the display position of the file display window currently associated with the associated tag when receiving a moving operation on the associated tag.
  • the associated label includes a preview control
  • the interaction device further includes:
  • the window browsing unit is configured to display a thumbnail of the file display window currently associated with the associated label when receiving a trigger operation on the preview control.
  • the interaction device further includes:
  • the relationship canceling unit is configured to cancel the relationship between the file display window corresponding to the thumbnail and the associated label when a trigger operation on the thumbnail is received.
  • the interaction device further includes:
  • the layout adjustment unit is configured to adjust the display layout of the file display window currently associated with the associated label according to the layout mode selected by the layout operation when the layout operation on the associated label is received.
  • the associated identification is a color identification.
  • the color identification is displayed on the frame and/or the shadow of the frame of the file display window and the associated label.
  • Each associated label corresponds to a different associated identifier.
  • this application also provides a terminal device, including:
  • One or more processors are One or more processors;
  • Memory used to store one or more programs
  • the one or more processors When the one or more programs are executed by the one or more processors, the one or more processors implement the interactive method of the smart interactive tablet according to any one of the first aspect.
  • the present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the interactive method of the smart interactive tablet as described in any one of the first aspects is realized.
  • the interactive method, device, terminal device and storage medium of the above-mentioned smart interactive tablet receive a window associated operation that occurs on the whiteboard application interface, and the whiteboard application interface displays a file display window for displaying third-party files; in the whiteboard application The associated label is displayed on the interface; the moving operation of the file display window is received, the moving operation moves the file display window, and when the file display window after the movement ends overlaps the associated label, the all The associated relationship between the document display window and the associated label is displayed, and the same associated identifier is correspondingly displayed.
  • Add associated tags in the whiteboard application interface and associate the file display windows that overlap with the associated tags after dragging and the associated tags.
  • the release operation of the association relationship is also convenient to adjust the association relationship at any time according to the use requirements, and the different expressions between different association relationships also facilitate the user to quickly confirm the target association label that needs to be operated and the corresponding file display window.
  • FIG. 1 is a flowchart of an interaction method of a smart interactive tablet provided in Embodiment 1 of this application;
  • FIG. 2 is a schematic diagram of a touch input interface of a smart interactive tablet according to Embodiment 1 of the application;
  • FIG. 3 is a schematic diagram of a file display operation provided by an embodiment of the application.
  • FIG. 4 is a schematic diagram of a file display window provided by an embodiment of the application.
  • FIG. 5 is a schematic diagram of associated tags and multiple file display windows provided by an embodiment of the application.
  • FIG. 6 is a schematic diagram of overlapping of a file display window and an associated label provided by an embodiment of the application
  • FIG. 7 is a flowchart of an interaction method of a smart interactive tablet provided in Embodiment 2 of this application.
  • FIG. 8 and FIG. 9 are schematic diagrams before and after the movement of the associated label provided by the embodiment of the application.
  • FIGS. 10 and 11 are schematic diagrams before and after the file display window is moved according to an embodiment of the application.
  • FIG. 12 is a schematic diagram of a preview control provided by an embodiment of the application.
  • FIG. 13 is a schematic diagram of automatically adjusting the display layout of the file display window according to the layout mode provided by the embodiment of the application;
  • FIG. 14 is a schematic structural diagram of an interactive device of a smart interactive tablet provided in Embodiment 3 of this application.
  • FIG. 15 is a schematic structural diagram of a terminal device provided in Embodiment 4 of this application.
  • a technical feature is recorded: when the window association control is triggered, it is confirmed that the association between certain file display windows needs to be established.
  • another technical feature is recorded: the association label and the file display window are only confirmed to establish an association relationship when they partially overlap. Since the above two technical features are not inconsistent with each other, those skilled in the art should be able to think of after reading the description of this application that the implementation with these two features at the same time is also an optional implementation, that is, when the window associated control is triggered When you confirm that you need to establish an association relationship between certain file display windows, drag the file display window, and the association label and the file display window will only be confirmed to establish an association relationship when they partially overlap.
  • the association relationship between the file display window corresponding to the thumbnail and the associated tag is released.
  • this feature is not described.
  • the interactive method of the smart interactive tablet provided in the first embodiment may also include this feature, that is, when there is an association relationship between the document display window and the associated tag
  • the association relationship between the file display window corresponding to the thumbnail and the associated tag is released.
  • FIG. 1 is a flowchart of an interaction method of a smart interactive tablet provided in Embodiment 1 of this application.
  • the interactive method of the smart interactive tablet provided in the embodiments can be executed by the interactive device of the smart interactive tablet.
  • the interactive device of the smart interactive tablet can be implemented by software and/or hardware.
  • the interactive device of the smart interactive tablet can be two Or it can be composed of multiple physical entities, or it can be composed of one physical entity.
  • the interactive device of the smart interactive tablet may be a mobile phone, an industrial control computer, and so on.
  • the smart interactive tablet is used as the actual carrier to exemplarily describe the detailed process of adjusting target selection, association, and response adjustment when the interactive method of the smart interactive tablet is implemented.
  • the smart interactive tablet can be an integrated device that controls the content displayed on the display tablet through touch technology and realizes human-computer interaction. It integrates a projector, an electronic whiteboard, a screen, a sound, a TV, and a video conference. One or more functions such as a terminal.
  • the smart interactive tablet 1 includes at least one display screen.
  • the smart interactive tablet 1 is equipped with a display screen with touch function, and the display screen may be a capacitive screen, a resistive screen or an electromagnetic screen.
  • a smart interactive tablet is provided.
  • the user can implement touch operations by touching the display screen with a finger or a stylus.
  • the smart interactive tablet detects the touch position and responds according to the touch position , In order to realize the touch function.
  • the smart interactive tablet is installed with at least one operating system, where the operating system includes but is not limited to the Android system, the Linux system, and the Windows system.
  • the smart interactive tablet can install at least one application with a writing function.
  • the application program may be an application program that comes with the operating system, and at the same time, an application program downloaded from a third-party device or server is also installed.
  • the application also has other editing functions, such as inserting tables, inserting pictures, illustration graphics, drawing tables, and drawing graphics.
  • the drawn table or figure is a standard element drawn by the computer.
  • Computer-drawn standard elements can be understood as printed standard elements drawn by the intelligent interactive tablet, which are different from the elements written by the user.
  • the touch screen can sense changes in current, voltage, or magnetic flux (corresponding to the specific setting type of capacitive touch screen, resistive touch screen or electromagnetic touch screen), and get the touch signal containing the coordinates of the touch position And the trigger time of the touch signal, according to the coordinates of the touch position and the trigger time of the touch signal, the trajectory data of the writing trajectory input during each time the stylus or the user’s finger is pressed to write until the writing stops are lifted, according to the trajectory
  • the data displays the writing track input by the user in the writing area of the touch screen in real time.
  • the writing process is not limited to writing, and any input process for displaying the operation track implemented on the touch screen of the smart handwriting device can be regarded as a writing process.
  • the touch operation can respond to the user's click, drag, and other operations. These different response methods are the same in the underlying coordinate processing.
  • the area where the touch writing occurs overlaps the area where the display is located, that is, the display area 2 shown in FIG. 2.
  • the functions of the whiteboard application can be further realized on the smart interactive tablet.
  • the embodiments of the solution are the implementation of the whiteboard application.
  • the interactive method of the smart interactive tablet specifically includes:
  • Step S101 Receive a window association operation that occurs on the whiteboard application interface, where the whiteboard application interface displays a file display window for displaying third-party files.
  • Application interface refers to an interactive interface used by an application to receive and/or display information, such as a video playback application, whose interactive interface is mainly used to display changing video images; for real-time communication applications, its interactive interface is mainly used to receive recent information.
  • the content input by the end user and the content input by the remote user are displayed;
  • the interactive interface of the file editing application is mainly used to receive and display the content input by the user;
  • the interactive interface of the browser application is mainly used to receive the user input And display the content of the webpage based on the keyword.
  • the specific application interface refers to the user interface presented during the use of the whiteboard application, that is, the whiteboard application interface.
  • the whiteboard application refers to the application for users to write, display and other operations. It can be used to generate writing handwriting based on the user's writing track on the whiteboard application interface, and can also be used to insert graphics, pictures, and pictures on the whiteboard application interface. Other multimedia elements such as tables.
  • users can implement operations such as writing, drawing, and erasing similar to a physical blackboard, and further have better digital functions such as moving, saving, zooming, inserting pictures, color adjustment, and stroke thickness setting.
  • Writing-based operations in whiteboard applications are mature implementations of related technologies and will not be described in detail in this solution.
  • the whiteboard application can also be named as writing application, electronic whiteboard application, collaborative whiteboard application, etc. No matter how the name is changed, as long as the application is used to realize the above functions, it is equivalent to the whiteboard application of this application.
  • the whiteboard application is usually displayed in full screen, that is, the whiteboard application will fill the display area 2 of the smart interactive tablet 1 in FIG. 2.
  • the subsequent drawings only illustrate the display change of the display area 2.
  • the content displayed in the whiteboard application interface 20 in addition to writing added content and inserted content displayed during use (not shown in Figure 3), there are also various tool controls for operating the above content.
  • These tool controls are normally displayed on the toolbar 21 in the whiteboard application interface 20.
  • the toolbar 21 is displayed at the bottom of the whiteboard application interface 20, and can also be on the left and/or right in the actual layout. , And even a comprehensive display on the left, right and bottom.
  • Some tool controls in the toolbar 21 correspond to the digital realization of the physical blackboard functions, such as writing, erasing, turning pages (only available on some physical blackboards), etc., and some tool controls are functional supplementary controls implemented on the basis of the whiteboard application, such as cancel Input, restore input, handwriting selection, insert, etc.
  • Figure 3 illustrates an operation method for opening a third-party file in the file display window.
  • a tool control for inserting a file is set in the toolbar 21.
  • the file will pop up.
  • the files and subfolders in the default folder or the most recently opened folder are displayed in the file list interface 24.
  • the selected file in the file list interface 24 can be a selected operation of a certain file (including the icon area and the file name area) in the file list interface 24, such as single-finger touch click, multi-finger touch click, etc.; It may be that the file is dragged from the file list interface 24 to an area outside the file list interface 24 in the whiteboard application interface 20.
  • the way of dragging and selecting is illustrated in FIG. 3. That is to say, the file display window formed by inserting a file implemented in the whiteboard application interface 20 is a combination of multiple actions, including at least triggering the file insertion control to pop up the file list interface 24 and the file list interface 24 for a specific For file selection, the display effect of the third-party file in the file display window 22 is shown in FIG. 4.
  • file display window mentioned in this embodiment is not limited to the window formed by inserting a file, and any other window used to display a third-party file, or to record specific input content (such as writing track) is customized All display windows belong to the implementation object of this interactive method.
  • the window association operation in this embodiment may be triggered based on the controls of the toolbar 21.
  • the controls such as erasing, turning pages, canceling input, restoring input, handwriting selection, inserting, etc., which implement normal functions during the use of the whiteboard application, there can also be window-related controls.
  • window association control When the window association control is triggered, it is confirmed that the association relationship between certain file display windows needs to be established.
  • Window association operations can also be triggered based on touch gestures. The trigger window association is confirmed when a specific gesture is detected on the whiteboard application interface 20, such as sliding a preset distance in a set direction with one or more fingers, or continuous tapping with one or more fingers. repeatedly.
  • Step S102 Display an associated label on the whiteboard application interface.
  • the associated label 23 is a display area on the whiteboard application interface.
  • the overlap state of the file display window 22 and the associated label 23 will be detected, and This overlap state is used as the basis for determining subsequent responses. That is to say, the associated label 23 does not have a complex content presentation requirement, and is only used as a reference for user operations. Therefore, the associated label 23 can be set to a smaller size, such as 3 cm in length and width. And 2cm, can reduce the display area while smoothly implementing the operation reference, and avoid the influence on other display contents.
  • Association prompts may be displayed in the association tab 23, which is shown as Group in FIG.
  • the association label is the user operation guide for establishing the association relationship and the background association confirmation reference, that is, it guides the user to drag the file display window to which position to establish the association relationship.
  • the background will start from the data when the set position relationship is recognized. Establish and save the relationship at the level.
  • the associated label can be displayed as a graphic of any shape, shown as a rectangular frame in FIG. 5, of course, it can also be in other shapes such as a circle or a square. In FIG. 5, a file display window 22a, a file display window 22b, and a file display window 22c are displayed. The process of establishing the association relationship between the three file display windows will be described in detail later.
  • the display level of the associated label can be further higher than the file display window, because the associated label is smaller than the file display window, and the user can clearly observe the The overlapping state of the file display window.
  • Step S103 Receive a moving operation on the file display window, the moving operation moves the file display window, and when the file display window after the move is over overlaps the associated tag, the file display is established The associated relationship between the window and the associated label, and correspondingly display the same associated identifier.
  • the movement of the file display window may be implemented due to various display requirements.
  • the purpose of the display can be to compare and explain with the display elements input in the whiteboard application interface in real time or the third-party file opened first, and the file display window may just cover the need for comparison.
  • the display position of the file display window can be adjusted by moving the file display window at this time.
  • the file display window can be adjusted in exactly the same display position following the movement track of the moving operation, that is, part of the file display window may not be displayed in the whiteboard application interface; it can also be the file display window following the moving operation.
  • the movement trajectory is adjusted within a certain constrained range. For example, the file display window will follow the movement trajectory to move to the boundary of the whiteboard application interface at most, and then the movement component of the movement trajectory in this direction, the document display window will no longer follow the movement to maintain the file The complete display of the display window.
  • the file display window follows the movement track to adjust the display position exactly, but when the boundary of the file display window moves outside the set boundary of the whiteboard application interface After the moving operation ends, the file display window is restored to the whiteboard application interface to be displayed, which can specifically add action effects to the restoration process, such as bounce, move, etc.
  • the movement of establishing the association relationship in this embodiment is the same as the operation process of real-time adjustment for display, and the difference lies in the further response after the movement.
  • FIG. 6 on the basis of FIG. 5, for the file display window 22a, file display window 22b, and file display window 22c that need to establish an association relationship with the associated tag 23, drag them to positions that overlap with the associated tag 23 in sequence , The establishment of the association relationship of the remaining association tags 23 is confirmed.
  • the file display window can remain in the position after the move, or it can be restored to the position before the move. If the latter realistic method is adopted, it is equivalent to the move process is only used for the establishment of the association relationship, without changing the file display window.
  • the current display position to avoid overlap between file display windows.
  • the specific overlap judgment it can be that as long as there is an overlap between the associated label and the file display window, it is confirmed that the association relationship is established, as shown in Figure 6 is based on this judgment method; it can also be that the associated label and the file display window only partially overlap
  • the reason for this judgment method is that there are multiple associated tags in the whiteboard application interface 20 itself, or the purpose of moving the file display window is to move the file display window to the area where the associated tags are located (for example, After moving, the associated tags are all located in the file display window), but there is no need to establish an association relationship.
  • the partial overlap judgment is equivalent to further constraining the judgment condition, which improves the accuracy of establishing the association relationship and avoids the conventional moving process Establish unnecessary relationships.
  • each associated label and file display window has a corresponding element identifier.
  • the association relationship between the associated tag and the element identifier corresponding to the file display window is established, and the association relationship is maintained and stored through an array, list or other data structure.
  • Subsequent operations on the associated tags at the front end are fed back to the front-end file display window through the association relationship between the element identifiers in the background.
  • the association relationship is specifically characterized by an association identifier, so that the user can visually confirm the establishment of the current association relationship.
  • the establishment of the association relationship and subsequent maintenance are the overall design for specific application scenarios during the actual use of the whiteboard application. For example, before certain meetings, teaching, seminars and other activities, multiple existing documents will be prepared as the focus of the activity for comparison display and comparison discussion. When the actual activity is carried out, the existing documents will be displayed through the document display window on the whiteboard application interface. In the course of the activity, take notes, opinions, outlines, etc. on the whiteboard application interface for the displayed content, and finally generate a complete activity record. In the process of adding records continuously, because the blank area needs to be continuously adjusted for recording, the display position of the file display window for comparison display may be adjusted at the same time. At this time, batch processing of the file display windows can be realized based on the association relationship.
  • the whiteboard application interface displaying a file display window for displaying third-party files; displaying an associated label on the whiteboard application interface; receiving a movement of the file display window Operation, and the end position of the file display window moved following the movement operation overlaps the associated label, establish an association relationship between the file display window and the associated tag, and the association relationship is through the same association Logo for characterization.
  • Add associated tags in the whiteboard application interface and associate the file display windows that overlap with the associated tags after dragging and the associated tags.
  • FIG. 7 is a flowchart of an interaction method of a smart interactive tablet provided in the second embodiment of the application. This embodiment is embodied on the basis of the above-mentioned embodiment.
  • the interactive method of the smart interactive tablet specifically includes:
  • Step S201 Receive a window association operation that occurs on the whiteboard application interface, where the whiteboard application interface displays a file display window for displaying third-party files.
  • Step S202 Display an associated label on the whiteboard application interface.
  • Associated label processing is based on the guidance of establishing an association relationship, and there can also be a design to achieve a richer interaction scheme.
  • the associated label includes a preview control, and when the preview control is triggered, the list displays the file display window currently associated with the associated label.
  • the associated identification can be realized through color identification. That is, the file display windows that have an association relationship with the same associated tag display the same color, and the color identification can be displayed on the frame and/or frame shadow of the file display window and the associated tag, and can also be displayed as the color fill of the associated tag. The color filling of the title bar of the file display window, etc.
  • each associated label corresponds to a different associated identifier.
  • file display windows that are associated with a certain associated label are distinguished by the same associated identifier, for example, by different The color identification is distinguished.
  • Step S203 Receive a moving operation on the file display window, the moving operation moves the file display window, and when the file display window after the move is over overlaps with the associated tag, establish the file display window and The association relationship of the associated tags is correspondingly displayed with the same association identifier.
  • Step S204 When a moving operation on the associated tag is received, follow the moving associated tag and the display position of the file display window currently associated with the associated tag.
  • the moving operation of the associated label is similar to the implementation of the moving operation of the file display window in the first embodiment. The only difference is that the moving operation of the associated label can move the display position of the associated label and its currently associated file display window.
  • the move operation of the file display window can only move the file display window specified by the move operation.
  • the moving operation of the associated tag 23 can simultaneously affect the file display window 22a, file display window 22b, and file display window 22c with which it has an association relationship. That is, in response to the moving operation shown in FIG.
  • the effect of the movement of the label 23, the file display window 22a, the file display window 22b, and the file display window 22c is shown in FIG. 9. As shown in FIG.
  • the moving operation of the file display window 22b can only affect the file display window 22b.
  • the associated label 23, the file display window 22a, and the file display window 22c are not affected by it, and still remain in the original display position.
  • the effect after the move is shown in Figure 11.
  • the individual movement of a single file display window ensures that the operation of local adjustment requirements between the file display windows that have an association relationship is realized. For example, after the associated label and the file display window are moved as a whole, because the display area of the moved display element is relatively large, the display requirements are generally met after the whole move to the target display position, but a file display window may affect other displays in a small area For the display of elements, at this time, the display influence on other display elements can be eliminated by moving the file display window separately.
  • Step S205 When a trigger operation on the preview control is received, the thumbnail of the file display window currently associated with the associated tag is displayed.
  • the preview control is specifically presented as a triangular control button in the associated label 23.
  • the triangular control button is only a presentation mode adopted in FIG. 12, and is not the only limitation on the specific presentation mode.
  • thumbnails of all file display windows currently associated with the associated label 23 are displayed. That is, if the triangle control button in Figure 12 is triggered, the thumbnails of the file display window 22a, file display window 22b, and file display window 22c will pop up below the triangle control button to complete the display, and the corresponding file display window will be displayed in the thumbnail. Screenshot of.
  • the display window of all the associated files of a certain associated label can be realized. confirm.
  • Step S206 When a trigger operation on the thumbnail is received, the association relationship between the file display window corresponding to the thumbnail and the associated tag is released.
  • the thumbnail not only exists as a preview picture, but also is a control control.
  • the association relationship between the file display window corresponding to the thumbnail and the associated label will be released.
  • the interaction between it and the associated label 23 is mainly to establish an association relationship and disassociate the association relationship. Based on the current association relationship that has been established, the association relationship can be dismissed directly by triggering the thumbnail.
  • the trigger operation of thumbnails can disassociate the association relationship when a certain file display window is no longer needed for the current display link, so as to avoid unnecessary subsequent overall movement of the associated label and its associated file display window.
  • Mobile interference thereby reducing the display area of all moving display elements, reducing the requirement for the blank area of the target display position of the mobile operation, and improving the adaptability of the display position during the overall movement.
  • Step S207 When receiving the layout operation on the associated label, adjust the display layout of the file display window currently associated with the associated label according to the layout mode selected by the layout operation.
  • the file display window after the file display window has established a relationship with the associated label, it can be displayed at the position after the move operation, or it can be displayed at the position before the move operation, as shown in Figure 6 is the position after the display and move operation, for convenience Quickly adjust the layout of multiple file display windows. You can add additional layout controls in the associated tab 23. When the layout controls are triggered, multiple layout methods will pop up. After the layout method is selected, as shown in Figure 13, the currently associated file display window is Associated tags are for reference, and they are automatically adjusted according to the layout method to complete the corresponding display layout, realizing a fast and standard layout process.
  • the overall display of multiple file display windows has shortcomings (overly concentrated, overlapping or too scattered display messy), At this time, a centralized and complete display state can be obtained through automatic layout, which improves the use efficiency of the display area of the whiteboard application interface, and does not affect the complete display of a single file display window.
  • any step can be executed at any time as long as the associated label is currently displayed.
  • the release operation of the association relationship is also convenient to adjust the association relationship at any time according to the use requirements, and the different expressions between different association relationships also facilitate the user to quickly confirm the target association label to be operated and the corresponding file display window.
  • FIG. 14 is a schematic structural diagram of an interactive device of a smart interactive tablet provided in the third embodiment of the application.
  • the interactive device of the smart interactive tablet includes: an associated operation receiving unit 301, an associated label display unit 302, and an associated relationship establishing unit 303.
  • the associated operation receiving unit 301 is used to receive window associated operations that occur on the whiteboard application interface, and the whiteboard application interface displays a file display window for displaying third-party files;
  • the associated label display unit 302 is used to display the whiteboard An association label is displayed on the application interface;
  • the association relationship establishment unit 303 is configured to receive a movement operation on the file display window, the movement operation moves the file display window, and when the movement ends, the file display window and the file display window When the associated tags overlap, an association relationship between the file display window and the associated tags is established, and the same associated identifiers are displayed correspondingly.
  • the interaction device further includes:
  • the associated moving unit is configured to move the associated tag and the display position of the file display window currently associated with the associated tag when receiving a moving operation on the associated tag.
  • the associated label includes a preview control
  • the interaction device further includes:
  • the window browsing unit is configured to display a thumbnail of the file display window currently associated with the associated label when receiving a trigger operation on the preview control.
  • the interaction device further includes:
  • the relationship canceling unit is configured to cancel the relationship between the file display window corresponding to the thumbnail and the associated label when a trigger operation on the thumbnail is received.
  • the interaction device further includes:
  • the layout adjustment unit is configured to adjust the display layout of the file display window currently associated with the associated label according to the layout mode selected by the layout operation when the layout operation on the associated label is received.
  • the association identification is a color identification.
  • the color identification is displayed on the frame and/or the shadow of the frame of the file display window and the associated label.
  • each associated label corresponds to a different associated identifier.
  • the interactive device of the smart interactive tablet provided by the embodiments of the present application is included in the interactive device of the smart interactive tablet, and can be used to execute any of the interactive methods of the smart interactive tablet provided in the first and second embodiments above, and has corresponding functions And beneficial effects.
  • the terminal device is a specific hardware presentation solution of the interactive device of the smart interactive tablet described above.
  • the terminal device includes a processor 410, a memory 420, an input device 430, an output device 440, and a communication device 450; the number of processors 410 in the terminal device may be one or more.
  • the processor 410 is taken as an example; the processor 410, the memory 420, the input device 430, the output device 440, and the communication device 450 in the terminal device may be connected by a bus or other means. The connection by a bus is taken as an example in FIG. 15.
  • the memory 420 can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the interactive method of the smart interactive tablet in the embodiment of the present application (for example, the smart interactive tablet’s
  • the processor 410 executes various functional applications and data processing of the terminal device by running the software programs, instructions, and modules stored in the memory 420, that is, realizes the aforementioned interactive method of the smart interactive tablet.
  • the memory 420 may mainly include a program storage area and a data storage area.
  • the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the terminal device.
  • the memory 420 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices.
  • the memory 420 may include a memory remotely provided with respect to the processor 410, and these remote memories may be connected to the terminal device through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.
  • the input device 430 may be used to receive inputted digital or character information, and generate key signal input related to user settings and function control of the terminal device.
  • the output device 440 may include a display device such as a display screen.
  • the above-mentioned terminal equipment includes an interactive device of an intelligent interactive tablet, which can be used to execute any interactive method of an intelligent interactive tablet, and has corresponding functions and beneficial effects.
  • the embodiment of the present application also provides a storage medium containing computer-executable instructions, when the computer-executable instructions are executed by a computer processor, they are used to execute the relevant interaction methods of the smart interactive tablet provided in any embodiment of the present application. Operation, and has corresponding functions and beneficial effects.
  • this application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware.
  • this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
  • This application is described with reference to flowcharts and/or block diagrams of methods, devices (systems), and computer program products according to embodiments of this application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions.
  • These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • the computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • the memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM).
  • RAM random access memory
  • ROM read-only memory
  • flash RAM flash memory
  • Computer-readable media include permanent and non-permanent, removable and non-removable media, and information storage can be realized by any method or technology.
  • the information can be computer-readable instructions, data structures, program modules, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage, Magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media can be used to store information that can be accessed by computing devices. According to the definition in this article, computer-readable media does not include transitory media, such as modulated data signals and carrier waves.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne un procédé et un appareil d'interaction associés à une tablette d'interaction intelligente, un dispositif terminal et un support d'informations. Le procédé consiste à : recevoir une opération d'association de fenêtre se produisant au niveau d'une interface d'application de tableau blanc, l'interface d'application de tableau blanc affichant une fenêtre de présentation de fichier permettant de présenter un fichier tiers (S101) ; afficher une étiquette d'association sur l'interface d'application de tableau blanc (S102) ; et recevoir une opération de déplacement appliquée à la fenêtre de présentation de fichier, déplacer la fenêtre de présentation de fichier au moyen de l'opération de déplacement et, lorsque la fenêtre de présentation de fichier chevauche l'étiquette d'association à la fin du déplacement, établir une relation d'association entre la fenêtre de présentation de fichier et l'étiquette d'association et afficher de manière correspondante le même identifiant d'association (S103).
PCT/CN2019/126815 2019-10-09 2019-12-20 Procédé et appareil d'interaction associés à une tablette d'interaction intelligente, dispositif terminal et support d'informations WO2021068412A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910953554.6A CN110941373B (zh) 2019-10-09 2019-10-09 智能交互平板的交互方法、装置、终端设备和存储介质
CN201910953554.6 2019-10-09

Publications (1)

Publication Number Publication Date
WO2021068412A1 true WO2021068412A1 (fr) 2021-04-15

Family

ID=69905816

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/126815 WO2021068412A1 (fr) 2019-10-09 2019-12-20 Procédé et appareil d'interaction associés à une tablette d'interaction intelligente, dispositif terminal et support d'informations

Country Status (2)

Country Link
CN (1) CN110941373B (fr)
WO (1) WO2021068412A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111580903B (zh) * 2020-04-20 2023-09-12 广州视源电子科技股份有限公司 实时投票方法、装置、终端设备和存储介质
CN112462999B (zh) * 2020-10-30 2022-05-24 北京数秦科技有限公司 显示方法、装置以及存储介质
CN113741844B (zh) * 2021-09-02 2024-02-27 杭州车厘子智能科技有限公司 一种基于智能移动终端的交互系统及交互方法
CN114040242B (zh) * 2021-09-30 2023-07-07 荣耀终端有限公司 投屏方法、电子设备和存储介质
CN116795262A (zh) * 2023-08-11 2023-09-22 江苏中威科技软件系统有限公司 一种在白板上聚类多元化工具的装置及方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101739196A (zh) * 2008-11-25 2010-06-16 富士施乐株式会社 工作空间管理方法及工作空间管理系统
US20120278756A1 (en) * 2011-04-26 2012-11-01 Google Inc. Mobile browser context switching
CN103455244A (zh) * 2013-08-18 2013-12-18 苏州量跃信息科技有限公司 窗口间光标转换的方法及客户端
US20140149908A1 (en) * 2012-11-28 2014-05-29 Samsung Electronics Co., Ltd Method for displaying applications and electronic device thereof
CN108132742A (zh) * 2013-05-06 2018-06-08 北京三星通信技术研究有限公司 一种终端设备及其关联窗口的显示方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8854395B2 (en) * 2009-07-30 2014-10-07 Intellectual Ventures Fund 83 Llc Method for producing artistic image template designs
US20120066628A1 (en) * 2010-09-09 2012-03-15 Microsoft Corporation Drag-able tabs
CN106708368A (zh) * 2016-12-30 2017-05-24 深圳天珑无线科技有限公司 应用图标管理方法及装置
CN110083292B (zh) * 2019-04-25 2020-03-27 安徽文香信息技术有限公司 界面窗口显示的控制方法、装置、存储介质及电子黑板

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101739196A (zh) * 2008-11-25 2010-06-16 富士施乐株式会社 工作空间管理方法及工作空间管理系统
US20120278756A1 (en) * 2011-04-26 2012-11-01 Google Inc. Mobile browser context switching
US20140149908A1 (en) * 2012-11-28 2014-05-29 Samsung Electronics Co., Ltd Method for displaying applications and electronic device thereof
CN108132742A (zh) * 2013-05-06 2018-06-08 北京三星通信技术研究有限公司 一种终端设备及其关联窗口的显示方法
CN103455244A (zh) * 2013-08-18 2013-12-18 苏州量跃信息科技有限公司 窗口间光标转换的方法及客户端

Also Published As

Publication number Publication date
CN110941373A (zh) 2020-03-31
CN110941373B (zh) 2021-06-25

Similar Documents

Publication Publication Date Title
WO2021218203A1 (fr) Procédé et appareil d'édition de pages pour tablette électronique interactive intelligente, et dispositif et support de stockage associés
CN110928468B (zh) 智能交互平板的页面显示方法、装置、设备和存储介质
WO2021068412A1 (fr) Procédé et appareil d'interaction associés à une tablette d'interaction intelligente, dispositif terminal et support d'informations
US20220121354A1 (en) Method and device for controlling interactive white board
US11620047B2 (en) Method, apparatus, terminal device, and storage medium for operating interactive white board
US9092121B2 (en) Copy and paste experience
WO2021068366A1 (fr) Procédé et dispositif d'opération d'écriture pour tableau blanc interactif intelligent, appareil et support de mémoire
CN110941382B (zh) 智能交互平板的显示操作方法、装置、设备和存储介质
WO2021068365A1 (fr) Procédé et appareil d'interaction entre pages pour tablette d'interactions intelligentes, et dispositif et support de stockage
CN111813302B (zh) 投屏显示方法、装置、终端设备和存储介质
CN111338538A (zh) 智能交互平板的页面操作方法、装置、设备和存储介质
TWI485616B (zh) 記錄軌跡的方法及電子裝置
WO2021068405A1 (fr) Procédé, appareil et dispositif de transfert d'éléments, et support de stockage
WO2021068382A1 (fr) Procédé et appareil de commande de fonctionnement de fenêtres multiples, dispositif et support de mémoire
CN112462972A (zh) 白板页面新建方法、装置、交互平板和存储介质
TW201319912A (zh) 觸控簡報系統及其執行方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19948759

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19948759

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 19948759

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 13.10.2022)

122 Ep: pct application non-entry in european phase

Ref document number: 19948759

Country of ref document: EP

Kind code of ref document: A1