WO2023097612A1 - 交互实现方法、装置、交互平板及存储介质 - Google Patents

交互实现方法、装置、交互平板及存储介质 Download PDF

Info

Publication number
WO2023097612A1
WO2023097612A1 PCT/CN2021/135099 CN2021135099W WO2023097612A1 WO 2023097612 A1 WO2023097612 A1 WO 2023097612A1 CN 2021135099 W CN2021135099 W CN 2021135099W WO 2023097612 A1 WO2023097612 A1 WO 2023097612A1
Authority
WO
WIPO (PCT)
Prior art keywords
interface
application
data
terminal
interactive
Prior art date
Application number
PCT/CN2021/135099
Other languages
English (en)
French (fr)
Inventor
张秀媚
Original Assignee
广州视臻信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视臻信息科技有限公司 filed Critical 广州视臻信息科技有限公司
Priority to CN202180007750.XA priority Critical patent/CN116601597A/zh
Priority to PCT/CN2021/135099 priority patent/WO2023097612A1/zh
Publication of WO2023097612A1 publication Critical patent/WO2023097612A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Definitions

  • the embodiments of the present application relate to the technical field of interactive panels, and in particular to an interaction implementation method, device, interactive panel, and storage medium.
  • an electronic device is used as a conference terminal, which can display conference documents, display screen projection data of other local electronic devices, conduct audio and video calls with remote electronic devices, and serve as a conference whiteboard.
  • an electronic device realizes different functions by running various application programs installed on it, for example, displaying different types of data through different application programs.
  • an electronic device realizes different functions by running various application programs installed on it, for example, displaying different types of data through different application programs.
  • the embodiment of the present application provides an interactive implementation method, device, interactive tablet and storage medium, so as to solve the technical problem in the related art that the operation process is cumbersome when opening different types of data.
  • an embodiment of the present application provides a method for implementing interaction, which is applied to an interactive tablet, and the method includes:
  • the first operation being used to select a target preview image in each of the preview images
  • the second application is an application for opening the first data corresponding to the target preview image
  • the second interface is closed, and the first interface is resumed.
  • an embodiment of the present application provides an interaction implementation method, which is applied to an interaction implementation system.
  • the interaction implementation system includes an interactive tablet and at least one first terminal.
  • the interaction implementation method includes:
  • the first terminal establishes a wireless communication connection with the interactive tablet
  • the interactive panel displays a first interface of a first application
  • the first terminal displays a fifth interface of the fourth application
  • the first terminal receives a fifth operation in the fifth interface
  • the fifth operation is used to select and send file data
  • the first terminal sends the local file data to the interactive panel according to the fifth operation
  • it is determined that the fifth operation is used to select and send screen projection data, so The first terminal uploads the local screen projection data to the interactive panel
  • the interactive tablet displays a preview image of the first data in the first interface, and the first data includes the file data or the screen projection data;
  • the interactive tablet receives a first operation, and the first operation is used to select a target preview image in each of the preview images;
  • the interactive panel displays a second interface of a second application, and the second application is an application program for opening the first data corresponding to the target preview image;
  • the interactive tablet receives a second operation on the second interface
  • the interactive tablet closes the second interface and resumes displaying the first interface according to the second operation.
  • an interaction realization device which is applied to an interactive tablet, and the device includes:
  • a first display unit configured to display a first interface of a first application
  • the first receiving unit is configured to receive first data sent by at least one first terminal, where the first data includes file data or screen projection data, wherein the first terminal communicates with the interactive tablet through wireless communication. ;
  • a second display unit configured to display a preview image of each of the first data in the first interface
  • the second receiving unit is configured to receive a first operation, and the first operation is used to select a target preview image in each of the preview images;
  • a third display unit configured to display a second interface of a second application, where the second application is an application for opening the first data corresponding to the target preview image;
  • a third receiving unit configured to receive a second operation on the second interface
  • the fourth display unit is configured to close the second interface and resume displaying the first interface according to the second operation.
  • an interactive tablet including:
  • processors one or more processors
  • a display for displaying according to instructions from the processor
  • a communication module configured to perform wireless communication with at least one first terminal
  • memory for storing one or more programs
  • the one or more processors are made to implement the interactive implementation method as described in the first aspect.
  • an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the interactive implementation method as described in the first aspect is implemented.
  • the preview image of the first data is displayed on the first interface
  • the second interface of the second application is displayed, and the first data is displayed in the second interface.
  • the second interface is closed and the first interface is resumed.
  • the user can The technical means of selecting the preview image again in the first interface to open the corresponding first data can solve the technical problem in the related art that the operation process is cumbersome when opening different types of data.
  • the corresponding first data can be directly opened through the preview image of the first interface, which simplifies the operation process. Moreover, displaying the preview image of the first data through the first interface can also make the user know which first data has been uploaded by the first terminal.
  • FIG. 1 is a flowchart of an interactive implementation method provided by an embodiment of the present application
  • Fig. 2 is a schematic diagram of an arrangement rule provided by an embodiment of the present application.
  • Fig. 3 is a schematic diagram of an arrangement rule provided by an embodiment of the present application.
  • Fig. 4 is a schematic diagram of an arrangement rule provided by an embodiment of the present application.
  • FIG. 5 is a flow chart of an interactive implementation method provided by an embodiment of the present application.
  • FIG. 6 is a flow chart of an interactive implementation method provided by an embodiment of the present application.
  • Fig. 7 is a schematic diagram of the main interface of the fourth application provided by an embodiment of the present application.
  • Fig. 8 is a schematic diagram of a seventh interface provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram of a fifth interface provided by an embodiment of the present application.
  • FIG. 10 is a first schematic diagram of a first interface provided by an embodiment of the present application.
  • FIG. 11 is a schematic diagram of a screen projection prompt provided by an embodiment of the present application.
  • Fig. 12 is a schematic diagram of the sixth interface provided by an embodiment of the present application.
  • Fig. 13 is a second schematic diagram of the first interface provided by an embodiment of the present application.
  • Fig. 14 is a schematic diagram of a second interface provided by an embodiment of the present application.
  • FIG. 15 is a schematic diagram of a contact list provided by an embodiment of the present application.
  • FIG. 16 is a schematic diagram of an invitation command display provided by an embodiment of the present application.
  • Fig. 17 is a third schematic diagram of the first interface provided by an embodiment of the present application.
  • Fig. 18 is a fourth schematic diagram of the first interface provided by an embodiment of the present application.
  • Fig. 19 is a schematic diagram of a fourth interface provided by an embodiment of the present application.
  • Fig. 20 is a fifth schematic diagram of the first interface provided by an embodiment of the present application.
  • FIG. 21 is a schematic diagram of a list of second data provided by an embodiment of the present application.
  • Fig. 22 is a schematic structural diagram of an interaction implementation device provided by an embodiment of the present application.
  • Fig. 23 is a schematic structural diagram of an interactive panel provided by an embodiment of the present application.
  • the embodiment of the present application provides an interaction realization method, which can be executed by an interaction realization device, and the interaction realization device can be realized by software and/or hardware, and the interaction realization method can be two or more physical entities Composition, can also be a physical entity composition.
  • the interaction realization device may be an intelligent electronic device such as an interactive tablet, a tablet computer, a smart TV, or a mobile phone.
  • the interactive realization method of the interactive flat panel is exemplarily described by taking the interaction realization device as an interactive flat panel.
  • the interactive panel is an integrated device that controls the content displayed on the display panel and realizes human-computer interaction through touch technology. It integrates projectors, electronic whiteboards, curtains, audio, televisions, and video conference terminals one or more functions.
  • At least one type of operating system is installed on the interactive tablet, and the operating system may be an Android system, a Windows system, a Linux system, an IOS system, and the like.
  • the interactive tablet can install at least one application program under the operating system.
  • the application program may be an application program provided by the operating system, or an application program downloaded from a third-party device or server, which is not currently limited.
  • the interactive tablet is installed with a whiteboard application.
  • the whiteboard application refers to an application for users to perform operations such as writing and displaying.
  • the interface of the whiteboard application inserts and displays multimedia elements, and the multimedia elements may include graphs, images, tables, documents, audio files and/or video files.
  • the whiteboard application can implement operations such as writing, drawing, and erasing similar to the physical blackboard, and further have better digital functions such as moving, saving, zooming, inserting pictures, color adjustment, and stroke thickness settings.
  • the whiteboard application can also display and edit file data (including handwriting and/or multimedia elements, etc.) created by the user in other terminal whiteboard applications.
  • the whiteboard application can also be named as writing application, electronic whiteboard application, collaborative whiteboard application, etc. No matter how the name is changed, as long as the application is used to realize the above functions, it is equivalent to the whiteboard application of the present disclosure.
  • the interactive tablet is installed with a file display application, which can be used to display files to users.
  • the file display application can also be used for users to edit files, such as for users to create files, edit file content, add Annotations, etc., to realize real-time display of user editing operations during the file display process, thereby improving information display and interaction effects during the file display process. It can be understood that multiple file display applications can be installed on the interactive tablet, and different file display applications can display different types of files.
  • the interactive panel is respectively installed with file display applications for displaying documents such as Word documents, PDF documents, PPT documents, and Excel documents, and is also installed with display applications for displaying pictures (such as bmp, jpg, png, tif, gif, etc.), videos (such as wmv, MP4, avi, rm, etc.), audio (such as MP3, WMA, etc.) and other multimedia file display applications.
  • the file display application can be named according to the type of the file displayed. No matter how the name of the file display application is changed, as long as the application used to realize the above functions is equivalent to the file display application of the present disclosure.
  • the interactive tablet is installed with a screen projection application, which is mainly used for wireless screen projection.
  • Screen data is displayed on the interactive panel in "real time", and the displayed content includes various media information and real-time operation screens.
  • the screen casting application can also be called a screen sharing application, a flying screen application, and a screen sharing application. No matter how the name of the screen casting application is changed, as long as the application is used to realize the above functions, it is equivalent to the screen projection application of the present disclosure.
  • the interactive flat panel is also configured with at least one display screen (also referred to as a display).
  • the interactive tablet is configured with a display screen with touch function, and the display screen may be a capacitive screen, a resistive screen, an infrared screen and/or an electromagnetic screen.
  • the user can control the interactive panel by touching the display screen with a finger or a stylus.
  • the interactive tablet can also be connected to external devices such as a mouse and a keyboard, and the user can also control the interactive tablet by operating the external device.
  • the interactive flat panel is also equipped with a communication module, and the interactive flat panel realizes the communication function through the communication module, for example, the interactive flat panel performs data transmission with other electronic devices through the communication module.
  • the interactive panel performs data transmission with the server through the communication module.
  • the interactive tablet communicates with other electronic devices through the communication module, it can receive and display the file data transmitted by other electronic devices or allow users to perform operations such as annotation and editing, and can also receive and display the projection data sent by other electronic devices. It can make audio and video calls with other electronic devices, or share screens with other electronic devices, etc., especially in conferences and other scenarios that require multi-person communication.
  • the interactive tablet can be used as an interactive device to achieve functional requirements in multi-person communication scenarios, such as , in the conference scene, the interactive panel sequentially displays the projection data of the mobile terminals of the local users in the conference room, or sequentially displays the file data sent by the mobile terminals of the local users in the conference room, or realizes the local
  • the user of the remote terminal (such as a remote interactive tablet, mobile terminal) conducts an audio and video call with a user of a remote terminal (such as a remote interactive tablet or a mobile terminal), and sends the screen content of the interactive tablet to the remote terminal for display during the audio and video call.
  • the interactive tablet displays the screen projection data of mobile terminal A.
  • the local user needs to disconnect the mobile terminal A from the interactive tablet and close the After that, open the corresponding file display application or whiteboard application on the interactive tablet, and open the file data of the mobile terminal B in the file display application or whiteboard application.
  • the local user needs to switch between the three mobile terminals in sequence to send the projection data to the interactive tablet, for example, mobile terminal A
  • the user of the mobile terminal A disconnects the interactive tablet, and the user of the mobile terminal B uses the mobile terminal B to establish a connection with the interactive tablet and send screen projection data.
  • the interactive tablet uses the file display application to display the local PPT document
  • the local user needs to operate the interactive tablet to close (or switch to the background) the PPT document
  • the corresponding file display application open the file display application corresponding to the Word document and open the Word document in the file display application, and then, when the PPT document needs to be displayed again, the user needs to operate the interactive tablet again to close (or switch to the background) the Word document
  • the corresponding file display application is opened, and the file display application corresponding to the PPT document is opened, and the PPT document is opened in the file display application.
  • the interactive tablet displays the Word document sent by mobile terminal A.
  • the local user needs to use the whiteboard function in the interactive tablet, he needs to close (or switch to the background) the file display application corresponding to the Word document and start Afterwards, when the user needs to open the Word document again, the user needs to close (or switch to the background) the Whiteboard application, open the file display application corresponding to the Word document, and open the Word document in the file display application.
  • Figure 1 is a flowchart of an interactive implementation method provided by an embodiment of the present application.
  • the interactive implementation method includes:
  • Step 110 displaying the first interface of the first application.
  • the first application is an application program installed in the interactive tablet.
  • the first application can be considered as an application for connection.
  • it when executing the interactive implementation method, it can be realized by displaying other applications or the data opened in them in the application interface of the first application in the form of a preview image. Quickly switch between other different applications.
  • the interactive tablet establishes a connection with another electronic device used by the user.
  • another electronic device used by the user is recorded as a first terminal
  • the first terminal may be an intelligent electronic device such as a mobile phone, a tablet computer, or a notebook computer.
  • the first terminal and the interactive tablet are geographically close to each other. For example, in a meeting scenario, the first terminal and the interactive tablet are in the same conference room. For another example, in a teaching scenario, the first terminal and the interactive tablet are located at in the same classroom.
  • the geographical distance between the first terminal and the interactive tablet may be relatively far, for example, the first terminal is a mobile phone, which has mobility, and the interactive tablet is installed in a meeting room , in the conference scenario, the participant can bring the first terminal into the conference room and establish a connection with the interactive tablet. After the meeting, the participant disconnects the first terminal from the interactive tablet and takes the first terminal away from the meeting room.
  • an application program corresponding to the first application is installed in the first terminal.
  • the application program installed in the first terminal is recorded as the fourth application.
  • the correspondence between the fourth application and the first application can be understood as A connection can be established between the fourth application and the first application, data can be transmitted, instructions can be transmitted, and the like.
  • the first application is a conference program suitable for the interactive tablet
  • the fourth application is a conference program suitable for the first terminal.
  • the connection between the first terminal and the interactive tablet can be realized through the two applications, and then, through the second
  • the fourth application can send the data required by the meeting in the first terminal to the interactive panel, and then make the interactive panel display the data for other participants to watch.
  • the connection between the first terminal and the interactive tablet is established through the first application and the fourth application.
  • the connection is mainly a wireless communication connection.
  • the first terminal and the interactive tablet may establish a connection by means of short-range wireless communication (that is, wireless communication suitable for short-distance range) and for data transfer.
  • short-range wireless communication that is, wireless communication suitable for short-distance range
  • data transfer For example, a connection is established by means of a connection code.
  • the first terminal and the interactive panel are located in the same local area network, and the user generates a connection code in the first terminal and one terminal of the interactive panel, and the connection code is a string of letters, numbers and/or symbols , when the user inputs the connection code in the first terminal and another terminal of the interactive panel (input through the fourth application when the other terminal is the first terminal, and input through the first application when the other terminal is the interactive panel), the second A terminal and an interactive panel confirm the connection based on the same connection code in the local area network.
  • Another example is to establish a connection through a two-dimensional code. For example, the user generates a two-dimensional code for connection through the interactive tablet, and then scans the two-dimensional code through the fourth application of the first terminal.
  • the first terminal and the interactive tablet confirm the connection.
  • a connection is established through Bluetooth pairing. It should be noted that in practical applications, other short-distance wireless communication methods can also be used to establish a connection, or the first terminal and the interactive tablet adopt a remote network communication (that is, use the Internet to achieve long-distance communication) to establish a connection. Not limited.
  • the interactive tablet opens the first application. It can be understood that if the first application has been opened before the connection, the first application is set to run in the foreground after the connection.
  • Running in the foreground can be understood as displaying an interface of the application program on the screen when the application program is running, through which the user can grasp the running process of the application program and control the application program accordingly.
  • the opposite of running in the foreground is running in the background.
  • Running in the background can be understood as when the application program is running, the interface of the application program is not displayed on the screen, and the user cannot intuitively grasp the running process of the application program.
  • the first interface of the first application is displayed.
  • the first interface can be considered as the main interface of the first application, wherein the interface (also referred to as application interface) refers to an interactive interface used by an application program to receive and/or display information, and the main interface is the first application displayed after running the first application.
  • An interface similar to the desktop of the first application. It can be understood that, when the first application has a startup animation or startup image, the first interface is the first interface after the startup animation or startup image is displayed. By operating the first interface, the user can trigger the first application to execute the corresponding function.
  • the first interface may be a full-screen interface or a non-full-screen interface, and a full-screen interface is currently used as an example.
  • the first interface is a full-screen interface, which can be understood as that the first interface covers the entire screen. Currently, by displaying the first interface, it can be determined that the connection between the first terminal and the interactive tablet has been successfully established.
  • the content and layout of the first interface are currently not limited.
  • a terminal list is displayed on the first interface, and the terminal list displays the currently connected first terminal (for example, displays the avatar and/or name of the first terminal).
  • a functional button is displayed on the first interface, and the functional button refers to a control that can trigger a corresponding function after the user operates it.
  • Functional buttons are presented in the form of virtual buttons on the first interface. The number of functional buttons is currently not limited.
  • One functional button can trigger a function.
  • the first interface displays a button for exiting the first application, and displays a button for Keystrokes to record screen content, etc.
  • a preset function may also be started.
  • the screen recording function is also enabled.
  • the interactive tablet will record the screen content and generate a screen recording file based on the recorded screen content. Through the screen recording file, you can review the interactive panel during the recording process. screen content.
  • first terminals may also establish a connection with the interactive tablet.
  • the interactive panel opens the first application and displays the first interface, in which the avatar of the first terminal is displayed, and then the second first terminal and the interactive panel establish When connecting, the interactive tablet adds the avatar of the second first terminal on the first interface, so as to display the situation of the locally connected first terminal.
  • Step 120 Receive first data sent by at least one first terminal, where the first data includes file data or screen projection data, wherein the first terminal communicates with the interactive tablet through wireless communication.
  • the user sends data to the interactive tablet by operating the fourth application.
  • the data sent by the first terminal is recorded as first data, and the first data includes file data and/or screen projection data.
  • File data refers to files stored in the first terminal (the file can be created in the first terminal or transmitted to the first terminal after being created in other terminals), and the type of file data is not currently limited, for example, the type of file data It can be images, text, audio and video, presentations, forms, whiteboard files, etc. Different types of file data need to be opened with adapted applications. For example, if the file data is presentation data in PPT format, the required file display application is a presentation application such as PPT or WPS Office. For another example, if the file data is audio and video data, the required file display application is an audio and video playback application. For another example, if the file data is whiteboard file data, a whiteboard application is required.
  • the fourth application displays the file data that can be uploaded, and the file data that can be uploaded may be all file data stored in the first terminal, Or, file data of a specific type (the specific type can be set according to the actual situation), or file data imported into the fourth application by the user in advance.
  • the imported file data can be understood as the file data selected by the user in advance
  • the file data that can be used by the fourth application supports sending multiple files, that is, the user can select one or more file data, and when the user selects multiple file data, the types of the multiple file data can be the same or different.
  • a maximum number of file selections is preset in the fourth application. After the file data selected by the user exceeds the maximum number of file selections, the user cannot continue to select file data. At this time, the fourth application can prompt the user to reach the maximum number of file selections.
  • the first terminal After selecting the file data, the first terminal sends the file data to the interactive panel.
  • the first terminal After the first terminal establishes short-distance wireless communication with the interactive tablet, it directly sends the file data to the interactive tablet.
  • the file data After the first terminal establishes a connection with the interactive tablet through remote network communication, the file data is uploaded to the server through remote network communication, and the server sends it to the interactive tablet.
  • the server is a server that provides services for the first application and the fourth application.
  • attribute information of the file data is also sent, wherein the attribute information includes: the name and type of the file data.
  • the attribute information may also include other content, for example, content such as the avatar and/or name of the first terminal, which is not currently limited.
  • Screen projection can be understood as displaying the content of the first terminal (which may be the content of the screen or the content of one or more interfaces, or the audio and video data played on the screen) on the interactive tablet in real time and synchronously.
  • the screen projection data refers to the data obtained based on the content encoding of the screen projection during the screen projection process.
  • the interactive panel can obtain and display the content of the first terminal by decoding the screen projection data.
  • the fourth application obtains the screen projection data and sends it to the interactive panel through the first terminal.
  • the connection between the first terminal and the interactive panel and the sending of screen projection data can also be realized through the screen projection terminal.
  • a screen projection application is installed or stored in the screen projection terminal.
  • the screen projection data can be directly obtained and encoded before being sent to the interactive panel.
  • the screen-casting application obtains the screen-casting data, encodes them and sends them to the interactive panel.
  • the first terminal sends the screen projection data, it can be sent directly to the interactive panel or sent to the interactive panel via the server.
  • attribute information of the screen projection data is also sent, wherein the attribute information includes: an identifier indicating the screen projection (the identifier can be regarded as the type of data). It can be understood that, in practical applications, the attribute information may also include other content, for example, content such as the avatar and/or name of the first terminal, which is not currently limited.
  • Step 130 displaying a preview image of each first data on the first interface.
  • the interactive panel after receiving the first data, the interactive panel generates a corresponding preview image according to the first data and displays it on the first interface of the first application, so that the user can select the first data to be opened.
  • the preview image refers to a small image obtained by compressing the data content in the first data, and usually includes a hyperlink pointing to the first data.
  • the preview image is a small image obtained based on the data content of the first page of the PPT document.
  • the preview image is a small image obtained based on the content of a frame (which may be the first frame or other frames) in the screen projection data.
  • step 130 includes: step 131-step 133:
  • Step 131 Obtain the data content of the first data.
  • the data content is the content contained in the first data.
  • the interactive panel analyzes the first data to obtain the data content, attribute information, etc. of the first data.
  • the currently acquired data content may be the data content used to generate the preview image.
  • the first data contains multiple pages or frames of data content
  • only one of the pages is acquired (such as the first page or the first data is opened The number of pages displayed by default) or the data content of a frame (such as the first frame or the number of frames that should be displayed when opening the first data).
  • all data content is acquired.
  • Step 132 generating a preview image of the first data according to the content of the data.
  • a preview image including data content is generated as a preview image of the first data.
  • the size of the preview image is currently unlimited.
  • the preview images of each first data have the same size.
  • the method of generating the preview image is not limited, for example, screenshot and compress the data content, and add a hyperlink pointing to the first data to obtain a preview image of the first data.
  • Step 133 Send the preview image to the first application, and the first application displays the preview image on the first interface after receiving the preview image.
  • the interactive panel parses the first data to obtain the preview image, it sends the preview image to the first application, and then the first application displays the preview image on the first interface.
  • the attribute information includes the avatar and/or name of the first terminal
  • the avatar and/or name of the first terminal is also sent, so that when the preview image is displayed on the first interface, the first terminal is displayed.
  • the avatar and/or name of the terminal enables the user to specify the first terminal to which the first data is sent.
  • the preview image of the first data when the preview image of the first data is displayed on the first interface, it is displayed according to an arrangement rule of the preview image.
  • the arrangement rules stipulate the size of the preview images in the first interface, the row interval (the distance between two adjacent preview images in the same row), and the column interval (the interval between two adjacent preview images in the same column).
  • the arrangement rules of the preview images are determined by the number of preview images, that is, the arrangement rules of the preview images may be different when the number of preview images is different.
  • the arrangement rules of the preview images are fixed and the user can modify the arrangement rules of the preview images, that is, when the number of preview images is different, the arrangement rules of the preview images are the same.
  • the arrangement rule of the preview images in the first interface is determined by the number of preview images as an example for description.
  • the arrangement rules of the preview images under different numbers are set, and the first application obtains the corresponding arrangement rules according to the number of preview images currently to be displayed, and then displays the preview images according to the arrangement rules.
  • Figure 2 shows the arrangement rules of preview images when the number of preview images is 1
  • Figure 3 shows the arrangement rules of preview images when the number of preview images is 2
  • Figure 4 shows the arrangement rules of preview images when the number of preview images is 3 or more Rules (five preview images are taken as an example in Figure 4), as can be seen from Figure 2 to Figure 4, setting different arrangement rules in combination with the number of preview images can make the display of preview images more flexible.
  • the order in which the multiple preview images are arranged in the first interface can be set according to actual conditions. For example, arrange multiple preview images by sending or receiving time. For another example, multiple preview images are arranged according to the type of the first data.
  • the name of the first data may also be displayed.
  • the preview image displayed on the first interface may also change according to the reception of the first data. For example, when a certain first terminal finishes sending screen projection data, the first application deletes the screen projection on the first interface. The preview image corresponding to the data, and adjust the arrangement of the remaining preview images. For another example, when the first terminal sends new first data, the first application adds a preview image of the new first data in the first interface, and adjusts the arrangement of the remaining preview images.
  • the type of the first data can also be clarified, and then the corresponding application program is started according to the type of the first data.
  • the started application program is recorded as the second application program, and the second application program It can be regarded as an application program required to open the first data, and after the second application is started, the first data is opened in the second application.
  • the data content displayed by the second application may be obtained after the second application opens the first data.
  • both launching the second application and opening the first data are completed in the background.
  • the first data opened in the second application can be found through the hyperlink of the preview image.
  • the first application can open the first data, the first application is directly used as the second application, and at this time, there is no need to open the second application.
  • step 140 is executed.
  • Step 140 receiving a first operation, the first operation is used to select a target preview image in each preview image.
  • the user can select a preview image in the first interface according to his own needs, so that the interactive tablet opens the first data corresponding to the preview image.
  • the operation of selecting a preview image by the user is marked as the first operation, and the preview image selected by the user is marked as the target preview image.
  • the trigger method of the first operation is currently not limited. For example, it is detected that the preview image has received a setting operation (such as a single-click operation, double-click operation), etc., and the first operation is determined to be received, and the preview image affected by the first operation is used as the target preview.
  • Step 150 displaying a second interface of a second application, where the second application is an application program for opening the first data corresponding to the target preview image.
  • the preview image has a hyperlink pointing to the first data
  • the corresponding first data can be opened through the hyperlink of the target preview image.
  • opening the first data through a hyperlink refers to switching the second application that opens the first data to the foreground to display the first data.
  • the first application after receiving the first operation, notifies the interactive tablet of the target preview image selected by the first operation, and the interactive tablet switches the second application to the foreground to run according to the hyperlink of the target preview image.
  • the interface of the second application is displayed.
  • the interface displayed by the second application is recorded as the second interface. It should be noted that the second application has already opened the first data when running in the background, therefore, the second interface displayed in the foreground refers to the interface displayed after the second application opens the first data, that is, the second interface displays the first data.
  • the second interface When the second interface is displayed, the second interface may be a full-screen interface or a non-full-screen interface. Currently, the second interface is a full-screen interface as an example for description.
  • the first interface is blocked by the second interface. At this time, it can be considered that the first application is switched to run in the background, and when the first application is switched to the foreground again, the first interface is resumed.
  • At least one functional key may also be displayed.
  • the functional key displayed when the second interface is displayed is marked as the first key.
  • One first button corresponds to one function.
  • the specific content of the function can be set according to actual needs. For example, two first buttons are currently displayed, and the function of one first button is a recovery function.
  • the recovery function can close the second interface and restore the display of the first interface.
  • the function of the other first button is a screen sharing function. Through the screen sharing function, the screen content of the interactive panel can be sent to other terminals, so that other terminals can display the screen content.
  • the first button may be an application-level button or a system-level button.
  • the application-level keys are executed by corresponding applications.
  • the system-level key is a command of the operating system, that is, the corresponding function is executed by the operating system.
  • different first buttons can belong to system-level buttons and application-level buttons respectively, and when multiple first buttons belong to application-level buttons, different first buttons can belong to different application programs. limited.
  • the display level of the first button is higher than that of the second interface, that is, the first button is displayed on the second interface, and when the user operates the position of the first button, it is confirmed that it is the operation of the first button rather than the second interface. Operations on the second interface.
  • the first button has at least a recovery function as an example for description.
  • the second interface is a full-screen interface, displaying the second interface of the second application, specifically: displaying the second interface of the second application, and The first button is displayed on the second interface, the display level of the first button is higher than that of the second interface, the first button includes the first control, and when the first control is triggered, the interactive panel receives the second operation.
  • the button used to trigger the recovery function among the first buttons is marked as the first control
  • the control refers to the encapsulation of data and methods
  • the functional button can be regarded as an implementation of the control.
  • the user issues a second operation by operating the first control, and the second operation refers to an operation of closing the second interface and restoring the display of the first interface.
  • the first control may be a system-level key, an application-level key of the first application, or an application-level key of the second application.
  • the first control is a system-level button, and the display level of the first control is higher than that of the second interface.
  • the display position of the first control is currently not limited.
  • the first application when the first application is opened for the first data, the first application can also be used as the second application. At this time, the first data is directly opened in the first application and the second interface is displayed.
  • the second interface is the first application. An interface displayed after an application opens the first data. Currently, the first button can still be displayed.
  • the first data received by the interactive tablet can be opened locally. If the received first data cannot be opened locally, a prompt that cannot be opened will be displayed when generating the preview image.
  • the user can also perform corresponding operations on the first data through the second interface.
  • the second application is a whiteboard application.
  • the method further includes: receiving a writing operation in the second interface, and generating corresponding handwriting in the second interface according to the writing operation.
  • the interactive tablet opens the whiteboard application and displays the first data in the whiteboard application.
  • the user can write, insert multimedia elements and other editing operations on the first data in the interactive panel.
  • writing in the second interface by the user is recorded as a writing operation.
  • the interactive tablet determines the position of the writing operation, and notifies the whiteboard application to display the corresponding handwriting at the position.
  • the second application is a file display application.
  • the method further includes: receiving a file display operation in the second interface, and displaying a corresponding file display result on the second interface according to the file display operation .
  • the user can edit the first data (such as modifying, adding or deleting data content and/or inserting multimedia elements), annotating, turning pages, etc. , at this time, the user's operation on the first data is recorded as a file display operation, and then the second application responds to the file display operation and presents the corresponding response result in the second interface.
  • the response result is recorded as The file shows the result.
  • the first data is a PPT document.
  • the second interface displays the first page of the PPT document. After the user issues a page turning operation in the second interface, the second interface displays the second page of the PPT document. The second page The data content of is the displayed file display result.
  • the second application is a screen projection application.
  • the method further includes: receiving real-time screen projection data sent by the first terminal, and displaying the real-time screen projection data on the second interface.
  • the first data is screen-casting data
  • the second application is a screen-casting application.
  • the screen-casting data of the first terminal can be displayed through the second interface.
  • the interactive tablet continues to receive the first The screen projection data of a terminal is displayed in real time on the second interface.
  • step 160 in addition to operating the first data in the second interface, operations can also be performed on the second interface as a whole, such as closing the second interface, exiting full-screen display, and the like.
  • the description is made by taking closing the second interface as an example, in this case, after step 150, step 160 is also performed.
  • Step 160 receiving a second operation on the second interface.
  • a triggering manner of the second operation is currently not limited.
  • the first control is also displayed, and when it is detected that the first control receives a setting operation (such as a click operation), it is determined that the second operation is received.
  • a setting operation such as a long press operation
  • the second operation is received, wherein the setting area is an area in the screen, and the specific area location is not currently limited.
  • Step 170 according to the second operation, close the second interface, and resume displaying the first interface.
  • closing the second interface refers to switching the second application to run in the background, and at this time, the second interface can be minimized or switched to the background.
  • the first interface is resumed, and the first interface also displays the preview image of the first data (including the target preview image), so that the user can open other first data through the preview image or open the current one again. first data. It can be understood that if the user closes the second application, the target preview image will no longer be displayed on the first interface.
  • the method further includes: updating the target preview image.
  • the target preview image when the second interface is closed, the target preview image is retained in the restored first interface, and when the user operates the first data in the second interface, the target preview image can be updated in a timely manner according to the operation content.
  • the data content displayed on the second interface is used as the preview image
  • the data content of the second interface is obtained, and a target preview image is generated based on the data content.
  • updating the target preview image can be The method includes: obtaining display content when the second interface is closed; generating a first preview image according to the display content, and updating the target preview image to the first preview image.
  • the display content of the second interface is acquired, and the display content is the data content of the first data displayed on the second interface.
  • obtain the displayed content by taking a screenshot.
  • a new preview image is generated according to the displayed content. This process is the same as the aforementioned process of generating a preview image, and will not be repeated here.
  • the generated preview image is marked as the first preview image, and the first preview image is used as a new preview image of the corresponding first data to replace the original target preview image, so that the target preview image displayed on the first interface is First preview image.
  • the display content of the second interface when obtaining the display content of the second interface, it may be first judged whether the display content of the second interface is consistent with the content of the target preview image, and if they are consistent, the generation of the first preview image is abandoned; otherwise, the first preview image is generated. Alternatively, after acquiring the display content of the second interface, the first preview image is directly generated. At this time, the content of the generated first preview image may be consistent with the content of the target preview image.
  • the number of pages or frames of the data content as the preview image can be fixed (such as always using the first page or the first frame as the preview image), At this time, when the first interface is resumed, it is determined whether the data content in the number of pages or frames as the preview image has changed. If there is no change, the target preview image will not be updated. If there is a change, the current data will be re-based. The content generates a first preview image, and updates the target preview image based on the first preview image.
  • the second interface is displayed again, and the display content of the second interface is consistent with the display content when the second interface is closed.
  • the preview image of the first data is displayed on the first interface, and when the user selects the preview image, the second image is displayed.
  • the first data is displayed on the second interface.
  • the second interface is closed and the first interface is resumed. After that, the user can display the first data again in the first interface.
  • the corresponding first data can be directly opened through the preview image of the first interface, which simplifies the operation process. Moreover, displaying the preview image of the first data through the first interface can also make the user know which first data has been uploaded by the first terminal. Receive the second operation through the first button at the system level, which simplifies the operation process of closing the second interface, and different second applications can be controlled through the first button, without adding the first button separately for each second application , reducing the difficulty of development.
  • a meeting scenario is taken as an example to describe the application process of the interaction implementation method.
  • the first terminal and the interactive tablet are located in the same meeting room, and after the first terminal establishes a short-range wireless communication connection with the interactive tablet, the interactive tablet displays the first interface of the first application, as shown in FIG. 10 , and the first interface is shown in FIG. In one interface, the number of connected first terminals and user avatars 23 of some first terminals are displayed.
  • the interactive tablet After receiving the first data sent by the plurality of first terminals, the interactive tablet generates a preview image of each first data and displays it on the first interface.
  • the first interface changes from FIG. 10 to FIG. 13 . Referring to FIG.
  • the interactive tablet opens the second application corresponding to each first data in the background, and opens the first data in the second application.
  • the first preview image is a preview image of a PPT document
  • a second interface of the second application is displayed, and the presentation data is displayed in the second interface.
  • the second interface is shown in Figure 14.
  • the second interface displays the presentation data in full screen for other people in the conference room to watch the presentation data. After that, the user can turn pages and make comments on the PPT document in the second interface. operate. Referring to FIG.
  • the first control 24 when the second interface is displayed, the first control 24 is also displayed.
  • the second interface is closed, and the first interface is resumed, that is, the interface shown in FIG. 14 is restored to the interface shown in FIG. 13 .
  • the display content of the second interface is obtained and the first preview image is generated, and then the first preview image in FIG. 13 is replaced with the first preview image.
  • the user can select the preview image in the first interface again, so that the interactive panel displays the second interface of the corresponding second application.
  • the user's switching operation can be simplified to two clicks, which improves the user's operation efficiency, and thus improves the meeting efficiency.
  • the first terminal may also select the target preview image in the first interface, and open the corresponding second interface by remotely controlling the interactive panel.
  • it also includes: receiving the first control instruction sent by the first terminal, the first control instruction is used to instruct the interactive tablet to open the target preview image; according to the first control instruction, displaying the second interface of the second application .
  • the fourth application installed on the first terminal also has the function of selecting a target preview image.
  • the first terminal After the user selects a target preview image through the fourth application, the first terminal generates a first control instruction and sends it to the interactive panel. Afterwards, the interactive panel determines the target preview image in the first interface according to the first control instruction, and then displays the second interface of the second application.
  • the implementation process of the user selecting the target preview image through the fourth application is not limited in the embodiment.
  • the user can call out the remote control interface in the fourth application, and the remote control interface displays virtual buttons representing the functions of "up”, “down”, “left”, “right” and “OK”. Select the target preview image in the interface.
  • the user obtains the first interface through the fourth application, and displays the first interface on the first terminal. After that, the user selects a target preview image through the first interface of the first terminal, and then, the first terminal previews the target selected by the user.
  • the position of the picture is sent to the interactive panel, and the interactive panel uses the preview picture displayed at the corresponding position in the first interface as the target preview picture according to the position.
  • the target preview image selected by the user may be a preview image of the first data sent by any first terminal.
  • the method of selecting the target preview image remotely through the first terminal does not require the user to enter the interactive tablet for operation, but only needs to operate at his own location.
  • step 110 may specifically include step 111-step 113:
  • Step 111 Receive a connection request sent by the first terminal.
  • a connection request is a request to establish a connection.
  • the main interface of the fourth application is displayed.
  • the main interface displays a functional button for triggering the connection function.
  • the fourth application enters the connection interface.
  • the connection interface is recorded as the seventh interface.
  • the connection is established through the connection code
  • the user inputs the connection code in the seventh interface
  • the fourth terminal generates a connection request and sends the connection request to the interactive panel.
  • the first terminal searches the local area network for an interactive tablet using the same connection code according to the connection code, and sends the connection request to the interactive tablet.
  • the user can scan the QR code for connection through the seventh interface. After the scan is successful, the fourth application generates a connection request and sends the connection request to the interactive tablet.
  • the interactive tablet can be found through the information contained in the two-dimensional code, and a connection request can be sent to the interactive tablet.
  • the first terminal and the interactive tablet are located in the same conference room.
  • the user starts the fourth application in the first terminal, and then, after the fourth application is started, the main interface of the fourth application is displayed.
  • the main interface is shown in FIG.
  • the fourth application enters the seventh interface, which is the connection interface.
  • the seventh interface is shown in Figure 8. Referring to Figure 8, a connection is currently established through a connection code, which is a 6-digit or 8-digit number, and the interactive panel is provided with a connection code.
  • the first terminal sends a connection request to the interactive tablet.
  • the seventh interface also displays a connection button 12.
  • clicks the connection button to make the first terminal send a connection request to the interactive tablet, or, after the user inputs the connection code, the first terminal automatically sends a connection request to the interactive tablet. Send a connection request.
  • Step 112 Confirm to establish a wireless communication connection with the first terminal according to the connection request.
  • the interactive panel determines the communication address of the first terminal according to the connection request, and establishes a connection with the first terminal based on the communication address, so that the interactive panel and the first terminal perform data communication.
  • the established connection refers to a wireless communication connection using a local area network for communication.
  • Step 113 after the wireless communication connection is established with the first terminal, open the first application and display the first interface of the first application.
  • the interactive tablet After the interactive tablet establishes a connection with the first terminal, the interactive tablet opens the first application.
  • the fourth application can also switch the main interface to an interface for connection control.
  • the interface for connection control is recorded as the fifth interface, and the user can send the first data through the fifth interface.
  • the method further includes: recording the display content of the first interface.
  • the user can set to automatically record the display content of the first interface after opening the first application according to his actual needs, and then the user can turn off the recording at any time to ensure that the screen recording function is used reasonably according to the actual needs of the user , wherein the screen recording function refers to the function of recording the display content of the first interface.
  • the screen recording function may also be enabled/disabled by the user during the display process of the first interface.
  • the first interface displays a functional button to enable/disable the screen recording function.
  • the screen recording function is disabled by default. The display content of the first interface is recorded, after which the user can turn off or start the screen recording function at any time.
  • each first terminal establishes a connection with the interactive panel through a connection code.
  • a part of the first terminals establishes a connection with the interactive tablet by means of a connection code
  • another part of the first terminals establishes a connection with the interactive tablet by means of scanning a two-dimensional code.
  • the first terminal and the interactive tablet when the first terminal and the interactive tablet are located on the same local area network, the first terminal and the interactive tablet can communicate through the local area network after establishing a connection.
  • the first application is automatically opened, which can make the user know that the current first terminal and the interactive tablet are successfully connected, so that the user can perform subsequent operations, such as using the first terminal to send the first data.
  • the user can review the interaction process, especially in the scenarios of meetings and teaching, which is convenient for the user to review the meeting or teaching content.
  • the user can send the first data to the interactive tablet through the first terminal at any time.
  • the interactive tablet receives the first data, it can update the first data according to the first data.
  • a preview image of the interface to ensure the validity of the preview image.
  • the new first data refers to the first data received again after the first data has been received. It can be understood that the first data received twice may be sent by the same first terminal, or may be sent by different first terminals. sent by a terminal. After receiving the new first data, a preview of the new first data needs to be added to the first interface. At this time, the preview of the previously received first data and the preview of the new first data are displayed on the first interface .
  • the processing manner of the new first data by the interactive panel is the same as the processing manner of the received first data, which will not be repeated now.
  • the new preview image may be arranged behind the original preview image, or the new preview image may be arranged before the original preview image.
  • the user can Send the first data.
  • the first interface is not displayed on the screen, such as when the first application is running in the background, the first application may also add a new preview image of the first data to the first interface, and then, when the first interface is displayed, the new A preview of the first data is displayed on the first interface.
  • the user can send the first data multiple times at any time according to their own needs, and then display the preview of the first data in the first interface in time, so that the user can clearly understand the receiving situation of the first data and quickly open it through the first interface. first data.
  • the user may also instruct the interactive tablet to make an audio and video call through the first terminal.
  • the interaction implementation method further includes: receiving a second control instruction sent by the first terminal, the second control instruction is used to instruct the interactive tablet to conduct audio and video calls with at least one second terminal; and displaying a third interface according to the second control instruction , and information about audio and video calls with the second terminal is displayed on the third interface.
  • a functional button for triggering an audio and video call is displayed in the fourth application of the first terminal, and the functional control is currently recorded as a call button, and the call button belongs to an application-level button of the fourth application, and the call button can be displayed in the fifth interface.
  • the second control instruction is used to instruct the interactive tablet to make an audio and video call.
  • the aforementioned audio and video call refers to the use of a network to transmit local video data and audio data of each terminal, so that each terminal realizes a call.
  • the fourth application further displays a contact list, and at least one contact is displayed in the contact list. How a contact is added to the contact list is currently not limited. Afterwards, the user selects a contact who is currently making an audio and video call in the contact list. Afterwards, the first terminal sends a third control instruction to the selected contact and sends a second control instruction to the interactive tablet. Wherein, the third control instruction is used to invite contacts to make audio and video calls. Optionally, sending the third control instruction to the contact is mainly to send an invitation instruction to the electronic device used by the contact. Currently, the electronic device used by the contact is recorded as the second terminal, and the second terminal is also installed with the second terminal. The fourth application is used to receive and display the third control instruction through the fourth application.
  • the third control instruction sent by the first terminal further includes relevant information of the interactive tablet, so that the second terminal can conduct audio and video calls with the interactive tablet through the relevant information.
  • the third control command sent by the first terminal also includes the connection code, and then the second terminal finds the interactive tablet through the connection code, and realizes the connection with the interactive tablet. audio and video calls.
  • the first terminal writes the same connection code in the third control instruction and the second control instruction, and then the second terminal finds the interactive tablet through the connection code, and implements an audio and video call with the interactive tablet.
  • the second terminal can be regarded as a remote terminal, and the second terminal communicates with the interactive tablet through a remote network.
  • the interactive tablet sends the second control instruction to the first application.
  • the first application starts an audio and video call according to the second control instruction.
  • the first application displays an interface for the call, and currently, the displayed interface is recorded as the third interface.
  • the second terminal collects the audio data and video data of the contact and sends them to the interactive panel.
  • the first application of the interactive panel acquires the video data and displays it on the third interface, and plays it through the audio of the interactive panel.
  • a device (such as a speaker) plays audio data. It can be understood that when the number of contacts is large, the third interface may display part of video data, or only display video data playing audio data.
  • the first application also instructs the interactive panel to turn on the video capture device (such as a camera) and the audio capture device (such as a microphone) according to the second control instruction, so as to collect local video data and audio data, and then send each second The terminal sends the local video data and audio data and the video data and audio data of other second terminals.
  • the third interface can also display local video data.
  • the third interface also displays functional keys related to audio and video calls, for example, a functional key for "turning on/off the microphone” is displayed, so as to collect or close the collection of local audio data.
  • a functional key for "turning on/off the camera” is displayed to realize collecting or closing the collecting of local video data.
  • a functional button for "manage contacts” is displayed, so as to add and delete contacts.
  • a functional button for "end call” is displayed to end the current audio and video call.
  • the display mode of the third interface is not currently limited.
  • the third interface is a full-screen interface, and at this time, the third interface is blocked on the first interface.
  • the third interface is a floating window interface.
  • the floating window interface refers to a window floating on the current interface.
  • a floating window pops up in the interface currently displayed on the interactive panel, and the third interface is displayed in the floating window.
  • the display level of the third interface is higher than the currently displayed interface, that is, when the user sends an operation to the position of the third interface, the operation on the third interface is performed by default.
  • the size and position of the floating window are currently not limited, and the floating window is movable, and the user can adjust the position of the floating window according to actual needs.
  • the third interface when the third interface is a floating window interface, it can also display a functional button that controls the display/hide of the floating window.
  • the functional button can be located in the floating window, or it can be an independently displayed functional button.
  • Functional buttons and floating windows have the same display level. The user can display or hide the third interface by operating the functional button.
  • content such as call duration may also be displayed on the third interface or independently of the third interface.
  • the method when displaying the third interface, the method further includes: sharing the displayed content of the first interface to the second terminal.
  • the interactive tablet when making a network call, the interactive tablet also enables a screen sharing function.
  • the first application continues to obtain the local screen content of the interactive tablet (the current screen content is the display content of the first interface), and sends the screen content to the second terminal, and then the second terminal displays the screen of the interactive tablet Content for viewing by contacts of the second terminal.
  • the third interface when the third interface is displayed, a functional button for enabling/closing the screen sharing function is also displayed, and the functional button and the functional control for controlling the display/hide of the floating window can be displayed simultaneously and located at the same display level. Afterwards, the user can turn off or turn on the screen sharing function through the functional key of turning on/off the screen sharing function according to actual needs.
  • the user can also send the second control command to the interactive tablet through the first terminal, so that the interactive tablet and the second terminal can conduct audio and video calls, especially in the conference scene, which is convenient for fast audio and video calls without additionally opening other applications to establish Audio and video calls, and no need for the user to go close to the interactive tablet for operation.
  • the third interface for audio and video calls is a floating window interface, which can reduce the blocking of other current interfaces, so that the user can continue to perform other operations such as opening the first data during the audio and video call.
  • sharing the display content of the first interface to the second terminal can make the contacts of the second terminal understand the user's current operation, which helps to improve the efficiency of the audio and video call.
  • the first terminal and the interactive tablet are located in the same meeting room, and after the first terminal establishes a short-range wireless communication connection with the interactive tablet, the interactive tablet displays the first interface of the first application and displays the first interface on the first interface.
  • the first terminal displays a fifth interface of the fourth application, the fifth interface is as shown in FIG. 9 , where a call button 15 is displayed. After detecting that the call button 15 receives a click operation, the first terminal displays a contact list. The contact list is shown in FIG. 15 .
  • the user selects a contact for audio and video calls by operating the contact list.
  • the OK button 18 is also displayed.
  • a third control command is sent to the second terminal used by the contact selected by the user, and the third control command is sent to the interactive tablet.
  • Second control command is sent.
  • the second terminal used by the contact pops up an invitation command.
  • the second terminal pops up a third control command in the form of a message. button and a button for rejecting the invitation, and when the contact chooses to accept the invitation, the second terminal conducts an audio and video call with the interactive tablet.
  • the interactive panel After receiving the second control instruction, the interactive panel displays the third interface in the form of a floating window.
  • the third interface is shown in Figure 17.
  • the interactive panel When the interactive panel displays the first interface, it receives the second control instruction and displays the third interface 25 in the form of a floating window.
  • the video data of the second terminal and the local third interface are displayed in the floating window interface.
  • the interactive tablet shares the displayed content of the first interface to the second terminal.
  • the remote second terminal can be quickly invited to participate in the conference, and the audio and video call between the interactive tablet and the second terminal can be established without the user approaching the interactive tablet for operation.
  • the second terminal can display the desktop content of the local interactive tablet, so that the remote contact can clearly understand the local operation.
  • the first data sent by the first terminal may be opened at any time.
  • the first application in addition to opening the first data sent by the first terminal, the first application may also open a local application, and open locally stored file data through the local application.
  • Fig. 5 is a flow chart of an interactive implementation method provided by an embodiment of the present application. On the basis of the above, the interactive implementation method illustrates how to open a local application program through the first application. Referring to Figure 5, the interactive implementation method includes:
  • Step 210 receiving a third operation, the third operation is used to call out the system toolbar of the interactive tablet.
  • the system toolbar is used to indicate system-level information or provide system-level functional keys.
  • the system toolbar includes functional buttons such as WiFi settings, brightness settings, volume settings, screenshots, photos, and comments.
  • the system toolbar also displays application icons of the application programs installed in the interactive tablet.
  • the user sets the application icon displayed in the system bar, and also optionally, displays the recently used application icon in the system toolbar.
  • the application icon of the application program built in the operating system is displayed in the system toolbar.
  • a fixed area is set in the system toolbar to display application icons. When the number of application icons is large, some application icons can be displayed in this area, and then the user can switch the displayed application by performing a swipe operation in the area. icon.
  • the application icons are arranged horizontally in the area. At this time, the user can switch the displayed application icons by swiping left or right.
  • the system toolbar can be hidden, and when the user invokes the system toolbar, it will appear in a designated display area in the screen.
  • the display area can be set according to the actual situation. Generally speaking, the display area is located at the edge of the screen.
  • the user's operation of calling up the system toolbar is recorded as the third operation.
  • the triggering method of the third operation is not currently limited. For example, when a sliding operation from the edge of the screen to the inside of the screen is detected, and the edge of the screen is the edge where the system toolbar display area is located, it is determined that the third operation is received.
  • icons of the system toolbar are displayed on the screen of the interactive tablet, and when the first interface is displayed, the icons of the system toolbar are superimposed on the first interface. Afterwards, when it is detected that the icon has received a setting operation (such as a click operation), it is determined that a third operation has been received.
  • a setting operation such as a click operation
  • Step 220 display a system toolbar, where the system toolbar includes at least one application icon.
  • the system toolbar After the system toolbar is invoked, it is displayed on the screen. At this time, the display level of the system toolbar is higher than the currently displayed interface, that is, the system toolbar can partially cover the currently displayed interface.
  • the system toolbar can also be hidden.
  • the system toolbar when it is detected that other areas of the screen other than the system toolbar receive a setting operation (such as a click operation), the system toolbar is hidden.
  • Step 230 receiving a fourth operation, the fourth operation is for selecting a target application icon among the application icons.
  • the user can start the corresponding application program through the application icon in the system toolbar.
  • the user's operation of selecting an application icon is recorded as the fourth operation, and the selected application icon is marked as a target application icon.
  • the triggering method of the fourth operation is currently not limited. For example, when it is detected that the application icon on the system toolbar receives a setting operation (such as a click operation), it is determined that the fourth operation is received, and the application icon that receives the setting operation OK as the target app icon.
  • Step 240 hide the system toolbar, and superimpose and display the fourth interface of the third application on the first interface, the third application being the application program corresponding to the target application icon.
  • the interactive tablet starts the application program corresponding to the target application icon.
  • the application program corresponding to the target application program is recorded as the third application.
  • the application interface of the third application is displayed.
  • the application interface of the third application is recorded as the fourth interface, after which the user can operate on the fourth interface.
  • the display mode of the fourth interface is not currently limited.
  • the fourth interface is a full-screen interface
  • the third application is an application running in the foreground.
  • the fourth interface is a non-full-screen interface.
  • the fourth interface is displayed on the screen in a windowed manner in a non-full screen, that is, a non-full-screen window is created in the screen and the fourth interface is displayed in the window.
  • the fourth interface is described as an example of a non-full-screen interface, and the fourth interface is superimposed and displayed on the currently displayed interface.
  • the first interface is currently displayed, and at this time, the fourth interface is superimposed and displayed on the first interface.
  • the system toolbar is hidden. After that, the user can continue to call out the system toolbar.
  • Step 250 receiving an insert operation for the third application.
  • inserting refers to displaying a preview image of the third application on the first interface, and the preview image is added with an interface for invoking the third application, through which the third application can be invoked, that is, the third application running in the foreground Three applications.
  • actions that trigger a put are counted as put actions.
  • the triggering method of the insertion operation is not currently limited, for example, when it is detected that the window displaying the fourth interface receives a setting operation (such as a long press operation), it is determined that the insertion operation is received.
  • the inserting operation is received through the functional key for inserting.
  • the description is made by taking receiving an inserting operation through a functional button for inserting as an example.
  • a functional button for inserting when superimposing and displaying the fourth interface of the target application icon on the first interface, it also includes: displaying the second button , the second button has the same display level as the fourth interface, the second button is used to control the fourth interface, the second button includes a second control, and when the second control is triggered, the interactive panel receives an insertion operation.
  • the second button refers to a functional button for controlling the fourth interface, and there may be one or more second buttons.
  • the second button may be a system-level button or an application-level button of the first application.
  • the second button is used as an example of a system-level button for description.
  • the second button does not control the display content of the fourth interface, but controls the display mode of the fourth interface.
  • the fourth interface uses When the windowed mode is not displayed in full screen, the second button includes a control for full screen display (for displaying the fourth interface in full screen), a control for exit (for exiting the third application), and a control for inserting.
  • the control used for insertion is recorded as the second control, and when a setting operation (such as a click operation) acting on the second control is detected, it is determined that the insertion operation is received.
  • Step 260 In response to the inserting operation, close the fourth interface, and add a preview image of the third application to the first interface.
  • the fourth interface when responding to the inserting operation, is closed.
  • closing the fourth interface may be to minimize the fourth interface. It can be understood that after the fourth interface is closed, the interactive tablet resumes displaying the interface before the system bar is called, and at this time, the third application can be considered to be running in the background. When the fourth interface is closed, a preview image of the third application is added to the first interface, so that the fourth interface can be displayed again through the preview image of the third application.
  • step 260 includes steps 261-262:
  • Step 261 in response to the inserting operation, close the fourth interface, take a screenshot of the fourth interface, and use the obtained screenshot image as a preview image of the third application.
  • the fourth interface After receiving the insertion operation, close the fourth interface, and take a screenshot of the fourth interface to obtain a screenshot image, and then add a hyperlink pointing to the third application (that is, call the interface of the third application) for the preview image to obtain the third application.
  • a hyperlink pointing to the third application that is, call the interface of the third application
  • the screenshot image can also be compressed to generate a preview image.
  • Step 262 adding and displaying the preview image on the first interface.
  • the preview image of the third application is sent to the first application.
  • the first application adds the preview image to the first interface.
  • the preview image of the third application is displayed.
  • the user can run the third application in the foreground by selecting the preview image of the third application, and display the fourth interface of the third application.
  • the application icon in the interactive panel is displayed in the system toolbar, and then the user can quickly start the application program by selecting the application icon without closing the current application program.
  • the application program of the interactive tablet can be placed in the first application, that is, the preview image of the application program is displayed on the first interface, and then the application program is quickly called out based on the preview image to run in the foreground, which simplifies the application program in the first terminal.
  • the switching link Moreover, the process of generating the preview image by taking a screenshot of the interface of the application program is simple and easy to implement.
  • the meeting scene is taken as an example to describe the process of inserting the preview image of the third application.
  • the first terminal and the interactive tablet are located in the same meeting room, and after the first terminal establishes a short-range wireless communication connection with the interactive tablet, the interactive tablet displays the first interface of the first application, as shown in FIG. 13 .
  • a preview image of the first data sent by the first terminal is displayed.
  • the interactive panel calls out the system toolbar through the third operation.
  • the system toolbar can also be recorded as a sidebar, and application icons 26 are displayed in the system toolbar, and when the user selects an application icon, the fourth interface corresponding to the application icon is displayed in the form of a window. Referring to FIG.
  • the fourth interface is displayed in a non-full screen, and a button 27 for full-screen display, a button 28 for inserting, and a button 29 for exiting are displayed.
  • the interactive panel closes the fourth interface, and takes a screenshot of the fourth interface to generate a corresponding preview image, and adds the preview image to the first interface.
  • the first interface is transformed into FIG. 20 as shown in FIG. 13 .
  • a preview image of the fourth interface (that is, the third application) is added to the first interface.
  • the interactive tablet opens the third application and displays the fourth interface.
  • the local application program of the interactive tablet can be quickly started, and by displaying the preview image on the first interface, after the local application program is switched to the background operation, it can be quickly switched to the foreground operation .
  • the above-mentioned interaction implementation method further includes: receiving an exit operation for the first application; in response to the exit operation, obtaining second data, the second data includes At least one of the first data, the screen recording data obtained when running the first application, the local file data opened or generated when running the first application, or the preview image of the local file data; upload the second data to the server for The first terminal downloads the second data from the server; closes the first application.
  • the exit operation is an operation that triggers closing of the first application, and the user may issue the exit operation through the first terminal or the interactive tablet.
  • the user issues an exit operation through the interactive panel as an example.
  • the triggering method of the exit operation is not currently limited.
  • the interactive panel displays the relevant interface of the first application (such as displaying the One interface) and display the functional key for receiving the exit operation in the relevant interface.
  • the functional key for receiving the exit operation is marked as the exit key, and the display position of the exit key is not currently limited.
  • the exit button is an application-level control of the first application and has the same display level as the first interface.
  • the exit button When the exit button is detected and a setting operation (such as a click operation) is received, it is determined that the exit operation is received. For another example, when it is detected that a setting operation (such as a long press operation) is received in the setting area of the relevant interface of the first application, it is determined that an exit operation is received, wherein the setting area is an area in the relevant interface, specifically Regional locations are currently unrestricted.
  • a setting operation such as a click operation
  • the operating system of the first application or the interactive tablet can obtain the data involved in the current running process of the first application.
  • the first application The data involved in the current running process of an application is recorded as the second data.
  • the second data includes the first data.
  • the first data currently mentioned mainly refers to file data. If the display content of the first interface is recorded when the first interface of the first application is displayed, the second data includes the data obtained after the screen recording is performed. When the data obtained by recording the screen is recorded as the screen recording data, it can be understood that After receiving the logout operation, the first application stops recording local screen content and generates screen recording data.
  • the first application When the first application is running and the interactive panel opens the locally stored file data through the third application or generates the locally stored file data through the third application, the first application also uses the locally stored file data as the second data.
  • the local file data is third-party data
  • the preview image of the file data is used as the second data
  • the local file data is used as the second data.
  • third-party data refers to data generated or opened by a third-party application
  • the first application cannot clarify the file data opened or generated during the running of the third-party application.
  • Non-third-party data refers to data generated or opened by non-third-party applications, and the first application can specify file data opened or generated during the running of non-third-party applications.
  • a whiteboard application is installed in the interactive tablet, which is a non-third-party application.
  • the interactive tablet opens the whiteboard application through the user's operation. After that, the user writes in the whiteboard application and generates whiteboard data.
  • the whiteboard data is not third-party data.
  • the first application will Whiteboard data is used as the second data.
  • the second data includes: at least one of the first data, screen recording data, file data opened or generated during the running of the first application, or a preview image of the file data. If the first application involves multiple types of second data when the first application is running, multiple types of second data are acquired.
  • the second data is saved.
  • the second data is saved in the interactive tablet and/or the server.
  • the second data is saved in the server.
  • the first terminal may query the second data through the server and download the second data. It should be noted that, in addition to the first terminal, other electronic devices may also download the second data from the server.
  • a saving prompt may pop up, after which the user can choose whether to save the second data.
  • the save prompt pops up, the second data is displayed in the save prompt, and then the user can check or uncheck the second data in the save prompt, and then the interactive panel saves the checked second data to in the server.
  • the interactive panel closes the first application.
  • the connection between the first terminal and the interactive tablet is disconnected.
  • the first terminal has a connection requirement, it can establish a connection with the interactive tablet again, so that the interactive tablet opens the first application.
  • the first terminal establishes a short-range wireless communication connection with the interactive tablet.
  • the first interface displayed on the interactive tablet is shown in FIG.
  • the interactive tablet displays a prompt on the first interface whether to end the meeting, when the user chooses to end the meeting, packs and uploads the second data used in the meeting to the server, and closes the first application.
  • the user can obtain the data in the server through the first terminal.
  • the user queries the second data of participating in the conference through the first terminal.
  • the package name of the second data is displayed on the main interface of the first terminal.
  • the package name of the second data is displayed on the main interface of the first terminal.
  • the first terminal displays a list of the second data.
  • FIG. 21 shows three second data packaged in a meeting, at this time, the user can select the second data to download.
  • the second data is saved in the server and the first application is exited, so that the second data involved in the running process of the first application can be uniformly saved and automatically uploaded, which simplifies the user's operation, and simplifies In order to save the path, it is only necessary to upload the second data to the server, and the first terminal can view all the second data in the server without searching for each second data separately, which simplifies the operation of the user.
  • FIG. 6 is a flow chart of an interaction implementation method provided by an embodiment of the present application. Referring to FIG. 6, when the interaction implementation system executes the interaction implementation method, it includes:
  • Step 310 the first terminal establishes a wireless communication connection with the interactive tablet.
  • the wireless communication may be short-distance wireless communication.
  • Step 320 the interactive panel displays the first interface of the first application.
  • the interactive tablet opens the first application and displays the first interface.
  • Step 330 the first terminal displays the fifth interface of the fourth application.
  • the fourth application is an application program installed on the first terminal, and the fourth application corresponds to the first application of the interactive tablet.
  • the fifth interface is an application interface displayed during the running of the fourth application. After the interactive tablet establishes a connection with the first terminal, the fourth application displays the fifth interface.
  • the display content of the fifth interface is currently not limited.
  • the fifth interface displays a file sending button and a screen projection button, wherein the file sending button is used to trigger the function of sending the file data to the interactive panel, and the screen projection is used to trigger the function of sending the screen projection data to the interactive panel Function.
  • the fifth interface also displays a call button and a join button.
  • the call button is used to invite other second terminals to conduct audio and video calls with the interactive panel.
  • the first terminal is the initiator, and the second terminal is the joiner.
  • the join button is used to join the audio and video calls initiated by other terminals.
  • the fifth interface may also display other functional buttons, which are not currently limited.
  • Step 340 the first terminal receives a fifth operation on the fifth interface.
  • the fifth operation is used to select whether to send file data or send screen projection data.
  • the fifth interface displays the file sending button and the screen projection button
  • a setting operation such as a single-click operation
  • the fifth operation is used to Select Send File Data.
  • the screen projection button receives a setting operation (such as a click operation)
  • a fifth operation is received, and the fifth operation is used to select and send the screen projection data.
  • step 350 is performed.
  • Step 350 Determine that the fifth operation is used to select and send file data, the first terminal sends the local file data to the interactive panel according to the fifth operation, and determine that the fifth operation is used to select and send the projection data, the first terminal sends the local file data The projection data is uploaded to the interactive panel.
  • step 350 includes step 351-step 353:
  • Step 351 When determining that the fifth operation is for selecting to send file data, the first terminal switches the fifth interface of the fourth application to the sixth interface of the fourth application, and the sixth interface displays local file data.
  • the sixth interface is the file selection interface
  • the sixth interface displays the file data that can be uploaded, so that the user can Select file data in the interface.
  • the user's operation of selecting file data in the sixth interface is recorded as the seventh operation.
  • Presentation and arrangement order of the file data in the sixth interface are currently not limited. For example, a preview image of the file data is displayed in the sixth interface, and the file data is arranged according to the latest opening time of the file data.
  • Step 352 the first terminal receives a seventh operation acting on the sixth interface, and the seventh operation is used to select file data.
  • each file data in the sixth interface has a corresponding selection mark, and the selection mark can show whether the file data is selected, and the file data can be selected or deselected by the user checking the selection mark.
  • the fourth application determines the selected file data through the selection identifier.
  • Step 353 the first terminal sends the selected file data to the interactive panel.
  • the fourth application of the first terminal acquires the screen projection data of the first terminal and sends the data to the first terminal.
  • the first terminal in order to facilitate the user to confirm that the screen projection is successful, when the first terminal uploads the local screen projection data to the interactive panel, it further includes: displaying a screen projection prompt.
  • the display content of the screen casting prompt is currently not limited, for example, a screen casting logo and a screen casting time are displayed in the screen casting prompt.
  • the screen-casting prompt is displayed in a pop-up window, or the screen-casting prompt is replaced by an interface to replace the current fifth interface.
  • Step 360 the interactive tablet displays a preview image of the first data on the first interface, where the first data includes file data or screen projection data.
  • Step 370 the interactive tablet receives a first operation, and the first operation is used to select a target preview image in each preview image.
  • Step 380 the interactive panel displays the second interface of the second application, and the second application is an application program for opening the first data corresponding to the target preview image.
  • Step 390 the interactive tablet receives a second operation on the second interface.
  • Step 3100 the interactive panel closes the second interface according to the second operation, and resumes displaying the first interface.
  • the user can send file data or screen projection data to the interactive tablet through the fifth operation in the fourth application, so that the first application of the interactive tablet sends the file data or
  • the preview image of the screen projection data is added on the first interface, so that the file data or screen projection data can be quickly opened through the preview image, which simplifies the operation performed by the user to open the first data on the interactive tablet.
  • the first terminal may also select the target preview image in the first interface, and open the corresponding second interface by remotely controlling the interactive panel.
  • the interaction implementation method performed by the interaction implementation system further includes: the first terminal receives the first control operation, the first control operation is used to instruct the interactive tablet to open the target preview image; the first terminal sends the first control operation according to the first control operation The instruction is sent to the interactive panel; the interactive panel displays the second interface of the second application according to the first control instruction.
  • the fourth application installed on the first terminal also has the function of selecting a target preview image.
  • the user's operation of selecting a target preview image through the fourth application can be considered as the first control operation.
  • the second A terminal After the first control operation is completed, the second A terminal generates a first control instruction and sends the first control instruction to the interactive tablet, and then the interactive tablet opens the second interface according to the first control instruction.
  • the first terminal may also instruct the interactive tablet to conduct audio and video calls with the second terminal.
  • the first terminal receives the fifth operation in the fifth interface, it also includes: when the fifth operation is used to select an audio and video call, the first terminal displays the contact list; the first terminal receives the sixth operation, and the sixth operation It is used to select at least one contact in the contact list; the first terminal sends a third control instruction to at least one second terminal according to the sixth operation, and sends a second control instruction to the interactive tablet, so that the second terminal interacts with the The tablet performs audio and video calls, and the second terminal is a terminal used by contacts.
  • the fifth interface further displays a call button, which is used to instruct the interactive tablet to make an audio and video call with the second terminal.
  • a setting operation such as a click operation
  • the call button When it is detected that the call button has received a setting operation (such as a click operation), it is determined to receive a fifth operation and the fifth operation is used to select an audio and video call.
  • the first terminal displays a contact list, and the contact list records contacts who can make audio and video calls.
  • the user may select a contact who is currently making an audio and video call in the contact list.
  • the user's operation of selecting a contact is recorded as the sixth operation.
  • the name and avatar of the contact are displayed in the contact list, and a selection indicator is also displayed, and the selection indicator can indicate whether the contact is selected.
  • the user's operation mode on the selection mark is similar to the user's operation mode on the file data selection mark, which will not be described here.
  • the first terminal sends a third control command to the second terminal used by the contact, and sends a second control command to the interactive panel.
  • the interactive panel enables the function of audio and video calls through the call command, and the second terminal Realize the audio and video call with the interactive tablet through the invitation command.
  • the first terminal can be used to invite the remote second terminal to conduct audio and video calls with the local interactive tablet, which enriches the functions of the first application and the fourth application.
  • the first terminal and the interactive tablet are located in the same meeting room, after the first terminal establishes a short-range wireless communication connection with the interactive tablet, the first terminal displays the fifth interface of the fourth application, and the fifth The interface is shown in FIG. 9 , and the fifth interface displays a screen projection button 13 , a file sending button 14 , a call button 15 and buttons for realizing other functions.
  • the interactive tablet opens the first application and displays the first interface, as shown in FIG. 10 .
  • the fourth application obtains the screen projection data of the first terminal and sends it to the interactive panel.
  • a screen projection prompt is displayed on the first terminal.
  • the screen projection prompt is presented in the form of an interface.
  • the screen projection prompt is shown in FIG. 11 .
  • the screen projection prompt includes a button 16 to stop the screen projection, and also displays content such as the duration of the screen projection.
  • the fourth application enters the sixth interface, and the sixth interface displays contents such as preview images and names of selectable file data.
  • the sixth interface is shown in FIG. 12 , each file data has a corresponding selection mark 17 , and the user can select file data by operating the selection mark.
  • the sixth interface also displays an OK button, and when it is detected that the OK button is clicked, the currently selected file data is sent to the first terminal, and then the sixth interface returns to the fifth interface.
  • the sixth interface also displays the selected number of file data.
  • the user can also click the call button 15 in the fifth interface, after that, the first terminal displays the contact list according to the user's operation, so that the user can select a contact in the contact list, and then, the first terminal uses the second terminal to contact the contact.
  • the second terminal sends the third control instruction, and sends the second control instruction to the interactive tablet, so as to implement audio and video calls between the local user and the remote user in the conference scene.
  • Fig. 22 is a schematic structural diagram of an interaction implementation device provided by an embodiment of the present application.
  • the interaction realization device is applied in the interactive tablet.
  • the interaction realization device includes: a first display unit 410, a first receiving unit 420, a second display unit 430, a second receiving unit 440, a third display unit 450, a Three receiving units 460 and a fourth display unit 470 .
  • the first display unit 410 is configured to display the first interface of the first application; the first receiving unit 420 is configured to receive the first data sent by at least one first terminal, the first data includes file data or screen projection data, Wherein, the first terminal communicates with the interactive tablet through wireless communication; the second display unit 430 is used to display a preview image of each first data in the first interface; the second receiving unit 440 is used to receive the first operation, The first operation is used to select the target preview image in each preview image; the third display unit 450 is used to display the second interface of the second application, and the second application is an application program for opening the first data corresponding to the target preview image The third receiving unit 460 is configured to receive the second operation on the second interface; the fourth display unit 470 is configured to close the second interface and resume displaying the first interface according to the second operation.
  • the fourth display unit 470 is specifically configured to: close the second interface, resume displaying the first interface, and update the target preview image according to the second operation.
  • the fourth display unit 470 updates the target preview image, it includes: a content acquisition subunit for acquiring the display content when the second interface is closed; a first preview image generation subunit for A first preview image is generated according to the displayed content, and the target preview image is updated to the first preview image.
  • the second application is a whiteboard application
  • the device further includes: a first response unit, configured to receive a writing operation in the second interface after displaying the second interface of the second application, and according to the writing operation to generate corresponding handwriting in the second interface.
  • the second application is a file display application
  • the device further includes: a second response unit, configured to receive a file display operation in the second interface after displaying the second interface of the second application, and according to the file display operation, The second interface displays the corresponding file display results.
  • the second application is a screen-casting application
  • the device further includes: a third response unit, configured to receive the real-time screen-casting data sent by the first terminal after displaying the second interface of the second application; The real-time projection data is displayed in .
  • a fourth receiving unit configured to receive the first control instruction sent by the first terminal after displaying the preview image of each first data on the first interface, and the first control instruction is used to Instructing the interactive tablet to open the target preview image; the fifth display unit is configured to display the second interface of the second application according to the first control instruction.
  • the arrangement rule of the preview images in the first interface is determined by the number of preview images.
  • the second interface is a full-screen interface
  • the third display unit 450 is specifically configured to: display the second interface of the second application, and display the first button on the second interface, and the first button
  • the display level is higher than the second interface
  • the first button includes the first control
  • the interactive panel receives the second operation
  • the second application is an application for opening the first data corresponding to the target preview image .
  • the device further includes: a fifth receiving unit, configured to receive a second control instruction sent by the first terminal, and the second control instruction is used to instruct the interactive tablet to perform audio and video communication with at least one second terminal. call; the sixth display unit is configured to display the third interface according to the second control instruction, and display information on the audio and video call with the second terminal on the third interface.
  • the third interface is a floating window interface.
  • the sixth display unit when displaying the third interface, is further configured to: share the displayed content of the first interface to the second terminal.
  • the first display unit 410 includes: a request receiving subunit, configured to receive a connection request sent by the first terminal; a connection establishment subunit, configured to confirm the establishment of wireless communication with the first terminal according to the connection request The connection; application opening subunit is configured to open the first application and display the first interface of the first application after the wireless communication connection is established with the first terminal.
  • the device further includes: a recording unit, configured to display a first interface of the first application, and record display content of the first interface.
  • the device further includes: a sixth receiving unit, configured to receive a third operation, and the third operation is used to call out the system toolbar of the interactive tablet; a seventh display unit, configured to The operation is to display the system toolbar, the system toolbar includes at least one application icon; the seventh receiving unit is used to receive the fourth operation, and the fourth operation is used to select the target application icon among the application icons; the eighth display unit is used to hide A system tool bar, and a fourth interface of a third application is displayed superimposed on the first interface, and the third application is an application program corresponding to the target application icon.
  • the device further includes: an eighth receiving unit, configured to receive an insertion operation for the third application after the fourth interface of the third application is superimposed and displayed on the first interface;
  • a closing unit is configured to close the fourth interface and add a preview image of the third application to the first interface in response to the inserting operation.
  • the eighth display unit is used to display the second button when superimposing the fourth interface of the third application on the first interface, and the second button has the same display level as the fourth interface , the second key is used to control the fourth interface, the second key includes a second control, and when the second control is triggered, the interactive tablet receives an inserting operation.
  • the first closing unit includes: a screenshot subunit, configured to close the fourth interface in response to the insertion operation, and take a screenshot of the fourth interface, and use the obtained screenshot image as the third application preview image; add a sub-unit for adding and displaying the preview image in the first interface.
  • the second display unit 430 includes: a content acquisition subunit for acquiring the data content of the first data; a preview generation subunit for generating a preview of the first data according to the data content;
  • the image sending subunit is configured to send the preview image to the first application, and the first application displays the preview image on the first interface after receiving the preview image.
  • the device further includes: a ninth receiving unit, configured to receive an exit operation for the first application; a data obtaining unit, configured to obtain second data in response to the exit operation, the second data Including at least one of the first data, the screen recording data obtained when running the first application, the local file data opened or generated when running the first application, or the preview image of the local file data; the data uploading unit is used to upload the second The data is uploaded to the server for the first terminal to download the second data from the server; the second closing unit is used for closing the first application.
  • the interaction implementation device provided in the embodiment of the present application is included in the interactive tablet, and can be used to execute any interaction implementation method provided in the above embodiments, and has corresponding functions and beneficial effects.
  • the included units and modules are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be realized; in addition, each The specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present application.
  • Fig. 23 is a schematic structural diagram of an interactive panel provided by an embodiment of the present application.
  • the interactive panel includes a processor 50, a memory 51, an input device 52, an output device 53, a display 54, and a communication device 55; the number of processors 50 in the interactive panel can be one or more, as shown in Figure 23 Take a processor 50 as an example; the processor 50, memory 51, input device 52, output device 53, display 54, and communication device 55 in the interactive panel can be connected through a bus or in other ways. In FIG. 23, the connection through a bus is used as an example .
  • the memory 51 can be used to store software programs, computer-executable programs and modules, such as the program instructions/modules corresponding to the interactive realization method executed by the interactive tablet in the embodiment of the present application (for example, in the interactive realization device).
  • the processor 50 executes various functional applications and data processing of the interactive panel by running the software programs, instructions and modules stored in the memory 51 , that is, realizes the above-mentioned interaction realization method.
  • the memory 51 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required by a function; the data storage area may store data created according to the use of the interactive tablet, etc.
  • the memory 51 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices.
  • the memory 51 may further include memory located remotely relative to the processor 50, and these remote memories may be connected to the interactive panel through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the input device 52 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the interactive tablet.
  • the output device 53 may include equipment such as an audio playback device.
  • the display 54 can be a display screen with a touch function, and the display screen can be a capacitive screen, a resistive screen, an infrared screen and/or an electromagnetic screen, and the display 54 displays according to instructions from the processor 50, such as displaying the first interface of the first application wait.
  • the communication device 55 is configured to implement a communication function, such as establishing a wireless communication connection with the first terminal.
  • the above-mentioned interactive tablet includes an interactive realization device, which can be used to implement the interactive realization method, and has corresponding functions and beneficial effects.
  • the embodiment of the present application also provides a storage medium containing computer-executable instructions, the computer-executable instructions are used to perform related operations in the interactive implementation method provided in any embodiment of the present application when executed by a computer processor, and It has corresponding functions and beneficial effects.
  • the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects.
  • the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
  • the present application is described with reference to flowcharts and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions.
  • These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
  • a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • Memory may include non-permanent storage in computer readable media, in the form of random access memory (RAM) and/or nonvolatile memory such as read only memory (ROM) or flash RAM.
  • RAM random access memory
  • ROM read only memory
  • flash RAM flash random access memory
  • Computer-readable media including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information.
  • Information may be computer readable instructions, data structures, modules of a program, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridge, tape magnetic disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device.
  • computer-readable media excludes transitory computer-readable media, such as modulated data signals and carrier waves.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种交互实现方法、装置、交互平板及存储介质,涉及交互平板技术领域,其中方法包括:显示第一应用的第一界面(110);接收至少一个第一终端发送的第一数据,第一数据包括文件数据或投屏数据,其中,第一终端与交互平板通过无线通信方式进行通信(120);在第一界面中显示各第一数据的预览图(130);接收第一操作,第一操作用于在各预览图中选择目标预览图(140);显示第二应用的第二界面,第二应用为用于打开目标预览图对应的第一数据的应用程序(150);接收针对第二界面的第二操作(160);根据第二操作,关闭第二界面,恢复显示第一界面(170)。采用上述方法可以解决相关技术中切换打开不同类型的数据时,操作过程较为繁琐的技术问题。

Description

交互实现方法、装置、交互平板及存储介质 技术领域
本申请实施例涉及交互平板技术领域,尤其涉及一种交互实现方法、装置、交互平板及存储介质。
背景技术
随着智能化技术的发展,各类智能化的电子设备被广泛地使用在日常的各类场景中。例如,会议场景下,电子设备作为会议终端,可以实现显示会议文件、显示本地其他电子设备的投屏数据、与远端的电子设备进行音视频通话、充当会议白板等功能。
随着电子设备的广泛使用,电子设备可实现的功能日益丰富。一般而言,电子设备通过运行其安装的各类应用程序实现不同的功能,例如,通过不同的应用程序来显示不同类型的数据。然而,当用户想要依次打开不同类型的数据时,通常需要操作电子设备先关闭当前类型的应用程序,之后,打开另一类型的应用程序并在应用程序中打开数据。这样需要用户在电子设备中发出多个操作,使得操作过程较为繁琐,影响了使用效率。
发明内容
本申请实施例提供了一种交互实现方法、装置、交互平板及存储介质,以解决相关技术中打开不同类型的数据时,操作过程较为繁琐的技术问题。
第一方面,本申请一个实施例提供了一种交互实现方法,应用于交互平板,该方法包括:
显示第一应用的第一界面;
接收至少一个第一终端发送的第一数据,所述第一数据包括文件数据或投屏数据,其中,所述第一终端与所述交互平板通过无线通信方式进行通信;
在所述第一界面中显示各所述第一数据的预览图;
接收第一操作,所述第一操作用于在各所述预览图中选择目标预览图;
显示第二应用的第二界面,所述第二应用为用于打开所述目标预览图对应的所述第一数据的应用程序;
接收针对所述第二界面的第二操作;
根据所述第二操作,关闭所述第二界面,恢复显示所述第一界面。
第二方面,本申请一个实施例提供了一种交互实现方法,应用于交互实现系统,所述交互实现系统包括交互平板和至少一个第一终端,所述交互实现方法包括:
所述第一终端与所述交互平板建立无线通信连接;
所述交互平板显示第一应用的第一界面;
所述第一终端显示第四应用的第五界面;
所述第一终端在所述第五界面中接收第五操作;
确定所述第五操作用于选择发送文件数据,所述第一终端根据所述第五操作,将本地的文件数据发送至交互平板,确定所述第五操作用于选择发送投屏数据,所述第一终端将本地的投屏数据上传至所述交互平板;
所述交互平板在所述第一界面中显示所述第一数据的预览图,所述第一数据包括所述文件数据或所述投屏数据;
所述交互平板接收第一操作,所述第一操作用于在各所述预览图中选择目标预览图;
所述交互平板显示第二应用的第二界面,所述第二应用为用于打开所述目标预览图对应的所述第一数据的应用程序;
所述交互平板接收针对所述第二界面的第二操作;
所述交互平板根据所述第二操作,关闭所述第二界面,恢复显示所述第一界面。
第三方面,本申请一个实施例提供了一种交互实现装置,应用于交互平板,该装置包括:
第一显示单元,用于显示第一应用的第一界面;
第一接收单元,用于接收至少一个第一终端发送的第一数据,所述第一数据包括文件数据或投屏数据,其中,所述第一终端与所述交互平板通过无线通信方式进行通信;
第二显示单元,用于在所述第一界面中显示各所述第一数据的预览图;
第二接收单元,用于接收第一操作,所述第一操作用于在各所述预览图中选择目标预览图;
第三显示单元,用于显示第二应用的第二界面,所述第二应用为用于打开所述目标预览图对应的所述第一数据的应用程序;
第三接收单元,用于接收针对所述第二界面的第二操作;
第四显示单元,用于根据所述第二操作,关闭所述第二界面,恢复显示所述第一界面。
第四方面,本申请一个实施例提供了一种交互平板,包括:
一个或多个处理器;
显示器,用于根据所述处理器的指示进行显示;
通信模块,用于与至少一个第一终端进行无线通信;
存储器,用于存储一个或多个程序;
当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如第一方面所述的交互实现方法。
第五方面,本申请一个实施例提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如第一方面所述的交互实现方法。
本申请一个实施例中,通过显示第一应用的第一界面,并在接收到第一终端发送的第一数据时,将第一数据的预览图显示在第一界面中,当用户选择预览图时,显示第二应用的第二界面,第二界面中显示第一数据,之后,接收针对第二界面的第二操作时,关闭第二界面,并恢复显示第一界面,之后,用户可以在第一界面中再次选择预览图,以打开对应的第一数据的技术手段,可以解决相关技术中打开不同类型的数据时,操作过程较为繁琐的技术问题。以第一应用的第一界面为载体,可以通过第一界面的预览图直接打开对应的第一数据,简化了操作过程。并且,通过第一界面显示第一数据的预览图,还可以使用户明确第一终端上传了哪些第一数据。
附图说明
图1为本申请一个实施例提供的一种交互实现方法的流程图;
图2为本申请一个实施例提供的一种排列规则示意图;
图3为本申请一个实施例提供的一种排列规则示意图;
图4为本申请一个实施例提供的一种排列规则示意图;
图5为本申请一个实施例提供的一种交互实现方法的流程图;
图6为本申请一个实施例提供的一种交互实现方法的流程图;
图7为本申请一个实施例提供的第四应用主界面示意图;
图8为本申请一个实施例提供的第七界面示意图;
图9为本申请一个实施例提供的第五界面示意图;
图10为本申请一个实施例提供的第一界面的第一示意图;
图11为本申请一个实施例提供的投屏提示示意图;
图12为本申请一个实施例提供的第六界面示意图;
图13为本申请一个实施例提供的第一界面的第二示意图;
图14为本申请一个实施例提供的第二界面示意图;
图15为本申请一个实施例提供的联系人列表示意图;
图16为本申请一个实施例提供的邀请命令显示示意图;
图17为本申请一个实施例提供的第一界面的第三示意图;
图18为本申请一个实施例提供的第一界面的第四示意图;
图19为本申请一个实施例提供的第四界面示意图;
图20为本申请一个实施例提供的第一界面的第五示意图;
图21为本申请一个实施例提供的第二数据的列表示意图;
图22为本申请一个实施例提供的一种交互实现装置的结构示意图;
图23为本申请一个实施例提供的一种交互平板的结构示意图。
具体实施方式
下面结合附图和实施例对本申请作进一步的详细说明。可以理解的是,此处所描述的具体实施例用于解释本申请,而非对本申请的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本申请相关的部分而非全部结构。
本申请实施例提供了一种交互实现方法,该交互实现方法可以由交互实现设备执行,交互实现设备可以通过软件和/或硬件的方式实现,该交互实现方法可以是两个或多个物理实体构成,也可以是一个物理实体构成。交互实现设备可以是交互平板、平板电脑、智能电视、手机等智能化的电子设备。
一个实施例中,以交互实现设备为交互平板,示例性描述交互平板的交互实现方法。其中,交互平板是通过触控技术对显示在显示平板上的内容进行操控和实现人机交互操作的一体化设备,其集成了投影机、电子白板、幕布、音响、电视机以及视频会议终端等一种或多种功能。
交互平板安装有至少一类操作系统,操作系统可以是Android系统、Windows系统、Linux系统、IOS系统等。交互平板在操作系统下可以安装至少一个应用程序。其中,应用程序可以是操作系统自带的应用程序,也安装是从第三方设备或者服务器中下载的应用程序,当前不作限定。例如,交互平板安装有白板应用,白板应用指供用户进行书写、展示等操作的应用,可以用于根据用户在白板应用的界面的书写操作(触控操作)生成书写笔迹,也可以用于在白板应用的界面插入和显示多媒体元素,多媒体元素可以包括图形、图像、表格、文档、音频文件和/或视频文件。在白板应用的界面中,用户可以实现与实体黑板类似的写、画、擦除等操作,并进一步有更好的移动、保存、缩放、插入图片、颜色调整、笔画粗细设置等数字化功能。白板应用还可以显示以及编辑用户在其他终端的白板应用中创建的文件数据(包括书写笔迹和/或多媒体元素等)。实际应用中,白板应用也可以命名为书写应用、电子白板应用、协同白板应用等名称,不管名称如何改变,只要用于实现上述功能的应用,均等同于本公开的白板应用。再如,交互平板安装有文件展示应用,文件展示应用可以用于向用户进行文件展示,一些场景下,文件展示应用也可以供用户对文件进行编辑,如供用户创建文件、编辑文件内容、添加批注等,以实现文件展示过程中的用户编辑操作的实时展示,进而提高文件展示过程中的信息展示和交互效果。可理解,交互平板可安装多个文件展示应用,且不同的文件展示应用可以展示不同类型的文件。例如,交互平板分别安装有用于展示Word文档、PDF文档、PPT文档、Excel文档等文档的文件展示应用,还安装有用于展示图片(如bmp,jpg,png,tif,gif等)、视频(如wmv、MP4、avi、rm等)、音频(如MP3、WMA等)等多媒体文件的文件展示应用。在实际应用中,根据展示文件的类型可以对文件展示应用进行相应的命名,不管文件展示应用的名称如何改变,只要用于实现上述功能的应用,均等同于本公开的文件展示应用。又如,交互平板安装有投屏应用,投屏应用主要用于无线投屏,无线投屏是通过特定技术方法将移动设备(如手机、平板电脑、笔记本电脑等)的画面(也称为投屏数据)“实时地”显示到交互平板,显示的内容包括各类媒体信息和实时操作画面。 投屏应用也可以被称为传屏应用、飞屏应用、屏幕共享应用,不管投屏应用的名称如何改变,只要用于实现上述功能的应用,均等同于本公开的投屏应用。
交互平板还配置有至少一块显示屏(也可记为显示器)。例如,交互平板配置有一块具有触摸功能的显示屏,该显示屏可以是电容屏、电阻屏、红外屏和/或电磁屏。用户可以通过手指或触控笔触控显示屏的方式实现对交互平板的控制。此外,交互平板还可以连接鼠标、键盘等外置设备,用户还可以通过操作外置设备的方式实现对交互平板的控制。
交互平板还配置有通信模块,交互平板通过通信模块实现通信功能,例如,交互平板通过通信模块与其他电子设备进行数据传输。再如,交互平板通过通信模块与服务器进行数据传输。交互平板通过通信模块与其他电子设备进行通信时,可以接收其他电子设备传输的文件数据并进行展示或者供用户进行批注、编辑等操作,还可以接收并显示其他电子设备发送的投屏数据,也可以与其他电子设备进行音视频通话、或者与其他电子设备进行屏幕共享等,尤其在会议等需要多人沟通场景的下,交互平板可以作为交互设备,实现多人沟通场景下的功能需求,例如,会议场景下,交互平板依次显示会议室中本地的各用户的移动终端的投屏数据,或者是,依次显示会议室中本地的各用户的移动终端发送的文件数据,又或是,实现本地的用户与远程终端(如远程的交互平板、移动终端)的用户进行音视频通话,并在音视频通话过程中将交互平板的屏幕内容发送至远程终端进行显示。
在现有的多人沟通场景下,当切换交互平板当前显示的数据内容时,需要执行多个操作环节。以会议场景为例,举例而言,交互平板显示移动终端A的投屏数据,当需要显示移动终端B上传的文件数据时,本地的用户需要断开移动终端A与交互平板的连接,并关闭投屏应用,之后,在交互平板中打开相应的文件展示应用或白板应用,并在文件展示应用或白板应用中打开移动终端B的文件数据。再举例而言,交互平板需要依次显示移动终端A、移动终端B和移动终端C的投屏数据时,本地的用户需要依次切换三个移动终端向交互平板发送投屏数据,例如,移动终端A的用户断开移动终端A与交互平板的连接,移动终端B的用户使用移动终端B与交互平板建立连接并发送投屏数据。再举例而言,交互平板利用文件展示应用显示本地的PPT文档后,若接收到移动终端B发送的Word文档,则需要本地的用户对交互平板进行操作,以关闭(或切换至后台)PPT文档对应的文件展示应用,打开Word文档对应的文件展示应用并在文件展示应用中打开Word文档,之后,需要再次显示PPT文档时,需要用户再次操作交互平板,以关闭(或切换至后台)Word文档对应的文件展示应用,并打开PPT文档对应的文件展示应用以及在文件展示应用中打开PPT文档。再举例而言,交互平板显示移动终端A发送的Word文档,之后,若本地的用户需要在交互平板中使用白板功能,则需要关闭(或切换至后台)Word文档对应的文件展示应用,并启动白板应用,之后,当用户需要再次打开Word文档时,需要关闭(或切换至后台)白板应用,打开Word文档对应的文件展示应用以及在文件展示应用中打开Word文档。
为了减少切换数据内容时执行的操作环节,本申请实施例提供的交互实现方法中,在多人沟通场景下,将交互平板接收的所有数据都以预览图的方式显示在一个应用程序的界面中,还将交互平板安装的其他应用程序的界面也以预览图的方式显示在该界面中,之后,用户只需在该界面中选择需要的预览图,便可以打开对应的数据或者其他应用程序。
交互平板执行所述交互实现方法时,图1为本申请一个实施例提供的一种交互实现方法的流程图,参考图1,该交互实现方法包括:
步骤110、显示第一应用的第一界面。
第一应用为交互平板中安装的应用程序。第一应用可认为是用于连接的应用程序,一个实施例中,执行交互实现方法时,通过将其他应用程序或者其中打开的数据以预览图的方式显示在第一应用的应用界面中可以实现其他不同应用程序间的快速切换。
一个实施例中,交互平板与用户使用的另一电子设备建立连接。当前,将用户使用的另一电子设备记为第一终端,第一终端可以是手机、平板电脑、笔记本电脑等智能化的电子设备。示例性的,第一终端和 交互平板在地理位置上相距较近,例如,会议场景下,第一终端和交互平板处于同一会议室中,再如,教学场景下,第一终端和交互平板位于同一教室中。可理解的是,在未执行交互实现方法时,第一终端和交互平板在地理位置上可以相距较远,例如,第一终端为手机,其具有移动性,交互平板安装在某个会议室中,会议场景下,参会者可以将第一终端带入会议室,并与交互平板建立连接,会议结束后,参会者断开第一终端和交互平板的连接,并将第一终端带离会议室。
一个实施例中,第一终端中安装有与第一应用相对应的应用程序,当前,将第一终端中安装的应用程序记为第四应用,第四应用和第一应用相对应可以理解为第四应用和第一应用之间可以建立连接、传输数据、传输指令等。例如,第一应用为适用于交互平板的会议程序,第四应用为适用于第一终端的会议程序,此时,通过两个应用程序可以实现第一终端和交互平板的连接,之后,通过第四应用,可以将第一终端中会议所需的数据发送至交互平板,进而使交互平板显示该数据,以供其他参会者观看。
一个实施例中,通过第一应用和第四应用建立第一终端和交互平板的连接,当前,该连接主要为无线通信连接。可选的,由于第一终端和交互平板在地理位置上相距较近,因此,第一终端和交互平板可以采用近距离无线通信(即适用于近距离范围内的无线通信)的方式建立连接并进行数据传输。例如,通过连接码的方式建立连接。举例来说,第一终端和交互平板位于同一局域网中,用户在第一终端和交互平板的一个终端中生成一个连接码,该连接码为一串由字母、数字和/或符号组成的字符串,当用户在第一终端和交互平板的另一个终端中输入该连接码(另一个终端为第一终端时通过第四应用输入,另一个终端为交互平板时通过第一应用输入)时,第一终端和交互平板在局域网中基于相同的连接码确认连接。再如,通过二维码的方式建立连接。举例来说,用户通过交互平板生成用于连接的二维码,之后,用户通过第一终端的第四应用扫描该二维码,扫描成功后,第一终端和交互平板确认连接。又如,通过蓝牙配对的方式建立连接。需说明,实际应用中,还可以采用其他的近距离无线通信方式建立连接,或者是,第一终端和交互平板采用远程网络通信(即利用互联网实现远距离范围的通信)的方式建立连接,当前不作限定。
一个实施例中,第一终端和交互平板连接后,交互平板打开第一应用。可理解,若连接前第一应用已经打开,则连接后将第一应用设置为前台运行。前台运行可理解为应用程序运行时,在屏幕中显示该应用程序的界面,用户可以通过该界面掌握应用程序的运行过程并对应用程序进行相应的控制。与前台运行相对的是后台运行,后台运行可理解为应用程序运行时,在屏幕中未显示该应用程序的界面,用户无法直观掌握应用程序的运行过程。
示例性的,打开第一应用后,显示第一应用的第一界面。第一界面可以认为是第一应用的主界面,其中,界面(也称为应用界面)指一个应用程序用于接收和/或展示信息的交互界面,主界面是运行第一应用后显示的第一个界面,类似于第一应用的桌面。可理解,第一应用存在开启动画或开启图像时,第一界面是开启动画或开启图像显示完成后的第一个界面。用户通过对第一界面的操作,可以触发第一应用执行对应的功能。第一界面可以为全屏界面也可以为非全屏界面,当前以全屏界面为例。第一界面为全屏界面,可理解为第一界面铺满屏幕。当前,通过显示第一界面,可以明确第一终端与交互平板成功建立了连接。
第一界面的内容和布局当前不作限定。例如,第一界面中显示终端列表,该终端列表显示当前已连接的第一终端(如显示第一终端的头像和/或名称)。再如,第一界面中显示功能性按键,功能性按键是指用户对其操作后可以触发相应功能的控件。功能性按键在第一界面中以虚拟按键的方式呈现,功能性按键的数量当前不作限定,一个功能性按键可以触发一个功能,如第一界面显示用于退出第一应用的按键、显示用于录制屏幕内容的按键等。
可选的,显示第一应用的第一界面时,还可以启动预先设置的功能。例如,显示第一界面时,还开启录屏功能,录屏功能下,交互平板对屏幕内容进行录制,并基于录制的屏幕内容生成录屏文件,通过录屏文件可以回顾录制过程中交互平板的屏幕内容。
可理解,交互平板和第一终端建立连接后,其他的第一终端也可以与交互平板建立连接。例如,第一个第一终端与交互平板建立连接后,交互平板打开第一应用并显示第一界面,第一界面中显示第一终端的 头像,之后,第二个第一终端与交互平板建立连接时,交互平板在第一界面中添加第二个第一终端的头像,从而显示本地连接的第一终端的情况。
步骤120、接收至少一个第一终端发送的第一数据,第一数据包括文件数据或投屏数据,其中,第一终端与交互平板通过无线通信方式进行通信。
一个实施例中,显示第一界面后,用户通过操作第四应用向交互平板发送数据。当前,将第一终端发送的数据记为第一数据,第一数据包括文件数据和/或投屏数据。
文件数据是指第一终端中存储的文件(该文件可以在第一终端中创建或者在其他终端中创建后传输至第一终端中),文件数据的类型当前不作限定,例如,文件数据的类型可以是图像、文本、音视频、演示文稿、表格、白板文件等。不同类型的文件数据需要使用适配的应用程序打开,例如,文件数据为PPT格式的演示文稿数据,则需要的文件展示应用为PPT或WPS Office等演示文稿应用。再如,文件数据为音视频数据,则需要的文件展示应用为音视频播放应用。再如,文件数据为白板文件数据,则需要白板应用。一个实施例中,用户在第四应用中选择用于上传文件数据的功能后,第四应用显示可被上传的文件数据,可被上传的文件数据可以是第一终端中保存的全部文件数据,或者是,特定类型的文件数据(特定类型可根据实际情况设置),又或是,预先由用户导入至第四应用的文件数据,导入的文件数据可理解为用户预先在全部文件数据中选择的且可以被第四应用使用的文件数据。示例性的,第四应用支持多文件发送,即用户可以选择一个或多个文件数据,当用户选择多个文件数据时,多个文件数据的类型可以相同或不同。可选的,第四应用中预先设置有最大文件选择数量,用户选择的文件数据超过最大文件选择数量后,用户无法继续选择文件数据,此时,第四应用可以提示用户达到最大文件选择数量。
选择文件数据后,第一终端将文件数据发送至交互平板。本申请实施例中,第一终端与交互平板建立近距离无线通信后,直接将文件数据发送至交互平板。第一终端通过远程网络通信的方式与交互平板建立连接后,将文件数据通过远程网络通信的方式上传至服务器,由服务器发送到交互平板。服务器是为第一应用和第四应用提供服务的服务器。
可选的,发送文件数据时,除了发送文件数据本身的内容外,还发送文件数据的属性信息,其中,属性信息包括:文件数据的名称、类型等内容。可理解,实际应用中,属性信息还可以包括其他的内容,例如,第一终端的头像和/或名称等内容,当前不作限定。
投屏可理解为将第一终端的内容(可以是屏幕内容或者是一个或多个界面的内容,还可以是屏幕中播放的音视频数据)即时同步地显示在交互平板上。投屏数据是指投屏过程中基于投屏的内容编码得到的数据,交互平板通过解码投屏数据可以获取并显示第一终端的内容。可选的,用户在第四应用中选择投屏的功能后,第四应用获取投屏数据,并通过第一终端发送至交互平板。可选的,还可以通过投屏终端来实现第一终端与交互平板的连接,以及投屏数据的发送。例如,投屏终端中安装或存储有投屏应用程序,投屏终端与交互平板实现配对连接后,当投屏终端接入第一终端后,可以直接获取投屏数据并编码后发送至交互平板,或者将投屏应用程序下载并安装到第一终端后,投屏应用程序获取投屏数据并编码后发送至交互平板。第一终端发送投屏数据时可以直接发送至交互平板或经过服务器发送至交互平板。发送投屏数据时,除了发送投屏数据本身的内容外,还发送投屏数据的属性信息,其中,属性信息包括:表示投屏的标识(该标识可以认为是数据的类型)。可理解,实际应用中,属性信息还可以包括其他的内容,例如,第一终端的头像和/或名称等内容,当前不作限定。
步骤130、在第一界面中显示各第一数据的预览图。
示例性的,交互平板接收到第一数据后,根据第一数据生成相应的预览图并显示在第一应用的第一界面中,以供用户选择需要打开的第一数据。其中,预览图是指将第一数据中的数据内容经压缩方式处理后得到的小图,通常会包含指向第一数据的超链接。例如,第一数据为PPT文档时,预览图是基于PPT文档的第一页数据内容得到的小图。再如,第一数据为投屏数据时,预览图是基于投屏数据中的一帧(可以是第一帧或其他帧)内容得到的小图。
一个实施例中,步骤130包括:步骤131-步骤133:
步骤131、获取第一数据的数据内容。
数据内容是第一数据中包含的内容。交互平板接收第一数据后,对第一数据进行解析,以获取第一数据的数据内容、属性信息等。可选的,当前获取的数据内容可以是用于生成预览图的数据内容,例如,第一数据包含多页或多帧数据内容时,只获取其中一页(如第一页或打开第一数据时默认显示的页数)或一帧(如第一帧或打开第一数据时应显示的帧数)数据内容。第一数据不包含多页或多帧数据内容时,获取全部数据内容。
步骤132、根据数据内容生成第一数据的预览图。
可选的,生成包含数据内容的预览图作为第一数据的预览图。预览图的尺寸当前不作限定。一般而言,各第一数据的预览图具有相同的尺寸。可选的,预览图的生成方式不作限定,例如,对数据内容进行截图以及压缩,并添加指向第一数据的超链接,以得到第一数据的预览图。
步骤133、将预览图发送至第一应用,第一应用接收到预览图后,在第一界面显示预览图。
示例性的,交互平板解析第一数据得到预览图后,将预览图发送给第一应用,之后,第一应用在第一界面中显示预览图。可选的,若属性信息包含第一终端的头像和/或名称,则发送预览图时,还发送第一终端的头像和/或名称,以在第一界面中显示预览图时,显示第一终端的头像和/或名称,使得用户明确发送第一数据的第一终端。
一个实施例中,在第一界面显示第一数据的预览图时,根据预览图的排列规则进行显示。排列规则规定了预览图在第一界面中的尺寸、行间隔(同一行中两个相邻预览图的间隔距离)和列间隔(同一列中两个相邻预览图的间隔距离)等内容。可选的,预览图的排列规则由预览图的数量而确定,即预览图的数量不同时,预览图的排列规则可以不同。或者,预览图的排列规则固定不变且用户可以修改预览图的排列规则,即预览图的数量不同时,预览图的排列规则相同。一个实施例中,以预览图在第一界面中的排列规则由预览图的数量而确定为例进行描述。此时,设置不同数量下预览图的排列规则,第一应用根据当前需要显示的预览图的数量,获取对应的排列规则,然后,根据排列规则显示预览图。举例而言,图2为预览图数量为1时预览图的排列规则,图3为预览图数量为2时预览图的排列规则,图4为预览图数量为3以及3以上时预览图的排列规则(图4以5个预览图为例),由图2至图4可知,结合预览图的数量设置不同的排列规则,可以使预览图的显示更加灵活。
可选的,第一数据为多个时,多个预览图在第一界面中的排列顺序可以根据实际情况设置。例如,按照发送或接收时间,排列多个预览图。再如,按照第一数据的类型,排列多个预览图。
可选的,在第一界面中显示第一数据的预览图时,还可以显示第一数据的名称。
可选的,第一界面中显示的预览图还可以根据第一数据的接收情况而发生变化,例如,某个第一终端结束发送投屏数据时,第一应用在第一界面中删除投屏数据对应的预览图,并调整剩余预览图的排列。再如,第一终端发送了新的第一数据时,第一应用在第一界面中添加新的第一数据的预览图,并调整剩余预览图的排列。
可选的,交互平板解析第一数据时还可以明确第一数据的类型,之后,根据第一数据的类型启动对应的应用程序,当前,将启动的应用程序记为第二应用,第二应用可以认为是打开第一数据所需的应用程序,第二应用启动后,在第二应用中打开第一数据。可选的,获取第一数据的数据内容时,可以是在第二应用打开第一数据后,获取第二应用所显示的数据内容。可选的,启动第二应用以及打开第一数据均在后台完成。第一数据打开后,通过预览图的超链接,可以找到第二应用中打开的第一数据。可选的,若第一应用可以打开第一数据,则直接将第一应用作为第二应用,此时,无需打开第二应用。
在第一界面中显示第一数据的预览图后,执行步骤140。
步骤140、接收第一操作,第一操作用于在各预览图中选择目标预览图。
示例性的,第一界面显示预览图后,用户可以根据自身的需求在第一界面中选择一张预览图,以使交 互平板打开预览图对应的第一数据。
一个实施例中,将用户选择预览图的操作记为第一操作,将用户选择的预览图记为目标预览图。第一操作的触发方式当前不作限定,例如,检测到预览图接收到设定操作(如单击操作、双击操作)等,确定接收到第一操作,并将第一操作作用的预览图作为目标预览图。
步骤150、显示第二应用的第二界面,第二应用为用于打开目标预览图对应的第一数据的应用程序。
示例性的,由于预览图具有指向第一数据的超链接,所以,当用户选择目标预览图后,通过目标预览图的超链接可以打开对应的第一数据。一个实施例中,由于第一数据在相应的第二应用中打开,因此,通过超链接打开第一数据,是指将打开第一数据的第二应用切换至前台运行,以显示第一数据。
示例性的,第一应用接收到第一操作后,将第一操作选择的目标预览图通知给交互平板,由交互平板根据目标预览图的超链接将第二应用切换至前台运行。第二应用切换至前台运行时,显示第二应用的界面。当前,将第二应用显示的界面记为第二界面。需说明,第二应用在后台运行时已经打开了第一数据,因此,前台显示的第二界面是指第二应用打开第一数据后显示的界面,即第二界面中显示有第一数据。
显示第二界面时,第二界面可以为全屏界面也可以为非全屏界面,当前,以第二界面为全屏界面为例进行描述。显示第二界面后,第一界面被第二界面遮挡,此时,可以认为第一应用切换为后台运行,当第一应用再次被切换至前台时,恢复显示第一界面。
一个实施例中,显示第二界面时,还可以显示至少一个功能性按键。当前,将显示第二界面时显示的功能性按键记为第一按键。第一按键可以为一个或多个,一个第一按键对应一项功能,功能的具体内容可以根据实际需求设置,例如,当前显示两个第一按键,一个第一按键的功能为恢复功能,通过恢复功能可以关闭第二界面并恢复显示第一界面,另一个第一按键的功能为屏幕共享功能,通过屏幕共享功能可以向其他终端发送交互平板的屏幕内容,以使其他终端显示该屏幕内容。
可选的,第一按键可以是应用级按键或者系统级按键。应用级按键是由相应的应用程序执行对应的功能。系统级按键是操作系统的命令,即由操作系统执行对应的功能。第一按键为多个时,不同的第一按键可以分别属于系统级按键和应用级按键,且多个第一按键属于应用级按键时,不同的第一按键可以属于不同的应用程序,当前不作限定。一个实施例中,第一按键的显示层级高于第二界面,即第一按键显示在第二界面之上,用户对第一按键所在位置进行操作时,确认是对第一按键的操作而非对第二界面的操作。
一个实施例中,以第一按键至少具有恢复功能为例进行描述,此时,第二界面为全屏界面,显示第二应用的第二界面,具体为:显示第二应用的第二界面,并在第二界面上显示第一按键,第一按键的显示层级高于第二界面,第一按键包括第一控件,且第一控件被触发时,交互平板接收到第二操作。
示例性的,将第一按键中用于触发恢复功能的按键记为第一控件,控件是指对数据和方法的封装,功能性按键可以认为控件的一种实现方式。用户通过操作第一控件发出第二操作,第二操作是指关闭第二界面并恢复显示第一界面的操作。第一控件可以为系统级按键、第一应用的应用级按键或者第二应用的应用级按键。可选的,第一控件为系统级按键,并且,第一控件的显示层级高于第二界面。第一控件的显示位置当前不做限定。
需要说明的是,第一数据在第一应用打开时,第一应用也可以作为第二应用,此时,直接在第一应用中打开第一数据,并显示第二界面,第二界面是第一应用打开第一数据后显示的界面。当前,仍可显示第一按键。
一般而言,交互平板接收的第一数据均可在本地打开。若接收的第一数据无法在本地打开,则在生成预览图时,显示无法打开的提示。
一个实施例中,显示第二界面后,用户还可以通过第二界面对第一数据进行相应的操作。可选的,第二应用为白板应用,显示第二应用的第二界面之后,还包括:在第二界面中接收书写操作,根据书写操作,在第二界面中生成相应的书写笔迹。示例性的,第一数据为基于白板应用生成的数据时,交互平板打开白板应用并在白板应用中显示第一数据。之后,用户可以在交互平板中对第一数据进行书写、插入多媒体元 素等编辑操作。当前,将用户在第二界面中进行书写的记为书写操作。用户书写过程中,交互平板确定书写操作的位置,并通知白板应用在该位置处显示相应的书写笔迹。
可选的,第二应用为文件展示应用,显示第二应用的第二界面之后,还包括:在第二界面中接收文件展示操作,根据文件展示操作,在第二界面显示相应的文件展示结果。示例性的,通过文件展示数据打开第二界面并显示第一数据后,用户可以对第一数据进行编辑(如修改、增加或删除数据内容和/或插入多媒体元素)、批注、翻页等操作,此时,将用户对第一数据发出的操作记为文件展示操作,之后,第二应用对文件展示操作进行响应,并在第二界面中呈现对应的响应结果,当前,将响应结果记为文件展示结果。举例而言,第一数据为PPT文档,当前,第二界面显示PPT文档的第一页,用户在第二界面中发出翻页操作后,第二界面显示PPT文档的第二页,第二页的数据内容便是显示的文件展示结果。
可选的,第二应用为投屏应用,显示第二应用的第二界面之后,还包括:接收第一终端所发送的实时的投屏数据,在第二界面中显示实时的投屏数据。示例性的,第一数据为投屏数据时,第二应用为投屏应用,显示第二界面之后,便可以通过第二界面显示第一终端的投屏数据,此时,交互平板持续接收第一终端的投屏数据并在第二界面中实时显示。
可理解,除了对第二界面中的第一数据进行操作,还可以对第二界面整体进行操作,如关闭第二界面、退出全屏显示等。一个实施例中,以关闭第二界面为例进行描述,此时,步骤150之后,还执行步骤160。
步骤160、接收针对第二界面的第二操作。
第二操作的触发方式当前不作限定。例如,显示第二界面时,还显示第一控件,当检测到第一控件接收到设定操作(如单击操作)时,确定接收到第二操作。再如,检测到设定区域中接收到设定操作(如长按操作)时,确定接收到第二操作,其中,设定区域为屏幕中的一块区域,具体的区域位置当前不作限定。
步骤170、根据第二操作,关闭第二界面,恢复显示第一界面。
示例性的,关闭第二界面是指将第二应用切换至后台运行,此时,第二界面可以最小化或者切换至后台。关闭第二界面时,恢复显示第一界面,并且,第一界面中还显示第一数据的预览图(包含目标预览图),以便于用户通过预览图打开其他的第一数据或者再次打开当前的第一数据。可理解,若用户关闭了第二应用,则目标预览图不再显示在第一界面中。
一个实施例中,恢复显示第一界面后,还包括:更新目标预览图。示例性的,关闭第二界面时,恢复显示的第一界面中还保留目标预览图,当用户在第二界面中对第一数据进行操作时,可以根据操作内容,适时的更新目标预览图。可选的,将第二界面显示的数据内容作为预览图时,在恢复显示第一界面时,获取第二界面的数据内容,并基于数据内容生成目标预览图,此时,更新目标预览图可包括:获取第二界面被关闭时的显示内容;根据显示内容生成第一预览图,并将目标预览图更新为第一预览图。其中,关闭第二界面时,获取第二界面的显示内容,该显示内容为第二界面显示的第一数据的数据内容。可选的,通过截图的方式获取显示内容。之后,根据显示内容生成一张新的预览图,该过程与前述生成预览图的过程相同,在此不作赘述。当前,将生成的预览图记为第一预览图,并将第一预览图作为相应第一数据的新预览图,取代原有的目标预览图,以使第一界面中显示的目标预览图为第一预览图。可理解,获取第二界面的显示内容时,可以先判断第二界面的显示内容与目标预览图的内容是否一致,若一致,则放弃生成第一预览图,否则,生成第一预览图。或者是,获取第二界面的显示内容后,直接生成第一预览图,此时,存在生成的第一预览图与目标预览图的内容一致的情况。可理解,实际应用中,第一数据包含多页或多帧数据内容时,作为预览图的数据内容的页数或帧数可以固定(如始终采用第一页或第一帧作为预览图),此时,恢复显示第一界面时,确定作为预览图的页数或帧数内的数据内容是否发生变化,若未发生变化,则不更新目标预览图,若发生变化,则重新基于当前的数据内容生成第一预览图,并基于第一预览图对目标预览图进行更新。
可选的,当用户再次选择已关闭的第二界面对应的预览图时,再次显示第二界面,且该第二界面的显示内容与关闭第二界面时的显示内容一致。
上述,通过显示第一应用的第一界面,并在接收到第一终端发送的第一数据时,将第一数据的预览图显示在第一界面中,当用户选择预览图时,显示第二应用的第二界面,第二界面中显示第一数据,之后,接收针对第二界面的第二操作时,关闭第二界面,并恢复显示第一界面,之后,用户可以在第一界面中再次选择预览图,以打开对应的第一数据的技术手段,可以解决解决相关技术中打开不同类型的数据时,操作过程较为繁琐的技术问题。以第一应用的第一界面为载体,可以通过第一界面的预览图直接打开对应的第一数据,简化了操作过程。并且,通过第一界面显示第一数据的预览图,还可以使用户明确第一终端上传了哪些第一数据。通过系统级的第一按键接收第二操作,简化了关闭第二界面的操作过程,并且,不同的第二应用均可以通过第一按键进行控制,无需为每个第二应用单独添加第一按键,减小了开发难度。
下面,以会议场景为例,描述交互实现方法的应用过程。此时,第一终端和交互平板位于同一会议室,第一终端与交互平板建立近距离无线通信的连接后,交互平板显示第一应用的第一界面,第一界面如图10所示,第一界面中,显示已连接的第一终端的数量以及部分第一终端的用户头像23。之后,交互平板接收多个第一终端发送的第一数据后,生成各第一数据的预览图并显示在第一界面中。此时,第一界面由图10变化为图13。参考图13,其示出了三个预览图,其中,前两个预览图对应于文件数据,第三个预览图对应于投屏数据。可理解,交互平板在后台打开了各第一数据对应的第二应用,并在第二应用中打开了第一数据。示例性的,第一个预览图为PPT文档的预览图,用户选择第一个预览图后,显示第二应用的第二界面,第二界面中显示演示文稿数据。第二界面如图14所示,第二界面全屏显示了演示文稿数据,以供会议室的其他人观看该演示文稿数据,之后,用户可在第二界面中对PPT文档进行翻页、批注等操作。参考图14,显示第二界面时,还显示第一控件24。检测到第一控件24接收点击操作时,确定接收第二操作,关闭第二界面,并恢复显示第一界面,即由图14所示的界面恢复至图13所示的界面。可选的,关闭第二界面时,获取第二界面的显示内容并生成第一预览图,之后,将图13中的第一个预览图替换为第一预览图。之后,用户可以再次在第一界面中选择预览图,以使交互平板显示相应第二应用的第二界面,上述过程中,当用户需要切换显示第一数据时,只需要关闭当前的第二界面,并继续在第一界面中选择需要的预览图即可,并且,通过显示第一控件,可以使得用户的切换操作简化为两次点击操作,提高了用户的操作效率,进而提高了会议效率。
在本申请一个实施例中,还可以由第一终端在第一界面中选择目标预览图,以遥控交互平板打开相应的第二界面。此时,步骤130之后,还包括:接收第一终端所发送的第一控制指令,第一控制指令用于指示交互平板打开目标预览图;根据第一控制指令,显示第二应用的第二界面。
示例性的,第一终端安装的第四应用还具有选择目标预览图的功能,当前,用户通过第四应用选择了目标预览图后,第一终端生成第一控制指令,并发送至交互平板。之后,交互平板根据第一控制指令,确定第一界面中的目标预览图,之后,显示第二应用的第二界面。需说明,实施例中不限定用户通过第四应用选择目标预览图的实现过程。例如,用户在第四应用中可以调出遥控界面,该遥控界面显示有表示“上”、“下”、“左”、“右”以及“确定”功能的虚拟按键,用户通过虚拟按键在第一界面中选择目标预览图。再如,用户通过第四应用获取第一界面,并在第一终端显示第一界面,之后,用户通过第一终端的第一界面选择目标预览图,之后,第一终端将用户选择的目标预览图的位置发送至交互平板,交互平板根据该位置将第一界面中对应位置显示的预览图作为目标预览图。可理解,用户选择的目标预览图可以是任意第一终端发送的第一数据的预览图。
上述,通过第一终端遥控选择目标预览图的方式,无需用户走进交互平板进行操作,只需要在自身的位置上进行操作即可。
本申请一个实施例中,步骤110可具体包括步骤111-步骤113:
步骤111、接收第一终端发送的连接请求。
连接请求是用于建立连接的请求。一个实施例中,第一终端启动第四应用时,显示第四应用的主界面。主界面中显示有用于触发连接功能的功能性按键,当检测到该功能性按键接收到设定操作(如单击操作) 时,第四应用进入连接界面,当前,将连接界面记为第七界面。一个实施例中,当通过连接码建立连接时,用户在第七界面中输入连接码,输入完成后,第四终端生成连接请求,并将连接请求发送至交互平板。可选的,第一终端根据连接码在局域网中查找使用相同连接码的交互平板,并将连接请求发送至交互平板。当通过二维码建立连接时,用户通过第七界面可以扫描用于连接的二维码,扫描成功后,第四应用生成连接请求,并将连接请求发送至交互平板。其中,通过二维码中包含的信息可以找到交互平板,并向交互平板发送连接请求。
举例而言,以会议场景为例。此时,第一终端和交互平板位于同一会议室。示例性的,用户在第一终端中启动第四应用,之后,第四应用启动后显示第四应用的主界面,主界面如图7所示,主界面中显示有连接按键11,之后,检测到作用于连接按键的单击操作时,第四应用进入第七界面,第七界面为连接界面。第七界面如图8所示,参考图8,当前通过连接码建立连接,连接码为6位或8位的数字,交互平板设置有连接码。用户在第七界面中输入连接码后,第一终端向交互平板发送连接请求。可理解,第七界面还显示连接按键12,用户输入连接码后,点击连接按键,以使第一终端向交互平板发送连接请求,或者是,用户输入连接码后,第一终端自动向交互平板发送连接请求。
步骤112、根据连接请求,确认与第一终端建立无线通信连接。
交互平板根据连接请求确定第一终端的通信地址,并基于通信地址与第一终端建立连接,以使交互平板和第一终端进行数据通信。当前,建立的连接是指利用局域网进行通信的无线通信连接。
步骤113、在与第一终端建立无线通信连接后,打开第一应用,并显示第一应用的第一界面。
交互平板与第一终端建立连接后,交互平板打开第一应用。可选的,第四应用同样可以将主界面切换为用于连接控制的界面,当前,将用于连接控制的界面记为第五界面,用户通过第五界面可以发送第一数据。
第一应用打开后显示第一界面。一个实施例中,为了便于用户回顾用户基于第一应用的交互过程,在显示第一应用的第一界面之后,还包括:对第一界面的显示内容进行录制。
可选的,用户可以根据自身的实际需求,设置打开第一应用后自动对第一界面的显示内容进行录制,之后,用户可以随时关闭录制,以保证根据用户的实际需求合理的使用录屏功能,其中,录屏功能是指对第一界面的显示内容进行录制的功能。一个实施例中,除了自动启动录屏功能外,还可以在第一界面显示过程中由用户启动/关闭录屏功能。例如,第一界面显示有启动/关闭录屏功能的功能性按键,显示第一界面时,默认关闭录屏功能,此时,用户可以结合自身的需求通过前述功能性按键启动录屏功能,以对所述第一界面的显示内容进行录制,之后,用户还可以随时关闭或启动录屏功能。
可选的,第一终端可以为一个或多个,当第一终端为多个时,多个第一终端均可以与交互平板建立连接,并且,不同的第一终端可以采用相同或不同的方式建立连接,例如,各第一终端均通过连接码的方式与交互平板建立连接。再如,一部分第一终端通过连接码的方式与交互平板建立连接,另一部分第一终端通过扫描二维码的方式与交互平板建立连接。
可选的,第一终端和交互平板位于同一局域网时,第一终端和交互平板建立连接后,可以利用局域网进行通信。
上述,当交互平板与第一终端连接后,自动打开第一应用,可以使用户明确当前第一终端和交互平板成功连接,以便于用户进行后续操作,如使用第一终端发送第一数据。并且,通过对第一界面的显示内容进行录制,可以使用户回顾交互过程,尤其在会议、教学等场景下便于用户回顾会议或教学内容。
本申请一个实施例中,第一终端和交互平板建立连接后,用户可以随时通过第一终端向交互平板发送第一数据,此时,交互平板接收第一数据后,可以根据第一数据更新第一界面的预览图,以保证预览图的有效性。此时,在第一界面中显示第一数据的预览图之后或显示第二应用的第二界面之后,还包括:接收第一终端发送的新的第一数据;在第一界面中添加新的第一数据的预览图。
示例性的,新的第一数据是指已经接收过第一数据之后,再次接收到的第一数据,可理解,两次接收的第一数据可以由同一第一终端发送,也可以由不同第一终端发送。接收新的第一数据后,需要在第一界面中添加新的第一数据的预览图,此时,第一界面中显示之前接收的第一数据的预览图以及新的第一数据的预览图。交互平板对新的第一数据的处理方式与对已经接收的第一数据的处理方式相同,当前不作赘述。可选的,添加新的第一数据的预览图时,可以是将新的预览图排列在原有的预览图之后,或者是,将新的预览图排列在原有的预览图之前。
需说明的是,限定在第一界面中显示第一数据的预览图之后或显示第二应用的第二界面之后,接收新的第一数据,只是用于说明显示第一界面后,用户可以随时发送第一数据。可理解,当第一界面未显示在屏幕时,如第一应用后台运行时,第一应用也可以在第一界面中添加新的第一数据的预览图,之后,显示第一界面时,新的第一数据的预览图被显示在第一界面中。
上述,用户可以根据自身需求多次、随时发送第一数据,之后,将第一数据的预览图及时的显示在第一界面中,便于用户明确第一数据的接收情况以及通过第一界面快速打开第一数据。
本申请一个实施例中,用户通过第一终端还可以指示交互平板进行音视频通话。此时,交互实现方法还包括:接收第一终端发送的第二控制指令,第二控制指令用于指示交互平板与至少一个第二终端进行音视频通话;根据第二控制指令,显示第三界面,并在第三界面显示与第二终端进行音视频通话的信息。
示例性的,在第一终端的第四应用中显示用于触发音视频通话的功能性按键,当前将该功能性控件记为通话按键,通话按键属于第四应用的应用级按键,该通话按键可以显示在第五界面中。当检测到用户对该功能性按键进行设定操作(如单击操作)时,确定接收到第二控制指令。其中,第二控制指令用于指示交互平板进行音视频通话。可理解,前述提及的音视频通话是指利用网络传输各终端本地的视频数据和音频数据,以使各终端实现通话。
可选的,第四应用中还显示联系人列表,联系人列表中显示至少一个联系人,联系人如何被添加在联系人列表中,当前不作限定。之后,用户在联系人列表中选择当前进行音视频通话的联系人。之后,第一终端向所选择的联系人发出第三控制指令并向交互平板发送第二控制指令。其中,第三控制指令用于邀请联系人进行音视频通话。可选的,向联系人发出第三控制指令主要是向联系人所使用的电子设备发送邀请指令,当前,将联系人所使用的电子设备记为第二终端,第二终端中也安装有第四应用,以通过第四应用接收并显示第三控制指令。一个实施例中,第一终端发送的第三控制指令中还包括交互平板的相关信息,以使第二终端通过相关信息与交互平板进行音视频通话。举例而言,第一终端和交互平板通过连接码建立连接时,第一终端发送的第三控制指令还包含该连接码,之后,第二终端通过该连接码找到交互平板,并实现与交互平板的音视频通话。再举例而言,第一终端在第三控制指令和第二控制指令中写入相同的连接码,之后,第二终端通过该连接码找到交互平板,并实现与交互平板的音视频通话。可理解,第二终端可以认为是远程的终端,第二终端与交互平板采用远程网络通信。
示例性的,交互平板接收第二控制指令后,将第二控制指令发送给第一应用。之后,第一应用根据第二控制指令开始音视频通话。音视频通话时,第一应用显示用于通话的界面,当前,将显示的界面记为第三界面。音视频通话过程中,第二终端采集联系人的音频数据和视频数据并发送至交互平板,之后,交互平板的第一应用获取视频数据并显示在第三界面上,并通过交互平板的音频播放装置(如音箱)播放音频数据。可理解,当联系人的数量较多,第三界面可以显示部分视频数据,或者只显示播放音频数据的视频数据。可选的,第一应用根据第二控制指令还指示交互平板开启视频采集装置(如摄像头)和音频采集装置(如麦克风),以采集本地的视频数据和音频数据,之后,向每个第二终端发送本地的视频数据和音频数据以及其他第二终端的视频数据和音频数据。可选的,第三界面还可显示本地的视频数据。
可选的,第三界面还显示与音视频通话有关的功能性按键,例如,显示用于“开启/关闭麦克风”的功能性按键,以实现采集或关闭采集本地的音频数据。再如,显示用于“开启/关闭摄像头”的功能性按键,以实现采集或关闭采集本地的视频数据。又如,显示用于“管理联系人”的功能性按键,以实现添加、删除联系 人。还如,显示用于“结束通话”的功能性按键,以结束本次音视频通话。
可选的,第三界面的显示方式当前不作限定,例如,第三界面为全屏界面,此时,第三界面遮挡在第一界面上。再如,第三界面为浮窗界面。其中,浮窗界面是指在当前的界面上悬浮的一个窗口,显示第三界面时,在交互平板当前显示的界面中弹出一个浮窗,并在浮窗中显示第三界面。第三界面的显示层级高于当前显示的界面,即用户向第三界面的位置处发出操作时,默认是对第三界面的操作。可选的,浮窗的大小和位置当前不作限定,并且,浮窗具有移动性,用户可以根据实际需求调整浮窗的位置。可选的,第三界面为浮窗界面时,还可以显示控制浮窗显示/隐藏的功能性按键,该功能性按键可以位于浮窗中,也可以为独立显示的功能性按键,独立显示的功能性按键与浮窗具有相同的显示层级。用户通过操作该功能性按键可以显示或隐藏第三界面。可选的,音视频通话时,还可以在第三界面中或者独立于第三界面显示通话时长等内容。
一个实施例中,显示第三界面时,还包括:将第一界面的显示内容共享至第二终端。
示例性的,进行网络通话时,交互平板还开启屏幕共享功能。屏幕共享功能开启后,第一应用持续获取交互平板本地的屏幕内容(当前屏幕内容为第一界面的显示内容),并将屏幕内容发送至第二终端,之后,第二终端显示交互平板的屏幕内容,以供第二终端的联系人观看。一个实施例中,显示第三界面时,还显示有开启/关闭屏幕共享功能的功能性按键,该功能性按键与控制浮窗显示/隐藏的功能性控件可以同时显示,并位于同一显示层级。之后,用户可以根据实际需求,通过开启/关闭屏幕共享功能的功能性按键关闭或开启屏幕共享功能。
上述,用户通过第一终端还可以向交互平板发送第二控制指令,以使交互平板和第二终端进行音视频通话,尤其在会议场景中,便于快速进行音视频通话,无需额外打开其他应用建立音视频通话,以及,无需用户走近交互平板进行操作。并且,进行音视频通话的第三界面为浮窗界面,其可以减小对当前其他的界面的遮挡,便于用户在音视频通话过程中,继续进行其他的操作如打开第一数据。并且,音视频通话时,将第一界面的显示内容共享至第二终端,可以使第二终端的联系人明确用户当前的操作,有助于提高音视频通话的效率。
以会议场景为例,第一终端和交互平板位于同一会议室,第一终端与交互平板建立近距离无线通信的连接后,交互平板显示第一应用的第一界面并在第一界面中显示第一终端发送的第一数据的预览图,第一界面参考图13,此时,用户可以根据自身需要选择预览图,以打开对应的第一数据。并且,第一终端显示第四应用的第五界面,第五界面如图9所示,其中,显示通话按键15。检测到通话按键15接收到单击操作后,第一终端显示联系人列表。联系人列表如图15所示,之后,用户通过操作联系人列表,选择进行音视频通话的联系人。参考图15,显示联系人列表时,还显示确定按键18,检测到确定按键18接收到点击操作后,向用户选择的联系人所使用的第二终端发送第三控制指令,并向交互平板发出第二控制指令。此时,联系人使用的第二终端弹出邀请命令,如图16所示,第二终端以消息的方式弹出第三控制指令,该第三控制指令中显示第一终端的用户头像、接收邀请的按键和拒接邀请的按键,当联系人选择接收邀请时,第二终端与交互平板进行音视频通话。交互平板接收到第二控制指令后,以浮窗的方式显示第三界面。第三界面如图17所示,交互平板显示第一界面时,接收第二控制指令,并以浮窗的方式显示第三界面25,该浮窗界面中显示第二终端的视频数据以及本地第一终端的用户头像。音视频通话过程中,交互平板将第一界面的显示内容共享至第二终端。
通过上述方式,可以在会议场景下,快速邀请远端的第二终端参加会议,无需用户走近交互平板进行操作,便可以建立交互平板与第二终端的音视频通话。并且可以使第二终端显示本地交互平板的桌面内容,便于远端的联系人明确本地的操作。并且,在音视频通话过程中,可以随时打开第一终端发送的第一数据。
本申请一个实施例中,第一应用除了打开第一终端发送的第一数据外,还可以打开本地的应用程序,并通过本地的应用程序打开存储在本地的文件数据。图5为本申请一个实施例提供的一种交互实现方法的 流程图,该交互实现方法是在上述基础上,说明了如何通过第一应用打开本地的应用程序。参考图5,该交互实现方法包括:
步骤210、接收第三操作,第三操作用于唤出交互平板的系统工具栏。
系统工具栏用于指示系统级信息或提供系统级的功能性按键。举例来说,系统工具栏包括:WiFi设置、亮度设置、音量设置、截图、拍照、批注等功能性按键。一个实施例中,系统工具栏还显示有交互平板中安装的应用程序的应用图标。可选的,由用户设置系统栏中显示的应用图标,还可选的,将最近使用的应用图标显示在系统工具栏中。也可选的,将操作系统自带的应用程序的应用图标显示在系统工具栏中。一个实施例中,在系统工具栏中设置固定的区域显示应用图标,当应用图标数量较多时,可以在该区域显示部分应用图标,之后,用户通过在区域中执行划动操作来切换显示的应用图标。例如,应用图标在区域中水平排列,此时,用户可以通过左划或右划的方式,切换显示的应用图标。
一个实施例中,系统工具栏可以隐藏,并且在用户唤出系统工具栏时,呈现在屏幕内指定的显示区域。其中,显示区域可以根据实际情况设定,一般而言,显示区域位于屏幕的边缘。当前,将用户唤出系统工具栏的操作记为第三操作。第三操作的触发方式当前不作限定,例如,检测到由屏幕边缘向屏幕内部的滑动操作,且屏幕边缘为系统工具栏显示区域所在的边缘时,确定接收到第三操作。再如,交互平板的屏幕中显示系统工具栏的图标,显示第一界面时,系统工具栏的图标叠加在第一界面上。之后,检测到该图标接收到设定操作(如点击操作)时,确定接收到第三操作。
步骤220、根据第三操作,显示系统工具栏,系统工具栏包括至少一个应用图标。
系统工具栏被唤出后,显示在屏幕中。此时,系统工具栏的显示层级高于当前显示的界面,即系统工具栏可以部分遮盖当前显示的界面。
可选的,显示系统工具栏后,还可以隐藏系统工具栏,例如,检测到屏幕中非系统工具栏的其他区域接收到设定操作(如点击操作)时,隐藏系统工具栏。
步骤230、接收第四操作,第四操作用于在应用图标中选择目标应用图标。
显示系统工具栏后,用户可以通过系统工具栏中的应用图标启动对应的应用程序。当前,将用户选择应用图标的操作记为第四操作,将被选择的应用图标记为目标应用图标。第四操作的触发方式当前不作限定,例如,当检测到系统工具栏的应用图标接收到设定操作(如点击操作)时,确定接收到第四操作,并将接收到设定操作的应用图标确定为目标应用图标。
步骤240、隐藏系统工具栏,并在第一界面上叠加显示第三应用的第四界面,第三应用为目标应用图标对应的应用程序。
示例性的,根据第四操作,交互平板启动目标应用图标对应的应用程序,当前,将目标应用程序对应的应用程序记为第三应用。启动第三应用后,显示第三应用的应用界面,当前,第三应用的应用界面记为第四界面,之后,用户可以对第四界面进行操作。
可选的,第四界面的显示方式当前不作限定,例如,第四界面为全屏界面,此时,第三应用为前台运行的应用程序。再如,第四界面为非全屏界面,此时,第四界面以窗口化的方式非全屏显示在屏幕中,即在屏幕中新建一个非全屏的窗口并在窗口中显示第四界面。实施例中,以第四界面为非全屏界面为例进行描述,第四界面叠加显示在当前显示的界面上。一个实施例中,当前显示第一界面,此时,第四界面叠加显示在第一界面上。
可选的,显示第三应用的第四界面时,隐藏系统工具栏。之后,用户还可以继续唤出系统工具栏。
步骤250、接收针对于第三应用的置入操作。
示例性的,置入是指将第三应用的预览图显示在第一界面中,并且,该预览图添加有用于调用第三应用的接口,通过该接口可以调用第三应用,即前台运行第三应用。当前,将触发置入的操作记为置入操作。其中,置入操作的触发方式当前不作限定,例如,检测到显示第四界面的窗口接收到设定操作(如长按操作)时,确定接收到置入操作。再如,通过用于置入的功能性按键接收置入操作。
一个实施例中,以通过用于置入的功能性按键接收置入操作为例进行描述,此时,在第一界面上叠加显示目标应用图标的第四界面时,还包括:显示第二按键,第二按键与第四界面具有相同的显示层级,第二按键用于对第四界面进行控制,第二按键包括第二控件,且第二控件被触发时,交互平板接收到置入操作。
示例性的,第二按键是指对第四界面进行控制的功能性按键,第二按键可以为一个或多个。第二按键可以为系统级按键或第一应用的应用级按键。当前以第二按键为系统级按键为例进行描述,此时,第二按键不对第四界面的显示内容进行控制,而对第四界面的显示方式进行控制,一个实施例中,第四界面以窗口化的方式非全屏显示时,第二按键包括用于全屏显示的控件(用于全屏显示第四界面)、用于退出的控件(用于退出第三应用)以及用于置入的控件。当前,将用于置入的控件记为第二控件,检测到作用于第二控件的设定操作(如点击操作)时,确定接收到置入操作。
步骤260、响应置入操作,关闭第四界面,并在第一界面中添加第三应用的预览图。
示例性的,响应置入操作时,关闭第四界面,可选的,关闭第四界面可以是对第四界面进行最小化处理。可理解,关闭第四界面后,交互平板恢复显示唤出系统栏之前的界面,此时,第三应用可以被认为在后台运行。关闭第四界面时,还在第一界面中添加第三应用的预览图,以通过第三应用的预览图可以重新显示第四界面。
生成第三应用的预览图时,可以是,将第三应用的应用图标作为预览图,或者,通过对第四界面进行截图的方式得到预览图。一个实施例中,通过对第四界面进行截图后生成预览图为例进行描述,此时,步骤260包括步骤261-步骤262:
步骤261、响应于置入操作,关闭第四界面,并对第四界面进行截图,将获得的截图图像作为第三应用的预览图。
接收到置入操作后,关闭第四界面,并对第四界面进行截图,得到截图图像,之后,为预览图添加指向第三应用的超链接(即调用第三应用的接口),以得到第三应用的预览图。可选的,还可对该截图图像进行压缩,以生成预览图。
步骤262、将预览图添加并显示在第一界面中。
示例性的,将第三应用的预览图发送至第一应用。第一应用接收到该预览图后将预览图添加在第一界面中。以在显示第一界面时,显示第三应用的预览图,之后,用户通过选择第三应用的预览图可以实现前台运行第三应用,并显示第三应用的第四界面。
上述,通过唤出系统工具栏后,该系统工具栏中显示交互平板中的应用图标,之后,用户通过选择应用图标可以实现快速启动应用程序,无需关闭当前的应用程序。之后,可以将交互平板的应用程序置入第一应用中,即在第一界面中显示应用程序的预览图,进而基于预览图快速调出应用程序在前台运行,简化了第一终端中应用程序切换的环节。并且,通过对应用程序的界面截图的方式生成预览图的过程简单,便于实现。
下面,以会议场景为例,描述置入第三应用的预览图的过程。此时,第一终端和交互平板位于同一会议室,第一终端与交互平板建立近距离无线通信的连接后,交互平板显示第一应用的第一界面,第一界面如图13所示,其显示第一终端发送的第一数据的预览图。之后,交互平板通过第三操作唤出系统工具栏,参考图18,交互平板显示第一界面时,唤出系统工具栏,系统工具栏显示在屏幕的左侧边(以用户视角),此时,系统工具栏也可以记为侧边栏,该系统工具栏中显示应用图标26,当用户选择一个应用图标时,以窗口的方式显示应用图标对应的第四界面。参考图19,当前,非全屏显示第四界面,并且显示用于全屏显示的按键27、用于置入的按键28和用于退出的按键29。当检测到按键28接收到点击操作时,确定接收到置入操作,交互平板关闭第四界面,并对第四界面进行截图以生成对应的预览图,并将预览图添加在第一界面中。此时,第一界面如图13变换为图20,参考图20,第一界面中添加了第四界面(即第三应用)的预览图。之后,当用户点击第四界面的预览图后,交互平板打开第三应用并显示第四界面。
通过上述方式,可以在会议场景下,快速启动交互平板本地的应用程序,并且,通过在第一界面显示预览图的方式,可以在将本地的应用程序切换至后台运行后,快速切换至前台运行。
本申请一个实施例中,为了便于用户回顾与交互平板的交互过程,上述交互实现方法,还包括:接收针对于第一应用的退出操作;响应于退出操作,获取第二数据,第二数据包括第一数据、运行第一应用时得到的录屏数据、运行第一应用时打开或生成的本地文件数据或本地文件数据的预览图中的至少一种;将第二数据上传至服务器,以供第一终端从服务器中下载第二数据;关闭第一应用。
示例性的,退出操作为触发关闭第一应用的操作,用户可以通过第一终端或交互平板发出退出操作。一个实施例中,以用户通过交互平板发出退出操作为例进行描述,退出操作的触发方式当前不作限定,例如,第一应用在前台运行时,交互平板显示第一应用的相关界面(如显示第一界面)并在相关界面中显示用于接收退出操作的功能性按键,当前,将用于接收退出操作的功能性按键记为退出按键,退出按键的显示位置当前不作限定。可选的,退出按键为第一应用的应用级控件并与第一界面具有相同的显示层级。当检测到退出按键接收到设定操作(如单击操作)时,确定接收到退出操作。再如,检测到第一应用的相关界面的设定区域中接收到设定操作(如长按操作)时,确定接收到退出操作,其中,设定区域为相关界面中的一块区域,具体的区域位置当前不作限定。
接收退出操作后,确定关闭第一应用,一个实施例中,关闭第一应用之前,可以由第一应用或交互平板的操作系统获取第一应用本次运行过程中涉及的数据,当前,将第一应用本次运行过程中涉及的数据记为第二数据。当第一终端向交互平板上传第一数据时,第二数据包含第一数据,可选的,当前所说的第一数据主要指文件数据。若显示第一应用的第一界面时,对第一界面的显示内容进行录制,则第二数据包括进行录屏后得到的数据,当将录屏得到的数据记为录屏数据,可理解,接收退出操作后,第一应用停止录制本地的屏幕内容,并生成录屏数据。当第一应用运行过程中,交互平板通过第三应用打开了本地存储的文件数据或者通过第三应用生成了存储在本地的文件数据,则第一应用还将本地的文件数据作为第二数据。可选的,若本地的文件数据为第三方数据,则将文件数据的预览图作为第二数据,若本地的文件数据为非第三方数据,则将文件数据作为第二数据。可理解,第三方数据是指通过第三方应用程序生成或打开的数据,第一应用无法明确第三方应用程序运行过程中打开或生成的文件数据。非第三数据是指通过非第三方应用程序生成或打开的数据,第一应用可以明确非第三方应用程序运行过程中打开或生成的文件数据。例如,交互平板中安装有白板应用,该应用程序为非第三方应用程序。第一应用运行过程中,通过用户的操作使得交互平板打开了白板应用,之后,用户在白板应用中进行书写,并生成了白板数据,该白板数据并非第三方数据,此时,第一应用将白板数据作为第二数据。基于上述描述可知,第二数据包括:第一数据、录屏数据、运行第一应用的过程中打开或生成的文件数据或文件数据的预览图中的至少一种。若在运行第一应用时,第一应用涉及了多种第二数据,则获取多种第二数据。
示例性的,获取第二数据后,对第二数据进行保存。可选的,将第二数据保存在交互平板和/或服务器中,一个实施例中,为了减轻交互平板的存储压力,将第二数据保存在服务器中。此时,第一终端可以通过服务器查询第二数据并下载第二数据。需要说明的是,除了第一终端,其他的电子设备也可以从服务器中下载第二数据。
可选的,保存第二数据前,可以弹出保存提示,之后,由用户选择是否保存第二数据。还可选的,弹出保存提示时,在保存提示中显示第二数据,之后,用户可以在保存提示中勾选或取消勾选第二数据,之后,交互平板将勾选的第二数据保存至服务器中。
示例性的,向服务器上传第二数据后,交互平板关闭第一应用。可选的,关闭第一应用时,断开第一终端和交互平板间的连接。之后,当第一终端存在连接需求时,可以与交互平板再次建立连接,以使交互平板打开第一应用。
举例而言,当前,以会议场景为例,第一终端与交互平板建立近距离无线通信连接,会议结束时,交互平板显示的第一界面如图20所示,当用户点击第二按键21时,交互平板在第一界面上显示是否结束本 次会议的提示,当用户选择结束会议时,将本次会议过程中使用的第二数据打包并上传至服务器中,并关闭第一应用。此时,用户通过第一终端可以获取到服务器中的数据。例如,用户通过第一终端查询参与会议的第二数据,此时,在第一终端的主界面中显示第二数据的打包名,例如,图7中显示的“会议协作”为某次会议的第二数据的打包名。当用户选择该打包名时,第一终端显示第二数据的列表。例如,图21示出了某次会议中打包的三个第二数据,此时,用户可以选择第二数据进行下载。
上述,接收到退出操作时,向服务器中保存第二数据并退出第一应用,可以实现将第一应用运行过程中涉及的第二数据统一保存以及自动上传,简化了用户的操作,并且,简化了保存路径,只需要将第二数据上传至服务器即可,第一终端可以在服务器中查看全部的第二数据,无需分别查找各第二数据,简化了用户的操作。
本申请实施例还提供了一种交互实现方法,应用于交互实现系统,该交互实现系统包括至少一个第一终端和交互平板。图6为本申请一个实施例提供的一种交互实现方法的流程图,参考图6,该交互实现系统执行交互实现方法时,包括:
步骤310、第一终端与交互平板建立无线通信连接。
其中,无线通信可选为近距离无线通信。
步骤320、交互平板显示第一应用的第一界面。
示例性的,建立无需通信连接后,交互平板打开第一应用并显示第一界面。
步骤330、第一终端显示第四应用的第五界面。
第四应用是第一终端安装的应用程序,第四应用与交互平板的第一应用相对应。第五界面是第四应用运行过程中显示的一个应用界面,交互平板与第一终端建立连接后,第四应用显示第五界面。第五界面的显示内容当前不作限定。一个实施例中,第五界面显示文件发送按键和投屏按键,其中,文件发送按键用于触发将文件数据发送至交互平板的功能,投屏发送用于触发将投屏数据发送至交互平板的功能。可选的,第五界面还显示通话按键和加入按键,通话按键用于邀请其他的第二终端与交互平板进行音视频通话,此时,第一终端作为发起方,第二终端作为加入方。加入按键用于加入其他终端发起的音视频通话。第五界面还可以显示其他的功能性按键,当前不作限定。
步骤340、第一终端在第五界面中接收第五操作。
当前,第五操作用于选择发送文件数据还是发送投屏数据。一个实施例中,第五界面显示文件发送按键和投屏按键时,若检测到文件发送按键接收到设定操作(如单击操作),则确定接收到第五操作,且第五操作用于选择发送文件数据。若检测到投屏按键接收到设定操作(如单击操作)时,确定接收到第五操作,且第五操作用于选择发送投屏数据。之后,执行步骤350。
步骤350、确定第五操作用于选择发送文件数据,第一终端根据第五操作,将本地的文件数据发送至交互平板,确定第五操作用于选择发送投屏数据,第一终端将本地的投屏数据上传至交互平板。
示例性的,第三选择操作用于选择发送文件数据时,将存储在本地的文件数据发送至交互平板。可选的,发送文件数据时,可以由用户在交互平板中选择需要上传的文件数据,一个实施例中,步骤350包括步骤351-步骤353:
步骤351、确定第五操作用于选择发送文件数据时,第一终端将第四应用的第五界面切换为第四应用的第六界面,第六界面中显示本地的文件数据。
示例性的,第五操作用于选择发送文件数据时,先将第五界面切换为第六界面,第六界面为文件选择界面,第六界面显示可以被上传的文件数据,以使用户在该界面下选择文件数据。当前,将用户在第六界面中选择文件数据的操作记为第七操作。文件数据在第六界面中的呈现方式以及排列顺序当前不作限定,例如,在第六界面中显示文件数据的预览图,并按照文件数据的最新打开时间排列文件数据。
步骤352、第一终端接收作用于第六界面的第七操作,第七操作用于选择文件数据。
可选的,第六界面中每个文件数据均有对应的选择标识,该选择标识可以示出文件数据是否被选择,通过用户勾选选择标识的方式可以实现选择或取消选择文件数据。之后,第四应用通过选择标识确定被选择的文件数据。
步骤353、第一终端将选择的文件数据发送至交互平板。
一个实施例中,确定第五操作用于选择发送投屏数据时,第一终端的第四应用获取第一终端的投屏数据,并发送至第一终端。一个实施例中,为了便于用户明确投屏成功,第一终端将本地的投屏数据上传至交互平板时,还包括:显示投屏提示。可选的,投屏提示的显示内容当前不作限定,例如投屏提示中显示投屏标识以及投屏时间。可选的,投屏提示以弹窗的方式显示,或者是,以界面的方式将投屏提示替换当前的第五界面。
步骤360、交互平板在第一界面中显示第一数据的预览图,第一数据包括文件数据或投屏数据。
步骤370、交互平板接收第一操作,第一操作用于在各预览图中选择目标预览图。
步骤380、交互平板显示第二应用的第二界面,第二应用为用于打开目标预览图对应的第一数据的应用程序。
步骤390、交互平板接收针对第二界面的第二操作。
步骤3100、交互平板根据第二操作,关闭第二界面,恢复显示第一界面。
上述,在第一终端和交互平板建立无线通信连接后,用户通过在第四应用中的第五操作,可以向交互平板发送文件数据或投屏数据,使得交互平板的第一应用将文件数据或投屏数据的预览图添加在第一界面,以便于通过预览图快速打开文件数据或投屏数据,简化了用户在交互平板中打开第一数据执行的操作。
本申请一个实施例中,还可以由第一终端在第一界面中选择目标预览图,以遥控交互平板打开相应的第二界面。此时,交互实现系统执行的交互实现方法还包括:第一终端接收第一控制操作,第一控制操作用于指示交互平板打开目标预览图;第一终端根据第一控制操作,发送第一控制指令至交互平板;交互平板根据第一控制指令,显示第二应用的第二界面。
示例性的,第一终端安装的第四应用还具有选择目标预览图的功能,当前,用户通过第四应用选择目标预览图的操作可以认为是第一控制操作,第一控制操作完成后,第一终端生成第一控制指令并将第一控制指令发送至交互平板,之后,交互平板根据第一控制指令打开第二界面。
本申请一个实施例中,第一终端还可以指示交互平板与第二终端进行音视频通话。此时,第一终端在第五界面中接收第五操作之后,还包括:第五操作用于选择音视频通话时,第一终端显示联系人列表;第一终端接收第六操作,第六操作用于在联系人列表中选择至少一个联系人;第一终端根据第六操作,向至少一个第二终端发送第三控制指令,并向交互平板发送第二控制指令,以使第二终端与交互平板进行音视频通话,第二终端为联系人使用的终端。
示例性的,第五界面还显示通话按键,通话按键用于指示交互平板与第二终端进行音视频通话。检测到通话按键接收到设定操作(如点击操作)时,确定接收第五操作且第五操作用于选择音视频通话。之后,第一终端显示联系人列表,该联系人列表中记录有可以进行音视频通话的联系人。示例性的,用户可以在联系人列表中选择当前进行音视频通话的联系人,当前,将用户选择联系人的操作记为第六操作。可选的,联系人列表中显示联系人的姓名和头像,还显示选择标识,该选择标识可以示出联系人是否被选择。用户对该选择标识的操作方式与用户对文件数据的选择标识的操作方式相似,当前不作赘述。用户选择完成后,第一终端向联系人所使用的第二终端发送第三控制指令,并向交互平板发送第二控制指令,之后,交互平板通过通话指令开启音视频通话的功能,第二终端通过邀请指令实现与交互平板的音视频通话。
上述,通过第一终端可以实现邀请远程的第二终端与本地的交互平板进行音视频通话,丰富了第一应用和第四应用的功能。
举例而言,以会议场景为例,第一终端和交互平板位于同一会议室,第一终端与交互平板建立近距离无线通信的连接后,第一终端显示第四应用的第五界面,第五界面如图9所示,该第五界面显示投屏按键 13、文件发送按键14、通话按键15以及用于实现其他功能的按键。此时,交互平板打开第一应用并显示第一界面,第一界面如图10所示。
之后,用户在第五界面中选择投屏按键13时,第四应用获取第一终端的投屏数据并发送至交互平板。此时,第一终端中显示投屏提示。当前,投屏提示以界面的方式呈现,此时,投屏提示如图11所示,该投屏提示包括停止投屏的按键16,还显示投屏时长等内容。
用户在第五界面中选择文件发送按键14时,第四应用进入第六界面,第六界面中显示可被选择的文件数据的预览图、名称等内容。第六界面如图12所示,每个文件数据还有对应的选择标识17,用户通过操作选择标识可以选择文件数据。第六界面还显示确定按键,检测到确定按键被点击时,将当前选择的文件数据发送至第一终端,之后,第六界面恢复至第五界面。可选的,第六界面还显示文件数据的选择数量。
此外,用户还可以在第五界面中单击通话按键15,之后,第一终端根据用户的操作显示联系人列表,以使用户在联系人列表中选择联系人,之后,向联系人使用的第二终端发送第三控制指令,向交互平板发送第二控制指令,以实现会议场景下,本地的用户与远程的用户进行音视频通话。
可理解,交互实现系统执行交互实现方法时未描述的技术细节可参考前述交互平板执行交互实现方法时的技术细节,具备相应的功能和有益效果。
图22为本申请一个实施例提供的一种交互实现装置的结构示意图。交互实现装置应用在交互平板中,参考图22,该交互实现装置包括:第一显示单元410、第一接收单元420、第二显示单元430、第二接收单元440、第三显示单元450、第三接收单元460和第四显示单元470。
其中,第一显示单元410,用于显示第一应用的第一界面;第一接收单元420,用于接收至少一个第一终端发送的第一数据,第一数据包括文件数据或投屏数据,其中,第一终端与交互平板通过无线通信方式进行通信;第二显示单元430,用于在第一界面中显示各第一数据的预览图;第二接收单元440,用于接收第一操作,第一操作用于在各预览图中选择目标预览图;第三显示单元450,用于显示第二应用的第二界面,第二应用为用于打开目标预览图对应的第一数据的应用程序;第三接收单元460,用于接收针对第二界面的第二操作;第四显示单元470,用于根据第二操作,关闭第二界面,恢复显示第一界面。
在上述实施例的基础上,第四显示单元470具体用于:根据第二操作,关闭第二界面,恢复显示第一界面,更新目标预览图。
在上述实施例的基础上,第四显示单元470在更新目标预览图时,包括:内容获取子单元,用于获取第二界面被关闭时的显示内容;第一预览图生成子单元,用于根据显示内容生成第一预览图,并将目标预览图更新为第一预览图。
在上述实施例的基础上,第二应用为白板应用,所述装置还包括:第一响应单元,用于显示第二应用的第二界面之后,在第二界面中接收书写操作,根据书写操作,在第二界面中生成相应的书写笔迹。或者,第二应用为文件展示应用,所述装置还包括:第二响应单元,用于显示第二应用的第二界面之后,在第二界面中接收文件展示操作,根据文件展示操作,在第二界面显示相应的文件展示结果。或者,第二应用为投屏应用,所述装置还包括:第三响应单元,用于显示第二应用的第二界面之后,接收第一终端所发送的实时的投屏数据,在第二界面中显示实时的投屏数据。
在上述实施例的基础上,还包括:第四接收单元,用于在第一界面中显示各第一数据的预览图之后,接收第一终端所发送的第一控制指令,第一控制指令用于指示交互平板打开目标预览图;第五显示单元,用于根据第一控制指令,显示第二应用的第二界面。
在上述实施例的基础上,预览图在第一界面中的排列规则由预览图的数量而确定。
在上述实施例的基础上,所述第二界面为全屏界面,第三显示单元450具体用于:显示第二应用的第二界面,并在第二界面上显示第一按键,第一按键的显示层级高于第二界面,第一按键包括第一控件,且第一控件被触发时,交互平板接收到第二操作,第二应用为用于打开目标预览图对应的第一数据的应用程 序。
在上述实施例的基础上,所述装置还包括:第五接收单元,用于接收第一终端发送的第二控制指令,第二控制指令用于指示交互平板与至少一个第二终端进行音视频通话;第六显示单元,用于根据第二控制指令,显示第三界面,并在第三界面显示与第二终端进行音视频通话的信息。
在上述实施例的基础上,第三界面为浮窗界面。
在上述实施例的基础上,第六显示单元在显示第三界面时,还用于:将第一界面的显示内容共享至第二终端。
在上述实施例的基础上,第一显示单元410包括:请求接收子单元,用于接收第一终端发送的连接请求;连接建立子单元,用于根据连接请求,确认与第一终端建立无线通信连接;应用打开子单元,用于在与第一终端建立无线通信连接后,打开第一应用,并显示第一应用的第一界面。
在上述实施例的基础上,所述装置还包括:录制单元,用于显示所述第一应用的第一界面,对所述第一界面的显示内容进行录制。
在上述实施例的基础上,所述装置还包括:第六接收单元,用于接收第三操作,第三操作用于唤出交互平板的系统工具栏;第七显示单元,用于根据第三操作,显示系统工具栏,系统工具栏包括至少一个应用图标;第七接收单元,用于接收第四操作,第四操作用于在应用图标中选择目标应用图标;第八显示单元,用于隐藏系统工具栏,并在第一界面上叠加显示第三应用的第四界面,第三应用为目标应用图标对应的应用程序。
在上述实施例的基础上,所述装置还包括:第八接收单元,用于在第一界面上叠加显示第三应用的第四界面之后,接收针对于第三应用的置入操作;第一关闭单元,用于响应于置入操作,关闭第四界面,并在第一界面中添加第三应用的预览图。
在上述实施例的基础上,第八显示单元用于在第一界面上叠加显示第三应用的第四界面时,还用于显示第二按键,第二按键与第四界面具有相同的显示层级,第二按键用于对第四界面进行控制,第二按键包括第二控件,且第二控件被触发时,交互平板接收到置入操作。
在上述实施例的基础上,所述第一关闭单元包括:截图子单元,用于响应于置入操作,关闭第四界面,并对第四界面进行截图,将获得的截图图像作为第三应用的预览图;添加子单元,用于将预览图添加并显示在第一界面中。
在上述实施例的基础上,第二显示单元430包括:内容获取子单元,用于获取第一数据的数据内容;预览图生成子单元,用于根据数据内容生成第一数据的预览图;预览图发送子单元,用于将预览图发送至第一应用,第一应用接收到预览图后,在第一界面显示预览图。
在上述实施例的基础上,所述装置还包括:第九接收单元,用于接收针对于第一应用的退出操作;数据获取单元,用于响应于退出操作,获取第二数据,第二数据包括第一数据、运行第一应用时得到的录屏数据、运行第一应用时打开或生成的本地文件数据或本地文件数据的预览图中的至少一种;数据上传单元,用于将第二数据上传至服务器,以供第一终端从服务器中下载第二数据;第二关闭单元,用于关闭第一应用。
本申请实施例提供的交互实现装置包含在交互平板中,且可用于执行上述实施例中提供的任一交互实现方法,具备相应的功能和有益效果。
值得注意的是,上述交互实现装置的实施例中,所包括的各个单元和模块只是按照功能逻辑进行划分的,但并不局限于上述的划分,只要能够实现相应的功能即可;另外,各功能单元的具体名称也只是为了便于相互区分,并不用于限制本申请的保护范围。
图23为本申请一个实施例提供的一种交互平板的结构示意图。如图23所示,该交互平板包括处理器50、存储器51、输入装置52、输出装置53、显示器54以及通信装置55;交互平板中处理器50的数量可 以是一个或多个,图23中以一个处理器50为例;交互平板中的处理器50、存储器51、输入装置52、输出装置53、显示器54以及通信装置55可以通过总线或其他方式连接,图23中以通过总线连接为例。
存储器51作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序以及模块,如本申请实施例中交互平板执行的交互实现方法对应的程序指令/模块(例如,交互实现装置中的第一显示单元410、第一接收单元420、第二显示单元430、第二接收单元440、第三显示单元450、第三接收单元460和第四显示单元470)。处理器50通过运行存储在存储器51中的软件程序、指令以及模块,从而执行交互平板的各种功能应用以及数据处理,即实现上述的交互实现方法。
存储器51可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据交互平板的使用所创建的数据等。此外,存储器51可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中,存储器51可进一步包括相对于处理器50远程设置的存储器,这些远程存储器可以通过网络连接至交互平板。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
输入装置52可用于接收输入的数字或字符信息,以及产生与交互平板的用户设置以及功能控制有关的键信号输入。输出装置53可包括音频播放装置等设备。显示器54可以是具有触摸功能的显示屏,该显示屏可以是电容屏、电阻屏、红外屏和/或电磁屏,显示器54根据处理器50的指示进行显示,如显示第一应用的第一界面等。通信装置55用于实现通信功能,如与第一终端建立无线通信连接。
上述交互平板包含交互实现装置,可以用于执行交互实现方法,具备相应的功能和有益效果。
本申请实施例还提供一种包含计算机可执行指令的存储介质,所述计算机可执行指令在由计算机处理器执行时用于执行本申请任意实施例中提供的交互实现方法中的相关操作,且具备相应的功能和有益效果。
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。
因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
在一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。存储器可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。存储器是计算机可读介质的示例。
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机 存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体(transitory media),如调制的数据信号和载波。
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括要素的过程、方法、商品或者设备中还存在另外的相同要素。
注意,上述仅为本申请的较佳实施例及所运用技术原理。本领域技术人员会理解,本申请不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本申请的保护范围。因此,虽然通过以上实施例对本申请进行了较为详细的说明,但是本申请不仅仅限于以上实施例,在不脱离本申请构思的情况下,还可以包括更多其他等效实施例,而本申请的范围由所附的权利要求范围决定。

Claims (24)

  1. 一种交互实现方法,应用于交互平板,其中,包括:
    显示第一应用的第一界面;
    接收至少一个第一终端发送的第一数据,所述第一数据包括文件数据或投屏数据,其中,所述第一终端与所述交互平板通过无线通信方式进行通信;
    在所述第一界面中显示各所述第一数据的预览图;
    接收第一操作,所述第一操作用于在各所述预览图中选择目标预览图;
    显示第二应用的第二界面,所述第二应用为用于打开所述目标预览图对应的所述第一数据的应用程序;
    接收针对所述第二界面的第二操作;
    根据所述第二操作,关闭所述第二界面,恢复显示所述第一界面。
  2. 根据权利要求1所述的交互实现方法,其中,所述恢复显示第一界面后,还包括:
    更新所述目标预览图。
  3. 根据权利要求2所述的交互实现方法,其中,所述更新所述目标预览图,包括:
    获取所述第二界面被关闭时的显示内容;
    根据所述显示内容生成第一预览图,并将所述目标预览图更新为所述第一预览图。
  4. 根据权利要求1所述的交互实现方法,其中,所述第二应用为白板应用,所述显示第二应用的第二界面之后,还包括:
    在所述第二界面中接收书写操作,根据所述书写操作,在所述第二界面中生成相应的书写笔迹;或,
    所述第二应用为文件展示应用,所述显示第二应用的第二界面之后,还包括:
    在所述第二界面中接收文件展示操作,根据所述文件展示操作,在所述第二界面显示相应的文件展示结果;或,
    所述第二应用为投屏应用,所述显示第二应用的第二界面之后,还包括:
    接收所述第一终端所发送的实时的投屏数据,在所述第二界面中显示所述实时的投屏数据。
  5. 根据权利要求1所述的交互实现方法,其中,所述在所述第一界面中显示各所述第一数据的预览图之后,还包括:
    接收所述第一终端所发送的第一控制指令,所述第一控制指令用于指示所述交互平板打开目标预览图;
    根据所述第一控制指令,显示所述第二应用的所述第二界面。
  6. 根据权利要求1所述的交互实现方法,其中,所述预览图在所述第一界面中的排列规则由所述预览图的数量而确定。
  7. 根据权利要求1所述的交互实现方法,其中,所述第二界面为全屏界面;
    所述显示第二应用的第二界面,具体为:
    显示第二应用的第二界面,并在所述第二界面上显示第一按键,所述第一按键的显示层级高于所述第二界面,所述第一按键包括第一控件,且所述第一控件被触发时,所述交互平板接收到所述第二操作。
  8. 根据权利要求1所述的交互实现方法,其中,还包括:
    接收所述第一终端发送的第二控制指令,所述第二控制指令用于指示所述交互平板与至少一个第二终端进行音视频通话;
    根据所述第二控制指令,显示第三界面,并在所述第三界面显示与所述第二终端进行音视频通话的信息。
  9. 根据权利要求8所述的交互实现方法,其中,所述第三界面为浮窗界面。
  10. 根据权利要求8所述的交互实现方法,其中,所述显示第三界面时,还包括:
    将所述第一界面的显示内容共享至所述第二终端。
  11. 根据权利要求1所述的交互实现方法,其中,所述显示第一应用的第一界面,包括:
    接收第一终端发送的连接请求;
    根据所述连接请求,确认与所述第一终端建立无线通信连接;
    在与所述第一终端建立无线通信连接后,打开第一应用,并显示所述第一应用的第一界面。
  12. 根据权利要求11所述的交互实现方法,其中,所述显示所述第一应用的第一界面之后,还包括:
    对所述第一界面的显示内容进行录制。
  13. 根据权利要求1所述的交互实现方法,其中,还包括:
    接收第三操作,所述第三操作用于唤出所述交互平板的系统工具栏;
    根据所述第三操作,显示所述系统工具栏,所述系统工具栏包括至少一个应用图标;
    接收第四操作,所述第四操作用于在所述应用图标中选择目标应用图标;
    隐藏所述系统工具栏,并在所述第一界面上叠加显示第三应用的第四界面,所述第三应用为目标应用图标对应的应用程序。
  14. 根据权利要求13所述的交互实现方法,其中,所述在所述第一界面上叠加显示第三应用的第四界面之后,还包括:
    接收针对于所述第三应用的置入操作;
    响应于所述置入操作,关闭所述第四界面,并在所述第一界面中添加所述第三应用的预览图。
  15. 根据权利要求14所述的交互实现方法,其中,所述在所述第一界面上叠加显示所述第三应用的第四界面时,还包括:
    显示第二按键,所述第二按键与所述第四界面具有相同的显示层级,所述第二按键用于对所述第四界面进行控制,所述第二按键包括第二控件,且所述第二控件被触发时,所述交互平板接收到所述置入操作。
  16. 根据权利要求14所述的交互实现方法,其中,所述响应于所述置入操作,关闭所述第四界面,并在所述第一界面中添加所述第三应用的预览图包括:
    响应于所述置入操作,关闭所述第四界面,并对所述第四界面进行截图,将获得的截图图像作为所述第三应用对应的预览图;
    将所述预览图添加并显示在所述第一界面中。
  17. 根据权利要求1所述的交互实现方法,其中,所述在所述第一界面中显示各所述第一数据的预览图,包括:
    获取所述第一数据的数据内容;
    根据所述数据内容生成所述第一数据的预览图;
    将所述预览图发送至所述第一应用,所述第一应用接收到所述预览图后,在所述第一界面显示所述预览图。
  18. 根据权利要求1所述的交互实现方法,其中,还包括:
    接收针对于所述第一应用的退出操作;
    响应于所述退出操作,获取第二数据,所述第二数据包括所述第一数据、运行所述第一应用时得到的录屏数据、运行所述第一应用时打开或生成的本地文件数据或本地文件数据的预览图中的至少一种;
    将所述第二数据上传至服务器,以供所述第一终端从所述服务器中下载所述第二数据;
    关闭所述第一应用。
  19. 一种交互实现方法,应用于交互实现系统,所述交互实现系统包括交互平板和至少一个第一终端;其中,所述交互实现方法包括:
    所述第一终端与所述交互平板建立无线通信连接;
    所述交互平板显示第一应用的第一界面;
    所述第一终端显示第四应用的第五界面;
    所述第一终端在所述第五界面中接收第五操作;
    确定所述第五操作用于选择发送文件数据,所述第一终端根据所述第五操作,将本地的文件数据发送 至交互平板,确定所述第五操作用于选择发送投屏数据,所述第一终端将本地的投屏数据上传至所述交互平板;
    所述交互平板在所述第一界面中显示所述第一数据的预览图,所述第一数据包括所述文件数据或所述投屏数据;
    所述交互平板接收第一操作,所述第一操作用于在各所述预览图中选择目标预览图;
    所述交互平板显示第二应用的第二界面,所述第二应用为用于打开所述目标预览图对应的所述第一数据的应用程序;
    所述交互平板接收针对所述第二界面的第二操作;
    所述交互平板根据所述第二操作,关闭所述第二界面,恢复显示所述第一界面。
  20. 根据权利要求19所述的交互实现方法,其中,还包括:
    所述第一终端接收第一控制操作,所述第一控制操作用于指示所述交互平板打开目标预览图;
    所述第一终端根据所述第一控制操作,发送第一控制指令至所述交互平板;
    所述交互平板根据所述第一控制指令,显示所述第二应用的所述第二界面。
  21. 根据权利要求19所述的交互实现方法,其中,所述第一终端在所述第五界面中接收第五操作之后,还包括:
    确定所述第五操作用于选择音视频通话,所述第一终端显示联系人列表;
    所述第一终端接收第六操作,所述第六操作用于在所述联系人列表中选择至少一个联系人;
    所述第一终端根据所述第六操作,向至少一个第二终端发送第三控制指令,并向所述交互平板发送第二控制指令,以使所述第二终端与所述交互平板进行音视频通话,所述第二终端为所述联系人使用的终端。
  22. 一种交互实现装置,应用于交互平板,其中,包括:
    第一显示单元,用于显示第一应用的第一界面;
    第一接收单元,用于接收至少一个第一终端发送的第一数据,所述第一数据包括文件数据或投屏数据,其中,所述第一终端与所述交互平板通过无线通信方式进行通信;
    第二显示单元,用于在所述第一界面中显示各所述第一数据的预览图;
    第二接收单元,用于接收第一操作,所述第一操作用于在各所述预览图中选择目标预览图;
    第三显示单元,用于显示第二应用的第二界面,所述第二应用为用于打开所述目标预览图对应的所述第一数据的应用程序;
    第三接收单元,用于接收针对所述第二界面的第二操作;
    第四显示单元,用于根据所述第二操作,关闭所述第二界面,恢复显示所述第一界面。
  23. 一种交互平板,其中,包括:
    一个或多个处理器;
    显示器,用于根据所述处理器的指示进行显示;
    通信模块,用于与至少一个第一终端进行无线通信;
    存储器,用于存储一个或多个程序;
    当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如权利要求1-18中任一所述的交互实现方法。
  24. 一种计算机可读存储介质,其上存储有计算机程序,其中,该程序被处理器执行时实现如权利要求1-18中任一所述的交互实现方法。
PCT/CN2021/135099 2021-12-02 2021-12-02 交互实现方法、装置、交互平板及存储介质 WO2023097612A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202180007750.XA CN116601597A (zh) 2021-12-02 2021-12-02 交互实现方法、装置、交互平板及存储介质
PCT/CN2021/135099 WO2023097612A1 (zh) 2021-12-02 2021-12-02 交互实现方法、装置、交互平板及存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/135099 WO2023097612A1 (zh) 2021-12-02 2021-12-02 交互实现方法、装置、交互平板及存储介质

Publications (1)

Publication Number Publication Date
WO2023097612A1 true WO2023097612A1 (zh) 2023-06-08

Family

ID=86611319

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/135099 WO2023097612A1 (zh) 2021-12-02 2021-12-02 交互实现方法、装置、交互平板及存储介质

Country Status (2)

Country Link
CN (1) CN116601597A (zh)
WO (1) WO2023097612A1 (zh)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130212489A1 (en) * 2012-02-15 2013-08-15 Victor Ivashin Method for Providing Multiple Mouse Inputs in a Remote Desktop Session
US20150331604A1 (en) * 2014-05-14 2015-11-19 Microsoft Corporation Presenting stored files in whiteboard application
US20160330404A1 (en) * 2015-05-09 2016-11-10 Ricoh Company, Ltd. Integration of Videoconferencing with Interactive Electronic Whiteboard Appliances
CN110928460A (zh) * 2019-10-09 2020-03-27 广州视源电子科技股份有限公司 智能交互平板的操作方法、装置、终端设备和存储介质
CN110928468A (zh) * 2019-10-09 2020-03-27 广州视源电子科技股份有限公司 智能交互平板的页面显示方法、装置、设备和存储介质
CN111459433A (zh) * 2020-03-30 2020-07-28 广州视源电子科技股份有限公司 一种传屏方法、设备及存储介质
WO2020207032A1 (zh) * 2019-04-10 2020-10-15 广州视源电子科技股份有限公司 传屏设备的桌面组件配置方法及装置
CN111813302A (zh) * 2020-06-08 2020-10-23 广州视源电子科技股份有限公司 投屏显示方法、装置、终端设备和存储介质

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130212489A1 (en) * 2012-02-15 2013-08-15 Victor Ivashin Method for Providing Multiple Mouse Inputs in a Remote Desktop Session
US20150331604A1 (en) * 2014-05-14 2015-11-19 Microsoft Corporation Presenting stored files in whiteboard application
US20160330404A1 (en) * 2015-05-09 2016-11-10 Ricoh Company, Ltd. Integration of Videoconferencing with Interactive Electronic Whiteboard Appliances
WO2020207032A1 (zh) * 2019-04-10 2020-10-15 广州视源电子科技股份有限公司 传屏设备的桌面组件配置方法及装置
CN110928460A (zh) * 2019-10-09 2020-03-27 广州视源电子科技股份有限公司 智能交互平板的操作方法、装置、终端设备和存储介质
CN110928468A (zh) * 2019-10-09 2020-03-27 广州视源电子科技股份有限公司 智能交互平板的页面显示方法、装置、设备和存储介质
CN111459433A (zh) * 2020-03-30 2020-07-28 广州视源电子科技股份有限公司 一种传屏方法、设备及存储介质
CN111813302A (zh) * 2020-06-08 2020-10-23 广州视源电子科技股份有限公司 投屏显示方法、装置、终端设备和存储介质

Also Published As

Publication number Publication date
CN116601597A (zh) 2023-08-15

Similar Documents

Publication Publication Date Title
AU2015315114B2 (en) Real-time sharing during a phone call
US20240053879A1 (en) Object Drag Method and Device
US9977591B2 (en) Image with audio conversation system and method
KR102470925B1 (ko) 비디오 처리 방법 및 장치, 디바이스 그리고 저장 매체
US20170024110A1 (en) Video editing on mobile platform
WO2020249044A1 (zh) 窗口层级切换的方法、装置、设备和存储介质
US20240089529A1 (en) Content collaboration method and electronic device
US20150092006A1 (en) Image with audio conversation system and method utilizing a wearable mobile device
WO2013173968A1 (zh) 终端和应用功能界面的切换方法
WO2023061414A1 (zh) 一种文件生成方法、装置及电子设备
WO2023185817A1 (zh) 多设备协作方法、装置、电子设备及介质
WO2024153191A1 (zh) 视频生成方法、装置、电子设备及介质
WO2022116033A1 (zh) 协同操作方法、装置、终端及存储介质
WO2024078514A1 (zh) 投屏方法、装置、电子设备和存储介质
WO2023202721A1 (zh) 文件传输方法、装置、电子设备和存储介质
WO2024011095A1 (en) Methods and systems for recording a graphical element by dragging a drag-to-record element
WO2023097612A1 (zh) 交互实现方法、装置、交互平板及存储介质
WO2022237491A1 (zh) 多媒体数据处理方法、装置、设备、计算机可读存储介质及计算机程序产品
CN114969580A (zh) 会议内容记录方法、装置、会议系统和存储介质
WO2023205917A1 (zh) 内容共享方法、装置、交互平板及存储介质
JP2015045945A (ja) 情報処理装置、プログラム及び情報処理システム
CN116225285A (zh) 界面交互方法、装置、交互平板及存储介质
CN116339590A (zh) 多数据源的信息窗口显示方法、装置、平板和存储介质
WO2023115490A1 (zh) 协作信息显示控制方法、电子设备和存储介质
CN116225302A (zh) 界面控制实现方法、装置、设备及存储介质

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 202180007750.X

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21966044

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE