CN116601597A

CN116601597A - Interactive implementation method and device, interactive flat board and storage medium

Info

Publication number: CN116601597A
Application number: CN202180007750.XA
Authority: CN
Inventors: 张秀媚
Original assignee: Guangzhou Shizhen Information Technology Co Ltd
Current assignee: Guangzhou Shizhen Information Technology Co Ltd
Priority date: 2021-12-02
Filing date: 2021-12-02
Publication date: 2023-08-15
Also published as: WO2023097612A1

Abstract

An interaction realization method, an interaction realization device, an interaction panel and a storage medium relate to the technical field of interaction panels, wherein the method comprises the following steps: displaying a first interface (110) of a first application; receiving first data sent by at least one first terminal, wherein the first data comprises file data or screen projection data, and the first terminal and the interaction panel are communicated (120) in a wireless communication mode; displaying a preview of each first data in the first interface (130); receiving a first operation for selecting a target preview image (140) among the preview images; displaying a second interface of a second application, wherein the second application is an application program (150) for opening first data corresponding to a target preview; receiving a second operation (160) for a second interface; according to the second operation, the second interface is closed and the display of the first interface is resumed (170). By adopting the method, the technical problem that the operation process is complicated when different types of data are switched on in the related technology can be solved.

Description

Interactive implementation method and device, interactive flat board and storage medium

Technical Field

The embodiment of the application relates to the technical field of interaction plates, in particular to an interaction realization method, an interaction realization device, an interaction plate and a storage medium.

Background

With the development of intelligent technology, various intelligent electronic devices are widely used in various daily scenes. For example, in a conference scene, the electronic device is used as a conference terminal, and functions of displaying conference files, displaying screen projection data of other local electronic devices, performing audio and video call with remote electronic devices, serving as a conference whiteboard and the like can be realized.

With the widespread use of electronic devices, the functions that can be achieved by the electronic devices are increasingly abundant. In general, an electronic device implements different functions by running various types of applications that it installs, for example, displaying different types of data through different applications. However, when a user wants to sequentially open different types of data, it is often necessary to operate the electronic device to first close the current type of application, then open another type of application and open data in the application. Therefore, a user is required to send out a plurality of operations in the electronic equipment, so that the operation process is complicated, and the use efficiency is affected.

Disclosure of Invention

The embodiment of the application provides an interaction implementation method, an interaction implementation device, an interaction panel and a storage medium, which are used for solving the technical problem that the operation process is complicated when different types of data are opened in the related technology.

In a first aspect, an embodiment of the present application provides an interaction implementation method, applied to an interaction tablet, where the method includes:

displaying a first interface of a first application;

receiving first data sent by at least one first terminal, wherein the first data comprises file data or screen projection data, and the first terminal and the interaction panel communicate in a wireless communication mode;

displaying a preview of each first data in the first interface;

receiving a first operation, wherein the first operation is used for selecting a target preview image in each preview image;

displaying a second interface of a second application, wherein the second application is an application program for opening the first data corresponding to the target preview;

receiving a second operation for the second interface;

and closing the second interface according to the second operation, and restoring to display the first interface.

In a second aspect, an embodiment of the present application provides an interaction implementation method, applied to an interaction implementation system, where the interaction implementation system includes an interaction panel and at least one first terminal, the interaction implementation method includes:

The first terminal establishes wireless communication connection with the interaction panel;

the interactive flat panel displays a first interface of a first application;

the first terminal displays a fifth interface of a fourth application;

the first terminal receives a fifth operation in the fifth interface;

determining that the fifth operation is used for selecting to send file data, the first terminal sending the local file data to an interactive panel according to the fifth operation, determining that the fifth operation is used for selecting to send screen throwing data, and uploading the local screen throwing data to the interactive panel by the first terminal;

the interaction panel displays a preview of the first data in the first interface, wherein the first data comprises the file data or the screen projection data;

the interaction panel receives a first operation, wherein the first operation is used for selecting a target preview image in each preview image;

the interaction panel displays a second interface of a second application, wherein the second application is an application program for opening the first data corresponding to the target preview;

the interactive tablet receives a second operation for the second interface;

and closing the second interface by the interactive flat plate according to the second operation, and recovering to display the first interface.

In a third aspect, an embodiment of the present application provides an interaction implementation apparatus, applied to an interaction tablet, the apparatus comprising:

the first display unit is used for displaying a first interface of the first application;

the first receiving unit is used for receiving first data sent by at least one first terminal, wherein the first data comprise file data or screen projection data, and the first terminal and the interaction panel are communicated in a wireless communication mode;

the second display unit is used for displaying preview images of the first data in the first interface;

a second receiving unit configured to receive a first operation for selecting a target preview image among the preview images;

the third display unit is used for displaying a second interface of a second application, wherein the second application is an application program for opening the first data corresponding to the target preview;

a third receiving unit configured to receive a second operation for the second interface;

and the fourth display unit is used for closing the second interface according to the second operation and restoring to display the first interface.

In a fourth aspect, one embodiment of the present application provides an interactive tablet comprising:

One or more processors;

a display for displaying according to the instruction of the processor;

a communication module for wireless communication with at least one first terminal;

a memory for storing one or more programs;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the interaction implementation method as described in the first aspect.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, implements the interaction implementation method according to the first aspect.

In one embodiment of the application, by displaying the first interface of the first application, displaying the preview of the first data in the first interface when receiving the first data sent by the first terminal, displaying the second interface of the second application when the user selects the preview, displaying the first data in the second interface, closing the second interface when receiving the second operation for the second interface, and restoring to display the first interface, the user can select the preview again in the first interface to open the corresponding technical means of the first data, so that the technical problem that the operation process is complicated when opening different types of data in the related art can be solved. The first interface of the first application is used as a carrier, and corresponding first data can be directly opened through the preview of the first interface, so that the operation process is simplified. And, the preview of the first data is displayed through the first interface, so that the user can also determine which first data is uploaded by the first terminal.

Drawings

FIG. 1 is a flow chart of an interactive implementation method according to an embodiment of the present application;

FIG. 2 is a schematic diagram of an arrangement rule according to an embodiment of the present application;

FIG. 3 is a schematic diagram of an arrangement rule according to an embodiment of the present application;

FIG. 4 is a schematic diagram of an arrangement rule according to an embodiment of the present application;

FIG. 5 is a flow chart of an interactive implementation method according to an embodiment of the present application;

FIG. 6 is a flow chart of an interactive implementation method according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a fourth application main interface according to an embodiment of the present application;

FIG. 8 is a schematic view of a seventh interface according to an embodiment of the present application;

FIG. 9 is a fifth interface schematic provided by an embodiment of the present application;

FIG. 10 is a first schematic view of a first interface provided by an embodiment of the present application;

FIG. 11 is a schematic diagram of a screen prompt provided in an embodiment of the present application;

FIG. 12 is a schematic illustration of a sixth interface provided in accordance with one embodiment of the present application;

FIG. 13 is a second schematic view of a first interface provided by an embodiment of the present application;

FIG. 14 is a second interface schematic provided in an embodiment of the application;

FIG. 15 is a schematic diagram of a contact list provided by one embodiment of the present application;

FIG. 16 is a schematic diagram illustrating an invitation command display according to an embodiment of the present application;

FIG. 17 is a third schematic view of a first interface provided by an embodiment of the present application;

FIG. 18 is a fourth schematic view of a first interface provided by an embodiment of the present application;

FIG. 19 is a fourth interface schematic provided by an embodiment of the present application;

FIG. 20 is a fifth schematic view of a first interface provided by an embodiment of the present application;

FIG. 21 is a schematic diagram of a list of second data according to an embodiment of the present application;

FIG. 22 is a schematic structural diagram of an interaction implementation device according to an embodiment of the present application;

fig. 23 is a schematic structural diagram of an interactive tablet according to an embodiment of the present application.

Detailed Description

The application is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are for purposes of illustration and not of limitation. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present application are shown in the drawings.

The embodiment of the application provides an interaction implementation method which can be executed by interaction implementation equipment, wherein the interaction implementation equipment can be realized in a software and/or hardware mode, and the interaction implementation method can be composed of two or more physical entities or one physical entity. The interaction realizing device can be an intelligent electronic device such as an interaction tablet, a tablet computer, an intelligent television, a mobile phone and the like.

In one embodiment, an interaction implementation method of an interaction panel is exemplarily described with an interaction implementation device as the interaction panel. The interactive flat board is integrated equipment for controlling the content displayed on the display flat board and realizing man-machine interaction operation through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound, a television, a video conference terminal and the like.

The interactive tablet is provided with at least one type of operating system, and the operating system can be an Android system, a Windows system, a Linux system, an IOS system and the like. The interactive tablet may install at least one application under the operating system. The application program may be an application program of the operating system, and is also installed as an application program downloaded from a third party device or a server, which is not limited at present. For example, the interactive tablet is installed with a whiteboard application, and the whiteboard application refers to an application for a user to perform writing, displaying and other operations, and can be used for generating writing handwriting according to writing operations (touch operations) of the user on an interface of the whiteboard application, and can also be used for inserting and displaying multimedia elements on the interface of the whiteboard application, wherein the multimedia elements can include graphics, images, tables, documents, audio files and/or video files. In the interface of the whiteboard application, the user can realize writing, drawing, erasing and other operations similar to the physical blackboard, and further has better digital functions of moving, saving, scaling, inserting pictures, adjusting colors, setting stroke weights and the like. The whiteboard application may also display and edit file data (including writing scripts and/or multimedia elements, etc.) created by the user in the whiteboard application of the other terminal. In practical applications, the whiteboard application may also be named as a writing application, an electronic whiteboard application, a collaborative whiteboard application, or the like, regardless of the change in the names, as long as the application for realizing the above functions is equivalent to the whiteboard application of the present disclosure. For another example, the interactive flat board is provided with a file display application, the file display application can be used for displaying files to users, and in some scenes, the file display application can also be used for editing the files by the users, such as creating the files, editing the content of the files, adding comments and the like, so that real-time display of user editing operation in the file display process is realized, and further information display and interactive effects in the file display process are improved. It is understood that the interactive tablet may install multiple file presentation applications, and that different file presentation applications may present different types of files. For example, the interactive tablet is respectively provided with a file display application for displaying documents such as Word documents, PDF documents, PPT documents, excel documents and the like, and also provided with a file display application for displaying multimedia files such as pictures (such as bmp, jpg, png, tif, gif and the like), videos (such as wmv, MP4, avi, rm and the like), audios (such as MP3, WMA and the like) and the like. In practical application, the file display application can be named correspondingly according to the type of the display file, and the file display application is equally identical to the file display application of the present disclosure as long as the application is used for realizing the above functions, regardless of the change of the name of the file display application. For another example, the interactive tablet is provided with a screen-throwing application, and the screen-throwing application is mainly used for wirelessly throwing a screen, and the wireless screen-throwing is used for displaying a picture (also called screen-throwing data) of a mobile device (such as a mobile phone, a tablet computer, a notebook computer and the like) to the interactive tablet in a real-time manner through a specific technical method, wherein the displayed content comprises various media information and a real-time operation picture. The screen-casting application may also be referred to as a screen-passing application, a fly-screen application, a screen sharing application, regardless of the name of the screen-casting application, as long as the application for realizing the above-described functions is equivalent to the screen-casting application of the present disclosure.

The interactive tablet is also provided with at least one display screen (also denoted display). For example, the interactive tablet is configured with a touch-enabled display screen, which may be a capacitive screen, resistive screen, infrared screen, and/or electromagnetic screen. The user can control the interactive flat panel in a mode of touching the display screen by a finger or a touch pen. In addition, the interaction panel can be connected with external devices such as a mouse and a keyboard, and a user can control the interaction panel in a mode of operating the external devices.

The interactive flat board is also provided with a communication module, and the interactive flat board realizes a communication function through the communication module, for example, the interactive flat board performs data transmission with other electronic equipment through the communication module. For another example, the interactive tablet performs data transmission with the server through the communication module. When the interactive flat board is communicated with other electronic equipment through the communication module, file data transmitted by the other electronic equipment can be received and displayed, or operations such as annotation and editing can be carried out by a user, screen throwing data transmitted by the other electronic equipment can be received and displayed, audio and video conversation can be carried out with the other electronic equipment, screen sharing can be carried out with the other electronic equipment, and the like, particularly under the condition that a conference and the like need multi-person communication scenes, the interactive flat board can be used as the interactive equipment, so that the functional requirements under the multi-person communication scenes are met, for example, under the conference scenes, the interactive flat board sequentially displays the screen throwing data of mobile terminals of local users in the conference room, or sequentially displays the file data transmitted by the mobile terminals of the local users in the conference room, or realizes audio and video conversation between the local users and remote terminals (such as remote interactive flat board and mobile terminal), and transmits the screen content of the interactive flat board to the remote terminal for display in the audio and video conversation process.

In the existing multi-user communication scenario, when the data content currently displayed by the interactive tablet is switched, a plurality of operation links need to be executed. Taking a conference scenario as an example, for example, the interactive flat panel displays the screen projection data of the mobile terminal a, when the file data uploaded by the mobile terminal B needs to be displayed, a local user needs to disconnect the mobile terminal a from the interactive flat panel and close the screen projection application, then open a corresponding file display application or whiteboard application in the interactive flat panel, and open the file data of the mobile terminal B in the file display application or whiteboard application. For another example, when the interactive flat panel needs to sequentially display the screen projection data of the mobile terminal a, the mobile terminal B and the mobile terminal C, the local user needs to sequentially switch the three mobile terminals to send the screen projection data to the interactive flat panel, for example, the user of the mobile terminal a disconnects the mobile terminal a from the interactive flat panel, and the user of the mobile terminal B uses the mobile terminal B to establish connection with the interactive flat panel and send the screen projection data. For another example, after the interactive flat board displays the local PPT document by using the file display application, if the Word document sent by the mobile terminal B is received, the local user needs to operate the interactive flat board to close (or switch to) the file display application corresponding to the PPT document, open the file display application corresponding to the Word document and open the Word document in the file display application, and then, when the PPT document needs to be displayed again, the user needs to operate the interactive flat board again to close (or switch to) the file display application corresponding to the Word document in the background, open the file display application corresponding to the PPT document and open the PPT document in the file display application. For another example, the interactive tablet displays the Word document sent by the mobile terminal a, and then if the local user needs to use the whiteboard function in the interactive tablet, the local user needs to close (or switch to the background) the file display application corresponding to the Word document and start the whiteboard application, and then when the user needs to open the Word document again, the user needs to close (or switch to the background) the whiteboard application, open the file display application corresponding to the Word document and open the Word document in the file display application.

In order to reduce the operation links executed when switching data content, in the interactive implementation method provided by the embodiment of the application, all data received by an interactive tablet is displayed in an interface of an application program in a preview mode under a multi-user communication scene, interfaces of other application programs installed on the interactive tablet are also displayed in the interface in a preview mode, and then a user can open corresponding data or other application programs only by selecting a needed preview in the interface.

When the interaction implementation method is executed by the interaction panel, fig. 1 is a flowchart of an interaction implementation method provided by an embodiment of the present application, and referring to fig. 1, the interaction implementation method includes:

step 110, displaying a first interface of a first application.

The first application is an application installed in the interactive tablet. The first application may be considered as an application program for connection, and in one embodiment, when the interactive implementation method is executed, by displaying other application programs or opened data therein in a preview manner in an application interface of the first application, quick switching between other different application programs may be implemented.

In one embodiment, the interactive tablet establishes a connection with another electronic device used by the user. Currently, another electronic device used by a user is denoted as a first terminal, and the first terminal may be an intelligent electronic device such as a mobile phone, a tablet computer, a notebook computer, and the like. The first terminal and the interactive tablet are illustratively geographically closely spaced, e.g., in a meeting scenario where the first terminal and the interactive tablet are in the same meeting room, and e.g., in a teaching scenario where the first terminal and the interactive tablet are in the same classroom. It will be appreciated that when the interactive implementation method is not performed, the first terminal and the interactive tablet may be geographically distant, for example, the first terminal is a mobile phone, the interactive tablet is installed in a conference room, in a conference scenario, a participant may bring the first terminal into the conference room and establish a connection with the interactive tablet, and after the conference is finished, the participant disconnects the first terminal and the interactive tablet and brings the first terminal away from the conference room.

In one embodiment, an application program corresponding to the first application is installed in the first terminal, and currently, the application program installed in the first terminal is denoted as a fourth application, where the fourth application corresponds to the first application and may be understood as that connection, data transmission, instruction transmission, and the like may be established between the fourth application and the first application. For example, the first application is a conference program applicable to the interactive flat panel, and the fourth application is a conference program applicable to the first terminal, at this time, connection between the first terminal and the interactive flat panel can be achieved through two application programs, and then, data required by a conference in the first terminal can be sent to the interactive flat panel through the fourth application, so that the interactive flat panel displays the data for other participants to watch.

In one embodiment, the connection between the first terminal and the interactive tablet is established by the first application and the fourth application, and is currently mainly a wireless communication connection. Alternatively, because the first terminal and the interactive tablet are geographically closely spaced, the first terminal and the interactive tablet may establish a connection and transmit data using close range wireless communications (i.e., wireless communications suitable for use in close range). For example, the connection is established by means of a connection code. For example, the first terminal and the interactive tablet are located in the same local area network, the user generates a connection code in one of the first terminal and the interactive tablet, the connection code being a string of letters, numbers and/or symbols, and when the user inputs the connection code in the other of the first terminal and the interactive tablet (the other terminal is input by the fourth application when the other terminal is the first terminal, and the other terminal is input by the first application when the other terminal is the interactive tablet), the first terminal and the interactive tablet confirm the connection in the local area network based on the same connection code. For another example, the connection is established by means of a two-dimensional code. For example, a user generates a two-dimensional code for connection through the interactive flat panel, then the user scans the two-dimensional code through a fourth application of the first terminal, and after the scanning is successful, the first terminal and the interactive flat panel confirm connection. As another example, the connection is established by means of bluetooth pairing. In practical application, other short-range wireless communication methods may be used to establish connection, or the first terminal and the interactive tablet may be used to establish connection by remote network communication (i.e. communication in a long-range using the internet), which is not limited at present.

In one embodiment, after the first terminal is connected to the interactive pad, the interactive pad opens the first application. It can be appreciated that if the first application has been opened before connection, the first application is set to be running in the foreground after connection. The foreground operation is understood as that when an application program is operated, an interface of the application program is displayed in a screen, and a user can grasp the operation process of the application program through the interface and control the application program correspondingly. The background operation is opposite to the foreground operation, and the background operation can be understood as that when the application program is operated, an interface of the application program is not displayed in a screen, and a user cannot intuitively grasp the operation process of the application program.

Illustratively, after the first application is opened, a first interface of the first application is displayed. The first interface may be considered as a main interface of the first application, where the interface (also referred to as an application interface) refers to an interactive interface of an application program for receiving and/or displaying information, and the main interface is the first interface displayed after the first application is run, similar to a desktop of the first application. It can be understood that when the first application has an opening animation or an opening image, the first interface is the first interface after the opening animation or the opening image is displayed. The user can trigger the first application to execute the corresponding function through the operation on the first interface. The first interface may be a full-screen interface or a non-full-screen interface, and a full-screen interface is taken as an example currently. The first interface is a full screen interface, which can be understood as the first interface is full screen. Currently, by displaying the first interface, it is clear that the first terminal and the interactive tablet are successfully connected.

The content and layout of the first interface is not currently limited. For example, a terminal list is displayed in the first interface, the terminal list displaying the first terminal that is currently connected (e.g., displaying the head portrait and/or name of the first terminal). For another example, a functional key is displayed in the first interface, where the functional key is a control that can trigger a corresponding function after the user operates the functional key. The functional keys are presented in the first interface in the form of virtual keys, the number of the functional keys is not limited currently, and one functional key may trigger a function, such as the first interface displaying a key for exiting the first application, displaying a key for recording screen content, etc.

Optionally, when the first interface of the first application is displayed, a preset function may also be started. For example, when the first interface is displayed, a screen recording function is also started, under the screen recording function, the interaction panel records screen contents, a screen recording file is generated based on the recorded screen contents, and the screen contents of the interaction panel in the recording process can be reviewed through the screen recording file.

It will be appreciated that after the connection between the interactive tablet and the first terminal is established, other first terminals may also establish a connection with the interactive tablet. For example, after the first terminal and the interactive flat board are connected, the interactive flat board opens a first application and displays a first interface, the first interface displays the head portrait of the first terminal, and then when the second first terminal and the interactive flat board are connected, the interactive flat board adds the head portrait of the second first terminal in the first interface, so as to display the situation of the locally connected first terminal.

Step 120, receiving first data sent by at least one first terminal, where the first data includes file data or screen projection data, and the first terminal communicates with the interactive tablet through a wireless communication mode.

In one embodiment, after displaying the first interface, the user sends data to the interactive pad by operating the fourth application. And recording the data sent by the first terminal as first data, wherein the first data comprises file data and/or screen projection data.

The file data refers to a file stored in the first terminal (the file may be created in the first terminal or transmitted to the first terminal after being created in another terminal), and the type of the file data is not limited currently, for example, the type of the file data may be an image, a text, an audio/video, a presentation, a form, a whiteboard file, or the like. Different types of file data need to be opened by using an adaptive application program, for example, the file data are presentation data in a PPT format, and the needed file presentation application is a presentation application such as PPT or WPS Office. For another example, if the file data is audio/video data, the required file display application is an audio/video playing application. For another example, the file data is whiteboard file data, and then a whiteboard application is required. In one embodiment, after the user selects the function for uploading the file data in the fourth application, the fourth application displays the file data that can be uploaded, where the file data that can be uploaded may be all file data stored in the first terminal, or specific type of file data (specific type may be set according to practical situations), or file data that is imported into the fourth application by the user in advance, where the imported file data may be understood as file data that is selected by the user in advance from all file data and that can be used by the fourth application. The fourth application, for example, supports multiple file delivery, i.e., the user may select one or more file data, and when the user selects multiple file data, the types of the multiple file data may be the same or different. Optionally, the maximum file selection number is preset in the fourth application, after the file data selected by the user exceeds the maximum file selection number, the user cannot continue to select the file data, and at this time, the fourth application may prompt the user to reach the maximum file selection number.

After selecting the file data, the first terminal transmits the file data to the interactive pad. In the embodiment of the application, after the first terminal establishes the close-range wireless communication with the interactive flat board, the file data is directly sent to the interactive flat board. After the first terminal establishes connection with the interactive flat board in a remote network communication mode, file data is uploaded to a server in the remote network communication mode, and the server sends the file data to the interactive flat board. The server is a server that provides services for the first application and the fourth application.

Optionally, when sending the file data, attribute information of the file data is sent in addition to the content of the file data, where the attribute information includes: the name, type, etc. of the file data. It can be appreciated that in practical applications, the attribute information may also include other contents, for example, the avatar and/or the name of the first terminal, which is not limited currently.

The screen projection can be understood as that the content (which may be screen content or content of one or more interfaces, or audio/video data played in the screen) of the first terminal is displayed on the interactive tablet in real-time and synchronously. The screen projection data are data obtained based on screen projection content coding in the screen projection process, and the interactive flat board can acquire and display the content of the first terminal by decoding the screen projection data. Optionally, after the user selects the screen-throwing function in the fourth application, the fourth application acquires the screen-throwing data and sends the screen-throwing data to the interaction panel through the first terminal. Optionally, the connection between the first terminal and the interactive flat panel and the sending of the screen throwing data can also be realized through the screen throwing terminal. For example, after the screen projection terminal is connected with the interactive flat board in a pairing manner, the screen projection terminal can directly acquire the screen projection data and code the screen projection data and transmit the screen projection data to the interactive flat board, or the screen projection application program can acquire the screen projection data and code the screen projection data and transmit the screen projection data to the interactive flat board after downloading and installing the screen projection application program to the first terminal. The first terminal may send the screen-throwing data directly to the interactive board or via the server. When the screen throwing data is sent, besides the content of the screen throwing data, attribute information of the screen throwing data is also sent, wherein the attribute information comprises: an identification representing the screen (which identification may be considered as a type of data). It can be appreciated that in practical applications, the attribute information may also include other contents, for example, the avatar and/or the name of the first terminal, which is not limited currently.

And 130, displaying a preview of each first data in the first interface.

The interaction panel generates a corresponding preview according to the first data after receiving the first data, and displays the preview in a first interface of the first application, so that a user can select the first data to be opened. The preview refers to a small image obtained by compressing the data content in the first data, and generally includes a hyperlink pointing to the first data. For example, when the first data is a PPT document, the preview image is a small image based on the first page data content of the PPT document. For another example, when the first data is the screen-shot data, the preview is a small image obtained based on the content of one frame (the first frame or other frames) in the screen-shot data.

In one embodiment, step 130 includes: step 131-step 133:

step 131, acquiring the data content of the first data.

The data content is content contained in the first data. After the interaction panel receives the first data, the first data is analyzed to obtain data content, attribute information and the like of the first data. Alternatively, the currently acquired data content may be data content for generating a preview, for example, when the first data includes a plurality of pages or frames of data content, only one of the pages (e.g., the first page or the default number of pages to be displayed when the first data is opened) or one of the frames (e.g., the first frame or the number of frames to be displayed when the first data is opened) of data content is acquired. And when the first data does not contain the multi-page or multi-frame data content, acquiring the whole data content.

Step 132, generating a preview of the first data according to the data content.

Optionally, a preview containing the data content is generated as a preview of the first data. The size of the preview is not currently limited. Generally, the preview images of the respective first data have the same size. Optionally, the generation manner of the preview is not limited, for example, screenshot and compression are performed on the data content, and a hyperlink pointing to the first data is added to obtain the preview of the first data.

And step 133, sending the preview to the first application, and displaying the preview on the first interface after the first application receives the preview.

The first application displays the preview image in the first interface after the first application receives the preview image from the first interface. Optionally, if the attribute information includes an avatar and/or a name of the first terminal, when the preview is sent, the avatar and/or the name of the first terminal is also sent, so that when the preview is displayed in the first interface, the avatar and/or the name of the first terminal is displayed, so that the user explicitly sends the first terminal of the first data.

In one embodiment, when the first interface displays the preview of the first data, the first data is displayed according to an arrangement rule of the preview. The arrangement rule specifies the size of the preview images in the first interface, the line spacing (the spacing distance between two adjacent preview images in the same line), and the column spacing (the spacing distance between two adjacent preview images in the same column), among others. Alternatively, the arrangement rule of the preview images is determined by the number of preview images, that is, when the number of preview images is different, the arrangement rule of the preview images may be different. Alternatively, the arrangement rule of the preview images is fixed and the user can modify the arrangement rule of the preview images, that is, the arrangement rule of the preview images is the same when the number of preview images is different. In one embodiment, the arrangement rule of the preview images in the first interface is described by taking as an example that the number of preview images is determined. At this time, arrangement rules of the preview images under different numbers are set, the first application obtains the corresponding arrangement rules according to the number of the preview images to be displayed currently, and then displays the preview images according to the arrangement rules. For example, fig. 2 is an arrangement rule of the preview images when the number of the preview images is 1, fig. 3 is an arrangement rule of the preview images when the number of the preview images is 2, fig. 4 is an arrangement rule of the preview images when the number of the preview images is 3 and more than 3 (fig. 4 is an example of 5 preview images), and as can be seen from fig. 2 to fig. 4, different arrangement rules are set in combination with the number of the preview images, so that the display of the preview images can be more flexible.

Optionally, when the number of the first data is multiple, an arrangement order of the multiple preview images in the first interface may be set according to an actual situation. For example, a plurality of preview images are arranged in accordance with the transmission or reception time. For another example, the plurality of preview images are arranged according to the type of the first data.

Alternatively, when the preview of the first data is displayed in the first interface, the name of the first data may also be displayed.

Optionally, the preview displayed in the first interface may also be changed according to the receiving condition of the first data, for example, when a certain first terminal ends sending the screen-throwing data, the first application deletes the preview corresponding to the screen-throwing data in the first interface, and adjusts the arrangement of the remaining preview. For another example, when the first terminal sends new first data, the first application adds a preview of the new first data in the first interface, and adjusts the arrangement of the remaining preview.

Optionally, the type of the first data may be further defined when the interactive tablet parses the first data, and then, a corresponding application program is started according to the type of the first data, and currently, the started application program is recorded as a second application, where the second application may be regarded as an application program required for opening the first data, and after the second application is started, the first data is opened in the second application. Alternatively, when the data content of the first data is acquired, the data content displayed by the second application may be acquired after the second application opens the first data. Optionally, the launching of the second application and the opening of the first data are done in the background. After the first data is opened, the first data opened in the second application can be found through the hyperlink of the preview. Optionally, if the first application can open the first data, the first application is directly used as the second application, and at this time, the second application does not need to be opened.

After displaying the preview of the first data in the first interface, step 140 is performed.

Step 140, receiving a first operation, where the first operation is used to select a target preview image from the preview images.

After the preview is displayed on the first interface, the user may select one preview in the first interface according to his own needs, so that the interactive flat opens the first data corresponding to the preview.

In one embodiment, the operation of selecting the preview image by the user is referred to as a first operation, and the preview image selected by the user is referred to as a target preview image. The triggering manner of the first operation is not limited at present, for example, detection of the preview image receiving a setting operation (such as a single click operation and a double click operation) or the like, determination of receiving the first operation, and taking the preview image acted by the first operation as a target preview image.

Step 150, displaying a second interface of a second application, where the second application is an application program for opening first data corresponding to the target preview.

Illustratively, since the preview image has hyperlinks pointing to the first data, when the user selects the target preview image, the corresponding first data may be opened through the hyperlinks of the target preview image. In one embodiment, since the first data is opened in the corresponding second application, opening the first data through the hyperlink refers to switching the second application that opened the first data to the foreground operation to display the first data.

The first application receives the first operation, notifies the interaction panel of the target preview image selected by the first operation, and the interaction panel switches the second application to the foreground operation according to the hyperlink of the target preview image. And when the second application is switched to the foreground operation, displaying an interface of the second application. Currently, the interface displayed by the second application is denoted as a second interface. It should be noted that, the second application has already opened the first data when running in the background, so the second interface displayed in the foreground refers to an interface displayed after the second application opens the first data, that is, the first data is displayed in the second interface.

When the second interface is displayed, the second interface may be a full-screen interface or a non-full-screen interface, and currently, the second interface is described by taking the full-screen interface as an example. After the second interface is displayed, the first interface is blocked by the second interface, at this time, the first application can be considered to be switched to background operation, and when the first application is switched to the foreground again, the display of the first interface is resumed.

In one embodiment, when the second interface is displayed, at least one functional key may also be displayed. Currently, the functional keys displayed when the second interface is displayed are denoted as first keys. The first keys can be one or more, one first key corresponds to one function, specific content of the function can be set according to actual requirements, for example, two first keys are displayed currently, the function of one first key is a recovery function, the second interface can be closed and the first interface can be recovered to be displayed through the recovery function, the function of the other first key is a screen sharing function, and the screen content of the interaction panel can be sent to other terminals through the screen sharing function, so that the other terminals can display the screen content.

Alternatively, the first key may be an application level key or a system level key. The application level keys are executed by the corresponding application programs. The system level keys are commands of the operating system, i.e. corresponding functions are performed by the operating system. When the plurality of first keys are provided, different first keys can respectively belong to the system-level keys and the application-level keys, and when the plurality of first keys belong to the application-level keys, different first keys can belong to different application programs, and the method is not limited at present. In one embodiment, the display layer of the first key is higher than the second interface, that is, the first key is displayed on the second interface, and when the user operates the position of the first key, the user confirms that the operation is performed on the first key, but not on the second interface.

In one embodiment, the description is given taking an example that the first key has at least a recovery function, where the second interface is a full screen interface, and the second interface of the second application is displayed, specifically: and displaying a second interface of the second application, and displaying a first key on the second interface, wherein the display layer level of the first key is higher than that of the second interface, the first key comprises a first control, and when the first control is triggered, the interaction panel receives a second operation.

Illustratively, the button used for triggering the recovery function in the first button is denoted as a first control, the control refers to encapsulation of data and methods, and the functional button can be regarded as an implementation manner of the control. And the user sends out a second operation by operating the first control, wherein the second operation is an operation of closing the second interface and resuming displaying the first interface. The first control may be a system level key, an application level key of a first application, or an application level key of a second application. Optionally, the first control is a system level button, and a display layer level of the first control is higher than the second interface. The display position of the first control is not currently limited.

It should be noted that, when the first application is opened, the first application may also be used as the second application, and at this time, the first data is directly opened in the first application, and the second interface is displayed, where the second interface is the interface displayed after the first application opens the first data. Currently, the first key may still be displayed.

In general, the first data received by the interactive tablet may be opened locally. If the received first data cannot be opened locally, displaying a prompt that the first data cannot be opened when the preview image is generated.

In one embodiment, after the second interface is displayed, the user may further perform a corresponding operation on the first data through the second interface. Optionally, the second application is a whiteboard application, and after displaying the second interface of the second application, the method further includes: and receiving writing operation in the second interface, and generating corresponding writing handwriting in the second interface according to the writing operation. Illustratively, when the first data is data generated based on the whiteboard application, the interactive tablet opens the whiteboard application and displays the first data in the whiteboard application. Then, the user can write, insert, etc. editing operations on the first data in the interactive tablet. Currently, the writing performed by the user in the second interface is denoted as a writing operation. During the user writing, the interactive tablet determines the location of the writing operation and notifies the whiteboard application to display the corresponding writing trace at that location.

Optionally, the second application is a file display application, and after displaying the second interface of the second application, the method further includes: and receiving file display operation in the second interface, and displaying corresponding file display results in the second interface according to the file display operation. The second interface is opened through the file display data, and the first data is displayed, so that the user can edit (e.g. modify, add or delete data content and/or insert multimedia elements), annotate, turn pages, etc. the operation sent by the user on the first data is referred to as a file display operation, and then the second application responds to the file display operation and presents a corresponding response result in the second interface. For example, the first data is a PPT document, and currently, the second interface displays a first page of the PPT document, and after the user sends out a page turning operation in the second interface, the second interface displays a second page of the PPT document, where the data content of the second page is the displayed file display result.

Optionally, the second application is a screen-throwing application, and after displaying the second interface of the second application, the method further includes: and receiving real-time screen projection data sent by the first terminal, and displaying the real-time screen projection data in the second interface. When the first data is the screen projection data, the second application is the screen projection application, and after the second interface is displayed, the screen projection data of the first terminal can be displayed through the second interface, and at this time, the interactive flat board continuously receives the screen projection data of the first terminal and displays the screen projection data in real time in the second interface.

It is understood that in addition to operating on the first data in the second interface, the second interface may also be operated on as a whole, such as closing the second interface, exiting full screen display, and so on. In one embodiment, the second interface is closed as an example, and step 160 is further performed after step 150.

Step 160, receiving a second operation for a second interface.

The manner of triggering the second operation is not currently limited. For example, when the second interface is displayed, the first control is also displayed, and when the first control is detected to receive a setting operation (such as a clicking operation), it is determined that a second operation is received. For another example, when it is detected that a setting operation (such as a long press operation) is received in a setting area, it is determined that a second operation is received, where the setting area is an area in the screen, and a specific area position is not limited currently.

And 170, closing the second interface according to the second operation, and restoring to display the first interface.

For example, closing the second interface refers to switching the second application to background operation, at which point the second interface may be minimized or switched to background. When the second interface is closed, the first interface is restored to be displayed, and a preview image (including a target preview image) of the first data is also displayed in the first interface, so that a user can open other first data through the preview image or open the current first data again. It will be appreciated that if the user closes the second application, the target preview is no longer displayed in the first interface.

In one embodiment, after resuming the displaying of the first interface, the method further comprises: and updating the target preview. The target preview is still reserved in the first interface which is restored to be displayed when the second interface is closed, and the target preview can be updated timely according to the operation content when the user operates the first data in the second interface. Optionally, when the data content displayed on the second interface is used as the preview, when the display of the first interface is resumed, the data content on the second interface is obtained, and a target preview is generated based on the data content, where updating the target preview may include: acquiring display content when the second interface is closed; and generating a first preview image according to the display content, and updating the target preview image into the first preview image. And when the second interface is closed, acquiring display content of the second interface, wherein the display content is data content of the first data displayed on the second interface. Optionally, the display content is acquired in a screenshot mode. Then, a new preview is generated according to the display content, and the process is the same as the process of generating the preview, which is not described herein. And currently, marking the generated preview image as a first preview image, taking the first preview image as a new preview image of corresponding first data, and replacing the original target preview image so as to enable the target preview image displayed in the first interface to be the first preview image. It can be understood that when the display content of the second interface is obtained, whether the display content of the second interface is consistent with the content of the target preview image can be judged first, if so, the generation of the first preview image is abandoned, and if not, the first preview image is generated. Alternatively, after the display content of the second interface is acquired, the first preview may be generated directly, and at this time, the generated first preview may coincide with the content of the target preview. It can be understood that, in practical application, when the first data includes multiple pages or frames of data content, the number of pages or frames of the data content as the preview image may be fixed (for example, the first page or the first frame is always adopted as the preview image), at this time, when the first interface is restored to be displayed, it is determined whether the number of pages or frames of the data content as the preview image changes, if the number of pages or frames of the data content as the preview image does not change, the target preview image is not updated, if the number of pages or frames of the data content does not change, the first preview image is generated again based on the current data content, and the target preview image is updated based on the first preview image.

Optionally, when the user selects the preview corresponding to the closed second interface again, the second interface is displayed again, and the display content of the second interface is consistent with the display content when the second interface is closed.

The technical means that when the preview image is selected by the user, a second interface of the second application is displayed, the first data is displayed in the second interface, then, when a second operation for the second interface is received, the second interface is closed, the first interface is restored to be displayed, and then, the user can select the preview image again in the first interface to open the corresponding first data can be solved, and the technical problem that the operation process is complicated when different types of data are opened in the related technology can be solved. The first interface of the first application is used as a carrier, and corresponding first data can be directly opened through the preview of the first interface, so that the operation process is simplified. And, the preview of the first data is displayed through the first interface, so that the user can also determine which first data is uploaded by the first terminal. The second operation is received through the first key of the system level, so that the operation process of closing the second interface is simplified, different second applications can be controlled through the first key, the first key is not required to be added for each second application, and the development difficulty is reduced.

In the following, a conference scenario is taken as an example, and an application process of the interaction implementation method is described. At this time, the first terminal and the interactive flat panel are located in the same conference room, and after the first terminal and the interactive flat panel establish a connection for short-range wireless communication, the interactive flat panel displays a first interface of the first application, where the first interface is shown in fig. 10, and the number of connected first terminals and a part of user portraits 23 of the first terminal are displayed in the first interface. And then, after the interaction flat receives the first data sent by the plurality of first terminals, generating a preview of each first data and displaying the preview in the first interface. At this time, the first interface is changed from fig. 10 to fig. 13. Referring to fig. 13, three preview images are shown, wherein the first two preview images correspond to file data and the third preview image corresponds to drop data. It can be understood that the interactive tablet opens the second application corresponding to each first data in the background, and opens the first data in the second application. Illustratively, the first preview is a preview of the PPT document, and after the user selects the first preview, a second interface of the second application is displayed, where presentation data is displayed. The second interface is shown in fig. 14, and the second interface displays the presentation data in full screen, so that other people in the conference room can watch the presentation data, and then the user can perform operations such as page turning, annotating and the like on the PPT document in the second interface. Referring to fig. 14, when the second interface is displayed, the first control 24 is also displayed. Upon detecting that the first control 24 receives the click operation, it is determined to receive the second operation, the second interface is closed, and the display of the first interface is resumed, that is, the interface shown in fig. 14 is resumed to the interface shown in fig. 13. Optionally, when the second interface is closed, the display content of the second interface is acquired and a first preview image is generated, and then the first preview image in fig. 13 is replaced by the first preview image. And then, the user can select the preview image in the first interface again so as to enable the interactive flat panel to display the second interface of the corresponding second application, in the process, when the user needs to switch and display the first data, the user only needs to close the current second interface and continuously select the needed preview image in the first interface, and the switching operation of the user can be simplified into two clicking operations through displaying the first control, so that the operation efficiency of the user is improved, and the conference efficiency is further improved.

In one embodiment of the present application, the first terminal may further select the target preview in the first interface, so as to remotely control the interactive tablet to open the corresponding second interface. At this time, after step 130, further includes: receiving a first control instruction sent by a first terminal, wherein the first control instruction is used for indicating an interaction panel to open a target preview; and displaying a second interface of the second application according to the first control instruction.

The fourth application installed in the first terminal also has a function of selecting a target preview, and when the user selects the target preview through the fourth application, the first terminal generates a first control instruction and sends the first control instruction to the interaction panel. And then, the interaction panel determines a target preview in the first interface according to the first control instruction, and then displays a second interface of the second application. Note that, in the embodiment, the implementation process of selecting the target preview by the user through the fourth application is not limited. For example, the user may call up a remote control interface in the fourth application, which displays virtual keys representing "up", "down", "left", "right", and "ok" functions, through which the user selects a target preview in the first interface. For another example, the user obtains the first interface through the fourth application, and displays the first interface on the first terminal, then the user selects the target preview image through the first interface of the first terminal, and then the first terminal sends the position of the target preview image selected by the user to the interaction panel, and the interaction panel uses the preview image displayed at the corresponding position in the first interface as the target preview image according to the position. It is understood that the target preview image selected by the user may be a preview image of the first data transmitted by any of the first terminals.

In the above manner, the first terminal remotely selects the target preview image, so that the user does not need to walk into the interactive tablet to operate, and only needs to operate at the position of the user.

In one embodiment of the present application, step 110 may specifically include steps 111-113:

step 111, receiving a connection request sent by the first terminal.

The connection request is a request for establishing a connection. In one embodiment, when the first terminal starts the fourth application, a main interface of the fourth application is displayed. The main interface is provided with a functional key for triggering the connection function, when the functional key is detected to receive a setting operation (such as a clicking operation), the fourth application enters the connection interface, and the connection interface is currently marked as a seventh interface. In one embodiment, when the connection is established by the connection code, the user inputs the connection code in the seventh interface, and after the input is completed, the fourth terminal generates a connection request and transmits the connection request to the interactive pad. Optionally, the first terminal searches the interaction panel using the same connection code in the local area network according to the connection code, and sends the connection request to the interaction panel. When the connection is established through the two-dimension code, a user can scan the two-dimension code for connection through the seventh interface, and after the scanning is successful, the fourth application generates a connection request and sends the connection request to the interactive flat board. The interactive flat board can be found through the information contained in the two-dimensional code, and a connection request is sent to the interactive flat board.

For example, a conference scenario is taken as an example. At this time, the first terminal and the interactive pad are located in the same conference room. The user starts the fourth application in the first terminal, then, the main interface of the fourth application is displayed after the fourth application is started, the main interface is shown in fig. 7, the connection key 11 is displayed in the main interface, then, when a click operation acting on the connection key is detected, the fourth application enters a seventh interface, and the seventh interface is the connection interface. The seventh interface is shown in fig. 8, referring to fig. 8, a connection is currently established through a connection code, the connection code is a number of 6 bits or 8 bits, and the interactive tablet is provided with the connection code. After the user inputs the connection code in the seventh interface, the first terminal sends a connection request to the interactive flat board. It can be understood that the seventh interface further displays a connection key 12, and after the user inputs the connection code, the user clicks the connection key to make the first terminal send the connection request to the interactive flat board, or, after the user inputs the connection code, the first terminal automatically sends the connection request to the interactive flat board.

And step 112, confirming that the wireless communication connection is established with the first terminal according to the connection request.

The interactive flat board determines the communication address of the first terminal according to the connection request, and establishes connection with the first terminal based on the communication address so as to enable the interactive flat board and the first terminal to conduct data communication. Currently, an established connection refers to a wireless communication connection that utilizes a local area network for communication.

Step 113, after the wireless communication connection is established with the first terminal, the first application is opened, and a first interface of the first application is displayed.

After the interaction panel establishes connection with the first terminal, the interaction panel opens the first application. Optionally, the fourth application may also switch the main interface to an interface for connection control, and currently, the interface for connection control is denoted as a fifth interface, through which the user may send the first data.

And displaying the first interface after the first application is opened. In one embodiment, to facilitate a user reviewing a user interaction process based on the first application, after displaying the first interface of the first application, the method further comprises: and recording the display content of the first interface.

Optionally, the user can set up to open the first application and then automatically record the display content of the first interface according to the actual demand of the user, and then the user can close the recording at any time to ensure that the screen recording function is reasonably used according to the actual demand of the user, wherein the screen recording function refers to the function of recording the display content of the first interface. In one embodiment, in addition to automatically starting the screen recording function, the screen recording function may be started/closed by the user during the display of the first interface. For example, the first interface is displayed with a functional key for starting/closing the screen recording function, when the first interface is displayed, the screen recording function is closed by default, at this time, the user can start the screen recording function through the functional key according to own requirements so as to record the display content of the first interface, and then the user can close or start the screen recording function at any time.

Alternatively, the number of the first terminals may be one or more, when the number of the first terminals is plural, the plural first terminals may each establish a connection with the interactive flat board, and different first terminals may establish a connection in the same or different manners, for example, each first terminal establishes a connection with the interactive flat board by means of a connection code. For another example, a part of the first terminals are connected with the interactive flat board in a connection code manner, and the other part of the first terminals are connected with the interactive flat board in a two-dimension code scanning manner.

Optionally, when the first terminal and the interactive flat board are located in the same local area network, the first terminal and the interactive flat board can communicate by using the local area network after connection is established.

After the interaction panel is connected with the first terminal, the first application is automatically opened, so that the user can clearly and successfully connect the first terminal with the interaction panel, and follow-up operation, such as sending first data by using the first terminal, can be conveniently performed by the user. And through recording the display content of the first interface, the user can review the interaction process, and particularly, the user can conveniently review the conference or teaching content in the conference, teaching and other scenes.

In one embodiment of the application, after the connection between the first terminal and the interactive flat board is established, the user can send the first data to the interactive flat board through the first terminal at any time, and at this time, after the interactive flat board receives the first data, the preview of the first interface can be updated according to the first data so as to ensure the effectiveness of the preview. At this time, after displaying the preview of the first data in the first interface or after displaying the second interface of the second application, further comprising: receiving new first data sent by a first terminal; and adding a preview of the new first data in the first interface.

The new first data is exemplified by the first data received again after the first data has been received, and it is understood that the first data received twice may be transmitted by the same first terminal or may be transmitted by a different first terminal. After receiving the new first data, a preview of the new first data needs to be added to the first interface, and at this time, the preview of the first data received before and the preview of the new first data are displayed in the first interface. The processing mode of the interaction panel on the new first data is the same as the processing mode of the received first data, and is not described in detail at present. Alternatively, when adding the new preview of the first data, the new preview may be arranged after the original preview, or the new preview may be arranged before the original preview.

It should be noted that, after the preview of the first data is displayed in the first interface or after the second interface of the second application is displayed, the new first data is received, which is only used to illustrate that after the first interface is displayed, the user may send the first data at any time. It will be appreciated that when the first interface is not displayed on the screen, such as when the first application is running in the background, the first application may also add a preview of the new first data to the first interface, after which the preview of the new first data is displayed in the first interface when the first interface is displayed.

The user can send the first data for a plurality of times at any time according to the self requirement, and then the preview of the first data is timely displayed in the first interface, so that the user can conveniently determine the receiving condition of the first data and quickly open the first data through the first interface.

In one embodiment of the application, the user can also instruct the interactive flat board to conduct audio and video call through the first terminal. At this time, the interaction implementation method further includes: receiving a second control instruction sent by the first terminal, wherein the second control instruction is used for indicating the interaction panel to carry out audio and video call with at least one second terminal; and displaying a third interface according to the second control instruction, and displaying information of audio and video call with the second terminal on the third interface.

For example, a functional key for triggering an audio-video call is displayed in a fourth application of the first terminal, the functional control is currently recorded as a call key, the call key belongs to an application level key of the fourth application, and the call key can be displayed in a fifth interface. When detecting that the user performs setting operation (such as clicking operation) on the functional key, determining that a second control instruction is received. The second control instruction is used for indicating the interactive flat board to conduct audio and video call. It will be understood that the foregoing references to audio-video call refer to the transmission of video data and audio data local to each terminal using a network, so that each terminal can implement the call.

Optionally, a contact list is also displayed in the fourth application, at least one contact is displayed in the contact list, and how the contact is added in the contact list is not limited currently. And then, the user selects the contact person currently carrying out the audio-video call from the contact person list. And then, the first terminal sends a third control instruction to the selected contact person and sends a second control instruction to the interaction panel. The third control instruction is used for inviting the contact person to conduct audio and video call. Optionally, sending the third control instruction to the contact person mainly sends an invitation instruction to the electronic device used by the contact person, and currently, the electronic device used by the contact person is recorded as a second terminal, and a fourth application is also installed in the second terminal so as to receive and display the third control instruction through the fourth application. In one embodiment, the third control instruction sent by the first terminal further includes related information of the interactive panel, so that the second terminal performs audio/video communication with the interactive panel through the related information. For example, when the first terminal and the interactive flat board are connected through the connection code, the third control instruction sent by the first terminal further includes the connection code, and then the second terminal finds the interactive flat board through the connection code, and realizes audio and video communication with the interactive flat board. For another example, the first terminal writes the same connection code in the third control instruction and the second control instruction, and then the second terminal finds the interactive flat board through the connection code, and realizes audio and video call with the interactive flat board. It will be appreciated that the second terminal may be considered a remote terminal, which communicates with the interactive tablet using a remote network.

The interactive tablet receives the second control instruction and then sends the second control instruction to the first application. And then, the first application starts the audio-video call according to the second control instruction. When the audio and video call is performed, the first application displays an interface for the call, and the displayed interface is currently recorded as a third interface. In the audio-video call process, the second terminal collects the audio data and the video data of the contact person and sends the audio data and the video data to the interaction panel, and then the first application of the interaction panel obtains the video data and displays the video data on the third interface, and plays the audio data through an audio playing device (such as a sound box) of the interaction panel. It will be appreciated that when the number of contacts is high, the third interface may display part of the video data, or only video data playing audio data. Optionally, the first application further instructs the interactive tablet to turn on a video capturing device (such as a camera) and an audio capturing device (such as a microphone) according to the second control instruction, so as to capture local video data and audio data, and then sends the local video data and audio data and video data and audio data of other second terminals to each second terminal. Optionally, the third interface may also display local video data.

Optionally, the third interface also displays a functional key related to the audio-video call, for example, a functional key for "turn on/off microphone" to enable acquisition or turn off acquisition of local audio data. For another example, a functional key for "turn on/off camera" is displayed to enable acquisition or to turn off acquisition of local video data. As another example, a functionality key for "manage contacts" is displayed to enable adding and deleting contacts. And if so, displaying a functional key for ending the call so as to end the audio-video call.

Optionally, the display manner of the third interface is not limited currently, for example, the third interface is a full screen interface, and at this time, the third interface is blocked on the first interface. For another example, the third interface is a floating window interface. The floating window interface is a window floating on the current interface, when the third interface is displayed, a floating window is popped up from the interface currently displayed on the interactive flat panel, and the third interface is displayed in the floating window. The display layer level of the third interface is higher than the currently displayed interface, namely, when a user sends an operation to the position of the third interface, the operation of the third interface is defaulted. Optionally, the size and the position of the floating window are not limited currently, and the floating window has mobility, so that a user can adjust the position of the floating window according to actual requirements. Optionally, when the third interface is a floating window interface, a functional key for controlling the display/hiding of the floating window may be displayed, and the functional key may be located in the floating window or may be an independently displayed functional key, where the independently displayed functional key and the floating window have the same display level. The user may display or hide the third interface by operating the functional keys. Optionally, during audio and video call, the contents such as call duration and the like can be displayed in the third interface or independently of the third interface.

In one embodiment, when the third interface is displayed, the method further includes: and sharing the display content of the first interface to the second terminal.

Illustratively, when a network call is made, the interactive tablet also opens the screen sharing function. After the screen sharing function is started, the first application continuously acquires local screen content (the current screen content is the display content of the first interface) of the interaction panel, and sends the screen content to the second terminal, and then the second terminal displays the screen content of the interaction panel so as to be watched by the contact person of the second terminal. In one embodiment, when the third interface is displayed, a functional key for opening/closing the screen sharing function is also displayed, and the functional key and a functional control for controlling the floating window to be displayed/hidden can be simultaneously displayed and located at the same display level. Then, the user can turn off or turn on the screen sharing function by turning on/off the functional keys of the screen sharing function according to actual demands.

Above-mentioned, the user can also send the second control command to the interactive flat board through first terminal to make interactive flat board and second terminal carry out audio and video conversation, especially in meeting scene, be convenient for carry out audio and video conversation fast, need not to open other application additionally and establish audio and video conversation, and need not the user to walk near interactive flat board and operate. And the third interface for carrying out audio-video call is a floating window interface, which can reduce the shielding of other interfaces at present, and is convenient for the user to continue other operations such as opening the first data in the audio-video call process. And when in audio and video call, the display content of the first interface is shared to the second terminal, so that the contact person of the second terminal can clearly determine the current operation of the user, and the efficiency of the audio and video call is improved.

Taking a conference scene as an example, the first terminal and the interaction panel are located in the same conference room, after the first terminal and the interaction panel are connected in a short-range wireless communication mode, the interaction panel displays a first interface of a first application, a preview of first data sent by the first terminal is displayed in the first interface, the first interface refers to fig. 13, and at this time, a user can select the preview according to own needs to open corresponding first data. The first terminal displays a fifth interface of the fourth application, as shown in fig. 9, in which the talk button 15 is displayed. After detecting that the talk button 15 receives a click operation, the first terminal displays a contact list. The contact list is shown in fig. 15, and then, the user selects a contact for making an audio-video call by operating the contact list. Referring to fig. 15, when the contact list is displayed, a determination button 18 is also displayed, and after the determination button 18 is detected to receive a click operation, a third control instruction is sent to a second terminal used by the contact selected by the user, and a second control instruction is sent to the interactive tablet. At this time, the second terminal used by the contact pops up the invitation command, as shown in fig. 16, and pops up a third control command in a message manner, where the third control command displays a user avatar of the first terminal, a key for receiving the invitation, and a key for refusing the invitation, and when the contact selects to receive the invitation, the second terminal performs an audio/video call with the interactive tablet. And after the interaction panel receives the second control instruction, displaying a third interface in a floating window mode. The third interface is shown in fig. 17, and when the first interface is displayed by the interactive flat panel, the second control instruction is received, and the third interface 25 is displayed in a floating window manner, where the video data of the second terminal and the user head portrait of the local first terminal are displayed. And in the audio and video call process, the interactive flat plate shares the display content of the first interface to the second terminal.

By the method, the second terminal at the far end can be quickly invited to participate in the conference under the conference scene, and the audio and video call between the interaction panel and the second terminal can be established without the need of the user to approach the interaction panel to operate. And the second terminal can display the desktop content of the local interaction tablet, so that the remote contact can clearly and locally operate. In addition, in the audio and video call process, the first data sent by the first terminal can be opened at any time.

In one embodiment of the present application, the first application may open a local application in addition to the first data sent by the first terminal, and open file data stored locally through the local application. Fig. 5 is a flowchart of an interaction implementation method according to an embodiment of the present application, where the interaction implementation method is based on the foregoing, and describes how to open a local application through a first application. Referring to fig. 5, the interaction implementing method includes:

step 210, receiving a third operation, wherein the third operation is used for calling out a system toolbar of the interactive tablet.

The system toolbar is used to indicate system level information or provide system level functionality keys. For example, the system toolbar includes: functional keys for WiFi setting, brightness setting, volume setting, screenshot, photographing, annotating and the like. In one embodiment, the system toolbar also displays application icons for applications installed in the interactive tablet. Optionally, the application icon displayed in the system bar is set by the user, and optionally, the application icon that is most recently used is displayed in the system toolbar. Alternatively, an application icon of an application program of the operating system is displayed in the system toolbar. In one embodiment, a fixed area displaying application icons is set in the system toolbar, and when the number of application icons is large, a part of the application icons may be displayed in the area, and then the user switches the displayed application icons by performing a swipe operation in the area. For example, the application icons are horizontally arranged in the area, and at this time, the user can switch the displayed application icons by left-hand or right-hand strokes.

In one embodiment, the system toolbar may be hidden and presented in a designated display area within the screen when the user invokes the system toolbar. The display area may be set according to practical situations, and in general, the display area is located at an edge of the screen. Currently, an operation of the user calling out the system toolbar is noted as a third operation. The triggering manner of the third operation is not limited currently, for example, when a sliding operation from the screen edge to the inside of the screen is detected and the screen edge is the edge where the system toolbar display area is located, it is determined that the third operation is received. For another example, icons of the system toolbar are displayed in a screen of the interactive tablet, and when the first interface is displayed, the icons of the system toolbar are overlapped on the first interface. Then, when it is detected that the icon receives a setting operation (e.g., a click operation), it is determined that a third operation is received.

Step 220, displaying a system toolbar according to the third operation, wherein the system toolbar comprises at least one application icon.

After the system toolbar is called out, the toolbar is displayed in a screen. At this time, the display level of the system toolbar is higher than the currently displayed interface, i.e., the system toolbar may partially obscure the currently displayed interface.

Optionally, after displaying the system toolbar, the system toolbar may be hidden, for example, when detecting that other areas of the screen other than the system toolbar receive a setting operation (such as a clicking operation), the system toolbar is hidden.

Step 230, receiving a fourth operation, where the fourth operation is used to select a target application icon from the application icons.

After displaying the system toolbar, the user can start the corresponding application program through the application icon in the system toolbar. Currently, an operation of selecting an application icon by a user is denoted as a fourth operation, and a selected application icon is denoted as a target application icon. The triggering manner of the fourth operation is not limited currently, for example, when it is detected that the application icon of the system toolbar receives a setting operation (such as a clicking operation), it is determined that the fourth operation is received, and the application icon that receives the setting operation is determined as the target application icon.

Step 240, hiding the system toolbar, and displaying a fourth interface of a third application on the first interface in an overlapping manner, wherein the third application is an application program corresponding to the target application icon.

In an exemplary manner, according to the fourth operation, the interactive tablet starts the application program corresponding to the target application icon, and currently, the application program corresponding to the target application program is denoted as the third application. After the third application is started, an application interface of the third application is displayed, the application interface of the third application is currently recorded as a fourth interface, and then a user can operate the fourth interface.

Optionally, the display mode of the fourth interface is not limited currently, for example, the fourth interface is a full screen interface, and at this time, the third application is an application program running in the foreground. For another example, the fourth interface is a non-full screen interface, and at this time, the fourth interface is displayed in a windowed manner in a non-full screen manner, that is, a non-full screen window is newly created in the screen and the fourth interface is displayed in the window. In the embodiment, the fourth interface is taken as a non-full screen interface as an example to describe, and the fourth interface is displayed in a superimposed manner on the currently displayed interface. In one embodiment, the first interface is currently displayed, and at this time, the fourth interface is displayed superimposed on the first interface.

Optionally, the system toolbar is hidden when the fourth interface of the third application is displayed. The user may then continue to call out the system toolbar.

Step 250, receiving an insert operation for a third application.

By way of example, the embedding means that a preview of the third application is displayed in the first interface, and an interface for calling the third application is added to the preview, through which the third application can be called, that is, the third application is executed in the foreground. Currently, the operation that triggers the insertion is referred to as an insertion operation. The triggering manner of the implantation operation is not limited currently, for example, when it is detected that the window displaying the fourth interface receives a setting operation (such as a long press operation), it is determined that the implantation operation is received. For another example, an insert operation is received via a functional key for insert.

In one embodiment, the description will be given taking an example of the function key receiving and placing operation for placing, when the fourth interface for displaying the target application icon is superimposed on the first interface, the method further includes: and displaying a second key, wherein the second key and the fourth interface have the same display level, the second key is used for controlling the fourth interface, the second key comprises a second control, and when the second control is triggered, the interactive panel receives the imbedding operation.

Illustratively, the second key refers to a functional key for controlling the fourth interface, and the second key may be one or more. The second key may be a system level key or an application level key of the first application. The second key is taken as a system level key to describe the example, at this time, the second key does not control the display content of the fourth interface, but controls the display mode of the fourth interface, and in one embodiment, when the fourth interface is displayed in a windowed mode and not in a full screen mode, the second key includes a control for full screen display (for displaying the fourth interface in a full screen mode), a control for exiting (for exiting the third application), and a control for placing in. Currently, the control for placement is recorded as a second control, and when a setting operation (such as a clicking operation) acting on the second control is detected, it is determined that the placement operation is received.

And 260, closing the fourth interface in response to the imbedding operation, and adding the preview of the third application in the first interface.

Illustratively, the fourth interface is closed in response to the insert operation, and optionally, the fourth interface may be closed by performing a minimization process on the fourth interface. It will be appreciated that after closing the fourth interface, the interactive tablet resumes displaying the interface before the system bar was invoked, at which point the third application may be considered to be running in the background. And when the fourth interface is closed, adding a preview of the third application in the first interface so that the fourth interface can be redisplayed through the preview of the third application.

When generating the preview of the third application, the preview may be obtained by taking an application icon of the third application as the preview or by capturing a screen of the fourth interface. In one embodiment, describing the preview generated after the fourth interface is captured by way of example, step 260 includes steps 261-262:

and 261, closing the fourth interface in response to the imbedding operation, and capturing the fourth interface, wherein the obtained captured image is used as a preview of the third application.

And closing the fourth interface after receiving the imbedding operation, and capturing a screenshot of the fourth interface to obtain a screenshot image, and adding a hyperlink pointing to the third application (namely calling the interface of the third application) for the preview image to obtain the preview image of the third application. Optionally, the screenshot image may also be compressed to generate a preview.

Step 262, adding and displaying the preview in the first interface.

Illustratively, the preview of the third application is sent to the first application. The first application adds the preview to the first interface after receiving the preview. When the first interface is displayed, displaying a preview of the third application, and then, a user can realize that the third application is operated in the foreground by selecting the preview of the third application, and displaying a fourth interface of the third application.

After the system toolbar is called out, the application icons in the interactive tablet are displayed in the system toolbar, and then the user can quickly start the application program by selecting the application icons without closing the current application program. And then, the application program of the interactive flat plate can be put into the first application, namely, a preview image of the application program is displayed in the first interface, and further, the application program is quickly called out to run in the foreground based on the preview image, so that the link of application program switching in the first terminal is simplified. And the process of generating the preview image by the mode of the interface screenshot of the application program is simple and convenient to realize.

Next, taking a conference scene as an example, a procedure of putting a preview of the third application is described. At this time, the first terminal and the interactive flat panel are located in the same conference room, and after the first terminal and the interactive flat panel establish a connection for short-range wireless communication, the interactive flat panel displays a first interface of the first application, where the first interface is shown in fig. 13, and displays a preview of first data sent by the first terminal. Thereafter, the interactive flat panel calls out the system toolbar through the third operation, referring to fig. 18, when the interactive flat panel displays the first interface, the system toolbar is called out and displayed on the left side of the screen (in the view of the user), at this time, the system toolbar may also be marked as a sidebar, and when the user selects one of the application icons, the application icon 26 is displayed in the system toolbar, and a fourth interface corresponding to the application icon is displayed in a window manner. Referring to fig. 19, currently, the fourth interface is not displayed full screen, and a key 27 for full screen display, a key 28 for put in, and a key 29 for exit are displayed. When it is detected that the key 28 receives the click operation, it is determined that the insert operation is received, the interactive tablet closes the fourth interface, and captures a screen of the fourth interface to generate a corresponding preview, and adds the preview to the first interface. At this time, the first interface is changed to fig. 20 as shown in fig. 13, and a preview of a fourth interface (i.e., a third application) is added to the first interface with reference to fig. 20. And after clicking the preview image of the fourth interface, the interactive flat opens the third application and displays the fourth interface.

By the method, the application program of the interaction panel can be quickly started in the conference scene, and the local application program can be quickly switched to the foreground operation after being switched to the background operation by displaying the preview image on the first interface.

In one embodiment of the present application, in order to facilitate the user to review the interaction process with the interaction tablet, the method for implementing interaction further includes: receiving an exit operation for the first application; responding to the exit operation, acquiring second data, wherein the second data comprises at least one of first data, screen recording data obtained when the first application is operated, local file data opened or generated when the first application is operated or a preview of the local file data; uploading the second data to a server for the first terminal to download the second data from the server; the first application is closed.

The exit operation is an operation for triggering to close the first application, and the user can send out the exit operation through the first terminal or the interaction panel. In one embodiment, the method of triggering the exit operation is not limited currently, for example, when the first application runs in the foreground, the interactive panel displays the relevant interface of the first application (for example, displays the first interface) and displays the functional key for receiving the exit operation in the relevant interface, and currently, the functional key for receiving the exit operation is recorded as the exit key, and the display position of the exit key is not limited currently. Optionally, the exit button is an application level control of the first application and has the same display level as the first interface. When it is detected that the exit button receives a setting operation (such as a click operation), it is determined that the exit operation is received. For another example, when it is detected that a setting operation (such as a long press operation) is received in a setting area of a related interface of the first application, it is determined that an exit operation is received, where the setting area is an area in the related interface, and a specific area position is not limited currently.

After the exit operation is received, the first application is determined to be closed, in one embodiment, before the first application is closed, the first application or the operating system of the interactive panel can acquire data related to the current running process of the first application, and the data related to the current running process of the first application is currently recorded as second data. When the first terminal uploads the first data to the interactive tablet, the second data comprises the first data, and optionally, the first data mainly refers to file data. If the first interface of the first application is displayed, recording the display content of the first interface, wherein the second data comprises data obtained after screen recording, and when the data obtained after screen recording is recorded as screen recording data, it can be understood that after receiving the exit operation, the first application stops recording the local screen content and generates the screen recording data. When the first application runs, the interaction panel opens the locally stored file data through the third application or generates the locally stored file data through the third application, and the first application also takes the locally stored file data as second data. Optionally, if the local file data is third party data, the preview of the file data is taken as second data, and if the local file data is non-third party data, the file data is taken as second data. It can be understood that the third party data refers to data generated or opened by the third party application program, and the first application cannot determine file data opened or generated in the running process of the third party application program. The non-third data refers to data generated or opened by a non-third party application program, and the first application can definitely determine file data opened or generated in the running process of the non-third party application program. For example, a whiteboard application is installed in the interactive tablet, which is a non-third party application. In the running process of the first application, the whiteboard application is opened through the operation of the user, then the user writes in the whiteboard application, whiteboard data which is not third-party data are generated, and at the moment, the first application takes the whiteboard data as second data. Based on the above description, the second data includes: at least one of the first data, the screen recording data, the file data opened or generated in the process of running the first application, or the preview of the file data. And if the first application relates to a plurality of second data when the first application is operated, acquiring the plurality of second data.

Illustratively, after the second data is obtained, the second data is saved. Optionally, the second data is stored in the interaction tablet and/or in the server, in one embodiment, in order to relieve the storage pressure of the interaction tablet. At this time, the first terminal may query the second data through the server and download the second data. It should be noted that, in addition to the first terminal, other electronic devices may download the second data from the server.

Alternatively, a save prompt may pop up before saving the second data, after which the user selects whether to save the second data. Optionally, when the saving prompt is popped up, the second data is displayed in the saving prompt, then the user can select or cancel selecting the second data in the saving prompt, and then the interactive tablet saves the selected second data in the server.

Illustratively, after uploading the second data to the server, the interactive tablet closes the first application. Optionally, when the first application is closed, the connection between the first terminal and the interactive flat panel is disconnected. And when the first terminal has a connection requirement, the connection with the interaction panel can be established again, so that the interaction panel opens the first application.

For example, currently, taking a conference scenario as an example, the first terminal and the interactive flat panel establish a short-distance wireless communication connection, when the conference is finished, a first interface displayed by the interactive flat panel is shown in fig. 20, when the user clicks the second key 21, the interactive flat panel displays a prompt on the first interface whether to finish the conference, when the user selects to finish the conference, the second data used in the conference process is packaged and uploaded to the server, and the first application is closed. At this time, the user can acquire data in the server through the first terminal. For example, the user queries the second data participating in the conference through the first terminal, and at this time, the package name of the second data is displayed in the main interface of the first terminal, for example, "conference collaboration" shown in fig. 7 is the package name of the second data of a certain conference. When the user selects the package name, the first terminal displays a list of the second data. For example, fig. 21 shows three pieces of second data packed in a certain meeting, at which time the user can select the second data for downloading.

When the exit operation is received, the second data is stored in the server and the first application is exited, so that the second data related in the running process of the first application can be uniformly stored and automatically uploaded, the operation of a user is simplified, the storage path is simplified, the second data is only required to be uploaded to the server, the first terminal can check all the second data in the server, and the operation of the user is simplified because each second data is not required to be searched respectively.

The embodiment of the application also provides an interaction implementation method which is applied to the interaction implementation system, wherein the interaction implementation system comprises at least one first terminal and an interaction panel. Fig. 6 is a flowchart of an interaction implementation method according to an embodiment of the present application, and referring to fig. 6, when the interaction implementation system executes the interaction implementation method, the method includes:

step 310, the first terminal establishes a wireless communication connection with the interactive tablet.

Wherein the wireless communication may be selected to be a short-range wireless communication.

Step 320, the interactive flat panel displays a first interface of the first application.

Illustratively, after the communication connection is established, the interactive tablet opens the first application and displays the first interface.

Step 330, the first terminal displays a fifth interface of the fourth application.

The fourth application is an application program installed on the first terminal, and corresponds to the first application of the interactive tablet. The fifth interface is an application interface displayed in the fourth application running process, and after the interaction panel is connected with the first terminal, the fourth application displays the fifth interface. The display content of the fifth interface is not currently limited. In one embodiment, the fifth interface displays a file sending button and a screen throwing button, wherein the file sending button is used for triggering a function of sending file data to the interactive flat panel, and the screen throwing button is used for triggering a function of sending screen throwing data to the interactive flat panel. Optionally, the fifth interface further displays a talk button and a join button, where the talk button is used to invite the other second terminal to perform an audio/video call with the interactive tablet, and at this time, the first terminal is used as an initiator, and the second terminal is used as a joining party. The joining key is used for joining the audio and video call initiated by other terminals. The fifth interface may also display other functional keys, not currently limited.

Step 340, the first terminal receives a fifth operation in the fifth interface.

Currently, a fifth operation is to select whether to transmit file data or screen-cast data. In one embodiment, when the fifth interface displays the file sending button and the screen-drop button, if it is detected that the file sending button receives a setting operation (such as a clicking operation), it is determined that a fifth operation is received, and the fifth operation is used for selecting to send file data. If the screen throwing key is detected to receive the setting operation (such as a clicking operation), a fifth operation is determined to be received, and the fifth operation is used for selecting to send the screen throwing data. Thereafter, step 350 is performed.

Step 350, determining that the fifth operation is used for selecting to send the file data, sending the local file data to the interactive flat-panel by the first terminal according to the fifth operation, determining that the fifth operation is used for selecting to send the screen-throwing data, and uploading the local screen-throwing data to the interactive flat-panel by the first terminal.

The third selection operation is for sending the file data stored locally to the interactive pad, for example, when the file data is selected to be sent. Optionally, when sending the file data, the user may select the file data to be uploaded in the interactive tablet, and in one embodiment, step 350 includes steps 351-353:

Step 351, when determining that the fifth operation is used for selecting to send the file data, the first terminal switches the fifth interface of the fourth application to the sixth interface of the fourth application, and the local file data is displayed in the sixth interface.

In an exemplary embodiment, when the fifth operation is used for selecting to send the file data, the fifth interface is first switched to the sixth interface, where the sixth interface is a file selection interface, and the sixth interface displays the file data that can be uploaded, so that the user selects the file data under the interface. Currently, an operation of selecting file data in the sixth interface by the user is referred to as a seventh operation. The presentation manner and arrangement order of the file data in the sixth interface are not limited at present, for example, a preview of the file data is displayed in the sixth interface, and the file data is arranged according to the latest opening time of the file data.

Step 352, the first terminal receives a seventh operation acting on the sixth interface, where the seventh operation is used to select file data.

Optionally, each file data in the sixth interface has a corresponding selection identifier, where the selection identifier may show whether the file data is selected, and selecting or deselecting the file data may be implemented by a user clicking the selection identifier. Thereafter, the fourth application determines the selected file data by selecting the identification.

Step 353, the first terminal sends the selected file data to the interactive pad.

In one embodiment, when the fifth operation is determined to be used for selecting to send the screen projection data, the fourth application of the first terminal obtains the screen projection data of the first terminal and sends the screen projection data to the first terminal. In one embodiment, in order to facilitate the user to explicitly and successfully screen, when the first terminal uploads the local screen-projection data to the interactive tablet, the method further includes: and displaying a screen projection prompt. Optionally, the display content of the screen projection prompt is not limited currently, for example, the screen projection identifier and the screen projection time are displayed in the screen projection prompt. Optionally, the screen projection prompt is displayed in a popup window mode, or the screen projection prompt is replaced with the current fifth interface in an interface mode.

Step 360, the interactive tablet displays a preview of the first data in the first interface, where the first data includes file data or screen-drop data.

Step 370, the interactive tablet receives a first operation for selecting a target preview from among the preview images.

Step 380, the interactive flat panel displays a second interface of a second application, where the second application is an application program for opening the first data corresponding to the target preview.

Step 390, the interactive tablet receives a second operation for a second interface.

Step 3100, the interactive tablet closes the second interface according to the second operation, and resumes displaying the first interface.

After the wireless communication connection is established between the first terminal and the interactive flat panel, the user can send the file data or the screen throwing data to the interactive flat panel through the fifth operation in the fourth application, so that the first application of the interactive flat panel adds the preview of the file data or the screen throwing data to the first interface, the file data or the screen throwing data can be conveniently and rapidly opened through the preview, and the operation of opening the first data in the interactive flat panel by the user is simplified.

In one embodiment of the application, the first terminal can also select the target preview in the first interface to remotely control the interactive tablet to open a corresponding second interface. At this time, the interaction implementation method executed by the interaction implementation system further includes: the method comprises the steps that a first terminal receives a first control operation, wherein the first control operation is used for indicating an interaction panel to open a target preview; the first terminal sends a first control instruction to the interaction panel according to the first control operation; and the interaction panel displays a second interface of the second application according to the first control instruction.

The fourth application installed in the first terminal further has a function of selecting a target preview, and currently, the operation of selecting the target preview by the user through the fourth application may be considered as a first control operation, after the first control operation is completed, the first terminal generates a first control instruction and sends the first control instruction to the interactive tablet, and then the interactive tablet opens the second interface according to the first control instruction.

In one embodiment of the present application, the first terminal may further instruct the interactive pad to perform an audio/video call with the second terminal. At this time, after the first terminal receives the fifth operation in the fifth interface, the method further includes: the fifth operation is used for displaying a contact list by the first terminal when the audio-video call is selected; the first terminal receives a sixth operation, wherein the sixth operation is used for selecting at least one contact in the contact list; and the first terminal sends a third control instruction to at least one second terminal according to the sixth operation, and sends a second control instruction to the interaction panel so as to enable the second terminal to conduct audio and video conversation with the interaction panel, wherein the second terminal is a terminal used by a contact person.

The fifth interface also displays a talk button, which is used to instruct the interactive pad to perform an audio/video call with the second terminal. When the call key is detected to receive a setting operation (such as a clicking operation), it is determined that a fifth operation is received and is used for selecting an audio-video call. And then, the first terminal displays a contact list, and contacts capable of carrying out audio and video call are recorded in the contact list. For example, the user may select a contact currently engaged in an audio-video call from the contact list, and the operation of selecting the contact by the user is currently referred to as a sixth operation. Optionally, the names and avatars of the contacts are displayed in the contact list, and a selection identifier is also displayed, which may show whether the contacts are selected. The operation mode of the user for the selection identifier is similar to the operation mode of the user for the selection identifier of the file data, and is not described in detail at present. After the user selects to finish, the first terminal sends a third control instruction to a second terminal used by the contact person, and sends a second control instruction to the interactive flat board, and then the interactive flat board starts the audio-video call function through the call instruction, and the second terminal realizes the audio-video call with the interactive flat board through the invitation instruction.

By means of the method, the first terminal can invite the remote second terminal to conduct audio and video call with the local interaction panel, and functions of the first application and the fourth application are enriched.

For example, taking a conference scenario as an example, the first terminal and the interactive tablet are located in the same conference room, after the first terminal and the interactive tablet establish a connection for short-range wireless communication, the first terminal displays a fifth interface of the fourth application, where the fifth interface is shown in fig. 9, and the fifth interface displays a screen projection button 13, a file sending button 14, a talk button 15, and buttons for implementing other functions. At this time, the interactive pad opens the first application and displays a first interface, which is shown in fig. 10.

And then, when the user selects the screen projection button 13 in the fifth interface, the fourth application acquires the screen projection data of the first terminal and sends the screen projection data to the interaction panel. At this time, a screen projection prompt is displayed in the first terminal. Currently, the screen projection prompt is presented in an interface mode, and at this time, the screen projection prompt is shown in fig. 11, and includes a key 16 for stopping screen projection, and also displays contents such as screen projection duration and the like.

When the user selects the file transmission key 14 in the fifth interface, the fourth application enters the sixth interface, and the contents such as a preview, a name, and the like of file data that can be selected are displayed in the sixth interface. The sixth interface is shown in fig. 12, and each file data further has a corresponding selection identifier 17, and the user can select the file data by operating the selection identifier. The sixth interface also displays a determination key, when the determination key is detected to be clicked, the file data selected currently is sent to the first terminal, and then the sixth interface is restored to the fifth interface. Optionally, the sixth interface further displays a selected number of file data.

In addition, the user may click the talk button 15 in the fifth interface, and then the first terminal displays a contact list according to the operation of the user, so that the user selects a contact in the contact list, and then sends a third control instruction to a second terminal used by the contact, and sends a second control instruction to the interactive tablet, so as to implement audio and video talk between the local user and the remote user in the conference scene.

It can be understood that technical details which are not described when the interactive implementation system executes the interactive implementation method can refer to technical details when the interactive implementation method is executed by the interactive tablet, and the interactive implementation system has corresponding functions and beneficial effects.

Fig. 22 is a schematic structural diagram of an interaction implementation device according to an embodiment of the present application. The interaction realizing apparatus is applied in an interaction tablet, referring to fig. 22, the interaction realizing apparatus includes: the first display unit 410, the first receiving unit 420, the second display unit 430, the second receiving unit 440, the third display unit 450, the third receiving unit 460, and the fourth display unit 470.

The first display unit 410 is configured to display a first interface of a first application; the first receiving unit 420 is configured to receive first data sent by at least one first terminal, where the first data includes file data or screen projection data, and the first terminal communicates with the interactive tablet through a wireless communication manner; a second display unit 430 for displaying a preview of each first data in the first interface; a second receiving unit 440 for receiving a first operation for selecting a target preview image among the preview images; a third display unit 450, configured to display a second interface of a second application, where the second application is an application program for opening first data corresponding to the target preview; a third receiving unit 460 for receiving a second operation for the second interface; and the fourth display unit 470 is configured to close the second interface according to the second operation, and resume displaying the first interface.

On the basis of the above embodiment, the fourth display unit 470 is specifically configured to: and closing the second interface according to the second operation, restoring to display the first interface, and updating the target preview.

On the basis of the above embodiment, the fourth display unit 470, when updating the target preview image, includes: the content acquisition subunit is used for acquiring the display content when the second interface is closed; and the first preview generation subunit is used for generating a first preview according to the display content and updating the target preview into the first preview.

On the basis of the above embodiment, the second application is a whiteboard application, and the apparatus further includes: and the first response unit is used for receiving writing operation in the second interface after the second interface of the second application is displayed, and generating corresponding writing handwriting in the second interface according to the writing operation. Alternatively, the second application is a file presentation application, and the apparatus further includes: and the second response unit is used for receiving file display operation in the second interface after displaying the second interface of the second application, and displaying corresponding file display results on the second interface according to the file display operation. Alternatively, the second application is a projection application, and the apparatus further includes: and the third response unit is used for receiving the real-time screen projection data sent by the first terminal after displaying the second interface of the second application, and displaying the real-time screen projection data in the second interface.

On the basis of the above embodiment, the method further comprises: the fourth receiving unit is used for receiving a first control instruction sent by the first terminal after the preview images of the first data are displayed in the first interface, and the first control instruction is used for indicating the interaction panel to open the target preview image; and the fifth display unit is used for displaying a second interface of the second application according to the first control instruction.

On the basis of the above embodiment, the arrangement rule of the preview images in the first interface is determined by the number of preview images.

On the basis of the above embodiment, the second interface is a full screen interface, and the third display unit 450 is specifically configured to: and displaying a second interface of a second application, and displaying a first key on the second interface, wherein the display layer level of the first key is higher than that of the second interface, the first key comprises a first control, and when the first control is triggered, the interaction panel receives a second operation, and the second application is an application program for opening first data corresponding to a target preview.

On the basis of the above embodiment, the apparatus further includes: the fifth receiving unit is used for receiving a second control instruction sent by the first terminal, and the second control instruction is used for indicating the interaction panel to carry out audio and video conversation with at least one second terminal; and the sixth display unit is used for displaying a third interface according to the second control instruction and displaying information of audio and video call with the second terminal on the third interface.

On the basis of the embodiment, the third interface is a floating window interface.

On the basis of the above embodiment, the sixth display unit, when displaying the third interface, is further configured to: and sharing the display content of the first interface to the second terminal.

On the basis of the above embodiment, the first display unit 410 includes: a request receiving subunit, configured to receive a connection request sent by a first terminal; a connection establishment subunit, configured to confirm, according to the connection request, establishment of wireless communication connection with the first terminal; and the application opening subunit is used for opening the first application after the wireless communication connection is established with the first terminal and displaying a first interface of the first application.

On the basis of the above embodiment, the apparatus further includes: and the recording unit is used for displaying a first interface of the first application and recording the display content of the first interface.

On the basis of the above embodiment, the apparatus further includes: a sixth receiving unit for receiving a third operation for calling out a system toolbar of the interactive tablet; a seventh display unit for displaying a system toolbar according to the third operation, the system toolbar including at least one application icon; a seventh receiving unit configured to receive a fourth operation for selecting a target application icon from among the application icons; and the eighth display unit is used for hiding the system toolbar, and displaying a fourth interface of a third application on the first interface in a superposition way, wherein the third application is an application program corresponding to the target application icon.

On the basis of the above embodiment, the apparatus further includes: an eighth receiving unit, configured to receive an embedding operation for the third application after displaying a fourth interface of the third application on the first interface in a superimposed manner; and the first closing unit is used for closing the fourth interface in response to the imbedding operation and adding the preview of the third application in the first interface.

On the basis of the above embodiment, the eighth display unit is configured to display a second key when the fourth interface of the third application is displayed on the first interface in a superimposed manner, where the second key has the same display level as the fourth interface, the second key is configured to control the fourth interface, the second key includes a second control, and when the second control is triggered, the interactive panel receives an insert operation.

On the basis of the above embodiment, the first closing unit includes: the screenshot subunit is used for responding to the imbedding operation, closing the fourth interface, performing screenshot on the fourth interface and taking the obtained screenshot image as a preview image of the third application; and the adding subunit is used for adding and displaying the preview image in the first interface.

On the basis of the above embodiment, the second display unit 430 includes: a content acquisition subunit, configured to acquire data content of the first data; a preview generation subunit, configured to generate a preview of the first data according to the data content; and the preview image sending subunit is used for sending the preview image to the first application, and after the first application receives the preview image, the preview image is displayed on the first interface.

On the basis of the above embodiment, the apparatus further includes: a ninth receiving unit configured to receive an exit operation for the first application; the data acquisition unit is used for responding to the exit operation, acquiring second data, wherein the second data comprises at least one of first data, screen recording data obtained when the first application is operated, local file data opened or generated when the first application is operated or a preview image of the local file data; the data uploading unit is used for uploading the second data to the server so that the first terminal can download the second data from the server; and the second closing unit is used for closing the first application.

The interaction realizing device provided by the embodiment of the application is contained in the interaction panel, can be used for executing any interaction realizing method provided by the embodiment, and has corresponding functions and beneficial effects.

It should be noted that, in the embodiment of the interaction implementation apparatus, each unit and module included are only divided according to the functional logic, but not limited to the above division, so long as the corresponding function can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present application.

Fig. 23 is a schematic structural diagram of an interactive tablet according to an embodiment of the present application. As shown in fig. 23, the interactive tablet includes a processor 50, a memory 51, an input device 52, an output device 53, a display 54, and a communication device 55; the number of processors 50 in the interactive tablet may be one or more, one processor 50 being taken as an example in fig. 23; the processor 50, memory 51, input device 52, output device 53, display 54, and communication device 55 in the interactive tablet may be connected by a bus or other means, for example by a bus connection in fig. 23.

The memory 51 is used as a computer readable storage medium, and may be used to store a software program, a computer executable program, and modules, such as program instructions/modules corresponding to an interaction implementation method performed by an interaction panel in an embodiment of the present application (for example, the first display unit 410, the first receiving unit 420, the second display unit 430, the second receiving unit 440, the third display unit 450, the third receiving unit 460, and the fourth display unit 470 in the interaction implementation apparatus). The processor 50 executes various functional applications of the interactive tablet and data processing, i.e. implements the interactive implementation method described above, by running software programs, instructions and modules stored in the memory 51.

The memory 51 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for functions; the storage data area may store data created from the use of the interactive pad, etc. In addition, memory 51 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 51 may further include memory remotely located with respect to processor 50, which may be connected to the interactive tablet through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input device 52 may be used to receive entered numeric or character information and to generate key signal inputs related to user settings and function control of the interactive pad. The output means 53 may comprise an audio playing means or the like. The display 54 may be a display screen with touch functionality, which may be a capacitive screen, a resistive screen, an infrared screen, and/or an electromagnetic screen, and the display 54 displays, such as a first interface displaying a first application, etc., according to the instructions of the processor 50. The communication means 55 are for enabling communication functions such as establishing a wireless communication connection with the first terminal.

The interactive flat board comprises an interactive realization device, can be used for executing an interactive realization method, and has corresponding functions and beneficial effects.

The embodiments of the present application also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the relevant operations in the interaction implementation method provided in any embodiment of the present application, and have corresponding functions and beneficial effects.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product.

Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.

Note that the above is only a preferred embodiment of the present application and the technical principle applied. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, while the application has been described in connection with the above embodiments, the application is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the application, which is set forth in the following claims.

Claims

An interaction implementation method is applied to an interaction panel, and comprises the following steps:

displaying a first interface of a first application;

receiving first data sent by at least one first terminal, wherein the first data comprises file data or screen projection data, and the first terminal and the interaction panel communicate in a wireless communication mode;

displaying a preview of each first data in the first interface;

receiving a first operation, wherein the first operation is used for selecting a target preview image in each preview image;

displaying a second interface of a second application, wherein the second application is an application program for opening the first data corresponding to the target preview;

receiving a second operation for the second interface;

and closing the second interface according to the second operation, and restoring to display the first interface.
The interaction implementation method of claim 1, wherein after the first interface is restored to be displayed, further comprising:

and updating the target preview.
The interaction implementation method of claim 2, wherein the updating the target preview comprises:

acquiring display content when the second interface is closed;

And generating a first preview according to the display content, and updating the target preview into the first preview.
The interaction implementation method of claim 1, wherein the second application is a whiteboard application, and after the displaying the second interface of the second application, further comprises:

receiving writing operation in the second interface, and generating corresponding writing handwriting in the second interface according to the writing operation; or alternatively, the first and second heat exchangers may be,

the second application is a file display application, and after the second interface of the second application is displayed, the method further includes:

receiving file display operation in the second interface, and displaying corresponding file display results in the second interface according to the file display operation; or alternatively, the first and second heat exchangers may be,

the second application is a screen-throwing application, and after the second interface of the second application is displayed, the method further includes:

and receiving real-time screen projection data sent by the first terminal, and displaying the real-time screen projection data in the second interface.
The interaction implementation method of claim 1, wherein after displaying the preview of each of the first data in the first interface, further comprising:

receiving a first control instruction sent by the first terminal, wherein the first control instruction is used for indicating the interaction panel to open a target preview;

And displaying the second interface of the second application according to the first control instruction.
The interaction implementation of claim 1, wherein an arrangement rule of the preview in the first interface is determined by a number of the preview.
The interaction implementation method of claim 1, wherein the second interface is a full screen interface;

the second interface for displaying the second application specifically comprises the following steps:

displaying a second interface of a second application, and displaying a first key on the second interface, wherein the display layer level of the first key is higher than that of the second interface, the first key comprises a first control, and when the first control is triggered, the interaction panel receives the second operation.
The interaction implementation method of claim 1, further comprising:

receiving a second control instruction sent by the first terminal, wherein the second control instruction is used for indicating the interaction panel to carry out audio and video call with at least one second terminal;

and displaying a third interface according to the second control instruction, and displaying information of audio and video call with the second terminal on the third interface.
The interaction implementation method of claim 8, wherein the third interface is a floating window interface.
The interaction implementation method of claim 8, wherein when the third interface is displayed, further comprising:

and sharing the display content of the first interface to the second terminal.
The interaction implementation method of claim 1, wherein the displaying the first interface of the first application includes:

receiving a connection request sent by a first terminal;

confirming that wireless communication connection is established with the first terminal according to the connection request;

and after the wireless communication connection is established with the first terminal, opening a first application and displaying a first interface of the first application.
The interaction implementation method of claim 11, wherein after the displaying the first interface of the first application, further comprising:

and recording the display content of the first interface.
The interaction implementation method of claim 1, further comprising:

receiving a third operation, wherein the third operation is used for calling out a system toolbar of the interactive tablet;

displaying the system toolbar according to the third operation, wherein the system toolbar comprises at least one application icon;

receiving a fourth operation, wherein the fourth operation is used for selecting a target application icon in the application icons;

Hiding the system toolbar, and superposing and displaying a fourth interface of a third application on the first interface, wherein the third application is an application program corresponding to a target application icon.
The interaction implementation method of claim 13, wherein after the fourth interface of the third application is displayed superimposed on the first interface, further comprising:

receiving an imbedding operation for the third application;

and closing the fourth interface in response to the imbedding operation, and adding a preview of the third application in the first interface.
The interaction implementation method of claim 14, wherein when the fourth interface of the third application is displayed superimposed on the first interface, further comprising:

and displaying a second key, wherein the second key and the fourth interface have the same display level, the second key is used for controlling the fourth interface, the second key comprises a second control, and when the second control is triggered, the interactive panel receives the placement operation.
The interaction implementation method of claim 14, wherein the closing the fourth interface and adding the preview of the third application in the first interface in response to the put operation includes:

Closing the fourth interface in response to the placement operation, capturing a screenshot of the fourth interface, and taking the obtained screenshot image as a preview image corresponding to the third application;

and adding and displaying the preview image in the first interface.
The interaction implementation method of claim 1, wherein the displaying, in the first interface, a preview of each of the first data includes:

acquiring the data content of the first data;

generating a preview of the first data according to the data content;

and sending the preview to the first application, and displaying the preview on the first interface after the first application receives the preview.
The interaction implementation method of claim 1, further comprising:

receiving an exit operation for the first application;

responding to the exit operation, acquiring second data, wherein the second data comprises at least one of the first data, screen recording data obtained when the first application is operated, local file data opened or generated when the first application is operated or a preview of the local file data;

uploading the second data to a server so that the first terminal downloads the second data from the server;

Closing the first application.
An interaction implementation method is applied to an interaction implementation system, and the interaction implementation system comprises an interaction panel and at least one first terminal; the interaction implementation method comprises the following steps:

the first terminal establishes wireless communication connection with the interaction panel;

the interactive flat panel displays a first interface of a first application;

the first terminal displays a fifth interface of a fourth application;

the first terminal receives a fifth operation in the fifth interface;

determining that the fifth operation is used for selecting to send file data, the first terminal sending the local file data to an interactive panel according to the fifth operation, determining that the fifth operation is used for selecting to send screen throwing data, and uploading the local screen throwing data to the interactive panel by the first terminal;

the interaction panel displays a preview of the first data in the first interface, wherein the first data comprises the file data or the screen projection data;

the interaction panel receives a first operation, wherein the first operation is used for selecting a target preview image in each preview image;

the interaction panel displays a second interface of a second application, wherein the second application is an application program for opening the first data corresponding to the target preview;

The interactive tablet receives a second operation for the second interface;

and closing the second interface by the interactive flat plate according to the second operation, and recovering to display the first interface.
The interaction implementation method of claim 19, further comprising:

the first terminal receives a first control operation, wherein the first control operation is used for indicating the interaction panel to open a target preview;

the first terminal sends a first control instruction to the interaction panel according to the first control operation;

and the interaction panel displays the second interface of the second application according to the first control instruction.
The interaction implementation method of claim 19, wherein after the first terminal receives a fifth operation in the fifth interface, further comprising:

determining that the fifth operation is used for selecting audio and video call, and displaying a contact list by the first terminal;

the first terminal receives a sixth operation, wherein the sixth operation is used for selecting at least one contact in the contact list;

and the first terminal sends a third control instruction to at least one second terminal according to the sixth operation, and sends a second control instruction to the interaction panel so as to enable the second terminal to carry out audio and video communication with the interaction panel, wherein the second terminal is a terminal used by the contact person.
An interaction implementation apparatus, applied to an interaction tablet, comprising:

the first display unit is used for displaying a first interface of the first application;

the first receiving unit is used for receiving first data sent by at least one first terminal, wherein the first data comprise file data or screen projection data, and the first terminal and the interaction panel are communicated in a wireless communication mode;

the second display unit is used for displaying preview images of the first data in the first interface;

a second receiving unit configured to receive a first operation for selecting a target preview image among the preview images;

the third display unit is used for displaying a second interface of a second application, wherein the second application is an application program for opening the first data corresponding to the target preview;

a third receiving unit configured to receive a second operation for the second interface;

and the fourth display unit is used for closing the second interface according to the second operation and restoring to display the first interface.
An interactive tablet, comprising:

one or more processors;

a display for displaying according to the instruction of the processor;

A communication module for wireless communication with at least one first terminal;

a memory for storing one or more programs;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the interaction implementation method of any of claims 1-18.
A computer readable storage medium having stored thereon a computer program, wherein the program when executed by a processor implements the interaction implementation method of any of claims 1-18.