WO2023024800A1

WO2023024800A1 - Web-based interaction method and system for multiple terminal devices, and terminal device

Info

Publication number: WO2023024800A1
Application number: PCT/CN2022/108027
Authority: WO
Inventors: 宋晨阳
Original assignee: 京东方科技集团股份有限公司; 重庆京东方智慧科技有限公司
Priority date: 2021-08-27
Filing date: 2022-07-26
Publication date: 2023-03-02
Also published as: CN113709541A

Abstract

The present disclosure relates to a WEB-based interaction method and system for multiple terminal devices, and a terminal device. The device comprises: a platform module, an application module and a communication module, wherein the platform module is used for providing a platform which supports the running of a WEB application; the communication module is used for transmitting shared data information; and the application module is used for loading the WEB application so as to render and display the data information. In the embodiment, the running of a WEB application can be supported by a platform module, and the WEB application is rendered and displayed by an application module, such that the WEB application can be run as a local application, without needing to rely on an external storage device nor needing to provide an insert, thus lowering the requirement for a terminal device, and achieving the effect of being able to use the WEB application without needing to install an application program in advance, thereby facilitating the improvement of the convenience of an operation and the usage experience.

Description

WEB-based multi-terminal device interaction method, system, and terminal device

technical field

The present disclosure relates to the field of control technology, and in particular to a WEB-based multi-terminal device interaction method, system, and terminal device.

Background technique

With the rapid development of the mobile Internet industry, smart terminals have also been widely used, such as smart TVs, smart accessories, smart phones, etc. Users can use the above-mentioned smart terminals to realize multi-terminal interconnection, such as video calls, multi-screen interaction, or online karaoke, etc., which improves the user experience.

Among them, multi-terminal interaction refers to the use of different operating systems (such as IOS, Android, Win7, etc.) terminal devices (such as smart phones, smart tablets, computers, TVs, etc.) Audio, picture, etc.) content transmission and sharing; at the same time, the content of different screens can be synchronized to meet the needs of different scenarios.

In practical applications, corresponding applications need to be preset in each terminal device to realize multi-terminal interaction, thereby reducing user experience.

Contents of the invention

The present disclosure provides a WEB-based multi-terminal device interaction method, system, and terminal device to solve the deficiencies of related technologies.

According to a first aspect of an embodiment of the present disclosure, a terminal device is provided, including a platform module, an application module, and a communication module;

The platform module is used to provide a platform supporting WEB application operation; the platform includes at least one of the following: operating system, browser or browser engine;

The communication module is used to transmit shared data information;

The application module is used to load a WEB application to render and display the data information.

Optionally, the platform module includes:

The WEB application management unit is used to be responsible for packaging and managing the WEB application, so that the WEB application runs in the mode of local application;

The WEB application loading unit is used to load the WEB application for rendering and displaying in the local platform;

The Websocket server unit is used to transmit data information to each terminal device.

Optionally, the WEB application loading unit includes a browser kernel, and is updated as the browser kernel is upgraded.

Optionally, the application modules include:

The two-dimensional code management unit is used to present the URL address of the WEB application in the form of two-dimensional code;

File management unit, used to read or push local files;

The communication unit is used to establish a Websocket data transmission channel with the server using the HTML5 interface, so that the WEB application communicates with the server.

Optionally, the application module also includes:

The interface management unit is used to manage the presentation form of each sub-application in the WEB application.

According to the second aspect of the embodiments of the present disclosure, a WEB-based multi-terminal device interaction system is provided, including a server and multiple terminal devices as described above; the server is provided with a WEB application;

The terminal device is used to enter the WEB application through a two-dimensional code and display the WEB application synchronously, and send data information of the WEB application to the server in response to a touch operation on the WEB application;

The server is configured to send the data information to other terminal devices in response to receiving the data information of the WEB application of any terminal device, so as to realize the interaction between any two terminal devices.

Optionally, the terminal device is further configured to send a Websocket handshake request to the server;

The server is also used for Websocket to establish a Websocket data transmission channel with the terminal device and generate a handshake response in response to receiving the Websocket handshake request;

The terminal device is also used to obtain the Websocket handshake request returned by the server.

Optionally, the server is further configured to send data to the corresponding target terminal device, so that the display of the target terminal device displays the WEB application and the corresponding two-dimensional code, and the two-dimensional code is used to make the target terminal device Other terminal devices of the user enter the WEB application through a two-dimensional code.

According to the third aspect of the embodiments of the present disclosure, there is provided a WEB-based multi-terminal device interaction method applied to a server, including:

In response to receiving the data information of the WEB application of any terminal device, the data information is sent to other terminal devices to realize the interaction between any two terminal devices; the data information is the response of the terminal device to the WEB application Generated by the touch operation.

Optionally, the method also includes:

In response to receiving the Websocket handshake request sent by the terminal device, the Websocket establishes a Websocket data transmission channel with the terminal device, and sends the generated handshake response to the terminal device.

Optionally, the method also includes:

Send the data information of the WEB application to the corresponding target terminal device, so that the display of the target terminal device displays the WEB application and the corresponding two-dimensional code, and the two-dimensional code is used to enable other terminal devices other than the target terminal device to pass two The two-dimensional code enters the WEB application.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, and when the executable computer program in the storage medium is executed by a processor, the above method can be implemented.

The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

As can be seen from the above-mentioned embodiments, the solutions provided by the embodiments of the present disclosure are provided with a platform module, a communication module, and an application module. The platform module provides a platform supporting the operation of WEB applications, the communication module transmits shared data information, and the application module loads WEB applications. The application is used to render and display the data information. In this way, in this embodiment, the platform module can support the operation of the WEB application and the application module can render and display the WEB application, so that the WEB application can be run as a local application without relying on external storage devices and without arranging plug-ins, reducing the The requirements for terminal equipment and the effect of using WEB applications without installing applications in advance are conducive to improving the convenience of operation and user experience.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure.

Fig. 1 is a block diagram of a terminal device according to an exemplary embodiment.

Fig. 2 is a block diagram of a platform module according to an exemplary embodiment.

Fig. 3 is a block diagram of an application module according to an exemplary embodiment.

Fig. 4 is a flow chart of configuring a terminal device according to an exemplary embodiment.

Fig. 5 is a block diagram of a WEB-based multi-terminal device interaction system according to an exemplary embodiment.

Fig. 6 is a flowchart showing one-to-many terminal device interaction according to an exemplary embodiment.

Fig. 7 is a flowchart showing many-to-many terminal device interaction according to an exemplary embodiment.

Detailed ways

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The exemplary described embodiments below do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of devices consistent with aspects of the present disclosure as recited in the appended claims. It should be noted that, in the case of no conflict, the features in the following embodiments and implementation manners can be combined with each other.

In order to solve the above technical problems, the embodiments of the present disclosure provide a WEB-based multi-terminal device interaction method, system and terminal device. Wherein, the above-mentioned terminal devices may include but not limited to devices such as tablet computers, smart phones, personal computers, smart TVs, desktop computers, and large screens. The above-mentioned terminal equipment is provided with a browser and has a browsing function.

FIG. 1 is a block diagram of a terminal device according to an exemplary embodiment. Referring to FIG. 1 , a terminal device includes a platform module 11 , an application module 12 and a communication module 13 . in,

The platform module 11 is used to provide a platform supporting WEB application operation; the above-mentioned platform includes at least one of the following: HTML5 operating environment, operating system, browser or browser engine; communication module 13, used to transmit shared data information; application module 12. It is used to load a WEB application to render and display the above data information.

In practical applications, continue to refer to FIG. 1 , the terminal device may also include local applications, such as audio applications, short video applications, etc., through which local files can be viewed or audio and video files can be viewed through the Internet.

In one embodiment, referring to FIG. 2 , the platform module 11 includes a WEB application management unit 111 , a WEB application loading unit 112 and a Websocket server unit 113 . in,

The WEB application management unit 111 is used to package and manage the WEB application, so that the WEB application can run as a local application; it is also used to expand the integrated Websocket service and expand the interface of the terminal; the WEB application loading unit 112 is used to load the WEB The application is used for rendering and displaying on the local platform; the Websocket server unit 113 is used for transmitting data information to each terminal device and storing data information.

In this embodiment, the WEB application loading unit 112 includes a browser kernel, such as a Trident kernel, a Gecko kernel, a WebKit kernel, a Blink kernel, and a Chromium kernel, and is updated following the browser kernel upgrade, that is, updated to the latest version of the browser kernel , to achieve the effect of getting rid of the limitation of the browser kernel version in the terminal device. In an example, the above-mentioned browser kernel is implemented by using the Chromium kernel.

In one embodiment, referring to FIG. 3, the application module 12 includes:

The two-dimensional code management unit 121 is used to present the URL (Uniform Resource Locator) address of the WEB application in the form of two-dimensional code;

The file management unit 122 is used to read or push local files, that is, the management of local files of the terminal device includes file reading (local pictures, videos, etc.) and transmission (that is, pushing local files).

The communication unit 123 is configured to use the HTML5 interface combined with the Websocket protocol communication mechanism to establish a Websocket data transmission channel with the server, so that the WEB application communicates with the server.

In an example, referring to FIG. 3 , the application module 12 further includes: an interface management unit 124, configured to manage the presentation forms of each sub-application in the WEB application, such as the display and hiding of application icons and QR code icons of the WEB application. Management, display of WEB application URL address, custom management and interface display of WEB application, and management of each sub-application through "one-key control" on the interface, etc.

In this embodiment, the terminal device platform module 11 supports the operation of WEB applications, which can be preset through the following steps, see FIG. 4, including:

Step 41: Build the platform module 11 on (the operating system of) the terminal device. Wherein, the operating system of the terminal device may include a Linux system, an Android system, an IOS system, a Windows system, and the like. The platform module 11 can use the crosswalk architecture to package the engine of the chromium browser into the WEB application; use the chromium kernel to support the rendering and operation of the WEB application; at the same time, it adds packaging and management functions for the WEB application, so that WEB applications can run as local applications on terminal devices.

Step 42: Integrate WEB applications based on the platform module 11. WEB application is a WEB application implemented based on the HTML5 standard. Due to the cross-platform nature of WEB applications, one application can be compatible with all manufacturers' devices. That is, the platform modules 11 of multiple terminal devices can all run as local applications and be displayed on the screens of the devices in the form of icons.

Step 43: Integrate the QR code function in the WEB application, that is, the URL address of the WEB application can be expressed in the form of a QR code.

Step 44: Configure the server based on the platform module 11, so that data information can be transmitted between the terminal device and the server through the Websocket protocol.

So far, the solutions provided by the embodiments of the present disclosure are provided with a platform module, a communication module, and an application module. The platform module provides a platform supporting the operation of WEB applications, the communication module transmits shared data information, and the application module loads WEB applications to support all WEB applications. The above data information is rendered and displayed. In this way, in this embodiment, the platform module can support the operation of the WEB application and the application module can render and display the WEB application, so that the WEB application can be run as a local application without relying on external storage devices and without arranging plug-ins, reducing the The requirements for terminal equipment and the effect of using WEB applications without installing applications in advance are conducive to improving the convenience of operation and user experience.

The embodiment of the present disclosure also provides a WEB-based multi-terminal device interaction system, as shown in FIG. 5 , including a server 50 and multiple terminal devices 10 as shown in FIG. 1 ; the server 50 is provided with a WEB application;

The terminal device 10 is used to enter the WEB application through the two-dimensional code and display the WEB application synchronously, and send the data information of the WEB application to the server in response to a touch operation on the WEB application;

The server 50 is configured to send the data information to other terminal devices in response to receiving the data information of the WEB application of any terminal device, so as to realize the interaction between any two terminal devices.

In one embodiment, the terminal device is also used to send a Websocket handshake request to the server; the server is also used to establish a Websocket data transmission channel with the terminal device and generate a handshake response in response to receiving the Websocket handshake request; the terminal device is also used to Obtain the Websocket handshake request returned by the server.

In one embodiment, the server is also used to send data to the corresponding target terminal equipment, so that the display of the target terminal equipment displays the WEB application and the corresponding two-dimensional code, and the two-dimensional code is used to make the target terminal equipment Other terminal devices of the user enter the WEB application through a two-dimensional code.

In this embodiment, the working principle of the WEB-based multi-terminal device interaction system takes a one-to-many scenario as an example, see FIG. 6, including:

In step 61: when the terminal device needs to share data information, the terminal device establishes a Websocket data transmission channel with the server. Wherein, the terminal device that shares the data information is referred to as the first terminal device. That is, the first terminal device clicks the WEB application icon on the screen, the above-mentioned WEB application is triggered, the first terminal device sends a Websocket handshake request to the server, and the server establishes a Websocket data transmission with the first terminal device in response to receiving the above-mentioned Websocket handshake request channel, and generate a handshake response. The first terminal device is also used to obtain the Websocket handshake request returned by the server.

In step 62: when the first terminal device has a demand for other terminal devices (hereinafter referred to as the first terminal device), the first terminal device may send data information to at least one second terminal device. For example, the first terminal device sends data information to the server through the Websocket data transmission channel, and the server forwards the data information to at least one second terminal device. The above data information may include information resources of local devices and public networks, such as pictures, videos, wordpads, and the like. At least one second terminal device can receive the above data information, and browse the above data information by clicking on the WEB application form, and at this time, the second terminal device can display the above data information.

When the second terminal device displays the interface of the WEB application, when the user can trigger the HTML5 interface, the second terminal device can generate data information and send it to the server.

In step 63: the first terminal device receives the data information sent by the second terminal device. For example, at least one second terminal device sends data information to the server through a Websocket data transmission channel, and the server forwards the above data information to the first terminal device.

In step 64: the first terminal device may close the Websocket data transmission channel established with the server.

In this embodiment, the working principle of the WEB-based multi-terminal device interaction system takes a many-to-many scenario as an example, see FIG. 7, including:

In step 71: at least one second terminal device establishes a Websocket data transmission channel with the server. For example, the second terminal device sends a Websocket handshake request to the server, and in response to receiving the above Websocket handshake request, the server establishes a Websocket data transmission channel with the second terminal device and generates a handshake response. The second terminal device is also used to obtain the Websocket handshake request returned by the server.

Moreover, at least one second terminal device scans the display screen corresponding to the server or the QR code of the WEB application of the first terminal device or inputs the URL address of the WEB application. At least one second terminal device opens a browser page corresponding to the WEB application.

In step 72: at least one second terminal device sends data information to other terminal devices. At least one second terminal device sends data information to the first terminal device via the server through the Websocket data transmission channel. For the solution of establishing a Websocket data transmission channel between the server and the first terminal device, reference may be made to step 61, which will not be repeated here.

In step 73: at least one second terminal device receives the data information sent by other terminal devices, that is, at least one second terminal device receives the data information pushed by the server through the Websocket data transmission channel.

In step 74: at least one second terminal device closes the Websocket data transmission channel with the server.

An embodiment of the present disclosure also provides a WEB-based multi-terminal device interaction method applied to a server, including:

In one embodiment, the method also includes:

It should be noted that the method shown in this embodiment matches the content of the above-mentioned device and system embodiments, and reference may be made to the content of the above-mentioned method embodiments, which will not be repeated here.

In an exemplary embodiment, a server is also provided, including:

processor;

memory for storing a computer program executable by said processor;

Wherein, the processor is configured to execute the computer program in the memory, so as to realize the steps of the above method.

In an exemplary embodiment, there is also provided a computer-readable storage medium, such as a memory including instructions, and the above-mentioned executable computer program can be executed by a processor, so as to realize the steps of the method as shown in FIG. 1 . Wherein, the readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device and the like.

Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. The present disclosure is intended to cover any modification, use or adaptation that follows the general principles of the present disclosure and includes common knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and examples are to be considered exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It should be understood that the present disclosure is not limited to the precise constructions which have been described above and shown in the drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

A terminal device, characterized in that it includes a platform module, an application module and a communication module;

The platform module is used to provide a platform supporting WEB application operation; the platform includes at least one of the following: operating system, browser or browser engine;

The communication module is used to transmit shared data information;

The application module is used to load a WEB application to render and display the data information.
The terminal device according to claim 1, wherein the platform module comprises:

The WEB application management unit is used to package and manage the WEB application, so that the WEB application can run as a local application;

The WEB application loading unit is used to load the WEB application for rendering and displaying in the local platform;

The Websocket server unit is used to transmit data information to each terminal device.
The terminal device according to claim 2, wherein the WEB application loading unit includes a browser kernel, and is updated following the upgrade of the browser kernel.
The terminal device according to claim 1, wherein the application module comprises:

The two-dimensional code management unit is used to present the URL address of the WEB application in the form of two-dimensional code;

File management unit, used to read or push local files;

The communication unit is used to establish a Websocket data transmission channel with the server using the HTML5 interface, so that the WEB application communicates with the server.
The terminal device according to claim 4, wherein the application module further comprises:

The interface management unit is used to manage the presentation form of each sub-application in the WEB application.
A WEB-based multi-terminal device interaction system, characterized in that it includes a server and a plurality of terminal devices according to any one of claims 1 to 5; the server is provided with a WEB application;

The terminal device is used to enter the WEB application through a two-dimensional code and display the WEB application synchronously, and send data information of the WEB application to the server in response to a touch operation on the WEB application;

The server is configured to, in response to receiving the data information of the WEB application of any terminal device, send the data information to other terminal devices so as to realize the interaction between any two terminal devices.
The system according to claim 6, wherein the terminal device is further configured to send a Websocket handshake request to the server;

The server is also used for Websocket to establish a Websocket data transmission channel with the terminal device and generate a handshake response in response to receiving the Websocket handshake request;

The terminal device is also used to obtain the Websocket handshake request returned by the server.
The system according to claim 6, wherein the server is further configured to send data to the corresponding target terminal device, so that the display of the target terminal device displays the WEB application and the corresponding two-dimensional code, and the two-dimensional The code is used to enable other terminal devices other than the target terminal device to enter the WEB application through the two-dimensional code.
A WEB-based multi-terminal device interaction method is characterized in that it is applied to a server, including:

In response to receiving the data information of the WEB application of any terminal device, the data information is sent to other terminal devices to realize the interaction between any two terminal devices; the data information is the response of the terminal device to the WEB application Generated by the touch operation.
The method according to claim 9, characterized in that the method further comprises:

In response to receiving the Websocket handshake request sent by the terminal device, establish a Websocket data transmission channel with the terminal device, and send the generated handshake response to the terminal device.
The method according to claim 9, characterized in that the method further comprises:

Send the data information of the WEB application to the corresponding target terminal device, so that the display of the target terminal device displays the WEB application and the corresponding two-dimensional code, and the two-dimensional code is used to enable other terminal devices other than the target terminal device to pass two The two-dimensional code enters the WEB application.
A computer-readable storage medium, characterized in that, when the executable computer program in the storage medium is executed by a processor, the method according to any one of claims 9-11 can be realized.