CN116204147A - Multi-screen linkage method, device, system, storage medium and electronic equipment - Google Patents

Multi-screen linkage method, device, system, storage medium and electronic equipment Download PDF

Info

Publication number
CN116204147A
CN116204147A CN202310127388.0A CN202310127388A CN116204147A CN 116204147 A CN116204147 A CN 116204147A CN 202310127388 A CN202310127388 A CN 202310127388A CN 116204147 A CN116204147 A CN 116204147A
Authority
CN
China
Prior art keywords
terminal
type
information
linkage
local
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310127388.0A
Other languages
Chinese (zh)
Inventor
占传喜
梁权清
林心旺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Coocaa Network Technology Co Ltd
Original Assignee
Shenzhen Coocaa Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Coocaa Network Technology Co Ltd filed Critical Shenzhen Coocaa Network Technology Co Ltd
Priority to CN202310127388.0A priority Critical patent/CN116204147A/en
Publication of CN116204147A publication Critical patent/CN116204147A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Abstract

The invention discloses a method, a device, a system, a storage medium and electronic equipment for multi-screen linkage, wherein the method comprises the following steps: receiving first UI information sent by a first type of terminal calling a first linkage UI configuration function, wherein the first UI information is used for displaying a first interface on the first type of terminal; and sending the first UI information to a second type terminal so that the second type terminal displays the first interface, wherein the first linkage UI configuration function is matched with the second type terminal. The invention solves the problem of poor multi-terminal synchronization effect experience in the related technology.

Description

Multi-screen linkage method, device, system, storage medium and electronic equipment
Technical Field
The invention relates to the field of computers, in particular to a method, a device, a system, a storage medium and electronic equipment for multi-screen linkage.
Background
Along with the development of economy and technology, linkage scenes and demands among multiple devices are more and more, and users are attracted more and more, but the prior art cannot well solve the technical bottleneck of multi-screen interaction, and the demands of users are difficult to meet. For example, in the prior art, the original control of the iOS system can realize linkage, but only the iOS system is supported, multi-terminal synchronization of the control cannot be realized, and the android system supports few linkage control, so that web linkage display performance is consumed more, and multi-terminal synchronization effect experience is poorer.
In view of the above problems in the related art, no effective solution has been found yet.
Disclosure of Invention
The embodiment of the invention provides a method, a device, a system, a storage medium and electronic equipment for multi-screen linkage.
According to an aspect of the embodiments of the present application, a method for multi-screen linkage is provided, which is applied to a server, and includes: receiving first UI information sent by a first type of terminal calling a first linkage UI configuration function, wherein the first UI information is used for displaying a first interface on the first type of terminal; and sending the first UI information to a second type terminal so that the second type terminal displays the first interface, wherein the first linkage UI configuration function is matched with the second type terminal.
Optionally, the method further comprises: receiving second UI information sent by a second type terminal by calling a second linkage UI configuration function, wherein the second UI information is used for displaying a second interface on the second type terminal; and sending the second UI information to a first type terminal so that the first type terminal displays the second interface, wherein the second linkage UI configuration function is matched with the first type terminal.
Optionally, before receiving the first UI information sent by the first type of terminal by calling the first linkage UI configuration function, the method includes: constructing a code script for multi-screen linkage control, wherein the code script comprises the linkage UI configuration function; and issuing the code script to a plurality of terminals to be displayed in a linkage way so that the plurality of terminals run the code script, wherein the plurality of terminals comprise the first type of terminals and the second type of terminals.
According to an aspect of the embodiment of the present invention, there is provided a method for multi-screen linkage, applied to a first type of terminal, including: acquiring a first control instruction aiming at a first type of terminal, wherein the first control instruction is used for operating interface display of the first type of terminal; calling a local UI configuration function of the first type terminal, and generating first local UI information of the first type terminal according to the first control instruction; rendering and displaying a first interface on a display interface of the first type terminal by adopting the first local UI information, and determining the first local UI information as first UI information; and calling a first linkage UI configuration function, and sending the first UI information to the second type of terminal.
According to an aspect of the embodiment of the present invention, there is provided a method for multi-screen linkage, applied to a second class of terminals, including: receiving first UI information of a first type of terminal forwarded by a server, wherein the first UI information is used for displaying a first interface on the first type of terminal; calling a local UI configuration function of the second type terminal, and updating second local UI information of the second type terminal by adopting the first UI information; and rendering and displaying the first interface on the display interface of the second type terminal by adopting the second local UI information.
Optionally, updating the second local UI information of the second class of terminals with the first UI information includes: acquiring a local rendering tree of the second class terminal; obtaining UI change information according to the first UI information and the local rendering tree, wherein the UI change information is used for indicating delta update or local update of the current UI of the second class terminal; and updating second local UI information of the second type terminal according to the UI change information.
Optionally, the method includes, before calling a local UI configuration function of the second type of terminal and updating the second local UI information of the second type of terminal with the first UI information: judging whether the second type of terminal starts a linkage control function or not; and if the second type terminal starts the linkage control function, confirming to call a local UI configuration function of the second type terminal, and updating second local UI information of the second type terminal by adopting the first UI information.
According to another aspect of the embodiment of the present invention, there is provided a multi-screen linkage device, applied to a server, including: the first receiving module is used for receiving first UI information sent by a first type of terminal calling a first linkage UI configuration function, wherein the first UI information is used for displaying a first interface on the first type of terminal; and the first sending module is used for sending the first UI information to a second type of terminal so as to enable the second type of terminal to display the first interface, wherein the first linkage UI configuration function is matched with the second type of terminal.
Optionally, the first receiving module is further configured to receive second UI information sent by the second type terminal by calling the second linkage UI configuration function, where the second UI information is used to display a second interface on the second type terminal; the first sending module is further configured to send the second UI information to a first type of terminal, so that the first type of terminal displays the second interface, where the second linkage UI configuration function is matched with the first type of terminal.
Optionally, the apparatus further comprises: the construction module is used for constructing a code script for multi-screen linkage control, wherein the code script comprises the linkage UI configuration function; and the issuing module is used for issuing the code script to a plurality of terminals to be displayed in a linkage way so as to enable the plurality of terminals to run the code script, wherein the plurality of terminals comprise the first type of terminals and the second type of terminals.
According to another aspect of the embodiment of the present invention, there is provided another multi-screen linkage apparatus, applied to a first type of terminal, including: the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a first control instruction aiming at a first type terminal, and the first control instruction is used for operating interface display of the first type terminal; the generation module is used for calling a local UI configuration function of the first type terminal and generating first local UI information of the first type terminal according to the first control instruction; the first display module is used for rendering and displaying a first interface on the display interface of the first type of terminal by adopting the first local UI information; a determining module configured to determine the first local UI information as first UI information; and the second sending module is used for calling the first linkage UI configuration function and sending the first UI information to the second type terminal.
According to another aspect of the embodiment of the present invention, there is provided another multi-screen linkage apparatus, applied to a second class of terminals, including: the second receiving module is used for receiving first UI information of a first type of terminal forwarded by a server, wherein the first UI information is used for displaying a first interface on the first type of terminal; the updating module is used for calling a local UI configuration function of the second type terminal and updating second local UI information of the second type terminal by adopting the first UI information; and the second display module is used for rendering and displaying the first interface on the display interface of the second type terminal by adopting the second local UI information.
Optionally, the updating module includes: the acquisition unit is used for acquiring the local rendering tree of the second class terminal; an updating unit, configured to obtain UI change information according to the first UI information and the local rendering tree, where the UI change information is used to indicate delta update or local update of a current UI of the second class terminal; and updating second local UI information of the second type terminal according to the UI change information.
Optionally, the apparatus further comprises: the judging module is used for judging whether the second type of terminal starts the linkage control function or not; and the confirmation module is used for confirming and calling the local UI configuration function of the second type terminal if the second type terminal starts the linkage control function, and updating the second local UI information of the second type terminal by adopting the first UI information.
According to another aspect of an embodiment of the present invention, there is provided a multi-screen linked system including: a server, a first type terminal and a second type terminal, wherein the server is connected with the first type terminal and the second type terminal and is used for executing the device; the first class of terminals is used for executing the device; the second class of terminals is configured to perform the apparatus as described above.
According to another aspect of the embodiments of the present invention, there is also provided a storage medium including a stored program that performs the above steps when running.
According to another aspect of the embodiment of the present invention, there is also provided an electronic device including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus; wherein: a memory for storing a computer program; and a processor for executing the steps of the method by running a program stored on the memory.
Embodiments of the present invention also provide a computer program product comprising instructions which, when run on a computer, cause the computer to perform the steps of the above method.
According to the method and the device, first UI information sent by a first type terminal calling a first linkage UI configuration function is received, wherein the first UI information is used for displaying a first interface on the first type terminal; the first UI information is sent to the second type of terminal so that the second type of terminal displays a first interface, wherein the first linkage UI configuration function is matched with the second type of terminal, the first UI information of the first type of terminal is sent by adopting the linkage UI configuration function, and the second type of terminal receives and displays the first UI information, so that linkage control among different types of terminals is realized, the difference of system platforms is ignored, linkage of different platforms is supported, and the multi-terminal synchronization experience effect is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiments of the invention and together with the description serve to explain the invention and do not constitute a limitation on the invention. In the drawings:
FIG. 1 is a block diagram of the hardware architecture of a server according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of multi-screen linkage according to an embodiment of the present invention;
FIG. 3 is a linkage messaging schematic diagram of a method of multi-screen linkage according to an embodiment of the present invention;
FIG. 4 is an overall logic architecture diagram of a method of multi-screen linkage according to an embodiment of the present invention;
FIG. 5 is a flow chart of another method of multi-screen linkage according to an embodiment of the present invention;
FIG. 6 is a flow chart of a method of yet another multi-screen linkage according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a mobile phone end linkage control in an implementation scenario according to an embodiment of the present invention;
FIG. 8 is a flow chart of one implementation scenario in accordance with an embodiment of the present invention;
FIG. 9 is a block diagram of a multi-screen linkage according to an embodiment of the present invention;
fig. 10 is a block diagram of a multi-screen linked system according to an embodiment of the present invention.
Detailed Description
In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application. It should be noted that, in the case of no conflict, the embodiments and features in the embodiments may be combined with each other.
It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
The method embodiment provided in the first embodiment of the present application may be executed in a server, a computer, a mobile phone, a television, a tablet or a similar computing device. Taking the operation on a server as an example, fig. 1 is a block diagram of a hardware structure of a server according to an embodiment of the present invention. As shown in fig. 1, the server may include one or more (only one is shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a microprocessor MCU or a processing device such as a programmable logic device FPGA) and a memory 104 for storing data, and optionally, a transmission device 106 for communication functions and an input-output device 108. It will be appreciated by those of ordinary skill in the art that the architecture shown in fig. 1 is merely illustrative and is not intended to limit the architecture of the server described above. For example, the server may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used to store server programs, such as software programs and modules of application software, such as a server program corresponding to a multi-screen linkage method in an embodiment of the present invention, and the processor 102 executes the server program stored in the memory 104 to perform various functional applications and data processing, that is, implement the method described above. Memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory remotely located with respect to the processor 102, which may be connected to a server via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of a server. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, simply referred to as NIC) that can connect to other network devices through a base station to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is configured to communicate with the internet wirelessly.
In this embodiment, a method for multi-screen linkage is provided, and fig. 2 is a flowchart of a method for multi-screen linkage according to an embodiment of the present invention, applied to a server, as shown in fig. 2, where the flowchart includes the following steps:
s11, receiving first UI information sent by a first type of terminal calling a first linkage UI configuration function, wherein the first UI information is used for displaying a first interface on the first type of terminal;
the network ecology applied in this embodiment includes: the system comprises a server and a plurality of terminals, wherein the terminals can be mobile phones, televisions, computers, tablets and the like.
The first linkage UI configuration function is used for setting the UI state of the remote second-class terminal. And the UI information of the first type of terminal is sent to the second type of terminal through the linkage UI configuration function, so that the second type of terminal can synchronously display in a linkage mode.
And S12, the first UI information is sent to a second type of terminal, so that the second type of terminal displays the first interface, wherein the first linkage UI configuration function is matched with the second type of terminal.
The first type of terminal and the second type of terminal can be different types of terminals, for example, the first type of terminal is a mobile phone terminal, and the second type of terminal is a TV terminal. The server receives the mobile phone UI information sent by the mobile phone end and forwards the mobile phone UI information to the TV end, and the TV end synchronously displays the mobile phone UI information according to the received UI information.
The server in the embodiment of the invention receives the first UI information sent by the first type terminal by calling the first linkage UI configuration function, wherein the first UI information is used for displaying a first interface on the first type terminal and sending the first UI information to the second type terminal so that the second type terminal synchronously displays the first interface of the first type terminal, thereby realizing linkage between the second type terminal and the first type terminal.
In one implementation of this embodiment, the method further includes:
s13, receiving second UI information sent by a second type terminal calling a second linkage UI configuration function, wherein the second UI information is used for displaying a second interface on the second type terminal;
And S14, the second UI information is sent to a first type terminal so that the first type terminal displays the second interface, wherein the second linkage UI configuration function is matched with the first type terminal.
The first type terminal and the second type terminal in the embodiment can perform linkage display in two directions. When the UI state of the first type terminal is changed, UI information is sent to the second type terminal through the corresponding first linkage UI configuration function, and when the UI state of the second type terminal is changed, UI information can be sent to the first type terminal through the corresponding second linkage UI configuration function, so that bidirectional linkage control of the first type terminal and the second type terminal is realized.
Referring to fig. 3, fig. 3 is a schematic diagram of linkage message transmission of a multi-screen linkage method according to an embodiment of the present invention, as shown in fig. 3, in this example, a first type of terminal is a mobile phone terminal, a second type of terminal is a TV terminal, when the mobile phone terminal is a control terminal (i.e., a user performs interface operation control through a mobile phone), the TV terminal is a linkage terminal, and when the first linkage UI configuration function is a setTvState function, the mobile phone terminal sends the setTvState function to the TV terminal, for setting a UI state of a remote television. And when the TV terminal is a control terminal and the mobile phone terminal is a linkage terminal, the second linkage UI configuration function is a setMobileState function, and the TV terminal sends the setMobileState function to the mobile phone terminal and is used for setting the UI state of the remote mobile phone terminal.
In one implementation manner of this embodiment, the method includes, before receiving the first UI information sent by the first type of terminal to invoke the first linkage UI configuration function S11: constructing a code script for multi-screen linkage control, wherein the code script comprises the linkage UI configuration function; and issuing the code script to a plurality of terminals to be displayed in a linkage way so that the plurality of terminals run the code script, wherein the plurality of terminals comprise the first type of terminals and the second type of terminals.
Before the UI information is sent by calling the linkage UI configuration function, a set of code script for multi-screen linkage control is firstly constructed and issued to a plurality of terminals to be displayed in a linkage mode, and the control linkage state synchronization can be realized by means of multi-terminal loading display of a set of codes and restriction of different platform operating systems. Referring to fig. 4, fig. 4 is an overall logic architecture diagram of a multi-screen linkage method according to an embodiment of the present invention, as shown in fig. 4, a set of adaptive multi-terminal code script is constructed in this embodiment, where a linkage UI configuration function and effect parameters for linkage display are defined, further, the code script may be packaged together with a picture resource, an audio video, a data file, and the like into a zip executable program package, and applied by js (JavaScript, a scripting language) packaging, and then issued to a plurality of terminals to be displayed in a linkage manner (fig. 4 only shows two terminals), the set of adaptive multi-terminal code is loaded on a multi-terminal device by a js script parsing engine, and consistency of display control effects between linkage terminals is achieved by a flutter cross-platform rendering engine and a unified custom component, and control state synchronization between different types of terminals is achieved by means of connection capability of interconnection protocols.
In this embodiment, another method for multi-screen linkage is provided, and fig. 5 is a flowchart of another method for multi-screen linkage according to an embodiment of the present invention, applied to a first type of terminal, as shown in fig. 5, where the flowchart includes the following steps:
s21, acquiring a first control instruction aiming at a first type of terminal, wherein the first control instruction is used for operating interface display of the first type of terminal;
the control instructions may include click, page up, page down, etc. instructions.
S22, calling a local UI configuration function of the first type terminal, and generating first local UI information of the first type terminal according to the first control instruction;
the local UI configuration function is a setState function and is used for setting the state of the local UI of the terminal, and the local UI refreshing is triggered by calling the setState function.
S23, rendering and displaying a first interface on the display interface of the first type terminal by adopting the first local UI information, and determining the first local UI information as first UI information;
rendering the interface after the display control on the first-class terminal, and sending the first UI information determined by the first local UI information of the first-class terminal after the control instruction to the second-class terminal.
S24, calling a first linkage UI configuration function and sending the first UI information to the second type of terminal.
If the second type of terminal is a TV terminal, the first linkage UI configuration function is a corresponding setTvState function, and the mobile phone terminal sends the setTvState function to the TV terminal to set the UI state of the remote television.
According to the embodiment of the invention, the first control instruction aiming at the first type terminal interface display is obtained, the local UI configuration function of the first type terminal is called, the first local UI information is generated according to the first control instruction and is rendered and displayed on the first type terminal display interface, the first linkage UI configuration function is called, the first UI information is sent to the second type terminal, and the linkage display of the second type terminal is controlled according to the operation of the first type terminal side.
In this embodiment, a further method for multi-screen linkage is provided, and fig. 6 is a flowchart of a further method for multi-screen linkage according to an embodiment of the present invention, applied to a second type of terminal, as shown in fig. 6, where the flowchart includes the following steps:
s31, receiving first UI information of a first type of terminal forwarded by a server, wherein the first UI information is used for displaying a first interface on the first type of terminal;
S32, calling a local UI configuration function of the second type terminal, and updating second local UI information of the second type terminal by adopting the first UI information;
and S33, rendering and displaying the first interface on the display interface of the second type terminal by adopting the second local UI information.
Illustratively, after receiving the UI information sent by the mobile phone, the TV synchronizes the UI interface and the status by setting a local setState.
In an embodiment of the present example, updating the second local UI information of the second class of terminals with the first UI information, S32, includes:
s321, acquiring a local rendering tree of the second class terminal;
the rendering tree is used to calculate the layout of the visible elements and as input to the process of rendering the pixels onto the screen, a final rendered tree consisting of a DOM (Document Object Model ) tree and a CSSOM (Cascoding Style Sheet Object Model, cascading style sheet object model) tree.
S322, UI change information is obtained according to the first UI information and the local rendering tree, wherein the UI change information is used for indicating difference update or local update of the current UI of the second-class terminal;
s323, updating the second local UI information of the second type terminal according to the UI change information.
In this embodiment, when the second type terminal receives the first UI information, the second type terminal compares the first UI information with the local current rendering tree to find out the difference update or the local update of the changing part, where the difference update or the local update of the UI may be implemented by using a Diff algorithm, and by comparing the change differences of the two new and old virtual DOM trees, the update patch acts on the real DOM, and the view update is completed with the minimum cost, so that the synchronization effect of the control is achieved and the multi-terminal synchronization of the control is implemented under the condition of occupying less resources.
In an embodiment of the present example, before calling a local UI configuration function of the second type terminal and updating the second local UI information of the second type terminal with the first UI information, the method includes: judging whether the second type of terminal starts a linkage control function or not; and if the second type terminal starts the linkage control function, confirming to call a local UI configuration function of the second type terminal, and updating second local UI information of the second type terminal by adopting the first UI information.
In this embodiment, before the linkage control is performed, whether the terminal enables the linkage control function is further determined, if the terminal enables the linkage control function, the linkage control is confirmed, the second type of terminal displays according to the display interface of the first type of terminal, and if the terminal does not enable the linkage control function, the linkage display is not performed.
In the following, a complete explanation of the embodiments of the present invention is provided by way of one implementation scenario.
Referring to fig. 7 and 8, fig. 7 is a schematic diagram of a linkage control at a mobile phone end in an implementation scenario according to an embodiment of the present invention, and fig. 8 is a flowchart of an implementation scenario according to an embodiment of the present invention. As shown in fig. 7, the linkage control in the present embodiment is a dial control, and the contents on the dial include "find cup", "and opposite cup", "female cup", "PASS", "man drink light", "people cup", "lower exposure", "upper exposure", "real heart sound", "drink half cup", "dry cup", "own singing song".
The mobile phone terminal enters a turntable game loading display turntable control, a user starts a game at a mobile phone endpoint, a turntable on a mobile phone terminal interface starts rotating, a local pointer rotates to point to a true voice, whether the mobile phone terminal starts enabling connection is judged, if the mobile phone terminal starts enabling connection, the mobile phone terminal calls a setTVState method to trigger linkage operation, a server receives linkage instruction information of the mobile phone terminal and distributes the linkage instruction information to a target device TV terminal, the TV terminal judges whether the TV terminal starts enabling connection after receiving the setTVState information, if the TV terminal starts enabling connection, the local setState method is called to trigger UI refreshing, the UI control interface and state are synchronized, and the turntable pointer of the TV terminal indicates the true voice, so that linkage control of the mobile phone terminal and the TV terminal is completed. Similarly, when the state of the TV-side carousel changes, the TV-side may reversely synchronize its state to the mobile phone side through setMobileState (as shown in the dashed flow in fig. 8). The setState is used for setting the state of a local UI, the setTvState is used for setting the UI state of a remote television, the setMobileState is used for setting the UI state of a remote mobile terminal (such as a mobile phone and the like), the issuing of state instructions realizes multi-terminal distribution of messages through an interconnection protocol connection library, and after the messages reach a target terminal, the target terminal triggers local UI refreshing through the setState.
In the implementation scene, the mobile phone terminal packages and sends the information changed in the local current control rendering tree to the TV terminal, the TV terminal receives the information and compares the information with the local current rendering tree of the TV terminal to find out the change part to update the difference or update the part, the validity and the reliability of the updated information of the component are ensured by updating the diff algorithm, the refreshing frequency is reduced as much as possible in a certain time, and the performance loss is reduced, so that the control synchronization effect is achieved under the condition of occupying less resources, and the control multi-terminal synchronization is realized.
Through the embodiment of the invention, a user operates the turntable control at the mobile phone end, the TV end can synchronously display the operation result of the turntable at the mobile phone end, and when the state of the turntable at the TV end changes, the TV end can reversely synchronize the state of the user to the mobile phone end through the setMobileState, so that UI state synchronization among multiple ends is realized.
From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
Example 2
The embodiment also provides a device and a system for multi-screen linkage, which are used for realizing the above embodiment and the preferred implementation manner, and are not described in detail. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
Fig. 9 is a block diagram of a multi-screen linkage device according to an embodiment of the present invention, as shown in fig. 9, applied to a server, where the device includes: a first receiving module 10, a first transmitting module 20, wherein,
the first receiving module 10 is configured to receive first UI information sent by a first type of terminal by calling a first linkage UI configuration function, where the first UI information is used to display a first interface on the first type of terminal;
and the first sending module 20 is configured to send the first UI information to a second type of terminal, so that the second type of terminal displays the first interface, where the first linkage UI configuration function is matched with the second type of terminal.
Optionally, the first receiving module is further configured to receive second UI information sent by the second type terminal by calling the second linkage UI configuration function, where the second UI information is used to display a second interface on the second type terminal; the first sending module is further configured to send the second UI information to a first type of terminal, so that the first type of terminal displays the second interface, where the second linkage UI configuration function is matched with the first type of terminal.
Optionally, the apparatus further comprises: the construction module is used for constructing a code script for multi-screen linkage control, wherein the code script comprises the linkage UI configuration function; and the issuing module is used for issuing the code script to a plurality of terminals to be displayed in a linkage way so as to enable the plurality of terminals to run the code script, wherein the plurality of terminals comprise the first type of terminals and the second type of terminals.
Fig. 10 is a block diagram of a multi-screen linked system according to an embodiment of the present invention, as shown in fig. 10, comprising: a server 100 and a first type terminal 200 and a second type terminal 300, wherein the server 100 is connected to the first type terminal 200 and the second type terminal 300, and is configured to perform the apparatus described in the above embodiments; the first type of terminal 200 is configured to execute an apparatus described in the following embodiments; the second class of terminals 300 is configured to execute the apparatus according to the following embodiments.
The embodiment also provides a multi-screen linkage device, which is applied to the first type of terminal and comprises: the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a first control instruction aiming at a first type terminal, and the first control instruction is used for operating interface display of the first type terminal; the generation module is used for calling a local UI configuration function of the first type terminal and generating first local UI information of the first type terminal according to the first control instruction; the first display module is used for rendering and displaying a first interface on the display interface of the first type of terminal by adopting the first local UI information; a determining module configured to determine the first local UI information as first UI information; and the second sending module is used for calling the first linkage UI configuration function and sending the first UI information to the second type terminal.
The embodiment also provides a multi-screen linkage device, which is applied to the second-class terminal and comprises: the second receiving module is used for receiving first UI information of a first type of terminal forwarded by a server, wherein the first UI information is used for displaying a first interface on the first type of terminal; the updating module is used for calling a local UI configuration function of the second type terminal and updating second local UI information of the second type terminal by adopting the first UI information; and the second display module is used for rendering and displaying the first interface on the display interface of the second type terminal by adopting the second local UI information.
Optionally, the updating module includes: the acquisition unit is used for acquiring the local rendering tree of the second class terminal; an updating unit, configured to obtain UI change information according to the first UI information and the local rendering tree, where the UI change information is used to indicate delta update or local update of a current UI of the second class terminal; and updating second local UI information of the second type terminal according to the UI change information.
Optionally, the apparatus further comprises: the judging module is used for judging whether the second type of terminal starts the linkage control function or not; and the confirmation module is used for confirming and calling the local UI configuration function of the second type terminal if the second type terminal starts the linkage control function, and updating the second local UI information of the second type terminal by adopting the first UI information.
It should be noted that each of the above modules may be implemented by software or hardware, and for the latter, it may be implemented by, but not limited to: the modules are all located in the same processor; alternatively, the above modules may be located in different processors in any combination.
Example 3
An embodiment of the invention also provides a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.
Alternatively, in the present embodiment, the above-described storage medium may be configured to store a computer program for performing the steps of:
s1, receiving first UI information sent by a first type of terminal calling a first linkage UI configuration function, wherein the first UI information is used for displaying a first interface on the first type of terminal;
s2, the first UI information is sent to a second type of terminal, so that the second type of terminal displays the first interface, wherein the first linkage UI configuration function is matched with the second type of terminal.
Alternatively, in the present embodiment, the storage medium may include, but is not limited to: a usb disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing a computer program.
An embodiment of the invention also provides an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
Optionally, the electronic device may further include a transmission device and an input/output device, where the transmission device is connected to the processor, and the input/output device is connected to the processor.
Alternatively, in the present embodiment, the above-described processor may be configured to execute the following steps by a computer program:
s1, receiving first UI information sent by a first type of terminal calling a first linkage UI configuration function, wherein the first UI information is used for displaying a first interface on the first type of terminal;
s2, the first UI information is sent to a second type of terminal, so that the second type of terminal displays the first interface, wherein the first linkage UI configuration function is matched with the second type of terminal.
Alternatively, specific examples in this embodiment may refer to examples described in the foregoing embodiments and optional implementations, and this embodiment is not described herein.
The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
In the foregoing embodiments of the present application, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed technology content may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, such as the division of the units, is merely a logical function division, and may be implemented in another manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application and are intended to be comprehended within the scope of the present application.

Claims (13)

1. The multi-screen linkage method is characterized by being applied to a server and comprising the following steps of:
receiving first UI information sent by a first type of terminal calling a first linkage UI configuration function, wherein the first UI information is used for displaying a first interface on the first type of terminal;
and sending the first UI information to a second type terminal so that the second type terminal displays the first interface, wherein the first linkage UI configuration function is matched with the second type terminal.
2. The method of claim 1, wherein the method further comprises:
receiving second UI information sent by a second type terminal by calling a second linkage UI configuration function, wherein the second UI information is used for displaying a second interface on the second type terminal;
and sending the second UI information to a first type terminal so that the first type terminal displays the second interface, wherein the second linkage UI configuration function is matched with the first type terminal.
3. The method of claim 1, wherein before receiving the first UI information sent by the first type of terminal to invoke the first linkage UI configuration function, the method comprises:
constructing a code script for multi-screen linkage control, wherein the code script comprises the linkage UI configuration function;
and issuing the code script to a plurality of terminals to be displayed in a linkage way so that the plurality of terminals run the code script, wherein the plurality of terminals comprise the first type of terminals and the second type of terminals.
4. The multi-screen linkage method is characterized by being applied to a first type of terminal and comprising the following steps of:
acquiring a first control instruction aiming at a first type of terminal, wherein the first control instruction is used for operating interface display of the first type of terminal;
calling a local UI configuration function of the first type terminal, and generating first local UI information of the first type terminal according to the first control instruction;
rendering and displaying a first interface on a display interface of the first type terminal by adopting the first local UI information, and determining the first local UI information as first UI information;
and calling a first linkage UI configuration function, and sending the first UI information to the second type of terminal.
5. The multi-screen linkage method is characterized by being applied to a second type of terminal and comprising the following steps of:
receiving first UI information of a first type of terminal forwarded by a server, wherein the first UI information is used for displaying a first interface on the first type of terminal;
calling a local UI configuration function of the second type terminal, and updating second local UI information of the second type terminal by adopting the first UI information;
and rendering and displaying the first interface on the display interface of the second type terminal by adopting the second local UI information.
6. The method of claim 5, wherein updating the second local UI information of the second class of terminals with the first UI information comprises:
acquiring a local rendering tree of the second class terminal;
obtaining UI change information according to the first UI information and the local rendering tree, wherein the UI change information is used for indicating delta update or local update of the current UI of the second class terminal;
and updating second local UI information of the second type terminal according to the UI change information.
7. The method of claim 5, wherein the method includes, before invoking the local UI configuration function of the second type of terminal and updating the second local UI information of the second type of terminal with the first UI information:
Judging whether the second type of terminal starts a linkage control function or not;
and if the second type terminal starts the linkage control function, confirming to call a local UI configuration function of the second type terminal, and updating second local UI information of the second type terminal by adopting the first UI information.
8. The utility model provides a device of many screen linkages which characterized in that, the application includes at the server:
the first receiving module is used for receiving first UI information sent by a first type of terminal calling a first linkage UI configuration function, wherein the first UI information is used for displaying a first interface on the first type of terminal;
and the first sending module is used for sending the first UI information to a second type of terminal so as to enable the second type of terminal to display the first interface, wherein the first linkage UI configuration function is matched with the second type of terminal.
9. A multi-screen linkage device, characterized in that it is applied to a first type of terminal, comprising:
the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a first control instruction aiming at a first type terminal, and the first control instruction is used for operating interface display of the first type terminal;
the generation module is used for calling a local UI configuration function of the first type terminal and generating first local UI information of the first type terminal according to the first control instruction;
The first display module is used for rendering and displaying a first interface on the display interface of the first type of terminal by adopting the first local UI information;
a determining module configured to determine the first local UI information as first UI information;
and the second sending module is used for calling the first linkage UI configuration function and sending the first UI information to the second type terminal.
10. The multi-screen linkage device is characterized by being applied to a second type of terminal and comprising:
the second receiving module is used for receiving first UI information of a first type of terminal forwarded by a server, wherein the first UI information is used for displaying a first interface on the first type of terminal;
the updating module is used for calling a local UI configuration function of the second type terminal and updating second local UI information of the second type terminal by adopting the first UI information;
and the second display module is used for rendering and displaying the first interface on the display interface of the second type terminal by adopting the second local UI information.
11. A multi-screen linked system, comprising: a server and terminals of a first type and terminals of a second type, wherein,
the server is connected with the first-type terminal and the second-type terminal and is used for executing the device according to claim 8;
The first class of terminals configured to perform the apparatus of claim 9;
the second class of terminals being arranged to perform the apparatus of claim 10.
12. A storage medium comprising a stored program, wherein the program when run performs the method steps of any of the preceding claims 1 to 7.
13. An electronic device comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus; wherein:
a memory for storing a computer program;
a processor for executing the method steps of any one of claims 1 to 7 by running a program stored on a memory.
CN202310127388.0A 2023-02-06 2023-02-06 Multi-screen linkage method, device, system, storage medium and electronic equipment Pending CN116204147A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310127388.0A CN116204147A (en) 2023-02-06 2023-02-06 Multi-screen linkage method, device, system, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310127388.0A CN116204147A (en) 2023-02-06 2023-02-06 Multi-screen linkage method, device, system, storage medium and electronic equipment

Publications (1)

Publication Number Publication Date
CN116204147A true CN116204147A (en) 2023-06-02

Family

ID=86518761

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310127388.0A Pending CN116204147A (en) 2023-02-06 2023-02-06 Multi-screen linkage method, device, system, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN116204147A (en)

Similar Documents

Publication Publication Date Title
US9563414B2 (en) Distribution of content and behavior to disparate platforms
CN108289234B (en) Virtual gift special effect animation display method, device and equipment
CN108449409B (en) Animation pushing method, device, equipment and storage medium
CN105142011A (en) Web-based television terminal multi-screen interaction method and device
CN113727130B (en) Message prompting method, system and device for live broadcasting room and computer equipment
CN108057243B (en) Data display method and device, storage medium and electronic device
CN111031376B (en) Bullet screen processing method and system based on WeChat applet
CN106843794B (en) Split screen display method and system based on android
CN110674040A (en) Application testing method, device, equipment and storage medium
CN112486620A (en) Cross-process off-screen rendering method and device, electronic equipment and storage medium
CN114237840A (en) Resource interaction method, device, terminal and storage medium
CN111031399B (en) Bullet screen processing method and system
CN112911320A (en) Live broadcast method and device, computer equipment and storage medium
CN113434105A (en) Screen projection control method and device, storage medium and electronic equipment
CN105025320B (en) Operable desktop system with hybrid architecture and implementation method thereof
CN112218144B (en) Screen projection control method and device, electronic equipment and computer readable medium
CN111190634B (en) Layout information processing method and device and electronic equipment
CN113242308A (en) Information pushing method, device, equipment and storage medium
CN113244609A (en) Multi-picture display method and device, storage medium and electronic equipment
CN106302670B (en) A kind of picture update method, communication terminal and server
CN107018166B (en) Service display method and terminal
CN116204147A (en) Multi-screen linkage method, device, system, storage medium and electronic equipment
CN113891162B (en) Live broadcast room loading method and device, computer equipment and storage medium
CN113467776B (en) Method and device for accessing equipment, storage medium and electronic device
CN113709541A (en) WEB-based multi-terminal equipment interaction method, system and terminal equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination