CN115379279A - Multi-screen linkage interaction method, device and system, storage medium and electronic equipment - Google Patents

Multi-screen linkage interaction method, device and system, storage medium and electronic equipment Download PDF

Info

Publication number
CN115379279A
CN115379279A CN202210874310.0A CN202210874310A CN115379279A CN 115379279 A CN115379279 A CN 115379279A CN 202210874310 A CN202210874310 A CN 202210874310A CN 115379279 A CN115379279 A CN 115379279A
Authority
CN
China
Prior art keywords
resource
client
target virtual
request
virtual room
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210874310.0A
Other languages
Chinese (zh)
Inventor
周少友
曾宪晖
卢宇翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Coocaa Network Technology Co Ltd
Original Assignee
Shenzhen Coocaa Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Coocaa Network Technology Co Ltd filed Critical Shenzhen Coocaa Network Technology Co Ltd
Priority to CN202210874310.0A priority Critical patent/CN115379279A/en
Publication of CN115379279A publication Critical patent/CN115379279A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel

Abstract

The invention discloses a multi-screen linkage interaction method, a multi-screen linkage interaction device, a multi-screen linkage interaction system, a multi-screen linkage interaction storage medium and electronic equipment, wherein the method comprises the following steps: receiving a first sharing request sent by a first client, wherein the first sharing request is used for sharing a first resource; recording the first resource in a target virtual room according to the first sharing request, wherein a room member set of the target virtual room comprises the first client and a plurality of second clients; and sending a notification message of the first resource to the second clients in a group manner, so that the second clients request and synchronously display the first resource to the target virtual room. The invention solves the technical problem that resources can only be shared through one-to-one screen projection in the related technology, omits the difference of platforms, supports screen interaction under different platforms, ignores the difference of networks, does not need to be limited to a certain local area network, and supports multi-person interaction.

Description

Multi-screen linkage interaction method, device and system, storage medium and electronic equipment
Technical Field
The invention relates to the field of computers, in particular to a multi-screen linkage interaction method, a multi-screen linkage interaction device, a multi-screen linkage interaction system, a multi-screen linkage interaction storage medium and electronic equipment.
Background
In the related art, there are three technical modes for transmitting the screen signal of the mobile device to the remote display device (such as a television, a display screen, etc.) via wireless transmission: DLNA, AIRPLAY, miracast. The screen projection technology of mobile equipment is becoming an important tool in scenes such as teaching and meetings and is widely applied. However, at present, three screen projection modes are one-to-one, one-to-one screen projection cannot support one-to-many screen projection, and simultaneous interaction of multiple people cannot be met.
In the related art, a scheme of realizing a synchronous playing mode of playing an entire picture by multiple terminals through pure software is not uncommon, most of the schemes are realized through hardware or by using an HDMI separator and the like, special hardware is required for support, the schemes are limited by wiring distance, and the flexibility is low. In the video conference in the related art, the video stream collected by the camera is pushed to the server in real time, and the participants pull the video stream from the server, so that very large network bandwidth is required, the control can be performed only at one end, the deployment and maintenance cost is increased, and the large-scale application expansion is inconvenient.
In view of the above problems in the related art, no effective solution has been found at present.
Disclosure of Invention
The embodiment of the invention provides a multi-screen linkage interaction method, a multi-screen linkage interaction device, a multi-screen linkage interaction system, a multi-screen linkage interaction storage medium and electronic equipment.
According to an aspect of the embodiments of the present invention, there is provided a multi-screen linkage interaction method, applied to a server, including: receiving a first sharing request sent by a first client, wherein the first sharing request is used for sharing a first resource; recording the first resource in a target virtual room according to the first sharing request, wherein a room member set of the target virtual room comprises the first client and a plurality of second clients; sending a notification message of the first resource to the second clients in a group manner, so that the second clients request and synchronously display the first resource to the target virtual room.
Optionally, before recording the first resource in the target virtual room according to the first sharing request, the method further includes: receiving a room creation request sent by a creation client; creating the target virtual room on a server based on the creation request, and allocating a fixed storage space for the target virtual room; and receiving a room joining request sent by a joining client, and adding the joining client to the room member set of the target virtual room.
Optionally, the recording the first resource in the target virtual room according to the first sharing request includes: searching a target virtual room matched with the first sharing request; acquiring an initial resource state of the first resource; and storing the first resource and the initial resource state in a storage space corresponding to the target virtual room.
Optionally, the searching for the target virtual room matching the first sharing request includes: analyzing a signaling channel of the first sharing request; and searching a target virtual room matched with the signaling channel in a plurality of virtual rooms, wherein each virtual room corresponds to one signaling channel group.
Optionally, after sending the notification of the first resource to the second clients in a group, the method includes: receiving a status update request sent by the first client, wherein the status update request is used for indicating to update the resource status of the first resource; sending the state updating request to the second clients in a group mode so that the second clients locally and synchronously update the resource state of the first resource.
According to an aspect of the embodiments of the present invention, there is provided a multi-screen linkage interaction method, applied to a first client, including: displaying a first resource on the first client; sending a first sharing request to a server, wherein the first sharing request is used for requesting to share the first resource to a room member set of a target virtual room, wherein the target virtual room is stored on the server, and the room member set of the target virtual room comprises the first client and a plurality of second clients; updating a resource status of the first resource on the first client; sending a status update request to the server, wherein the status update request is used for indicating that the resource status of the first resource is updated.
According to an aspect of the embodiments of the present invention, there is provided a multi-screen linkage interaction method, applied to a second client, including: receiving a notification message sent by a server, wherein the notification message is used for notifying the second client to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room comprises the first client and a plurality of second clients; requesting the first resource from the target virtual room using the resource link; and synchronously displaying the first resource on the second client.
Optionally, after displaying the first resource on the second client, the method further includes: receiving a state updating request sent by the server, wherein the state updating request is used for indicating to update the resource state of the first resource, and the state updating request carries a state control instruction; synchronously controlling a resource state of the first resource on the second client based on the state control instruction.
According to another aspect of the embodiments of the present invention, there is provided a multi-screen linkage interaction device applied to a server, including: a first receiving module, configured to receive a first sharing request sent by a first client, where the first sharing request is used to share a first resource; a recording module, configured to record the first resource in a target virtual room according to the first sharing request, where a room member set of the target virtual room includes the first client and a plurality of second clients; and the linkage module is used for sending the notification message of the first resource to the plurality of second clients in a group manner so that the plurality of second clients request the target virtual room and synchronously display the first resource.
Optionally, the apparatus further comprises: a second receiving module, configured to receive a room creation request sent by a creation client before the recording module records the first resource in a target virtual room according to the first sharing request; the creating module is used for creating the target virtual room on the server based on the creating request and distributing a fixed storage space for the target virtual room; and the joining module is used for receiving a room joining request sent by a joining client and adding the joining client to the room member set of the target virtual room.
Optionally, the recording module includes: a searching unit, configured to search for a target virtual room matching the first sharing request; an obtaining unit, configured to obtain an initial resource state of the first resource; and the existence unit is used for storing the first resource and the initial resource state in a storage space corresponding to the target virtual room.
Optionally, the searching unit includes: the analysis subunit is configured to analyze a signaling channel of the first sharing request; and the searching subunit is used for searching a target virtual room matched with the signaling channel in a plurality of virtual rooms, wherein each virtual room corresponds to one signaling channel group.
Optionally, the apparatus includes: a third receiving module, configured to receive a status update request sent by the first client after the linkage module sends the notification of the first resource to the plurality of second clients in a group, where the status update request is used to indicate that the resource status of the first resource is updated; and the sending module is used for sending the state updating request to the plurality of second clients in a group manner so that the plurality of second clients locally and synchronously update the resource state of the first resource.
According to another aspect of the embodiments of the present invention, there is provided another multi-screen linkage interaction device, applied to a first client, including: a display module for displaying a first resource on the first client; a first sending module, configured to send a first sharing request to a server, where the first sharing request is used to request sharing of the first resource to a room member set of a target virtual room, where the target virtual room is stored on the server, and the room member set of the target virtual room includes the first client and several second clients; an update module to update a resource status of the first resource on the first client; a second sending module, configured to send a status update request to the server, where the status update request is used to indicate that the resource status of the first resource is updated.
According to another aspect of the embodiments of the present invention, there is provided another multi-screen linkage interaction device applied to a second client, including: a first receiving module, configured to receive a notification message sent by a server, where the notification message is used to notify a second client to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room includes the first client and a plurality of the second clients; a request module to request the first resource from the target virtual room using the resource link; and the synchronization module is used for synchronously displaying the first resource on the second client.
Optionally, the apparatus further comprises: a second receiving module, configured to receive a status update request sent by the server after the synchronization module displays the first resource on the second client, where the status update request is used to indicate to update a resource status of the first resource, and the status update request carries a status control instruction; and the control module is used for synchronously controlling the resource state of the first resource on the second client based on the state control instruction.
According to another aspect of the embodiments of the present invention, there is provided a multi-screen linkage interaction system, including: the server is connected with the first client and the second clients and is used for executing the device in the embodiment; the first client is used for executing the device in the embodiment; the second client is configured to execute the apparatus according to the above embodiment.
According to another aspect of the embodiments of the present invention, there is also provided a storage medium including a stored program which executes the above steps when the program is executed.
According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including a processor, a communication interface, a memory and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus; wherein: a memory for storing a computer program; a processor for executing the steps of the method by running the program stored in the memory.
Embodiments of the present invention also provide a computer program product containing instructions, which when run on a computer, cause the computer to perform the steps of the above method.
According to the invention, a first sharing request sent by a first client is received, wherein the first sharing request is used for sharing a first resource, the first resource is recorded in a target virtual room according to the first sharing request, a room member set of the target virtual room comprises the first client and a plurality of second clients, and a notification message of the first resource is sent to the plurality of second clients in a group manner, so that the plurality of second clients request the target virtual room and synchronously display the first resource.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a television according to an embodiment of the present invention;
FIG. 2 is a flowchart of a multi-screen linked interaction method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of resource sharing performed by the same client in multiple virtual rooms according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of the interaction between a client and a server according to an embodiment of the present invention;
FIG. 5 is a flow chart of another multi-screen linked interaction method according to an embodiment of the invention;
FIG. 6 is a flowchart of another multi-screen linked interaction method according to an embodiment of the present invention;
FIG. 7 is a flow chart of a multi-screen linkage according to an embodiment of the present invention;
FIG. 8 is a block diagram of a multi-screen linked interaction device, according to an embodiment of the present invention;
FIG. 9 is a block diagram of a multi-screen linked interactive system according to an embodiment of the present invention;
fig. 10 is a block diagram of an electronic device implementing an embodiment of the invention.
Detailed Description
In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
The method provided by the first embodiment of the present invention may be executed in a television, a mobile phone, a tablet, a computer, a server, a processor, or a similar computing device. Taking an example of the operation on a television, fig. 1 is a hardware structure block diagram of a television according to an embodiment of the present invention. As shown in fig. 1, the tv set may include one or more processors 102 (only one is shown in fig. 1) (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA, etc.) and a memory 104 for storing data, and optionally may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the television set. For example, a television may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used to store a television program, for example, a software program and a module of an application software, such as a television program corresponding to a multi-screen linkage interaction method in an embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the television program stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to a television set over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of a television set. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices via a base station to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used to communicate with the internet in a wireless manner.
In the present embodiment, a multi-screen linkage interaction method is provided, and fig. 2 is a flowchart of a multi-screen linkage interaction method according to an embodiment of the present invention, as shown in fig. 2, the flowchart includes the following steps:
step S202, receiving a first sharing request sent by a first client, wherein the first sharing request is used for sharing a first resource;
the network ecology of the application of the embodiment includes: server, client (e.g., mobile phone, television, computer, etc.).
Optionally, the first resource of this embodiment may be screen projection, file, voice, streaming media (video, picture, etc.), and other contents. The first share request is for requesting sharing of a first resource on a number of second clients.
Step S204, recording a first resource in a target virtual room according to a first sharing request, wherein a room member set of the target virtual room comprises a first client and a plurality of second clients;
the first sharing request may carry a data packet of the first resource, or the server may actively pull the first resource from the first client after receiving the first sharing request, and then store a complete data packet (such as a video, a file, a voice, and the like) of the first resource in an upper target virtual room of the server, where the target virtual room may be a network disk or a cloud disk on the server.
Optionally, a plurality of virtual rooms are created on the server, each virtual room is distinguished by a room identifier (e.g., a room ID, a storage directory), each virtual room is equivalent to a virtual conference room, and only clients creating the virtual room or joining the virtual room can share resources requested to be shared by room members in the virtual room.
Step S206, sending notification messages of the first resources to a plurality of second clients in a group manner, so that the plurality of second clients request the target virtual room and synchronously display the first resources;
in one example, after sending the notification message of the first resource to several second clients in a group, the server may also actively push the first resource to the second clients, or carry the first resource in the notification message.
Optionally, the notification message carries a download path or a download link of the first resource on the server. In some examples, to further implement multi-end synchronization, a notification message of the first resource may also be sent to a room member set (including the first client and several second clients) of the target virtual room in a group manner, so that the room member set of the target virtual room requests and synchronously displays the first resource.
Through the steps, a first sharing request sent by a first client is received, wherein the first sharing request is used for sharing a first resource, the first resource is recorded in a target virtual room according to the first sharing request, a room member set of the target virtual room comprises the first client and a plurality of second clients, and a notification message of the first resource is sent to the plurality of second clients in a group mode, so that the plurality of second clients request the target virtual room and synchronously display the first resource.
The scheme of the embodiment can also be applied to video conferences, remote teaching, screen-connected entertainment and other scenes.
In one implementation of the embodiment, before recording the first resource in the target virtual room according to the first sharing request, the method further includes: receiving a room creation request sent by a creation client; creating a target virtual room on the server based on the creation request, and allocating a fixed storage space for the target virtual room; and receiving a room joining request sent by the joining client, and adding the joining client to the room member set of the target virtual room.
After the target virtual room is created, the target virtual room is bound with the distributed fixed storage space, and resources which the client of any room member wants to share are uploaded, transferred and issued based on the corresponding fixed storage space. When a target virtual room is created, a room ID is generated, an invitation code, a conference password and the like can be set, and any joining client wishing to join the target virtual room can join the target virtual room through the room information and the verification information to become a member of the room member set.
Optionally, a signaling channel group is created simultaneously when a target virtual room is created, all clients joining the virtual room automatically join the signaling channel group, and after joining, signaling interaction of each client is supported; the server and the clients transmit data and instructions by using signaling channels in the corresponding group, and optionally, each client in the room member set allocates one signaling channel in the group matched with the target virtual room.
In one example, recording the first resource in the target virtual room according to the first sharing request includes:
s11, searching a target virtual room matched with the first sharing request;
optionally, the searching for the target virtual room matching the first sharing request includes: analyzing a signaling channel of the first sharing request; and searching a target virtual room matched with the signaling channel in a plurality of virtual rooms, wherein each virtual room corresponds to one signaling channel group.
The signaling channel is a channel that transmits the first share request between the server and the first client. In some examples, a first client joins multiple virtual rooms simultaneously, such as room 1 and room 2, and when interacting with different devices in multiple rooms simultaneously, uses signaling channel 1 when sharing resource 1 to member set 1 in room 1, and uses signaling channel 2 when sharing resource 2 to member set 2 in room 2, one client may join different virtual rooms simultaneously, and each virtual room is displayed and interacted independently.
Fig. 3 is a schematic diagram illustrating resource sharing performed by the same client in multiple virtual rooms according to the embodiment of the present invention, where the client a joins in a virtual room a and a virtual room B at the same time, the room member sets of each virtual room are a client B1-a client N1 and a client B2-a client N2, and the client a uses a signaling channel 1 and a signaling channel 2 to perform resource sharing and resource state updating with the virtual room a and the virtual room B, respectively.
S12, acquiring an initial resource state of the first resource;
optionally, the initial resource state of the first resource may be an initial display state of the first resource, which corresponds to a current display state of the first resource on the first client, such as a display state of a text on a home page, a display state of a multimedia in an initial playing progress, a display state of a picture in an original scale, and the like. The initial resource state of this embodiment corresponds to a display form of the first resource, and is used to control an initial display form of the first resource after the first resource is shared to the second client.
And S13, storing the first resource and the initial resource state in a storage space corresponding to the target virtual room.
In an implementation manner of this embodiment, after sending the notification of the first resource to the plurality of second clients in a group, the method further includes: receiving a state updating request sent by a first client, wherein the state updating request is used for indicating to update the resource state of the first resource; and sending a state updating request to the second clients in a group manner so that the second clients locally and synchronously update the resource state of the first resource.
In addition, when a certain second client serves as a control end, the resource state of the first resource can be updated, and multi-user synchronization and interaction are further achieved. The method comprises the following steps: after sending the notification of the first resource to the plurality of second clients in a group, the method further comprises: receiving a state updating request sent by a second client, wherein the state updating request is used for indicating the resource state of the first resource to be updated; and sending a state updating request to other second clients and the first client in a group mode so that the other second clients and the first client locally update the resource state of the first resource in an abnormal screen mode.
In an example, the network transmission delay of the status update request may be further considered, an end-to-end delay (transmission delay between a client in the target virtual room and another client in the control signaling) is calculated, after the first client performs the status update operation, the corresponding status update request is triggered, the status update request is sent to the server, and after the first client delays the duration of the end-to-end delay, the status update operation is responded on the first client, so that the status update operation is responded synchronously on all the clients.
Optionally, the state update request may be a play request, a pause request, a page turn request, an enlargement request, a reduction request, and the like, and after the first client performs the state update operation (play, pause, page turn, enlargement, reduction, and the like) on the first resource, the corresponding state update request is automatically triggered, so that the first resource on the second client performs the state update operation at the same time, and multi-end synchronous display of the first resource is realized.
Fig. 4 is an interaction diagram of a client and a server according to an embodiment of the present invention, where the client creates a virtual room on the server, and then the client of a certain room member in the virtual room initiates resource sharing, or ends resource sharing, and in a sharing project, the resource state of the shared resource can be updated in real time.
The first client and the second client in this embodiment are clients participating in multi-screen interaction, and may be smart phones, PCs, and various intelligent hardware including screens, such as televisions and outdoor curtain walls, where each client may share the client, may also passively display the shares of other clients, and may interact with other clients.
In this embodiment, another multi-screen linkage interaction method is provided, and fig. 5 is a flowchart of another multi-screen linkage interaction method according to an embodiment of the present invention, which is applied to a first client, as shown in fig. 5, the flowchart includes the following steps:
step S502, displaying a first resource on a first client;
step S504, a first sharing request is sent to a server, wherein the first sharing request is used for requesting to share a first resource to a room member set of a target virtual room, the target virtual room is stored on the server, and the room member set of the target virtual room comprises a first client and a plurality of second clients;
the first client terminal automatically triggers the first sharing request by clicking a button or taking the first client terminal device as a sharing terminal, taking other terminals in the virtual room as shared terminals, and selecting the resource to be shared by the first terminal.
Step S506, updating the resource state of the first resource on the first client;
by monitoring the state updating operation of the first client for the first resource, the state updating request corresponding to the state updating operation is automatically triggered, and if the state updating operation is play, pause, page turning, zooming in and zooming out, the state updating request can be a play instruction, a pause instruction and the like.
Step S508, sending a status update request to the server, where the status update request is used to indicate to update the resource status of the first resource.
In this embodiment, another multi-screen linkage interaction method is provided, and fig. 6 is a flowchart of another multi-screen linkage interaction method according to an embodiment of the present invention, which is applied to a second client, as shown in fig. 6, the flowchart includes the following steps:
step S602, receiving a notification message sent by a server, where the notification message is used to notify second clients to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room includes the first client and a plurality of second clients;
step S604, a resource link is adopted to request a first resource from a target virtual room;
step S606, synchronously displaying the first resource on the second client.
Optionally, after displaying the first resource on the second client, the method further includes: receiving a state updating request sent by a server, wherein the state updating request is used for indicating to update the resource state of the first resource and carries a state control instruction; resource state of the first resource is synchronously controlled on the second client based on the state control instruction.
In another example, the second client may also send a status update request, including: and sending a state updating permission to the first client or the server, sending a state updating request to the server after the first client or the server agrees, and forwarding the state updating request to other clients (including the first client) in the room member set by the server, so that multi-terminal interaction is realized.
FIG. 7 is a flowchart of multi-screen linkage according to an embodiment of the present invention, where the flowchart includes:
s71, when a client A wants to perform multi-screen interaction, a server is requested to create a virtual room, and all other clients needing to perform interaction are invited to join the virtual room or actively join the virtual room;
s72, when the server side creates the virtual room, a signaling channel group is created at the same time, all the clients N which join the virtual room automatically join the signaling channel group, and after joining, signaling interaction of each client is supported;
s73, calling an interface of a server by the client A to initiate sharing, updating the state of the virtual room by the server, recording the current shared resource and the initial state, simultaneously sending a signaling to other clients N in the virtual room in a group mode through a signaling channel, requesting the current latest shared information from the server after the other clients N receive the signaling, then displaying the current latest shared information, and refreshing the state;
s74, the sharing initiator calls the state update interface of the server, may update the state of the current resource, and simultaneously broadcasts the state update signaling through the signaling channel, and after receiving the signaling, the other clients refresh the state of the current resource, for example: play, pause, page turn, zoom in and out, etc.;
when other clients want to share new content, the operation of S73 is repeatedly executed;
a new client adds into the virtual room, requests the sharing state of the current room, and displays the shared content if the shared content exists; the initiator of the client sharing executes the sharing ending, calls the server interface to update the sharing state, simultaneously broadcasts an ending signaling through the signaling channel, and other clients update the state after receiving the signaling; a client can join different virtual rooms at the same time, and the display and interaction of each virtual room are independent.
By adopting the scheme of the embodiment, cross-platform multi-screen interaction can be realized, cross-network real-time response is realized, the difference of the network is ignored, a local area network is not limited, and screen joining interaction under different networks can be supported; different interactions with a plurality of screens are supported at the same time; differences of platforms are ignored, screen interaction under different platforms is supported, sharing of different contents is supported, the method is not limited to screen projection, and sharing of contents such as files, voice and streaming media is supported; the multi-person interaction is supported, and when sharing, the sharing can be realized through modes of voice, characters, video and the like, and the shared resources can be synchronously operated in real time; the method supports the same equipment, simultaneously interacts with a plurality of different equipment and supports multiple tasks.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention or portions thereof contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (which may be a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
Example 2
The present embodiment further provides a multi-screen linkage interaction device and system, which are used to implement the foregoing embodiments and preferred embodiments, and the description of the multi-screen linkage interaction device and system is omitted. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 8 is a block diagram illustrating a multi-screen linkage interaction device according to an embodiment of the present invention, and as shown in fig. 8, the device is applied to a server, and the device includes: a first receiving module 80, a recording module 82, a linkage module 84, wherein,
a first receiving module 80, configured to receive a first sharing request sent by a first client, where the first sharing request is used to share a first resource;
a recording module 82, configured to record the first resource in a target virtual room according to the first sharing request, where a room member set of the target virtual room includes the first client and a plurality of second clients;
a linkage module 84, configured to send a notification message of the first resource to the second clients in a group, so that the second clients request and synchronously display the first resource from the target virtual room.
Optionally, the apparatus further comprises: a second receiving module, configured to receive a room creation request sent by a creation client before the recording module records the first resource in a target virtual room according to the first sharing request; the creating module is used for creating the target virtual room on the server based on the creating request and distributing a fixed storage space for the target virtual room; and the joining module is used for receiving a room joining request sent by a joining client and adding the joining client to the room member set of the target virtual room.
Optionally, the recording module includes: a searching unit, configured to search for a target virtual room matching the first sharing request; an obtaining unit, configured to obtain an initial resource state of the first resource; and the existence unit is used for storing the first resource and the initial resource state in a storage space corresponding to the target virtual room.
Optionally, the searching unit includes: the analysis subunit is configured to analyze a signaling channel of the first sharing request; and the searching subunit is used for searching a target virtual room matched with the signaling channel in a plurality of virtual rooms, wherein each virtual room corresponds to one signaling channel group.
Optionally, the apparatus includes: a third receiving module, configured to receive a status update request sent by the first client after the linkage module sends the notification of the first resource to the plurality of second clients in a group, where the status update request is used to indicate that the resource status of the first resource is updated; and the sending module is used for sending the state updating request to the plurality of second clients in a group manner so that the plurality of second clients locally and synchronously update the resource state of the first resource.
Fig. 9 is a block diagram of a multi-screen linkage interaction system according to an embodiment of the present invention, and as shown in fig. 9, the multi-screen linkage interaction system includes: a server 90 and a first client 92 and a plurality of second clients 94, wherein the server 90 is connected to the first client 92 and the plurality of second clients 94 for executing the apparatus according to the above embodiment; the first client 92 is configured to execute the following devices according to the following embodiments; the second client 94 is configured to execute the following devices according to the following embodiments.
The embodiment further provides an interaction device for multi-screen linkage, which is applied to the first client, and includes: a display module for displaying a first resource on the first client; a first sending module, configured to send a first sharing request to a server, where the first sharing request is used to request sharing of the first resource to a room member set of a target virtual room, where the target virtual room is stored on the server, and the room member set of the target virtual room includes the first client and several second clients; an update module to update a resource status of the first resource on the first client; a second sending module, configured to send a status update request to the server, where the status update request is used to indicate that the resource status of the first resource is updated.
The embodiment further provides an interaction device for multi-screen linkage, which is applied to the second client, and includes: a first receiving module, configured to receive a notification message sent by a server, where the notification message is used to notify a second client of sharing a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room includes the first client and a plurality of second clients; a request module to request the first resource from the target virtual room using the resource link; and the synchronization module is used for synchronously displaying the first resource on the second client.
Optionally, the apparatus further comprises: a second receiving module, configured to receive a status update request sent by the server after the synchronization module displays the first resource on the second client, where the status update request is used to indicate to update a resource status of the first resource, and the status update request carries a status control instruction; and the control module is used for synchronously controlling the resource state of the first resource on the second client based on the state control instruction.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Example 3
Fig. 10 is a structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 10, the electronic device includes a processor 101, a communication interface 102, a memory 103, and a communication bus 104, where the processor 101, the communication interface 102, and the memory 103 complete mutual communication through the communication bus 104, and the memory 103 is used for storing a computer program; the processor 101 is configured to implement the following steps when executing the program stored in the memory 103: receiving a first sharing request sent by a first client, wherein the first sharing request is used for sharing a first resource; recording the first resource in a target virtual room according to the first sharing request, wherein a room member set of the target virtual room comprises the first client and a plurality of second clients; sending a notification message of the first resource to the second clients in a group manner, so that the second clients request and synchronously display the first resource to the target virtual room.
The communication bus mentioned in the above terminal may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the terminal and other equipment.
The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, or discrete hardware components.
In another embodiment provided by the present application, a computer-readable storage medium is further provided, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute the multi-screen linkage interaction method according to any one of the above embodiments.
In another embodiment provided by the present application, there is also provided a computer program product containing instructions, which when run on a computer, causes the computer to execute the multi-screen linkage interaction method according to any one of the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), among others.
The above description is only for the preferred embodiment of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application are included in the protection scope of the present application.
The above description is merely exemplary of the present application and is presented to enable those skilled in the art to understand and practice the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (14)

1. A multi-screen linkage interaction method is applied to a server and comprises the following steps:
receiving a first sharing request sent by a first client, wherein the first sharing request is used for sharing a first resource;
recording the first resource in a target virtual room according to the first sharing request, wherein a room member set of the target virtual room comprises the first client and a plurality of second clients;
sending a notification message of the first resource to the second clients in a group manner, so that the second clients request and synchronously display the first resource to the target virtual room.
2. The method of claim 1, wherein prior to recording the first resource in a target virtual room in accordance with the first share request, the method further comprises:
receiving a room creation request sent by a creation client;
creating the target virtual room on a server based on the creation request, and allocating a fixed storage space for the target virtual room;
and receiving a room joining request sent by a joining client, and adding the joining client to the room member set of the target virtual room.
3. The method of claim 1, wherein recording the first resource in a target virtual room according to the first sharing request comprises:
searching a target virtual room matched with the first sharing request;
acquiring an initial resource state of the first resource;
and storing the first resource and the initial resource state in a storage space corresponding to the target virtual room.
4. The method of claim 3, wherein finding the target virtual room matching the first share request comprises:
analyzing a signaling channel of the first sharing request;
and searching a target virtual room matched with the signaling channel in a plurality of virtual rooms, wherein each virtual room corresponds to one signaling channel group.
5. The method of claim 1, wherein after sending the notification of the first resource to the number of second clients in a group, the method comprises:
receiving a status update request sent by the first client, wherein the status update request is used for indicating to update the resource status of the first resource;
sending the state updating request to the second clients in a group mode so that the second clients locally and synchronously update the resource state of the first resource.
6. A multi-screen linkage interaction method is applied to a first client, and comprises the following steps:
displaying a first resource on the first client;
sending a first sharing request to a server, wherein the first sharing request is used for requesting to share the first resource to a room member set of a target virtual room, the target virtual room is stored on the server, and the room member set of the target virtual room comprises the first client and a plurality of second clients;
updating a resource status of the first resource on the first client;
sending a status update request to the server, wherein the status update request is used for indicating the resource status of the first resource is updated.
7. A multi-screen linkage interaction method is applied to a second client, and comprises the following steps:
receiving a notification message sent by a server, wherein the notification message is used for notifying the second client to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room comprises the first client and a plurality of second clients;
requesting the first resource from the target virtual room using the resource link;
and synchronously displaying the first resource on the second client.
8. The method of claim 7, wherein after displaying the first resource on the second client, the method further comprises:
receiving a state updating request sent by the server, wherein the state updating request is used for indicating to update the resource state of the first resource, and the state updating request carries a state control instruction;
synchronously controlling the resource state of the first resource on the second client based on the state control instruction.
9. The utility model provides an interactive installation of many screens linkage which characterized in that, uses at the server side, includes:
a first receiving module, configured to receive a first sharing request sent by a first client, where the first sharing request is used to share a first resource;
a recording module, configured to record the first resource in a target virtual room according to the first sharing request, where a room member set of the target virtual room includes the first client and a plurality of second clients;
and the linkage module is used for sending the notification message of the first resource to the plurality of second clients in a group manner so that the plurality of second clients request the target virtual room and synchronously display the first resource.
10. A multi-screen linkage interaction device is applied to a first client side and comprises:
a display module for displaying a first resource on the first client;
a first sending module, configured to send a first sharing request to a server, where the first sharing request is used to request sharing of the first resource to a room member set of a target virtual room, where the target virtual room is stored on the server, and the room member set of the target virtual room includes the first client and several second clients;
an update module to update a resource status of the first resource on the first client;
a second sending module, configured to send a status update request to the server, where the status update request is used to indicate that the resource status of the first resource is updated.
11. A multi-screen linkage interaction device is applied to a second client, and comprises:
a first receiving module, configured to receive a notification message sent by a server, where the notification message is used to notify a second client to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room includes the first client and a plurality of the second clients;
a request module to request the first resource from the target virtual room using the resource link;
and the synchronization module is used for synchronously displaying the first resource on the second client.
12. A multi-screen linkage interaction system, comprising: a server, a first client and a plurality of second clients, wherein,
the server, connected with the first client and a plurality of second clients, for executing the apparatus of claim 9;
the first client to execute the apparatus of claim 10;
the second client configured to execute the apparatus of claim 11.
13. A storage medium, characterized in that the storage medium comprises a stored program, wherein the program when executed performs the method steps of any of the preceding claims 1 to 8.
14. An electronic device comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus; wherein:
a memory for storing a computer program;
a processor for performing the method steps of any of claims 1 to 8 by executing a program stored on a memory.
CN202210874310.0A 2022-07-22 2022-07-22 Multi-screen linkage interaction method, device and system, storage medium and electronic equipment Pending CN115379279A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210874310.0A CN115379279A (en) 2022-07-22 2022-07-22 Multi-screen linkage interaction method, device and system, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210874310.0A CN115379279A (en) 2022-07-22 2022-07-22 Multi-screen linkage interaction method, device and system, storage medium and electronic equipment

Publications (1)

Publication Number Publication Date
CN115379279A true CN115379279A (en) 2022-11-22

Family

ID=84062339

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210874310.0A Pending CN115379279A (en) 2022-07-22 2022-07-22 Multi-screen linkage interaction method, device and system, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN115379279A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115499256A (en) * 2022-07-27 2022-12-20 深圳市酷开网络科技股份有限公司 Resource linkage display method, device and system, storage medium and electronic equipment

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331287A (en) * 2015-06-24 2017-01-11 中兴通讯股份有限公司 Synchronization method and device for terminal screen contents
WO2017121180A1 (en) * 2016-01-15 2017-07-20 优视科技(中国)有限公司 Multi-screen interaction method, device, server and non-transitory machine-readable storage medium
CN108876081A (en) * 2017-05-16 2018-11-23 腾讯科技(深圳)有限公司 virtual room distribution method, device, storage medium and processor
CN109525902A (en) * 2018-11-15 2019-03-26 贵阳语玩科技有限公司 A kind of method and device of more people's Real-Time Sharing videos
CN110035329A (en) * 2018-01-11 2019-07-19 腾讯科技(北京)有限公司 Image processing method, device and storage medium
KR20200040406A (en) * 2018-10-10 2020-04-20 에스케이텔레콤 주식회사 Method And Apparatus for Sharing Virtual Mobile Infrastructure Screen
US20200177645A1 (en) * 2018-11-30 2020-06-04 Eiichiro Yoshida Content management server, information sharing system, and communication control method
US20200293261A1 (en) * 2019-03-15 2020-09-17 Microsoft Technology Licensing, Llc User Interaction with Shared Content During a Virtual Meeting
WO2021223453A1 (en) * 2020-05-06 2021-11-11 上海幻电信息科技有限公司 Multi-screen interactive display method and apparatus
CN113891128A (en) * 2021-09-18 2022-01-04 上海豹云网络信息服务有限公司 Screen sharing method and device and electronic equipment

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331287A (en) * 2015-06-24 2017-01-11 中兴通讯股份有限公司 Synchronization method and device for terminal screen contents
WO2017121180A1 (en) * 2016-01-15 2017-07-20 优视科技(中国)有限公司 Multi-screen interaction method, device, server and non-transitory machine-readable storage medium
CN108876081A (en) * 2017-05-16 2018-11-23 腾讯科技(深圳)有限公司 virtual room distribution method, device, storage medium and processor
CN110035329A (en) * 2018-01-11 2019-07-19 腾讯科技(北京)有限公司 Image processing method, device and storage medium
KR20200040406A (en) * 2018-10-10 2020-04-20 에스케이텔레콤 주식회사 Method And Apparatus for Sharing Virtual Mobile Infrastructure Screen
CN109525902A (en) * 2018-11-15 2019-03-26 贵阳语玩科技有限公司 A kind of method and device of more people's Real-Time Sharing videos
US20200177645A1 (en) * 2018-11-30 2020-06-04 Eiichiro Yoshida Content management server, information sharing system, and communication control method
US20200293261A1 (en) * 2019-03-15 2020-09-17 Microsoft Technology Licensing, Llc User Interaction with Shared Content During a Virtual Meeting
WO2021223453A1 (en) * 2020-05-06 2021-11-11 上海幻电信息科技有限公司 Multi-screen interactive display method and apparatus
CN113891128A (en) * 2021-09-18 2022-01-04 上海豹云网络信息服务有限公司 Screen sharing method and device and electronic equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115499256A (en) * 2022-07-27 2022-12-20 深圳市酷开网络科技股份有限公司 Resource linkage display method, device and system, storage medium and electronic equipment

Similar Documents

Publication Publication Date Title
CN105335112B (en) Multi-screen display information processing and main control end content sending method and device
US20150365453A1 (en) Media projection method and device, control terminal and cloud server
EP3926917B1 (en) Data transmission method, device and computer storage medium
EP2933982B1 (en) Media stream transfer method and user equipment
CN111031368B (en) Multimedia playing method, device, equipment and storage medium
US20200304547A1 (en) Method and System for Elevating A Phone Call into A Video Conferencing Session
CN105407369A (en) Web application based terminal communication method and device
CN102325144A (en) Method and system for interconnection between media equipment and multimedia equipment
WO2020216059A1 (en) Network resource sharing method and related apparatus
CN111654742B (en) Remote intelligent linkage screen projection method and system
CN105323628B (en) Cross-screen playing method and system based on DLNA (digital Living network alliance), browser end device and playing device
CN113923470B (en) Live stream processing method and device
CN104394127A (en) A multimedia sharing method, device and system
CN112738540A (en) Multi-device live broadcast switching method, device and system, electronic device and readable storage medium
WO2015180446A1 (en) System and method for maintaining connection channel in multi-device interworking service
CN108574689B (en) Method and device for video call
CN112788053A (en) Real-time communication method, device, server, system and storage medium
WO2013166762A1 (en) Networking method and system for personal area network devices
CN110557612B (en) Control method of monitoring equipment and video networking system
CN109862307B (en) Video conference initiating method and device
CN115379279A (en) Multi-screen linkage interaction method, device and system, storage medium and electronic equipment
CN109698818B (en) Method and device for acquiring online user and cross-streaming media communication
WO2016197955A1 (en) Multimedia stream multicasting method and device
WO2017092323A1 (en) Main control device, playing device and data transmission method therefor
CN112422880A (en) Video conference method, terminal device and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination