CN115499693A

CN115499693A - Multi-screen different display control method, device and system, storage medium and electronic equipment

Info

Publication number: CN115499693A
Application number: CN202210950780.0A
Authority: CN
Inventors: 俞湛; 曾宪晖
Original assignee: Shenzhen Coocaa Network Technology Co Ltd
Current assignee: Shenzhen Coocaa Network Technology Co Ltd
Priority date: 2022-08-09
Filing date: 2022-08-09
Publication date: 2022-12-20

Abstract

The invention discloses a control method, a device, a system, a storage medium and electronic equipment for multi-screen different display, wherein the method comprises the following steps: receiving a first sharing request sent by a first client, wherein the first sharing request is used for sharing a first resource; recording a first resource in a target virtual room according to a first sharing request, wherein a room member set of the target virtual room comprises a first client and a plurality of second clients, and each second client corresponds to one display parameter; and sending a notification message of the first resource to the plurality of second clients in a group manner, so that the plurality of second clients request the target virtual room and synchronously display the first resource on the different screens according to the display parameters. According to the invention, the technical problem that resources can not be shared synchronously on different screens in the related technology is solved, multi-user interaction is supported, differential display can be realized, and differential and diversified display of a display end is realized.

Description

Multi-screen different display control method, device and system, storage medium and electronic equipment

Technical Field

The invention relates to the field of computers, in particular to a control method, a control device, a control system, a storage medium and electronic equipment for multi-screen different display.

Background

In the related art, the multi-screen display includes a multi-screen simultaneous display and a multi-screen separate display. The multi-screen simultaneous display refers to displaying the same content on a plurality of display screens; the multi-screen display is that different contents can be displayed on a plurality of android devices respectively.

In the related technology, there are two different display schemes for multiple screens, one is to access the cable and take other display screens as an expansion screen; the other is that virtual screen data is created by a main screen and transmitted to other display screens through a network, the other display screens display the virtual screen data, and the transmitted data is complete screen data or a recorded video stream; the multi-screen different display scheme has distance limitation due to the fact that a plurality of wired connections are used. In the multi-screen different display scheme, the screen is easy to display in a mode that a main screen sends display data codes to other display screens and only one main display screen is available, and when more accessed screens are available, the burden of the main screen is too heavy. In the multi-screen different display scheme, the sent display data is actually video data, which is equivalent to that the main screen records the screen code and then sends the screen code to other screens for decoding and playing, the resolution and the network speed of different screens are different, the clarity and the fluency of the video playing are affected, and the proportions of different screens are different, for example, one screen is 16. The multi-screen different display scheme lacks the connection between direct contents of screens, particularly controls the synchronization aspect, and has no way to operate when other devices want to control the main screen device to page documents.

In view of the above problems in the related art, no effective solution has been found at present.

Disclosure of Invention

The embodiment of the invention provides a multi-screen different display control method, a multi-screen different display control device, a multi-screen different display control system, a storage medium and electronic equipment.

According to an aspect of the embodiments of the present invention, a method for controlling a multi-screen display is provided, which is applied to a server, and includes: receiving a first sharing request sent by a first client, wherein the first sharing request is used for sharing a first resource; recording the first resource in a target virtual room according to the first sharing request, wherein a room member set of the target virtual room comprises the first client and a plurality of second clients, and each second client corresponds to one display parameter; and sending a notification message of the first resource to the second clients in a group manner so that the second clients request the target virtual room and synchronously display the first resource on different screens according to the display parameters.

Optionally, before recording the first resource in the target virtual room according to the first sharing request, the method further includes: receiving a room creation request sent by a creation client; creating the target virtual room on a server based on the creation request, and allocating a fixed storage space for the target virtual room; and receiving a room joining request sent by a joining client, and adding the joining client to the room member set of the target virtual room.

Optionally, sending the notification message of the first resource to the plurality of second clients in a group includes: sending a first field, a second field and a third field to the plurality of second clients in a group, wherein the first field indicates a message type of the notification message, the second field is used for indicating a service type for the first resource, the third field is used for a room identifier of the target virtual room, and the notification message carries the first field, the second field and the third field.

Optionally, after sending the notification of the first resource to the second clients in a group, the method includes: receiving a status update request sent by the first client, wherein the status update request is used for indicating to update the resource status of the first resource; and sending the state updating request to the second clients in a group manner so that the second clients locally update the resource state of the first resource in an abnormal screen manner.

According to an aspect of the embodiments of the present invention, there is provided a control method for multi-screen different display, which is applied to a second client, and includes: receiving a notification message sent by a server, wherein the notification message is used for notifying the second client to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room comprises the first client and a plurality of second clients; requesting the first resource from the target virtual room using the resource link; acquiring display parameters of the second client; and displaying the first resource according to the display parameter.

Optionally, the obtaining of the display parameter of the second client includes: acquiring the display size of a display screen of the second client; acquiring the resolution of a display screen of the second client; and acquiring a function characteristic parameter of a display screen of the second client, wherein the function characteristic parameter is used for indicating a display control function supported by the second client.

Optionally, the display parameters include a display size, a resolution, and functional characteristic parameters, and displaying the first resource according to the display parameters includes: displaying a resource interface of the first resource according to the display size and the resolution; analyzing the functional characteristic parameters, determining a first control operation type set supported by the second client hardware, and determining a second control operation type set supported by the display size; and selecting a target control operation type set contained in both the first control operation type set and the second control operation type set, and displaying a control assembly corresponding to the target control operation type set on the resource interface.

Optionally, the resource interface for displaying the first resource according to the display size and the resolution includes: determining a maximum resolution supported by the second client; rendering the resource interface of the first resource according to the maximum resolution; judging whether the display size is smaller than a preset size or not; if the display size is smaller than the preset size, triggering an amplification instruction, and amplifying and displaying the resource interface of the first resource; and if the display size is larger than or equal to the preset size, displaying the resource interface according to the maximum size.

According to another aspect of the embodiments of the present invention, there is provided a control device for multi-screen different display, which is applied to a server, and includes: a first receiving module, configured to receive a first sharing request sent by a first client, where the first sharing request is used to share a first resource; a recording module, configured to record the first resource in a target virtual room according to the first sharing request, where a room member set of the target virtual room includes the first client and a plurality of second clients, and each second client corresponds to one display parameter; and the display-on-screen module is used for sending the notification message of the first resource to the plurality of second client-sides in a group so that the plurality of second client-sides request the target virtual room and synchronously display the first resource on a display-on-screen according to the display parameters.

Optionally, the apparatus further comprises: a second receiving module, configured to receive a room creation request sent by a creation client before the recording module records the first resource in a target virtual room according to the first sharing request; the creating module is used for creating the target virtual room on the server based on the creating request and distributing a fixed storage space for the target virtual room; and the adding module is used for receiving a room adding request sent by a adding client and adding the adding client to the room member set of the target virtual room.

Optionally, the display module includes: a sending unit, configured to send a first field, a second field, and a third field to the plurality of second clients in a group, where the first field indicates a message type of the notification message, the second field is used to indicate a service type for the first resource, the third field is used for a room identifier of the target virtual room, and the notification message carries the first field, the second field, and the third field.

Optionally, the apparatus includes: a third receiving module, configured to receive a status update request sent by the first client after the first resource notification is sent to the second clients in a group by the video-on-demand module, where the status update request is used to indicate that the resource status of the first resource is updated; and the mass sending module is used for sending the state updating requests to the second clients in a mass mode so that the second clients can update the resource state of the first resource on local different screens.

According to another aspect of the embodiments of the present invention, there is provided another control apparatus for multi-screen display, which is applied to a second client, and includes: a receiving module, configured to receive a notification message sent by a server, where the notification message is used to notify a second client to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room includes the first client and a plurality of second clients; a request module to request the first resource from the target virtual room using the resource link; the acquisition module is used for acquiring the display parameters of the second client; and the display module is used for displaying the first resource according to the display parameter.

Optionally, the obtaining module includes: a first obtaining unit, configured to obtain a display size of a display screen of the second client; the second acquisition unit is used for acquiring the resolution of the display screen of the second client; and a third obtaining unit, configured to obtain a functional characteristic parameter of a display screen of the second client, where the functional characteristic parameter is used to indicate a display control function supported by the second client.

Optionally, the display parameters include display size, resolution and functional characteristic parameters, and the display module includes: the first display unit is used for displaying the resource interface of the first resource according to the display size and the resolution; the determining unit is used for analyzing the functional characteristic parameters, determining a first control operation type set supported by the second client hardware, and determining a second control operation type set supported by the display size; and the second display unit is used for selecting a target control operation type set contained in both the first control operation type set and the second control operation type set, and displaying a control assembly corresponding to the target control operation type set on the resource interface.

Optionally, the first display unit includes: a determining subunit, configured to determine a maximum resolution supported by the second client; a rendering subunit, configured to render a resource interface of the first resource according to the maximum resolution; a judging subunit, configured to judge whether the display size is smaller than a preset size; the display subunit is used for triggering an amplification instruction and amplifying and displaying the resource interface of the first resource if the display size is smaller than a preset size; and if the display size is larger than or equal to the preset size, displaying the resource interface according to the maximum size.

According to another aspect of the embodiments of the present invention, there is provided a control system for multi-screen different display, including: the server is connected with the first client and the second clients and is used for executing the device in the embodiment; the first client includes: a display module for displaying a first resource on the first client; the first sending module is used for sending a first sharing request to the server; an update module to update a resource status of the first resource on the first client; a second sending module, configured to send a status update request to the server, where the status update request is used to indicate that the resource status of the first resource is updated; the second client is configured to execute the apparatus according to the above embodiment.

According to another aspect of the embodiments of the present invention, there is also provided a storage medium including a stored program which executes the above steps when the program is executed.

According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including a processor, a communication interface, a memory and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus; wherein: a memory for storing a computer program; a processor for executing the steps of the method by running the program stored in the memory.

Embodiments of the present invention also provide a computer program product containing instructions, which when run on a computer, cause the computer to perform the steps of the above method.

According to the method and the device, a first sharing request sent by a first client is received, wherein the first sharing request is used for sharing a first resource, the first resource is recorded in a target virtual room according to the first sharing request, a room member set of the target virtual room comprises the first client and a plurality of second clients, each second client corresponds to one display parameter, a notification message of the first resource is sent to the plurality of second clients in a group mode, so that the plurality of second clients request the target virtual room and synchronously display the first resource on different screens according to the display parameters, the first resource to be shared is recorded and stored on a server, the second clients in the virtual room can be located on the first resource from top to bottom of the server to achieve synchronous display, different screen display is conducted according to the display parameters of the second clients, when the first resource is synchronously displayed on multiple screens, real-time synchronization can be achieved only through the group-sent state updating request, the technical problem that the different screen shared resource cannot be synchronized in the related technology is solved, the difference of the platforms is supported, the screen interaction of different platforms is ignored, the difference of the network, the difference of the local area display is not limited, and the difference of the local area display is ignored, and the difference of the multiple displays is achieved.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:

fig. 1 is a block diagram of a hardware configuration of a television according to an embodiment of the present invention;

FIG. 2 is a flowchart of a control method for multi-screen display according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a client sharing a file according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a client joining a virtual room according to an embodiment of the present invention;

FIG. 5 is a flowchart of another control method for multi-screen highlighting according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of a multi-terminal off-screen display according to an embodiment of the present invention;

FIG. 7 is a block diagram of a control apparatus for multi-screen displays according to an embodiment of the present invention;

FIG. 8 is a block diagram of another control apparatus for multi-screen displays according to an embodiment of the present invention;

FIG. 9 is a block diagram of a control system for multi-screen displays according to an embodiment of the present invention;

fig. 10 is a block diagram of an electronic device implementing an embodiment of the invention.

Detailed Description

In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example 1

The method provided by the first embodiment of the present invention may be executed in a television, a mobile phone, a tablet, a computer, a server, a processor, or a similar computing device. Taking an example of the operation on a television, fig. 1 is a hardware structure block diagram of a television according to an embodiment of the present invention. As shown in fig. 1, the television set may include one or more (only one shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and optionally may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the television set. For example, a television may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.

The memory 104 can be used to store a television program, for example, a software program and a module of an application software, such as a television program corresponding to a control method of a multi-screen display, in an embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the television program stored in the memory 104, that is, implements the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to a television through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission device 106 is used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of a television set. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices via a base station to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used to communicate with the internet via wireless.

In this embodiment, a method for controlling a multi-screen monitor is provided, and fig. 2 is a flowchart of a method for controlling a multi-screen monitor according to an embodiment of the present invention, as shown in fig. 2, the flowchart includes the following steps:

step S202, receiving a first sharing request sent by a first client, wherein the first sharing request is used for sharing a first resource;

the network ecology of the application of the embodiment includes: server, client (e.g., mobile phone, television, computer, etc.).

Optionally, the first resource of this embodiment may be screen projection, file, voice, streaming media (video, picture, etc.), and other contents. The first share request is for requesting sharing of a first resource on a number of second clients.

Step S204, recording a first resource in a target virtual room according to a first sharing request, wherein a room member set of the target virtual room comprises a first client and a plurality of second clients, and each second client corresponds to one display parameter;

the display parameters of this embodiment may be resolution, display screen size, ratio, and supported display control functions (such as touch function, page turning function, and pause function), the second client of this embodiment may be a mobile phone, a television, a computer, a curtain wall, and other terminals, and the display parameters of each second client may be the same or different.

The first sharing request may carry a data packet of the first resource, or the server may actively pull the first resource from the first client after receiving the first sharing request, and then store a complete data packet (such as a video, a file, a voice, and the like) of the first resource in an upper target virtual room of the server, where the target virtual room may be a network disk or a cloud disk on the server.

Optionally, a plurality of virtual rooms are created on the server, each virtual room is distinguished by a room identifier (e.g., a room ID, a storage directory), each virtual room is equivalent to a virtual conference room, and only clients creating the virtual room or joining the virtual room can share resources requested to be shared by room members in the virtual room.

Step S206, sending notification messages of the first resources to a plurality of second client-sides in a group mode so that the plurality of second client-sides can request the target virtual room and synchronously display the first resources on different screens according to the display parameters;

in one example, after sending the notification message of the first resource to several second clients in a group, the server may also actively push the first resource to the second clients, or carry the first resource in the notification message. When the display parameters of the two second clients are different, the resource interfaces of the first resources displayed by the two second clients are different, so that different-screen display of the same resource on different clients is realized.

Through the steps, a first sharing request sent by a first client is received, wherein the first sharing request is used for sharing a first resource, the first resource is recorded in a target virtual room according to the first sharing request, a room member set of the target virtual room comprises the first client and a plurality of second clients, each second client corresponds to one display parameter, a notification message of the first resource is sent to the plurality of second clients in a group mode, so that the plurality of second clients request the target virtual room and synchronously display the first resource on different screens according to the display parameters, the first resource to be shared is recorded and stored on a server, the second clients in the virtual room can be located on the first resource from top to bottom of the server to achieve synchronous display, different-screen display is conducted according to the display parameters of the second clients, when the first resource is synchronously displayed on multiple screens, real-time synchronization can be achieved only through the group-sending state updating request, the technical problem that the different-screen shared resource cannot be synchronized in the related technology is solved, the difference of the platforms is supported, the screen interaction of different platforms is ignored, the difference of the network, the difference of the local-area display is not limited, and the difference of the local-area display is ignored, and the difference of the multiple-area display is achieved.

The scheme of the embodiment can also be applied to video conferences, remote teaching, screen-connected entertainment and other scenes.

In one implementation of the embodiment, before recording the first resource at the target virtual room according to the first sharing request, the method further comprises: receiving a room creation request sent by a creation client; creating a target virtual room on the server based on the creation request, and allocating a fixed storage space for the target virtual room; and receiving a room joining request sent by the joining client, and adding the joining client to the room member set of the target virtual room.

After the target virtual room is created, the target virtual room is bound with the distributed fixed storage space, and resources which the client of any room member wants to share are uploaded, transferred and issued based on the corresponding fixed storage space. When a target virtual room is created, a room ID is generated, an invitation code, a conference password and the like can be set, and any joining client who wants to join the target virtual room can join the target virtual room through the room information and the verification information to become a member of the room member set.

Optionally, a signaling channel group is created simultaneously when a target virtual room is created, all clients joining the virtual room automatically join the signaling channel group, and after joining, signaling interaction of each client is supported; the server and the clients transmit data and instructions by using signaling channels in the corresponding group, and optionally, each client in the room member set allocates one signaling channel in the group matched with the target virtual room.

In one example, recording the first resource in the target virtual room according to the first sharing request includes:

s11, searching a target virtual room matched with the first sharing request;

optionally, the searching for the target virtual room matching the first sharing request includes: analyzing a signaling channel of the first sharing request; and searching a target virtual room matched with the signaling channel in a plurality of virtual rooms, wherein each virtual room corresponds to one signaling channel group.

The signaling channel is a channel that transmits the first share request between the server and the first client. In some examples, a first client joins multiple virtual rooms simultaneously, such as room 1 and room 2, and when interacting with different devices in multiple rooms simultaneously, uses signaling channel 1 when sharing resource 1 to member set 1 in room 1, and uses signaling channel 2 when sharing resource 2 to member set 2 in room 2, one client may join different virtual rooms simultaneously, and each virtual room is displayed and interacted independently.

S12, acquiring an initial resource state of the first resource;

optionally, the initial resource state of the first resource may be an initial display state of the first resource, which corresponds to a current display state of the first resource on the first client, such as a display state of a text on a home page, a display state of a multimedia in an initial playing progress, a display state of a picture in an original scale, and the like. The initial resource state of this embodiment corresponds to a display form of the first resource, and is used to control an initial display form of the first resource after the first resource is shared to the second client.

And S13, storing the first resource and the initial resource state in a storage space corresponding to the target virtual room.

In an implementation manner of this embodiment, after sending the notification of the first resource to the plurality of second clients in a group, the method further includes: receiving a state updating request sent by a first client, wherein the state updating request is used for indicating to update the resource state of the first resource; and sending a state updating request to the second clients in a group manner so that the second clients locally update the resource state of the first resource in an abnormal screen manner.

In addition, when a certain second client serves as a control end, the resource state of the first resource can be updated, and multi-user synchronization and interaction are further achieved. The method comprises the following steps: after sending the notification of the first resource to the plurality of second clients in a group, the method further comprises: receiving a state updating request sent by a second client, wherein the state updating request is used for indicating to update the resource state of the first resource; and sending a state updating request to other second clients and the first client in a group mode so that the other second clients and the first client locally update the resource state of the first resource in an abnormal screen mode.

In an example, the network transmission delay of the status update request may be further considered, an end-to-end delay (transmission delay between a client in the target virtual room and another client in the control signaling) is calculated, after the first client performs the status update operation, the corresponding status update request is triggered, the status update request is sent to the server, and after the first client delays the duration of the end-to-end delay, the status update operation is responded on the first client, so that the status update operation is responded synchronously on all the clients.

Optionally, the state update request may be a play request, a pause request, a page turn request, an enlargement request, a reduction request, and the like, and after the first client performs the state update operation (play, pause, page turn, enlargement, reduction, and the like) on the first resource, the corresponding state update request is automatically triggered, so that the first resource on the second client performs the state update operation at the same time, and multi-end synchronous display of the first resource is realized.

The first client and the second client in this embodiment are clients participating in multi-screen interaction, and may be smart phones, PCs, and various intelligent hardware including screens, such as televisions and outdoor curtain walls, where each client may share the client, may also passively display the shares of other clients, and may interact with other clients.

Optionally, sending the notification message of the first resource to the plurality of second clients in a group includes: and sending a first field, a second field and a third field to a plurality of second clients in a group manner, wherein the first field indicates the message type of the notification message, the second field is used for indicating the service type aiming at the first resource, the third field is used for identifying the room of the target virtual room, and the notification message carries the first field, the second field and the third field.

Fig. 3 is a schematic diagram of a client sharing a file according to an embodiment of the present invention, fig. 4 is a schematic diagram of a client joining a virtual room according to an embodiment of the present invention, where a first client creating the virtual room is a device a, a second client joining the virtual room is another device, and a server is a cloud server, and a process includes:

firstly, calling a server interface by equipment A to create a virtual room, wherein other equipment can be added into the virtual room;

any device joining the virtual room can initiate a cloud file sharing, and after the server-side interface is called successfully, the device opens a file preview by itself, and in one example, the instruction data format for initiating the cloud file sharing is as follows:

{"type":"SIGNALING","cmd":"SEND","key":"doc_preview","content":"{\"room_code\":\"5ON31GL\",\"room_id\":\"d975287cbd864f2d86a92caaffdb25e4\"}","subKey":"open"}。

the field is in json format, and the field is interpreted as follows:

type: the message type, SIGNALING indicates that the message is a SIGNALING message, the SIGNALING message refers to a message that the opposite side can reply to the received state after receiving the message, and the reply is called reply after receiving the message; at the same level as SIGNALING is a TEXT message, representing a plain TEXT message, without the need for a post-acknowledgement.

cmd: the message command, SEND, is a SEND message and REPLY is a REPLY message.

key: the message service, doc _ preview, refers to a file preview service, and similarly, the key for sharing a file is doc _ share.

The subKey is a message service sub-service, taking a file preview service as an example, the sub-service comprises file opening, file closing, file page turning, file zooming and the like, and the corresponding subKey is open, close, change _ page and scale respectively.

content: the message extension field, which is also a content field of the message, is a json format serialized character String, and needs to be deserialized back to json during parsing, taking file preview as an example, the field of the content is described as follows:

room _ code: current Room code

room _ id: the difference between the current room id, the room id and the room code is that the room code is visible to the user, other users can join the room through the room code, and the room id is used for service development and is invisible to the user.

After receiving the notification that the server opens the file sharing, other devices display corresponding content according to the characteristics of the devices, such as display parameters;

the device A operates on files, such as picture zooming, video progress dragging, document page turning and the like, an operation instruction is sent to the server, and the server issues the instruction to other devices. In one example, an example of an instruction data format for a document page flip operation is as follows:

{"type":"SIGNALING","cmd":"SEND","key":"doc_preview","content":"{\"page\":1}","subKey":"change_page"}。

the field is in json format, and the field is interpreted as follows:

type: the message type, SIGNALING indicates that the message is a SIGNALING message, the SIGNALING message refers to a message that the opposite side can reply to the received state after receiving the message, and the reply is called reply after receiving the message; on the same level as SIGNALING is a TEXT message, representing a plain TEXT message, without requiring a post-acknowledgement.

cmd: the message command, SEND, is a SEND message and REPLY is a REPLY message.

key: the doc _ preview refers to a file preview service, and similarly, the key for sharing the file is doc _ share.

content: the message extension field, which is also a content field of the message, is a json format serialized character String, and needs to be deserialized back to json during parsing, taking file preview as an example, the content field is described as follows:

page: the number of pages currently turned over, e.g., 1, is the first page, and 5 is the fifth page.

After receiving the file operation instruction, other equipment can perform the same operation on the file displayed by the equipment, so that multi-end synchronous display is realized;

the device (such as other devices) joining the virtual room in the middle can acquire the file and the file operation state currently shared from the server, open the file and synchronize to the current operation state, and can also initiate file sharing and state updating operations.

In this embodiment, another control method for multi-screen different display is provided, which is applied to a first client, and the process includes the following steps:

step S21, displaying a first resource on a first client;

step S22, a first sharing request is sent to a server, wherein the first sharing request is used for requesting to share a first resource to a room member set of a target virtual room, the target virtual room is stored on the server, and the room member set of the target virtual room comprises a first client and a plurality of second clients;

the first client terminal clicks a button, or after the first client terminal device is taken as a sharing terminal, other terminals in the virtual room are taken as shared terminals, the first terminal selects a first resource to be shared, and a first sharing request is automatically triggered.

Step S23, updating the resource state of the first resource on the first client;

by monitoring the state updating operation of the first client for the first resource, the state updating request corresponding to the state updating operation is automatically triggered, and if the state updating operation is play, pause, page turning, zooming in and zooming out, the state updating request can be a play instruction, a pause instruction and the like.

Step S24, sending a status update request to the server, where the status update request is used to indicate that the resource status of the first resource is updated.

In this embodiment, another control method for multi-screen different display is provided, and fig. 5 is a flowchart of another control method for multi-screen different display according to an embodiment of the present invention, which is applied to a second client, as shown in fig. 5, the flowchart includes the following steps:

step S502, receiving a notification message sent by a server, wherein the notification message is used for notifying second clients to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room comprises the first client and a plurality of second clients;

step S504, a first resource is requested from a target virtual room by adopting resource linkage;

step S506, acquiring display parameters of the second client;

step S508, displaying the first resource according to the display parameter.

Optionally, after the displaying the first resource on the second client, the method further includes: receiving a state updating request sent by a server, wherein the state updating request is used for indicating to update the resource state of the first resource and carries a state control instruction; resource states of the first resource are synchronously controlled on the second client based on the state control instructions.

In another example, the second client may also send a status update request, including: and sending a state updating permission to the first client or the server, sending a state updating request to the server after the first client or the server agrees, and forwarding the state updating request to other clients (including the first client) in the room member set by the server, so that multi-terminal interaction is realized.

In an implementation manner of this embodiment, the obtaining the display parameter of the second client includes: acquiring the display size of a display screen of a second client; acquiring the resolution of a display screen of a second client; and acquiring a function characteristic parameter of a display screen of the second client, wherein the function characteristic parameter is used for indicating a display control function supported by the second client.

In one example, the display parameters include display size, resolution, and functional characteristic parameters, and displaying the first resource according to the display parameters includes:

s31, displaying a resource interface of the first resource according to the display size and the resolution;

optionally, the resource interface for displaying the first resource according to the display size and the resolution includes: determining a maximum resolution supported by the second client; rendering a resource interface of the first resource according to the maximum resolution; judging whether the display size is smaller than a preset size or not; if the display size is smaller than the preset size, triggering an amplification instruction, and amplifying and displaying a resource interface of the first resource; and if the display size is larger than or equal to the preset size, displaying the resource interface according to the maximum size.

S32, analyzing the functional characteristic parameters, determining a first control operation type set supported by second client hardware, and determining a second control operation type set supported by display size;

the control operation type of this embodiment may be a control means such as touch control, gesture control, voiceprint control, keyboard and mouse control, key control, or the like, or a control object such as sound control, color control, character control, or the like, or an operation type such as zoom, fast forward, page turning, or the like.

And S33, selecting a target control operation type set contained in both the first control operation type set and the second control operation type set, and displaying a control assembly corresponding to the target control operation type set on the resource interface.

The second client in this embodiment is a display device with a display function, each display device receives data and then automatically analyzes a cloud file downloaded from a server to browse, for example, opening a picture, directly playing a video through a video playing address, opening documents such as ppt, doc, xls, and opening custom data such as a whiteboard, each display device may define the definition of a loaded UI according to its own display resolution and network quality, and for example, a picture may be selected from different resolutions such as 1920x1080, 1280x720, 680x 480.

The display of each second client has a difference in resolution definition and may also have a difference in functional characteristics, for example, the television does not support touch, the display resource content does not display the UI of the operation component (e.g., touch operation buttons such as return, pause, fast forward, etc.), and the UI of the touch operation can be displayed after the content is displayed on the mobile phone, pad, etc. Each second client can display different contents with other equipment according to the logic of the demand, if the size of a screen is small, the picture can be clearly seen only by amplifying, the sizes of other equipment are enough and do not need to be amplified, and the display of each display equipment is different after the operation instructions are amplified asynchronously. Each second client has a difference in characteristics, for example, the watch device is relatively small, and when a document is shared, only the document operation buttons, such as page turning, zooming and the like, may be displayed;

each second client can operate the cloud file, such as zooming and moving of pictures, progress dragging of videos, page turning of documents and the like, after the operation is transmitted to the cloud end, the cloud end is issued to other display devices, and after the other display devices receive the operation instruction, the same operation is performed on the cloud file opened by the second client.

Fig. 6 is a schematic diagram of multi-terminal different-screen display according to an embodiment of the present invention, where a whiteboard is used to illustrate display differences of different screens, a mobile phone device is inconvenient to operate due to a small screen, a whiteboard operation toolbar is not displayed, a mobile phone displays a centered display when erecting a screen, a tablet device displays a whiteboard toolbar UI, and has a larger resolution, differentiated display, and a television device does not support touch, does not display a whiteboard toolbar UI, and does not support whiteboard drawing.

A new client adds in a virtual room, requests the sharing state of the current room, and displays the shared content if the shared content exists; the initiator of the client sharing executes the sharing ending, calls the server interface to update the sharing state, simultaneously broadcasts an ending signaling through the signaling channel, and other clients update the state after receiving the signaling; a client can join different virtual rooms at the same time, and the display and interaction of each virtual room are independent.

By adopting the scheme of the embodiment, cross-platform multi-screen interaction can be realized, cross-network real-time response is realized, the difference of the network is ignored, a local area network is not limited, and screen joining interaction under different networks can be supported; different interactions with a plurality of screens are supported at the same time; differences of platforms are ignored, screen interaction under different platforms is supported, sharing of different contents is supported, the method is not limited to screen projection, and sharing of contents such as files, voice and streaming media is supported; the multi-person interaction is supported, and the sharing can be realized while communication can be realized in the modes of voice, characters, video and the like, so that the resources can be synchronously operated and shared in real time; the method supports the same equipment, simultaneously interacts with a plurality of different equipment and supports multiple tasks.

By adopting the mode of the embodiment, the direct real-time data transmission among the devices is not relied on, but the cloud server is relied on, so that the operation pressure of the devices is reduced, and the advantage of stronger operation capability of the server is fully utilized; the same content is played among the devices, instead of being converted into a video playing mode by relying on screen recording playing, various types of files such as pictures, files and custom data such as a white board are directly played, synchronous display can be realized only by transmitting a state updating instruction after resources are downloaded to the local part of a client, the data format can be simplified to be very small, and the data transmission efficiency can be greatly improved; the equipment directly opens the file, so the definition and the size to be loaded can be controlled according to the resolution and the requirement supported by the equipment, the actual display resolution of each equipment can be different, and the characteristics of different screens are fully exerted; the attributes of various devices are different, such as a TV, a pad, a mobile phone, a watch, an intelligent sound box and the like, supported operations are different, and after one device shares contents, other devices actually display different types, such as the watch only displays a file operation button, and the sound box only displays a voice operation button; all the devices are supported to operate the files and synchronize to other terminals to respond to the same operation, the time delay of resource synchronous display is smaller, and the transmission speed is higher.

Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method according to the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.

Example 2

The present embodiment further provides a control device and a system for multi-screen different display, which are used to implement the foregoing embodiments and preferred embodiments, and are not described again after being described. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.

Fig. 7 is a block diagram of a control apparatus for multi-screen display according to an embodiment of the present invention, and as shown in fig. 7, the control apparatus is applied to a server, and the apparatus includes: a first receiving module 70, a recording module 72, and an reproducing module 74, wherein,

a first receiving module 70, configured to receive a first sharing request sent by a first client, where the first sharing request is used to share a first resource;

a recording module 72, configured to record the first resource in a target virtual room according to the first sharing request, where a room member set of the target virtual room includes the first client and a plurality of second clients, and each second client corresponds to one display parameter;

and an abnormal display module 74, configured to send a notification message of the first resource to the plurality of second clients in a group, so that the plurality of second clients request the target virtual room and synchronously display the first resource on an abnormal screen according to the display parameter.

Optionally, the display-in-different module includes: a sending unit, configured to send a first field, a second field, and a third field to the plurality of second clients in a group, where the first field indicates a message type of the notification message, the second field is used to indicate a service type for the first resource, the third field is used for a room identifier of the target virtual room, and the notification message carries the first field, the second field, and the third field.

Optionally, the apparatus includes: a third receiving module, configured to receive a status update request sent by the first client after the first resource notification is sent to the second clients in a group by the video-on-demand module, where the status update request is used to indicate that the resource status of the first resource is updated; and the mass sending module is used for sending the state updating request to the second clients in a mass mode so that the second clients can update the resource state of the first resource in a local different screen mode.

Fig. 8 is a block diagram of another control apparatus for multi-screen display according to an embodiment of the present invention, and as shown in fig. 8, the apparatus is applied to a second client, and includes: a receiving module 80, a requesting module 82, an obtaining module 84, a displaying module 86, wherein,

a receiving module 80, configured to receive a notification message sent by a server, where the notification message is used to notify the second client to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room includes the first client and a plurality of the second clients;

a request module 82 for requesting the first resource from the target virtual room using the resource link;

an obtaining module 84, configured to obtain display parameters of the second client;

and a display module 86, configured to display the first resource according to the display parameter.

Optionally, the obtaining module includes: the first acquisition unit is used for acquiring the display size of the display screen of the second client; the second acquisition unit is used for acquiring the resolution of the display screen of the second client; and a third obtaining unit, configured to obtain a functional characteristic parameter of a display screen of the second client, where the functional characteristic parameter is used to indicate a display control function supported by the second client.

Optionally, the first display unit includes: a determining subunit, configured to determine a maximum resolution supported by the second client; a rendering subunit, configured to render the resource interface of the first resource according to the maximum resolution; the judging subunit is used for judging whether the display size is smaller than a preset size; the display subunit is used for triggering an amplification instruction and amplifying and displaying the resource interface of the first resource if the display size is smaller than a preset size; and if the display size is larger than or equal to the preset size, displaying the resource interface according to the maximum size.

Fig. 9 is a block diagram of a control system for multi-screen display according to an embodiment of the present invention, and as shown in fig. 9, the control system includes: a server 90 and a first client 92 and a plurality of second clients 94, wherein the server 90 is connected to the first client 92 and the plurality of second clients 94 for executing the apparatus according to the above embodiment; the first client 92, which includes: a display module for displaying a first resource on the first client; the first sending module is used for sending a first sharing request to the server; an update module to update a resource status of the first resource on the first client; a second sending module, configured to send a status update request to the server, where the status update request is used to indicate that the resource status of the first resource is updated; the second client 94 is configured to execute the following devices according to the following embodiments.

It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.

Example 3

Fig. 10 is a structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 10, the electronic device includes a processor 101, a communication interface 102, a memory 103, and a communication bus 104, where the processor 101, the communication interface 102, and the memory 103 complete communication with each other through the communication bus 104, and the memory 103 is used for storing a computer program; the processor 101 is configured to implement the following steps when executing the program stored in the memory 103: receiving a first sharing request sent by a first client, wherein the first sharing request is used for sharing a first resource; recording the first resource in a target virtual room according to the first sharing request, wherein a room member set of the target virtual room comprises the first client and a plurality of second clients, and each second client corresponds to one display parameter; and sending a notification message of the first resource to the second clients in a group manner so that the second clients request the target virtual room and synchronously display the first resource on different screens according to the display parameters.

The communication bus mentioned in the above terminal may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this is not intended to represent only one bus or type of bus.

The communication interface is used for communication between the terminal and other equipment.

The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

In another embodiment provided by the present application, a computer-readable storage medium is further provided, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute the method for controlling the multi-screen display and the multi-screen display in any one of the above embodiments.

In another embodiment provided by the present application, there is also provided a computer program product containing instructions, which when run on a computer, causes the computer to execute the method for controlling multi-screen display and video playback described in any of the above embodiments.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), among others.

The above description is only for the preferred embodiment of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application are included in the protection scope of the present application.

The above description is merely exemplary of the present application and is presented to enable those skilled in the art to understand and practice the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A control method for multi-screen different display is applied to a server side and comprises the following steps:

receiving a first sharing request sent by a first client, wherein the first sharing request is used for sharing a first resource;

recording the first resource in a target virtual room according to the first sharing request, wherein a room member set of the target virtual room comprises the first client and a plurality of second clients, and each second client corresponds to one display parameter;

and sending a notification message of the first resource to the second clients in a group manner so that the second clients request the target virtual room and synchronously display the first resource on different screens according to the display parameters.

2. The method of claim 1, wherein prior to recording the first resource in a target virtual room in accordance with the first share request, the method further comprises:

receiving a room creation request sent by a creation client;

creating the target virtual room on a server based on the creation request, and allocating a fixed storage space for the target virtual room;

and receiving a room joining request sent by a joining client, and adding the joining client to the room member set of the target virtual room.

3. The method of claim 1, wherein sending the notification message of the first resource to the number of second clients in a group comprises:

sending a first field, a second field and a third field to the second clients in a group manner, wherein the first field indicates a message type of the notification message, the second field is used for indicating a service type for the first resource, the third field is used for identifying a room of the target virtual room, and the notification message carries the first field, the second field and the third field.

4. The method of claim 1, wherein after sending the notification of the first resource to the number of second clients in a group, the method comprises:

receiving a status update request sent by the first client, wherein the status update request is used for indicating to update the resource status of the first resource;

and sending the state updating request to the second clients in a group manner so that the second clients locally update the resource state of the first resource in an abnormal screen manner.

5. A control method for multi-screen different display is applied to a second client, and comprises the following steps:

receiving a notification message sent by a server, wherein the notification message is used for notifying the second client to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room comprises the first client and a plurality of second clients;

requesting the first resource from the target virtual room using the resource link;

acquiring display parameters of the second client;

and displaying the first resource according to the display parameter.

6. The method of claim 5, wherein obtaining the display parameters of the second client comprises:

acquiring the display size of a display screen of the second client;

acquiring the resolution of a display screen of the second client;

and acquiring a functional characteristic parameter of a display screen of the second client, wherein the functional characteristic parameter is used for indicating a display control function supported by the second client.

7. The method of claim 5, wherein the display parameters include display size, resolution, and functional characteristic parameters, and wherein displaying the first resource according to the display parameters comprises:

displaying a resource interface of the first resource according to the display size and the resolution;

analyzing the functional characteristic parameters, determining a first control operation type set supported by the second client hardware, and determining a second control operation type set supported by the display size;

and selecting a target control operation type set contained in both the first control operation type set and the second control operation type set, and displaying a control assembly corresponding to the target control operation type set on the resource interface.

8. The method of claim 7, wherein displaying the resource interface of the first resource according to the display size and the resolution comprises:

determining a maximum resolution supported by the second client;

rendering the resource interface of the first resource according to the maximum resolution;

judging whether the display size is smaller than a preset size or not;

if the display size is smaller than the preset size, triggering an amplification instruction, and amplifying and displaying the resource interface of the first resource; and if the display size is larger than or equal to the preset size, displaying the resource interface according to the maximum size.

9. The utility model provides a controlling means that many screens are different to show which uses at the server side, includes:

a first receiving module, configured to receive a first sharing request sent by a first client, where the first sharing request is used to share a first resource;

a recording module, configured to record the first resource in a target virtual room according to the first sharing request, where a room member set of the target virtual room includes the first client and a plurality of second clients, and each second client corresponds to one display parameter;

and the display-on-screen module is used for sending the notification message of the first resource to the plurality of second client-sides in a group so that the plurality of second client-sides request the target virtual room and synchronously display the first resource on a display-on-screen according to the display parameters.

10. The utility model provides a controlling means that many screens are different to show which is applied to the second customer end, includes:

a receiving module, configured to receive a notification message sent by a server, where the notification message is used to notify a second client to share a first resource uploaded by a first client, the notification message carries a resource link of the first resource, the first resource is stored in a target virtual room of the server, and a room member set of the target virtual room includes the first client and a plurality of second clients;

a request module to request the first resource from the target virtual room using the resource link;

the acquisition module is used for acquiring the display parameters of the second client;

and the display module is used for displaying the first resource according to the display parameter.

11. A control system for multi-screen different display is characterized by comprising: a server, a first client and a plurality of second clients, wherein,

the server, connected with the first client and a plurality of second clients, for executing the apparatus of claim 9;

the first client includes: a display module for displaying a first resource on the first client; the first sending module is used for sending a first sharing request to the server; an update module to update a resource status of the first resource on the first client; a second sending module, configured to send a status update request to the server, where the status update request is used to indicate that the resource status of the first resource is updated;

the second client configured to execute the apparatus of claim 10.

12. A storage medium, characterized in that the storage medium comprises a stored program, wherein the program is operative to perform the method steps of any of the preceding claims 1 to 8.

13. An electronic device comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus; wherein:

a memory for storing a computer program;

a processor for performing the method steps of any of claims 1 to 8 by executing a program stored on a memory.