CN114615535A - Synchronous display method and device, electronic equipment and readable storage medium - Google Patents
Synchronous display method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN114615535A CN114615535A CN202210134039.7A CN202210134039A CN114615535A CN 114615535 A CN114615535 A CN 114615535A CN 202210134039 A CN202210134039 A CN 202210134039A CN 114615535 A CN114615535 A CN 114615535A
- Authority
- CN
- China
- Prior art keywords
- terminal
- synchronous
- server
- target terminal
- synchronization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43076—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
Abstract
The embodiment of the application provides a synchronous display method, a synchronous display device, electronic equipment and a readable storage medium, and relates to the technical field of computers. In the embodiment of the application, the server may broadcast the encoded synchronous images to each synchronous terminal, when performing synchronous display, the target terminal may determine the touch coordinates according to the received control instruction and send the touch coordinates to the server, and then, after receiving the touch coordinates sent by the target terminal, the server may execute synchronous operation based on the touch coordinates and the encoded synchronous images, so as to implement synchronous display of each synchronous terminal, and ensure that each synchronous terminal can normally display the same image when sharing the screen.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a synchronous display method and apparatus, an electronic device, and a readable storage medium.
Background
With the development of computer technology, people can display images, texts, presentations and the like in a screen sharing manner at present.
In the related art, a user may share a display screen of a target terminal to another terminal by controlling the target terminal to achieve the purpose of screen sharing.
However, when the target terminal is screen-shared to one or more terminals of different models, the target terminal and the terminal accepting screen sharing may have a problem that the display screen of the terminal accepting screen sharing is not normal due to a difference in display screen size, a difference in operating system, and the like.
Disclosure of Invention
In view of this, embodiments of the present application provide a synchronous display method, an apparatus, an electronic device, and a readable storage medium, so as to ensure that each synchronous terminal can normally display the same picture when sharing a screen.
In a first aspect, a synchronous display method is provided, the method including:
the server broadcasts the coded synchronous images to each synchronous terminal;
determining a touch coordinate by a target terminal in each synchronous terminal according to a received control instruction;
the target terminal sends the touch coordinate to the server and executes the control instruction; and
and the server receives the touch coordinates sent by the target terminal and executes synchronous operation based on the touch coordinates and the coded synchronous images so as to synchronously display the synchronous terminals except the target terminal in each synchronous terminal.
In some embodiments, the performing a synchronization operation based on the touch coordinates and the encoded synchronization image includes:
the server sends the touch coordinates to the synchronous terminals except the target terminal in each synchronous terminal; and
and after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal.
In some embodiments, the sending, by the target terminal, the touch coordinates to the server includes:
the target terminal sends an operation request to the server;
the server responds to the operation request and returns an operation response to the target terminal, wherein the operation response is used for representing that the target terminal obtains operation permission; and
and the target terminal responds to the operation response and sends the touch coordinate to the server.
In some embodiments, after returning an operation response to the target terminal, the method further comprises:
the server responds to the received operation request sent by the synchronous terminals except the target terminal in each synchronous terminal, and returns a refusal response to the synchronous terminal sending the operation request; and
and the synchronous terminal receives the touch coordinate sent by the server in response to the received rejection response returned by the server, and synchronously displays the touch coordinate and the coded synchronous image.
In some embodiments, the synchronization terminal includes a high priority terminal and a low priority terminal, and the target terminal is a high priority terminal;
the performing a synchronization operation based on the touch coordinates and the encoded synchronization image includes:
the server responds to a selection control of a target low-priority terminal corresponding to the touch coordinate, and sends the touch coordinate to the synchronous terminals except the target terminal;
after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal; and
and the server transfers all or part of the operation authority of the target terminal to the target low-priority terminal.
In some embodiments, the synchronization terminal includes a high priority terminal and a low priority terminal, and the target terminal is a low priority terminal;
the performing a synchronization operation based on the touch coordinates and the encoded synchronization image includes:
the server responds to a selection control corresponding to the touch coordinate and ending the operation, and sends the touch coordinate to the synchronous terminals except the target terminal;
after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal; and
and the server transfers all or part of the operation authority of the target terminal to the high-priority terminal.
In some embodiments, the method further comprises:
and the server responds to the received permission recovery instruction of the high-priority terminal and transfers all or part of the operation permission of the target terminal to the high-priority terminal.
In a second aspect, a synchronous display system is provided, the system includes a server and a synchronous terminal, the synchronous terminal includes a target terminal:
the server is configured to broadcast a coded synchronization image to each synchronization terminal, receive touch coordinates sent by the target terminal, and perform synchronization operation based on the touch coordinates and the coded synchronization image, so that the synchronization terminals except the target terminal in each synchronization terminal perform synchronous display;
the synchronous terminal is configured to receive the coded synchronous image;
the target terminal is configured to send the touch coordinates to the server and execute the control instruction.
In a third aspect, there is provided a synchronous display device, the device comprising:
the broadcasting module is used for broadcasting the coded synchronous images to each synchronous terminal by the server;
the touch coordinate determination module is used for determining a touch coordinate by a target terminal in each synchronous terminal according to the received control instruction;
the touch coordinate sending module is used for sending the touch coordinate to the server by the target terminal and executing the control instruction; and
and the synchronization module is used for receiving the touch coordinates sent by the target terminal by the server and executing synchronization operation based on the touch coordinates and the coded synchronization image so as to enable the synchronization terminals except the target terminal to synchronously display.
In some embodiments, the synchronization module is specifically configured to:
and the server sends the touch coordinates to the synchronous terminals except the target terminal in each synchronous terminal.
And after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal.
In some embodiments, the touch coordinate sending module is specifically configured to:
and the target terminal sends an operation request to the server.
And the server responds to the operation request and returns an operation response to the target terminal, wherein the operation response is used for representing the target terminal to obtain the operation authority.
And the target terminal responds to the operation response and sends the touch coordinate to the server.
In some embodiments, the apparatus further comprises:
the response module is used for the server to respond to the received operation request sent by the synchronous terminals except the target terminal in each synchronous terminal and return a refusal response to the synchronous terminal sending the operation request; and
and the synchronous display module is used for receiving the touch coordinates sent by the server by the synchronous terminal in response to receiving the rejection response returned by the server and synchronously displaying the touch coordinates and the coded synchronous image.
In some embodiments, the synchronization terminals include a high priority terminal and a low priority terminal, and the target terminal is a high priority terminal.
The synchronization module is specifically configured to:
and the server responds to the selection control of the target low-priority terminal corresponding to the touch coordinate, and sends the touch coordinate to the synchronous terminals except the target terminal.
And after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal.
And the server transfers all or part of the operation authority of the target terminal to the target low-priority terminal.
In some embodiments, the synchronization terminals include a high priority terminal and a low priority terminal, and the target terminal is a low priority terminal.
The synchronization module is specifically configured to:
and the server responds to the selection control corresponding to the touch coordinate and ending the operation, and sends the touch coordinate to the synchronous terminals except the target terminal.
And after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal.
And the server transfers all or part of the operation authority of the target terminal to the high-priority terminal.
In some embodiments, the apparatus further comprises:
and the permission recovery module is used for responding to the permission recovery instruction of the high-priority terminal received by the server and transferring all or part of the operation permission of the target terminal to the high-priority terminal.
In a fourth aspect, embodiments of the present application provide an electronic device, comprising a memory and a processor, the memory being configured to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method according to the first aspect.
In a fifth aspect, embodiments of the present application provide a computer-readable storage medium on which computer program instructions are stored, which when executed by a processor implement the method according to the first aspect.
According to the embodiment of the application, the server can broadcast the coded synchronous images to the synchronous terminals, so that the synchronous terminals receive the same display picture images and display the same display picture images. When synchronous display is carried out, the target terminal can determine touch coordinates according to the received control instruction and sends the touch coordinates to the server, and then after the server receives the touch coordinates sent by the target terminal, the server can execute synchronous operation based on the touch coordinates and the coded synchronous images so as to realize synchronous display of all synchronous terminals. In the process, because the synchronous display of each synchronous terminal is realized based on the touch coordinate and the coded synchronous image, and the coded synchronous images displayed by each synchronous terminal are the same image, even if factors such as different display screen sizes, different operating systems, different application program versions and the like exist among the synchronous terminals, the synchronous operation executed based on the touch coordinate and the coded synchronous image cannot be influenced, and the synchronous terminals can normally display the same image when the screen is shared.
Drawings
The foregoing and other objects, features and advantages of the embodiments of the present application will be apparent from the following description of the embodiments of the present application with reference to the accompanying drawings in which:
FIG. 1 is a schematic diagram of a synchronous display system according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating a synchronous display method according to an embodiment of the present application;
FIG. 3 is a diagram illustrating an embodiment of the present invention for encoding a synchronization image;
fig. 4 is a flowchart illustrating rights distribution performed by a server according to an embodiment of the present application;
FIG. 5 is a flowchart illustrating a synchronous display process according to an embodiment of the present application;
FIG. 6 is a schematic structural diagram of a synchronous display device according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The present application is described below based on examples, but the present application is not limited to only these examples. In the following detailed description of the present application, certain specific details are set forth in detail. It will be apparent to one skilled in the art that the present application may be practiced without these specific details. Well-known methods, procedures, components and circuits have not been described in detail so as not to obscure the present application.
Further, those of ordinary skill in the art will appreciate that the drawings provided herein are for illustrative purposes and are not necessarily drawn to scale.
Unless the context clearly requires otherwise, throughout the description, the words "comprise", "comprising", and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is, what is meant is "including but not limited to".
In the description of the present application, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In addition, in the description of the present application, "a plurality" means two or more unless otherwise specified.
In the related art, a user may share a display screen of a target terminal to another terminal a by controlling the target terminal, so that a file such as an image, a text, a presentation, and the like displayed by the target terminal may be synchronously displayed at the terminal a.
However, in the screen sharing process, there may occur a problem that the display screen of the terminal a which accepts the screen sharing is not normal due to objective reasons. For example, the operating systems of the target terminal and the terminal a are different, which may cause a problem that the terminal a cannot normally display even if receiving the data transmitted by the target terminal. For another example, due to the difference in the sizes of the display screens of the target terminal and the terminal a, the content synchronously displayed by the terminal a may be shifted. For another example, the versions of the application programs in the target terminal and the terminal a are different, and the display screens displayed by the target terminal and the terminal a are different due to the different versions, so that the content displayed synchronously may not be synchronized to the corresponding position in the display interface.
Therefore, how to ensure that each terminal can display a normal picture when sharing the screen is a problem that needs to be solved at present.
In order to solve the above problem, an embodiment of the present application provides a synchronous display method, which may be applied to an electronic device in a synchronous display system, where the electronic device includes a synchronous terminal and a server, the synchronous terminal may be a smart phone, a tablet Computer, a Personal Computer (PC), a Virtual Reality (VR) device, or the like, and the server may be a single server, a server cluster configured in a distributed manner, or a cloud server. The VR technology is a technology for displaying a three-dimensional model, a two-dimensional image and a video to a user through VR equipment based on electronic signals generated by computer technology.
In the embodiment of the application, the synchronization terminals include target terminals, wherein the target terminals are terminals which send data to the server and enable the synchronization terminals except the target terminals to be based on synchronous display.
As shown in fig. 1, fig. 1 is a schematic diagram of a synchronous display system according to an embodiment of the present application, where the schematic diagram includes: server 11, target terminal 12, sync terminal 13, and sync terminal 14.
The server 11, the target terminal 12, the synchronization terminal 13, and the synchronization terminal 14 may implement online data transmission through a network connection manner shown in fig. 1, and in another case, the server 11, the target terminal 12, the synchronization terminal 13, and the synchronization terminal 14 may also implement data transmission through a wired connection manner.
In the embodiment of the present application, the target terminal may be a terminal operable and having a display function, and the synchronization terminal may be a terminal having a display function. For example, as shown in fig. 1, the target terminal 12 is a computer device, the synchronization terminal 13 is a mobile terminal device, and the synchronization terminal 14 is a VR device. Of course, the target terminal and the sync terminal in fig. 1 are only an illustration of the embodiment of the present application, in practical applications, the target terminal and the sync terminal may also be other types of terminals, such as a tablet computer, an intelligent display screen, and the like, and the number of the target terminal and the sync terminal is not limited to the number shown in fig. 1.
After the server 11 is in communication connection with a plurality of devices (the target terminal 12, the synchronization terminal 13 and the synchronization terminal 14), the server 11 may receive data sent by the target terminal 12 through the communication connection, and then send the data sent by the target terminal 12 to the synchronization terminal 13 and the synchronization terminal 14, so that the synchronization terminal 13 and the synchronization terminal 14 may display synchronously with the target terminal 12.
Specifically, in order to ensure that each terminal can display a normal picture when the screen is shared, the server in the synchronous display system may be configured to perform: broadcasting the coded synchronous image to each synchronous terminal, receiving the touch coordinate sent by the target terminal, and executing synchronous operation based on the touch coordinate and the coded synchronous image so as to synchronously display the synchronous terminals except the target terminal in each synchronous terminal.
The sync terminal in the sync display system may be configured to perform: a coded synchronization image is received.
The target terminal in the synchronous display system may be configured to perform: and sending the touch coordinates to a server, and executing a control instruction.
The coded synchronous image is a display picture which is subjected to digital coding and has a small data volume. In the data transmission process, the data volume occupied by the coding synchronous image is small, so that the time required for transmitting the coding synchronous image is short, and the transmission efficiency is high. In the embodiment of the application, the server broadcasts the coded synchronous image to each synchronous terminal, so that each synchronous terminal can receive the same display picture image and display the same display picture image.
In addition, the encoded synchronous image further includes a corresponding coordinate system, and after the target terminal receives a control instruction input by a user through an external device (e.g., a mouse, a keyboard, etc.) or a point touch operation (e.g., the user touches a display screen, clicks the display screen through a touch pen, etc.), a touch coordinate corresponding to the control instruction can be determined, where the touch coordinate is a coordinate in the coordinate system corresponding to the encoded synchronous image.
Furthermore, after the server receives the touch coordinates sent by the target terminal, the server may perform a synchronization operation based on the touch coordinates and the coordinate system of the encoded synchronization image. For example, the server may restore the operation corresponding to the touch coordinate to the encoded synchronous image, and send the encoded synchronous image after the restoration operation to each of the synchronous terminals, so that the synchronous terminals except the target terminal in each of the synchronous terminals perform synchronous display. For another example, the server may also send the touch coordinates to each synchronization terminal, so that the synchronization terminals except the target terminal in each synchronization terminal perform synchronous display based on the touch coordinates and the encoded synchronization image.
According to the embodiment of the application, the server can broadcast the coded synchronous images to the synchronous terminals, so that the synchronous terminals receive the same display picture images and display the same display picture images. When synchronous display is carried out, the target terminal can determine touch coordinates according to the received control instruction and sends the touch coordinates to the server, and then after the server receives the touch coordinates sent by the target terminal, the server can execute synchronous operation based on the touch coordinates and the coded synchronous images so as to realize synchronous display of all synchronous terminals. In the process, because the synchronous display of each synchronous terminal is realized based on the touch coordinate and the coded synchronous image, and the coded synchronous images displayed by each synchronous terminal are the same image, even if factors such as different display screen sizes, different operating systems, different application program versions and the like exist among the synchronous terminals, the synchronous operation executed based on the touch coordinate and the coded synchronous image cannot be influenced, and the synchronous terminals can normally display the same image when the screen is shared.
As shown in fig. 2, fig. 2 is a flowchart of a synchronous display method according to an embodiment of the present application, and specifically, the method may include the following steps:
in step 21, the server broadcasts the encoded synchronization image to each synchronization terminal, and accordingly, each synchronization terminal receives the encoded synchronization image broadcast by the server.
After receiving the encoded synchronization image, each synchronization terminal may display the encoded synchronization image on a display device (e.g., its own display screen, an external display screen, etc.). The coded synchronous images displayed in the synchronous terminals are uniformly issued by the server, so that the interface images displayed by the synchronous terminals are the same.
In addition, the encoded synchronous image further includes a corresponding coordinate system, and after the target terminal receives a control instruction input by a user through an external device (e.g., a mouse, a keyboard, etc.) or a point touch operation (e.g., the user touches a display screen, clicks the display screen through a touch pen, etc.), a touch coordinate corresponding to the control instruction can be determined, where the touch coordinate is a coordinate in the coordinate system corresponding to the encoded synchronous image.
In step 22, the target terminal in each synchronous terminal determines the touch coordinates according to the received control command.
The touch coordinates can be used to represent a relative position between the position operated by the user and the encoded synchronous image, that is, a position of the position operated by the user in the encoded synchronous image.
For example, as shown in fig. 3, fig. 3 is a schematic diagram of encoding a synchronous image according to an embodiment of the present application, where the schematic diagram includes: the encoded synchronization image 30, touch coordinates 31, touch coordinates 32, touch coordinates 33, touch coordinates 34, a toolbar 35 provided for selection by the user, a selection button 36 provided for selection by the user, and blank areas provided for other operations (e.g., writing, drawing, etc.) by the user.
The encoded synchronization image 30 is a screen displayed on the display device of each synchronization terminal. When the encoded synchronization image 30 is a frame displayed by the target terminal, the user can touch the toolbar 35, the selection button 36, or the blank area in the display screen by using a stylus, a touch pad, a finger, a mouse, a keyboard, or other methods, so as to input the control command.
After the target terminal receives the control instruction input by the user, the target terminal can determine the touch coordinate according to the received control instruction.
For example, as shown in fig. 3, when the user inputs a control instruction to write a "person" word in the blank area, the target terminal may determine, according to the control instruction input by the user (i.e., a path traced by the user when writing the "person" word in the blank area), each touch coordinate 31(a, b), touch coordinate 32(c, d), touch coordinate 33(e, f), and touch coordinate 34(g, h) corresponding to the user during the operation.
It should be noted that fig. 3 only lists 4 touch coordinates exemplarily to illustrate the meaning of the touch coordinates in the embodiment of the present application, and in fact, when the user writes a "person" word in a blank area, the target terminal may determine several other touch coordinates in the writing process in addition to the stroke starting point and the end point. Through the touch coordinates and the preset rendering mode, the target terminal can display the 'people' words written by the user in the blank area.
It should be further noted that, in an embodiment, if the control instruction input by the user is in an execution order (for example, when writing, the user needs to draw strokes in sequence in order), the target terminal needs to determine the execution order of each touch coordinate while determining the touch coordinate. The execution sequence of each touch coordinate may be determined according to the sequence in which the target terminal receives the control instruction, that is, the execution sequence of the touch coordinate corresponding to the control instruction received first is first, and the execution sequence of the touch coordinate corresponding to the control instruction received later is later. For example, as shown in fig. 3, if the user writes a "person" word, first writing from the touch coordinates 31 to the touch coordinates 32 in the direction shown in fig. 3, and then writing from the touch coordinates 33 to the touch coordinates 34 in the direction shown in fig. 3 until writing is completed, the execution sequence of the 4 touch coordinates shown in fig. 3 is from first to last: touch coordinates 31, touch coordinates 32, touch coordinates 33, and touch coordinates 34.
In another case, if the control instruction input by the user is not in the execution order (for example, during drawing, the user may fill a certain area through a filling option), the target terminal does not need to determine the execution order of each touch coordinate after determining the touch coordinate. That is, if the touch coordinates are determined simultaneously by the target terminal, the target terminal does not need to determine the execution order of the touch coordinates.
In another case, if the control instruction input by the user is in the execution order and not in the execution order (for example, when drawing, the user may draw the graphics in a certain order and then fill the graphics with the filling option), the target terminal needs to determine the execution order of the touch coordinates while determining the touch coordinates, and there may be multiple touch coordinates in the same execution order (for example, the touch coordinates determined when filling the graphics).
In step 23, the target terminal sends the touch coordinates to the server, and correspondingly, the server receives the touch coordinates sent by the target terminal.
In step 24, the target terminal executes the control instruction.
It should be noted that, in the embodiment of the present application, the execution order of step 23 and step 24 is not limited, that is, in the embodiment of the present application, step 23 may be executed first and then step 24 is executed, step 24 may be executed first and then step 23 is executed, or step 23 and step 24 may be executed simultaneously.
In an alternative embodiment, step 23 may be performed as: the target terminal sends an operation request to the server, the server responds to the operation request and returns an operation response to the target terminal, and the target terminal responds to the operation response and sends the touch coordinate to the server.
The operation response is used for representing the target terminal to obtain the operation authority.
In the embodiment of the application, before the target terminal sends the touch coordinate to the server, the corresponding operation authority needs to be acquired from the server. That is to say, in each synchronous terminal, only the terminal that acquires the operation authority may serve as the target terminal to send the touch coordinate to the server, so as to achieve the purpose of synchronous display. Therefore, when the server executes the synchronous operation, the server only receives the touch coordinates sent by the target terminal, the interference of other synchronous terminals is avoided, and the stability of the synchronous process is improved.
In an optional implementation manner, if the server receives an operation request sent by a synchronization terminal other than the target terminal in the synchronization terminals, the embodiment of the present application may perform: the server responds to the received operation requests sent by the synchronous terminals except the target terminal in the synchronous terminals, returns rejection responses to the synchronous terminals sending the operation requests, and the synchronous terminals respond to the rejection responses returned by the server, receive the touch coordinates sent by the server and synchronously display the touch coordinates and the coded synchronous images.
For example, as shown in fig. 4, fig. 4 is a flowchart of right distribution performed by a server according to an embodiment of the present application, and specifically includes the following steps:
in step 41, the server broadcasts the encoded synchronization image to each synchronization terminal, and accordingly, each synchronization terminal receives the encoded synchronization image broadcast by the server.
In step 42, the target terminal in the synchronous terminals sends an operation request to the server, and accordingly, the server receives the operation request sent by the target terminal.
In step 43, the server returns an operation response to the target terminal, and accordingly, the target terminal receives the operation response returned by the server.
After receiving the operation response sent by the server, the target terminal represents that the target terminal acquires the corresponding operation permission, and further can execute the corresponding operation in the corresponding permission.
In step 44, the sync terminals except the target terminal transmit operation requests to the server, and accordingly, the server receives the operation requests transmitted by the sync terminals.
In step 45, the server returns a rejection response to the corresponding synchronization terminal, and accordingly, the synchronization terminal receives the rejection response returned by the server.
That is, when there is a terminal (i.e., a target terminal) that has acquired the authority among the synchronization terminals, if another synchronization terminal transmits an operation request to the server to acquire the operation authority, the server rejects the synchronization terminal and returns a rejection response. Therefore, when the server executes the synchronous operation, the server only receives the touch coordinates sent by the target terminal, the interference of other synchronous terminals is avoided, and the stability of the synchronous process is improved.
In step 25, the server performs a synchronization operation to cause the synchronization terminals other than the target terminal among the synchronization terminals to perform a synchronization display.
When the server executes the synchronous operation, synchronous display of synchronous terminals except the target terminal can be performed on the synchronous terminals based on the touch coordinates and the coded synchronous images. For example, the server may restore the operation corresponding to the touch coordinate to the encoded synchronous image, and send the encoded synchronous image after the restoration operation to each of the synchronous terminals, so that the synchronous terminals except the target terminal in each of the synchronous terminals perform synchronous display. For another example, the server may also send the touch coordinates to each synchronization terminal, so that the synchronization terminals except the target terminal in each synchronization terminal perform synchronous display based on the touch coordinates and the encoded synchronization image.
For example, as shown in fig. 5, fig. 5 is a schematic flowchart of a synchronization display process according to an embodiment of the present application, where the schematic diagram includes a server 511, a target terminal 512 of synchronization terminals, and other synchronization terminals 513.
In step 521, after the target terminal 512 acquires the corresponding operation authority, the target terminal 512 may determine the touch coordinate according to the control instruction, and then send the touch coordinate to the server 511.
The touch coordinate may be a single coordinate or a set of multiple touch coordinates. If the target terminal 512 sends a set of touch coordinates, the touch coordinates in the set may or may not have an execution order.
In step 522, when the server 511 receives the touch coordinates sent by the target terminal 512, the server 511 may perform a synchronization operation according to the touch coordinates, so that each synchronization terminal 513 displays in synchronization with the target terminal 512.
The server 511 may restore the operation corresponding to the touch coordinate to the encoded synchronous image, and send the encoded synchronous image after the restoration operation to each of the synchronous terminals 513. The server 511 may also transmit the touch coordinates to each of the synchronization terminals 513 so that each of the synchronization terminals 513 performs synchronous display based on the touch coordinates and the encoded synchronization image.
As shown in fig. 5, the "person" word is displayed in the blank area of the target terminal 512, the sync terminal 513 has no contents in the blank area before the sync display, and the sync terminal 513 displays the "person" word in the blank area after the sync display. That is, with the embodiment of the present application, the server can broadcast the encoded synchronization image to each synchronization terminal so that each synchronization terminal receives the same display screen image and displays it. When synchronous display is carried out, the target terminal can determine touch coordinates according to the received control instruction and sends the touch coordinates to the server, and then after the server receives the touch coordinates sent by the target terminal, the server can execute synchronous operation based on the touch coordinates and the coded synchronous images so as to realize synchronous display of all synchronous terminals. In the process, because the synchronous display of each synchronous terminal is realized based on the touch coordinate and the coded synchronous image, and the coded synchronous images displayed by each synchronous terminal are the same image, even if factors such as different display screen sizes, different operating systems, different application program versions and the like exist among the synchronous terminals, the synchronous operation executed based on the touch coordinate and the coded synchronous image cannot be influenced, and the synchronous terminals can normally display the same image when the screen is shared.
In an alternative embodiment, the step 25 may be specifically implemented as: and the server sends the touch coordinates to the synchronous terminals except the target terminal in each synchronous terminal, and the synchronous terminals analyze the touch coordinates and synchronously display the touch coordinates and the target terminal after receiving the touch coordinates.
In this case, after receiving the touch coordinate sent by the target terminal, the server can directly send the touch coordinate to each synchronous terminal, so that when the server needs to process a large amount of data, the embodiment of the application can reduce the operation pressure and improve the processing efficiency.
Correspondingly, after the synchronous terminal analyzes the touch coordinate, the touch coordinate is a relative position between the position representing the user operation and the code synchronous image, namely the position of the user operation in the code synchronous image. Therefore, the synchronous terminals can accurately determine the positions of the corresponding operations in the coded synchronous images through the touch coordinates, and each synchronous terminal can normally display the same picture when the screen is shared.
In an alternative embodiment, the synchronous terminals may include a high-priority terminal and a low-priority terminal, and the target terminal is the high-priority terminal.
Specifically, the step 25 may be specifically executed as: the server responds to the selection control of the target low-priority terminal corresponding to the touch coordinate, sends the touch coordinate to the synchronous terminals except the target terminal, the synchronous terminals receive the touch coordinate, analyze the touch coordinate and synchronously display the touch coordinate and the target terminal, and the server transfers all or part of operation authority of the target terminal to the target low-priority terminal.
That is, when the target terminal is a high-priority terminal, the user using the target terminal may select any target low-priority terminal and transfer all or part of his or her own right to the target low-priority terminal.
For example, in a conference scenario, the target terminal (high priority terminal) may be the conference moderator and the other synchronized terminals may be conference participants. Taking fig. 3 as an example, the encoded sync image 30 in fig. 3 is a picture displayed by the target terminal, and each selection button 36 may correspond to a different sync terminal. When the conference host clicks a certain selection button 36 (for example, a selection button a) through the target terminal, the target terminal may send the corresponding touch coordinates to the server, so that the server performs a synchronization operation and simultaneously transfers all or part of rights of the target terminal to a synchronization terminal corresponding to the selection button 36.
Then, after the synchronization terminal corresponding to the selection button 36 acquires the corresponding operation permission, the conference participant using the synchronization terminal may input a control instruction to the synchronization terminal, so that the synchronization terminal sends the touch coordinate corresponding to the control instruction to the server, and the server executes the synchronization operation.
In the embodiment of the application, the control of the authority can be more standardized by setting the priority of the synchronous terminal, and the applicability of the system is expanded.
In another alternative embodiment, the synchronous terminals may include a high-priority terminal and a low-priority terminal, and the target terminal is a low-priority terminal.
Specifically, the step 25 may be specifically executed as: the server responds to the selection control corresponding to the touch coordinate and ending the operation, sends the touch coordinate to the synchronous terminals except the target terminal in each synchronous terminal, the synchronous terminals receive the touch coordinate, analyze the touch coordinate and synchronously display the touch coordinate and the target terminal, and the server transfers all or part of operation authority of the target terminal to the high-priority terminal.
For example, in a teaching scenario, the target terminal (low priority terminal) may be a student in a classroom and the other synchronization terminals include other students (low priority terminal) and teachers in the classroom (high priority terminal). Taking fig. 3 as an example, the encoded synchronization image 30 in fig. 3 is a screen displayed by the target terminal, and the selection button E may be a selection control for ending the operation.
When the student clicks the selection button E through the target terminal, the target terminal can send the corresponding touch coordinate to the server, so that the server can transfer all or part of the authority of the target terminal to the high-priority terminal corresponding to the teacher while performing synchronous operation.
Further, in an optional implementation manner, the high-priority terminal may also actively withdraw the right, and specifically, the process may be specifically executed as: and the server responds to the received permission recovery instruction of the high-priority terminal and transfers all or part of the operation permission of the target terminal to the high-priority terminal.
For example, in a teaching scenario, the target terminal (low priority terminal) may be a student in a classroom and the other synchronization terminals include other students (low priority terminal) and teachers in the classroom (high priority terminal). Taking fig. 3 as an example, the encoded synchronization image 30 in fig. 3 is a screen displayed by a synchronization terminal used by a teacher, where the selection button E may be a selection control for sending a permission retraction instruction.
When the teacher clicks the selection button E through the high-priority terminal, the high-priority terminal can send the corresponding touch coordinates to the server, so that the server can perform synchronous operation, and simultaneously transfer all or part of the authority of the target terminal to the high-priority terminal corresponding to the teacher, namely, the authority recovery operation is realized.
In the embodiment of the application, the control of the authority can be more standardized by setting the priority of the synchronous terminal, and the applicability of the system is expanded.
Based on the same technical concept, an embodiment of the present application further provides a synchronous display device, as shown in fig. 6, the device includes: a broadcasting module 61, a touch coordinate determination module 62, a touch coordinate transmission module 63, and a synchronization module 64.
And a broadcasting module 61, configured to broadcast the encoded synchronous image to each synchronous terminal by the server.
And a touch coordinate determination module 62, configured to determine a touch coordinate according to the received control instruction by a target terminal in each of the synchronous terminals.
And a touch coordinate sending module 63, configured to send the touch coordinate to the server by the target terminal, and execute the control instruction.
And a synchronization module 64, configured to receive the touch coordinates sent by the target terminal by the server, and execute a synchronization operation based on the touch coordinates and the encoded synchronization image, so that the synchronization terminals except the target terminal in each synchronization terminal perform synchronous display.
In some embodiments, the synchronization module 64 is specifically configured to:
and the server sends the touch coordinates to the synchronous terminals except the target terminal in each synchronous terminal.
And after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal.
In some embodiments, the touch coordinate sending module 63 is specifically configured to:
and the target terminal sends an operation request to the server.
And the server responds to the operation request and returns an operation response to the target terminal, wherein the operation response is used for representing that the target terminal obtains the operation authority.
And the target terminal responds to the operation response and sends the touch coordinate to the server.
In some embodiments, the apparatus further comprises:
the response module is used for the server to respond to the received operation request sent by the synchronous terminals except the target terminal in each synchronous terminal and return a refusal response to the synchronous terminal sending the operation request; and
and the synchronous display module is used for receiving the touch coordinates sent by the server by the synchronous terminal in response to receiving the rejection response returned by the server and synchronously displaying the touch coordinates and the coded synchronous image.
In some embodiments, the synchronization terminal includes a high priority terminal and a low priority terminal, and the target terminal is a high priority terminal.
The synchronization module 64 is specifically configured to:
and the server responds to the selection control of the target low-priority terminal corresponding to the touch coordinate, and sends the touch coordinate to the synchronous terminals except the target terminal.
And after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal.
And the server transfers all or part of the operation authority of the target terminal to the target low-priority terminal.
In some embodiments, the synchronization terminal includes a high priority terminal and a low priority terminal, and the target terminal is a low priority terminal.
The synchronization module 64 is specifically configured to:
and the server responds to the selection control corresponding to the touch coordinate and ending the operation, and sends the touch coordinate to the synchronous terminals except the target terminal.
And after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal.
And the server transfers all or part of the operation authority of the target terminal to the high-priority terminal.
In some embodiments, the apparatus further comprises:
and the permission recovery module is used for responding to the permission recovery instruction of the high-priority terminal received by the server and transferring all or part of the operation permission of the target terminal to the high-priority terminal.
According to the embodiment of the application, the server can broadcast the coded synchronous images to the synchronous terminals, so that the synchronous terminals receive the same display picture images and display the same display picture images. When synchronous display is carried out, the target terminal can determine touch coordinates according to the received control instruction and sends the touch coordinates to the server, and then after the server receives the touch coordinates sent by the target terminal, the server can execute synchronous operation based on the touch coordinates and the coded synchronous images so as to realize synchronous display of all synchronous terminals. In the process, because the synchronous display of each synchronous terminal is realized based on the touch coordinate and the coded synchronous image, and the coded synchronous images displayed by each synchronous terminal are the same image, even if factors such as different display screen sizes, different operating systems, different application program versions and the like exist among the synchronous terminals, the synchronous operation executed based on the touch coordinate and the coded synchronous image cannot be influenced, and the synchronous terminals can normally display the same image when the screen is shared.
Fig. 7 is a schematic diagram of an electronic device according to an embodiment of the present application. As shown in fig. 7, the electronic device shown in fig. 7 is a general address query device, which includes a general computer hardware structure, which includes at least a processor 71 and a memory 72. The processor 71 and the memory 72 are connected by a bus 73. The memory 72 is adapted to store instructions or programs executable by the processor 71. The processor 71 may be a stand-alone microprocessor or a collection of one or more microprocessors. Thus, the processor 71 implements the processing of data and the control of other devices by executing the instructions stored in the memory 72 to execute the method flows of the embodiments of the present application as described above. The bus 73 connects the above-described components together, and also connects the above-described components to a display controller 74 and a display device and an input/output (I/O) device 75. Input/output (I/O) devices 75 may be a mouse, keyboard, modem, network interface, touch input device, motion sensing input device, printer, and other devices known in the art. Typically, the input/output devices 75 are connected to the system through input/output (I/O) controllers 76.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, apparatus (device) or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may employ a computer program product embodied on one or more computer-readable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations of methods, apparatus (devices) and computer program products according to embodiments of the application. It will be understood that each flow in the flow diagrams can be implemented by computer program instructions.
These computer program instructions may be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows.
These computer program instructions may also be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows.
Another embodiment of the present application is directed to a non-transitory storage medium storing a computer-readable program for causing a computer to perform some or all of the above-described method embodiments.
That is, as can be understood by those skilled in the art, all or part of the steps in the method for implementing the embodiments described above may be accomplished by specifying the relevant hardware through a program, where the program is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (11)
1. A method for synchronized display, the method comprising:
the server broadcasts the coded synchronous images to each synchronous terminal;
determining a touch coordinate by a target terminal in each synchronous terminal according to a received control instruction;
the target terminal sends the touch coordinate to the server and executes the control instruction; and
and the server receives the touch coordinates sent by the target terminal and executes synchronous operation based on the touch coordinates and the coded synchronous images so as to synchronously display the synchronous terminals except the target terminal in each synchronous terminal.
2. The method of claim 1, wherein the performing a synchronization operation based on the touch coordinates and the encoded synchronization image comprises:
the server sends the touch coordinates to the synchronous terminals except the target terminal in each synchronous terminal; and
and after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal.
3. The method of claim 1, wherein the target terminal sending the touch coordinates to the server comprises:
the target terminal sends an operation request to the server;
the server responds to the operation request and returns an operation response to the target terminal, wherein the operation response is used for representing that the target terminal obtains operation permission; and
and the target terminal responds to the operation response and sends the touch coordinate to the server.
4. The method of claim 3, wherein after returning an operation response to the target terminal, the method further comprises:
the server responds to the received operation request sent by the synchronous terminals except the target terminal in each synchronous terminal, and returns a refusal response to the synchronous terminal sending the operation request; and
and the synchronous terminal receives the touch coordinate sent by the server in response to the received rejection response returned by the server, and synchronously displays the touch coordinate and the coded synchronous image.
5. The method of claim 1, wherein the synchronized terminals comprise a high priority terminal and a low priority terminal, and wherein the target terminal is a high priority terminal;
the performing a synchronization operation based on the touch coordinates and the encoded synchronization image includes:
the server responds to a selection control of a target low-priority terminal corresponding to the touch coordinate, and sends the touch coordinate to the synchronous terminals except the target terminal;
after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal; and
and the server transfers all or part of the operation authority of the target terminal to the target low-priority terminal.
6. The method of claim 1, wherein the synchronized terminals comprise a high priority terminal and a low priority terminal, and wherein the target terminal is a low priority terminal;
the performing a synchronization operation based on the touch coordinates and the encoded synchronization image includes:
the server responds to a selection control corresponding to the touch coordinate and ending the operation, and sends the touch coordinate to the synchronous terminals except the target terminal;
after receiving the touch coordinate, the synchronous terminal analyzes the touch coordinate and synchronously displays the touch coordinate and the target terminal; and
and the server transfers all or part of the operation authority of the target terminal to the high-priority terminal.
7. The method of claim 6, further comprising:
and the server responds to the received permission recovery instruction of the high-priority terminal and transfers all or part of the operation permission of the target terminal to the high-priority terminal.
8. A synchronous display system is characterized in that the system comprises a server and a synchronous terminal, wherein the synchronous terminal comprises a target terminal:
the server is configured to broadcast a coded synchronization image to each synchronization terminal, receive touch coordinates sent by the target terminal, and perform synchronization operation based on the touch coordinates and the coded synchronization image, so that the synchronization terminals except the target terminal in each synchronization terminal perform synchronous display;
the synchronous terminal is configured to receive the coded synchronous image;
the target terminal is configured to send the touch coordinate to the server and execute the control instruction.
9. A synchronous display device, characterized in that the device comprises:
the broadcasting module is used for broadcasting the coded synchronous images to each synchronous terminal by the server;
the touch coordinate determination module is used for determining a touch coordinate by a target terminal in each synchronous terminal according to the received control instruction;
the touch coordinate sending module is used for sending the touch coordinate to the server by the target terminal and executing the control instruction; and
and the synchronization module is used for receiving the touch coordinates sent by the target terminal by the server and executing synchronization operation based on the touch coordinates and the coded synchronization image so as to synchronously display the synchronization terminals except the target terminal in each synchronization terminal.
10. An electronic device comprising a memory and a processor, wherein the memory is configured to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method of any of claims 1-7.
11. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210134039.7A CN114615535A (en) | 2022-02-14 | 2022-02-14 | Synchronous display method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210134039.7A CN114615535A (en) | 2022-02-14 | 2022-02-14 | Synchronous display method and device, electronic equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114615535A true CN114615535A (en) | 2022-06-10 |
Family
ID=81859023
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210134039.7A Pending CN114615535A (en) | 2022-02-14 | 2022-02-14 | Synchronous display method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114615535A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115328372A (en) * | 2022-07-30 | 2022-11-11 | 深圳乐播科技有限公司 | Synchronous display method, device, electronic equipment and storage medium |
-
2022
- 2022-02-14 CN CN202210134039.7A patent/CN114615535A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115328372A (en) * | 2022-07-30 | 2022-11-11 | 深圳乐播科技有限公司 | Synchronous display method, device, electronic equipment and storage medium |
| CN115328372B (en) * | 2022-07-30 | 2024-01-09 | 深圳乐播科技有限公司 | Synchronous display method, synchronous display device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220319139A1 (en) | Multi-endpoint mixed-reality meetings | |
| CN110609654B (en) | Data synchronous display method, device and equipment and teleconferencing system | |
| CN104133630A (en) | Stroke synchronization method and device | |
| CN111381790A (en) | Control method, device and system, electronic whiteboard and mobile terminal | |
| CN114648615B (en) | Method, device and equipment for controlling interactive reproduction of target object and storage medium | |
| US9740294B2 (en) | Display apparatus and method for controlling display apparatus thereof | |
| CN113746797A (en) | Three-dimensional point cloud transmission method, device and medium | |
| CN114615535A (en) | Synchronous display method and device, electronic equipment and readable storage medium | |
| CN112487871B (en) | Handwriting data processing method and device and electronic equipment | |
| CN111273804A (en) | Touch forwarding device, touch display equipment and control method | |
| US20160117140A1 (en) | Electronic apparatus, processing method, and storage medium | |
| US20150138077A1 (en) | Display system and display controll device | |
| CN110119199B (en) | Tracking system, method and non-transitory computer readable medium for real-time rendering of images | |
| EP4290361A1 (en) | Display control method and apparatus for pointer in window, device, and storage medium | |
| CN109308862B (en) | Signal control method, control device, processing device and signal control equipment | |
| CN112651801B (en) | Method and device for displaying house source information | |
| CN114168098A (en) | Data synchronization method, device, equipment and storage medium of electronic whiteboard | |
| CN114168060A (en) | Electronic whiteboard rendering method, device, equipment and storage medium | |
| CN112966480A (en) | Teleconference annotation method and related equipment thereof | |
| CN107516334B (en) | Display method, device and equipment of handwriting track and storage medium | |
| CN113891160B (en) | Sliding switching method and device for content card, terminal and storage medium | |
| WO2016166955A1 (en) | Image processing device, image distribution system, and image processing method | |
| CN116400841A (en) | Interface display method, device, electronic equipment and readable storage medium | |
| KR20220079213A (en) | System and method for providing product demonstration service based on extended reality | |
| CN114153539A (en) | Front-end application interface generation method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |