CN113282257A

CN113282257A - Method, terminal device, device and readable storage medium for synchronous display

Info

Publication number: CN113282257A
Application number: CN202110491008.2A
Authority: CN
Inventors: 刘双双; 高佩文; 周瑜
Original assignee: Beijing Urban Network Neighbor Information Technology Co Ltd
Current assignee: Beijing Urban Network Neighbor Information Technology Co Ltd
Priority date: 2019-11-30
Filing date: 2019-11-30
Publication date: 2021-08-20
Anticipated expiration: 2039-11-30
Also published as: CN111078171B; CN113282257B; CN111078171A

Abstract

The embodiment of the invention provides a method, terminal equipment, equipment and a readable storage medium for synchronous display. The method comprises the following steps: receiving a first timestamp sent by the opposite terminal equipment, wherein the first timestamp is the timestamp recorded by the server and used for receiving the first operation information and is sent to the opposite terminal equipment; acquiring a second timestamp, wherein the acquired second timestamp is a timestamp recorded by the server and used for receiving second operation information and sent to the terminal device, or the acquired second timestamp is a timestamp stored by the terminal device and used for recording the last operation triggered by a target space image synchronously displayed with the opposite terminal device; and determining the operation correspondingly executed on the terminal equipment and the operation correspondingly and synchronously executed by the opposite terminal equipment according to the priority of the first time stamp and the priority of the second time stamp.

Description

Method, terminal device, device and readable storage medium for synchronous display

The patent application of the invention is a divisional application of Chinese patent application with application date of 2019, 11 and 30, and application number of 201911208529.1, entitled "method for synchronous display, terminal equipment, equipment and readable storage medium".

Technical Field

The present disclosure relates to the field of display technologies, and in particular, to a method, a terminal device, a device, and a readable storage medium for synchronous display.

Background

With the continuous development of social productivity and scientific technology, a vivid three-dimensional model of a building can be constructed based on Virtual Reality (VR), and the structures and functions inside and outside the building can be displayed in an all-around manner, so that a user can roam in the three-dimensional model of the building through a network, feel the building and the surrounding environment thereof personally, and quickly and conveniently realize remote house watching, house selection and the like.

Based on flat panel display or based on VR display technology, a synchronized presentation of the premises may be achieved or may be referred to as screen sharing. Screen sharing may be understood as keeping the content displayed within the screens of different terminals consistent in real time between different terminals.

Disclosure of Invention

At least one embodiment of the present disclosure provides a method for synchronous display, which is applied to a terminal device, and receives a first timestamp sent by an opposite terminal device, where the first timestamp is a timestamp recorded by a server and used for receiving first operation information and sent to the opposite terminal device, and the first operation information is information corresponding to a first operation, which is sent to the server by the opposite terminal device after a first user triggers the first operation on a target space image displayed synchronously with the terminal device on the opposite terminal device; acquiring a second timestamp, wherein the acquired second timestamp is a timestamp recorded by the server and used for receiving second operation information and sent to the terminal device, and the second operation information is information corresponding to the second operation, which is sent to the server by the terminal device after a second user triggers a second operation on a target space image synchronously displayed with the opposite terminal device on the terminal device; or the obtained second timestamp is a timestamp which is stored by the terminal device and used for recording the last operation triggered by the target space image synchronously displayed with the opposite terminal device; and determining the operation correspondingly executed on the terminal equipment and the operation correspondingly and synchronously executed by the opposite terminal equipment according to the priority of the first time stamp and the priority of the second time stamp.

For example, in the method for synchronous display provided by an embodiment of the present disclosure, when the obtained second timestamp is a timestamp recorded by the server and used for receiving the second operation information, and is sent to the terminal device, the determining, according to the priority of the first timestamp and the priority of the second timestamp, an operation performed on the terminal device and an operation performed by the peer device in synchronization includes: when the priority of the first timestamp is higher than that of the second timestamp, executing a first operation on the terminal device according to received first operation data corresponding to the first operation to enable the terminal device to display a target space image corresponding to the first operation, and enabling the opposite-end device to execute the first operation according to the first operation data to enable the opposite-end device to display the target space image corresponding to the first operation.

For example, an embodiment of the present disclosure provides a method for synchronous display, further including: and updating a second timestamp stored in the terminal equipment for recording the timestamp of the last operation triggered by the target space image synchronously displayed with the opposite terminal equipment into the first timestamp.

For example, in the method for synchronous display provided by an embodiment of the present disclosure, when the obtained second timestamp is a timestamp recorded by the server and used for receiving the second operation information, and is sent to the terminal device, the method for determining, according to the priority of the first timestamp and the priority of the second timestamp, an operation performed on the terminal device and an operation performed by the peer device synchronously includes: when the priority of the first timestamp is lower than that of the second timestamp, executing, at the terminal device, a second operation according to second operation data corresponding to the second operation so that the terminal device displays a target spatial image corresponding to the second operation, and sending the second operation data corresponding to the second operation to the opposite-end device so that the opposite-end device executes the second operation according to the second operation data so that the opposite-end device displays the target spatial image corresponding to the second operation.

For example, in the method for synchronous display provided by an embodiment of the present disclosure, in a case that the obtained second timestamp is a timestamp stored by the terminal device and used for recording a last operation triggered on a target spatial image displayed in synchronization with the peer device, determining an operation performed on the terminal device and an operation performed by the peer device in synchronization according to a priority of the first timestamp and a priority of the second timestamp includes: executing a first operation on the terminal device according to the received first operation data corresponding to the first operation to enable the terminal device to display a target space image corresponding to the first operation, and enabling the opposite-end device to execute the first operation according to the first operation data to enable the opposite-end device to display the target space image corresponding to the first operation.

For example, an embodiment of the present disclosure provides a method for synchronous display, further including: and storing the first time stamp in the terminal as a second time stamp of the terminal device for recording the time stamp of the last operation triggered by the target space image synchronously displayed with the opposite terminal device.

For example, in the method for synchronizing display provided by an embodiment of the present disclosure, the first operation or the second operation includes any one of: zoom in, zoom out, rotate, drag, click.

At least one embodiment of the present disclosure provides a terminal device for synchronous display, which is suitable for a terminal device, and includes: the transmission unit is configured to receive a first timestamp sent by the opposite-end device, wherein the first timestamp is the timestamp recorded by the server and used for receiving first operation information and is sent to the opposite-end device, and the first operation information is information corresponding to the first operation, which is sent to the server by the opposite-end device after a first user triggers a first operation on a target space image synchronously displayed with the terminal device on the opposite-end device; the acquisition unit is configured to acquire a second timestamp, wherein the acquired second timestamp is a timestamp recorded by the server and used for receiving second operation information and sent to the terminal device, and the second operation information is information corresponding to a second operation, which is sent to the server by the terminal device after the second user triggers the second operation on a target space image synchronously displayed with the opposite terminal device on the terminal device; or the obtained second timestamp is a timestamp which is stored by the terminal device and used for recording the last operation triggered by the target space image synchronously displayed with the opposite terminal device; and the determining unit is configured to determine the operation correspondingly executed on the terminal equipment and the operation correspondingly and synchronously executed by the opposite terminal equipment according to the priority of the first time stamp and the priority of the second time stamp.

At least one embodiment of the present disclosure provides an apparatus for synchronizing display, including: a processor; and a memory, wherein the memory has stored therein computer readable code which, when executed by the processor, performs the method for synchronized display described above.

At least one embodiment of the present disclosure provides a computer-readable storage medium having stored thereon instructions that, when executed by a processor, cause the processor to perform the above-described method for synchronizing displays.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings used in the description of the embodiments will be briefly introduced below. The drawings in the following description are merely exemplary embodiments of the disclosure.

FIG. 1A shows a schematic diagram of a scene for a synchronized display;

FIG. 1B is a schematic diagram of another scene for a synchronized display;

FIG. 2 is a schematic diagram of an application interface of a terminal device and a peer device for synchronous display;

FIG. 3 is a flow chart illustrating a method for synchronizing displays according to an embodiment of the present disclosure;

fig. 4 is a detailed flowchart illustrating step S330 according to at least one embodiment of the present disclosure;

fig. 5 is another detailed flowchart illustrating step S330 according to at least one embodiment of the present disclosure;

fig. 6 is yet another detailed flowchart illustrating step S330 according to at least one embodiment of the present disclosure;

fig. 7 is a schematic diagram illustrating functional modules of a terminal device 700 for synchronized display according to at least one embodiment of the present disclosure;

FIG. 8 shows a schematic diagram of an apparatus 800 for synchronized display according to an embodiment of the present disclosure;

FIG. 9 shows a schematic diagram of an architecture of an exemplary computing device 900, according to an embodiment of the present disclosure;

fig. 10 shows a schematic diagram of a storage medium 1000 according to an embodiment of the disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described below clearly and completely with reference to the accompanying drawings of the embodiments of the present disclosure. It is to be understood that the described embodiments are only a few embodiments of the present disclosure, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the disclosure without any inventive step, are within the scope of protection of the disclosure.

Unless otherwise defined, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. The use of "first," "second," and similar terms in this disclosure is not intended to indicate any order, quantity, or importance, but rather is used to distinguish one element from another. The word "comprising" or "comprises", and the like, means that the element or item listed before the word covers the element or item listed after the word and its equivalents, but does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", and the like are used merely to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly. To maintain the following description of the embodiments of the present disclosure clear and concise, a detailed description of some known functions and components have been omitted from the present disclosure.

Flow charts are used in this disclosure to illustrate steps of methods according to embodiments of the disclosure. It should be understood that the preceding and following steps are not necessarily performed in the exact order in which they are performed. Rather, various steps may be processed in reverse order or simultaneously. Meanwhile, other operations may be added to the processes, or a certain step or steps may be removed from the processes.

In the screen sharing state, if the users of the terminal device and the peer device both operate the target spatial image displayed synchronously by the peer device and the terminal device, due to a delay in network transmission data, it may happen that the terminal device cannot determine the operation to be performed thereon, and thus cannot maintain synchronous display.

The utility model provides a method, terminal equipment, equipment and storage medium for synchronous display, terminal equipment is through obtaining the first time stamp and the second time stamp of unified confirming by the server from the server to according to the priority of first time stamp and the priority of second time stamp, confirm the operation that corresponds the execution on terminal equipment and make the operation that opposite terminal equipment corresponds the synchronous execution, thereby realize the synchronous show of the target space image on terminal equipment and the opposite terminal equipment. And because the first timestamp and the second timestamp are uniformly determined by the server, the first timestamp and the second timestamp are consistent for the terminal device and the opposite terminal device, and there is no clock difference between different devices. And the process of determining the operation correspondingly executed on the terminal equipment and the operation correspondingly and synchronously executed by the opposite terminal equipment is finished at the terminal equipment, so that the load of the server can be reduced.

Hereinafter, a method according to the present disclosure will be described in detail with reference to the accompanying drawings.

Referring to fig. 1A to 1B, first, a scene to which the method for synchronous displaying according to the present disclosure is applied is described with reference to fig. 1A to 1B, where fig. 1A is a schematic diagram illustrating a scene for synchronous displaying; FIG. 1B shows a schematic diagram of another scenario for synchronized display.

Referring to fig. 1A-1B, the

peer devices

111 and 113 and the terminal device 112 in the present disclosure may communicate with the server 120 via a network for data exchange, and the

peer devices

111 and 113 and the terminal device 112 in the present disclosure may communicate with each other directly via the network for data exchange or through data forwarding by the server 120 via the network for data exchange.

The

peer devices

111, 113 and the terminal device 112 in the present disclosure may be any electronic devices, including but not limited to a mobile terminal or a fixed terminal having data processing capability, such as a notebook computer, a desktop computer, a smart phone, a tablet computer, and the like. For example, the

peer devices

111, 113 and the terminal device 112 may include an application (App) of the mobile terminal. The application may be, for example, "live guest," "58 city," etc.

Server 120 in the present disclosure refers to a device that provides computing services, including but not limited to file servers, database servers, application servers, WEB servers, and the like. Also, a timing generator (not shown in the figure) may be included in the server 120, the timing server being configured to generate a first time stamp according to the received first operation information and a second time stamp according to the received second operation information.

Networks in the present disclosure include, but are not limited to, the internet, IPTV networks, wireless fidelity (Wi-Fi) networks, Wireless Local Area Networks (WLANs), Local Area Networks (LANs), and/or Metropolitan Area Networks (MANs), etc., following configurations such as Real-time audio video technology (RTC), transmission control protocol and internet protocol (TCP/IP), User Datagram Protocol (UDP), hypertext transfer protocol (HTTP), and/or File Transfer Protocol (FTP). For example, a transmission channel may be established between the

peer devices

111 and 113 and the terminal device 112 through Real-Time audio and video (RTC) technology, and Real-Time transmission of data is realized through a transmission channel group. For example, the data may be a first time stamp, a second time stamp, first operational data, second operational data, and the like, described below.

Referring to fig. 1A, in the scenario of fig. 1A, at the peer device 111, a first user may trigger a first operation on a target space image (which will be explained in detail with reference to fig. 2) displayed synchronously with the terminal device 112 on the peer device 111, for example, the first user may be a broker that displays the target space image to a house-watching user, and may first enter the house roaming space, that is, the peer device 111 may display the target space image corresponding to the house roaming space, and the broker may perform a click operation on the target space image, for example.

Then, the peer device 111 sends first operation information corresponding to the first operation to the server 120, and the server 120 receives the first operation information and records a first timestamp of receiving the first operation information, and sends the first timestamp to the peer device 111. After receiving the first timestamp, peer device 111 sends the first timestamp to terminal device 112, where peer device 111 may directly send the first timestamp to terminal device 112, or may forward the first timestamp to terminal device 112 through server 120. At the terminal device 112, the second user may also trigger a second operation on the terminal device 112 for the target spatial image that is synchronously presented with the peer device 111. For example, the second user may be a house-watching user, who may also enter the house roaming space through the same web link as the broker, for example, that is, the same target space image corresponding to the house roaming space is also displayed at the terminal device 112, and the house-watching user may also perform a click operation on the target space image, for example.

When terminal device 112 receives the first timestamp, a second timestamp is obtained. There are also various ways to obtain the second timestamp. For example, if a second user triggers a second operation on the terminal device 112 for a target space image displayed synchronously with the peer device 111 at this time, the terminal device 112 sends second operation information corresponding to the second operation to the server 120, the server 120 receives the second operation information and records a second timestamp of the received second operation information, and sends the second timestamp to the terminal device 112, so that the terminal device 112 obtains the second timestamp.

For another example, if the second user does not trigger the second operation on the terminal device 112 for the target spatial image displayed in synchronization with the peer device 111 at this time, the terminal device 112 acquires, as the second timestamp, the timestamp stored in the terminal device 112 and used for recording the last operation triggered on the target spatial image displayed in synchronization with the peer device 111. Terminal device 112 determines, according to the priority of the first timestamp and the priority of the second timestamp, an operation to be correspondingly executed on terminal device 112 and an operation to be correspondingly and synchronously executed by peer device 111.

With continued reference to fig. 1B, compared to the scenario of fig. 1A, the scenario in fig. 1B may have more peer devices (only the peer device 113 is shown in the figure), and in this scenario, after the peer device 111 receives the first timestamp from the server 120, the first timestamp may be sent to the terminal device 112 and the peer device 113 directly or through the server 120, so that the terminal device 112 and the peer device 113 perform processing by a method similar to that of the terminal device 112 in the scenario of fig. 1A, thereby implementing operations performed on the terminal device 112 and the peer device 113 correspondingly and operations performed by the peer device 111 correspondingly and synchronously.

It can be understood that the method for synchronous display of the present disclosure can be applied not only to the above scenario in which the broker takes a room to watch the user, but also to a scenario in which multiple users in different regions watch the room, and also to a scenario in which the broker takes multiple users to watch the room in different regions, and any scenario in which screen sharing, i.e., synchronous display, is required.

Referring to fig. 2, fig. 2 shows a schematic diagram of an application interface of the peer device 111 and the terminal device 112 for synchronous display.

In the method for synchronous display provided by the embodiment of the present disclosure, the first user and the second user may synchronously display the target space image as shown in fig. 2 through the peer device 111 and the terminal device 112, respectively, and the target space image are explained first below.

For example, the target space may be a physical space, and may include an indoor space, which may include a house, an office, etc., and an outdoor space, which may include an outdoor garden, a street, etc. The first user and the second user may not both be located within the target space, and both the first user and the second user may be located away from the target space, i.e., the first user and the second user may remotely (e.g., offsite) view the target space and roam within the target space.

For example, the target space may include one or more subspaces. For example, when the target space is a residence, the target space may include a living room subspace, a main lying subspace, a sub-lying subspace, a balcony subspace, a toilet subspace, a kitchen subspace, and the like. When the target space is an outdoor garden, the target space may include a subspace corresponding to a flower bed, a subspace corresponding to a sports facility, and the like. The following embodiments of the present disclosure are described in detail by taking a target space as a house as an example, and the present disclosure includes but is not limited thereto.

For example, the target space image may be a panoramic image of the target space, for example, the panoramic image of the target space may be a 2D (two-dimensional) house type image or a 3D (three-dimensional) house type image, and further, for example, a panoramic image generated based on a sky box or a sky dome. The 2D house type image is a two-dimensional plane house type image of the house, the 3D house type image is a three-dimensional stereo model image of the house, and the 2D house type image and the 3D house type image both show each subspace (e.g., a living room subspace, a main lying subspace, a sub-lying subspace, a balcony subspace, a toilet subspace, a kitchen subspace, etc.) of the house, the position arrangement of each subspace, and the like. It should be noted that the user can select and click on a subspace (e.g., main-lying subspace) shown in the 2D house type image or the 3D house type image, thereby viewing a three-dimensional virtual reality presentation image (i.e., panoramic image) of the subspace (e.g., main-lying subspace). The target space image may be any of various planar images corresponding to the target space (for example, an image showing a map of a target space location, an environment image of a cell corresponding to the target space, and the like).

In the method for synchronous display provided by the embodiment of the present disclosure, a first user and a second user may trigger a first operation and a second operation on a target space image synchronously displayed through a peer device 111 and a terminal device 112, respectively, so that application interfaces of the peer device 111 and the terminal device 112 are changed.

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, but the present disclosure is not limited to these specific embodiments.

Referring to fig. 3, fig. 3 is a flowchart illustrating a method for synchronizing display according to an embodiment of the present disclosure, which may be applied to the terminal device 112 and may include the following operations:

step S310, receiving a first timestamp sent by the opposite terminal device, wherein the first timestamp is the timestamp recorded by the server and used for receiving the first operation information and sent to the opposite terminal device, and the first operation information is information corresponding to the first operation and sent to the server by the opposite terminal device after a first user triggers the first operation on a target space image synchronously displayed with the terminal device on the opposite terminal device.

For example, the first operation may include at least one of: zoom in, zoom out, rotate, drag, click. For example, when a first user performs a trigger click operation on a target space image displayed synchronously with a terminal device on a peer device, the peer device generates first operation information and sends the first operation information to a server, where the first operation information may be any information used to notify the server that the peer device triggers a first operation and requests a first timestamp, for example.

For example, the server receiving the first operation information may record a timestamp of receiving the first operation information as a first timestamp and transmit the first timestamp to the peer device. For example, the server may determine the first timestamp according to a time when the first operation information is received based on a timing generator configured in the server, wherein the timing generator is configured to generate the first timestamp.

The server is used for uniformly recording the time stamp for the triggered first operation of the first user on the synchronously displayed target space image, so that the terminal equipment can be more fair when determining the operation correspondingly executed on the terminal equipment and the operation correspondingly synchronously executed by the opposite terminal equipment according to the priority of the first time stamp and the priority of the second time stamp.

For example, the peer device receives the first timestamp sent by the server, and may forward the first timestamp through the server or directly send the first timestamp to the terminal device.

For another example, instead of obtaining the first timestamp through the server, the peer device may record, as the first timestamp, the timestamp of the first operation by the peer device when the first user triggers the first operation on the target spatial image displayed synchronously with the terminal device on the peer device, and send the first timestamp to the terminal device.

For another example, if the first user operates the peer device very frequently, the terminal device may receive a first time stamp sequence including a plurality of first time stamps, and at this time, the first time stamp in the first time stamp sequence may be sequentially compared with the second time stamp, or only the last first time stamp in the first time stamp sequence may be compared.

Step S320, a second timestamp is obtained, wherein the obtained second timestamp is a timestamp recorded by the server and used for receiving second operation information and sent to the terminal device, and the second operation information is information corresponding to the second operation and sent to the server by the terminal device after a second user triggers the second operation on a target space image synchronously displayed with the opposite terminal device on the terminal device; or the obtained second timestamp is a timestamp stored by the terminal device and used for recording the last operation triggered by the target space image synchronously displayed with the opposite terminal device.

Two situations may occur at the terminal device: (1) a second user triggers a second operation on the target space image synchronously displayed with the opposite terminal equipment on the terminal equipment; (2) and the second user does not trigger a second operation on the target space image synchronously displayed with the opposite terminal equipment on the terminal equipment.

For the first case, for example, when the second user triggers a zoom-in operation on the peer device for the target aerial image synchronously displayed with the peer device, the terminal device will generate and send second operation information to the server, for example, the second operation information may be any information for notifying the server that the terminal device triggers the second operation and requests the second timestamp.

The server is used for uniformly recording the time stamp for the triggered second operation of the synchronously displayed target space image by the second user, so that the terminal equipment can determine the corresponding execution operation on the terminal equipment and the corresponding synchronous execution operation of the opposite terminal equipment according to the priority of the first time stamp and the priority of the second time stamp, and the fairness can be improved.

For example, the server receiving the second operation information may record a timestamp of the reception of the second operation information as a second timestamp and transmit the second timestamp to the terminal device. For example, the server may determine the second timestamp according to a time when the second operation information is received based on a timing generator configured in the server, wherein the timing generator is configured to generate the second timestamp.

For another example, the terminal device may not obtain the second timestamp through the server, but when the second user triggers a second operation on the terminal device for the target spatial image displayed in synchronization with the peer device, the terminal device may record the timestamp of the second operation as the second timestamp.

For the second case, for example, when the second user does not perform a trigger click operation on the target spatial image displayed in synchronization with the peer device on the peer device, the terminal device obtains a timestamp stored in the terminal device and used for recording a last operation triggered on the target spatial image displayed in synchronization with the peer device, for example, the timestamp stored in the terminal device and used for the last operation may be the timestamp of the last operation of the terminal device itself or the timestamp of the last operation of the peer device.

Step S330, according to the priority of the first time stamp and the priority of the second time stamp, determining the operation correspondingly executed on the terminal device and the operation correspondingly and synchronously executed by the opposite terminal device.

After determining the operation correspondingly executed on the terminal device and the operation correspondingly and synchronously executed by the opposite terminal device, the target space image corresponding to the determined operation can be synchronously displayed by using the first image drawing tool and the second image drawing tool on the terminal device and the opposite terminal device respectively.

As one example, the first and second graphical drawing tools may be canvas canvases.

According to the method for synchronous display, the terminal equipment acquires a first time stamp and a second time stamp which are uniformly determined by the server from the server, and determines the operation which is correspondingly executed on the terminal equipment and the operation which is correspondingly and synchronously executed by opposite terminal equipment according to the priority of the first time stamp and the priority of the second time stamp, so that the synchronous display of the target space images on the terminal equipment and the opposite terminal equipment is realized; the priority of the first timestamp and the priority of the second timestamp are uniformly determined by the server, and the priority of the first timestamp and the priority of the second timestamp are relatively fair to both the terminal device and the opposite-end device; and the process of determining the operation correspondingly executed on the terminal equipment and the operation correspondingly and synchronously executed by the opposite terminal equipment is finished at the terminal equipment, so that the load of the server can be reduced.

Several embodiments of step S330 will be described in detail below with reference to fig. 4 to 6, respectively. Fig. 4 is a detailed flowchart illustrating step S330 in a case where the obtained second timestamp is a timestamp recorded by the server and receiving the second operation information, and is sent to the terminal device according to at least one embodiment of the present disclosure. Fig. 5 shows another detailed flowchart of step S330 in the case that the obtained second timestamp is a timestamp recorded by the server and receiving the second operation information, and is sent to the terminal device according to at least one embodiment of the present disclosure. Fig. 6 is a further detailed flowchart of step S330 in a case that the obtained second timestamp is a timestamp stored by the terminal device and used for recording a last operation triggered on the target aerial image synchronously displayed with the peer device according to at least one embodiment of the present disclosure.

A description will first be given of a processing flow in a case where the acquired second time stamp is a time stamp of reception of the second operation information recorded by the server and is transmitted to the terminal device.

Referring to fig. 4, in step S410, when the priority of the first timestamp is higher than that of the second timestamp, executing, on the terminal device, the first operation according to the received first operation data corresponding to the first operation, so that the terminal device displays a target spatial image corresponding to the first operation, and causing the peer device to execute the first operation according to the first operation data, so that the peer device displays the target spatial image corresponding to the first operation.

For example, the priority of the first timestamp and the priority of the second timestamp may be determined by the morning and the evening of the timestamps, e.g., if the first timestamp is later than the second timestamp, the priority of the first timestamp may be considered higher than the priority of the second timestamp; if the first timestamp is earlier than the second timestamp, the priority of the first timestamp may be considered lower than the priority of the second timestamp.

When the first timestamp is later than the second timestamp, that is, the time of the first operation triggered by the first user on the opposite terminal device on the target spatial image synchronously displayed with the terminal device is later than the time of the second operation triggered by the second user on the terminal device on the target spatial image synchronously displayed with the opposite terminal device, at this time, the target spatial image corresponding to the later-triggered operation can be synchronously displayed in the opposite terminal device and the terminal device.

For example, when a first user triggers a first operation on the target space image displayed synchronously with the terminal device on the peer device 111, in the peer device 111, the first operation may be monitored by using a first graphics rendering tool configured in the peer device 111 to obtain first operation data based on the first graphics rendering tool.

As one example, the first graphics rendering tool may be a canvas for implementing graphics rendering, with listening operations implemented by scripts (such as JavaScript). After listening to the operation, the canvas will acquire first operation data corresponding to the operation, and may draw an image based on the acquired first operation data.

The first operation data corresponding to the first operation is data related to the first operation, and for example, if the first operation is a click operation, the first operation data may be coordinate data (x, y) of a click position or the like. For another example, if the first operation is a zoom-in operation, the first operation data may be a zoom factor or the like. For another example, if the first operation is a reduction operation, the first operation data may be a reduction factor or the like. For another example, if the first operation is a rotation operation, the first operation data may be a rotation angle or the like. For another example, if the first operation is a drag operation, the first operation data may be a drag distance or the like. The present disclosure is not limited thereto.

For another example, the peer device may transmit first operation data corresponding to the first operation to the terminal device simultaneously with the first timestamp. For example, the peer device may not simultaneously transmit the first operation data corresponding to the first operation and the first timestamp to the terminal device, and may receive the first operation data corresponding to the first operation from the peer device after interpreting that the priority of the first timestamp is higher than the priority of the second timestamp.

For another example, the peer device may transmit the first operation data of the first graphic drawing tool from the peer device to the server, so that the server forwards the first operation data to the terminal device, or the peer device directly sends the first operation data of the first graphic drawing tool to the terminal device.

For example, on the terminal device, according to the received first operation data corresponding to the first operation, the state of the second graphic drawing tool (second canvas) configured in the terminal device may be set according to the first operation data, so that the terminal device synchronously displays the target space image corresponding to the first operation, and the opposite-end device sets the state of the first graphic drawing tool configured in the opposite-end device according to the first operation data, so that the opposite-end device displays the target space image corresponding to the first operation.

For example, the terminal device may send the second timestamp and the second operation data corresponding to the second operation to the peer device, so that the peer device performs determination based on the same principle, and since the first timestamp and the second timestamp are determined by the server, the results determined by the terminal device and the peer device are consistent, thereby implementing synchronous display of the target spatial image.

In step S420, a second timestamp stored in the terminal device for recording a timestamp of a last operation triggered on the target aerial image displayed in synchronization with the peer device is updated to the first timestamp.

After the terminal device executes a first operation according to received first operation data corresponding to the first operation so that the terminal device displays a target space image corresponding to the first operation, a second timestamp, which is stored in the terminal device and used for recording a timestamp of a last operation triggered on the target space image synchronously displayed with the opposite terminal device, is updated to be a first timestamp, so that the timestamp is kept corresponding to the latest operation.

By the embodiment, under the condition that the opposite terminal equipment and the terminal equipment both initiate operations, the synchronous display of the picture can be realized when the first operation initiated by the opposite terminal equipment is later than the second operation initiated by the terminal equipment.

Another process flow in the case where the acquired second timestamp is a timestamp recorded by the server at which the second operation information is received and is transmitted to the terminal device will be described below.

Referring to fig. 5, in step S510, when the priority of the first timestamp is lower than the priority of the second timestamp, a second operation is performed at the terminal device according to the second operation data to enable the terminal device to display a target spatial image corresponding to the second operation, and the second operation data corresponding to the second operation is sent to the peer device, so that a second operation is performed at the peer device according to the second operation data to enable the peer device to display the target spatial image corresponding to the second operation.

For example, when the first timestamp is earlier than the second timestamp, that is, the time of a first operation triggered by the first user on the peer device on the target spatial image synchronously displayed with the terminal device may be earlier than the time of a second operation triggered by the second user on the terminal device on the target spatial image synchronously displayed with the peer device, the target spatial image corresponding to the later triggered operation, that is, the target spatial image corresponding to the second operation, may be synchronously displayed in the peer device and the terminal device.

Since the second operation is performed at the terminal device according to the second operation data at this time to cause the terminal device to display the target space image corresponding to the second operation, the first operation data transmitted from the counterpart device may not be received, and in this case, transmission of the data amount may be reduced.

For example, when a second user triggers a second operation on the target space image displayed synchronously with the opposite terminal device on the terminal device, in the terminal device, a second graphic drawing tool configured in the terminal device may be used to monitor the second operation to obtain second operation data based on the second graphic drawing tool.

As one example, the second graphics rendering tool may be a canvas for implementing graphics rendering, with listening operations implemented by scripts (such as JavaScript). After listening to the operation, the canvas will acquire second operation data corresponding to the operation, and may draw an image based on the acquired second operation data.

The second operation data corresponding to the second operation is data related to the second operation, and for example, if the second operation is a click operation, the second operation data may be coordinate data (x, y) of a click position or the like. For another example, if the second operation is an enlargement operation, the second operation data may be an enlargement factor or the like. For another example, if the second operation is a reduction operation, the first operation data may be a reduction factor or the like. For another example, if the second operation is a rotation operation, the second operation data may be a rotation angle or the like. For another example, if the second operation is a drag operation, the second operation data may be a drag distance or the like. The present disclosure is not limited thereto.

For example, the second operation may be the same as or different from the first operation, and correspondingly, the second operation data may also be the same as or different from the second operation data. For another example, when the second operation is the same as the first operation, the second operation data may also be different from the first operation data, e.g., the second operation and the first operation are both amplification operations, but the amplification factor is different, etc.

For example, the terminal device sets a state of a second graphic drawing tool (a second canvas) configured in the terminal device according to the second operation data, so that the terminal device displays a target space image corresponding to the second operation, and sends second operation data corresponding to the second operation to the opposite device, so that the opposite device sets a state of a first graphic drawing tool configured in the opposite device according to the second operation data, so that the opposite device displays the target space image corresponding to the second operation.

By the embodiment, under the condition that the opposite terminal equipment and the terminal equipment both initiate operations, the synchronous display of the picture can be realized when the first operation initiated by the opposite terminal equipment is earlier than the second operation initiated by the terminal equipment.

The following describes a processing flow in a case where the acquired second timestamp is a timestamp stored in the terminal device and used for recording the last operation triggered by the target aerial image displayed in synchronization with the peer device.

Referring to fig. 6, in step S610, a first operation is performed on the terminal device according to received first operation data corresponding to the first operation, so that the terminal device displays a target space image corresponding to the first operation, and the peer device performs the first operation according to the first operation data, so that the peer device displays the target space image corresponding to the first operation.

Under the condition that the second user does not trigger the second operation on the target space image synchronously displayed with the opposite terminal equipment on the terminal equipment, at the moment, the terminal equipment can directly execute the first operation according to the first operation data which is sent by the opposite terminal equipment and corresponds to the first operation so that the terminal equipment can display the target space image corresponding to the first operation, and the early and late determination of the priority of the first timestamp and the priority of the second timestamp is not needed.

For example, on the terminal device, according to received first operation data corresponding to a first operation, a state of a second graphic drawing tool configured in the terminal device may be set according to the first operation data, so that the terminal device synchronously displays a target space image corresponding to the first operation, and the peer device sets a state of a first graphic drawing tool configured in the peer device according to the first operation data, so that the peer device displays the target space image corresponding to the first operation. At this time, the terminal device does not generate the second operation data, and therefore, the second operation data and the second timestamp do not need to be sent to the peer device.

In step S620, the first timestamp is stored in the terminal as a second timestamp of the terminal device for recording a timestamp of a last operation of the trigger for the target aerial image displayed in synchronization with the peer device.

By the embodiment, the synchronous display of the picture can be realized under the condition that the opposite terminal equipment initiates the first operation and the terminal equipment does not initiate the second operation.

Fig. 7 is a schematic diagram illustrating functional modules of a terminal device 700 for synchronous display according to at least one embodiment of the present disclosure, where the terminal device 700 for synchronous display may be applied to the terminal device 112 shown in fig. 1, and referring to fig. 7, the terminal device 700 for synchronous display may include a transmission unit 710, an acquisition unit 720, and a determination unit 730.

The transmission unit 710 may be configured to receive a first timestamp sent by an opposite-end device, where the first timestamp is a timestamp recorded by the server and used for receiving first operation information and sent to the opposite-end device, and the first operation information is information corresponding to a first operation, which is sent to the server by the opposite-end device after a first operation is triggered by a first user on the opposite-end device on a target spatial image displayed synchronously with the terminal device.

The obtaining unit 720 may be configured to obtain a second timestamp, where the obtained second timestamp is a timestamp recorded by the server and used for receiving second operation information and sent to the terminal device, and the second operation information is information corresponding to a second operation, which is sent by the terminal device to the server after a second user triggers the second operation on a target space image displayed on the terminal device in synchronization with the peer device; or the obtained second timestamp is a timestamp stored by the terminal device and used for recording the last operation triggered by the target space image synchronously displayed with the opposite terminal device.

For example, the server determines a first timestamp according to the time when the first operation information is received and determines a second timestamp according to the time when the second operation information is received based on a timing generator configured in the server, wherein the timing generator is used for generating the first timestamp and the second timestamp.

For example, the first operation or the second operation includes at least one of: zoom in, zoom out, rotate, drag, click.

The determining unit 730 may be configured to determine, according to the priority of the first timestamp and the priority of the second timestamp, an operation to be correspondingly executed on the terminal device and an operation to be correspondingly and synchronously executed by the peer device.

For example, the determining unit 730 may be further configured to, in a case where the obtained second timestamp is a timestamp recorded by the server and receiving the second operation information and is sent to the terminal device, perform, on the terminal device, a first operation according to received first operation data corresponding to the first operation so that the terminal device displays a target spatial image corresponding to the first operation when the priority of the first timestamp is higher than the priority of the second timestamp, and cause the peer device to perform the first operation according to the first operation data so that the peer device displays the target spatial image corresponding to the first operation.

For another example, the determining unit 730 may be further configured to update a second timestamp stored in the terminal device for recording a timestamp of a last operation triggered on the target aerial image synchronously exhibited with the peer device to the first timestamp.

For another example, the determining unit 730 may be further configured to, when the obtained second timestamp is a timestamp recorded by the server and used for receiving the second operation information and is sent to the terminal device, execute, at the terminal device, a second operation according to the second operation data so that the terminal device displays a target spatial image corresponding to the second operation when the priority of the first timestamp is lower than the priority of the second timestamp, and send, to the peer device, second operation data corresponding to the second operation so that the peer device executes the second operation according to the second operation data so that the peer device displays the target spatial image corresponding to the second operation.

For another example, the determining unit 730 may be further configured to, in a case that the obtained second timestamp is a timestamp stored by the terminal device and used for recording a last operation triggered on the target spatial image synchronously displayed with the peer device, execute, on the terminal device, the first operation according to the received first operation data corresponding to the first operation, so that the terminal device displays the target spatial image corresponding to the first operation, and cause the peer device to execute the first operation according to the first operation data, so that the peer device displays the target spatial image corresponding to the first operation.

For another example, the determining unit 730 may be further configured to store the first timestamp in the terminal as a second timestamp of a last operation of the terminal device for recording a trigger for the target aerial image being synchronously presented with the peer device.

According to the terminal device 700 for synchronous display, the first timestamp and the second timestamp which are uniformly determined by the server are obtained from the server, and according to the priority of the first timestamp and the priority of the second timestamp, the operation which is correspondingly executed on the terminal device and the operation which is correspondingly and synchronously executed by the opposite terminal device are determined, so that the synchronous display of the target space images on the terminal device and the opposite terminal device is realized; the priority of the first timestamp and the priority of the second timestamp are uniformly determined by the server, and the priority of the first timestamp and the priority of the second timestamp are relatively fair to both the terminal device and the opposite-end device; and the process of determining the operation correspondingly executed on the terminal equipment and the operation correspondingly and synchronously executed by the opposite terminal equipment is finished at the terminal equipment, so that the load of the server can be reduced.

According to still another aspect of the present disclosure, there is also provided an apparatus for synchronizing displays. Fig. 8 shows a schematic diagram of a device 800 for synchronized display according to an embodiment of the present disclosure.

As shown in fig. 8, device 800 may include one or more processors 810, and one or more memories 820. Stored in memory 820 is computer readable code which, when executed by the one or more processors 810, may perform the method for synchronizing displays as described above.

A method or terminal device according to embodiments of the present disclosure may also be implemented by means of the architecture of the computing device 900 shown in fig. 9. As shown in fig. 9, computing device 900 may include a bus 910, one or more CPUs 920, a Read Only Memory (ROM)930, a Random Access Memory (RAM)940, a communication port 950 connected to a network, input/output components 960, a hard disk 970, and the like. A storage device in the computing device 900, such as the ROM 930 or the hard disk 970, may store various data or files used by the processing and/or communication of the method for synchronized display provided by the present disclosure and program instructions executed by the CPU. Computing device 900 may also include a user interface 980. Of course, the architecture shown in FIG. 9 is merely exemplary, and one or more components of the computing device shown in FIG. 9 may be omitted when implementing different devices, as desired.

According to yet another aspect of the present disclosure, there is also provided a computer-readable storage medium. Fig. 10 shows a schematic diagram 1000 of a storage medium according to the present disclosure.

As shown in FIG. 10, computer-readable instructions 1010 are stored on computer-readable storage medium 1020. The computer readable instructions 1010, when executed by a processor, may perform the method for synchronizing displays according to embodiments of the present disclosure described with reference to the above figures. Computer-readable storage media include, but are not limited to, volatile memory and/or nonvolatile memory, for example. Volatile memory can include, for example, Random Access Memory (RAM), cache memory (or the like). The non-volatile memory may include, for example, Read Only Memory (ROM), a hard disk, flash memory, and the like.

Those skilled in the art will appreciate that the disclosure of the present disclosure is susceptible to numerous variations and modifications. For example, the various devices or components described above may be implemented in hardware, or may be implemented in software, firmware, or a combination of some or all of the three.

Further, while the present disclosure makes various references to certain elements of a system according to embodiments of the present disclosure, any number of different elements may be used and run on a client and/or server. The units are illustrative only, and different aspects of the systems and methods may use different units.

It will be understood by those skilled in the art that all or part of the steps of the above methods may be implemented by instructing the relevant hardware through a program, and the program may be stored in a computer readable storage medium, such as a read only memory, a magnetic or optical disk, and the like. Alternatively, all or part of the steps of the above embodiments may be implemented using one or more integrated circuits. Accordingly, each module/unit in the above embodiments may be implemented in the form of hardware, and may also be implemented in the form of a software functional module. The present disclosure is not limited to any specific form of combination of hardware and software.

Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

The foregoing is illustrative of the present disclosure and is not to be construed as limiting thereof. Although a few exemplary embodiments of this disclosure have been described, those skilled in the art will readily appreciate that many modifications are possible in the exemplary embodiments without materially departing from the novel teachings and advantages of this disclosure. Accordingly, all such modifications are intended to be included within the scope of this disclosure as defined in the claims. It is to be understood that the foregoing is illustrative of the present disclosure and is not to be construed as limited to the specific embodiments disclosed, and that modifications to the disclosed embodiments, as well as other embodiments, are intended to be included within the scope of the appended claims. The present disclosure is defined by the claims and their equivalents.

Claims

1. A method for synchronizing displays, comprising:

acquiring a first timestamp, wherein the first timestamp is determined by a server according to first operation information sent by opposite-end equipment, and the first operation information is information which is sent by the opposite-end equipment to the server and corresponds to a first operation after the opposite-end equipment triggers the first operation on a target space image which is synchronously displayed with terminal equipment according to a first user;

acquiring a second timestamp, wherein the second timestamp is determined by the server according to second operation information sent by the terminal device, and the second operation information is information corresponding to a second operation sent to the server by the terminal device after the terminal device triggers the second operation on the target space image according to a second user; or the second timestamp is a timestamp stored by the terminal device and used for recording the last operation triggered by the target space image;

controlling the terminal device and the opposite terminal device to synchronously execute the first operation or the second operation according to the priority of the first timestamp and the priority of the second timestamp;

wherein the method further comprises:

and if the priority of the first timestamp determined by the server is higher than the second timestamp determined by the server, or the second timestamp is the timestamp of the last operation triggered by the target space image, updating the second timestamp corresponding to the terminal equipment according to the first timestamp.

2. The method according to claim 1, wherein if the priority of the first timestamp determined by the server is higher than the determined second timestamp, or the second timestamp is a timestamp of a last operation triggered by the target aerial image, updating a second timestamp corresponding to the terminal device according to the first timestamp, includes:

under the condition that the obtained second timestamp is the timestamp determined by the server according to the second operation information sent by the terminal device, if the priority of the first timestamp is higher than that of the second timestamp, updating the second timestamp stored in the terminal device and used for recording the timestamp of the last operation triggered by the target space image synchronously displayed with the opposite terminal device into the first timestamp;

and under the condition that the obtained second timestamp is a timestamp stored by the terminal device and used for recording the last operation triggered by the target space image, storing the first timestamp in the terminal device as the second timestamp of the terminal device and used for recording the timestamp of the last operation triggered by the target space image synchronously displayed with the opposite terminal device.

3. The method of claim 1, wherein the first timestamp is a timestamp recorded by the server and used for receiving the first operation information and is sent to the peer device.

4. The method according to claim 1 or 3, wherein the second timestamp is a timestamp recorded by the server and used for receiving the second operation information and sent to the terminal device.

5. The method according to claim 4, wherein, in a case that the obtained second timestamp is a timestamp recorded by the server and used for receiving second operation information and is sent to the terminal device, controlling the terminal device and the peer device to synchronously execute the first operation or the second operation according to the priority of the first timestamp and the priority of the second timestamp includes:

when the priority of the first timestamp is higher than that of the second timestamp, executing the first operation on the terminal device according to received first operation data corresponding to the first operation to enable the terminal device to display a target space image corresponding to the first operation, and enabling the opposite-end device to execute the first operation according to the first operation data to enable the opposite-end device to display the target space image corresponding to the first operation.

6. The method according to claim 4, wherein when the obtained second timestamp is a timestamp recorded by the server and used for receiving second operation information and is sent to the terminal device, controlling the terminal device and the peer device to synchronously execute the first operation or the second operation according to the priority of the first timestamp and the priority of the second timestamp includes:

when the priority of the first timestamp is lower than the priority of the second timestamp, executing, at the terminal device, the second operation according to second operation data corresponding to the second operation to enable the terminal device to display a target spatial image corresponding to the second operation, and sending, at the opposite-end device, the second operation according to the second operation data to enable the opposite-end device to display the target spatial image corresponding to the second operation.

7. The method according to claim 1, wherein, in a case that the obtained second timestamp is a timestamp stored by the terminal device and used for recording a last operation triggered on a target spatial image synchronously displayed with the peer device, the controlling the terminal device to execute the first operation or the second operation synchronously with the peer device according to the priority of the first timestamp and the priority of the second timestamp comprises:

executing the first operation according to received first operation data corresponding to the first operation on the terminal device to enable the terminal device to display a target space image corresponding to the first operation, and enabling the opposite-end device to execute the first operation according to the first operation data to enable the opposite-end device to display the target space image corresponding to the first operation.

8. The method of claim 1, wherein the server is based on a timing generator configured in the server, the timing generator being configured to generate the first timestamp and the second timestamp, determine the first timestamp as a time of receipt of first operation information, and determine the second timestamp as a time of receipt of second operation information.

9. The method of claim 1, the obtaining a first timestamp, comprising:

and acquiring a first time stamp sent by the opposite terminal equipment or the server.

10. The method of any of claims 2-9, wherein the first or second operation comprises any of: zoom in, zoom out, rotate, drag, click.

11. A terminal device for synchronized display, comprising:

the transmission unit is configured to acquire a first timestamp, wherein the first timestamp is determined by the server according to first operation information sent by the opposite terminal equipment, and the first operation information is information corresponding to a first operation sent to the server by the opposite terminal equipment after the opposite terminal equipment triggers the first operation on a target space image synchronously displayed with the terminal equipment according to a first user;

the acquisition unit is configured to acquire a second timestamp, wherein the second timestamp is determined by the server according to second operation information sent by the terminal device, and the second operation information is information corresponding to a second operation sent to the server by the terminal device after the terminal device triggers the second operation on the target space image according to a second user; or the second timestamp is a timestamp stored by the terminal device and used for recording the last operation triggered by the target space image; and

a determining unit configured to control the terminal device and the peer device to synchronously execute the first operation or the second operation according to the priority of the first timestamp and the priority of the second timestamp;

wherein the apparatus further comprises:

the determining unit is further configured to update a second timestamp corresponding to the terminal device according to the first timestamp if the priority of the first timestamp determined by the server is higher than the determined second timestamp, or the second timestamp is a timestamp of a last operation triggered by the target spatial image.

12. An apparatus for synchronized display, comprising:

a processor; and

memory, wherein the memory has stored therein computer readable code, which when executed by the processor, performs the method for synchronized display of any of claims 1-10.

13. A computer-readable storage medium having stored thereon instructions that, when executed by a processor, cause the processor to perform the method for synchronized display of any of claims 1-10.