CN111045770A - Method, first terminal, device and readable storage medium for remote exhibition - Google Patents
Method, first terminal, device and readable storage medium for remote exhibition Download PDFInfo
- Publication number
- CN111045770A CN111045770A CN201911208541.2A CN201911208541A CN111045770A CN 111045770 A CN111045770 A CN 111045770A CN 201911208541 A CN201911208541 A CN 201911208541A CN 111045770 A CN111045770 A CN 111045770A
- Authority
- CN
- China
- Prior art keywords
- image
- terminal
- target space
- operation data
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Abstract
The present disclosure provides a method, a first terminal, a device, a readable storage medium for remote presentation. The method is applied to a first terminal and comprises the following steps: establishing a transmission channel group with a second terminal based on a real-time audio and video technology, so that the second terminal and the first terminal synchronously display a first image of the same target space; in response to detecting a first operation performed on a first image of the target space shown on the first terminal, obtaining first operation data corresponding to the first operation; displaying a second image of the target space corresponding to the first operation; and transmitting the first operation data from the first terminal to the second terminal through the transmission channel group, so that the second terminal synchronously executes the first operation on the first image of the target space displayed by the second terminal based on the first operation data, and the second terminal displays a second image of the target space corresponding to the first operation.
Description
Technical Field
The present disclosure relates to the field of data processing technology. And in particular to a method, a first terminal, a device, a readable storage medium for remote presentation.
Background
Currently, Virtual Reality (VR) technology is an emerging practical technology, and the VR technology generates a Virtual scene in a three-dimensional space by using computer simulation, provides simulation of senses such as vision, hearing, touch and the like for a user, and enables the user to personally observe objects in the three-dimensional space. With the continuous development of social productivity and scientific technology, VR technology is increasingly required in various fields. For example, the VR technology can be applied to a space (e.g., building) display system, and a realistic three-dimensional model of a building can be constructed based on the VR technology to display the internal and external structures and functions of the building in an all-around manner, so that a user can roam in the three-dimensional model of the building through a network, feel the building and the surrounding environment thereof personally, and quickly and conveniently realize remote room watching, room selection and the like.
Disclosure of Invention
According to an aspect of the present disclosure, there is provided a method for remote exhibition, applied to a first terminal, including: establishing a transmission channel group with a second terminal based on a real-time audio and video technology, so that the second terminal and the first terminal synchronously display a first image of the same target space; in response to detecting a first operation performed on a first image of the target space shown on the first terminal, obtaining first operation data corresponding to the first operation; displaying a second image of the target space corresponding to the first operation; and transmitting the first operation data from the first terminal to the second terminal through the transmission channel group, so that the second terminal synchronously executes the first operation on the first image of the target space displayed by the second terminal based on the first operation data, and the second terminal displays a second image of the target space corresponding to the first operation.
According to some embodiments of the disclosure, the type of the first image comprises any one of: two-dimensional house type pictures, three-dimensional house type pictures and panoramic pictures.
According to some embodiments of the present disclosure, the type of the second image is the same as the type of the first image, the target space includes a plurality of subspaces, the first image of the target space includes a plurality of sub-images respectively corresponding to the plurality of subspaces, the first operation is a selection operation of selecting any one of the plurality of subspaces on the first image displayed on the first terminal, wherein the displaying of the second image of the target space corresponding to the first operation includes: and displaying the sub-image corresponding to the subspace selected by the selection operation, wherein the sub-image corresponding to the selected subspace is used as the second image.
According to some embodiments of the present disclosure, a type of the second image is different from a type of the first image, and the first operation is a switching operation of performing switching to a second image on the first image displayed on the first terminal, wherein the displaying the second image of the target space corresponding to the first operation includes: and displaying a second image corresponding to the switching operation.
According to some embodiments of the present disclosure, the type of the second image is the same as the type of the first image; the first operation is any one of the following operations performed on the first image shown on the first terminal: clicking, dragging, zooming in and zooming out, wherein the displaying of the second image of the target space corresponding to the first operation comprises: and performing processing corresponding to the first operation on a first image of the target space displayed by the first terminal based on the first operation data, and displaying the processed image, wherein the processed image is used as the second image.
According to some embodiments of the disclosure, the obtaining first operation data corresponding to the first operation comprises: monitoring the first operation by utilizing a first graphic drawing tool configured in the first terminal to acquire first operation data based on the first graphic drawing tool.
According to some embodiments of the present disclosure, the transmitting, by the transmission channel group, the first operation data from the first terminal to the second terminal, so that the second terminal performs the first operation on the first image of the target space displayed by the second terminal based on the first operation data in synchronization, so that the second terminal displays the second image of the target space corresponding to the first operation, includes: transmitting first operation data based on the first graphic drawing tool from the first terminal to the second terminal through the transmission channel group, so that the second terminal sets the state of a second graphic drawing tool configured in the second terminal according to the first operation data, and the second terminal displays a second image of a target space corresponding to the first operation; wherein the first and second graphical drawing tools are the same graphical drawing tool.
According to another aspect of the present disclosure, there is also provided a first terminal for remote exhibition, including: the communication unit is configured to establish a transmission channel group with a second terminal based on a real-time audio and video technology, so that the second terminal and the first terminal synchronously display a first image of the same target space; an acquisition unit configured to acquire first operation data corresponding to a first operation performed on a first image of the target space shown on the first terminal in response to detection of the first operation; a presentation unit configured to present a second image of the target space corresponding to the first operation; and a transmission unit configured to transmit the first operation data from the first terminal to the second terminal through the transmission channel group, so that the second terminal synchronously performs the first operation on a first image of the target space displayed by the second terminal based on the first operation data, so that the second terminal displays a second image of the target space corresponding to the first operation.
According to some embodiments of the disclosure, the type of the first image comprises any one of: two-dimensional house type pictures, three-dimensional house type pictures and panoramic pictures.
According to some embodiments of the present disclosure, the type of the second image is the same as the type of the first image, the target space includes a plurality of subspaces, the first image of the target space includes a plurality of sub-images respectively corresponding to the plurality of subspaces, the first operation is a selection operation of selecting any one of the plurality of subspaces on the first image displayed on the first terminal, wherein the display unit is configured to: and displaying the sub-image corresponding to the subspace selected by the selection operation, wherein the sub-image corresponding to the selected subspace is used as the second image.
According to some embodiments of the present disclosure, a type of the second image is different from a type of the first image, the first operation is a switching operation of performing switching to a second image on the first image displayed on the first terminal, wherein the display unit is configured to: and displaying a second image corresponding to the switching operation.
According to some embodiments of the present disclosure, the type of the second image is the same as the type of the first image; the first operation is any one of the following operations performed on the first image shown on the first terminal: click, drag, zoom in, and zoom out, wherein the presentation unit is configured to: and performing processing corresponding to the first operation on a first image of the target space displayed by the first terminal based on the first operation data, and displaying the processed image, wherein the processed image is used as the second image.
According to some embodiments of the present disclosure, the obtaining unit is configured to listen to the first operation using a first graphic drawing tool configured in the first terminal to obtain first operation data based on the first graphic drawing tool.
According to some embodiments of the disclosure, the transmission unit is configured to: transmitting first operation data based on the first graphic drawing tool from the first terminal to the second terminal through the transmission channel group, so that the second terminal sets the state of a second graphic drawing tool configured in the second terminal according to the first operation data, and the second terminal displays a second image of a target space corresponding to the first operation; wherein the first and second graphical drawing tools are the same graphical drawing tool.
According to another aspect of the present disclosure, there is also provided an apparatus for remote exhibition, including: one or more processors; and one or more memories, wherein the memories have stored therein computer readable code, which when executed by the one or more processors, performs a method for remote presentation as described above.
According to another aspect of the present disclosure, there is also provided a computer-readable storage medium having stored thereon instructions, which, when executed by a processor, cause the processor to perform the method for remote presentation as described above.
Drawings
In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 shows a schematic flow chart of a method for remote presentation according to an embodiment of the present disclosure;
fig. 2 illustrates a schematic diagram of screen sharing between a first terminal and a second terminal provided according to an embodiment of the present disclosure;
FIG. 3A shows a schematic diagram of a two-dimensional house graph in accordance with an embodiment of the present disclosure;
FIG. 3B shows a schematic diagram of a three-dimensional house view in accordance with an embodiment of the present disclosure;
FIG. 3C shows a schematic diagram of a pre-click image according to an embodiment of the disclosure;
FIG. 3D shows a schematic diagram of a clicked image according to an embodiment of the disclosure;
FIG. 4 shows a schematic diagram of a first terminal for remote presentation according to an embodiment of the present disclosure;
FIG. 5 illustrates an application example of a remote presentation according to an embodiment of the present disclosure;
FIG. 6 shows a schematic block diagram of an apparatus for remote presentation according to an embodiment of the present disclosure;
FIG. 7 shows a schematic diagram of an architecture of an exemplary computing device, in accordance with embodiments of the present disclosure;
FIG. 8 shows a schematic diagram of a storage medium according to an embodiment of the disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described below clearly and completely with reference to the accompanying drawings of the embodiments of the present disclosure. It is to be understood that the described embodiments are only a few embodiments of the present disclosure, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the disclosure without any inventive step, are within the scope of protection of the disclosure.
Unless otherwise defined, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. The use of "first," "second," and similar terms in this disclosure is not intended to indicate any order, quantity, or importance, but rather is used to distinguish one element from another. The word "comprising" or "comprises", and the like, means that the element or item listed before the word covers the element or item listed after the word and its equivalents, but does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", and the like are used merely to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly. To maintain the following description of the embodiments of the present disclosure clear and concise, a detailed description of some known functions and components have been omitted from the present disclosure.
Flow charts are used in this disclosure to illustrate steps of methods according to embodiments of the disclosure. It should be understood that the preceding and following steps are not necessarily performed in the exact order in which they are performed. Rather, various steps may be processed in reverse order or simultaneously. Meanwhile, other operations may be added to the processes, or a certain step or steps may be removed from the processes.
Based on the plane display or based on the VR display technology, remote exhibition of the house can be realized. In the process of remote display, synchronous display between two terminals is required, or screen sharing is available. The screen sharing may be understood as keeping the contents displayed in the screens of different terminals consistent in real time between the different terminals. For example, in the screen sharing state, after a first user corresponding to a first terminal performs, for example, a drag operation on a displayed house on a first screen of the first terminal, the second terminal will also perform the drag operation so that the content displayed on a second screen of the second terminal remains synchronized with the first screen.
In a method for implementing screen sharing, generally, based on a Web Real-time communication (WebRTC) technology, an image currently displayed on a first screen is acquired in a screen capturing manner, and then the captured image is transmitted to a second terminal, so as to synchronously display content displayed on the first screen on a second screen of the second terminal. For example, screen shots may be taken at a rate of 30 frames per second, 45 frames per second, and the shot images are transmitted to the second terminal one by one. However, this screen capture method will occupy a lot of device resources to store and transmit captured images, which will result in a lot of device resource occupation, reduce the performance of the device, and even cause phenomena such as display jamming and device heating. The transmission of a large amount of image data will also cause a display delay problem, i.e., there is a time difference between the contents displayed by the two terminals, which is particularly noticeable on a mobile terminal with lower performance. In addition, in order to reduce the data volume occupied by the transmission image, the intercepted image may be compressed, and the resolution is reduced, so that the image displayed by the second terminal has a problem of being unclear, and the user experience is reduced.
The present disclosure provides a method for remote presentation for implementing screen sharing between terminals. In the remote display method according to the present disclosure, the screen sharing is realized by transmitting the operation data between the terminals instead of the screen capturing method, so that the above problems are avoided, and the user experience is improved. Hereinafter, a method according to the present disclosure will be described in detail with reference to the accompanying drawings.
Fig. 1 shows a schematic flow chart of a method for remote presentation according to an embodiment of the present disclosure, which may be applied to a first terminal, i.e., the first terminal may implement screen sharing with a second terminal by performing the method. It should be noted that the first terminal and the second terminal are only used for distinguishing the two terminals, and do not indicate any sequence, number or importance, but are used for distinguishing different components. Similarly, the second terminal may also implement screen sharing with the first terminal by performing the method, which is not limited herein.
As shown in fig. 1, first, in step S101, a transmission channel group is established with a second terminal based on a real-time audio/video technology, so that the second terminal and the first terminal synchronously display a first image of the same target space. The target space may be a physical space, and may include an indoor space, which may include a house, an office, etc., and an outdoor space, which may include an outdoor garden, a street, etc.
For example, for the step of establishing a transmission channel group with the second terminal based on the real-time audio and video technology, the first terminal may obtain the parameters of the first terminal and the parameters of the second terminal, and establish the transmission channel group according to the parameters of the first terminal and the parameters of the second terminal. The parameters of the first terminal may include an IP (internet protocol) address (e.g., a network IP address) of the first terminal, a device identifier (e.g., an ID of a mobile phone, etc.) corresponding to the first terminal, time, and other information, and the parameters of the second terminal may include an IP address of the second terminal, a device identifier corresponding to the second terminal, time, and other information. For example, the first terminal and the second terminal may be various mobile terminals, fixed terminals, and the like, for example, the first terminal and the second terminal may include an application (App) of the mobile terminal. The application may be, for example, "live guest," "58 city," etc. The mobile terminal can be a mobile phone, a tablet computer and the like. The fixed terminal may be a desktop computer or the like.
As an example, the transmission channel group may implement data transmission by way of a wired network and/or a wireless network. The wired network may perform data transmission by using twisted pair, coaxial cable, or optical fiber transmission, for example, and the wireless network may perform data transmission by using 3G/4G/5G mobile communication network, bluetooth, Zigbee, or WiFi, for example. For example, the transmission channel group is established based on a real-time audio and video technology, so that the time delay of data transmission of the transmission channel group is small, and the requirement of real-time data interaction is met.
For example, after a transmission channel group is established between a first terminal and a second terminal based on Real-Time audio and video (RTC), the first terminal and the second terminal can realize Real-Time transmission of data through the transmission channel group. For example, the data may be operational data as described below.
As an example, fig. 2 illustrates a schematic diagram of screen sharing between a first terminal and a second terminal provided according to an embodiment of the present disclosure. As shown in fig. 2, a first image of the target space is displayed in the first screen 2011 of the first terminal 201. A transmission channel group established based on a real-time audio and video technology is arranged between the first terminal 201 and the second terminal 202, and is used for real-time data transmission. A first image of the target space is synchronously displayed in the second screen 2021 of the second terminal 202.
Next, as shown in fig. 1, in step S102, in response to detecting a first operation performed on a first image of the target space shown on the first terminal, first operation data corresponding to the first operation is acquired. Then, in step S103, a second image of the target space corresponding to the first operation is shown. According to the embodiment of the present disclosure, the first user corresponding to the first terminal may perform a screen operation, i.e., the first operation, on the first screen of the first terminal to change a picture displayed on the first screen. After detecting the first operation, the first terminal may acquire first operation data corresponding to the first operation. And after the screen operation is executed, the first terminal displays a second image corresponding to the first operation. In other words, the screen operation is for causing the content displayed by the first screen to change from the first image to the second image. The specific process of acquiring the first operation data and presenting the second image will be described in detail below.
Next, in step S104, the first operation data is transmitted from the first terminal to the second terminal through the transmission channel group, so that the second terminal synchronously performs the first operation on the first image of the target space displayed by the second terminal based on the first operation data, so that the second terminal displays a second image of the target space corresponding to the first operation. For example, after the second terminal receives first operation data transmitted through a transmission channel group, the second terminal may perform the first operation on a first image of the target space presented by the second terminal based on the first operation data in synchronization, so that the second terminal presents a second image of the target space in synchronization.
In the remote display method provided by the embodiment of the disclosure, a first user corresponds to a first terminal, and a second user corresponds to a second terminal. The first user and the second user may not both be located within the target space, and both the first user and the second user may be located away from the target space, i.e., the first user and the second user may remotely (e.g., offsite) view the target space and roam within the target space. During the remote presentation, the first user and the second user can view the same image of the target space, for example, the first image at the same time, i.e., perform screen sharing. For example, when the target space is a house, if the first image displayed by the first terminal is a picture corresponding to a living room, the first image displayed by the second terminal is also a picture corresponding to the living room, and the spatial position coordinate and the viewing angle of the picture displayed by the first terminal are respectively the same as the spatial position coordinate and the viewing angle of the picture displayed by the second terminal, so that the first user corresponding to the first terminal and the second user corresponding to the second terminal view the same image of the target space.
After the transmission channel group is established, the first terminal and the second terminal may acquire images corresponding to the same target space, for example, house type maps corresponding to the same house. For example, the first terminal may first determine an identifier of a target space to be displayed, such as a house identifier, a serial number, and other information, and then send the identifier of the target space to the second terminal through the transmission channel group, so that the second terminal also accesses the target space.
It should be noted that, when the first terminal and the second terminal initially display the initial image of the target space, there may be a case where the initial screen displayed by the first terminal is different from the initial screen displayed by the second terminal. In this case, the initial screen displayed by the first terminal and the initial screen displayed by the second terminal need to be synchronized, so that the screen displayed by the first terminal and the screen displayed by the second terminal are the same.
According to an embodiment of the present disclosure, the type of the first image includes any one of: a two-dimensional house view (alternatively referred to as a planar house view), a three-dimensional house view (alternatively referred to as a stereoscopic house view), and a panoramic image. Similarly, the type of the second image includes any one of: two-dimensional house type pictures, three-dimensional house type pictures and panoramic pictures. The types of the second images may be the same as or different from the types of the first images.
For example, the two-dimensional house layout can be a two-dimensional house layout of a house, and the three-dimensional house layout can be a three-dimensional stereo model map of the house. Schematically, fig. 3A shows a schematic diagram of a two-dimensional house view according to an embodiment of the disclosure, and fig. 3B shows a schematic diagram of a three-dimensional house view according to an embodiment of the disclosure. As shown in fig. 3A and 3B, the two-dimensional and three-dimensional house views show various subspaces (e.g., a living room subspace, a main lying subspace, a sub-lying subspace, a balcony subspace, a toilet subspace, a kitchen subspace, etc.) of a house, a positional arrangement of the various subspaces, and the like.
For example, the panoramic image may be a panoramic image corresponding to, for example, a house generated based on a sky box or a sky dome, or referred to as a virtual reality presentation image. The first image and the second image may be various two-dimensional images corresponding to the target space, for example, a map image showing a geographical position of the target space, a cell environment image corresponding to the target space, and the like, which is not limited herein.
According to one embodiment of the present disclosure, the type of the second image is the same as the type of the first image. For example, the first image and the second image are both a two-dimensional house view as shown in fig. 3A, and for example, a three-dimensional house view as shown in fig. 3B, and may also be the panoramic image. The first image and the second image are two-dimensional house-type maps, which will be described below as an example.
As shown in fig. 3A, the target space includes a plurality of subspaces, and the first image of the target space includes a plurality of sub-images respectively corresponding to the plurality of subspaces. The subspaces may be individual rooms in a house diagram, such as a living room, a kitchen, a bedroom a, a bedroom B, etc. The first image comprises a plurality of sub-images corresponding to the living room, the kitchen, the bedroom A and the bedroom B respectively. In this embodiment, the first operation is a selection operation of selecting any one of the plurality of subspaces on the first image shown on the first terminal. For example, a first user, such as a first user corresponding to a first terminal, may operate a first screen of the first terminal in a touch manner to select one of the subspaces in the target space. For example, in the case where the graph shown in fig. 3A is a first image, the selection operation may be an operation of clicking a living room subspace in the first image, that is, selecting the living room. After the first user selects the hall subspace, the first terminal may present a sub-image corresponding to the subspace (i.e., the hall subspace) selected by the selection operation, wherein the sub-image corresponding to the selected subspace serves as the second image.
In response to detecting a selection operation performed on a first image of the target space presented on the first terminal, the first terminal may acquire selection operation data corresponding to the selection operation. Through the selection operation, the image displayed on the first screen of the first terminal can realize the conversion from the first image to the second image, for example, the first terminal realizes the process of displaying the second image based on the selection operation data. Then, the first terminal may transmit the selection operation data to the second terminal through the transmission channel group, so that the second terminal performs the selection operation on the first image of the target space displayed by the second terminal based on the selection operation data in synchronization, so that the second terminal displays a second image of the target space corresponding to the selection operation, that is, an image corresponding to a living room subspace. Through the above process, the display contents viewed by the first user and the second user can be kept consistent, that is, after the first user switches the display contents from the first image to the second image, the second user can also view the process of switching the display contents from the first image to the second image from the second screen of the second terminal, that is, screen sharing is realized.
According to another embodiment of the present disclosure, the type of the second image is different from the type of the first image. For example, the first image is a two-dimensional house view as shown in fig. 3A, and the second image is a three-dimensional house view as shown in fig. 3B. For another example, the first image is a two-dimensional house layout as shown in fig. 3A, and the second image is a three-dimensional house layout panorama image generated from the two-dimensional house layout. The types of the first image and the second image may be combined in other ways, and are not limited herein. The first image is a two-dimensional house map, and the second image is a three-dimensional house map.
In this embodiment, the first operation is a switching operation of performing switching to a second image on the first image shown on the first terminal. For example, a first user corresponding to a first terminal may operate a first image presented on a first screen of the first terminal in a touch manner, such as clicking a button of "three-dimensional user type diagram" shown in fig. 3A, thereby switching a first image corresponding to a two-dimensional user type diagram to a second image corresponding to a three-dimensional user type diagram as shown in fig. 3B, wherein the first image is of a different type from the second image.
In response to detecting the switching operation performed on the first image of the target space shown on the first terminal, the first terminal may acquire switching operation data corresponding to the switching operation. Through the switching operation, the image displayed on the first screen of the first terminal can be switched from the first image to the second image, for example, the first terminal realizes the process of displaying the second image based on the switching operation data. Then, the first terminal may transmit the switching operation data to the second terminal through the transmission channel group, so that the second terminal synchronously performs the switching operation on the first image of the target space displayed by the second terminal based on the switching operation data, so that the second terminal displays a second image of the target space corresponding to the switching operation, that is, a three-dimensional house type image. Through the above process, the display contents viewed by the first user and the second user can be kept consistent, that is, after the first user switches the display contents from the first image to the second image, the second user can also view the process of switching the display contents from the first image to the second image from the second screen of the second terminal, that is, screen sharing is realized.
According to a further embodiment of the disclosure, the type of the second image is the same as the type of the first image. For example, the first image and the second image are both a two-dimensional house view as shown in fig. 3A, and for example, a three-dimensional house view as shown in fig. 3B, and may also be the panoramic image. The following description will be given taking an example in which the first image and the second image are both panoramic images.
In this embodiment, the first operation is any one of the following operations performed on the first image shown on the first terminal: click, drag, zoom in, and zoom out. The click operation will be described as an example. It should be noted that, in a specific application, to distinguish from the above-described clicking, the clicking operation herein may be implemented by, for example, double-clicking the screen.
In response to detecting a click operation performed on a first image of the target space shown on the first terminal, the first terminal may acquire click operation data corresponding to the click operation. Through the above clicking operation, the image displayed on the first screen of the first terminal may implement the conversion from the first image to the second image, for example, the first terminal implements the above process of displaying the second image based on the selection operation data.
Schematically, fig. 3C shows a schematic diagram of an image before clicking (i.e., a first image) according to an embodiment of the present disclosure, and fig. 3D shows a schematic diagram of an image after clicking (i.e., a second image) according to an embodiment of the present disclosure. For example, fig. 3C shows a first image currently displayed on a first screen, a first user may click the screen in a double-click manner to perform the click operation, and after the click operation is detected, the first terminal may obtain click operation data corresponding to the click operation to display a second image as shown in fig. 3D according to the click operation data.
Then, the first terminal may transmit the click operation data to the second terminal through the transmission channel group, so that the second terminal synchronously performs the click operation on the first image of the target space displayed by the second terminal based on the click operation data, so that the second terminal displays a second image of the target space corresponding to the click operation, that is, a panoramic image corresponding to the bedroom B. Through the above process, the display contents viewed by the first user and the second user can be kept consistent, that is, after the first user switches the display contents from the first image to the second image, the second user can also view the process of switching the display contents from the first image to the second image from the second screen of the second terminal, that is, screen sharing is realized.
Similarly, the execution process of the drag, zoom-in, and zoom-out operations is similar to the execution process of the click operation described above, and a description thereof will not be repeated.
According to an embodiment of the present disclosure, the obtaining first operation data corresponding to the first operation includes: monitoring the first operation by utilizing a first graphic drawing tool configured in the first terminal to acquire first operation data based on the first graphic drawing tool. According to the embodiment of the present disclosure, the first terminal may transmit first operation data based on the first graphic drawing tool to the second terminal through the transmission channel group, so that the second terminal sets a state of a second graphic drawing tool configured in the second terminal according to the first operation data, so that the second terminal displays a second image of a target space corresponding to the first operation. According to an embodiment of the present disclosure, the first and second graphical drawing tools are the same graphical drawing tool.
As one example, the first graphics rendering tool may be a canvas for implementing graphics rendering, with listening operations implemented by scripts (such as JavaScript). After listening to the operation, the canvas will acquire operation data corresponding to the operation and draw an image based on the acquired operation data. For example, after the first user performs an enlargement operation on the first screen, the canvas may listen to the enlargement operation, acquire operation data such as an enlargement magnification corresponding to the enlargement operation, and perform graphic rendering based on the operation data to display a second image obtained by enlarging the first image at the enlargement magnification.
Then, the first terminal may send the operation data acquired by the canvas to the second terminal in real time through the transmission channel group. After the second terminal receives the operation data sent by the first terminal, the received operation data is provided to a canvas configured in the second terminal, so that the canvas draws graphics based on the operation data, for example, the zoom-in operation is performed, so as to synchronously display the second image on the second screen.
In other examples according to the present disclosure, the first user and the second user may perform information communication while sharing a screen, for example, transmit voice data through the transmission channel group, thereby achieving more timely information transmission and more accurate information feedback, improving product experience, improving product performance, and increasing interest in spatial display.
In the method according to the present disclosure, the first terminal and the second terminal perform graphic drawing through the same graphic drawing tool, i.e., canvas, and transmit the operation data in real time through the established transmission communication group, so that the first terminal and the second terminal can perform synchronous display based on the operation data transmitted in real time, i.e., screen sharing between the first terminal and the second terminal, B is realized, and synchronous display in the screens of the two terminals is ensured. Compared with screen sharing realized in a screen capturing mode, the method reduces the data volume of transmission, and avoids the phenomena of occupation of a large amount of equipment resources, display blockage, equipment heating and the like. In addition, on the basis of reducing the data transmission quantity, the problem of display delay caused by the transmission of a large amount of image data can be avoided, real-time screen sharing is more favorably realized, and the time difference of the display contents of the two terminals is reduced. Furthermore, because the screen sharing is realized by executing the same operation based on the graphic drawing tools configured in the first terminal and the second terminal, the resolution of the images displayed at the two ends can be ensured, the use experience of the user is improved, and the remote display is more convenient.
The present disclosure also provides a first terminal for remote display. Fig. 4 shows a schematic block diagram of a first terminal 1000 for remote presentation according to an embodiment of the present disclosure. As shown in fig. 4, the first terminal 1000 may include a communication unit 1010, an obtaining unit 1020, a presenting unit 1030, and a transmitting unit 1040.
According to the embodiment of the present disclosure, the communication unit 1010 may be configured to establish a transmission channel group with a second terminal based on a real-time audio/video technology, so that the second terminal and the first terminal synchronously display a first image of the same target space. The obtaining unit 1020 may be configured to obtain first operation data corresponding to a first operation performed on a first image of the target space shown on the first terminal in response to detecting the first operation. The presentation unit 1030 may be configured to present a second image of the target space corresponding to the first operation. The transmitting unit 1040 is configured to transmit the first operation data from the first terminal to the second terminal through the transmission channel group, so that the second terminal synchronously performs the first operation on the first image of the target space displayed by the second terminal based on the first operation data, so that the second terminal displays a second image of the target space corresponding to the first operation.
According to an embodiment of the present disclosure, the type of the first image includes any one of: two-dimensional house type pictures, three-dimensional house type pictures and panoramic pictures.
According to the embodiment of the present disclosure, the type of the second image is the same as that of the first image, the target space includes a plurality of subspaces, the first image of the target space includes a plurality of sub-images respectively corresponding to the plurality of subspaces, and the first operation is a selection operation of selecting any one of the plurality of subspaces on the first image displayed on the first terminal. The presentation unit 1030 may be configured to: and displaying the sub-image corresponding to the subspace selected by the selection operation, wherein the sub-image corresponding to the selected subspace is used as the second image.
According to the embodiment of the disclosure, the type of the second image is different from the type of the first image, and the first operation is a switching operation of switching the first image displayed on the first terminal to the second image. The presentation unit 1030 may be configured to: and displaying a second image corresponding to the switching operation.
According to an embodiment of the present disclosure, the type of the second image is the same as the type of the first image; the first operation is any one of the following operations performed on the first image shown on the first terminal: click, drag, zoom in, and zoom out. The presentation unit 1030 may be configured to: and performing processing corresponding to the first operation on a first image of the target space displayed by the first terminal based on the first operation data, and displaying the processed image, wherein the processed image is used as the second image.
According to an embodiment of the present disclosure, the obtaining unit 1020 may be configured to utilize a first graphics drawing tool configured in the first terminal to listen to the first operation to obtain first operation data based on the first graphics drawing tool.
According to an embodiment of the present disclosure, the transmitting unit 1040 may be configured to: and transmitting first operation data based on the first graphic drawing tool from the first terminal to the second terminal through the transmission channel group, so that the second terminal sets the state of a second graphic drawing tool configured in the second terminal according to the first operation data, and the second terminal displays a second image of a target space corresponding to the first operation. According to an embodiment of the present disclosure, the first and second graphical drawing tools are the same graphical drawing tool.
FIG. 5 shows an application example of remote presentation according to an embodiment of the present disclosure. As shown in fig. 5, the first terminal 501 may include a first screen for presenting an image to a first user, and the second terminal 502 may include a second screen for presenting an image to a second user, with a transmission channel group established between the first terminal and the second terminal, such as a long connection channel for real-time communication. Further, after establishing the transmission channel group, the terminals 501, 502 may acquire a first image corresponding to the same target space, which may be a room, a house-type scene, or the like. Next, a tool unit, such as canvas, in the first terminal 501 may listen to a first operation of the first screen by the first user, acquire first operation data corresponding to the first operation, and perform graphic drawing on the first screen based on the first operation data to display a second image. In addition, a voice unit, such as a microphone, in the first terminal 501 may listen to the voice input of the first user and acquire voice data.
Then, the terminal 501 may transmit the voice data and the operation data to the communication unit of the terminal 502 via the established transmission channel group using the communication unit. The tool unit in the terminal 502 may perform the operation based on the received operation data to cause the second image to be displayed on the second screen. In addition, the voice unit in the terminal 502 may play the voice data based on the received voice data. Through the process illustrated in fig. 5, screen sharing between terminals can be achieved.
According to yet another aspect of the present disclosure, there is also provided an apparatus for remote presentation. FIG. 6 shows a schematic diagram of a device 2000 for remote presentation according to an embodiment of the present disclosure;
as shown in fig. 6, the device 2000 may include one or more processors 2010, and one or more memories 2020. Wherein the memory 2020 has stored therein computer readable code, which when executed by the one or more processors 2010 may perform a method for remote presentation as described above.
Methods or apparatus in accordance with embodiments of the present disclosure may also be implemented with the aid of the architecture of computing device 3000 shown in fig. 7. As shown in fig. 7, computing device 3000 may include a bus 3010, one or more CPUs 3020, a Read Only Memory (ROM)3030, a Random Access Memory (RAM)3040, a communication port 3050 to connect to a network, input/output components 3060, a hard disk 3070, and the like. A storage device in the computing device 3000, such as the ROM 3030 or the hard disk 3070, may store various data or files used in the processing and/or communication of the methods for remote presentation provided by the present disclosure as well as program instructions executed by the CPU. Computing device 800 may also include a user interface 3080. Of course, the architecture shown in FIG. 7 is merely exemplary, and one or more components of the computing device shown in FIG. 7 may be omitted as needed in implementing different devices.
According to yet another aspect of the present disclosure, there is also provided a computer-readable storage medium. Fig. 8 shows a schematic diagram 4000 of a storage medium according to the present disclosure.
As shown in fig. 8, computer readable instructions 4010 are stored on a computer readable storage medium 4020. The computer readable instructions 4010, when executed by a processor, can perform the method for remote presentation according to embodiments of the present disclosure described with reference to the above figures. The computer-readable storage medium includes, but is not limited to, volatile memory and/or non-volatile memory, for example. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), hard disk, flash memory, etc.
Those skilled in the art will appreciate that the disclosure of the present disclosure is susceptible to numerous variations and modifications. For example, the various devices or components described above may be implemented in hardware, or may be implemented in software, firmware, or a combination of some or all of the three.
Further, while the present disclosure makes various references to certain elements of a system according to embodiments of the present disclosure, any number of different elements may be used and run on a client and/or server. The units are illustrative only, and different aspects of the systems and methods may use different units.
It will be understood by those skilled in the art that all or part of the steps of the above methods may be implemented by instructing the relevant hardware through a program, and the program may be stored in a computer readable storage medium, such as a read only memory, a magnetic or optical disk, and the like. Alternatively, all or part of the steps of the above embodiments may be implemented using one or more integrated circuits. Accordingly, each module/unit in the above embodiments may be implemented in the form of hardware, and may also be implemented in the form of a software functional module. The present disclosure is not limited to any specific form of combination of hardware and software.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
The foregoing is illustrative of the present disclosure and is not to be construed as limiting thereof. Although a few exemplary embodiments of this disclosure have been described, those skilled in the art will readily appreciate that many modifications are possible in the exemplary embodiments without materially departing from the novel teachings and advantages of this disclosure. Accordingly, all such modifications are intended to be included within the scope of this disclosure as defined in the claims. It is to be understood that the foregoing is illustrative of the present disclosure and is not to be construed as limited to the specific embodiments disclosed, and that modifications to the disclosed embodiments, as well as other embodiments, are intended to be included within the scope of the appended claims. The present disclosure is defined by the claims and their equivalents.
Claims (16)
1. A method for remote exhibition is applied to a first terminal and comprises the following steps:
establishing a transmission channel group with a second terminal based on a real-time audio and video technology, so that the second terminal and the first terminal synchronously display a first image of the same target space;
in response to detecting a first operation performed on a first image of the target space shown on the first terminal, obtaining first operation data corresponding to the first operation;
displaying a second image of the target space corresponding to the first operation; and
and transmitting the first operation data from the first terminal to the second terminal through the transmission channel group, so that the second terminal synchronously executes the first operation on the first image of the target space displayed by the second terminal based on the first operation data, and the second terminal displays a second image of the target space corresponding to the first operation.
2. The remote presentation method of claim 1, wherein the type of the first image comprises any one of: two-dimensional house type pictures, three-dimensional house type pictures and panoramic pictures.
3. The remote exhibition method according to claim 2, wherein the second image is of the same type as the first image, the target space includes a plurality of subspaces, the first image of the target space includes a plurality of sub-images respectively corresponding to the plurality of subspaces, the first operation is a selection operation of selecting any one of the plurality of subspaces on the first image exhibited on the first terminal, wherein,
the presenting a second image of the target space corresponding to the first operation comprises:
and displaying the sub-image corresponding to the subspace selected by the selection operation, wherein the sub-image corresponding to the selected subspace is used as the second image.
4. The remote presentation method according to claim 2, wherein a type of the second image is different from a type of the first image, the first operation is a switching operation of performing switching to a second image for the first image presented on the first terminal, wherein,
the presenting a second image of the target space corresponding to the first operation comprises:
and displaying a second image corresponding to the switching operation.
5. The remote presentation method of claim 2, wherein the second image is of the same type as the first image; the first operation is any one of the following operations performed on the first image shown on the first terminal: click, drag, zoom in, and zoom out, wherein,
the presenting a second image of the target space corresponding to the first operation comprises:
and performing processing corresponding to the first operation on a first image of the target space displayed by the first terminal based on the first operation data, and displaying the processed image, wherein the processed image is used as the second image.
6. The remote presentation method of claim 1, wherein the obtaining first operation data corresponding to the first operation comprises:
monitoring the first operation by utilizing a first graphic drawing tool configured in the first terminal to acquire first operation data based on the first graphic drawing tool.
7. The remote presentation method according to claim 6, wherein the transmitting the first operation data from the first terminal to the second terminal through the transmission channel group so that the second terminal synchronously performs the first operation on the first image of the target space presented by the second terminal based on the first operation data to cause the second terminal to present the second image of the target space corresponding to the first operation comprises:
transmitting first operation data based on the first graphic drawing tool from the first terminal to the second terminal through the transmission channel group, so that the second terminal sets the state of a second graphic drawing tool configured in the second terminal according to the first operation data, and the second terminal displays a second image of a target space corresponding to the first operation; wherein the content of the first and second substances,
the first and second graphical drawing tools are the same graphical drawing tool.
8. A first terminal for remote presentation, comprising:
the communication unit is configured to establish a transmission channel group with a second terminal based on a real-time audio and video technology, so that the second terminal and the first terminal synchronously display a first image of the same target space;
an acquisition unit configured to acquire first operation data corresponding to a first operation performed on a first image of the target space shown on the first terminal in response to detection of the first operation;
a presentation unit configured to present a second image of the target space corresponding to the first operation; and
a transmission unit configured to transmit the first operation data from the first terminal to the second terminal through the transmission channel group, so that the second terminal synchronously performs the first operation on a first image of the target space displayed by the second terminal based on the first operation data, so that the second terminal displays a second image of the target space corresponding to the first operation.
9. The first terminal of claim 8, wherein the type of the first image comprises any one of: two-dimensional house type pictures, three-dimensional house type pictures and panoramic pictures.
10. The first terminal according to claim 9, wherein the second image is of the same type as the first image, the target space includes a plurality of subspaces, the first image of the target space includes a plurality of sub-images respectively corresponding to the plurality of subspaces, the first operation is a selection operation of selecting any one of the plurality of subspaces on the first image presented on the first terminal, wherein,
the presentation unit is configured to: and displaying the sub-image corresponding to the subspace selected by the selection operation, wherein the sub-image corresponding to the selected subspace is used as the second image.
11. The first terminal according to claim 9, wherein a type of the second image is different from a type of the first image, the first operation is a switching operation of performing switching to a second image on the first image presented on the first terminal, wherein,
the presentation unit is configured to: and displaying a second image corresponding to the switching operation.
12. The first terminal of claim 9, wherein the second image is of the same type as the first image; the first operation is any one of the following operations performed on the first image shown on the first terminal: click, drag, zoom in, and zoom out, wherein,
the presentation unit is configured to: and performing processing corresponding to the first operation on a first image of the target space displayed by the first terminal based on the first operation data, and displaying the processed image, wherein the processed image is used as the second image.
13. The first terminal of claim 8, wherein the obtaining unit is configured to listen to the first operation with a first graphics drawing tool configured in the first terminal to obtain first operation data based on the first graphics drawing tool.
14. The first terminal of claim 13, wherein the transmission unit is configured to:
transmitting first operation data based on the first graphic drawing tool from the first terminal to the second terminal through the transmission channel group, so that the second terminal sets the state of a second graphic drawing tool configured in the second terminal according to the first operation data, and the second terminal displays a second image of a target space corresponding to the first operation; wherein the content of the first and second substances,
the first and second graphical drawing tools are the same graphical drawing tool.
15. An apparatus for remote display, comprising:
one or more processors; and
one or more memories, wherein the memory has stored therein computer readable code, which when executed by the one or more processors, performs the method for remote presentation of any of claims 1-7.
16. A computer-readable storage medium having stored thereon instructions that, when executed by a processor, cause the processor to perform the method for remote presentation of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911208541.2A CN111045770A (en) | 2019-11-30 | 2019-11-30 | Method, first terminal, device and readable storage medium for remote exhibition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911208541.2A CN111045770A (en) | 2019-11-30 | 2019-11-30 | Method, first terminal, device and readable storage medium for remote exhibition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111045770A true CN111045770A (en) | 2020-04-21 |
Family
ID=70234232
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911208541.2A Pending CN111045770A (en) | 2019-11-30 | 2019-11-30 | Method, first terminal, device and readable storage medium for remote exhibition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111045770A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111581564A (en) * | 2020-05-10 | 2020-08-25 | 青岛希望鸟科技有限公司 | Webpage synchronous communication method realized by applying Canvas |
| CN111641878A (en) * | 2020-06-03 | 2020-09-08 | 天津卓朗科技发展有限公司 | Three-dimensional model display method and device and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108566366A (en) * | 2018-01-25 | 2018-09-21 | 置景（上海）科技有限公司 | Virtual reality teleconference method and system |
| CN108765536A (en) * | 2018-05-30 | 2018-11-06 | 链家网（北京）科技有限公司 | A kind of synchronization processing method and device of virtual three-dimensional space |
| WO2019226124A1 (en) * | 2018-05-22 | 2019-11-28 | Reyhanoglu Ozgur | A control device for touchless control of medical devices |
-
2019
- 2019-11-30 CN CN201911208541.2A patent/CN111045770A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108566366A (en) * | 2018-01-25 | 2018-09-21 | 置景（上海）科技有限公司 | Virtual reality teleconference method and system |
| WO2019226124A1 (en) * | 2018-05-22 | 2019-11-28 | Reyhanoglu Ozgur | A control device for touchless control of medical devices |
| CN108765536A (en) * | 2018-05-30 | 2018-11-06 | 链家网（北京）科技有限公司 | A kind of synchronization processing method and device of virtual three-dimensional space |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111581564A (en) * | 2020-05-10 | 2020-08-25 | 青岛希望鸟科技有限公司 | Webpage synchronous communication method realized by applying Canvas |
| CN111581564B (en) * | 2020-05-10 | 2023-12-12 | 青岛希望鸟科技有限公司 | Webpage synchronous communication method implemented by Canvas |
| CN111641878A (en) * | 2020-06-03 | 2020-09-08 | 天津卓朗科技发展有限公司 | Three-dimensional model display method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021204296A1 (en) | Remote display method for three-dimensional model, first terminal, electronic device and storage medium | |
| WO2019228188A1 (en) | Method and apparatus for marking and displaying spatial size in virtual three-dimensional house model | |
| US20160180593A1 (en) | Wearable device-based augmented reality method and system | |
| EP2685715B1 (en) | Method and device for managing video resources in video conference | |
| WO2015070694A1 (en) | Screen splicing system and video data stream processing method | |
| CN110891167A (en) | Information interaction method, first terminal and computer readable storage medium | |
| CN109831662B (en) | Real-time picture projection method and device of AR (augmented reality) glasses screen, controller and medium | |
| JP2016511603A (en) | System and method for media streaming for multi-user control and shared display | |
| CN111007997A (en) | Remote display method, electronic device and computer-readable storage medium | |
| CN111078171B (en) | Method, terminal device, device and readable storage medium for synchronous display | |
| EP3962090A1 (en) | Communication terminal, image communication system, method for displaying image, and carrier means | |
| CN103795961A (en) | Video conference telepresence system and image processing method thereof | |
| CN111045770A (en) | Method, first terminal, device and readable storage medium for remote exhibition | |
| CN105306872B (en) | Control the methods, devices and systems of multipoint videoconference | |
| CN109788359B (en) | Video data processing method and related device | |
| CN114374853A (en) | Content display method and device, computer equipment and storage medium | |
| CN110944140A (en) | Remote display method, remote display system, electronic device and storage medium | |
| JP6617547B2 (en) | Image management system, image management method, and program | |
| CN114007022A (en) | Video source switching method and device and LED display screen control system | |
| CN110662015A (en) | Method and apparatus for displaying image | |
| CN112651801B (en) | Method and device for displaying house source information | |
| CN113989427A (en) | Illumination simulation method and device, electronic equipment and storage medium | |
| CN109241304B (en) | Picture processing method, device and equipment | |
| CN112463089A (en) | Cross-terminal picture synchronous zooming method and device, electronic medium and storage medium | |
| CN111696214A (en) | House display method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |