CN112153619A - Track display method, first terminal, second terminal and storage medium - Google Patents
Track display method, first terminal, second terminal and storage medium Download PDFInfo
- Publication number
- CN112153619A CN112153619A CN202010932667.0A CN202010932667A CN112153619A CN 112153619 A CN112153619 A CN 112153619A CN 202010932667 A CN202010932667 A CN 202010932667A CN 112153619 A CN112153619 A CN 112153619A
- Authority
- CN
- China
- Prior art keywords
- interface
- terminal
- sharing
- display
- shared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
- H04W12/06—Authentication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
- H04W76/11—Allocation or use of connection identifiers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
- H04W76/14—Direct-mode setup
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W84/00—Network topologies
- H04W84/02—Hierarchically pre-organised networks, e.g. paging networks, cellular networks, WLAN [Wireless Local Area Network] or WLL [Wireless Local Loop]
- H04W84/04—Large scale networks; Deep hierarchical networks
- H04W84/08—Trunked mobile radio systems
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application discloses a track display method, a first terminal, a second terminal and a storage medium, wherein the method applied to the first terminal comprises the following steps: under the condition of establishing wireless connection with a second terminal, performing interface sharing with the second terminal, and determining a displayed interface as a first shared interface; acquiring operation information aiming at a first shared interface under the condition of starting a track display function, and determining an operation track based on the operation information; and transmitting the operation track to the second terminal so that the second terminal can display the operation track on a second sharing interface which is the same as the first sharing interface.
Description
Technical Field
The embodiment of the application relates to the technical field of communication, in particular to a track display method, a first terminal, a second terminal and a storage medium.
Background
With the continuous development of communication technology, terminals can provide more and more functions. For example, screen sharing and remote assistance can be performed between terminals.
At present, in the process of screen sharing or remote assistance between terminals, one terminal needs to share its own display interface to another terminal. However, in the screen sharing scenario, the shared terminal can only display the operation result of the other terminal for the shared interface, and in the remote assistance scenario, the assisted terminal can also only display the operation result of the other terminal for the self interface, that is, the user can only know the interface operation result, and the interface display effect is not good.
Disclosure of Invention
The embodiment of the application provides a track display method, a first terminal, a second terminal and a storage medium, which can provide an operation track of a display interface for a shared terminal or an assisted terminal in the process of screen sharing or remote assistance between terminals, so that the interface display effect is improved.
The technical scheme of the embodiment of the application is realized as follows:
the embodiment of the application provides a track display method, which is applied to a first terminal and comprises the following steps:
under the condition of establishing wireless connection with a second terminal, performing interface sharing with the second terminal, and determining a displayed interface as a first shared interface;
under the condition that a track display function is started, collecting operation information aiming at the first shared interface, and determining an operation track based on the operation information;
and transmitting the operation track to the second terminal so that the second terminal can display the operation track on a second sharing interface which is the same as the first sharing interface.
In the above method, the interface sharing with the second terminal and determining the displayed interface as the first shared interface include:
determining a currently displayed first display interface as the first shared interface;
and transmitting first interface information corresponding to the first sharing interface to the second terminal so that the second terminal can display the second sharing interface by using the first interface information.
In the above method, the interface sharing with the second terminal and determining the displayed interface as the first shared interface include:
receiving second interface information corresponding to the second shared interface transmitted by the second terminal;
and displaying an interface according to the second interface information to obtain the first shared interface.
In the above method, the acquiring operation information for the first shared interface and determining an operation trajectory based on the operation information includes:
overlaying a transparent interface on the first shared interface;
receiving touch operation aiming at the first shared interface through the transparent interface, and determining the operation information according to the touch operation;
and generating the operation track on the transparent interface based on the operation information.
In the above method, the generating the operation track on the transparent interface based on the operation information includes:
on the transparent interface, sequentially connecting the touch points according to a touch sequence to obtain at least one line segment;
and adding a target special effect to the at least one line segment to obtain the operation track.
In the above method, before the interface sharing is performed with the second terminal and the displayed interface is determined as the first shared interface when the wireless connection is established with the second terminal, the method further includes:
sending a control request to a user server;
receiving cluster identification and authentication information generated by the user server according to the control request;
and initiating a request for joining the cluster corresponding to the cluster identifier to a real-time communication server by using the authentication information so as to join the cluster through the real-time communication server and complete handshake connection with the second terminal joining the cluster.
The embodiment of the application provides a track display method, which is applied to a second terminal and comprises the following steps:
under the condition of establishing wireless connection with a first terminal, performing interface sharing with the first terminal, and determining a displayed interface as a second sharing interface;
receiving an operation track on a first sharing interface transmitted by the first terminal; the first sharing interface is the same interface displayed by the first terminal as the second sharing interface;
and displaying the operation track on the second sharing interface.
In the above method, the interface sharing with the first terminal and determining the displayed interface as the second shared interface include:
receiving first interface information corresponding to the first shared interface transmitted by the first terminal;
and displaying an interface according to the first interface information to obtain the second sharing interface.
In the above method, the interface sharing with the first terminal and determining the displayed interface as the second shared interface include:
determining a currently displayed second display interface as the second sharing interface;
and transmitting second interface information corresponding to the second shared interface to the first terminal so that the first terminal can display the first shared interface by using the second interface information.
In the above method, before the interface sharing is performed with the first terminal and the displayed interface is determined as the second shared interface when the wireless connection is established with the first terminal, the method further includes:
receiving cluster identification and authentication information sent by a user server;
and sending a request for joining the cluster corresponding to the cluster identifier to a real-time communication server by using the authentication information so as to join the cluster through the real-time communication server and complete handshake connection with the first terminal joining the cluster.
The embodiment of the application provides a first terminal, which comprises:
the first sharing module is used for sharing an interface with a second terminal under the condition of establishing wireless connection with the second terminal and determining the displayed interface as a first sharing interface;
the determining module is used for acquiring operation information aiming at the first shared interface under the condition that a track display function is started, and determining an operation track based on the operation information;
the first communication module is configured to transmit the operation track to the second terminal, so that the second terminal displays the operation track on a second sharing interface that is the same as the first sharing interface.
The embodiment of the application provides a second terminal, which comprises:
the second sharing module is used for sharing an interface with the first terminal under the condition of establishing wireless connection with the first terminal and determining the displayed interface as a second sharing interface;
the second communication module is used for receiving an operation track on a first sharing interface transmitted by the first terminal; the first sharing interface is the same interface displayed by the first terminal as the second sharing interface;
and the display module is used for displaying the operation track on the second sharing interface.
The embodiment of the present application provides a first terminal, which includes: a first processor, a first memory, a first display and a first communication bus;
the first communication bus is used for realizing communication connection among the first processor, the first memory and the first display;
the first processor and the first display are configured to execute a first trajectory display program stored in the first memory, so as to implement the trajectory display method applied to the first terminal.
The embodiment of the present application provides a second terminal, which includes: a second processor, a second memory, a second display and a second communication bus;
the second communication bus is used for realizing communication connection among the second processor, the second memory and the second display;
the second processor and the second display are configured to execute a second trajectory display program stored in the second memory, so as to implement the trajectory display method applied to the second terminal.
An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the trajectory display method described above.
The embodiment of the application provides a track display method, a first terminal, a second terminal and a storage medium, wherein the method applied to the first terminal comprises the following steps: under the condition of establishing wireless connection with a second terminal, performing interface sharing with the second terminal, and determining a displayed interface as a first shared interface; acquiring operation information aiming at a first shared interface under the condition of starting a track display function, and determining an operation track based on the operation information; and transmitting the operation track to the second terminal so that the second terminal can display the operation track on a second sharing interface which is the same as the first sharing interface. According to the technical scheme provided by the embodiment of the application, in the process of screen sharing or remote assistance between the terminals, the operation track of the display interface can be provided for the shared terminal or the assisted terminal, and the interface display effect is improved.
Drawings
Fig. 1 is a first schematic flow chart of a track display method according to an embodiment of the present disclosure;
fig. 2 is a first display diagram of an exemplary first terminal according to an embodiment of the present disclosure;
fig. 3 is a second schematic display diagram of an exemplary first terminal according to an embodiment of the present disclosure;
fig. 4 is a third schematic display diagram of an exemplary first terminal according to an embodiment of the present disclosure;
FIG. 5 is a schematic diagram of an exemplary track display provided by embodiments of the present application;
fig. 6 is a second flowchart illustrating a track display method according to an embodiment of the present application;
fig. 7 is a schematic diagram of terminal interaction in an exemplary remote assistance scenario provided in an embodiment of the present application;
fig. 8 is a first schematic structural diagram of a first terminal according to an embodiment of the present disclosure;
fig. 9 is a second schematic structural diagram of a first terminal according to an embodiment of the present application;
fig. 10 is a first schematic structural diagram of a second terminal according to an embodiment of the present disclosure;
fig. 11 is a second schematic structural diagram of a second terminal according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The embodiment of the application provides a track display method which is realized through a first terminal. The first terminal may be an electronic device such as a mobile phone and a tablet computer, and the embodiment of the present application is not limited. Fig. 1 is a first flowchart illustrating a track display method according to an embodiment of the present application. As shown in fig. 1, the method mainly comprises the following steps:
s101, under the condition that wireless connection is established with a second terminal, interface sharing is conducted with the second terminal, and a displayed interface is determined to be a first sharing interface.
In the embodiment of the application, the first terminal performs interface sharing with the second terminal under the condition that the first terminal establishes wireless connection with the second terminal, and determines a displayed interface as a first shared interface.
It should be noted that, in the embodiment of the present application, the second terminal may be an electronic device such as a mobile phone and a tablet computer, and the embodiment of the present application is not limited.
It should be noted that, in the embodiment of the present application, the first terminal needs to establish a wireless connection with the second terminal first, and then perform interface sharing with the second terminal. Specifically, the first terminal and the second terminal can simultaneously start a screen sharing or remote assistance function, so that the first terminal and the second terminal access the same network to perform account matching and realize wireless connection. Of course, the first terminal and the second terminal may also establish a wireless connection in other manners, and the embodiment of the present application is not limited.
Fig. 2 is a first display diagram of an exemplary first terminal according to an embodiment of the present disclosure. As shown in fig. 2, in the embodiment of the present application, a user may click a "remote assistance" icon displayed on a first terminal to start a remote assistance function, so as to further perform account connection matching with a second terminal that also starts the remote assistance function, thereby implementing wireless connection with the second terminal.
Fig. 3 is a second schematic display diagram of an exemplary first terminal according to an embodiment of the present application. As shown in fig. 3, in the embodiment of the present application, a user may click a "screen sharing" icon displayed on a first terminal, and start a screen sharing function, so as to further perform account connection matching with a second terminal that also starts the screen sharing function, and implement wireless connection with the second terminal.
It is understood that in the embodiment of the present application, in the case where the first terminal turns on the remote assistance or screen sharing function, the second terminal also needs to turn on the same function.
It can be understood that, in the embodiment of the present application, the first terminal may perform interface sharing with the second terminal when establishing a wireless connection with the second terminal, so as to determine an interface displayed by the first terminal as the first shared interface. Of course, since the terminal and the second terminal share the interface, the display interfaces of the terminal and the second terminal are actually the same, that is, the interface displayed on the second terminal is the same interface as the first shared interface. Specific first shared interface embodiments of the present application are not limited.
In the embodiment of the present application, the first terminal and the second terminal share an interface, and the interface displayed by the second terminal may be displayed by the first terminal, or may be displayed by the first terminal by the second terminal, and the interfaces displayed by the first terminal and the second terminal are actually the same.
Specifically, in an embodiment of the present application, interface sharing is performed between a first terminal and a second terminal, and a displayed interface is determined as a first shared interface, including: determining a first display interface which is currently displayed as a first sharing interface; and transmitting the first interface information corresponding to the first sharing interface to the second terminal so that the second terminal can display the second sharing interface by using the first interface information.
It can be understood that, in the embodiment of the application, in a scene of screen sharing, the first terminal may directly determine a first display interface currently displayed as the first sharing interface, and wirelessly transmit first interface information corresponding to the first sharing interface to the second terminal, so that the second terminal may display a second sharing interface that is the same as the first sharing interface according to the first interface information.
Specifically, in an embodiment of the present application, interface sharing is performed between a first terminal and a second terminal, and a displayed interface is determined as a first shared interface, including: receiving second interface information corresponding to a second shared interface transmitted by a second terminal; and displaying the interface according to the second interface information to obtain a first shared interface.
It can be understood that, in the embodiment of the present application, under the condition of remote assistance, the first terminal needs to display an interface displayed by the second terminal, where the interface is the second sharing interface, therefore, the second terminal may transmit second interface information corresponding to the second sharing interface to the first terminal, and the first terminal may display an interface that is the same as the second sharing interface according to the received second interface information, where the interface is the first sharing interface.
S102, collecting operation information aiming at the first shared interface under the condition that the track display function is started, and determining an operation track based on the operation information.
In the embodiment of the application, the first terminal can collect operation information for the first shared interface under the condition that the track display function is started, and determines the operation track based on the operation information.
It should be noted that, in the embodiment of the present application, in a case where the first terminal establishes a wireless connection with the second terminal, for example, the first terminal and the second terminal are in a screen sharing or remote assistance process, the user may start the track display function through a specific operation. The specific manner of activating the trajectory display function is not limited in the embodiments of the present application.
Fig. 4 is a third schematic display diagram of an exemplary first terminal according to an embodiment of the present application. As shown in fig. 4, the first terminal starts the screen sharing function, establishes a wireless connection with the second terminal, and the user may click the "operation track" icon on the first terminal, thereby starting the track display function.
It can be understood that, in the embodiment of the application, a user may perform a touch operation on a first shared interface displayed by a first terminal, for example, in a scene of screen sharing, the user may mark certain places needing important attention, or perform interface sliding, and in a scene of remote assistance, the user may click certain function entries provided in the first shared interface, so that the first terminal may collect corresponding operation information, thereby determining an operation trajectory corresponding to the touch operation.
Specifically, in an embodiment of the present application, the acquiring, by the first terminal, operation information for the first shared interface, and determining an operation trajectory based on the operation information includes: covering a transparent interface on the first shared interface; receiving touch operation aiming at the first shared interface through the transparent interface, and determining operation information according to the touch operation; and generating an operation track on the transparent interface based on the operation information.
It can be understood that, in the embodiment of the present application, the first terminal may cover a layer of transparent interface on the displayed first shared interface for drawing the operation track, the transparent interface does not affect the touch operations such as clicking and the like performed by the user on the first shared interface, and the terminal may continue to receive the touch operations on the first shared interface through the transparent interface when the operation track is drawn and displayed on the transparent interface by the first terminal.
It should be noted that, in an embodiment of the present application, the operation information includes a plurality of touch points, and the generating, by the first terminal, an operation track on the transparent interface based on the operation information includes: on the transparent interface, sequentially connecting a plurality of touch points according to a touch sequence to obtain at least one line segment; and adding a target special effect to at least one line segment to obtain an operation track.
It should be noted that, in the embodiment of the present application, the first terminal may sequentially connect the collected multiple touch points on the transparent interface, and a line segment is formed between every two touch points, so as to obtain at least one line segment, and an end point of a previous line segment is used as a starting point of a next line segment, and has continuity. And then, the terminal can add a target special effect to at least one line segment on the transparent interface so as to obtain an operation track. Compared with the method of directly displaying at least one line segment, the obtained operation track has better visual effect. The target special effect can comprise the effect that the thickness of the line segment is gradually reduced along with the time, so that the head is large and the tail is small, and can also comprise the effect that the transparency of the line segment is gradually reduced along with the time, so that the line segment gradually disappears.
It should be noted that, in the embodiment of the present application, a target special effect may be stored in the first terminal, so that the target special effect is called in the drawing of the operation trajectory. The specific target effect can be set according to actual requirements, and the embodiment of the application is not limited.
S103, the operation track is transmitted to the second terminal, so that the second terminal can display the operation track on a second sharing interface which is the same as the first sharing interface.
In an embodiment of the application, after obtaining the operation trajectory, the first terminal may transmit the operation trajectory to the second terminal, so that the operation trajectory is displayed on a second sharing interface that is the same as the first sharing interface.
It can be understood that, in the embodiment of the present application, the first terminal and the second terminal perform interface sharing, and the first sharing interface displayed on the first terminal is the same as the second sharing interface displayed on the second terminal. The first terminal transmits the operation track on the first sharing interface to the second terminal, and the second terminal can display the operation track on the second sharing interface displayed by the second terminal, which is equal to the operation track of the user using the first terminal aiming at the first sharing interface, so that the user using the second terminal can know the operation process of the user using the first terminal, not only the operation result.
Fig. 5 is a schematic track display diagram of an exemplary second sharing interface provided in an embodiment of the present application. As shown in fig. 5, in an embodiment of the present application, the second terminal may display an operation track on the second sharing interface according to the received operation track. It should be noted that the first shared interface on the first terminal is the same as the second shared interface, and the first terminal draws an operation track on the transparent interface on the first shared interface, that is, the content actually displayed by the first terminal is the same as the content displayed by the second terminal.
It should be noted that, in the embodiment of the application, in a remote assistance scenario, the first terminal further needs to transmit the operation information to the second terminal, so that the second terminal can perform corresponding response on the second shared interface according to the operation information under the condition that the second terminal performs track display on the second shared interface.
It should be noted that, in the embodiment of the present application, the first terminal is a terminal providing screen sharing or a terminal providing remote assistance, and correspondingly, the second terminal is a shared terminal or an assisted terminal.
It should be noted that, in this embodiment of the application, in a case that a wireless connection is established with a second terminal, interface sharing is performed with the second terminal, and before determining a displayed interface as a first shared interface, the method further includes: sending a control request to a user server; receiving cluster identification and authentication information generated by a user server according to the control request; and initiating a request for joining the cluster corresponding to the cluster identifier to the real-time communication server by using the authentication information so as to join the cluster through the real-time communication server and complete handshake connection with the second terminal joining the cluster.
It should be noted that, in the embodiment of the present application, the first terminal and the second terminal complete a handshake connection, so as to mutually determine a wireless connection mode for wireless connection. In a scenario where the first terminal and the second terminal can establish a direct connection, the first terminal and the second terminal may directly interact with each other, for example, in a case where the first terminal remotely assists the second terminal, the first terminal may transmit the operation trajectory to the second terminal through the data channel. In addition, in a scenario where the first terminal and the second terminal cannot establish a direct connection, the first terminal and the second terminal may perform information interaction through the relay server, for example, in a case where the first terminal remotely assists the second terminal, the first terminal transmits the operation trajectory to the second terminal through the relay server. The embodiment of the present application is not limited to a specific manner of information interaction between the first terminal and the second terminal.
The embodiment of the application provides a track display method, which is applied to a first terminal and comprises the following steps: under the condition of establishing wireless connection with a second terminal, performing interface sharing with the second terminal, and determining a displayed interface as a first shared interface; acquiring operation information aiming at a first shared interface under the condition of starting a track display function, and determining an operation track based on the operation information; and transmitting the operation track to the second terminal so that the second terminal can display the operation track on a second sharing interface which is the same as the first sharing interface. According to the track display method provided by the embodiment of the application, in the process of screen sharing or remote assistance between terminals, the operation track of the display interface can be provided for the shared terminal or the assisted terminal, and the interface display effect is improved.
The embodiment of the application provides a track display method which is applied to a second terminal. Fig. 6 is a second flowchart illustrating a track display method according to an embodiment of the present application. As shown in fig. 6, the method mainly comprises the following steps:
s601, under the condition that wireless connection is established with the first terminal, interface sharing is carried out with the first terminal, and the displayed interface is determined to be a second sharing interface.
In the embodiment of the application, the second terminal performs interface sharing with the first terminal under the condition that the wireless connection is established with the first terminal, and determines the displayed interface as a second shared interface.
It should be noted that, in the embodiment of the present application, the second terminal needs to establish a wireless connection with the first terminal first, and then perform interface sharing with the first terminal. Specifically, the second terminal and the first terminal can simultaneously start a screen sharing or remote assistance function, so that the second terminal and the first terminal can access the same network to perform account matching, and wireless connection is realized. Of course, the second terminal and the first terminal may also establish a wireless connection in other manners, and the embodiment of the present application is not limited.
In the embodiment of the present application, the second terminal and the first terminal share an interface, and the interface displayed by the first terminal may be displayed by the second terminal, or may be displayed by the second terminal by the first terminal, and the interfaces displayed by the second terminal are actually the same.
Specifically, in an embodiment of the present application, interface sharing is performed between the second terminal and the first terminal, and the interface displayed is determined as the second shared interface, including: receiving first interface information corresponding to a first shared interface transmitted by a first terminal; and displaying the interface according to the first interface information to obtain a second sharing interface.
Specifically, in an embodiment of the present application, interface sharing is performed between the second terminal and the first terminal, and the interface displayed is determined as the second shared interface, including: determining a second display interface which is currently displayed as a second sharing interface; and transmitting second interface information corresponding to the second shared interface to the first terminal so that the first terminal can display the first shared interface by using the second interface information.
S602, receiving an operation track on a first sharing interface transmitted by a first terminal; the first sharing interface is the same interface displayed by the first terminal as the second sharing interface.
In an embodiment of the application, the second terminal may receive an operation track on a first shared interface transmitted by the first terminal, where the first shared interface is an interface displayed by the first terminal and the same as the second shared interface.
It is understood that, in the embodiment of the present application, the second terminal performs interface sharing with the first terminal, and therefore, the two terminals actually display the same interface, that is, the second sharing interface displayed by the second terminal is the same as the first sharing interface displayed by the first terminal, except that the displayed terminals are different. The user using the first terminal can perform touch operation on the first shared interface displayed by the first terminal, and the first terminal can obtain an operation track on the first shared interface and transmit the operation track to the second terminal.
And S603, displaying the operation track on the second sharing interface.
In the embodiment of the application, after the second terminal receives the operation track transmitted by the first terminal, the operation track can be displayed on the displayed second sharing interface.
It can be understood that, in the embodiment of the present application, the second terminal performs interface sharing with the first terminal, and the second sharing interface displayed on the second terminal is the same as the first sharing interface displayed on the first terminal. Therefore, when the second terminal receives the operation track on the first shared interface, the track display can be performed on the second shared interface displayed by the second terminal by using the operation track, which is equivalent to that the two terminals display the same interface and the operation track of the user on the same interface, and the user using the second terminal can know the operation process of the user using the first terminal, not only the operation result.
It should be noted that, in the embodiment of the application, in a remote assistance scenario, the first terminal may further transmit operation information for the first shared interface to the second terminal, that is, the second terminal may further receive the operation information, so that the second terminal may further perform a corresponding response on the second shared interface according to the operation information when displaying the operation track on the second shared interface.
It should be noted that, in this embodiment of the application, when the second terminal establishes a wireless connection with the first terminal, interface sharing is performed with the first terminal, and before the displayed interface is determined as the second shared interface, the following steps are further performed: receiving cluster identification and authentication information sent by a user server; and sending a request for joining the cluster corresponding to the cluster identifier to the real-time communication server by using the authentication information so as to join the cluster through the real-time communication server and complete handshake connection with the first terminal joining the cluster.
It should be noted that, in the embodiment of the present application, the second terminal and the first terminal complete a handshake connection, so as to mutually determine a wireless connection mode for wireless connection. Under the scene that the first terminal and the second terminal can establish direct connection, the first terminal and the second terminal can directly interact information with each other, for example, under the condition that the first terminal remotely assists the second terminal, the second terminal can transmit the information of the self display interface to the first terminal through an audio/video channel. In addition, in a scenario where the first terminal and the second terminal cannot establish a direct connection, the first terminal and the second terminal may perform information interaction through the relay server, for example, in a case where the first terminal remotely assists the second terminal, the second terminal transmits information of a display interface of the second terminal to the first terminal through the relay server. The embodiment of the present application is not limited to a specific manner of information interaction between the first terminal and the second terminal.
Fig. 7 is a schematic diagram of terminal interaction in an exemplary remote assistance scenario provided in an embodiment of the present application. As shown in fig. 7, in a scenario where the first terminal remotely assists the second terminal, the first terminal requests assistance/control from the user server, and then the user server generates a unified room identifier and an authentication token, where the room identifier is equivalent to a cluster identifier and the authentication token is equivalent to authentication information. The user server can send the room identifier and the authentication token to the first terminal and the second terminal, the first terminal and the second terminal can initiate connection authentication to the real-time communication server according to the received room identifier and the authentication token, and add the room corresponding to the room identifier, and then the real-time communication server can complete handshake connection between the first terminal and the second terminal through SDP protocol exchange. Then, in a scene that the first terminal and the second terminal are directly connected, the second terminal can transmit information of the display interface to the first terminal through an audio and video channel, the first terminal can transmit operation information to the second terminal through a data channel, in the scene that the first terminal and the second terminal are in transit connection, the second terminal sends the information of the display interface to the first terminal through a transit server, and the first terminal sends the operation information to the second terminal through the transit server.
The embodiment of the application provides a first terminal. Fig. 8 is a first schematic structural diagram of a first terminal according to an embodiment of the present application. As shown in fig. 8, the first terminal includes:
a first sharing module 801, configured to perform interface sharing with a second terminal and determine a displayed interface as a first sharing interface when a wireless connection is established with the second terminal;
a determining module 802, configured to collect operation information for the first shared interface when a track display function is started, and determine an operation track based on the operation information;
the first communication module 803 is configured to transmit the operation track to the second terminal, so that the second terminal displays the operation track on a second shared interface that is the same as the first shared interface.
In an embodiment of the present application, the first sharing module 801 is specifically configured to determine a currently displayed first display interface as the first sharing interface; and transmitting first interface information corresponding to the first sharing interface to the second terminal so that the second terminal can display the second sharing interface by using the first interface information.
In an embodiment of the present application, the first sharing module 801 is specifically configured to receive second interface information corresponding to the second sharing interface transmitted by the second terminal; and displaying an interface according to the second interface information to obtain the first shared interface.
In an embodiment of the present application, the determining module 802 is specifically configured to overlay a transparent interface on the first shared interface; receiving touch operation aiming at the first shared interface through the transparent interface, and determining the operation information according to the touch operation; and generating the operation track on the transparent interface based on the operation information.
In an embodiment of the present application, the determining module 802 is specifically configured to sequentially connect the touch points on the transparent interface according to a touch sequence to obtain at least one line segment; and adding a target special effect to the at least one line segment to obtain the operation track.
In an embodiment of the present application, the first communication module 803 is further configured to send a control request to a user server; receiving cluster identification and authentication information generated by the user server according to the control request; and initiating a request for joining the cluster corresponding to the cluster identifier to a real-time communication server by using the authentication information so as to join the cluster through the real-time communication server and finish handshaking with the second terminal joining the cluster.
Fig. 9 is a second schematic structural diagram of a first terminal according to an embodiment of the present application. As shown in fig. 9, the first terminal includes: a first processor 901, a first memory 902, a first display 903, and a first communication bus 904;
the first communication bus 904 is used for realizing communication connection among the first processor 901, the first memory 902 and the first display 903;
the first processor 901 is configured to execute the first track display program stored in the first memory 902, so as to implement the track display method applied to the first terminal.
The embodiment of the application provides a second terminal. Fig. 10 is a first schematic structural diagram of a second terminal according to an embodiment of the present application. As shown in fig. 10, the second terminal includes:
a second sharing module 1001, configured to perform interface sharing with a first terminal and determine a displayed interface as a second sharing interface when a wireless connection is established with the first terminal;
the second communication module 1002 is configured to receive an operation track on a first shared interface transmitted by the first terminal; the first sharing interface is the same interface displayed by the first terminal as the second sharing interface;
a display module 1003, configured to display the operation track on the second sharing interface.
In an embodiment of the present application, the second sharing module 1001 is specifically configured to receive first interface information corresponding to the first sharing interface transmitted by the first terminal; and displaying an interface according to the first interface information to obtain the second sharing interface.
In an embodiment of the present application, the second sharing module 1001 is specifically configured to determine a second display interface currently displayed as the second sharing interface; and transmitting second interface information corresponding to the second shared interface to the first terminal so that the first terminal can display the first shared interface by using the second interface information.
In an embodiment of the present application, the second communication module 1002 is further configured to receive a cluster identifier and authentication information sent by a user server; and sending a request for joining the cluster corresponding to the cluster identifier to a real-time communication server by using the authentication information so as to join the cluster through the real-time communication server and complete handshake connection with the first terminal joining the cluster.
Fig. 11 is a second schematic structural diagram of a second terminal according to an embodiment of the present application. As shown in fig. 11, in an embodiment of the present application, the second terminal includes: a second processor 1101, a second memory 1102, a second display 1103, and a second communication bus 1104;
the second communication bus 1104 is used for realizing communication connection among the second processor 1101, the second memory 1102 and the second display 1103;
the second processor 1101 is configured to execute a second trajectory display program stored in the second memory 1102, so as to implement the trajectory display method applied to the second terminal.
An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the trajectory display method described above. The computer-readable storage medium may be a volatile Memory (volatile Memory), such as a Random-Access Memory (RAM); or a non-volatile Memory (non-volatile Memory), such as a Read-Only Memory (ROM), a flash Memory (flash Memory), a Hard Disk (Hard Disk Drive, HDD) or a Solid-State Drive (SSD); or may be a respective device, such as a mobile phone, computer, tablet device, personal digital assistant, etc., that includes one or any combination of the above-mentioned memories.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of implementations of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart block or blocks and/or flowchart block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks in the flowchart and/or block diagram block or blocks.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application are included in the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (15)
1. A track display method is applied to a first terminal, and is characterized by comprising the following steps:
under the condition of establishing wireless connection with a second terminal, performing interface sharing with the second terminal, and determining a displayed interface as a first shared interface;
under the condition that a track display function is started, collecting operation information aiming at the first shared interface, and determining an operation track based on the operation information;
and transmitting the operation track to the second terminal so that the second terminal can display the operation track on a second sharing interface which is the same as the first sharing interface.
2. The method of claim 1, wherein the interface sharing with the second terminal and determining the displayed interface as the first shared interface comprises:
determining a currently displayed first display interface as the first shared interface;
and transmitting first interface information corresponding to the first sharing interface to the second terminal so that the second terminal can display the second sharing interface by using the first interface information.
3. The method of claim 1, wherein the interface sharing with the second terminal and determining the displayed interface as the first shared interface comprises:
receiving second interface information corresponding to the second shared interface transmitted by the second terminal;
and displaying an interface according to the second interface information to obtain the first shared interface.
4. The method of claim 1, wherein the collecting operation information for the first shared interface and determining an operation trajectory based on the operation information comprises:
overlaying a transparent interface on the first shared interface;
receiving touch operation aiming at the first shared interface through the transparent interface, and determining the operation information according to the touch operation;
and generating the operation track on the transparent interface based on the operation information.
5. The method of claim 4, wherein the operation information comprises a plurality of touch points, and wherein generating the operation track on the transparent interface based on the operation information comprises:
on the transparent interface, sequentially connecting the touch points according to a touch sequence to obtain at least one line segment;
and adding a target special effect to the at least one line segment to obtain the operation track.
6. The method according to claim 1, wherein before the interface sharing with the second terminal and determining the displayed interface as the first shared interface in the case of establishing the wireless connection with the second terminal, the method further comprises:
sending a control request to a user server;
receiving cluster identification and authentication information generated by the user server according to the control request;
and initiating a request for joining the cluster corresponding to the cluster identifier to a real-time communication server by using the authentication information so as to join the cluster through the real-time communication server and complete handshake connection with the second terminal joining the cluster.
7. A track display method is applied to a second terminal, and is characterized by comprising the following steps:
under the condition of establishing wireless connection with a first terminal, performing interface sharing with the first terminal, and determining a displayed interface as a second sharing interface;
receiving an operation track on a first sharing interface transmitted by the first terminal; the first sharing interface is the same interface displayed by the first terminal as the second sharing interface;
and displaying the operation track on the second sharing interface.
8. The method of claim 7, wherein the interface sharing with the first terminal and determining the displayed interface as a second shared interface comprises:
receiving first interface information corresponding to the first shared interface transmitted by the first terminal;
and displaying an interface according to the first interface information to obtain the second sharing interface.
9. The method of claim 7, wherein the interface sharing with the first terminal and determining the displayed interface as a second shared interface comprises:
determining a currently displayed second display interface as the second sharing interface;
and transmitting second interface information corresponding to the second shared interface to the first terminal so that the first terminal can display the first shared interface by using the second interface information.
10. The method according to claim 7, wherein before the interface sharing with the first terminal and determining the displayed interface as the second shared interface in the case of establishing the wireless connection with the first terminal, the method further comprises:
receiving cluster identification and authentication information sent by a user server;
and sending a request for joining the cluster corresponding to the cluster identifier to a real-time communication server by using the authentication information so as to join the cluster through the real-time communication server and complete handshake connection with the first terminal joining the cluster.
11. A first terminal, comprising:
the first sharing module is used for sharing an interface with a second terminal under the condition of establishing wireless connection with the second terminal and determining the displayed interface as a first sharing interface;
the determining module is used for acquiring operation information aiming at the first shared interface under the condition that a track display function is started, and determining an operation track based on the operation information;
the first communication module is configured to transmit the operation track to the second terminal, so that the second terminal displays the operation track on a second sharing interface that is the same as the first sharing interface.
12. A second terminal, comprising:
the second sharing module is used for sharing an interface with the first terminal under the condition of establishing wireless connection with the first terminal and determining the displayed interface as a second sharing interface;
the second communication module is used for receiving an operation track on a first sharing interface transmitted by the first terminal; the first sharing interface is the same interface displayed by the first terminal as the second sharing interface;
and the display module is used for displaying the operation track on the second sharing interface.
13. A first terminal, comprising: a first processor, a first memory, a first display and a first communication bus;
the first communication bus is used for realizing communication connection among the first processor, the first memory and the first display;
the first processor is configured to execute a first track display program stored in the first memory to implement the track display method according to any one of claims 1 to 6.
14. A second terminal, comprising: a second processor, a second memory, a second display and a second communication bus;
the second communication bus is used for realizing communication connection among the second processor, the second memory and the second display;
the second processor is configured to execute a second trajectory display program stored in the second memory to implement the trajectory display method according to any one of claims 7 to 10.
15. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the trajectory display method according to any one of claims 1 to 10.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010932667.0A CN112153619A (en) | 2020-09-08 | 2020-09-08 | Track display method, first terminal, second terminal and storage medium |
| PCT/CN2021/107840 WO2022052649A1 (en) | 2020-09-08 | 2021-07-22 | Trajectory display method, first terminal, second terminal, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010932667.0A CN112153619A (en) | 2020-09-08 | 2020-09-08 | Track display method, first terminal, second terminal and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112153619A true CN112153619A (en) | 2020-12-29 |
Family
ID=73889773
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010932667.0A Pending CN112153619A (en) | 2020-09-08 | 2020-09-08 | Track display method, first terminal, second terminal and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112153619A (en) |
| WO (1) | WO2022052649A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113242522A (en) * | 2021-04-30 | 2021-08-10 | 中国银行股份有限公司 | Remote mobile banking operation guiding method, device and system based on 5G |
| CN114089878A (en) * | 2021-10-21 | 2022-02-25 | 吕贺 | Remote control method, terminal, electronic device and storage medium |
| WO2022052649A1 (en) * | 2020-09-08 | 2022-03-17 | Oppo广东移动通信有限公司 | Trajectory display method, first terminal, second terminal, and storage medium |
| WO2022228129A1 (en) * | 2021-04-30 | 2022-11-03 | 中兴通讯股份有限公司 | Information processing method, terminal, and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140086105A1 (en) * | 2012-09-21 | 2014-03-27 | Pantech Co., Ltd. | Device and method for providing drawing screen sharing service |
| CN105681542A (en) * | 2014-11-21 | 2016-06-15 | 中兴通讯股份有限公司 | Information processing method and system and terminal |
| WO2019056610A1 (en) * | 2017-03-27 | 2019-03-28 | 广州视源电子科技股份有限公司 | Conference record sharing method, device, conference terminal and storage medium |
| US20190121599A1 (en) * | 2017-10-13 | 2019-04-25 | Slack Technologies, Inc. | Method, apparatus, and computer program product for sharing interface annotations among participating devices within a group-based communication system |
| CN111338721A (en) * | 2020-01-20 | 2020-06-26 | 北京大米未来科技有限公司 | Online interaction method, system, electronic device and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120173622A1 (en) * | 2011-01-04 | 2012-07-05 | Samsung Electronics Co., Ltd. | Social screen casting |
| CN203858621U (en) * | 2013-12-16 | 2014-10-01 | 联想(北京)有限公司 | Electronic device |
| CN105812547B (en) * | 2014-12-30 | 2019-10-29 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN112153619A (en) * | 2020-09-08 | 2020-12-29 | Oppo广东移动通信有限公司 | Track display method, first terminal, second terminal and storage medium |
-
2020
- 2020-09-08 CN CN202010932667.0A patent/CN112153619A/en active Pending
-
2021
- 2021-07-22 WO PCT/CN2021/107840 patent/WO2022052649A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140086105A1 (en) * | 2012-09-21 | 2014-03-27 | Pantech Co., Ltd. | Device and method for providing drawing screen sharing service |
| CN105681542A (en) * | 2014-11-21 | 2016-06-15 | 中兴通讯股份有限公司 | Information processing method and system and terminal |
| WO2019056610A1 (en) * | 2017-03-27 | 2019-03-28 | 广州视源电子科技股份有限公司 | Conference record sharing method, device, conference terminal and storage medium |
| US20190121599A1 (en) * | 2017-10-13 | 2019-04-25 | Slack Technologies, Inc. | Method, apparatus, and computer program product for sharing interface annotations among participating devices within a group-based communication system |
| CN111338721A (en) * | 2020-01-20 | 2020-06-26 | 北京大米未来科技有限公司 | Online interaction method, system, electronic device and storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022052649A1 (en) * | 2020-09-08 | 2022-03-17 | Oppo广东移动通信有限公司 | Trajectory display method, first terminal, second terminal, and storage medium |
| CN113242522A (en) * | 2021-04-30 | 2021-08-10 | 中国银行股份有限公司 | Remote mobile banking operation guiding method, device and system based on 5G |
| CN113242522B (en) * | 2021-04-30 | 2022-07-19 | 中国银行股份有限公司 | Remote mobile banking operation guiding method, device and system based on 5G |
| WO2022228129A1 (en) * | 2021-04-30 | 2022-11-03 | 中兴通讯股份有限公司 | Information processing method, terminal, and computer readable storage medium |
| CN114089878A (en) * | 2021-10-21 | 2022-02-25 | 吕贺 | Remote control method, terminal, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022052649A1 (en) | 2022-03-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112153619A (en) | Track display method, first terminal, second terminal and storage medium | |
| EP4047902A1 (en) | Remote assistance method, electronic device, and system | |
| EP3236660A1 (en) | Video processing method and device | |
| WO2014178364A1 (en) | System, program, and method for message transceiving assistance | |
| KR20170032445A (en) | Terminal, server, and terminal control method | |
| EP3068099A1 (en) | Communication system, transmission terminal, communication method, and medium | |
| WO2014012444A1 (en) | Method, device and system for realizing augmented reality information sharing | |
| JP2017526099A (en) | Target function starting method, apparatus, system, program, and recording medium | |
| US20230138804A1 (en) | Enhanced video call method and system, and electronic device | |
| EP3051772A1 (en) | Method and apparatus for accessing network | |
| CN111368232A (en) | Password sharing reflux method and device, electronic equipment and storage medium | |
| JP2021528706A (en) | File transmission methods, devices, and computer-readable storage media | |
| CN107992546B (en) | Electronic device, method thereof, and computer-readable recording medium | |
| CN104394199A (en) | A mobile terminal remote after-sale supporting method and device | |
| JP6314111B2 (en) | TERMINAL DEVICE, TERMINAL DEVICE CONTROL METHOD, AND TERMINAL DEVICE CONTROL PROGRAM | |
| US9762859B2 (en) | Shared communication terminal, communication system, and communication method | |
| CN105607958B (en) | Information input method and device | |
| CN113938759A (en) | File sharing method and file sharing device | |
| CN104219781A (en) | System and method for exchanging data between intelligent terminals | |
| JP2017079376A (en) | Transmission terminal, automatic response method, and program | |
| KR20160046444A (en) | Download sharing method for data | |
| JP2018041990A (en) | Communication terminal, communication system, display control method, and program | |
| KR20160046449A (en) | Method for controlling data download | |
| WO2024114065A1 (en) | Multimedia resource sharing method, and device and computer-readable storage medium | |
| CN113613348B (en) | Connection establishment method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |