WO2022142492A1

WO2022142492A1 - Screen sharing method for mobile terminals, mobile terminal, and storage medium

Info

Publication number: WO2022142492A1
Application number: PCT/CN2021/119143
Authority: WO
Inventors: 肖其虎
Original assignee: 中兴通讯股份有限公司
Priority date: 2020-12-31
Filing date: 2021-09-17
Publication date: 2022-07-07
Also published as: CN114765603A

Abstract

Embodiments of the present disclosure provides a screen sharing method for mobile terminals. The method comprises: a first mobile terminal defines a session name field of session header information in a first SIP INVITE message as a specific value; the first mobile terminal sends a screen sharing request to a second mobile terminal; when the first mobile terminal receives an indication of receiving screen sharing returned from the second mobile terminal, the first mobile terminal records interface content of the first mobile terminal, and encodes the recorded content into a video stream; and the first mobile terminal sends the video stream to the second mobile terminal to perform screen sharing.

Description

Screen sharing method of mobile terminal, mobile terminal and storage medium

CROSS-REFERENCE TO RELATED APPLICATIONS

The present disclosure is based on Chinese patent application CN202011635623.8 filed on December 31, 2020, entitled "Screen Sharing Method for Mobile Terminal and Mobile Terminal and Storage Medium", and claims the priority of this patent application, all of which are incorporated by reference. The disclosure is fully incorporated into this disclosure.

technical field

The embodiments of the present disclosure relate to the field of communications, and in particular, to a screen sharing method for a mobile terminal, a mobile terminal, and a storage medium.

Background technique

In the prior art, in the process of realizing screen sharing of mobile terminals, it is usually necessary to install the same third-party application program on two terminals, then register an account, and perform screen sharing of the mobile terminal through account search and the like.

However, the screen sharing method in the prior art needs to download an additional program and register an additional account to realize the screen sharing, and the efficiency of the screen sharing is low.

SUMMARY OF THE INVENTION

The embodiments of the present disclosure provide a screen sharing method for a mobile terminal, a mobile terminal, and a storage medium, so as to at least solve the problem of low screen sharing efficiency of the mobile terminal in the related art.

According to an embodiment of the present disclosure, a screen sharing method for a mobile terminal is provided, including: the first mobile terminal defines a session name field of session header information in a first SIP INVITE message as a specific value; the first mobile terminal described above Send a screen sharing request to the second mobile terminal, wherein the screen sharing request includes the mobile phone number on the second mobile terminal, the screen sharing request also includes the first SIP INVITE message, and the second mobile terminal receives the In the case of the above-mentioned screen sharing request, the above-mentioned first SIP INVITE message in the above-mentioned screen-sharing request is parsed, and the above-mentioned session name field of the above-mentioned session header information of the above-mentioned first SIP INVITE message is obtained, and the above-mentioned session name field is the above-mentioned specific value. Under the circumstance, it is prompted that there is an invitation for remote desktop sharing, and in the case that the above-mentioned session name field is empty, it is processed according to the default RCS video sharing business process; when the above-mentioned first mobile terminal receives the receiving screen returned by the above-mentioned second mobile terminal In the case of sharing the instruction, the first mobile terminal records the interface content of the first mobile terminal, and encodes the recorded content into a video stream; the first mobile terminal sends the video stream to the second mobile terminal to Do screen sharing.

According to another embodiment of the present disclosure, there is provided a screen sharing method for a mobile terminal, including: a second mobile terminal receiving a screen sharing request from a first mobile terminal, wherein the screen sharing request includes a screen sharing request on the second mobile terminal. mobile phone number, the above-mentioned screen sharing request also includes the first SIP INVITE message; the above-mentioned second mobile terminal parses the above-mentioned first SIP INVITE message, and the session name field of the session header information in the above-mentioned first SIP INVITE message is a specific value Under the circumstance, prompt there is an invitation for remote desktop sharing, and in the case that the above-mentioned session name field is empty, it is processed according to the default RCS video sharing service flow; the above-mentioned second mobile terminal sends an instruction to receive screen sharing to the above-mentioned first mobile terminal or an instruction to reject screen sharing; when the second mobile terminal sends the above-mentioned instruction to receive screen sharing to the first mobile terminal, the second mobile terminal receives the video stream sent by the first mobile terminal to perform screen sharing , wherein the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.

According to yet another embodiment of the present disclosure, a first mobile terminal is provided, comprising: a defining unit configured to define a session name field of session header information in a first SIP INVITE message as a specific value; a first sending unit, Set to send a screen sharing request to the second mobile terminal, wherein the above-mentioned screen sharing request includes the mobile phone number on the above-mentioned second mobile terminal, the above-mentioned screen sharing request also includes the above-mentioned first SIP INVITE message, and the above-mentioned second mobile terminal is in the In the case of receiving the above-mentioned screen sharing request, parse the above-mentioned first SIP INVITE message in the above-mentioned screen sharing request, and obtain the above-mentioned session name field of the above-mentioned session header information of the above-mentioned first SIP INVITE message, where the above-mentioned session name field is the above-mentioned session name field. In the case of a specific value, it is prompted that there is an invitation for remote desktop sharing, and when the above-mentioned session name field is empty, it is processed according to the default RCS video sharing business process; the recording unit is set to receive the above-mentioned No. In the case of receiving the screen sharing instruction returned by the second mobile terminal, record the interface content of the first mobile terminal, and encode the recorded content into a video stream; the second sending unit is set so that the first mobile terminal sends the video stream to the video stream. sent to the above-mentioned second mobile terminal for screen sharing.

According to yet another embodiment of the present disclosure, a second mobile terminal is provided, comprising: a first receiving unit configured to receive a screen sharing request from the first mobile terminal, wherein the screen sharing request includes the second mobile terminal The mobile phone number on the above-mentioned screen sharing request also includes the first SIP INVITE message; the parsing unit is set to parse the above-mentioned first SIP INVITE message, and the session name field of the session header information in the above-mentioned first SIP INVITE message is a specific In the case of value, it is prompted that there is an invitation for remote desktop sharing, and in the case that the above-mentioned session name field is empty, it is processed according to the default RCS video sharing business process; an instruction to instruct or reject screen sharing; the second receiving unit is configured to receive the video stream sent by the first mobile terminal when the second mobile terminal sends the instruction to receive the screen sharing to the first mobile terminal, to Screen sharing is performed, wherein the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.

According to yet another embodiment of the present disclosure, a computer-readable storage medium is also provided, where a computer program is stored in the computer-readable storage medium, wherein the computer program is configured to execute any one of the above method embodiments when running steps in .

According to yet another embodiment of the present disclosure, an electronic device is also provided, including a memory and a processor, the memory stores a computer program, and the processor is configured to run the computer program to execute any of the above method embodiments steps in .

Description of drawings

1 is a block diagram of a hardware structure of a mobile terminal according to a screen sharing method for a mobile terminal according to an embodiment of the present disclosure;

2 is a flowchart of a screen sharing method of a mobile terminal according to an embodiment of the present disclosure;

3 is a flowchart of another screen sharing method of a mobile terminal according to an embodiment of the present disclosure;

FIG. 4 is a flowchart of still another screen sharing method of a mobile terminal according to an embodiment of the present disclosure;

5 is an interactive schematic diagram of a screen sharing method of a mobile terminal according to an embodiment of the present disclosure;

6 is a schematic structural diagram of a first mobile terminal according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of a second mobile terminal according to an embodiment of the present disclosure.

Detailed ways

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings and in conjunction with the embodiments.

It should be noted that the terms "first", "second" and the like in the description and claims of the present disclosure and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence.

The method embodiments provided in the embodiments of this application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking running on a mobile terminal as an example, FIG. 1 is a block diagram of a hardware structure of a mobile terminal according to a screen sharing method for a mobile terminal according to an embodiment of the present disclosure. As shown in FIG. 1 , the mobile terminal may include one or more (only one is shown in FIG. 1 ) processor 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 configured to store data, wherein the above-mentioned mobile terminal may further include a transmission device 106 and an input/output device 108 configured as a communication function. Those of ordinary skill in the art can understand that the structure shown in FIG. 1 is only a schematic diagram, which does not limit the structure of the above-mentioned mobile terminal. For example, the mobile terminal may also include more or fewer components than those shown in FIG. 1 , or have a different configuration than that shown in FIG. 1 .

The memory 104 may be configured to store computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the screen sharing method of the mobile terminal in the embodiment of the present disclosure. The processor 102 runs the computer programs stored in the memory 104 , so as to perform various functional applications and data processing, that is, to implement the above method. Memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory located remotely from the processor 102, and these remote memories may be connected to the mobile terminal through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

Transmission means 106 are arranged to receive or transmit data via a network. The specific example of the above-mentioned network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, NIC for short), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 may be a radio frequency (Radio Frequency, RF for short) module, which is configured to communicate with the Internet in a wireless manner.

This embodiment provides a screen sharing method for a mobile terminal. FIG. 2 is a flowchart of a screen sharing method for a mobile terminal according to an embodiment of the present disclosure. As shown in FIG. 2 , the process includes the following steps:

S202, the first mobile terminal defines the session name field of the session header information in the first SIP INVITE message as a specific value;

S204, the first mobile terminal sends a screen sharing request to the second mobile terminal, wherein the screen sharing request includes the mobile phone number of the second mobile terminal, and the screen sharing request also includes the first SIP INVITE message, in the case of receiving the screen sharing request, the second mobile terminal parses the first SIP INVITE message in the screen sharing request, and obtains the meeting of the first SIP INVITE message. The session name field of the session header information, in the case that the session name field is the specific value, prompts an invitation for remote desktop sharing, and in the case that the session name field is empty, the default RCS video sharing is performed. business process processing;

S206, in the case that the first mobile terminal receives the instruction of receiving screen sharing returned by the second mobile terminal, the first mobile terminal records the interface content of the first mobile terminal, and records the recorded content encoded as a video stream;

S208, the first mobile terminal sends the video stream to the second mobile terminal for screen sharing.

Optionally, the above-mentioned method for screen sharing of mobile terminals may be applied, but not limited to, in the process of sharing screens between mobile terminals. The first mobile terminal may be a terminal that shares a screen, and the second mobile terminal is a terminal that displays the screen of the first mobile terminal. If the first mobile terminal initiates a screen sharing request to the second mobile terminal, the screen sharing request may be directly sent to the second mobile terminal through the mobile phone number of the second mobile terminal. If the second mobile terminal agrees to perform screen sharing, the first mobile terminal records the interface content of the first mobile terminal and shares it with the second mobile terminal. The second mobile terminal can display the interface content shared by the first mobile terminal, and operate the interface content, then the interface of the first mobile terminal performs corresponding processing according to the operation of the second mobile terminal, so as to realize the The screen is shared to the second mobile terminal.

Through the above embodiment, when the screen sharing of the mobile terminal is performed, the first mobile terminal can directly initiate a screen sharing request to the second mobile terminal through the mobile phone number of the second mobile terminal, and use the first SIP INVITE message to carry this The secondary request is the identifier of the screen sharing request, thereby realizing the effect of rapid screen sharing. Therefore, the problem of low screen sharing efficiency of the mobile terminal can be solved, and the effect of improving the screen sharing efficiency of the mobile terminal can be achieved.

As an optional example, the method further includes:

In the case of receiving the pause instruction sent by the second mobile terminal, the first mobile terminal pauses recording the interface content, or the first mobile terminal pauses sending the video to the second mobile terminal flow.

As an optional example, during the screen sharing process, the method further includes:

The first mobile terminal receives the SIP UPDATE message sent by the second mobile terminal, wherein after the second mobile terminal performs a touch operation on the screen interface of the first mobile terminal, the touch operation is performed. and the touch position of the touch operation is filled into a specific field of the SIP UPDATE message;

The first mobile terminal parses the SIP UPDATE message to acquire the touch operation and the touch position of the touch operation.

As an optional example, the method further includes:

establishing an instant communication session between the first mobile terminal and the second mobile terminal;

The first mobile terminal receives the session message sent by the second mobile terminal, and in the case of parsing that the session message contains a specific field, obtains the record of the second mobile terminal in the specific field. The touch operation performed on the screen interface of the first mobile terminal and the touch position of the touch operation during the screen sharing process;

The first mobile terminal forwards the touch operation and the touch position of the touch operation to the screen sharing application.

As an optional example, the method further includes:

The first mobile terminal receives the second sip invite message sent by the second mobile terminal;

The first mobile terminal parses the second sip invite message, and obtains the touch operation and the touch control performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process The touch position of the operation.

As an optional example, a screen sharing method of a mobile terminal is provided. As shown in FIG. 3 , the above method includes:

S302, the second mobile terminal receives a screen sharing request from the first mobile terminal, wherein the screen sharing request includes the mobile phone number on the second mobile terminal, and the screen sharing request further includes a first SIP INVITE message ;

S304, the second mobile terminal parses the first SIP INVITE message, and in the case that the session name field of the session header information in the first SIP INVITE message is a specific value, prompts an invitation for remote desktop sharing, and When the session name field is empty, it is processed according to the default RCS video sharing business process;

S306, the second mobile terminal sends to the first mobile terminal an indication of receiving screen sharing or an indication of rejecting screen sharing;

S308, in the case that the second mobile terminal sends the instruction for receiving screen sharing to the first mobile terminal, the second mobile terminal receives the video stream sent by the first mobile terminal to perform screen sharing , wherein the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.

As an optional example, in the process of screen sharing, the method further includes:

After the second mobile terminal performs the touch operation on the screen interface of the first mobile terminal, the touch operation and the touch position of the touch operation are filled in a specific field of the SIP UPDATE message;

The second mobile terminal sends a SIP UPDATE message to the first mobile terminal, so that the first mobile terminal parses the SIP UPDATE message to obtain the touch operation and the touch position of the touch operation.

The second mobile terminal establishes an instant communication session with the first mobile terminal;

The second mobile terminal sends a session message to the first mobile terminal, wherein the session message includes a specific field, and the specific field records the touches performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process. control operation and the touch position of the touch operation.

The second mobile terminal sends a second sip invite message to the first mobile terminal, where the second sip invite message includes touch operations and touches performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process. The touch position of the control operation.

The second mobile terminal sends a pause instruction to the first mobile terminal, so that the first mobile terminal pauses recording the interface content, or pauses sending the recording content to the second mobile terminal.

Take a concrete example to illustrate. The first mobile terminal and the second mobile terminal in the embodiments of the present application may be mobile communication terminals, and may be mobile terminals supporting a rich media communication (Rich Communication Suite, RCS for short) service. The relevant standard information of RCS is GSMA RCC.71 RCC.07

In this embodiment of the present application, the first mobile terminal and the second mobile terminal may be mobile phones. Taking a mobile phone that supports RCS as an example, mobile phone A can send a request for screen sharing to mobile phone B, and mobile phone B responds to mobile phone A to receive the sharing instruction, then mobile phone A can send the shared content to mobile phone B for display. Click on the screen content of the mobile phone A displayed on the screen, so as to control the screen content of the mobile phone A. The software part of this application is divided into 6 modules. The modules may include: m1: desktop sharing service initiator control module. M2: Desktop screen recording module. m3: Video encoding module. m4: RCS protocol parsing module. m5: Video decoding module. m6: desktop sharing service receiver control module.

m1: desktop sharing service initiator control module, this module is the user portal for initiating remote desktop sharing, and has two functions: providing an operation interface for user operations, and responding to user operations from remote mobile phones. further,

m1-1 provides the user with an input phone number and initiates the process behind remote desktop sharing. For example, an interface can be provided for the user to select a person in the address book, or enter a phone number, and then choose to initiate remote desktop sharing, or after a remote desktop sharing application is started, choose to share his desktop with the remote mobile phone .

m1-2 analyzes and processes the data information returned by the remote user operation. For example, when the user of mobile phone B clicks on the screen, mobile phone B will send a message back, and mobile phone A analyzes and processes the message and responds to the click.

m2: In the RCS video sharing service, the desktop screen recording module in this application is responsible for intercepting the screen interface of mobile phone A, and transmits the data of the content displayed on the screen to m3 for video encoding.

m3: Video encoding module, responsible for encoding the data of the content displayed on the screen into a video stream according to a specific format, such as a video encoded in H.264 format.

m4: RCS protocol parsing module. The RCS service video sharing service uses the Session Initiation Protocol (SIP for short) to establish a session with the B mobile phone. The relevant standard information of SIP is: IETF RFC 3261. A mobile phone will pass some parameters of the video sharing through the SIP invite message, and will update the session information through the SIP update message. In the embodiment of the present application, based on some optional fields in the protocol that are originally only used for manual analysis but not used for program control, the remote desktop sharing is realized by analyzing these extended fields. For example, a specific character is used to inform that the request is a request to establish screen sharing.

m5: video decoding module, mobile phone B receives the video stream sent by mobile phone A, decodes it and displays it on the screen.

m6: desktop sharing service receiver control module, this module is responsible for receiving the interface display and user operation screen (such as touching the menu on the screen interface) event, and returning the event to A mobile phone.

The specific steps may be as shown in steps S401 to S415 of the flowchart 4 .

In the flowchart 4, S401: User A operates the mobile phone of A, and selects the number of B as the target to start the process of the remote desktop. You can directly input B's phone number, or you can find the contact from the address book and call records, and then automatically extract B's phone number as the target object. A clear desktop sharing operation menu is provided on the interface for users to choose and start the process of remote desktop.

S402: A mobile phone sends an RCS video sharing service session invitation message to B mobile phone. In the message, the session name field of the session header information in the SIP INVITE is defined as a specific value, which is used to indicate that it is a special RCS video sharing service—remote desktop sharing business.

In the RCS service protocol, the session name field of the SIP INVITE message is not processed and is set to be empty by default, that is:

"s="

In this embodiment, as an implementation case, it is set as "DesktopShare", that is, "s=DesktopShare"

S402: The mobile phone B receives the RCS video sharing service session invitation message of A, and S404, the mobile phone B parses the session name line in the message header to determine whether it is a remote desktop sharing service. If the name is a specific value of the implementation agreement, such as "s=DesktopShare", it indicates that it is a remote desktop sharing service, S405-1, the mobile phone B prompts the user on the screen that there is an invitation for remote desktop sharing, waiting for the user to operate. If this name is empty, S405-2, it is processed according to the default RCS video sharing business process.

S406: The user of the mobile phone B touches the screen and accepts the invitation, and the mobile phone B replies with an answering message to the mobile phone A.

S407: After the mobile phone A receives the reply message from the mobile phone B, the RCS video sharing session is established, and the mobile phone A enters the remote desktop sharing state. Mobile phone A starts to record the screen, encodes it into a video stream in the session negotiation format, and sends it to mobile phone B. further,

S407-1, the remote sharing status of mobile phone A, which means that the front-end interface of mobile phone A will have a status prompt and a control entry to exit this status, and the background will start to enter the screen recording and video encoding status;

S407-2, the frame rate of the screen recording can be set by the user according to the content shared on the desktop to ensure a better user experience. For example, if you want to provide the desktop of mobile phone A to mobile phone B to control mobile phone A, then the interface of mobile phone A will not change too fast, you can record and encode the screen according to the frame rate of 15fps; and if it is a shared game, according to the game video frame rate for screen recording and encoding.

S407-3, the resolution parameter of video coding adopts the parameter determined in the session negotiation between A mobile phone and B mobile phone.

S408: Mobile phone B receives the video sent by mobile phone A, and displays it on the screen according to the interface design of remote desktop sharing. further,

S408-1, remote desktop sharing, mobile phone A sends the screen recording of its own mobile phone, that is, the full-screen image displayed on the screen of mobile phone A, although it is a video stream compiled according to the resolution negotiated in the session, and sent to mobile phone B Still need to make a suitable display area according to B mobile phone screen.

In S408-2, the mobile phone B must be able to completely display the desktop image of the mobile phone A.

So far, based on the RCS video sharing service, mobile phone A sends the image of its own screen to mobile phone B for display in real time.

S409, the user operates on the mobile phone B, and in the step of S408, the screen of the mobile phone B displays the full screen interface on the screen of the mobile phone A. For example, if you click the screen, the program will judge the location area of the contact, and do different processing according to the area. As shown in Figure 5. In Figure 5, mobile phone A sends a full-screen image to mobile phone B, and mobile phone B displays the screen shared by mobile phone A. Click to form a contact (solid dot) on the screen shared by A's mobile phone on B's mobile phone, and the position of the point needs to be transmitted to A's mobile phone.

S410, if the touch point is within the full screen area of the mobile phone A, it is interpreted as an operation on the mobile phone A. S411-1 records the position coordinates of the touch point on the screen, and processes and packages the touch event of the user to A mobile phone. The parameter information of the touch event includes the event type and the position coordinates. The position coordinates of the touch point on the screen of mobile phone B should be combined with the position area of the full-screen image of mobile phone A on the screen of mobile phone B, and further converted into the relative position ratio of the touch point on the full-screen image of mobile phone A. Further, it is assumed that the coordinates of the solid point contact of the mobile phone B in Figure 5 are (540, 1500) in B, and the full-screen image of A in the screen area of B is the upper left corner (0, 100) and the lower right corner (1080, 2020), Then the coordinates of this contact on screen A need to subtract an offset of 100 to become (440,1500). Considering the difference in screen resolution between A and B, there is also a scaling ratio to consider. Therefore, in order to accurately locate the position of the touch point on screen A, a scale value is used for this touch point, x=0.407 (ie 440/1080) and y=0.781 (ie 1500/1920).

Further, the types of touch events of the user on the screen include click, double-click, long-press, drag, etc., which are exactly the same as the general touch event definitions of Android mobile phones/Iphone mobile phones/winphone mobile phones.

S411-2, if the touch point is outside the full-screen screen area of the mobile phone A, it is interpreted as not an operation on the mobile phone A, and processing is performed according to the current interface touch of the mobile phone B.

S412, the mobile phone B sends the user operation event to the mobile phone A. Further, there are multiple ways to send a message back to A:

Using the session update message, the user operation event is filled into the specific field of the SIP UPDATE message, and the session update cancellation request of the RCS service is sent to the A mobile phone. In the RCS service framework, after a session is established, A or B mobile phone is allowed to send a session update message. Moreover, the answering party can refuse the session update. When the receiving party refuses the session update, the current session will not be affected in any way. Taking advantage of this feature, two extended attributes are defined in the media information of the UPDATE message. The former indicates the type of a remote user operation event, and the latter indicates the coordinates of the touch point. Examples are as follows:

a=remote_action click

a=0.407/0.781

In the RCS service, multiple sessions are allowed to be established between users at the same time, and a real-time chat session is established while the video sharing service is established, so that the wrapped user operation events can be sent by using the chat session. When A receives the chat information data, it parses out the user operation time for remote desktop sharing according to the specific field information, and then forwards the event to the remote sharing application for processing.

Use the sip invite message of the RCS service to initiate a session invitation message again, and encapsulate the user operation time into the data field of the message and return it to A.

S413, the mobile phone A receives the SIP UPDATE message, and needs to parse the description information of the message. When the two pieces of information newly added in S8 are parsed, it knows that this is a user's remote click operation on the mobile phone A, and the user operates The event information is saved.

S414, the mobile phone A further parses the user operation event, replaces the corresponding coordinates transmitted by the SIP UPDATE message with the real coordinates on the current screen, and responds to this event according to the current application interface.

S415, A mobile phone sends a response message of the session update request to B mobile phone, and rejects the session update request initiated by B mobile phone. Preferably, according to the definition of the SIP protocol, the response message of 48x can be selected. This type of message will not affect the current session, so it will not initiate a session update, nor will it have any impact on the current session.

Through the above steps, it is realized that the mobile phone A sends its desktop to the mobile phone B, and the user's operation on the mobile phone B can respond on the mobile phone A.

The advantage of the above embodiment is that users can directly initiate a desktop sharing service based on mobile phone numbers, which greatly reduces the threshold for remote desktops between users. Between ordinary users, it can be initiated and used at any time.

Moreover, the present application is based on the framework of the RCS service, the RCS is a service to be supported by the 5G terminal by default, and the mobile terminal must support its basic protocol by default. Therefore, the technical difficulty of complex mobility management can be omitted, and it is easy to implement on the terminal; at the same time, the method can help operators increase new business scenarios and increase revenue without the need to transform the network.

From the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present disclosure essentially or the parts that contribute to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to enable a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of the various embodiments of the present disclosure.

In this embodiment, a first mobile terminal is also provided, and the device is used to implement the above-mentioned embodiments and preferred implementations, and what has been described will not be repeated. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, implementations in hardware, or a combination of software and hardware, are also possible and contemplated.

FIG. 6 is a first mobile terminal according to an embodiment of the present application, as shown in FIG. 6 , including:

A definition unit 602 is set to define the session name field of the session header information in the first SIP INVITE message as a specific value;

The first sending unit 604 is configured to send a screen sharing request to the second mobile terminal, wherein the screen sharing request includes the mobile phone number on the second mobile terminal, and the screen sharing request also includes the first SIP INVITE message, in the case of receiving the screen sharing request, the second mobile terminal parses the first SIP INVITE message in the screen sharing request, and obtains all the information of the first SIP INVITE message. The session name field of the session header information, in the case that the session name field is the specific value, prompts an invitation to share the remote desktop, in the case that the session name field is empty, according to the default RCS Video sharing business process processing;

The recording unit 606 is configured to record the interface content of the first mobile terminal when the first mobile terminal receives an instruction to receive screen sharing returned by the second mobile terminal, and encode the recorded content as video stream;

The second sending unit 608 is configured for the first mobile terminal to send the video stream to the second mobile terminal for screen sharing.

As an optional example, the first mobile terminal further includes:

a processing unit configured to, in the process of screen sharing, in the case of receiving a pause instruction sent by the second mobile terminal, the first mobile terminal to pause the recording of the interface content, or the first mobile terminal Suspend sending the video stream to the second mobile terminal.

As an optional example, the first mobile terminal further includes:

The first receiving unit is configured to receive a SIP UPDATE message sent by the second mobile terminal during the screen sharing process, wherein the second mobile terminal is performing touch on the screen interface of the first mobile terminal. After the control operation, fill the touch operation and the touch position of the touch operation into a specific field of the SIP UPDATE message;

The first parsing unit is configured to parse the SIP UPDATE message to obtain the touch operation and the touch position of the touch operation.

As an optional example, the first mobile terminal further includes:

an establishment unit, configured to establish an instant communication session with the second mobile terminal during the screen sharing process;

The second receiving unit is configured to receive the session message sent by the second mobile terminal, and obtain the second mobile terminal recorded in the specific field when it is parsed that the session message contains a specific field a touch operation performed on the screen interface of the first mobile terminal and a touch position of the touch operation during the screen sharing;

A forwarding unit, configured to forward the touch operation and the touch position of the touch operation to the screen sharing application.

As an optional example, the first mobile terminal further includes:

The third receiving unit is configured to receive the second sip invite message sent by the second mobile terminal during the screen sharing process;

A second parsing unit, configured to parse the second sip invite message, to obtain the touch operation and the touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process. The touch position of the control operation.

For other examples of this embodiment, please refer to the foregoing examples, and details are not described herein again.

FIG. 7 is another first mobile terminal according to an embodiment of the present application, as shown in FIG. 7 , including:

The first receiving unit 702 is configured to receive a screen sharing request from a first mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes a first SIP INVITE message;

The parsing unit 704 is configured to parse the first SIP INVITE message, and in the case that the session name field of the session header information in the first SIP INVITE message is a specific value, prompting an invitation for remote desktop sharing, and in the If the session name field is empty, follow the default RCS video sharing business process;

A sending unit 706, configured to send an indication of receiving screen sharing or an indication of rejecting screen sharing to the first mobile terminal;

The second receiving unit 708 is configured to receive the video stream sent by the first mobile terminal to perform screen sharing when the second mobile terminal sends the instruction for receiving screen sharing to the first mobile terminal , wherein the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.

As an optional example, the second mobile terminal further includes:

The filling unit is configured to fill the touch operation and the touch position of the touch operation into the SIP UPDATE message after the second mobile terminal performs the touch operation on the screen interface of the first mobile terminal during the screen sharing process. in a specific field;

The second sending unit is configured to send the SIP UPDATE message to the first mobile terminal, so that the first mobile terminal parses the SIP UPDATE message to obtain the touch operation and the touch position of the touch operation.

As an optional example, the second mobile terminal further includes:

a establishing unit, configured to establish an instant communication session with the first mobile terminal during the screen sharing process;

The third sending unit is configured to send a session message to the first mobile terminal, wherein the session message includes a specific field, and the specific field records the screen interface of the second mobile terminal to the first mobile terminal during the screen sharing process The touch operation performed and the touch position of the touch operation.

As an optional example, the second mobile terminal further includes:

The fourth sending unit is configured to send a second sip invite message to the first mobile terminal in the process of screen sharing, wherein the second sip invite message includes the second mobile terminal in the process of screen sharing to the first mobile terminal. The touch operation performed on the screen interface of the terminal and the touch position of the touch operation.

As an optional example, the second mobile terminal further includes:

The fifth sending unit is configured to, during the screen sharing process, the second mobile terminal sends a pause instruction to the first mobile terminal, so that the first mobile terminal suspends recording the interface content, or suspends sending the recording content to the second mobile terminal.

Embodiments of the present disclosure also provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, wherein the computer program is configured to execute the steps in any one of the above method embodiments when running.

In an exemplary embodiment, the above-mentioned computer-readable storage medium may include, but is not limited to, a USB flash drive, a read-only memory (Read-Only Memory, referred to as ROM for short), and a random access memory (Random Access Memory, referred to as RAM for short) , mobile hard disk, magnetic disk or CD-ROM and other media that can store computer programs.

An embodiment of the present disclosure also provides an electronic device, including a memory and a processor, where a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

In an exemplary embodiment, the above-mentioned electronic device may further include a transmission device and an input-output device, wherein the transmission device is connected to the above-mentioned processor, and the input-output device is connected to the above-mentioned processor.

For specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments and exemplary implementation manners, and details are not described herein again in this embodiment.

Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the present disclosure can be implemented by a general-purpose computing device, and they can be centralized on a single computing device or distributed in a network composed of multiple computing devices On the other hand, they can be implemented in program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, can be performed in a different order than shown here. Or the described steps, or they are respectively made into individual integrated circuit modules, or a plurality of modules or steps in them are made into a single integrated circuit module to realize. As such, the present disclosure is not limited to any particular combination of hardware and software.

The above descriptions are only preferred embodiments of the present disclosure, and are not intended to limit the present disclosure. For those skilled in the art, the present disclosure may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the principles of the present disclosure shall be included within the protection scope of the present disclosure.

Claims

A screen sharing method of a mobile terminal, comprising:

The first mobile terminal defines the session name field of the session header information in the first SIP INVITE message as a specific value;

The first mobile terminal sends a screen sharing request to the second mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request further includes the first SIP INVITE message, the second mobile terminal, when receiving the screen sharing request, parses the first SIP INVITE message in the screen sharing request, and obtains the meeting of the first SIP INVITE message. The session name field of the session header information, in the case that the session name field is the specific value, prompts an invitation for remote desktop sharing, and in the case that the session name field is empty, the default RCS video sharing is performed. business process processing;

In the case that the first mobile terminal receives the instruction of receiving screen sharing returned by the second mobile terminal, the first mobile terminal records the interface content of the first mobile terminal, and encodes the recorded content as video stream;

The first mobile terminal sends the video stream to the second mobile terminal for screen sharing.
The method according to claim 1, wherein, in the process of screen sharing, the method further comprises:

In the case of receiving the pause instruction sent by the second mobile terminal, the first mobile terminal pauses recording the interface content, or the first mobile terminal pauses sending the video to the second mobile terminal flow.
The method according to claim 1, wherein, in the process of the screen sharing, the method further comprises:

The first mobile terminal receives the SIP UPDATE message sent by the second mobile terminal, wherein after the second mobile terminal performs a touch operation on the screen interface of the first mobile terminal, the touch operation is performed. and the touch position of the touch operation is filled into a specific field of the SIP UPDATE message;

The first mobile terminal parses the SIP UPDATE message to acquire the touch operation and the touch position of the touch operation.
The method according to claim 1, wherein, in the process of the screen sharing, the method further comprises:

establishing an instant communication session between the first mobile terminal and the second mobile terminal;

The first mobile terminal receives the session message sent by the second mobile terminal, and in the case of parsing that the session message contains a specific field, obtains the record of the second mobile terminal in the specific field. The touch operation performed on the screen interface of the first mobile terminal and the touch position of the touch operation during the screen sharing process;

The first mobile terminal forwards the touch operation and the touch position of the touch operation to the screen sharing application.
The method according to claim 1, wherein, in the process of the screen sharing, the method further comprises:

The first mobile terminal receives the second sip invite message sent by the second mobile terminal;

The first mobile terminal parses the second sip invite message, and obtains the touch operation and the touch control performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process The touch position of the operation.
A screen sharing method of a mobile terminal, comprising:

The second mobile terminal receives a screen sharing request from the first mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request further includes a first SIP INVITE message;

The second mobile terminal parses the first SIP INVITE message, and in the case that the session name field of the session header information in the first SIP INVITE message is a specific value, it prompts that there is an invitation for remote desktop sharing. If the session name field is empty, follow the default RCS video sharing business process;

sending, by the second mobile terminal, an indication of receiving screen sharing or an indication of rejecting screen sharing to the first mobile terminal;

In the case where the second mobile terminal sends the indication of receiving screen sharing to the first mobile terminal, the second mobile terminal receives the video stream sent by the first mobile terminal for screen sharing, wherein , the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.
A first mobile terminal, comprising:

A definition unit, configured to define the session name field of the session header information in the first SIP INVITE message as a specific value;

a first sending unit configured to send a screen sharing request to a second mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request further includes the first SIP INVITE message, in the case of receiving the screen sharing request, the second mobile terminal parses the first SIP INVITE message in the screen sharing request to obtain the information of the first SIP INVITE message The session name field of the session header information, in the case that the session name field is the specific value, prompts an invitation for remote desktop sharing, and in the case that the session name field is empty, according to the default RCS video Shared business process processing;

a recording unit, configured to record the interface content of the first mobile terminal when the first mobile terminal receives an instruction to receive screen sharing returned by the second mobile terminal, and encode the recorded content into a video flow;

The second sending unit is configured to send the video stream to the second mobile terminal by the first mobile terminal for screen sharing.
A second mobile terminal, comprising:

A first receiving unit, configured to receive a screen sharing request from a first mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes a first SIP INVITE information;

A parsing unit, configured to parse the first SIP INVITE message, and in the case that the session name field of the session header information in the first SIP INVITE message is a specific value, prompting an invitation for remote desktop sharing, and in the session If the name field is empty, it is processed according to the default RCS video sharing business process;

a sending unit, configured to send an indication of receiving screen sharing or an indication of rejecting screen sharing to the first mobile terminal;

a second receiving unit, configured to receive a video stream sent by the first mobile terminal to perform screen sharing when the second mobile terminal sends the instruction to receive the screen sharing to the first mobile terminal, The video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.
A computer-readable storage medium storing a computer program, wherein the computer program implements the steps of the method described in any one of claims 1 to 5 when the computer program is executed by a processor , or implement the steps of the method recited in claim 6 .
An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, when the processor executes the computer program, any one of claims 1 to 5 is implemented The steps of the method recited in claim 6, or the steps of implementing the method recited in claim 6.