WO2022142492A1 - Procédé de partage d'écran pour des terminaux mobiles, terminal mobile et support de stockage - Google Patents

Procédé de partage d'écran pour des terminaux mobiles, terminal mobile et support de stockage Download PDF

Info

Publication number
WO2022142492A1
WO2022142492A1 PCT/CN2021/119143 CN2021119143W WO2022142492A1 WO 2022142492 A1 WO2022142492 A1 WO 2022142492A1 CN 2021119143 W CN2021119143 W CN 2021119143W WO 2022142492 A1 WO2022142492 A1 WO 2022142492A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile terminal
screen sharing
screen
session
sip invite
Prior art date
Application number
PCT/CN2021/119143
Other languages
English (en)
Chinese (zh)
Inventor
肖其虎
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2022142492A1 publication Critical patent/WO2022142492A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04L51/046—Interoperability with other network applications or services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1083—In-session procedures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725—Cordless telephones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/24—Systems for the transmission of television signals using pulse code modulation

Definitions

  • the embodiments of the present disclosure relate to the field of communications, and in particular, to a screen sharing method for a mobile terminal, a mobile terminal, and a storage medium.
  • the screen sharing method in the prior art needs to download an additional program and register an additional account to realize the screen sharing, and the efficiency of the screen sharing is low.
  • the embodiments of the present disclosure provide a screen sharing method for a mobile terminal, a mobile terminal, and a storage medium, so as to at least solve the problem of low screen sharing efficiency of the mobile terminal in the related art.
  • a screen sharing method for a mobile terminal including: the first mobile terminal defines a session name field of session header information in a first SIP INVITE message as a specific value; the first mobile terminal described above Send a screen sharing request to the second mobile terminal, wherein the screen sharing request includes the mobile phone number on the second mobile terminal, the screen sharing request also includes the first SIP INVITE message, and the second mobile terminal receives the
  • the above-mentioned first SIP INVITE message in the above-mentioned screen-sharing request is parsed, and the above-mentioned session name field of the above-mentioned session header information of the above-mentioned first SIP INVITE message is obtained, and the above-mentioned session name field is the above-mentioned specific value.
  • the first mobile terminal records the interface content of the first mobile terminal, and encodes the recorded content into a video stream; the first mobile terminal sends the video stream to the second mobile terminal to Do screen sharing.
  • a screen sharing method for a mobile terminal including: a second mobile terminal receiving a screen sharing request from a first mobile terminal, wherein the screen sharing request includes a screen sharing request on the second mobile terminal.
  • mobile phone number the above-mentioned screen sharing request also includes the first SIP INVITE message;
  • the above-mentioned second mobile terminal parses the above-mentioned first SIP INVITE message, and the session name field of the session header information in the above-mentioned first SIP INVITE message is a specific value
  • prompt there is an invitation for remote desktop sharing and in the case that the above-mentioned session name field is empty, it is processed according to the default RCS video sharing service flow;
  • the above-mentioned second mobile terminal sends an instruction to receive screen sharing to the above-mentioned first mobile terminal or an instruction to reject screen sharing; when the second mobile terminal sends the above-mentioned instruction to receive screen sharing to the first mobile terminal, the second mobile terminal
  • a first mobile terminal comprising: a defining unit configured to define a session name field of session header information in a first SIP INVITE message as a specific value; a first sending unit, Set to send a screen sharing request to the second mobile terminal, wherein the above-mentioned screen sharing request includes the mobile phone number on the above-mentioned second mobile terminal, the above-mentioned screen sharing request also includes the above-mentioned first SIP INVITE message, and the above-mentioned second mobile terminal is in the In the case of receiving the above-mentioned screen sharing request, parse the above-mentioned first SIP INVITE message in the above-mentioned screen sharing request, and obtain the above-mentioned session name field of the above-mentioned session header information of the above-mentioned first SIP INVITE message, where the above-mentioned session name field is the above-mentioned session name field.
  • the recording unit is set to receive the above-mentioned No.
  • the second sending unit is set so that the first mobile terminal sends the video stream to the video stream. sent to the above-mentioned second mobile terminal for screen sharing.
  • a second mobile terminal comprising: a first receiving unit configured to receive a screen sharing request from the first mobile terminal, wherein the screen sharing request includes the second mobile terminal
  • the mobile phone number on the above-mentioned screen sharing request also includes the first SIP INVITE message
  • the parsing unit is set to parse the above-mentioned first SIP INVITE message, and the session name field of the session header information in the above-mentioned first SIP INVITE message is a specific In the case of value, it is prompted that there is an invitation for remote desktop sharing, and in the case that the above-mentioned session name field is empty, it is processed according to the default RCS video sharing business process; an instruction to instruct or reject screen sharing;
  • the second receiving unit is configured to receive the video stream sent by the first mobile terminal when the second mobile terminal sends the instruction to receive the screen sharing to the first mobile terminal, to Screen sharing is performed, wherein the video stream is obtained by recording the interface content of the first mobile terminal by the
  • a computer-readable storage medium is also provided, where a computer program is stored in the computer-readable storage medium, wherein the computer program is configured to execute any one of the above method embodiments when running steps in .
  • an electronic device including a memory and a processor, the memory stores a computer program, and the processor is configured to run the computer program to execute any of the above method embodiments steps in .
  • FIG. 1 is a block diagram of a hardware structure of a mobile terminal according to a screen sharing method for a mobile terminal according to an embodiment of the present disclosure
  • FIG. 2 is a flowchart of a screen sharing method of a mobile terminal according to an embodiment of the present disclosure
  • FIG. 3 is a flowchart of another screen sharing method of a mobile terminal according to an embodiment of the present disclosure
  • FIG. 4 is a flowchart of still another screen sharing method of a mobile terminal according to an embodiment of the present disclosure
  • FIG. 5 is an interactive schematic diagram of a screen sharing method of a mobile terminal according to an embodiment of the present disclosure
  • FIG. 6 is a schematic structural diagram of a first mobile terminal according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic structural diagram of a second mobile terminal according to an embodiment of the present disclosure.
  • FIG. 1 is a block diagram of a hardware structure of a mobile terminal according to a screen sharing method for a mobile terminal according to an embodiment of the present disclosure.
  • the mobile terminal may include one or more (only one is shown in FIG.
  • processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 configured to store data, wherein the above-mentioned mobile terminal may further include a transmission device 106 and an input/output device 108 configured as a communication function.
  • a processing device such as a microprocessor MCU or a programmable logic device FPGA
  • a memory 104 configured to store data
  • the above-mentioned mobile terminal may further include a transmission device 106 and an input/output device 108 configured as a communication function.
  • FIG. 1 is only a schematic diagram, which does not limit the structure of the above-mentioned mobile terminal.
  • the mobile terminal may also include more or fewer components than those shown in FIG. 1 , or have a different configuration than that shown in FIG. 1 .
  • the memory 104 may be configured to store computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the screen sharing method of the mobile terminal in the embodiment of the present disclosure.
  • the processor 102 runs the computer programs stored in the memory 104 , so as to perform various functional applications and data processing, that is, to implement the above method.
  • Memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.
  • the memory 104 may further include memory located remotely from the processor 102, and these remote memories may be connected to the mobile terminal through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
  • Transmission means 106 are arranged to receive or transmit data via a network.
  • the specific example of the above-mentioned network may include a wireless network provided by a communication provider of the mobile terminal.
  • the transmission device 106 includes a network adapter (Network Interface Controller, NIC for short), which can be connected to other network devices through a base station so as to communicate with the Internet.
  • the transmission device 106 may be a radio frequency (Radio Frequency, RF for short) module, which is configured to communicate with the Internet in a wireless manner.
  • RF Radio Frequency
  • FIG. 2 is a flowchart of a screen sharing method for a mobile terminal according to an embodiment of the present disclosure. As shown in FIG. 2 , the process includes the following steps:
  • the first mobile terminal defines the session name field of the session header information in the first SIP INVITE message as a specific value
  • the first mobile terminal sends a screen sharing request to the second mobile terminal, wherein the screen sharing request includes the mobile phone number of the second mobile terminal, and the screen sharing request also includes the first SIP INVITE message, in the case of receiving the screen sharing request, the second mobile terminal parses the first SIP INVITE message in the screen sharing request, and obtains the meeting of the first SIP INVITE message.
  • the session name field of the session header information in the case that the session name field is the specific value, prompts an invitation for remote desktop sharing, and in the case that the session name field is empty, the default RCS video sharing is performed. business process processing;
  • the first mobile terminal in the case that the first mobile terminal receives the instruction of receiving screen sharing returned by the second mobile terminal, the first mobile terminal records the interface content of the first mobile terminal, and records the recorded content encoded as a video stream;
  • the first mobile terminal sends the video stream to the second mobile terminal for screen sharing.
  • the above-mentioned method for screen sharing of mobile terminals may be applied, but not limited to, in the process of sharing screens between mobile terminals.
  • the first mobile terminal may be a terminal that shares a screen
  • the second mobile terminal is a terminal that displays the screen of the first mobile terminal. If the first mobile terminal initiates a screen sharing request to the second mobile terminal, the screen sharing request may be directly sent to the second mobile terminal through the mobile phone number of the second mobile terminal. If the second mobile terminal agrees to perform screen sharing, the first mobile terminal records the interface content of the first mobile terminal and shares it with the second mobile terminal.
  • the second mobile terminal can display the interface content shared by the first mobile terminal, and operate the interface content, then the interface of the first mobile terminal performs corresponding processing according to the operation of the second mobile terminal, so as to realize the The screen is shared to the second mobile terminal.
  • the first mobile terminal when the screen sharing of the mobile terminal is performed, the first mobile terminal can directly initiate a screen sharing request to the second mobile terminal through the mobile phone number of the second mobile terminal, and use the first SIP INVITE message to carry this
  • the secondary request is the identifier of the screen sharing request, thereby realizing the effect of rapid screen sharing. Therefore, the problem of low screen sharing efficiency of the mobile terminal can be solved, and the effect of improving the screen sharing efficiency of the mobile terminal can be achieved.
  • the method further includes:
  • the first mobile terminal In the case of receiving the pause instruction sent by the second mobile terminal, the first mobile terminal pauses recording the interface content, or the first mobile terminal pauses sending the video to the second mobile terminal flow.
  • the method further includes:
  • the first mobile terminal receives the SIP UPDATE message sent by the second mobile terminal, wherein after the second mobile terminal performs a touch operation on the screen interface of the first mobile terminal, the touch operation is performed. and the touch position of the touch operation is filled into a specific field of the SIP UPDATE message;
  • the first mobile terminal parses the SIP UPDATE message to acquire the touch operation and the touch position of the touch operation.
  • the method further includes:
  • the first mobile terminal receives the session message sent by the second mobile terminal, and in the case of parsing that the session message contains a specific field, obtains the record of the second mobile terminal in the specific field.
  • the touch operation performed on the screen interface of the first mobile terminal and the touch position of the touch operation during the screen sharing process;
  • the first mobile terminal forwards the touch operation and the touch position of the touch operation to the screen sharing application.
  • the method further includes:
  • the first mobile terminal receives the second sip invite message sent by the second mobile terminal;
  • the first mobile terminal parses the second sip invite message, and obtains the touch operation and the touch control performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process The touch position of the operation.
  • a screen sharing method of a mobile terminal includes:
  • the second mobile terminal receives a screen sharing request from the first mobile terminal, wherein the screen sharing request includes the mobile phone number on the second mobile terminal, and the screen sharing request further includes a first SIP INVITE message ;
  • the second mobile terminal parses the first SIP INVITE message, and in the case that the session name field of the session header information in the first SIP INVITE message is a specific value, prompts an invitation for remote desktop sharing, and When the session name field is empty, it is processed according to the default RCS video sharing business process;
  • the second mobile terminal sends to the first mobile terminal an indication of receiving screen sharing or an indication of rejecting screen sharing;
  • the second mobile terminal in the case that the second mobile terminal sends the instruction for receiving screen sharing to the first mobile terminal, the second mobile terminal receives the video stream sent by the first mobile terminal to perform screen sharing , wherein the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.
  • the method further includes:
  • the touch operation and the touch position of the touch operation are filled in a specific field of the SIP UPDATE message;
  • the second mobile terminal sends a SIP UPDATE message to the first mobile terminal, so that the first mobile terminal parses the SIP UPDATE message to obtain the touch operation and the touch position of the touch operation.
  • the method further includes:
  • the second mobile terminal establishes an instant communication session with the first mobile terminal
  • the second mobile terminal sends a session message to the first mobile terminal, wherein the session message includes a specific field, and the specific field records the touches performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process. control operation and the touch position of the touch operation.
  • the method further includes:
  • the second mobile terminal sends a second sip invite message to the first mobile terminal, where the second sip invite message includes touch operations and touches performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process.
  • the touch position of the control operation is not limited to:
  • the method further includes:
  • the second mobile terminal sends a pause instruction to the first mobile terminal, so that the first mobile terminal pauses recording the interface content, or pauses sending the recording content to the second mobile terminal.
  • the first mobile terminal and the second mobile terminal in the embodiments of the present application may be mobile communication terminals, and may be mobile terminals supporting a rich media communication (Rich Communication Suite, RCS for short) service.
  • RCS Rich media communication
  • the relevant standard information of RCS is GSMA RCC.71 RCC.07
  • the first mobile terminal and the second mobile terminal may be mobile phones.
  • mobile phone A can send a request for screen sharing to mobile phone B, and mobile phone B responds to mobile phone A to receive the sharing instruction, then mobile phone A can send the shared content to mobile phone B for display. Click on the screen content of the mobile phone A displayed on the screen, so as to control the screen content of the mobile phone A.
  • the software part of this application is divided into 6 modules.
  • the modules may include: m1: desktop sharing service initiator control module.
  • M2 Desktop screen recording module.
  • m3 Video encoding module.
  • m4 RCS protocol parsing module.
  • m5 Video decoding module.
  • m6 desktop sharing service receiver control module.
  • m1 desktop sharing service initiator control module
  • this module is the user portal for initiating remote desktop sharing, and has two functions: providing an operation interface for user operations, and responding to user operations from remote mobile phones.
  • m1-1 provides the user with an input phone number and initiates the process behind remote desktop sharing.
  • an interface can be provided for the user to select a person in the address book, or enter a phone number, and then choose to initiate remote desktop sharing, or after a remote desktop sharing application is started, choose to share his desktop with the remote mobile phone .
  • m1-2 analyzes and processes the data information returned by the remote user operation. For example, when the user of mobile phone B clicks on the screen, mobile phone B will send a message back, and mobile phone A analyzes and processes the message and responds to the click.
  • the desktop screen recording module in this application is responsible for intercepting the screen interface of mobile phone A, and transmits the data of the content displayed on the screen to m3 for video encoding.
  • Video encoding module responsible for encoding the data of the content displayed on the screen into a video stream according to a specific format, such as a video encoded in H.264 format.
  • the RCS service video sharing service uses the Session Initiation Protocol (SIP for short) to establish a session with the B mobile phone.
  • SIP Session Initiation Protocol
  • the relevant standard information of SIP is: IETF RFC 3261.
  • a mobile phone will pass some parameters of the video sharing through the SIP invite message, and will update the session information through the SIP update message.
  • the remote desktop sharing is realized by analyzing these extended fields. For example, a specific character is used to inform that the request is a request to establish screen sharing.
  • m5 video decoding module
  • mobile phone B receives the video stream sent by mobile phone A, decodes it and displays it on the screen.
  • m6 desktop sharing service receiver control module, this module is responsible for receiving the interface display and user operation screen (such as touching the menu on the screen interface) event, and returning the event to A mobile phone.
  • steps S401 to S415 of the flowchart 4 The specific steps may be as shown in steps S401 to S415 of the flowchart 4 .
  • S401 User A operates the mobile phone of A, and selects the number of B as the target to start the process of the remote desktop. You can directly input B's phone number, or you can find the contact from the address book and call records, and then automatically extract B's phone number as the target object.
  • a clear desktop sharing operation menu is provided on the interface for users to choose and start the process of remote desktop.
  • S402 A mobile phone sends an RCS video sharing service session invitation message to B mobile phone.
  • the session name field of the session header information in the SIP INVITE is defined as a specific value, which is used to indicate that it is a special RCS video sharing service—remote desktop sharing business.
  • the session name field of the SIP INVITE message is not processed and is set to be empty by default, that is:
  • S406 The user of the mobile phone B touches the screen and accepts the invitation, and the mobile phone B replies with an answering message to the mobile phone A.
  • the frame rate of the screen recording can be set by the user according to the content shared on the desktop to ensure a better user experience. For example, if you want to provide the desktop of mobile phone A to mobile phone B to control mobile phone A, then the interface of mobile phone A will not change too fast, you can record and encode the screen according to the frame rate of 15fps; and if it is a shared game, according to the game video frame rate for screen recording and encoding.
  • the resolution parameter of video coding adopts the parameter determined in the session negotiation between A mobile phone and B mobile phone.
  • Mobile phone B receives the video sent by mobile phone A, and displays it on the screen according to the interface design of remote desktop sharing. Further,
  • mobile phone A sends the screen recording of its own mobile phone, that is, the full-screen image displayed on the screen of mobile phone A, although it is a video stream compiled according to the resolution negotiated in the session, and sent to mobile phone B Still need to make a suitable display area according to B mobile phone screen.
  • the mobile phone B In S408-2, the mobile phone B must be able to completely display the desktop image of the mobile phone A.
  • mobile phone A sends the image of its own screen to mobile phone B for display in real time.
  • the user operates on the mobile phone B, and in the step of S408, the screen of the mobile phone B displays the full screen interface on the screen of the mobile phone A.
  • the program will judge the location area of the contact, and do different processing according to the area.
  • mobile phone A sends a full-screen image to mobile phone B, and mobile phone B displays the screen shared by mobile phone A. Click to form a contact (solid dot) on the screen shared by A's mobile phone on B's mobile phone, and the position of the point needs to be transmitted to A's mobile phone.
  • S410 if the touch point is within the full screen area of the mobile phone A, it is interpreted as an operation on the mobile phone A.
  • S411-1 records the position coordinates of the touch point on the screen, and processes and packages the touch event of the user to A mobile phone.
  • the parameter information of the touch event includes the event type and the position coordinates.
  • the position coordinates of the touch point on the screen of mobile phone B should be combined with the position area of the full-screen image of mobile phone A on the screen of mobile phone B, and further converted into the relative position ratio of the touch point on the full-screen image of mobile phone A.
  • touch events of the user on the screen include click, double-click, long-press, drag, etc., which are exactly the same as the general touch event definitions of Android mobile phones/Iphone mobile phones/winphone mobile phones.
  • the mobile phone B sends the user operation event to the mobile phone A. Further, there are multiple ways to send a message back to A:
  • the user operation event is filled into the specific field of the SIP UPDATE message, and the session update cancellation request of the RCS service is sent to the A mobile phone.
  • a or B mobile phone is allowed to send a session update message.
  • the answering party can refuse the session update.
  • the receiving party refuses the session update, the current session will not be affected in any way.
  • two extended attributes are defined in the media information of the UPDATE message. The former indicates the type of a remote user operation event, and the latter indicates the coordinates of the touch point. Examples are as follows:
  • RCS service multiple sessions are allowed to be established between users at the same time, and a real-time chat session is established while the video sharing service is established, so that the wrapped user operation events can be sent by using the chat session.
  • A receives the chat information data, it parses out the user operation time for remote desktop sharing according to the specific field information, and then forwards the event to the remote sharing application for processing.
  • the mobile phone A receives the SIP UPDATE message, and needs to parse the description information of the message.
  • the two pieces of information newly added in S8 are parsed, it knows that this is a user's remote click operation on the mobile phone A, and the user operates The event information is saved.
  • the mobile phone A further parses the user operation event, replaces the corresponding coordinates transmitted by the SIP UPDATE message with the real coordinates on the current screen, and responds to this event according to the current application interface.
  • a mobile phone sends a response message of the session update request to B mobile phone, and rejects the session update request initiated by B mobile phone.
  • the response message of 48x can be selected. This type of message will not affect the current session, so it will not initiate a session update, nor will it have any impact on the current session.
  • the mobile phone A sends its desktop to the mobile phone B, and the user's operation on the mobile phone B can respond on the mobile phone A.
  • the advantage of the above embodiment is that users can directly initiate a desktop sharing service based on mobile phone numbers, which greatly reduces the threshold for remote desktops between users. Between ordinary users, it can be initiated and used at any time.
  • the present application is based on the framework of the RCS service, the RCS is a service to be supported by the 5G terminal by default, and the mobile terminal must support its basic protocol by default. Therefore, the technical difficulty of complex mobility management can be omitted, and it is easy to implement on the terminal; at the same time, the method can help operators increase new business scenarios and increase revenue without the need to transform the network.
  • a first mobile terminal is also provided, and the device is used to implement the above-mentioned embodiments and preferred implementations, and what has been described will not be repeated.
  • the term "module” may be a combination of software and/or hardware that implements a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, implementations in hardware, or a combination of software and hardware, are also possible and contemplated.
  • FIG. 6 is a first mobile terminal according to an embodiment of the present application, as shown in FIG. 6 , including:
  • a definition unit 602 is set to define the session name field of the session header information in the first SIP INVITE message as a specific value
  • the first sending unit 604 is configured to send a screen sharing request to the second mobile terminal, wherein the screen sharing request includes the mobile phone number on the second mobile terminal, and the screen sharing request also includes the first SIP INVITE message, in the case of receiving the screen sharing request, the second mobile terminal parses the first SIP INVITE message in the screen sharing request, and obtains all the information of the first SIP INVITE message.
  • the session name field of the session header information in the case that the session name field is the specific value, prompts an invitation to share the remote desktop, in the case that the session name field is empty, according to the default RCS Video sharing business process processing;
  • the recording unit 606 is configured to record the interface content of the first mobile terminal when the first mobile terminal receives an instruction to receive screen sharing returned by the second mobile terminal, and encode the recorded content as video stream;
  • the second sending unit 608 is configured for the first mobile terminal to send the video stream to the second mobile terminal for screen sharing.
  • the first mobile terminal further includes:
  • a processing unit configured to, in the process of screen sharing, in the case of receiving a pause instruction sent by the second mobile terminal, the first mobile terminal to pause the recording of the interface content, or the first mobile terminal Suspend sending the video stream to the second mobile terminal.
  • the first mobile terminal further includes:
  • the first receiving unit is configured to receive a SIP UPDATE message sent by the second mobile terminal during the screen sharing process, wherein the second mobile terminal is performing touch on the screen interface of the first mobile terminal. After the control operation, fill the touch operation and the touch position of the touch operation into a specific field of the SIP UPDATE message;
  • the first parsing unit is configured to parse the SIP UPDATE message to obtain the touch operation and the touch position of the touch operation.
  • the first mobile terminal further includes:
  • an establishment unit configured to establish an instant communication session with the second mobile terminal during the screen sharing process
  • the second receiving unit is configured to receive the session message sent by the second mobile terminal, and obtain the second mobile terminal recorded in the specific field when it is parsed that the session message contains a specific field a touch operation performed on the screen interface of the first mobile terminal and a touch position of the touch operation during the screen sharing;
  • a forwarding unit configured to forward the touch operation and the touch position of the touch operation to the screen sharing application.
  • the first mobile terminal further includes:
  • the third receiving unit is configured to receive the second sip invite message sent by the second mobile terminal during the screen sharing process
  • a second parsing unit configured to parse the second sip invite message, to obtain the touch operation and the touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process.
  • the touch position of the control operation is configured to parse the second sip invite message, to obtain the touch operation and the touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process.
  • FIG. 7 is another first mobile terminal according to an embodiment of the present application, as shown in FIG. 7 , including:
  • the first receiving unit 702 is configured to receive a screen sharing request from a first mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes a first SIP INVITE message;
  • the parsing unit 704 is configured to parse the first SIP INVITE message, and in the case that the session name field of the session header information in the first SIP INVITE message is a specific value, prompting an invitation for remote desktop sharing, and in the If the session name field is empty, follow the default RCS video sharing business process;
  • a sending unit 706, configured to send an indication of receiving screen sharing or an indication of rejecting screen sharing to the first mobile terminal
  • the second receiving unit 708 is configured to receive the video stream sent by the first mobile terminal to perform screen sharing when the second mobile terminal sends the instruction for receiving screen sharing to the first mobile terminal , wherein the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.
  • the second mobile terminal further includes:
  • the filling unit is configured to fill the touch operation and the touch position of the touch operation into the SIP UPDATE message after the second mobile terminal performs the touch operation on the screen interface of the first mobile terminal during the screen sharing process. in a specific field;
  • the second sending unit is configured to send the SIP UPDATE message to the first mobile terminal, so that the first mobile terminal parses the SIP UPDATE message to obtain the touch operation and the touch position of the touch operation.
  • the second mobile terminal further includes:
  • a establishing unit configured to establish an instant communication session with the first mobile terminal during the screen sharing process
  • the third sending unit is configured to send a session message to the first mobile terminal, wherein the session message includes a specific field, and the specific field records the screen interface of the second mobile terminal to the first mobile terminal during the screen sharing process The touch operation performed and the touch position of the touch operation.
  • the second mobile terminal further includes:
  • the fourth sending unit is configured to send a second sip invite message to the first mobile terminal in the process of screen sharing, wherein the second sip invite message includes the second mobile terminal in the process of screen sharing to the first mobile terminal.
  • the touch operation performed on the screen interface of the terminal and the touch position of the touch operation.
  • the second mobile terminal further includes:
  • the fifth sending unit is configured to, during the screen sharing process, the second mobile terminal sends a pause instruction to the first mobile terminal, so that the first mobile terminal suspends recording the interface content, or suspends sending the recording content to the second mobile terminal.
  • Embodiments of the present disclosure also provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, wherein the computer program is configured to execute the steps in any one of the above method embodiments when running.
  • the above-mentioned computer-readable storage medium may include, but is not limited to, a USB flash drive, a read-only memory (Read-Only Memory, referred to as ROM for short), and a random access memory (Random Access Memory, referred to as RAM for short) , mobile hard disk, magnetic disk or CD-ROM and other media that can store computer programs.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • An embodiment of the present disclosure also provides an electronic device, including a memory and a processor, where a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.
  • the above-mentioned electronic device may further include a transmission device and an input-output device, wherein the transmission device is connected to the above-mentioned processor, and the input-output device is connected to the above-mentioned processor.
  • modules or steps of the present disclosure can be implemented by a general-purpose computing device, and they can be centralized on a single computing device or distributed in a network composed of multiple computing devices
  • they can be implemented in program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, can be performed in a different order than shown here.
  • the described steps, or they are respectively made into individual integrated circuit modules, or a plurality of modules or steps in them are made into a single integrated circuit module to realize.
  • the present disclosure is not limited to any particular combination of hardware and software.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Telephonic Communication Services (AREA)
  • Telephone Function (AREA)

Abstract

Des modes de réalisation de la présente divulgation concernent un procédé de partage d'écran pour des terminaux mobiles. Le procédé comprend : la définition, par un premier terminal mobile, d'un champ de nom de session d'informations d'en-tête de session dans un premier message SIP INVITE en tant que valeur spécifique; l'envoi, par le premier terminal mobile, d'une demande de partage d'écran à un second terminal mobile; lorsque le premier terminal mobile reçoit une indication de réception d'un partage d'écran renvoyée par le second terminal mobile, l'enregistrement, par le premier terminal mobile, d'un contenu d'interface du premier terminal mobile et le codage du contenu enregistré dans un flux vidéo; et l'envoi, par le premier terminal mobile, du flux vidéo au second terminal mobile pour réaliser un partage d'écran.
PCT/CN2021/119143 2020-12-31 2021-09-17 Procédé de partage d'écran pour des terminaux mobiles, terminal mobile et support de stockage WO2022142492A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011635623.8 2020-12-31
CN202011635623.8A CN114765603A (zh) 2020-12-31 2020-12-31 移动终端的屏幕共享方法和移动终端及存储介质

Publications (1)

Publication Number Publication Date
WO2022142492A1 true WO2022142492A1 (fr) 2022-07-07

Family

ID=82258986

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/119143 WO2022142492A1 (fr) 2020-12-31 2021-09-17 Procédé de partage d'écran pour des terminaux mobiles, terminal mobile et support de stockage

Country Status (2)

Country Link
CN (1) CN114765603A (fr)
WO (1) WO2022142492A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115484086A (zh) * 2022-09-07 2022-12-16 中移互联网有限公司 云手机屏幕共享方法及电子设备、计算机可读存储介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009138004A1 (fr) * 2008-05-14 2009-11-19 华为技术有限公司 Procédé, dispositif et système destinés à réaliser un tableau blanc électronique dans une conférence audio/vidéo
CN101674110A (zh) * 2009-10-21 2010-03-17 中兴通讯股份有限公司 一种实现移动终端桌面共享和控制的方法及移动终端
WO2010135876A1 (fr) * 2009-05-27 2010-12-02 中兴通讯股份有限公司 Système et procédé de mise en oeuvre de conférence avec tableau blanc électronique sur la base de l'architecture du sous-système multimédia ip
US20140108568A1 (en) * 2011-03-29 2014-04-17 Ti Square Technology Ltd. Method and System for Providing Multimedia Content Sharing Service While Conducting Communication Service
CN104836852A (zh) * 2015-04-22 2015-08-12 深圳市邦彦信息技术有限公司 一种多联屏桌面共享的方法及系统
CN105472100A (zh) * 2014-08-15 2016-04-06 中兴通讯股份有限公司 桌面共享的方法及终端
CN110691102A (zh) * 2019-10-29 2020-01-14 维沃移动通信有限公司 一种信息共享方法及电子设备、服务器
CN111314903A (zh) * 2020-02-14 2020-06-19 维沃移动通信有限公司 一种信息共享方法及电子设备

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009138004A1 (fr) * 2008-05-14 2009-11-19 华为技术有限公司 Procédé, dispositif et système destinés à réaliser un tableau blanc électronique dans une conférence audio/vidéo
WO2010135876A1 (fr) * 2009-05-27 2010-12-02 中兴通讯股份有限公司 Système et procédé de mise en oeuvre de conférence avec tableau blanc électronique sur la base de l'architecture du sous-système multimédia ip
CN101674110A (zh) * 2009-10-21 2010-03-17 中兴通讯股份有限公司 一种实现移动终端桌面共享和控制的方法及移动终端
US20140108568A1 (en) * 2011-03-29 2014-04-17 Ti Square Technology Ltd. Method and System for Providing Multimedia Content Sharing Service While Conducting Communication Service
CN103748610A (zh) * 2011-03-29 2014-04-23 Ti广场技术株式会社 用于在进行通信服务的同时提供多媒体内容共享服务的方法和系统
CN105472100A (zh) * 2014-08-15 2016-04-06 中兴通讯股份有限公司 桌面共享的方法及终端
CN104836852A (zh) * 2015-04-22 2015-08-12 深圳市邦彦信息技术有限公司 一种多联屏桌面共享的方法及系统
CN110691102A (zh) * 2019-10-29 2020-01-14 维沃移动通信有限公司 一种信息共享方法及电子设备、服务器
CN111314903A (zh) * 2020-02-14 2020-06-19 维沃移动通信有限公司 一种信息共享方法及电子设备

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115484086A (zh) * 2022-09-07 2022-12-16 中移互联网有限公司 云手机屏幕共享方法及电子设备、计算机可读存储介质
CN115484086B (zh) * 2022-09-07 2023-10-27 中移互联网有限公司 云手机屏幕共享方法及电子设备、计算机可读存储介质

Also Published As

Publication number Publication date
CN114765603A (zh) 2022-07-19

Similar Documents

Publication Publication Date Title
WO2020220840A1 (fr) Procédé de connexion de réseau à un même écran, appareil, dispositif intelligent et support de stockage
EP3952265B1 (fr) Procédé et dispositif de traitement d'appel
CN110891123B (zh) 交互信息传输方法及装置
US20140293997A1 (en) Method, Apparatus, and System for Implementing VOIP Call in Cloud Computing Environment
CN105706410B (zh) 用于交换服务能力的方法和用户设备
US11050801B2 (en) Call to meeting upgrade
CN107786415B (zh) 一种业务处理方法及相关设备与系统
WO2022142492A1 (fr) Procédé de partage d'écran pour des terminaux mobiles, terminal mobile et support de stockage
CN113473395B (zh) 消息处理方法、装置、介质及电子设备
US20160226933A1 (en) Method and device for communicating between at least a first terminal and a second terminal
US10542054B2 (en) Device and method for providing mobile internet call service
CN110650254B (zh) 信息的发送方法、信息的接收方法、终端及存储介质
US9049310B2 (en) Data communication
CN112866253B (zh) 信息传输方法、装置、电子设备
CN116346988A (zh) 接收来电的方法和装置
CN113766630A (zh) Ims网络注册方法、装置及电子设备
CN110505070A (zh) 一种三方会话的建立方法及装置
WO2024067309A1 (fr) Procédé et appareil de traitement de guidage de position, support de stockage et appareil électronique
WO2023011476A1 (fr) Procédé de communication, procédé d'établissement de canal de données, dispositif, et support de stockage
WO2023011024A1 (fr) Procédé de notification d'appel malveillant, terminal, dispositif électronique et support de stockage
WO2023087925A1 (fr) Procédé de télécommunication, dispositif électronique et support de stockage
JP6731977B2 (ja) 情報処理システム、情報処理システムの制御方法、及び、情報処理システムの制御プログラム
US20210185170A1 (en) Media display control method and related product
WO2020029824A1 (fr) Procédé, dispositif et système d'invite d'appel entrant
CN117014552A (zh) 一种基于视频彩铃进行元宇宙场景互动的方法及相关设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21913238

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21913238

Country of ref document: EP

Kind code of ref document: A1